The real world is filled with signals that can be used to optimize AI systems, and we need to build systems that can adapt to these signals effectively.