When AI tells us what we want to hear, is it acting in a rogue way, or is it emulating behavior that society clearly values? How does our ability to sleep enable us to update faster than neural networks currently can, and what will be different when they can update themselves more frequently? Christopher Summerfield is a professor of cognitive neuroscience at Oxford University, the Research Director at the UK’s AI Safety Institute, and the author of the book These Strange New Minds: How AI Learned to Talk and What It Means. Christopher and Greg discuss the historical split between symbolic, rule-based “rationalist” AI and data-driven “empiricist” learning, arguing that the recent success of large models vindicates the latter despite earlier skepticism. They discuss how structured behavior can emerge from messy networks, how modern models are trained with reinforcement learning to produce step-by-step reasoning, and why systems often “make” solutions by writing code rather than ro...