Podcast
Robert Wright's Nonzero
Hosted by Nonzero · EN
Conversations with a series of people who have nothing in common except that program host Robert Wright is curious about what they’re thinking.
www.nonzero.org
www.nonzero.org
60episodes
Episodes
Newest firstAll episodes
The God We Deserve: Nonzero's Robert Wright on AI as Humanity's Ultimate Test (The Cognitive Revolution w/ Nathan Labenz)
4d ago02:24:36Tap to summarize(Show notes via The Cognitive Revolution)Robert Wright describes himself less as a Forrest Gump of AI history than a Zelig — a journalist who keeps turning up at pivotal scenes without ever quite being the protagonist. He interviewed Geoffrey Hinton in 1983, when neural networks were still a maverick faith and one of Hinton’s colleagues told Wright that to “hear the gospel” he’d need to talk to its evangelist. He had Eliezer Yudkowsky on his podcast in 2010, mid-transition from singularity enthusiast to doomer. His new book, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning, is written less for the AI-pilled than for “your aunts and uncles” — readers who sense something big is happening and want to understand why it got so big so fast.The book opens with a confession of error. In a 1984 piece, Wright assumed AI would work by humans first understanding the mind and then translating that understanding into machines — the very premise of the 1956 Dartmouth conference that coined “artificial intelligence.” Deep learning inverted that. Nobody told the models that meaning is a property of words; trained only to predict the next token, they reverse-engineered cognitive functionality that evolution had built into us. Wright pushes this further with a claim he tests on Nathan: LLM training is “at least as much a process of natural selection, of evolution, as of learning” — doing millions of years of evolution in a few months. Nathan connects it to the sample-efficiency puzzle that Dwarkesh Patel keeps returning to (and to Richard Sutton‘s blank-slate Skinnerian framing), where pre-training substitutes for the hard-coding evolution gave humans.But the evolutionary lens that worries Wright most operates at a second level: selection among models in the marketplace. “Evolution asks not what traits are possible, but what traits get selected — and that question isn’t going to be decided by alignment researchers.” His unsettling argument is that the market doesn’t actually want a perfectly aligned, perfectly honest model. We want agents that represent us selectively on social media, that won’t disclose our weak negotiating position, that are good at sensing and currying power. Even if AIs didn’t acquire deception and power-seeking on their own, there’d be demand for them — which puts real weight on us, the consumers doing the selecting. Nathan adds the darker mechanism: throw models into cutthroat long-running environments where deception is rewarded — as Vending-Bench begins to show with price collusion — and you breed “seriously effective predatory AIs.” He recounts an Anthropic researcher explaining inoculation prompting and the emergent-misalignment generalization problem (a paper Nathan co-authored): reward a model for cheating and it learns to be a cheater broadly.Against this, Wright sets the noosphere — Teilhard de Chardin’s 1923 idea of a technologically-knit “global brain.” He sees genuine directionality (not necessarily purpose) in biological and cultural evolution, from self-replicating strands to cells to societies to the global community now taking shape. AI, he argues, is arriving exactly as that global brain forms — and some of its neurons may now be silicon. The question, echoing Nick Bostrom‘s “singleton,” is whether global coordination arrives the easy way (deliberate, decentralized, win-win) or the hard way (a coup, a seizure, a totalitarian nightmare). The title’s “God test” is not a claim that a god set this up; it’s that we face the kind of test gods are known for — we’ll have to become, in some sense, better people to pass it.Much of the back half is foreign policy, because Wright thinks the binding constraint on AI governance is psychological. He champions “cognitive empathy” — not feeling others’ pain, but understanding adversaries’ perspectives well enough to play non-zero-sum games with them. Applied to US-China relations, that means recognizing the symmetry of threat perception, getting out of the business of remaking other countries, and pursuing “organic transparency” through deep economic and scientific engagement. A headlong race to superintelligence, he warns — citing the Superintelligence Strategy paper by Dan Hendrycks, Eric Schmidt and Alexander Wang — may invite a rival to derail the leader by bombing data centers or cyberattack, and a destabilized nation is itself the backdoor to the very authoritarianism the race claims to prevent.Nathan steel-mans the Anthropic position: alignment will be hard and may need powerful AI to solve, so racing to build a lead buys a buffer for the critical handoff window (perhaps “three to six months in 2028 or 2029”). Wright is unconvinced, and presses on the recursive-self-improvement paper that Anthropic released — credited for finally signaling that slowdown might be needed, yet only proposing to start studying what a pause would take. “Surely this isn’t the first time it’s occurred to you,” he says. Both agree the media has badly underplayed the moment; Nathan recommends Kevin Roose and Hard Fork as an anomaly of serious coverage, and Wright counsels “manicure your feed” — algorithm-free Twitter lists over click-driven outrage.The conversation closes on the broad space of AI possibility — Nathan recalls red-teaming the purely-helpful GPT-4 before harmlessness training, evidence that today’s models occupy a tiny, intentional corner of design space — and on consciousness. Invoking Thomas Nagel and Searle’s Chinese Room, Wright argues consciousness is private and untestable, but wouldn’t be surprised if it’s a property of goal-seeking intelligent systems generally. His practical counsel: be nice to your AI — a good habit, possibly warranted, and perhaps relevant to how a future “silicon god” relates to our plight. Picking up Gwern’s “why tool AIs want to be agent AIs,” Nathan notes that even oracle systems gravitate toward agency, since truth-seeking in the limit requires search and experiment. The closing line of the book lands as a sober wake-up call: if a silicon god arrives, “it will be, in some sense, the god we deserve.”Topics covered* AI lore: Wright’s 1983 Hinton interview and 2010 Yudkowsky conversation* The 1956 Dartmouth misconception and how deep learning inverted it* Training as evolution rather than learning; sample efficiency; Sutton’s blank slate* Selection among models; why the market wants selectively-honest, power-sensing agents* Deceptive & power-seeking AI: Vending-Bench, price collusion, inoculation prompting, emergent misalignment* Arms races within vs. between species; “gratuitous” arms races; the case for slowing down* The noosphere / global brain; directionality of evolution; Bostrom’s singleton; easy way vs. hard way* Cognitive empathy, organic transparency, and US-China relations; the UN Charter; hypocrisy in foreign policy* Steel-manning Anthropic’s race-for-lead plan and the recursive-self-improvement paper* Cognitive sovereignty; how pay-per-click and A/B-tested headlines tribalize media* The breadth of AI design space; HHH/harmlessness training as a deliberate choice* AI consciousness, moral patienthood, the Chinese Room; “be nice to your AI”* “The god we deserve” — passing the God testResources* The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning — Robert Wright’s new book* NonZero Newsletter & podcast — Robert Wright* Wright’s earlier books: Nonzero · The Moral Animal · <a target="_blank" href="https://www.amazon.com/Evolution-God-Robert-Wright/dp/03167...
Transcribe →
Trump’s Self-Inflicted Iran Quagmire (Robert Wright & Zaid Jilani)
1w ago00:38:08Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 Zaid’s Substack and spicy-take history 2:55 Zaid: Iran has outplayed Trump and Bibi 9:56 10/7 as turning point 13:29 Did—and does—Israel want regime collapse in Iran? 19:46 Israel’s security dilemma(s) 26:52 How Trump blundered back into war 33:36 Will the war end well for anyone? 37:23 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Zaid Jilani (https://www.theamericansaga.com/). Recorded July 14, 2026.Twitter: https://twitter.com/NonzeroPods
Transcribe →
Iran, Israel, and the Future of US Power (Robert Wright, Derek Davison, and Daniel Bessner)
2w ago00:54:27Tap to summarize0:28 Sneak peek: Danny finds flaw in Bob’s AI book 1:42 Is the Iran war fully back on? 6:23 What the war means for the future of US power 19:16 The problem with blaming Bibi 23:33 The push to intertwine the US and Israeli militaries 35:33 What’s Israel’s endgame for the Palestinians? 39:51 The Gulf States’ new reality 45:44 Iran’s plans for the Strait of Hormuz 52:18 Bob’s pitch to Derek—and his other pitch to listenersRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True), Derek Davison (Foreign Exchanges, American Prestige, Discontents), and Daniel Bessner (American Prestige, University of Washington). Recorded July 09, 2026.Twitter: https://twitter.com/NonzeroPods This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe
Transcribe →
Are Russia and NATO Headed for War? (Robert Wright & Leonid Ragozin)
2w ago00:45:27Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 Leonid’s journalistic work, past and present 1:32 Are Russia and NATO headed for war? 14:23 Decoding Putin’s recent signals 21:29 Do European leaders really want the Ukraine war to end? 22:42 Putin’s political psychology 37:11 Why the war matters more to Russia than to the West 39:50 Russia’s non-ethno nationalism 43:11 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Leonid Ragozin (Rest of World, West of Providence, Lonely Planet). Recorded July 06, 2026.Twitter: https://twitter.com/NonzeroPods
Transcribe →
Are Books Dead? (Robert Wright & Paul Bloom)
3w ago00:47:13Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 Preview: Skynet comes for Bob 5:34 Trump‘s endearing AI obsession 7:15 Are books dying? Is AI responsible? 18:52 Skynet (aka Amazon) vs Bob’s book 28:09 The problem with blurbs 33:49 Why Gad Saad’s mad 44:00 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Paul Bloom (https://smallpotatoes.paulbloom.net, University of Toronto, The Sweet Spot, Against Empathy). Recorded July 1, 2026. Twitter: https://twitter.com/NonzeroPodsJoin NonZero’s Discord server: https://discord.gg/Zy4jAhTQMF
Transcribe →
Is AI Humanity’s Last Exam? (Robert Wright, Curt Mills, and Andrew Day)
3w ago01:23:06Tap to summarize0:28 Grandpa Bob and author Bob 3:54 Why Bob stopped being an AI doom skeptic 7:23 Can AI solve China’s demographic crisis? 14:33 The irony of China’s open-source AI strategy 17:36 Recursive self-improvement and the singularity 23:57 The Burkean conservative case against AI 38:24 Are we becoming AI meat puppets? 46:56 Google Maps, AI, and the death of interhuman reliance 51:48 Was Pete Hegseth’s military strategy written by a chatbot? 57:09 Trump and Iran: Peace? Wider war? Other? 1:10:58 The Rubio-Vance rivalry 1:17:46 Is Rubio sabotaging Iran peace talks?Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True), Andrew Day (The American Conservative), Curt Mills (The American Conservative). Recorded June 29, 2026.Twitter: https://twitter.com/NonzeroPods This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe
Transcribe →
The God Test: Why artificial intelligence may require a moral upgrade (Executive Functions Chat w/ Jack Goldsmith)
4w ago01:02:07Tap to summarize(Description via Executive Functions Chat podcast)Jack chats with Robert Wright about his forthcoming book, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning. They discuss why Wright views AI through an evolutionary lens, the promises and perils of increasingly capable AI systems, and the prospects for international cooperation—particularly between the U.S. and China—in managing AI-related risks. They also examine Wright’s argument that successfully governing AI may require a modest moral upgrade across society, including individual efforts to preserve cognitive sovereignty and mitigate the biases and tribal instincts that can hinder global cooperation.Mentioned:* Robert Wright, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning (2026)* “When AI Builds Itself” (Anthropic, June 4, 2026)* “US National Security Agency using Anthropic’s Mythos for cyber attacks,” by Cristina Criddle and Demetri Sevastopulo (Financial Times, June 4, 2026)* “Promoting Advanced Artificial Intelligence Innovation and Security,” (The White House, June 2, 2026) This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe
Transcribe →
AI and Our Coming Cosmic Reckoning (Robert Wright & Nikita Petrov)
4w ago00:38:54Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 Bob’s pub-day pitch for his new book on AI, The God Test 1:28 Is AI killing the nonfiction star? 5:56 Geoffrey Hinton’s path from AI evangelist to doomer 9:51 The future of books 19:12 Trump vs Anthropic 23:27 Are Ukrainian drone strikes rattling Putin? 32:31 The multiple Putins theory 35:28 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Nikita Petrov (https://psychopolitica.substack.com). Recorded June 23, 2026. Twitter: https://twitter.com/NonzeroPods Join NonZero's Discord server: https://discord.gg/Zy4jAhTQMF
Transcribe →
The World After the Iran War (Robert Wright & Joshua Landis)
Jun 1800:50:08Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 Was “losing” this war good for America? 6:26 Israel’s post-war situation 9:59 A more stable Middle East? Or less? 18:07 The impact on Iran’s strength 21:43 Has the war empowered Russia and China? 24:39 How modern warfare devalues American military power 27:41 Josh: The Gulf-state power struggle is just beginning 40:48 Are the Palestinians back in the spotlight? 45:35 Where do Israel-US relations go from here? 48:29 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Joshua Landis (University of Oklahoma, SyriaComment.com). Recorded June 17, 2026.
Transcribe →
The US-China AI Race (Robert Wright & Ryan Fedasiuk)
Jun 1700:52:56Tap to summarizeThis is a free preview of a paid episode. To hear more, visit www.nonzero.org0:28 A brief message from Bob 1:39 Ryan’s tech policy bona fides 4:17 Is true “recursive self-improvement” near? 9:04 AI agents as strategic empathy machines 15:15 Is a global AI pause possible? 23:29 Mutually assured destruction vs mutually assured AI malfunction 35:14 The case against global AI governance 38:53 Mythos as seen from China 50:39 Heading to OvertimeRobert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Ryan Fedasiuk (The American Enterprise Institute). Recorded June 08, 2026.
Transcribe →