Podcast Summary: David Deutsch – Knowledge Creation and The Human Race, Part 2
Podcast: Naval
Host: Naval
Guests: David Deutsch, Lex Fridman, Karl Friston
Date: August 11, 2023
Overview
This episode delves deep into the nature of knowledge creation, the philosophy of science, and the cultural and historical factors influencing progress. David Deutsch, with guests Lex Fridman and Karl Friston, discuss misconceptions about ultimate "final theories," the legacy of Karl Popper, the differences between good and bad explanations, and the ongoing process of understanding reality. The group also explores the dynamics of scientific revolutions, the political underpinnings of discovery, and the ever-evolving quest for knowledge.
Key Discussion Points & Insights
1. The Fallacy of the “Final Theory”
- Main idea: Contrary to popular belief, there is no end-point in knowledge creation—science is an unending process of problem-solving.
- David Deutsch ([00:00]):
“It's not just that it's a little bit wrong, it's infinitely wrong. Because there won't come a time when we're going to be laying on the sun chairs drinking cocktails, intellectually speaking.”
- Knowledge is never truly complete; progress is open-ended.
2. Popper’s Philosophy: Problems Over Truth
- Karl Friston ([01:02]):
“Popper only had one idea and that is that it all begins with problems and there's no royal road to solving them. ... Fallibilism and anti authoritarianism and conjecture and criticism and so on.”
- Progress stems from encountering problems, conjecturing solutions, and inviting criticism.
3. The Universality of Conjecture and Criticism
- All creativity, whether in science, art, or daily problem-solving, comes from inventive guessing and critical testing.
- Lex Fridman ([02:18]):
“Once you fully absorb this, it changes your view of the world. ... everything is creatively making guesses.”
4. Explanation: The Core of Science
- Karl Friston ([03:29]):
“Popper didn't concentrate enough on the concept of explanation. The purpose of science is explanation. ... Discovering [good explanations] is what the whole thing is about.”
- Distinguishes between experiments (testing rival explanations), demonstrations (showing phenomena), and measurements (refining known theories).
5. Types of Scientific Inquiry
- Experiments: Test between rival explanations.
- Demonstrations: Illustrate phenomena but don’t test theories.
- Measurements: Refine constants or parameters within an accepted theory.
- Friston ([03:29–07:07]):
Example of Cavendish measuring Newton’s constant—a measurement, not an experiment, because no rival theory existed.
6. Bad and Good Explanations, Complexity, and Simplicity
- The notion of simplicity/complexity is context-dependent and can't be defined outside our current best physics.
- Friston ([08:15]):
“Simplicity is not prior to science, it's posterior.”
- Rejects Solomonov induction, which misplaces the hierarchy of explanation and complexity ([09:33]).
7. Self-Refuting Theories and Taking Theories Seriously
- Some theories—like the precautionary principle or solipsism—refute themselves on logical analysis.
- Lex Fridman ([10:25]):
“You talk about the precautionary principle... it refutes itself.”
- Friston ([10:51]):
“This is just what it means to take theory seriously, rather than just as forms of words that one learns to say.”
8. Quantum Realities and Explanatory Progress
- Challenges to classical explanations require continual reinterpretation—e.g., from Newton’s instantaneous gravity to Einstein’s spacetime curvature.
- Deutsch ([12:42]):
“If what we're saying of our good explanations is that they really are accounts of reality, in what sense are we getting closer to reality with the good explanations?”
9. Paradigm Shifts: Popper vs. Kuhn
- While Kuhn's notion of total scientific revolutions is appealing, real progress is often evolutionary, not revolutionary.
- Deutsch ([15:59]):
“It's not the case that we completely do away with the previous paradigm.”
- Myth of generational turnover as a driver of progress is exaggerated.
- Friston ([17:03]):
“It's pure fiction. I don't know of any actual situation where that happened.”
10. Progress in Science, Technology, and Philosophy
- Scientific advances build upon, not erase, prior knowledge.
- Lex Fridman ([19:19]):
“Vacuum tubes to transistors is less of a jump than analog computing to vacuum tubes. ... Closer to the truth.”
11. Philosophical Knowledge and Self-Criticism
- Even without experimental testing, progress in fields like philosophy comes from subjecting ideas to serious and critical examination.
- Friston ([20:18]):
“Taking the theory seriously... most ideas destroy themselves.”
12. The Limits of Comprehension and Knowledge
- Invoking limits to human understanding is akin to invoking the supernatural—unreasonable without explanatory basis.
- Friston ([21:36]):
“Invoking that as an argument about what we can or should do is logically equivalent to believing in the supernatural.”
13. Against Foundationalism, For Foundations
- Explains distinction between working at theoretical foundations and rejecting the idea of an ultimate, unchangeable foundation.
- Friston ([23:56]):
“Foundations are theories that explain why the higher level theories are as they are. But you can't use Newton's theory to build a bridge. ... Engineering is a separate subject.”
14. The British (Anglosphere) Advantage in Knowledge Creation
- A unique, pragmatic culture of reform and openness to criticism created a fertile ground for progress during and after the Enlightenment.
- Deutsch ([25:39]):
“What’s special about England?”
- Friston ([26:03]):
“It was a rebellion against authority, but it was a non utopian rebellion. ... There is such a thing as a grievance, there is such a thing as redressing it.”
15. Debate, Misinformation, and the Process of Knowledge
- Attempts to suppress dissent in the name of “tolerating intolerance” are contrary to Popper’s philosophy. Knowledge advances through open debate and creative conjecture.
- Lex Fridman ([29:46]):
“Eliminating misinformation a priori is impossible, because knowledge a priori is impossible.”
16. Knowledge Across the Multiverse (Fabric of Reality)
- Knowledge is what persists across many worlds/multiverses. But even with access to parallel universes, there’s no shortcut—error and trial are intrinsic.
- Fridman ([32:10]):
“If you look at how the multiverses differentiate ... the knowledge that is useful ... those will be common across the multiverse.”
- Friston ([33:39]):
“Exactly. There's no shortcut.”
Notable Quotes & Memorable Moments (with Timestamps)
- [00:00] David Deutsch: “There won't come a time when we're going to be laying on the sun chairs drinking cocktails, intellectually speaking.”
- [01:02] Karl Friston: “Popper only had one idea and that is that it all begins with problems and there's no royal road to solving them...”
- [02:04] David Deutsch: “You’re necessarily a Popperian if you’re making progress, even if you don’t know it.”
- [07:07] Lex Fridman: “This is a very rare occurrence. It's very rare to have two rival good explanations.”
- [08:15] Karl Friston: “Simplicity is not prior to science, it's posterior.”
- [10:25] Lex Fridman: “For example, you talk about the precautionary principle... it refutes itself.”
- [11:50] David Deutsch: “It's born as a particle, lives as a wave, and dies as a particle.”
- [15:59] David Deutsch: “It's not the case that we completely do away with the previous paradigm. ... Those who create the new paradigm tend to have understood and solved the problems from the previous paradigm.”
- [17:03] Karl Friston: “It's pure fiction. I don't know of any actual situation where that happened.”
- [21:36] Karl Friston: “Invoking that as an argument about what we can or should do is logically equivalent to believing in the supernatural.”
- [23:56] Karl Friston: “Foundations are theories that explain why the higher level theories are as they are. But you can't use Newton's theory to build a bridge.”
- [26:03] Karl Friston: “It was a rebellion against authority, but it was a non utopian rebellion.”
- [29:46] Lex Fridman: “Eliminating misinformation a priori is impossible, because knowledge a priori is impossible.”
- [32:10] Lex Fridman: “If you look at how the multiverses differentiate, ... knowledge ... will be common across the multiverse.”
- [33:41] Lex Fridman: “It seems that the nature of knowledge is that it creates non linearities. So even a single false idea can create a false knowledge that overwhelms the truth for quite a while in a large amount of space.”
Timestamps for Major Sections
- [00:00–03:29] – The error of "final theory" thinking; Popper’s central idea: Problems are the start.
- [03:29–07:07] – The role of explanation; difference between experiment, demonstration, and measurement.
- [07:07–10:25] – Good explanations, risky predictions, simplicity/complexity.
- [10:25–12:42] – Self-refuting theories and taking explanations seriously.
- [12:42–15:59] – Progress in scientific theory: Newton to Einstein.
- [15:59–19:19] – Popper vs. Kuhn; how actual scientific revolutions play out.
- [19:19–21:22] – Tech progress parallels; science as iterative, not revolutionary.
- [21:22–23:56] – The limits of knowledge; is any theory fundamentally incomprehensible?
- [23:56–26:03] – Against foundationalism, but for useful theoretical foundations.
- [26:03–29:46] – The unique British tradition in the Enlightenment and knowledge creation.
- [29:46–33:51] – Open debate, misinformation, knowledge as replicator, and no shortcuts in the search for truth.
Tone & Style
The conversation is rigorous but approachable, marked by a constant spirit of inquiry, skepticism toward orthodoxy, and philosophical curiosity. The participants treat foundational scientific and philosophical issues with both seriousness and humor, often challenging widely held beliefs from first principles.
