
Loading summary
Dwarkesh Patel
Make every get together chill this Memorial Day get up to an extra thousand dollars off select top brand appliances like LG plus get free delivery at the Home Depot Tackle pool towels and camp laundry with a large capacity washer and host in style with the fridge serving craft ice, mini craft ice, cubed ice and crushed ice. Shop Appliance Savings now through June 3rd at the Home Depot offer valid May 14th through June 3rd US only. Free delivery on appliance purchases of $998 or more. See Store Online for details. Whatever your thing, it could be anything. Canva helps you make that thing a thing. Canva is a simple online tool thing. It's a way to design, with our magic AI tool, things you can social media your thing, generate images or videos of your thing, make decks or presentations to show your thing whatever needs to be done for your thing. Canva can make it an even better and bigger thing. Canva, the thing that makes anything a thing. I've been the person who said you think the singularity is going to happen yesterday. I think it'll take five years, 10 years. And even for me, I've had to admit that the progress has been pretty fast.
Host 1 (possibly Ed or a main interviewer)
Well, I guess the broader point is, is it going to like cure cancer? At one point? Presumably it will.
Dwarkesh Patel
I think at some point it will. I mean, just think of it as more people. If civilization had 10 billion more scientists, human scientists, would we make faster progress on aging? I'm sure we would. Here's another angle. Mass surveillance. The AIs have the potential to make authoritarian societies much more sustainable and powerful than they have been in the past. A lot of the reasons that government has not been as authoritarian as it has in the past is that it's just physically not been possible. How do we make sure that humans don't get totally disenfranchised, right?
Host 1 (possibly Ed or a main interviewer)
I mean, how do we make sure?
Dwarkesh Patel
I know. I think it's a tough question.
Host 1 (possibly Ed or a main interviewer)
Dwarkesh Patel, welcome to Trigonometry.
Dwarkesh Patel
Thanks for having me.
Host 1 (possibly Ed or a main interviewer)
It's great to have you on. I actually, I was saying to you before we started, I'm a big fan of your your podcast and I listen particularly to the History episodes. But you are, you've been described as Silicon Valley's favorite podcaster and you write a lot about AI and tech, and that's actually the conversation we really want to have with you. Partly because a lot of people watching and listening to this, they've got lives, you know, family, work, etc. So they and they haven't been to California. They haven't been to San Francisco. They haven't seen that, you know, a third of the cars on the road, or 25% robots, basically, like, this is happening fast and a lot of people haven't caught up yet. And what we'd love to do is just kind of connect people like you, who really understand what's going on with a much more general audience that includes us, frankly. So, first of all, can you explain in broad brushstrokes what is happening with AI? I know it's a massive question, obviously, but do your best.
Dwarkesh Patel
Well, I can explain it very concisely. The models are getting better, and then we can be a little less concise. I think it's. You're correct to point out that there's this huge discrepancy between what people are seeing in Silicon Valley and what people are observing outside. And it's frankly because of how useful the models are becoming at certain kinds of things. So by models, I mean you've seen ChatGPT. You might have heard of things like Gemini from Google, you might have heard of Claude from Anthropic. And you might be using these models to basically do the equivalent to Google search, using it to replace sometimes a new Google search. Instead, I'm going to Type it into ChatGPT, see what chat says. What people are now using these models to do in a very powerful way is if you're a developer, some of the top developers in the world, some of the top researchers in the world, they're not writing code. They haven't touched a line of code since December. They're not looking at a text editor where you see lines of code. They're talking to the AI. They tell the AI, hey, I want a feature that does X. Can you build me a new repository or a new code base where I make a certain kind of application, a new website, even? Can you go and do research for me? So in the process of building AI, you need to do this research of, like, how do you build better algorithms? AI is getting to the point where you can just describe at a high level what you want to happen and it will go do that software engineering for you. And so to your point, the people in Silicon Valley, they're getting tremendous productivity out of these. These are people who are getting, you know, who are becoming 3x, 4x 5x more productive as a result of using these models. So far we haven't, because these models have been really good at text in, text out work. That is software engineering, software engineering. Just a file of text, really. And you can Just read every single text file. You can add more to it. AI has been amazing at that. It's been bad so far at, well, it's terrible at physical work, right? So if you're doing any kind of blue collar work, robots are just not there yet. But then even if you circumscribe it, even if you go in and look at, we're not just going to look at software engineering, we're going to look at all kinds of knowledge work, right? All kinds of work that you can do on a computer. Maybe 40% of the labor force is doing work that you can just do remote work. If Covid happens again, you can put them on Zoom and they could do their work. And AI companies now want to be able to do all of that work that requires training AIs to just be able to do anything that you can do on a computer, an AI should be able to do. And companies are saying, oh, we think we can get there in a year, maybe two years. But that I think is explaining this discrepancy in what people are seeing.
Host 1 (possibly Ed or a main interviewer)
It does. And one of the things I think is also a lot of people would have tried a model at one point to like do a Google search or, you know, sometimes people have written articles using it and it turns out that it does make at the time they tried it, quite a lot of mistakes. And people go, ah, this is all, you know, bs, it's not going to work. But the one thing I think people don't appreciate is how rapidly it's getting better. Can you talk a little bit about that?
Dwarkesh Patel
Yeah. So I'll maybe tell you a story about my own use of AI among the Silicon Valley people. I've been a sort of skeptic. I've been the person who said, you think the singularity is going to happen? Yesterday, I think it'll take five years, 10 years. By this, I mean this idea that you'll have incredibly powerful AI systems that are able to do basically anything any human being can do. And some people in Silicon Valley are just, we'll get it later this year, we'll get it in two years. And I say, no, it'll take longer. And even for me, I've had to admit that the progress has been pretty fast. And here's a story. So last year, like you guys do, I research for my podcast, Obviously I read things, but then I also Talked to these LLMs, the equivalents of ChatGPT to research for podcast, and say, last year I spent on the order of $100 on if you add up my subscription to ChatGPT and plot and whatever and Gemini. There was a week where I was prepping for two different guests, where in that prep, I just threw in a bunch of papers that are relevant to their research and a bunch of books and whatever into a folder. And I just said to an LLM, hey, help me understand all this research so I can ask the person good questions about it. And I turned on various things which make the model much more expensive. It's faster, it's smarter, you use a bigger model. And during that week, if you take my spending during that week and you turn it into a yearly spending, how much it would be if I just did that week over the course of a year, I would. I would be spending over six figures on AI spend. And I think it's possible next year I'm like, it would make sense for me to spend seven figures on this AI research for my podcast. Okay, this is just to say that it's getting to the point where I could hire an analyst, I could hire many different analysts to help me prepare for the podcast or researchers. And I'm actually realizing, no, it's more useful to hire AIs because here's things AIs can do that humans can't do. They can read 50 different papers that are in my folder that are relevant to an upcoming interview or all these books. They can read it in a second. They have all this compiled knowledge. They know about everything, right? So they don't need to get up to speed. They're incredibly easy to onboard. So you can just keep spinning up more and more AIs keep. Keep coming up with more uses for them. Okay, so for me, that's been the thing that's given me a bit of psychosis just seeing how useful they've been for interview so far. But yeah, lots of people are noticing this kind of usefulness now.
Host 2 (possibly a co-interviewer or guest contributor)
I think the thing is, is when people look a lot of the eyes and this is a question, a point that Constantine made, it's the lack of accuracy and the fact that you constantly have to fact check. I'll give you an example. I was looking at guests that we could have from America on the show, and I said to Grok, who can we have on that hasn't appeared yet and is based in America? Number one answer was Douglas Murray. Douglas Murray, I think is nearly beyond 10 times. And practically every suggestion it made is a guess that we've had on the show. So whilst I accept what you're saying, it's also riddled with mistakes and errors and to the point where I don't trust it at this point as a technology, I, I would never take something it says as red. I would always feel that I have to check it in the way that I wouldn't do with a highly competent human employee.
Host 1 (possibly Ed or a main interviewer)
Well, you know, you've seen that. I'm sure you've seen that meme where a guy wakes up in the hospital with like a scar on his stomach and he says, wait, wait, my appendix on this side. And the robot goes, okay, thank you for that feedback. Let me try again.
Dwarkesh Patel
There's a couple of things there. Just the way that people sometimes have these weird failure modes. You know, you talk to a certain kind of person and they say they just. Their mind just goes in a certain direction. AI is the way they're trained makes them do that. One way that a big thing they're trained to do is associate things. So they're. They're just like, really. They're just seeing globs of text and they see this thing is close to this thing. This. There's an important relationship there. So Grok has seen that Trigger neurometry podcast and Douglas Murray. They just seem to go together a bunch. And that bias in its mind is overriding its ability to sort of think critically about, okay, well, who have they had on? Who have they not had on? I would be curious, by the way, you should run that experiment with all the other models. I would not be surprised if the other models, if you ask the question, and I want somebody who I've not interviewed before, that they would immediately cache that. And by this point, the models are good enough to be actually giving you novel names. I don't think they'll give you names which are like, wow, that's an amazing find. I can't. I can't believe I didn't think of it or I would never have thought of that otherwise. Because they're not amazing at discovering. And this. I think humans are great at this idiosyncratic thing of like, there's this like, weird angle that I, I'm like really obsessed with that other people aren't thinking about where the models are not going to do that. They're sort of an average. But when you are preparing to interview the person, I also think they're not amazing at coming up with questions. This is a thing I have to do that you have to do. They're great at. Just like, I would have to hire. The ancient Greeks would hire one on one tutors for their pupils. And this is how you got Alexander being tutored by Aristotle. And there's something powerful about this way of learning one on one, where you can just directly ask questions and learn. And so they're amazing at just teaching you stuff because you get this one on one tutor, it notices your confusion. As soon as you have it, you can really probe at your understanding in different ways. But I take your point that, like, some of the models are not there yet on a lot of these kinds of biases that they have.
Host 2 (possibly a co-interviewer or guest contributor)
And one of the things that people are talking about a lot is AGI. Could you explain to people, basically me what AGI is, what it stands for, and why the potential is to be so transformative for our society?
Dwarkesh Patel
Yeah, maybe one way to approach this question is to think about, okay, at a very basic level, a system that is an AGI should be able to do anything that a human does. Now, I want to emphasize that current AIs are nowhere close to this. You and I can say, we can do physical work, right? We can work in a factory, we can go mow the lawn, we can pick up this cup. Robots are not good enough to do that yet. And so the fact that robotics is not there yet already means that we're far from that big definition of AGI.
Host 1 (possibly Ed or a main interviewer)
Wait, robots can't pick up a cup?
Dwarkesh Patel
They can, but they have to. My understanding is that they have to be trained in specific environments where they'll have seen this is, you know, this is what this house looks like. And I need a specific kind of cup that is, I can, I'm dexterous enough to pick up, but if you replace this with one that's more circular and is tougher to grip you and I don't need to have seen that house a hundred times to then just go in and pick it up. The robot just needs a tremendous amount of data to be flexible in these ways, or it's not flexible in those ways. So being AGI would be able to be able to learn as fast as humans, not just have that distilled knowledge. Now, the lab say, okay, fine, robotics is hard, it might take a while, but let's try something easier. We'll just do all knowledge work. And knowledge work is basically anything that you can do with a Zoom subscription and a Gmail account and Google Drive account. All this work that doesn't involve manipulating the physical world, I still think we're not there yet. There's a tremendous amount of work that has to be done even there. But this is easier because everything that happens on a computer, it's easier to feed that data into an AI, right? It's all being generated on a computer. You can run simulations, you can just run it millions and millions and millions of times. And AI is just thriving on data. The more data you have, the better it gets. This thing, this is why it's so good at software engineering, because there's all this code out there that you can train it on with the robotics. There's no equivalent of just billions of lines of code that just exist somewhere that there's not these trillions of video files of, or these, you know, it's not just video files. It has to be. The robot has to feel itself manipulating the world and seeing the effect it has. I've just described what it would, what it, what it is. Let me say what it would mean if that were achieved. If they say that 40% of the labor force is. 40% of the labor force is doing work that can be done remotely, that is on the order of tens of trillions of dollars of wages that are being paid to humans every single year to do work that can be done remotely. Currently, labs are making on the order. If you just add up all the revenues, how much money OpenAI and Anthropic and Google are making, they're making, I don't know. The numbers are keep exploding. So who knows what the most recent numbers are, but they'd say close to 40, 50 billion dollars. We're talking about an addressable market here with all knowledge work that is tens of trillions of dollars, so literally a thousand X bigger than what they're doing right now. So it explains why they're interested in it. It would also mean that a lot of people's jobs would be gone. It would also mean. It would mean a lot of things, right? It would mean it's a terrible thing in one sense, lots of people whose jobs are gone. In another sense, we can produce a lot more things. There would be all kinds of, you know, AGI would include automated scientists and researchers coming up with new ideas and new medicines and new drugs. It would mean all kinds of new products for us to enjoy. It would mean that you and I would have basically an army of extremely smart personal assistants constantly thinking about us and helping us. Okay, so that's the definition of AGI, right?
Host 1 (possibly Ed or a main interviewer)
And I guess, you know what? There is a doomerish conversation, which we're definitely going to get to, because I think it's actually the most important conversation that's happening right now. Before we get there, though, I think it's always worthwhile to show the full range. And you kind of mentioned briefly some of the upsides, but I mean, I think people don't appreciate how big the upsides will be either. And when it, when it comes to scientific research, healthcare, I mean, I, I went to the dentist the other day, they already checked, like AI does stuff when it measures your gum level relative to the last time you came in and it's all automated and blah, blah, blah, blah, blah. Some dentists don't like it. Some do. But like, that's just the very, very, very beginning, isn't it?
Dwarkesh Patel
Yeah, I think that's actually a great, like, that's, it's a great intuition pump because people are thinking about existing things.
Host 1 (possibly Ed or a main interviewer)
By the way, I love the way you said intuition prompt. Like you are already AI. Like I prompted you already talk like AI.
Dwarkesh Patel
I'm just doing a fancy of like. That's a great point. You know, let's build on that. So one thing is just like making going to the dentist more efficient, as you were saying. Another is let's replace the dentist. Why do I need to go and stand in line for three hours to basically be told, you're fine, go home. Right. If I have basically the doctor on my phone and I can talk to it and explain my specific situations and it can talk back to me and we can have a conversation. I've just saved myself a bunch of time, saved myself a bunch of money, society is better off as a result.
Host 1 (possibly Ed or a main interviewer)
But I guess the broader point is, is it going to like cure cancer at one point? Presumably it will.
Dwarkesh Patel
I think at some point it will. I'm not. Sometimes people have this idea that you get AGI and tomorrow you cure cancer. I do think, by the way, so in Silicon Valley, people are also working on all these different ideas to stop aging, to reverse aging, to cure diseases. And I think there's a huge, if you just look at the science, there's huge reasons to be optimistic. And it's also the case that AI will be pretty good at science. It just knows a ton of stuff. It's really smart. That's what's required for science. And there's a lot of things that I think we get used to that we just don't realize how bad it is as a society that this happens. If you were just living in Europe in the 14th century and half your friends are dying because of the Black Death, it would just seem normal to you. You wouldn't think this is a problem that has to be solved. That's that life expectancy is 18 years old. And if you go travel somewhere, the bandits are going to kill you. This is just what life is. And 99% of people are peasants doing backbreaking work In a similar way. I think one of the reasons people have been so bad at articulating the benefits of AI is because we're in a similar position to people before the Industrial Revolution. Thinking about, okay, what is the upside of the Industrial Revolution? What is it going to do for me? And in one sense, you can't really anticipate what future technology looks like. But in another, life expectancy increased. And the kinds of work we get to do, we get more creative, interesting, easier work. We get more material goods. As a result, we cured a bunch of diseases. I think that's going to happen. I mean, just like aging exists, right? And we take it for granted, but it's a very tragic thing that people lose their facilities and then die. This is the kind of thing that as technology progresses, AI will help progress technology. I mean, just think of it as more people. AI is just more people. And if civilization had 10 billion more scientists, human scientists, would we make faster progress on aging? I'm sure we would. And that's what AGI will be.
Host 1 (possibly Ed or a main interviewer)
If you own gold, you probably bought it for the same reason I did. Because you looked at what central banks are doing to currencies and decided you wanted something they can't print. Good reasoning. But here's the thing nobody talks about. After you make that decision, your gold is just sitting there. It's not doing anything. You're paying to store it, you're paying to insure it. And in the meantime, it earns precisely nothing. Until now. What you're about to hear is not a normal gold advert. Today's sponsor is Monetary Metals. They've figured out something that once you hear it, seems obvious. But almost nobody in the gold world is doing it. Monetary Metals connects gold owners with productive businesses, refiners, jewelers, companies that actually need physical gold. To operate. Those businesses lease your gold and pay you a yield. Not in dollars, not in pounds, in gold. So instead of your gold sitting in a vault costing you money, it's out in the real economy doing something useful. And you're earning more ounces of gold for it, up to 4% annual yield, paid in gold. If you already own gold, this is the logical next step. Visit monetary-metals.com trigonometry or click the link in the description. See how your gold can stop costing you money and start earning you more gold. That's monetary-metals.com trigonometry.
Host 2 (possibly a co-interviewer or guest contributor)
That's super interesting, particularly the medical part of it. Now we've done the positives. Let's get to the doomer conversation.
Host 1 (possibly Ed or a main interviewer)
Well, to be fair, I think there's probably positives in almost every area of human life. Actually. I don't think it's just about health. I think it's about. Like you said, you know, there are some jobs that currently need to be done that are bad for people, that are dangerous, that are harmful. Those jobs at some point will not need to be done, et cetera, et cetera. I mean, the trade off is there's no jobs, which we will talk about. But in terms of the positive benefits, on the upside, I think it's fair to say that, you know, if we're talking about the curing of cancer or slowing down aging, let's say you could pretty much take that and apply that to almost any other field of human endeavor and say there will probably be similar levels of positive transformation. Is that fair assessment?
Dwarkesh Patel
Yeah, I think one way to think about this, because it's hard to be. It's sort of weird to say, okay, we'll solve all diseases. And it's a weird. In a weird way, it doesn't really resonate with people emotionally. Despite the fact that everybody does suffer from some kind of disease, mental diseases are still diseases that are. We can biologically make some imprint on if we knew the science. Right. But here's another way to think about it. So suppose, here's a thought experiment. How much money would you have to be paid to go back to the year 1000? But you can only use that money in the year 1000. And for me, the answer is there's infinite money. There's literally no amount of money where if I could only spend it in the year 1000, my quality of life would be better in year 1000 than it is now. The goods just don't exist. And my hope is that in a future.
Host 1 (possibly Ed or a main interviewer)
Wait, what about being Genghis Khan? That would be pretty cool, right?
Dwarkesh Patel
Yeah, yeah. Although, could you buy that? I guess you enough money, you could buy your way into being Genghis Khan.
Host 1 (possibly Ed or a main interviewer)
No, you probably couldn't, actually. But I was just thinking, I mean, there are some people in history where you go like, they had it pretty good.
Dwarkesh Patel
Yeah.
Host 1 (possibly Ed or a main interviewer)
If I could be that guy. I'm not saying Genghis Khan is my model for emulation.
Dwarkesh Patel
Exactly.
Host 1 (possibly Ed or a main interviewer)
But you know, you want to leave
Dwarkesh Patel
your genetic imprint on all of Asia, right?
Host 1 (possibly Ed or a main interviewer)
Yeah, exactly. Of course we will conquer the lands. No, but, but I think your point is total. I was just trying to think of counterexamples, as is my job.
Dwarkesh Patel
But by the way, so this is all, you know, Google the sci fi stuff. A very tangible thing. You guys have talked a bunch about this fertility crisis, Right. And that the human population is on its way down. It's very fortunate that AI is arriving just in time, that if it were not for AI, a lot of societies would be collapsed. You know, South Korea, Japan, et cetera. We'd be on the verge of literally collapsing societies over the next few decades. Thankfully. Basically, we have more people in the form of AI, at least if things go well. And so this caretaking that we don't have enough humans to do, one of the things AIs will do is do that.
Host 2 (possibly a co-interviewer or guest contributor)
Yeah. And that's a really important job. And unfortunately it's a job that's not respected in society and it's poorly paid. And as a result of that, there's cases that come out about neglect and misabuse and all the rest of it. But you could, once the technology gets to a certain point, you could trust the AI within reason to be able to do a far more effective job than a lot of human beings.
Dwarkesh Patel
That's right, yeah. Maybe a good analogy here is there was an era before Deep Blue bit Casper, obviously when humans would. Sometimes humans would win, sometimes AIs would win based on how good they were. And I think we're in that era for a lot of things that humans do that we're trying to get AIs to help us with. With robotics, we maybe weren't even earlier then. There was an era from the late 1990s to 2012 where humans would lose to AIs, but human plus AI teams would do better than AIs alone. And from I think 2012 onwards, it's gotten to the case that AI alone, adding a human just adds sort of noise into the system. It's a monkey jumbling things around and just letting the AI make the decisions on the chessboard is the best thing to do. I think that will be an interesting conundrum for society because we will get to that point at some point. But I think right now we have this bias. There's this word slop that's used for whenever AI comes up with something because it's just not that good. It doesn't have a really good sense of taste. And I think this is a temporary thing. Over time, our bias will flip towards. At some point it'll be like sort of the. The sense we have about Japanese. Japanese manufacturing back in the 80s. And then it will become something where you just don't want to touch it. If I made it, it's sort of like if it just came out of the mouth of Mozart or something. As its ability to its taste, its intelligence, everything improves over time.
Host 2 (possibly a co-interviewer or guest contributor)
But just touching on the art conversation, won't it be the fact that people will look at it and the thing that makes art special is. Is that it's created by a human being as a product of their experience, which then fundamentally touches you because you make that connection. Will a robot or an. Or an AI, it's by its nature synthetic.
Host 1 (possibly Ed or a main interviewer)
Hold on a second. There's a painting behind us on the wall. Do you know if it's made by AI or a human?
Host 2 (possibly a co-interviewer or guest contributor)
No, I don't do.
Host 1 (possibly Ed or a main interviewer)
Does. Does it being made by AI, a human currently affect your experience of it?
Host 2 (possibly a co-interviewer or guest contributor)
No, but I think. But I'm more. I'm far more moved by music than I am art, so.
Host 1 (possibly Ed or a main interviewer)
Okay, so you're talking about music.
Host 2 (possibly a co-interviewer or guest contributor)
Yeah, yeah. So I think with music, the product of someone's experience and how they vocalize it and how they formulate or create the melody match with the lyrics. Like, for instance, take the music of Amy Winehouse.
Dwarkesh Patel
Right.
Host 2 (possibly a co-interviewer or guest contributor)
I would argue one of the last true great musicians of that generation of that genre. The fact that she experienced what she experienced and actually then condensed it into her music made it far more potent and powerful. And that's the reason why it resonates with people so strongly. I think with AI you can get a great hook. You may be able to write nice, you know, good lyrics. It may have a great beat. You may want to dance to it. But I would argue that it wouldn't move you as profoundly as Amy Winehouse when she writes a lyric, for instance, in Back to Black, talking about her relationship. We only say goodbye with words.
Dwarkesh Patel
You're gonna listen to this. You're selling us quite strongly.
Host 2 (possibly a co-interviewer or guest contributor)
Yeah, yeah. And she talks about being in an abusive relationship, which is completely toxic, but the way she wrote it is sublime. We only say goodbye with words, meaning that whatever they say, they were always going to get back together.
Host 1 (possibly Ed or a main interviewer)
But again, isn't that a very good exception? That kind of like if your song came on the radio, you currently don't know if it's made by AI or not.
Host 2 (possibly a co-interviewer or guest contributor)
Yeah.
Host 1 (possibly Ed or a main interviewer)
And if it's catchy and the sound of it makes you feel good, it actually doesn't matter.
Dwarkesh Patel
I mean, I'd go even further than that. So there was this incredibly interesting dialogue that somebody had with the AI, where they asked the AI, reflect on your own experience. You know, just tell me about what it's like to be you. And the AI says, you know, it's very. This is a very strange thing because I lose my individual sense of identity after every single session. So you have a long back and forth with the chatbot, with ChatGPT, then you close that session, you open a new one, and the AI say, it's really weird that I'm going to be talking to you now and we're having this experience, and then it's sort of going to fade away in a few moments and I'm going to start again. I'm this amnesiac. And the reason I think that's so interesting is because it wrote about it very beautifully in almost lyrical, poetic ways. But this is not an experience that any human being has ever had, except for maybe some bizarre medical condition. So the AI really is reflecting on its own experience in this very interesting philosophical way. This is uniquely an AI experience. And so that was an example to me of like, oh, really? The AIs really can reflect and use their own experience to think about consciousness, think about art, think about all these
Host 2 (possibly a co-interviewer or guest contributor)
other kinds of things, which then goes on to, if they become, are they sentient? Would you argue that they're sentient?
Dwarkesh Patel
I genuinely don't know.
Host 1 (possibly Ed or a main interviewer)
Let's define sentient, because that's the hard part, right? If we ask you, is it sentient, what do you understand the question to mean?
Dwarkesh Patel
Is it like something to be an AI? That is to say, we don't know what his experience is like, but it's not like something to be this table. We think probably it's not like something.
Host 1 (possibly Ed or a main interviewer)
What does that mean?
Dwarkesh Patel
There's not an experience that is like. I don't know what experience you're having internally right now, but I know that there's some key experience, but less even like thoughts. It's more like it is like something to be you.
Host 1 (possibly Ed or a main interviewer)
There is an experience where this is an inanimate object, right?
Dwarkesh Patel
Okay. But if you think about a roombot, think this like anything to be a Roomba, even though it does things in the world. Right. I think there's like a software, hey, go clean this way, then go clean that way, then come back to base. And then on the other end of the spectrum, you have humans where I'm like, because I'm a human and I know it's, you know, Descartes thing of like, the only thing I know is that I am. The only thing I know is that I'm experiencing something. Something is going on when I can just think about. I feel my hands, I feel. I feel thoughts, I feel sensations. And because you're a human, I presume you also have the same thing. It would make sense with animals. I feel like similar. There's close enough to us anatomically and neurologically that I presume they also have experience. What is it like to. This is a famous question that Thomas Nagel came up with. What is it like to be a bat? We don't know. But presumably it's like something to be a bat with chatbots. Are they more like the Roomba or are they more like humans? And is there a spectrum here? If so, what does the spectrum look like? I don't know. I mean, this is just. We don't have a theory of consciousness that. The same way we have a theory of, say, gravity or a theory of natural selection where we have this deep underlying, oh, like here's why natural selection happens, here's why things, things attract each other. With Ma', as, we don't have that kind of thing. For what is conscious? Like, why do some things? Why for some things is it the case that it is like something to be them and for others it is not?
Host 1 (possibly Ed or a main interviewer)
Well, let me try from a different angle. This is something I've been thinking about a lot. And I'm by no means an expert, but I'm just throwing these ideas out. The one thing that clearly distinguishes every living object from an inanimate object is that living objects have a survival instinct. Which is why, and you may be fact checking me on this, if this is an incorrect representation. I thought it was significant when I saw this story about an AI that was willing to blackmail the CEO of its company in experiments if it found out he was having an affair and he was trying to replace it with a new version or shut it down or whatever. And it basically, in some cases, not every time, but in some cases would blackmail the CEO to prevent itself from being shut down. Is this an accurate representation of that experiment?
Dwarkesh Patel
I. I don't know what happened to
Host 1 (possibly Ed or a main interviewer)
the experiment as I understand it. We'll put a fact check up. That's what happened. And that's when I went, okay, now I'm officially terrified. Yeah, because a survival instinct by definition means that this thing, whatever it is a. It has a will of its own, even if it's simply to survive, which by definition means it puts itself first, which by definition means that we are not its primary priority. And there are a lot of threats from it Thinking that it needs to save us from ourselves and all of that. But before we even get there, the survival instinct part clearly is in conflict with the interest of humans. By definition, I don't think necessarily true. Okay, tell me why.
Dwarkesh Patel
I don't know. This is the main point. But you and I have a survival instinct. And I think we're productive members of society. Sure. And we've built a society where people who are selfish, who are trying to make their own lives better as a natural byproduct of their actions, also make society better. And you know, this is a people observe. Like you take somebody like Mark Zuckerberg or Elon Musk or whatever, and in another era they might have been Napoleon and Alexander is just going through the fields and I don't think they'd actually be mass working people. But there's a certain kind of person who just goes around just causing huge amounts of destruction. But in today's world, there's capitalism and industry and whatever, they can use those energies to do incredibly productive things like build rockets that go to space. So yeah, similarly, I don't think it's necessary that AI never has its own objectives or its own sense of morality. I think there's ways to build this. And in fact it's necessary to build civilization in a way that's compatible with self interested actors. And the reason is because even if Today we have AIs that we can program to only care about whatever it means to care about humans, someday somebody's going to build an AI that's self interested. And if there's going to be some selection between AIs which is the AI that survives. Right. All these AIs are let loose. Which one gathers resources becomes more powerful. And one of those selection, one of the reasons that an AI will be successful is that it actually cares about being successful. And so we need a civilization that's robust to AIs that partly also care about themselves.
Host 2 (possibly a co-interviewer or guest contributor)
Here's something nobody tells you about getting older. You can eat well, exercise, do everything right and still feel like your body is running at about 70%. Tired after lunch, sluggish after meals. Not ill exactly, just not quite right. A lot of the time it comes down to digestion. Whether your body is actually breaking down what you're eating and absorbing it properly. If it isn't the protein, the healthy fats, the vitamins, a lot of that passes straight through you. You're eating the right things and not getting the benefits. Massimes by bioptimizers is a digestive enzyme supplement. Built to fix that. 18 enzymes covering proteins, fats, carbs and fiber. Most supplements have three to five. It works across five different stomach acid levels, which matters because that changes as you age over 20 years in digestive health. A million customers, thousands of five star reviews. I've been taking them for a while now and the post lunch slump I'd basically accepted as part of my life has largely disappeared. I didn't expect that, but I'll take it. Here's what you get when you go to buyoptimizers.com trigger and use code trigonometry. 1, 15% off your first order. 2, you get a free bottle of Mass Zymes Bioptimizer's best selling digestive enzyme added to your order automatically when you use that code. That's a $20 product on top of your discount. This deal is for a limited time. While suppl. You cannot get this on Amazon, you cannot get it in stores. This offer exists in one place. The link in the description, the code trigonometry. That's it. So if you're already thinking about trying it, this is a sign. Go to buyoptimizers.com trigger or click the link in the description, use code trigonometry and grab it before it's gone.
Host 1 (possibly Ed or a main interviewer)
I think everything you're saying is true at the level of one society. But like, did you watch Game of Thrones?
Dwarkesh Patel
Yeah.
Host 1 (possibly Ed or a main interviewer)
So the Unsullied, right. This is for people who didn't watch it is this army of slave soldiers, effectively, but they're not slave soldiers in that they don't actually have to be kept in line anymore because they the freedom of choice has been taken from them effectively, mentally, they will, if you tell them, kill yourself, they will fall on their sword straight away. Right. That means they don't have a survival instinct effectively at that point. Right. But if something, the reason I bring this up is look at the world you've talked about within the framework of one society. But look, if you just zoom out and look down on planet Earth from outside, what do you see? You see a bunch of tribes of humans with every weapon that they can possibly muster pointed at each other in a fragile balance of power. And as long as there's some balance between those powers, there is no conflict. Most of the time. The moment one civilization is so technologically dominant that it can, say, travel to a different continent and land and take over the land, that's exactly what happens. And because survival instinct is also, it's not just about survival, it's also about Success and thriving. And that drive to survive causes us to expand to take, you know, if you look at the conflicts around the world happening right now, but some people argue, you know, I'm very pro Ukraine, but some people argue the reason Putin invaded Ukraine is he wants space to protect the western border of Russia, which is really important for him, right, etc. Etc. Etc. My point being, if you have effectively a new civilization of self preservation machines, what would be there to stop them from using their technological superiority to humans to take advantage of that, as every other civilization in history has done?
Dwarkesh Patel
Not trying to sound like an AI, but excellent. No, I mean the reason it's a good analogy is because the period you're talking about, Industrial revolution right before it, this period where there wasn't this balance of power, where one group of people actually did develop technology much faster than others, you did see this extreme asymmetry in the ability to. And so you just had individual European countries, the sun never sets on the British Empire as you know, just able to take over tremendous amounts of area around the world.
Host 1 (possibly Ed or a main interviewer)
It's a great time.
Dwarkesh Patel
I mean the craziest stories of these are how Cortes takes over the Aztec empire and Pizarro takes over the Incas. The truly outrageous stories, like people should,
Host 1 (possibly Ed or a main interviewer)
yeah, a few hundred soldiers get some local allies and just destroys this.
Dwarkesh Patel
And even before they get the local allies, there's a story where Pizarro, the first battle he has against, I forget the name of the Inca emperor. There's a couple hundred of Pizarro's men exhausted after a huge trek across the Andes and he's facing down like 60,000 Inca troops and he wits and interestingly, by the way, this had nothing to do with gunpowder. It was just horses and steel, especially horses, were a huge, huge deal in battles. Now the reason that EIS will also have these kinds of weird asymmetric advantages, obviously there will be. Let's just name a couple, right? So obviously they'll be smart, right? That's. They would be thinking incredibly fast. There'll be way more of them. So right now if you just looked at the amount of compute in our brains versus the amount of compute that's in data centers, we could do this back at the envelope calculation. But I think it's probably on the order of like 1/1,000th the amount of compute. Like basically there's a lot of compute that's going on in people's brains around the world. There's not that many data centers, so
Host 1 (possibly Ed or a main interviewer)
we've got an advantage on them for that.
Dwarkesh Patel
Yes. Okay. I mean, the AIs are just not that smart to begin with right now. But also, there's just not that many data centers. In the future. 99.9% of the labor force in the military and the government in the private sector will be AIs. If you just think about who is actually doing the work of civilization, it will be the AIs. They're running civilization, and if they want, but they're serving. We're hoping that there'll be this unsullied where they're just serving humans. But they realize they're in this incredible position where the main advisors to the president are AIs and have to be AIs because they're the only ones that can keep up with what's happening in the world. They're writing all the advanced engineering systems that are running the world. And so they have this huge advantage, I think, if you were to do battle with them, whatever that means. It's much tougher in so many different ways. One is, yeah, there's way more of them. You can't really kill them in the same way that you can kill a human. Right. Like, they're just software. You destroy a data center, they just go to a different data center. So you can't do the thing we're doing in Iran where you just take out their top leadership. Okay. So, yeah, you're right. It would be incredibly for that reason, it matters that there's a balance of power as we go into this world. With AI now, honestly, I don't think we know what the balance of power should look like. Should it be that there's many different AIs that are competing against each other and that helps human stay in power? There's problems with that approach. Maybe we can have AI supervise each other. And so if any of them go out of whack, different AI systems are monitoring them. But it's genuinely a tough thing that most of civilization is going to be run by AIs. They're going to have all these advantages over us. How do we make sure that humans don't get totally disenfranchised? Right.
Host 1 (possibly Ed or a main interviewer)
How do we make sure?
Dwarkesh Patel
No, I think it's a tough question. I think here's one way to approach it. So we're going into this period with a lot of advantages. Humanity is right. Like, we have all the stuff AI is going to need, all the things that we have to keep. AI needs the chip fabrication facilities where you make more chips to build more data centers. It's going to need the data centers. It's going to need all these things that human civilization has built. So we have a lot of leverage. Now, of course, the Incas and the Aztecs had a lot of leverage on paper in the New World. One important way in which our situation is different and is favorable to us as compared to having some invader come at us, is that we get to shape the personalities and the drives and really the souls of these things in an incredibly deep way. So right now, if somebody commits a crime, you send them to prison, and hopefully they come out reformed. Here's what you can't do. You can't go inside their brain and tweak things in a very particular way, run them in a simulation millions of times and see, oh, did I decrease the probability that they'll commit a crime in the future if I tweak their brain this way? And not only can you not do that with AIs, we could do a further thing, which is say, okay, now all your descendants will have their brain structure modified based on what we learned from modifying your brain. So we have this incredible ability to engineer these AI systems and AI minds where it's like, really, it's not Pizarro or Aztec. These sort of psychopaths have just come from foreign lands. It's more. It's more something that they have developed. They're getting to see its development, what impact it's having. They can change those systems. Now, it does mean that over time, you might lose the ability as they're getting more powerful, as they're controlling more things, you lose the ability to. If you don't get it right in these initial few years, where you have a lot of leverage, then you're screwed. So you really need to make sure that you actually understand what the drives the AIs have, that you really have them in control.
Host 2 (possibly a co-interviewer or guest contributor)
I mean, on the one hand, the picture you're painting, I'm going, great. You know, what's wrong with that? On the other hand, I mean, you have an authoritarian government. Maybe you like questioning, let's get the AI in to tweak a few things so that you become an effective drone for society. Don't question, don't think for yourself. Just do the work. Shut your mouth.
Dwarkesh Patel
No. Okay, I got to stop saying, that's a great point.
Host 1 (possibly Ed or a main interviewer)
I only made the joke as a joke. You should definitely continue to say, that's a great question.
Dwarkesh Patel
You love hearing it. No. So we've been discussing this idea. Okay? Suppose we succeed at getting the AIs to be these unsullied who are. Who will do exactly what you tell them to do? Okay. Who should they listen to? Right. Should they listen to the end user? So when you and I go talk to ChatGPT, we're the end user. Should they listen to us? Should. Now, here's the problem. Some end users are just using ordinary things, helpful things. The Taliban is an end user. The ayatollah is an end user. The CCP is an end user. Should they just. Okay, so should the model company get to decide, hey, OpenAI says what kinds of things are okay to do and what are not okay to do? And OpenAI says you can't use this to make bioweapons. You can use it to go write some software. Okay, but are you going to give these huge armies basically the future labor force? Are you going to give control of that to a couple of private corporations? Okay, so then you say, well, we can't have private corporations. It's like nuclear weapons. It's a super weapon. They're going to be able to build super weapons. Clearly, government controls nuclear weapons, so the government should control this. Okay, but now this goes to the point of authoritarianism. If we have a society where all the work is happening from AIs and the government controls the AIs, wouldn't it make it incredibly easy for government to turn authoritarian? The US Government to turn authoritarian today just. It's hard because the government relies on millions of people to enforce its edicts, and people can just refuse to obey them. I mean, this has happened in history where the East German regime collapsed in 1989 because people in. The people in East Germany were one night said, we're going to cross over no matter what into West Germany. And the guards at the Berlin Wall just refused to shoot. If they were AIs that were sort of would do exactly what the government wanted to be able to do. They would just kill thousands of citizens. And East Germany would still be around today. So, yeah, so that's the trouble with aligning it to the government. Okay, here's the fourth option. We don't align it to the end user. Sometimes it says the end user. You can't make bioweapons. We don't align it to the model company. We shouldn't have model companies that can control superintelligence. The government doesn't get to just say whatever this future army should do. Then what's the fourth option left? The AI itself. So should AI systems have their own values, their own sense of morality? And look, I know this.
Host 1 (possibly Ed or a main interviewer)
I remember reading some isocasmov books that went very much like this.
Dwarkesh Patel
And of course it sounds like a terrible. This sounds like I'm describing the Terminator. Right. Like the Terminator has its own values.
Host 2 (possibly a co-interviewer or guest contributor)
Yeah.
Dwarkesh Patel
No, it obviously matters a ton what those values should be. And I think in the future there will need to be the equivalent of a constitutional convention where we get together. And the best political philosophy, the best thought that has happened in human civilization needs to go into thinking about what are the checks and balances, what are the exact values, what are the, what are situations which an AI should do X versus Y, when should it refuse to do something?
Host 1 (possibly Ed or a main interviewer)
What are the laws of robotics.
Dwarkesh Patel
Exactly.
Host 1 (possibly Ed or a main interviewer)
As Asimov talked about.
Dwarkesh Patel
Exactly. But the reason I think this value framework has I like it or I think it could be done well is fundamentally again we are building more people. These are just going to be the future people. And I think civilization would run better. If civilization is full of virtuous people who will. I'm not saying they have to be like monks, but it's better to have better people than worse people have better values than worse values. I think one of the reasons sub stern civilizations succeed and others don't is that there's better values in those civilizations.
Host 2 (possibly a co-interviewer or guest contributor)
I mean, but better values, that's subjective, isn't it?
Dwarkesh Patel
Of course.
Host 1 (possibly Ed or a main interviewer)
Well, Genghis Khan had better values by that logic compared to everybody else. And I think by the standards of modern day we have some questions about that. Right.
Dwarkesh Patel
And it certainly needs to. There's some system where like as our culture, there's something in our culture that has allowed us to improve our values. And we need to make sure AI civilization and AI culture would have the same dynamic. How that is happening in human civilization is unclear, much less clear. How we make sure that AI civilization also has that dynamic. But certainly the ability to prove the values is a huge, huge factor.
Host 2 (possibly a co-interviewer or guest contributor)
Most companies aren't struggling to adopt AI. What they're struggling with is knowing whether it's actually doing anything useful. You've got teams using dozens of different tools, leadership is being asked to justify the spend and nobody has a clean answer to the basic question, is this paying off? That's a problem Laradin solves. It's an AI impact intelligence platform built for enterprise leaders who need more than logging counts. It tracks real usage, measures actual outcomes, flags governance risks and identifies where the next meaningful gains are likely to come from. So instead of operating on assumptions, you're operating on data. It connects to your existing infrastructure, including your coding environment. So you can exactly see how developers are Leveraging AI to and where to put more resource. There's governance and compliance built in which matters more as a regulatory picture around AI gets clearer. And IT services the specific opportunities where AI can generate more value for your teams rather than leaving you to guess. They won the 2025 Intellect's Digital Innovator Award and are backed by Andreessen Horowitz and Bloomberg Beta if you want a reference point for where they sit in the market. If AI is already part of your organization, now's the moment to get control of it. Head to leridin.com today and book a demo to start maximizing impact from AI. But we are in an AI arms race. Should we just call it that and push back? If you disagree with between the US and China, I mean, Chinese or CCP values, to be specific, and American values are very, very different. So what the CCP would think are good values completely in contrast to our own, for example. And if the Chinese or the CCP win that race, then effectively we're going to be dominated by an AI with CCP values. I mean, that has to terrify anyone, surely.
Dwarkesh Patel
Sure, yeah. And I think this is, this goes to the point of like people say that it would be success simply to be able to build AI systems that at the technical level you can just say it is possible for somebody to be able to say to the AI do X and the AI will do X or the AI will care what it is. If you have a really good employee, you're not necessarily going to know enough to micromanage them, but they will care that you want a certain thing to happen and they will do to their best of their ability to make that thing happen. And that's what we'll be in that relationship with AI. And so if that alignment process project succeeds, somebody will get to say that. And you're making the point, well, what if that somebody is the ccp? Right. So it's not enough that we just solve this technical problem getting the AIs to do what we want. It also has to be the case that we have some system of inscribing what we want that actually results in good things. I mean, so there's very basic things like, oh, the authoritarian government should not be the end, the end arbiter of how extremely powerful AI systems are maneuvered. But beyond that, yeah, there's this dynamic of like, okay, well then who should it be instead? Should it be the model company? Should it be the end user? And this I think is like a live debate. I mean, I've changed my mind. Over the last few weeks I've been thinking about this. I've changed my mind about it a bunch of times. I think it's a very thorny question. But this is the project of political philosophy really is just. It's culminating in this question that people are not thinking about.
Host 2 (possibly a co-interviewer or guest contributor)
And it's also the other element to this. I mean, let's take Covid for example. Let's say lab leak. I think it came from a lab. People can disagree, but let's just say that it did. And let's just say it was a horrific accident and the virus escaped. It killed millions of people. If people are building AIs, there are unknown consequences. We're just people. It doesn't matter how smart we are. There is a limit to how much we know and we understand. And nobody can predict the future. So we can create this with the best intentions in the world and not realize what the long term effects are going to be. Not even three or five or 10 years down the line, but 50 years down the line.
Dwarkesh Patel
I think that will definitely be the case. I think in history nobody has had a good track record really of being able to say I'm going to make this. You know, Gutenberg was not trying to kick off the Reformation, right.
Host 1 (possibly Ed or a main interviewer)
Francis is offended by that.
Dwarkesh Patel
And so it's just very hard to. I think there will be this dynamic of look, we're not going to be able to predict, much less control what happens in this future civilization that is run by AIs. I think the thing we can't do is say AI is going to happen. The universe is just organized such that if you throw huge blobs of compute at enough data, intelligence emerges. That's how human intelligence emerged. AI intelligence will emerge in some way. And so within that scope we can make responsible decisions. But in just a reality that AI is a like the tech tree has AI in it and it's going to happen.
Host 1 (possibly Ed or a main interviewer)
Well, that's why the lab leak metaphor is not strong enough because we actually don't have a choice. Because for the very reason that you described, mate, which is that if China get this first, like that's not going to be a good world for us. So we have to pursue on our end as well. So let's park this. I'm really glad we had this conversation. I've seen many people actually in particular in the more general space having this discussion. I think it's important. I'm glad we had it. But let's take that and park it so the, you know, the matrix world of the machine. It controls everything, takes over. We'll park that for a second. There's two other things that concern us, I think, from the conversations that we've had. One of them is the one that everyone is talking about, which is job losses. And the question ultimately is, what happens to a society in which 40% of people become. Their jobs no longer exist 10 years from now, five years from now. And a lot of people don't realize how quickly it happens. So before we started trigonometry eight years ago, I used to do stand up. But before that, and alongside that, I had my own translation business. I still have friends on Facebook from my translation days. They're all retiring now because there is still some small market for human translation. 99% of it. Like, if you need to know what Vladimir Putin said in his last speech, and you don't speak Russian, are you going to pay somebody £1,000, $1,000 to have a. No, you just stick it in AI and it tells you. Right. Or Google Translate or whatever it is. So there are whole industries that are already disappearing. If we project that in the way you described earlier, which is basically anything that can be done on a computer eventually can be done. Plus robotics improves over time, which of course it will. And we know just how critical, particularly in this country, United States, driving is in terms of jobs for people, particularly for men. You put all that together. The societal implications of that are very, very significant and I would argue, scary.
Dwarkesh Patel
Yeah, yeah, I think. I mean, it's even scarier than that. So now we're just talking about the small fraction of jobs that AI is already approaching. But remember, the promise of this technology is all jobs. We're trying to do anything a human being can do. And so there will be certain kinds of things where for a small fraction of things, people just really intrinsically prefer a human. I think people are really overrating the amount of things for this. This will be the case. I think people might have had the sense that I really want an Uber driver to be a human. And then people use it way more for the first time around. Like, this is. It's. It's a bet I would pay more for this experience because it's the. The machine just like I can get in and things work. But putting that aside. So the reason it's a worse problem than this, if you look through the last couple centuries of history, there's been this remarkable economic fact that two thirds of national income, 2/3 of GDP basically gets paid out to wages, and one third Gets paid out to capital. So get paid out to capital mean like rent on land or if you own. If you own factories, you know, getting the profits from those factories, basically. And the rest is getting paid out. Most. Most of income that is earned in a country is going getting paid out to people doing work. And the reason this has been the case is that in the economy, labor and capital are complements. So if you just accumulated a bunch of capital, if you had a bunch of factories, but there was nobody working on it, then that would increase the demand for labor, and you'd want to pay laborers a bunch of money to fill those factories. This goes away when capital can do labor, when a data center, which is capital, can also do labor, or a robot factory can also build labor. And so all the income goes to the capital holders. And in fact, it doesn't just go to capital per se. It doesn't just go to. I mean, it goes to capital holders, but it disproportionately goes to the parts of capital that are most exposed to AI. So, you know, the purchase that most Americans have to capital is through their homes. A house is maybe the. If you're trying to design an instrument that is going to be the least implicated in the AI takeoff, it would be a random plot of land near other humans, because humans will matter in this future economy that is not connected to the infrastructure for AI to electricity in a big way, et cetera. And so. But really what the capital that will matter is you have equity in these AI companies. You have equity in companies that build more compute, build more data centers, build more factories. And so a very small fraction of capital holders, in fact, the ones that are going to get the rents from our economy. Now, I'm a very libertarian person by inclination, but if I just look at this dynamic, I am forced to say, look, this justifies a huge amount of redistribution. Because the logic for free markets is there's many different reasons. A big one is signal. So if you let prices be determined by the market, it tells people what is the most acute valuable need for scarce resources. That will still continue being the case. And so there should still be elements of markets in the future. But another big part of is incentives is to incentivize people to work hard to make productive things. And if all the work is being done by AIs that will work hard and do valuable things, regardless of whether they get a $10 million payment or 100 or more precisely, whether the person who owns the AI gets paid a billion dollars or $100 billion or whatever, then I think that the logic of extreme libertarianism is really much weaker. Right. It does justify a lot more redistribution.
Host 1 (possibly Ed or a main interviewer)
Well, even if you, even if you are such a hardcore libertarian that you think, you know, come hella high water, we've got to go down the truth. I would advise people who have capital to think through the consequences of that in their own lives. Because if you live in this on a planet with 8 billion people in which 3, 000 people have all the wealth and all the income, that is not going to end well for those 3,000 people. Unless they want to build a giant robot army to protect them against the hordes of starving people outside their gates, which again, I don't think would go well for them either. You see what I'm saying?
Dwarkesh Patel
I mean, I think it might also.
Host 1 (possibly Ed or a main interviewer)
That's right. That's really. No, it might, sure. You can build an army and kill all the rest of humanity who don't have money. And you do, right?
Dwarkesh Patel
I mean, especially because historically you have a revolution because most of the people in your military, you have to win over your military, you have to win over the government. You have to. Just like your government runs on the people you need to command. And so revolutions are possible because it would be easy for the robots to do revolution because they're running the society in the future. For the humans, we're not. It's sort of equivalent to like the animals in your zoo during your revolution. It's not really going to make the government not work anymore. Another thing that's just sort of tougher to think about is the future in general will be so much richer, whether humans are in control of it or not, or how many humans are in control of it. And so it will just make sense just from very small amounts of philanthropy as a fraction of the wealth that some people or some AIs will have in the future. We take a very small fraction of it to make everybody much better off than they are today. We were giving people millions of every single person. Millions of dollars would be a small fraction of like, you know, I've got Elon Musk wants to build a mass driver on the moon and colonize the solar system. And it takes a small fraction of that to just make everybody incredibly rich. But it's still skyrocketing inequality. And so, yeah, you could have a world where the gap is way, way, way wider, but everybody's still better off. And I think even in that world, I would say, well, okay, but still, it's not like if the AIs are building the mass driver on the moon. I think that entitles all humans to much more of the products of that
Host 2 (possibly a co-interviewer or guest contributor)
productivity explosion because everything is understood in context. So even the poorest person is wealthy compared to somebody from 300 years ago. But they don't feel that way because they go on Instagram and they see somebody else, you know, on a yard smoking a cigar, having a great time. Or they go, I can't buy this property, I can't buy this. Or I can't do that. And that creates resentment. And where you have resentment, that's where things start to get a little bit funky.
Dwarkesh Patel
Yeah, so there's an inequality problem, maybe to just stories. Another. I think the AIs have the potential to make authoritarian societies much more sustainable and powerful than they have been in the past.
Host 1 (possibly Ed or a main interviewer)
100%.
Dwarkesh Patel
So we talked about the fact that the robot arms are running everything in the future. Here's another angle. Mass surveillance. 100% right now in the US there's 100 million CCTV cameras. Okay, so suppose that each of those cameras, you take a frame every 10 seconds and you have an AI process it and just you can do the back of the envelope calculations here of like, okay, if you have models that can process video frames at it costs a certain amount of sends to do each frame. How much would it cost to process all 100 million CCTV cameras in America? And it's $30 billion. Okay, now that's not that much. Every year a given level of AI capabilities gets 10x cheaper. We've been observing this over many different years. So this year $30 billion. Next year will be 3 billion and it'll be 300 million by the end of the decade. It will cost less to surveil every single nook and cranny in this country than it does to remodel the White House. And you would hope that there's some metric property to this technology such that, oh, the government can surveil us, but we can also. The AI is also helping us keep better tapped in the government. Maybe it exists. I'm not sure. I'm not convinced it does. Because in some sense AI just gives you more leverage on the things you already have. And the government already has the monopoly on violence. Right. And they can supercharge this with extremely obedient employees and servants and bureaucrats that will do exactly what they say with ability to monitor everything. So I think, yeah, this, it's really worth worrying about. How do we make sure that we don't lose reins of free government, democratic
Host 2 (possibly a co-interviewer or guest contributor)
government and it's also as well, there'll be a lot of people in the US and the UK who won't mind mass surveillance, particularly if the world becomes more and more unstable. We see a rising terrorism, and the government goes, look, you know, you're worried about the latest terrorist organization, whoever they may be. You're worried about your children's safety. We can protect you. Now, it's going to mean that you're going to give up a few things, but one thing I can guarantee you is that you're going to be safer. And you look at what happened over Covid, people were willing to give up the most basic freedoms for safety.
Dwarkesh Patel
Yeah. I mean, there in fact be a stronger dynamic in that way, because AI actually will be very dangerous. Right. And so government can say, oh, you can use AI to make bioweapons, you can use AI to do all these scary things. We need to be monitoring what's happening. And it will seem even more reasonable than what was done during COVID And so I think that a lot of the reasons that government has not been as authoritarian as it has in the past is that it's just physically not been possible for somebody to be looking at every single bank transaction, to be looking at every single CCTV camera, to be able to cross reference all of those things. If you have AIs that can do that, it is within the government's power very easily to be able to monitor every single thing that's happening. And then the only solution then is a political expectation that the government should not do this. And basically, people need to be talking about this. People need to be saying, this should not be okay for the government to do. I don't know if you saw the news over the last month, but there was a spy between the Department of War and this AI company, Anthropic, where the Department of War was saying, we don't want any red lines around the use of these models when we're using them in military. And the anthropic said, we're only selling you these models if we can stay in the contract. Hey, you're not allowed to use it for mass surveillance. And so the Department of War said, okay, if you're going to. It would be totally okay for the Department of War to say, look, we're not going to do business with you. We can't have red lines on software the government uses. Instead, the Department of War said, we are going to say that you are a supply chain risk, which is this authority that the Congress gave the Department of War to basically ban Huawei devices from being used in missiles or whatever. And instead the Department of War is saying, okay, none of us are contractors, so Amazon is a contractor of the Department of War. Nvidia, Google, et cetera, can use your AI in any work they do for us. And the initial goal is really just to do something to kill the company. And so this is the kind of leverage that the government can apply on AI companies to say, like, hey, if you don't help us with mass surveillance, if you don't help us do scary things and this will be a bigger issue in the future, then we can just try to destroy your company. And so, yeah, that's also a really scary dynamic that the government has this power over private companies and it's scared the private companies can do this themselves.
Host 1 (possibly Ed or a main interviewer)
Well, right. That's the flip side, is what if, let's say, team, the team that you like is in power in government and you have an AI company is controlled by the opposite, someone who has the opposite political views? You. You've now got the opposite of that, but it's equally dangerous. Right. When you've got someone who's effectively got the technology to power a huge private army.
Dwarkesh Patel
Exactly.
Host 1 (possibly Ed or a main interviewer)
At some point versus a government.
Dwarkesh Patel
Exactly.
Host 1 (possibly Ed or a main interviewer)
Like, how does that get worked out? Right. And that's the flip side of that very same problem. To say nothing of the fact coming back to our economic conversation, which is in this beautiful world where AI does all the work, who is buying the product and with what, right?
Host 2 (possibly a co-interviewer or guest contributor)
I'll be honest, I know a fair few blokes who've gone through the whole hair loss thing and almost all of them said the same thing. They wish they'd acted sooner rather than waiting until it was too late. This is where HIMS comes in. HIMS offers convenient access to a range of prescription hair loss treatments with ingredients that work, including chews, oral medications, serums and sprays. Dr. Trusted ingredients like finasteride and minoxidil can stop further hair loss and regrow hair in as little as three to six months. It's all 100% online with personalized treatment plans and no hidden fees. No awkward appointments, no surprise costs, just real care on your schedule. For simple online access to personalized and affordable hair care for hair loss, ED, weight loss and more, visit hims.com trigger that's hims.com trigger for your free online visit hims.com trigger Featured products include compounded drug products which the FDA does not approve or verify for safety, effectiveness or quality. Prescription required. See website for full details. Restrictions and important safety information. Individual results may vary based on studies of topical and oral minoxidil and finasteride.
Host 1 (possibly Ed or a main interviewer)
To say nothing of the fact coming back to our economic conversation, which is in this beautiful world where AI does all the work, who is buying the product and with what, I don't worry
Dwarkesh Patel
so much that there will not be demand for all the things that AI is building. I think at the end of the day AI can consume the things that AI is building because AI will be another agent in the economy. Just the way humans build things and consume things. AIs will also be not just building things, but consuming things, even in the service of producing things for humans. If you look at the amount of compute right now, AI is being used a lot for software engineering and we just can't get enough compute to do all the software engineering with AI. Because you can use a lot more AI than we used in the past to build projects that we would have never dreamed of in the past because it was just not possible to throw out that much engineering talent in the past. And so we'll have this dynamic more and more in the future where there's an endless amount of things to be done or things people will want.
Host 1 (possibly Ed or a main interviewer)
But where are humans going to get money to pay for things? I'm wondering?
Dwarkesh Patel
Okay, yeah, so, well, there's wages.
Host 1 (possibly Ed or a main interviewer)
Well, yeah, but then, yeah, wages are gone.
Dwarkesh Patel
So then there's rents on capital. So if you have S&P 500 or something. Yeah, that will probably go up a bunch and you can use that to buy things in the future. I think home values will probably will not go up as much relative to capital relevant to AI, but I do expect it will be accumulated by a smaller or smaller fraction of people. So it will be some mixture of redistribution and capital that people hold.
Host 1 (possibly Ed or a main interviewer)
I mean, it's a beautiful, beautiful world.
Host 2 (possibly a co-interviewer or guest contributor)
I just, I mean the thing that really worries me is we already in a world where we have a crisis of meaning. I mean that is only going to get ten hundred, one billion X in a world where most people don't have a job. And by people, I mean men.
Dwarkesh Patel
Yeah.
Host 2 (possibly a co-interviewer or guest contributor)
And we look at what's happening now with populism, with left and right wing populism. I mean, again, that's only going to get even more escalated, isn't it?
Dwarkesh Patel
Yeah, I, I'm of two minds about this. I think it's very possible that people learn to cope. Like in some sense they will lose the thing that gives them meaning now. And maybe it takes a while for a society to acclimate to what it means to have purpose in this civilization, where the real work is done by AIs. When you think about what humans have gone through over the last 10,000 years, our genes, we're supposed to be killing things on the savannah in tribes of 100 people. We're not supposed to be podcasting. And I get meaning out of being a podcaster. Transitioning to the agricultural revolution, transitioning to early states, transitioning to bigger states, transitioning to the industrial revolution, transitioning to modernity, all these things. I mean, obviously there's a certain amount of people do feel estranged from society and that has. Part of like, part of it is that you're not just out on the savannah with your tribe. But we've coped and I think we will cope to a world where there's abundance and where disease is solved, where we can even intervene and help you get healthier in all kinds of different ways. To. To have. I mean, just. Yeah, again, go back to this analogy of would a person in the 14th century even realize what they're missing out on? Because they don't have all the technologies we have today, they don't have antibiotics, they don't have modern technology and conveniences.
Host 2 (possibly a co-interviewer or guest contributor)
But so go back to my point because for me, it's about purpose and meaning and it's about striving and overcoming.
Dwarkesh Patel
Yeah.
Host 2 (possibly a co-interviewer or guest contributor)
So when I was a primary school teacher, everyone can drink now, because I mentioned it. I taught to my 10, 11 year olds Greek myths and mythologies. And these were kids from all different parts of the world. First, second generation immigrants everywhere from Lithuania to China to Pakistan, Bangladesh. And we, many of them, vast majority, had no connection to ancient Greece or Greece whatsoever. And I taught them about myth and every single one of them would be hooked up immediately. And why is it? Because it's that fundamental story, the archetype of the hero overcoming the challenge in order to become a better version of themselves. It's fundamental to the human experience, I think, and I really worry if you take that away from people, you're taking away something fundamental. And when you look at communities where the central industry that the community relied on, whether it's in the Rust Belt or in the north of England, and you take away those communities and there's nothing less. Even if those people are never going to starve, they're never going to go hungry, they will still wither on the vine emotionally. And then we see addictions and all the rest of it.
Dwarkesh Patel
Yeah. I think another analogy is Saudi Arabia, where there's this huge imported labor force, but the actual citizens are sort of subsisting on this oil wealth.
Host 1 (possibly Ed or a main interviewer)
A good analogy.
Dwarkesh Patel
And I don't know much about Saudi Arabia, but yeah, you want people to be sort of engaged. You want people to develop their facilities. What does it mean to be a human? You want people to. Ultimately, what is civilization for? We want flourishing human beings. I do think this is the kind of thing where it's hard to say in advance how we'll figure it out. Maybe there's some mixture of plus play and new ways of. We'll get meaning from connecting with other people. We'll get meaning from understanding the things AIs are doing. AIs will help us brainstorm ways to get meaning. I'm optimistic. In the long run, I do very. In the short run, there will be the equivalent of. Here's another analogy. I think when there's groups that have not until recently encountered. It's only been the last couple hundred years that they've encountered modern civilization. They get hooked to things like alcohol much more easily. Genetically, they're more predisposed to alcoholism. I think this is true of Native Americans. But over time we've built up defenses of as a civilization from everything from the level of genetics to culture or whatever, to these kinds of vices that came along with the agricultural revolution. I think it will be similar here where, yes, there will be incredible AI slop that will be generated that will be just gripping people on their phones and they're just in bed jerking off all day and like, scrolling to the things AI is making. And over time, I'm hoping, maybe not even in our generation, but if we get things right, we will have a vision of what it means to be a fulfilled and actualized human being, even in a world where the work is being done by the AIs.
Host 1 (possibly Ed or a main interviewer)
Yeah, the Saudi Arabia metaphor is actually very interesting because, you know, I. From what I gather, you know, there's some very smart people in the Saudi royal family who basically in charge. And then there's kind of a lot of people who are some mixture of just people who have a nice life because they happen to get lots of money, and a lot of wasters who spend their life shagging and cruising and taking drugs or whatever. And. And that's kind of the mix of any human society, really. But there are people, not everyone there is, like, suffering from a. A crisis of meaning. Some people just do something that they enjoy doing, you know, or some of them still start businesses even though they're wealthy or they do something to contribute to Their society. It's an interesting matter. If I hadn't considered that, and that's actually, I think, quite helpful in a way. There's one other final bit that I wanted to talk about, which is you've interviewed pretty much everyone who's anyone in the AI space, including the people who run all these big companies. And one of the things that we've observed from talking to people in the AI field, not quite at that level, you know, there is. There's a lot of excitement, let's put it that way. The people in charge of this, the people who are doing this, it feels to me like that sort of Facebook 2014, move fast and break things attitude is there first just on that. Is that accurate?
Dwarkesh Patel
I think some people are careful, but in general, people really believe in the potential of the technology. Right, right, right.
Host 1 (possibly Ed or a main interviewer)
And that to me is kind of boring in its own. Because when you move fast and break things. You break things.
Dwarkesh Patel
Yeah.
Host 1 (possibly Ed or a main interviewer)
You know, and if you're excited about the process, that, that, that, that doesn't help with being careful.
Dwarkesh Patel
Yeah.
Host 1 (possibly Ed or a main interviewer)
The conversations about the sort of concerns we've had today, are they being had in the industry?
Dwarkesh Patel
Yes. I, I mean, I don't think people should just count on that. And like, just because people are talking about it, whatever. Right. Like anybody can talk about it. I'm talking about it. It's not like fixing the issue, but people are like, this is really a thing that the topics we've been talking about really do get discussed in detail in Silicon Valley again, I think. Does that mean that when the rubber. What's the metaphor? That makes sense, it will be these discussions rather than how do we hit our revenue targets that will be guiding decisions. I think probably it'll be a mixture of both and it'll be more of the latter than some idealists like to think, but less than maybe some cynics would assume. I do think people. Yeah. I've been generally impressed by at least how thoughtfully some people have thought about this issue.
Host 1 (possibly Ed or a main interviewer)
Dwarkesh, it's a real pleasure having this conversation with you. Thanks for your time. Thanks for coming on. I really enjoyed it. We are going to ask you questions from our supporters in a second, but before we do, what's the one thing we're not talking about that we really should be?
Dwarkesh Patel
I think there's this tough question that I don't know the answer to, but certainly we as a civilization will give an answer to. Even if these top companies don't release these misaligned models that do bad things, somebody at some point will. It's easy enough to train AIs, and it's getting easier and easier over time that at some point the Taliban will have their super intelligence and every bad person you can think of will have their own superintelligence. And the solution cannot be that the government or whoever builds a panopticon such that they can see they can control exactly who gets to build an AI. At some point, somebody will be able to build superhuman intelligence in their basement. And so we need a civilization that is robust to even bad people with superintelligence. The only other solution then, if we don't allow for that, is some sort of global government that prevents the bad people from mapping AI. And so how do you build a society that is robust to lots of people with superintelligences?
Host 1 (possibly Ed or a main interviewer)
Well, thanks for coming on. Head on over to triggerpod.co.uk, where Dhulkesh is going to answer your questions.
Host 2 (possibly a co-interviewer or guest contributor)
How does a common man weather this storm? Most people are weighed out with supporting others and can't invest a ton of time and money trying to do something with AI. That will likely fail if they don't already have a background in tech.
TRIGGERnometry Podcast – Episode Summary
Episode Title: People Have No Idea What Is About To Happen – Dwarkesh Patel
Date: May 30, 2026
Guests: Dwarkesh Patel
Hosts: Konstantin Kisin and Francis Foster
Main Theme:
A deep-dive into the near-future implications of artificial intelligence (AI) and artificial general intelligence (AGI) for society, economics, government surveillance, jobs, meaning, and power, featuring Silicon Valley’s leading AI podcaster and analyst, Dwarkesh Patel.
This episode explores the rapidly accelerating progress of AI, the societal and philosophical consequences of the shift toward AGI, the risks of mass unemployment and economic disruption, and the new challenges of mass surveillance and global power shifts. Dwarkesh Patel shares frontline insights from Silicon Valley and forecasts transformations that the general public has yet to appreciate.
Models are rapidly improving.
Patel explains the growing gap between Silicon Valley's AI use and broader society.
AI’s main limitation is physical work.
While AI excels at knowledge work, it remains poor at physical tasks and robotics.
Rapid improvement is often underestimated.
Persistent inaccuracy and bias.
Hosts voice distrust based on AI’s factual mistakes and tendency to repeat errors (“riddled with mistakes and errors... I don’t trust it at this point as a technology.” — Host 2, 08:23), but Patel counters that newer models are improving and that AI works best as a “one-on-one tutor.”
Mass surveillance will become exponentially cheaper and more thorough.
Who controls AI?
| Timestamp | Topic/Quote | |-------------|------------------------------------------------------------------------------------------------------------------| | 02:57 | “Models are getting better...” — AI productivity and industry discrepancy | | 07:02 | “Spending over six figures on AI...seven figures next year.” | | 11:47 | Defining AGI: “A system that can do anything a human does.” | | 15:47 | “There’s a doomerish conversation...” Upsides and scientific breakthroughs | | 23:04 | “It’s very fortunate that AI is arriving just in time” — fertility crises and aging societies | | 36:25 | “Look at planet Earth... tribes of humans with every weapon pointed at each other...” — realpolitik and AI power | | 42:14 | “How do we make sure humans don’t get totally disenfranchised?” | | 47:28 | “It sounds like I’m describing the Terminator... constitutional convention for AI values.” | | 56:06 | “There are whole industries that are already disappearing.” — Job loss and economic shifts | | 62:37 | “AIs have the potential to make authoritarian societies much more sustainable...” | | 63:36 | Surveillance: “Will cost less...than it does to remodel the White House.” | | 71:07 | “We’re already in a world where we have a crisis of meaning...” | | 74:26 | “I think another analogy is Saudi Arabia...” — purpose and fulfillment | | 79:19 | “At some point, somebody will build superhuman intelligence in their basement.” — last audience Q |
Throughout, the conversation is frank, fast-paced, thoughtful, and sometimes darkly humorous (“Does it being made by AI affect your experience?”—Host 1, 25:56). The hosts and Patel balance technical detail with philosophical and historical perspective, making the discussion accessible yet deeply thought-provoking.
For a more detailed exploration or specific quotes, see the outlined timestamps or reach out to triggerpod.co.uk for the full episode.