← Conversations with Tyler
Conversations with Tyler
Sam Altman on Trust, Persuasion, and the Future of Intelligence - Live at the Progress Conference
00:54:53
Loading summary
Transcript259 lines
- [00:05]
A
Hi listeners, this is Tyler. Please mark your calendars For Friday, January 9th, we're hosting a CWT listener meetup in Austin, Texas at Parkside on East 6th Street. This is your chance to connect with fellow fans and meet me and also the entire CWT team in person and to enjoy some great conversation over light refreshments. We'll have a Q and A session, plus plenty of time to mix and mingle. Space is limited and filling up fast, so click the link in the Show Notes to register now it's first come first serve and plus ones are absolutely welcome. Just make sure they register at the link as well. Hope to see you there. Conversations with Tyler is produced by the Mercatus center at at George Mason University, bridging the gap between academic ideas and real world problems. Learn more@mercatus.org for a full transcript of every conversation enhanced with helpful links, visit conversationswithtyler.com hello Sam, happy to do this with you.
- [01:19]
B
Excited to do it again now.
- [01:21]
A
The last two months or so there have been so many deals involving OpenAI and I'm not even talking about the globetrotting. A lot of them are local. There's new product features such as Pulse. Presumably you were productive to begin with. How is it that you manage to up your productivity to get all this done?
- [01:38]
B
I mean a lot of I don't think there's like one single takeaway other than I think you always are. People are almost never allocate their time as well as they think they do and as you have more demands and more opportunities you find ways to continue to be more efficient. But we've been able to hire and promote great people and I delegate a lot to them and get them to take stuff on and that that is kind of the only sustainable way I know how to do it. I do try to make sure we increasingly as what we need to do comes into focus and there's as you mentioned, like a lot of infrastructure that needs to be built out right now. I do try to like make sure we understand or I understand like what what the the core thing for us to do is and it has in some sense simplified and it's very clear what we need to do. So that's been helpful. I don't really know. I guess another thing that's happened is more of the world wants to work with us so deals are quicker to negotiate.
- [02:33]
A
You're doing much more with hardware or matters that are hardware adjacent. How is hiring or delegating to a good hardware person different from hiring good AI people? Which is what you started off doing.
- [02:46]
B
You mean like consumer devices or chips?
- [02:48]
A
Both.
- [02:49]
B
One thing that's different is that cycle times are much longer, the capital is more intense, the cost of screen up is higher. So I like to spend more time getting to know the people before saying, okay, you just go do this and I'll trust that it'll work out. But it's kind of otherwise. The theory is the same. You try to find good, effective, fast moving people. Like, get clear on what the goal is and just let them go do it.
- [03:14]
A
Like, I visited Nvidia earlier this year. They were great. They were great. To me they're super smart. But it just felt so different from walking the floor of OpenAI. And I'm sure you've been to Nvidia. Like, people read Twitter less, at least on the surface. They're less weird. Like, what is that intangible difference in the hardware world that one has to grasp to do well in it?
- [03:35]
B
Look, I don't know if this is going to turn out to be a good sign or a bad sign, but our chip team feels more like the OpenAI research team than a chip company. I think it might work out phenomenally well.
- [03:46]
A
So you're extending the model of your previous hires to hardware?
- [03:49]
B
With some risk, but we are.
- [03:52]
A
There's this fellow on Twitter, his name is Rune. He's become quite well known. What is it that makes Rune special to you?
- [04:04]
B
He's like a very lateral thinker. You can start down one path and sort of jump somewhere completely else, but keep going down. You know, stay on like the same trajectory but in some sort of like very different context. That's sort of unusual. He's clearly, he's great at phrasing observations in an interesting, useful, whatever way. And that sort of makes him fun and quite like, useful to talk to. I know he brings together like a lot of skills that don't often exist in one person's head.
- [04:38]
A
And how does that shape what you have him work on? So you, you see this about him and then you think, ah, Rune should.
- [04:44]
B
Do X. I very rarely get to have anybody work on anything. Like, one thing about researchers is they're going to work on what they're going to work on. And that's kind of that there.
- [04:52]
A
Someone put an essay online and it said in all the time they worked at OpenAI, they hardly ever sent or received an email that so many things were done over Slack. Why is that? What's your model of why email is bad and Slack is good for OpenAI?
- [05:05]
B
I'll agree email is bad. I don't know if Slack is good. I suspect it's not. I think email's very bad. So the threshold to make something better than email is not high. And I think Slack is better than email. We have a lot of things going on at the same time, as you observed, and we have to do things extremely quickly. It's definitely a very fast moving organization. So there are positives about Slack, but there's also like, you know, I like kind of dread the first hour of the morning, last hour before I go to bed where I'm just like dealing with this explosion of Slack and I think it does create a lot of fake work. I suspect there is something new to build that is going to replace a lot of the current sort of office productivity suite. Whatever you think of like docs, slides, email, Slack, whatever, that will be sort of the AI driven version of all of these things. Not where you tack on the horrible, like you accidentally click the wrong place and it tries to write a whole document for you or summarize some thread or whatever, but the actual version of like you are trusting your AI agent and my AI agent to work most stuff out and escalate to us when necessary. I think there is probably finally a good solution for someone to make within reach.
- [06:23]
A
How far are you from having that internally? Maybe not a product for the whole world that it's in every way tested, but that you would use it with an OpenAI very far.
- [06:32]
B
But I suspect just because we haven't made any effort to try, not because the models are that far away, but.
- [06:38]
A
Since talent, time, human capital is so valuable within your company, why shouldn't that be a priority? Probably we should do it.
- [06:45]
B
But there's like, you know, people get stuck in their own ways of doing things and we got like a lot of stuff is going very well right now. So it's, there's a lot of activation energy for like a big new thing.
- [06:54]
A
What is it about GPT6 that makes that special to you?
- [06:58]
B
I think GPT5 if GPT3 was like the first moment where you saw like a glimmer of something that felt like the spiritual Turing test getting passed. GPT5 is the first moment where you see a glimmer of AI doing new science. It's like very tiny things, but here and there someone's posting like, oh, it figured this thing out. Or oh, it came up this new idea. Oh, it was like a useful collaborator on this paper. And there is a chance that GPT6 will be a GPT3 to 4. Like Leap. That happened for kind of Turing Test, like stuff for science where five has these tiny glimmers and six can really do it.
- [07:36]
A
So let's say I run a science lab and I know GPT6 is coming. What should I be doing now to prepare for that?
- [07:43]
B
It's always a very hard question, like, even if you know this thing is.
- [07:47]
A
Coming, let's say I even had it now. Right. What exactly would I do the next morning?
- [07:54]
B
I mean, I guess the first thing you would do is just type in the current research questions you're struggling with and maybe it'll say like, here's an idea or run this experiment or go do this other thing.
- [08:03]
A
But if I'm thinking about restructuring an entire organization to put GPT 6 or 7 or whatever at the center of it, what is it I should be doing organizationally rather than just having all my top people use it as add ons to their current stock of knowledge?
- [08:19]
B
So I've, I've thought about this more for the context of companies than scientists, just because, like, I understand that better and I think it's a very important question. And right now I have met some orgs that are really saying, like, okay, we're going to adopt AI and let AI kind of do this. But I'm very interested in this because shame on me if OpenAI is not the first big company run by an AI CEO. Right.
- [08:42]
A
But just parts of it. And I thought the whole thing, that's very ambitious. The finance department, whatever.
- [08:47]
B
Well, but eventually it should get to the whole thing.
- [08:48]
A
Yeah.
- [08:49]
B
So we can use this and then try to work backwards from that. And I find this a very interesting thought experiment of what would have to happen for an AI CEO to be able to do a much better job of running Open Air than me, which clearly will happen someday. But how can we accelerate that? What's in the way of that? I have found that to be a super useful thought experiment for how we design our org over time and what the other pieces and kind of like roadblocks will be. And I assume someone running the science lab should kind of try to think the same way and they'll come to different conclusions.
- [09:21]
A
How far off do you think it is that just say one division of OpenAI is 85% run by AIs?
- [09:29]
B
Any single division, not a tiny.
- [09:31]
A
Any significant division, mostly run by the AIs.
- [09:35]
B
Some small single digit number of years. Not very far.
- [09:37]
A
Not very far. And how does that.
- [09:40]
B
When do you think the. When do you think I can be like, okay, Mr. AI CEO, you take over.
- [09:46]
A
CEO is tricky because the public role of a CEO as you know, becomes more and more important.
- [09:50]
B
Let's say I stay on the like anyone if I can like pretend to be a politician, which is not my natural strength and AI can do it too. But let's say I stay involved for the public, facing whatever, just actually making the good decisions, figuring out what to do.
- [10:05]
A
I think you'll have billion dollar companies run by two or three people with AI as I don't know in two and a half years. I used to think one year, but maybe I've put it off a bit. I'm not more pessimistic about the AI, maybe I'm more pessimistic about the humans. But what's your forecast?
- [10:21]
B
I agree on all of those counts. I think the AI can do it sooner than that. People have a great and I think this is a good thing for society and a good thing for the future, not a bad one. People have a great deal higher trust in other people over an AI, even if they shouldn't, even if that's irrational. You know, the AI doctor is better, but you want the human whatever. So I think it may take much longer for society to get really comfortable with this and for people in an organization to get really comfortable with this. But on the actual decision making for most things, maybe the AI is pretty good.
- [10:53]
A
Pretty soon and you're hiring a lot of smart people, do you ask yourself what are the markers of how AI resistant this very smart person will be? Like you have an implicit mental test for that or you just hire smart people and hope it's all going to work out later.
- [11:08]
B
No, I do ask questions about that.
- [11:10]
A
But people will just lie, right? Like they know they're talking to OpenAI. Well, what do you actually look for in them?
- [11:17]
B
I mean a big one is how they use AI today. And the people who still are like, oh yeah, you know, I use it for better Google search and nothing else. That's not necessarily disqualifier, but that's like a yellow flag. And people who are like seriously considering like what their day to day is going to look like in three years, that's a green flag. A lot of people aren't, they're like oh yeah, you know, probably it's going to be really smart.
- [11:38]
A
Do you think scientific labs might get GPT6 this year?
- [11:42]
B
Not this year.
- [11:43]
A
Not this year. Here's a very difficult question. As you know, both you and I were fans of nuclear power, but we also know the insurance for nuclear Power plants is provided by the government, the plants might be quite safe, but people worry. They're nervous nellies. There's a lot of parties involved, so the federal government does the insurance. Do you worry that the future holds the same for AI companies or the Feds are your insurer and how do you plan for that? Again, even if AI is pretty safe, as with nuclear power, people are nervous nellies. How will you insure everything?
- [12:19]
B
Like, at some level, when something gets sufficiently huge, whether or not they are on paper, the federal government is kind of the insurer of last resort, as we've seen in various financial crises and insurance companies screwing things up. So I guess given the magnitude of what I expect AI economic impact to look like, sort of, I do think the government ends up as like, the insurer of last resort, but I think I mean that in a different way than you mean that. And I don't expect them to actually be like, writing the policies in the way that maybe they do for nuclear.
- [12:55]
A
And there's a big difference between the government being the insurer of last resort and the insurer of first resort. Last resort's inevitable, but I'm worried they'll become the insurer of first resort. And that I don't want.
- [13:06]
B
I don't want that either. I don't think that's what will happen.
- [13:10]
A
What we're seeing with Intel, Lithium, Rare Earths, is the government is becoming an equity holder, again, not of last resort, it's of second or third resort. And I don't mean this as a comment about the Trump administration. I think this is something we might be seeing in any case or see in the future after Trump is gone. But how do you plan for OpenAI knowing that's now a thing on the table in the American economy?
- [13:34]
B
Look, there are all these ways where you can imagine that I put almost no probability en masse onto the world where no one has any meaning in the post AGI world, because the AI is doing everything. I think we're really great at finding new things to do, new games to play, new ways to be useful to each other, to compete, to get fulfilled, whatever. But I do put a significant probability that the social contract has to change significantly. I don't know what that will look like. Can I see the government getting more involved there and thus having some strong opinions about AI companies? I can totally see that. But we don't live our lives that way. We just kind of try to work with capitalism as it currently exists. And I believe that that should be done by the companies and not the government. Although we'll partner with the government and try to be like, a good collaborator. Like, I don't want them, like, writing our insurance policies now.
- [14:23]
A
I did a trip through France and Spain this summer with my wife. Every hotel we booked other than the first one we booked through, well, we found it through GPT5, we didn't book it through GPT. Almost every meal we ate. Right. And you didn't get a dime for this. And I'm telling my wife, well, this just seems wrong. Right? What is the new world going to look like soon enough? How will that work?
- [14:46]
B
I think if ChatGPT finds you to zoom out even before the answer, one of the sort of unusual things we noticed a while ago, and this was when it was a worse problem. ChatGPT would consistently be reported as like a user's most trusted technology product from a big tech company. We don't really think of ourselves as a big tech company, but I guess we sort of are now. And that's very odd on the surface, right, Because AI is the thing that hallucinates. AI is the thing with all the errors. And this was when that was much more of a problem. And there is a question of why ads on a Google search are dependent on Google doing badly. Like, if it was giving you the best answer, there'd be no reason ever to buy an ad above it. So you kind of like, you're like, that thing is not quite aligned with me. ChatGPT, maybe it gives you the best answer, maybe it doesn't, but you're paying it, or hopefully all are paying it, and it's at least trying to give you the best answer. If we. And that has led to people having like a deep and pretty trusting relationship with ChatGPT. You ask ChatGPT for the best hotel, not Google or something else. If ChatGPT were accepting payment to put a worse hotel above a better hotel, that's probably catastrophic for your relationship with ChatGPT. On the other hand, if ChatGPT shows you it's guess the best hotel, whatever that is, and then if you book it with one click, takes the same cut that it would take from any other hotel. And there's nothing that influenced it, but there's some sort of transaction fee, I think that's probably okay. And with our recent commerce thing, that's the spirit of what we're trying to do. We'll do that for travel at some point.
- [16:22]
A
I'm not worried about the payola issue, but let me tell you my worry, and that is there may be a tight cap on the commission you can charge, because we're now in a world, say, where there's agents and someone finds the best hotel through GPT7 or whatever, and then they just talk to their computer or their pendant and they go to some stupider service. But the stupider service is an agent that books very cheaply and they only really have to pay OpenAI a commission equal to what the stupidest service will charge.
- [16:52]
B
So one thing I believe in general related to this is that margins are going to go dramatically down on most goods and services, including things like hotel bookings. I'm happy about that. I think there's like a lot of taxes that just suck for the economy and getting those down should be great all around. But I think that Most companies like OpenAI will make more money at a lower margin.
- [17:18]
A
But do you worry about the discrepancy between the fixed upfront cost of making yours the smartest model compared to the very cheap cost if all the competing agent has to do is book it for someone? And how do you use the commissions to pay for making the model smarter?
- [17:33]
B
In essence, I think the way to monetize the world's smartest model is certainly.
- [17:38]
A
Not hotel booking, but you want to do it nonetheless.
- [17:41]
B
I mean, I want to discover new science and figure out a way to monetize that that you can only do with the smartest model. There is a question of, like, should many people have asked, should OpenAI do chatgpt at all? Why don't you just go build AGI? Why don't you go discover, you know, a cure for every disease, nuclear fusion, cheap rockets, the whole thing, and just license that technology. And it is not an unfair question because I believe that is the stuff that we will do that will be most important and make the most money eventually. But my story, my most likely story about how this works, how the world gets like dramatically better, is we put a really great super intelligence in the hands of everybody. We make it super easy to use, it's nicely integrated, we make you beautiful devices, we connect it to all your services, it gets to know you over your life, it does all this stuff for you. And we invest in infrastructure and chips and energy and the whole thing to make it super abundant and super cheap. And then you all figure out how the world gets way better. Maybe some people will only ever book hotels and not do anything else, but a lot of people will figure out they can do more and more stuff and create new companies and ideas and art and whatever. So maybe chatgpt and hotel booking and whatever else is not the best way we can make money. In fact, I'm certain it's not. I do think it's a very important thing to do for the world and I'm happy for OpenAI to do some things that are not the like, economic Maxine thing.
- [19:11]
A
Now you have a deal in the works with Walmart that people can use GPT, ask it questions, what should I buy at Walmart? And then they can buy it at Walmart and you and Walmart have some arrangement. Do you think Amazon will fold and join that or are they going to fight back and try to do their own thing?
- [19:26]
B
I have no idea. If I were them, I would fight back.
- [19:28]
A
You would fight back?
- [19:29]
B
I think so, yeah.
- [19:31]
A
Ads. How important a revenue source will ads be for OpenAI? Again?
- [19:36]
B
There's a kind of ad that I think would be really bad, like the one we talked about. There are kinds of ads that I think would be very good or pretty good to do. I expected something we'll try at some point. I do not think it is our biggest revenue opportunity.
- [19:51]
A
What will the ad look like on the page?
- [19:54]
B
I have no idea. You asked like a question about productivity earlier. Yeah, I'm really good about not doing the things I don't want to do.
- [20:02]
A
And that's something you don't want to do.
- [20:03]
B
You know, we have like the world expert thinking about our product strategy. I used to do that. I used to spend a lot of time thinking about product and. And now she's much better at it than me. I have other things to think about. I'm sure she'll figure it out.
- [20:17]
A
Whether or not you agree with it, what is the best. This is not a bubble argument, is it just the insatiable demand for compute.
- [20:24]
B
There's a lot of arguments I'm tempted to give, but I think the intellectually most interesting one is we have no idea how much past human level intelligence can go and what you can do with it as it does. So there's all the arguments that everyone has made. The one I would like to see people talk about much more is how are you even supposed to think about like vastly superhuman intelligence and the economic impacts of that?
- [20:52]
A
Now OpenAI is in talks with Saudi Arabia, with UAE. Let's take the most optimistic scenario for how all that goes. What is it that top OpenAI management needs to know or understand about those countries and how is it you learn it?
- [21:08]
B
Well, it would depend on what we were doing with them. Putting data centers in a country or taking an investment from a country or deploying commercial services would be very different than a set of other collaborations we could imagine. But generally speaking, to put data centers in a country, what we need to understand is who's going to run it. We don't operate our own data centers, but, you know, Microsoft or Oracle or somebody else. What workload are we going to put there? So what model weights are we going to put there? And what are the security guarantees going to look like? We do want to build data centers around the world with lots of countries. But for this question, which is kind of the main thing we deal with other countries for, those are the kinds of questions if we were. Which we don't have current plans, if we were like developing a custom model for some country, we'd have a whole bunch more questions.
- [21:54]
A
But they have different legal codes, different expectations from a deal. I'm not saying it's in a bad way. It's just quite different. Right. And you do the Jared Kushner thing. Here's the 25 books I read. Or you sit down and you ask GPT6 how to understand this culture. Or you bring in three experts.
- [22:11]
B
We bring in experts.
- [22:12]
A
You bring in experts.
- [22:12]
B
We talk to the US Government a lot. We bring in experts. Again, if we're like, if we're building a data center that a very trusted partner is going to operate, we know what the workload is, and it's being built like a kind of U.S. embassy or U.S. military base. We have a very different set of questions than if we were doing other things which we have not yet decided to do, and we'd bring in more experts for.
- [22:31]
A
And those are quite intangible forms of knowledge often. How good do you think GPT6 is at teaching you those things? Or you still need the human experts to come in because you could just ask your own model. Right.
- [22:44]
B
I don't think GPT6 will have those intangibles. It might surprise us, but I wouldn't. That'd be very unexpected if I was like, oh, don't even talk to experts anymore.
- [22:53]
A
Do you have an evaluation for that in the works?
- [22:56]
B
Actually, for something very close to that, we do. I don't want to pre announce it, but that class of stuff. Yes, we do have. Yes.
- [23:03]
A
Yeah. How good will GPT6 be at poetry?
- [23:06]
B
How good do you think GPT5 is at poetry?
- [23:09]
A
Not that good. It's not what I want it for, so that's not a complaint. My guess is in a year you'll have some model that can write a poem as good as the median Pablo Neruda poem. But not the best.
- [23:22]
B
I was going to say, I think, like, I don't want to say GPT, whether it's 6 or 7, but I think we will get to something where you will say this is like a. This is not long way to the very best, but like, this is like a real poet's okay poem.
- [23:38]
A
In my view, there's a big gap between a Neruda poem that's a 7 on a scale of 1 to 10 and one that's a 10. I'm not sure you'll ever reach the 10. I think you'll reach the 8.8 within a few years.
- [23:50]
B
I think we will reach the 10. And you won't care.
- [23:54]
A
Who won't care?
- [23:55]
B
You won't care.
- [23:56]
A
I'll care. Well, I promise.
- [24:01]
B
I mean, you'll care in terms of the technological accomplishment, but in terms of the great pieces of art and emotion and whatever else produced by humanity, you care a lot about the person or that a person produced it. And it's definitely something for an AI to write a 10 on its technical merits. But my classic example of this is the greatest. Chess players don't really care that AI is hugely better than them at chess. It doesn't demotivate them to play. They don't really care that they are. They really care about beating the other human, and they really get obsessed with that dude sitting across from them. But the fact that the AI is better, they don't care. Watching two AIs play each other, not that fun for that long.
- [24:46]
A
Well, let me tell you my worry about reaching the 10. Evaluations rely a lot on these rubrics. And the rubrics will become good enough to produce very good poems. But maybe there's something about the 10 poem that stands outside the rubric. And if you're just training on rubrics, rubrics, rubrics, it might in a way be counterproductive for reaching the 10.
- [25:06]
B
I mean, evals can rely on a lot of things, including when you call a poem a 10 and when you don't, and you can read a bunch in the process and provide some real time signal.
- [25:15]
A
But say we have no human poets today writing tens, and we're asking those same people to judge and grade the GPTs. I'm worried again. I think it will be fine. But to me, we're talking about a 9, not a 10. You don't have William Wordsworth working for OpenAI.
- [25:33]
B
This gets to like a very interesting thing, which is, let's say you can't write a 10, but you can decide when something is a 10. Yeah, that might be all that we need.
- [25:44]
A
Maybe humanity only decides collectively what's a 10. And there's something a little mysterious and history laden about that process.
- [25:52]
B
Okay, but still we can do it. Now maybe our decision is not very good because it is history related and it does drift over time. And some things we all agree are great, the next generation decides are not whatever. But if whatever process humanity has to determine what a poem is a 10, you could imagine that providing some sort of signal to an AI. Now that again, if you know it's an AI, maybe you don't care. We see this phenomenon with AI art.
- [26:18]
A
To the extent you end up building your own chips. What's the hardest part of that?
- [26:22]
B
Man, that's a hard thing all around.
- [26:24]
A
There's the hardest.
- [26:25]
B
There's no easy part of that.
- [26:26]
A
Yeah, no easy part of that. Well, Jonathan Ross said it's just keeping up with what is new.
- [26:31]
B
No, I'll tell you what might. People talk a lot about the recursive self improvement loop for AI research where AI can help researchers maybe today write code faster, eventually do automated research. And this thing is like well understood. Very, very much discussed. Very little discussed or relatively little discussed are the hardware implications of this. Robots that can build other robots, data centers that can build other data centers. Chips that can design their own next generation. So there's many hard parts, but maybe a lot of them can get much easier. Maybe the problem of chip design will turn out to be a very good problem for previous generations of chips.
- [27:10]
A
You know the stupidest question possible, why don't we just make more GPUs?
- [27:13]
B
Because we need to make more electrons.
- [27:15]
A
But what's stopping that? What's the ultimate binding constraint?
- [27:18]
B
I think we're working on it really hard. I mean this is, you know.
- [27:21]
A
But if you could have more of one thing to have more compute, what would the one thing be?
- [27:25]
B
Electrons.
- [27:26]
A
Electrons.
- [27:27]
B
Yeah.
- [27:27]
A
Just energy.
- [27:28]
B
Yeah.
- [27:30]
A
And what's the most likely short term solution for that? Short term easing. Not full solution, but easing of the constraints.
- [27:36]
B
Short term, natural gas, long term in.
- [27:38]
A
The American south or wherever.
- [27:40]
B
Long term it will be dominated, I believe by fusion and by solar. I don't know what ratio, but I would say those are the two winners.
- [27:46]
A
And you're still bullish on fusion?
- [27:48]
B
Very much. And solar?
- [27:50]
A
Do you worry that as long as it's called nuclear power, even if it works.
- [27:54]
B
Did I say the word nuclear?
- [27:55]
A
No, you didn't, but other people will. The people just Won't want it. Getting back to the irrationality point in the insurance.
- [28:04]
B
You're the economist, not me. But I think there is some price point at a given level of safety where the demand for this will be overwhelming. If this is the same price as natural gas, maybe it's unfortunately hard. If it's 1/10 the price, I think we could agree it would happen very fast. I don't know what the cut point is between.
- [28:25]
A
Do you ever worry there's some scenario where ultimately superintelligence doesn't need that much compute? And in some funny way, by investing in compute, you're betting against progress over 30 year time horizon?
- [28:37]
B
In the same way that people always want more energy if it's cheaper, I think people always want more compute if it's cheaper. So even if you can make incredibly smart models with much less compute, which I'm sure you can, the desire to consume in all sorts of new ways and do more stuff with less, more up on the intelligence. Take that bet every day. The related thing I worry about is that there is like a, a huge phase shift on how we do compute and we're all kind of like chasing a dead end paradigm. That would be bad.
- [29:07]
A
And what would that look like?
- [29:09]
B
I don't know, we like all switch to optical compute, like full on optical.
- [29:11]
A
Compute or something and just have to spend a lot of money all over again.
- [29:14]
B
Yeah, well, not on all like the energy is the energy, but yes on everything else.
- [29:19]
A
Now I love Pulse. Why don't I hear more about Pulse? Or do you think there is a lot of chatter out there?
- [29:24]
B
People love Pulse, but it is only available to our pro users right now, which is not that many. And also we're not giving much per day to users and we will change both of those things. But I suspect when we roll it out to plus, you will hear about it a lot more. But people do love it. It gets great, great reviews.
- [29:43]
A
And what do you use PLS for?
- [29:45]
B
There are kind of only two things in my life right now, like there's my family and work and clearly this is what I talk to ChatGPT about because I get a lot of stuff about that and you know, I get the odd like new hypercar came out or like here's a great hiking trail or whatever. But it's mostly those two things. But it's very, it's great for that, both of those.
- [30:02]
A
I'd just like to do a brief interlude on your broader view of the world and just see how I should think about how you think. So People in California, they have a lot of views, like on their own health, some of which to me sound nutty. What do you think is your nuttiest view about your own health? That you're going to live forever. That you know the seed oils are bad or what is it? Or do you not have any?
- [30:26]
B
I mean, I'm. I, When I was less busy, I was more disciplined on health related stuff. I didn't have crazy views, but I was like. I kind of ate healthy. I didn't drink that much. I like worked out a lot. I tried a few things here and there. Like I was. I once ended up in a hospital for trying semaglutide before. It was cool, like that kind of stuff. But I now do basically nothing. I don't.
- [30:50]
A
You just live family life and try.
- [30:51]
B
I eat junk food. I don't exercise enough. It's like a pretty bad situation. Like I'm feeling bullied into, like taking this more seriously again.
- [30:59]
A
Yeah, but why eat junk food? Like, it doesn't taste good.
- [31:03]
B
It does taste good compared to like good sushi.
- [31:07]
A
You could afford good sushi. Someone will bring it.
- [31:11]
B
Really want that chocolate chip cookie at 11:30 at night?
- [31:13]
A
Yeah.
- [31:14]
B
Or at least I do.
- [31:15]
A
Yeah. Do you think there's any kind of alien life on the moons of Saturn? Because I do. That's one of my nutty views.
- [31:23]
B
I have no opinion on the matter.
- [31:24]
A
No opinion on the matter.
- [31:25]
B
I don't know.
- [31:26]
A
Yeah. That's a way of passing the test. What do you think about UAPs? Do you think this is.
- [31:31]
B
I think something's going on there. I don't know.
- [31:33]
A
I think something's going on there.
- [31:34]
B
I have an opinion that there is something that I would like an explanation for. I kind of doubt it's little green men. I extremely doubt it's little green men, but I think someone's got something.
- [31:44]
A
And how many conspiracy theories do you believe in? Because I believe in close to zero, at least in the United States. They may be true for like Pakistani military coups, but I think mostly they're just false.
- [31:56]
B
Like true conspiracy theory. Not just an unpopular belief.
- [31:59]
A
Correct.
- [32:00]
B
You know, I have one of those. What was that, the X File shirts? Like I want to believe. Yeah, I still have one of those shirts from when I was in high school. I. I like, I want to believe in conspiracy. I'm predisposed to believe in conspiracy theories. And I believe in either zero or very few.
- [32:13]
A
Yeah, I'm the opposite of that. I don't want to believe and I believe in very few. Like Maybe the White Sox fixed the World Series way back when.
- [32:20]
B
Yeah, stuff like that. I, I don't quite count that. Like a true massive global government cover up that requires a level of competence to people I just rarely ascribe.
- [32:31]
A
Now some number of years ago, this was before even GPT4. I asked you if you were directing a fund of money to revitalize St. Louis, which is where you grew up, how would you invest the money now? It's a quite different world from when I asked you last time. And if I ask you again to revitalize St. Louis, how would you spend the money? Say it's a billion dollars, which is not actually transformational, but it's enough that it's some real money, a billion dollars.
- [32:59]
B
And I'm willing to go spend personal time on it.
- [33:01]
A
You have free time, the universe grants you free time. You don't take time away from anything else you're doing. You're in charge.
- [33:08]
B
I would go try to start a thing that is like, this is not like a deeply incisive answer because I think this is not a generally replicatable thing, but unique to me. What I could do, I think I would try to go start a Y combinator like thing in St. Louis and get a ton of startup founders focused on AI to move there and start a bunch of companies.
- [33:31]
A
That's a pretty similar answer to last time.
- [33:33]
B
I didn't remember what I said last time, so that's a good sign.
- [33:36]
A
You said the same thing, but you didn't mention AI. But AI to me seems quite clustered. Where we are in the Bay Area. Is trying to get AI into St. Louis the right way to do that? Isn't that in a way working at cross purpose?
- [33:50]
B
I mean, this is why I said it'd be like a unique to me thing. I think I could do it. Maybe that's like hopelessly naive.
- [33:56]
A
Yeah. Should it be legal to just release an AI agent into the wild, unowned, untraceable? Do we need some other AI agent to go out there and tackle it down or is there minimum capitalization? How do you think about that problem?
- [34:10]
B
I think it's a question of thresholds. I don't think you'd advocate that most systems should have any oversight or regulation or legal questions or whatever. But if we have an agent that is going to like capable, like with serious probability of massively self replicating over the Internet and you know, sweeping all the money out of bank accounts or whatever, you would then say, okay, maybe that one needs some like oversight. So I think it's a question of where you draw the threshold for where it should not be.
- [34:40]
A
But say it's hiring the cloud computing from a semi rogue nation, so you can't just turn it off. What actually should we do or will we be able to do? Just try to ring fence it, somehow identify it, surveil it, put sanctions on the country that's sponsoring it or what.
- [34:58]
B
Do we do for people that do that today?
- [35:00]
A
Well, there are a lot of cyber attacks that come from North Korea and I think we can't do that much about them. Right.
- [35:06]
B
My naive take is that I don't know what the right answer is yet, but my take is we should try to solve this problem urgently for people using like rogue Internet resources and AI will just be like a worse version.
- [35:17]
A
Of that problem, but we'll have better defense also.
- [35:19]
B
For sure.
- [35:20]
A
Yeah. Now, if I think about social media and AI, here's one thing I've noticed in my own work. I'm so, so keen to read the answers to my own queries to GPT5. But when people send me the answers to their queries, I'm bored. I don't blame them. Like, I know it's super useful for them, but that makes me a little skeptical about blending social media and AI. Am I missing something or would you try to talk me out of that somehow?
- [35:49]
B
No, I've had the same. I don't want to read your ChatGPT queries.
- [35:53]
A
Yeah, but they're great for me, I'm.
- [35:54]
B
Sure, and I'm sure you don't want to read mine, but they're great for me. So ChatGPT, I think, is very much like a single player experience. I don't think that means there's not some interesting new kind of social product to build. In fact, I'm pretty sure there is. But I don't think it's the like, share your ChatGPT queries videos or what.
- [36:16]
A
Any sense of what that looks like that one's doing?
- [36:18]
B
Well, you know, people clearly like, they love making their own, but they also like watching other people's AI generated videos. But no, I think none of this stuff is the really interesting kind of things you can imagine when you and I and everybody else have like really great personal AI agents that can do stuff on our behalfs. There's, there's probably entirely new social dynamics to think about.
- [36:39]
A
And just the physical form of ChatGPT on my screen or on my smartphone, is that more or less going to stay the same. But the thing will be better or 13 years from now it will physically just be an entirely different beast, because I can talk to it now. Now it does video. And is it just a better version or somehow it morphs?
- [37:01]
B
We are going to try to make you a new kind of computer with a completely new kind of interface that is meant for AI, which I think wants something completely different than the computing paradigm we've been using for the last 50 years that we're currently stuck in. Like, AI is a crazy change to the possibility space. And a lot of the, like, basic assumptions of how you use a computer and the fact that you should even be opening having an operating system or opening a window or sending a query at all are now called into question. I realize that the track record of people saying they're going to invent a new kind of computer is very bad. But if there's one person that you should bet on to do it, I think Johnny Odd is like a credible, maybe the best bet you could take. So we'll see if it works. I'm very excited to try.
- [37:46]
A
But haven't you already been surprised how robust it is that people love typing text into boxes? This sort of shocks me. In the bigger picture, people are still texting all the time. It's one of the most robust forms of Internet anything. And maybe that will just stick forever. And it's a sign of our own limitations. But how do we get past that?
- [38:05]
B
Texting, command lines, search queries. That's my favorite interface.
- [38:09]
A
Yeah, I think, like, you like it, I like it. Maybe we're just going to keep it.
- [38:14]
B
Well, a lot of people use it. Like, people love to text. People like ChatGPT. Like, you know, I, I remember when we were thinking about the interface for ChatGPT, I was like, very set that this was something people would be familiar with and want to use. And I think I just, like, I grew up as like a child of the Internet with a lot of conviction. That was the right kind of Internet. Like, you know, texting was like my life as a teenager.
- [38:40]
A
If you have some kind of ideal arrangement, partnership with an institution of higher education, say within two to three years, what does that look like? You get to write the whole thing.
- [38:51]
B
I suspect that the whole model should change, but I don't know what to like. I think the ideal partnership would look like we try 20 different experiments, we see what leads to the best results. I've been watching these AI schools pop up with great interest. It seems like a lot of them with very different approaches are all showing positive results. But I think the first few years of the ideal partnership would look like we run 20 wildly different experiments.
- [39:19]
A
Sometimes I have the fear that these institutions don't have enough internal reputational strength or credibility to make any major change, forget about AI and that to do a partnership with an institution like that is maybe intrinsically frustrating. And for the next 10 years the actual model is kind of privatized AI use on the side by faculty, by students, by labs. And in a sense there is no partnership other than actually just marketing your product to these people. Do you ever think that might be true?
- [39:49]
B
Yeah, and I don't. It wouldn't like super upset me if that's what happens.
- [39:53]
A
Yeah. What do you think will happen to the returns to a college degree? Not Harvard, not Stanford, but like a quite good State School, five, 10 years out.
- [40:03]
B
What's the historical rate of decline of the value of that recently?
- [40:06]
A
It's gone down though. For a long time it was going up quite a bit.
- [40:10]
B
Yeah. I mean like the last say decade.
- [40:11]
A
Gone down, I don't know how much.
- [40:13]
B
I would kind of guess that it goes down at a slightly higher rate than the last decade, but it does not like collapse to zero as fast as it should.
- [40:23]
A
And then it's the returns to doing what other than learning AI that go up, like being on the college football team or what?
- [40:32]
B
I don't think the returns will, I mean massive returns will accrue to doing AI for a small set of people, but I think the returns to using AI super well will be like surprisingly widely distributed. I am not a believer that the, I think the most important thing AI will do is discover new science for all of us and people will, a lot of people will benefit from that and people will start companies or get jobs doing that. But I am not a believer that that is like the only thing that eventually makes money. I think people will just use AI for all sorts of new kinds of jobs or to do existing jobs better. And you know, maybe the starkest example of this in 2025 is, is what it the day to day of how you know, the average programmer in Silicon Valley did their workflow at the beginning of this year versus the end of this year. Extremely different, extremely different. And you don't really have to know how to program AI to do that, but you now have like, you can get more done and you probably have much more value and the world is going to get much more software. I think we'll see things like that for a surprising number of industries.
- [41:35]
A
But say five years out there's a so called normie person they're not a specialist. They want to learn how to use AI much better. What will they actually do that will give them a high return to acquiring that skill?
- [41:45]
B
To learn. To learn how to use AI specifically.
- [41:48]
A
Yeah. Not program, not the inner guts, just actually in their job.
- [41:52]
B
I'm smiling because I remember when, when I was a kid and Google came out there like I had a job teaching older people how to use Google.
- [41:59]
A
Yeah.
- [42:00]
B
And it felt like a, it just couldn't wrap my head around like I was like, you type the thing in and it does this and you know, a thing that I'm hopeful about for AI is that I think one of the reasons ChatGPT has grown so fast is it is so easy to learn how to use it and get real value out of it.
- [42:16]
A
So we don't need startups to do that.
- [42:17]
B
Or there's such teach people how to use it.
- [42:19]
A
Teach people. Yeah, there is such a startup or what's the institution? My school will teach me. That's hard to believe.
- [42:25]
B
You know, 10% of the world will use ChatGPT this week didn't exist three years ago. I suspect a year from now maybe 30% of people will use ChatGPT that week. People, once they start using it, do find more and more sophisticated things to use it for. This is not a top of mind problem for me, I think. I believe in human creativity and adoption of new things over some period of number of years.
- [42:50]
A
But you might just want to support or invest in the startups that will do this because if you're bullish on AI, presumably you're bullish on those startups and it will help your business in turn. So it seems odd not to have a theory of how we're all going to learn to use AI better. Like you can go to dog trainer school and they teach you how to train a dog.
- [43:07]
B
Okay, maybe I have like a blind spot here and I promise I'll go think about this more. But if you ask ChatGPT, like teach me how to use you.
- [43:15]
A
Yeah, maybe that's it.
- [43:15]
B
It's pretty good.
- [43:16]
A
Yeah. So maybe you're the school.
- [43:18]
B
Maybe.
- [43:18]
A
Yeah. Let's say when your kids are old enough that they're grown, they can go out on their own in that future world, which is not like so far off. Do you think you'll still be reading books or you'll just be interacting with your AI?
- [43:32]
B
Books have survived a lot of other technological chains, so I think there is something deep about the format of a book that has persisted. It's very lindy whatever that current word for that is. But I suspect that there will be a new kind of way to interact with a cluster of ideas that is better than a book for most things. So I don't think books will be gone, but I would bet they're like a smaller percentage of how people like learn a new or interact with a new idea.
- [44:05]
A
And what's the cultural habit you have that you think will change the most? Like oh, I won't watch movies anymore, I'll create my own or whatever for you. AI will obliterate what you did when you were 23.
- [44:19]
B
I mean this is kind of boring. But I think the way I work, you know, where I'm like doing emails and calls and meetings and you know, like writing documents and dealing with slack like that I expect to change hugely. And that has become like a real. And I have like a cultural habit and like a rhythm of my workday at this point. Spending time with my family, like spending time in nature, you know, eating food, my interactions with my friends, that stuff. I sort of expect to change almost not at all. At least not for a very long time.
- [44:54]
A
You think San Francisco will remain the center for AI Putting aside China issues, I just mean for you know, the so called west.
- [45:04]
B
Yeah, I think that's the default.
- [45:05]
A
It's the default. And you think the city is just absolutely making a comeback. It looks much nicer to me. Seems nicer. Am I deluded?
- [45:12]
B
I love this city. I have always. I mean I love the whole Bay Area, I particularly love the city, but I love the Bay Area and I. So I'm like, I don't think I'm like a fair person to ask because I so want it to be making a comeback and to remain the place. I think so. I hope so. But you know, very biased.
- [45:29]
A
AI will improve many things very quickly. But what's the time horizon for it making rent or home prices cheaper? That seems like a tough one. Not the fault of AI but land is land and there's a lot of legal restrictions.
- [45:45]
B
Yeah, I was going to push back on the land is land. There are a lot of other problems that I don't think I can solve anytime soon. I wouldn't. I mean there could be these like very strange second order effects where home prices get much cheaper. But sadly I don't think AI has like a direct attack on solving it anytime soon. Food prices would bet down, but why?
- [46:06]
A
You know, in the short run, energy might be a bit more expensive. How long does it take for food prices to go down?
- [46:12]
B
If they're not down in a decade.
- [46:14]
A
I'd be very disappointed if we think of healthcare. My sense is we're going to spend a lot more on healthcare. We'll get a lot for it because there'll be new inventions. But a lot of the world will feel more expensive because rent won't be cheaper, food. I'm not sure about healthcare. You'll live to age 98, but you'll have to spend a lot more. You'll just be alive more. You were spending, right? So are people just going to think of AI as this very expensive thing or will it be thought of as a very cheap thing that makes life more affordable?
- [46:46]
B
I would bet we spend less on healthcare. I bet there are a lot of diseases that we can just cure or come up with a very cheap treatment for that. Right now we have nothing but expensive chronic stuff that doesn't even work that well. So I would bet healthcare gets cheaper through pharmaceuticals devices, through pharmaceuticals and devices and even like delivery of actual healthcare services. Look, housing is the one to me that just looks so super hard. And there will be other categories of things that we want to get more expensive and of course those will status goods or whatever. But I would take the healthcare goes.
- [47:16]
A
Down but with all the blizzard of new ideas coming, patent law, copyright law, those are based on earlier technologies and earlier models of how the world would work. Do we need to re examine or change those radically for an AI drenched world? Or we can just keep what we have and modify it a bit?
- [47:36]
B
I really have no idea.
- [47:39]
A
I'm a big free speech advocate. But I can imagine the world saying, well, with all this AI driven content, we need to re examine the first Amendment. Do you have a view on that?
- [47:49]
B
I put out a tweet recently about how we're going to be allowing more freedom of expression in ChatGPT.
- [47:57]
A
And this is the famous erotica. Yeah. You know it's funny what people get upset about.
- [48:05]
B
It is funny what animates people.
- [48:06]
A
Because all you're saying is you're not going to stop people, right?
- [48:09]
B
Well, we used to not a long time. I mean, well that's not totally fair. We're going to allow more than we did in the past. But like a very important principle to me is that we treat our adult users like adults and that people have a very high degree of privacy with their AI, which we need legal change for. And also that people have a, you know, very broad bounds of how they're able to use it. And to me this should be one of the easiest things to agree on by like most people in the tech industry or even like most people in the U.S. government, like, this was. I kind of dashed this tweet off and closed my computer and it didn't even like hit my mind that it was going to be like, you know, really a firestorm. It was, it was that we have. We made a decision, which I also think was a fair one over the summer, that because there was, there were new problems and particularly because we wanted to protect teenage users, we were going to heavily restrict ChatGPT, which is also always a very unpopular thing to do. And along with the rolling out of age gating and some of these mental health mitigations, we were going to bring back and in some cases increase freedom of use for adults. I was like, yeah, you know, I'll tell people that's coming because the first, the first model update is shipping soon, but this should be a non issue. And like, boy, did I get that one wrong. So clearly people, I think maybe it's just people don't believe in freedom of expression as much as they they.
- [49:39]
A
That is my opinion.
- [49:40]
B
Yeah, that was kind of my only like, everyone thinks, okay, my own freed expression, I can handle it, I need it. My ideas are all right, but yours.
- [49:47]
A
Like, and for greater privacy rights, is it subpoena power that needs to be changed or something else in addition?
- [49:53]
B
Subpoena power? I believe that we should apply at least as much. Well, let me just say I believe we should apply as much protection as when you talk to your doctor, your human doctor, or your human lawyer as you do when you talk to your AI doctor or AI lawyer.
- [50:08]
A
And right now we don't have that.
- [50:10]
B
Correct.
- [50:11]
A
Do you think there's enough trust in America today for people to trust the AI companies the way we sort of trust doctors, lawyers and therapists?
- [50:20]
B
By revealed preference? Yes.
- [50:21]
A
Yes. By how many people talk to it. LLM psychosis. Everyone on Twitter today is saying it's a thing. How much a thing is it?
- [50:32]
B
I mean, a very tiny thing, but not a zero thing. Which is why we pissed off the whole user base or most of the user base by putting a bunch of restrictions in place. We that treat adult users like adults includes an asterisk, which is people that are treat adults of sound mind like adults. You know, society decides that we treat adults that are having a psychiatric crisis differently than other adults. And when we saw it is one of these things that you learn as you go. But when we saw that the kind of like put ChatGPT into role playing mode or you know, Pretend like it's writing a book and have it encourage someone in delusional thoughts. 99 point some big number percentage of adults totally fine with that. Some tiny percentage of people. Also, if they talk to another person who encourages delusion, it's bad. So we made a bunch of changes which are in conflict with the freedom of expression policy. And now that we have those mental health mitigations in place, we'll again allow some of that stuff in creative mode, role playing mode, writing Mode, whatever. Of ChatGPT, I the thing I worry about is not that, you know, there will be a few basis points of people that are like close to losing grips with reality and we can trigger a psychotic break and we can get that right. The thing I worry about more is it's funny, the things that like stick in your mind. Someone said to me once, like, never ever let yourself believe that propaganda doesn't work on you. They just haven't found the right thing for you yet. And again, I have no doubt that we can't address the clear cases of people near a psychotic break. But for all of the talk about AI safety, I kind of would divide most AI thinkers into these two camps of okay, it's the bad guy uses AI to cause a lot of harm, or it's the AI itself is misaligned, wakes up whatever, intentionally takes over the world. There's this other category that gets third category that gets very little talk that I think is sort of much scarier and more interesting, which is the AI models accidentally take over the world. It's not that they're going to induce psychosis in you, but if you have the whole world talking to this one model, it's like not with any intentionality, but just as it learns from the world in this kind of continually co evolving process, it just subtly convinces you of something. No intention just does learned that somehow. And that's like not as theatrical as chatbot psychosis, obviously, but I do think about that a lot.
- [53:02]
A
Maybe I'm not good enough, but as a professor, I find people pretty hard to persuade. Actually, I worry about this less than many of my AI related friends do.
- [53:10]
B
I hope you're right.
- [53:11]
A
Yeah, last question. On matters where you can speak publicly at the margin, if you could call in an expert to help you resolve a question in your mind of substance, what would that question be?
- [53:23]
B
I have an answer to this ready to go, but only because I got asked to. Well, maybe I'll tell the story right after it. There will come this is like a kind of take this spiritually not literally. There will come a moment where the super intelligence is built, it is safety tested, it is ready to go. It is going to like, you know, we'll still be able to supervise it, but it's going to do just like vastly incredible things. It's going to be self improving, it's going to launch the probes to the stars, whatever. And you get the opportunity to type in the prompt before it does, before you say, okay. And the question is, what should you type in?
- [54:02]
A
And do you have a tentative answer now?
- [54:05]
B
No, I don't. The reason that I had that ready to go in mind is someone was going to see the Dalai Lama and said, I'll ask any question about AI you want. And I was like, what a great opportunity. So I thought really hard about. And that was my question.
- [54:16]
A
Sam Altman, thank you very much.
- [54:18]
B
Thank you.
- [54:24]
A
Thanks for listening to Conversations with Tyler. You can subscribe to the show on Apple Podcasts, Spotify or your favorite podcast app. If you like this podcast, please consider giving us a rating and leaving a review. This helps other listeners find the show on Twitter. I'm TylerCowen and the show is OwenConvos. Until next time, please keep listening and learning.