
Loading summary
Marc Andreessen
Something about AI that causes the people in the field, I would say, to become both excessively utopian and excessively apocalyptic. Having said that, I think what's actually happened is an enormous amount of technical
Ben Horowitz
progress that built up over time.
Marc Andreessen
And like, for example, we now know
Ben Horowitz
the neural network is the correct architecture.
Marc Andreessen
And I will tell you, like, there was a 60 year run where that
Ben Horowitz
was like a, you know, or even 70 years where that was controversial.
Marc Andreessen
And so, so the way I think
Ben Horowitz
about what's happening is basically, I think, I think about basically the period we're in right now is it's, I call it 80 year overnight success, right?
Marc Andreessen
Which is like, it's an overnight success because it's like bam, you know, chatgpt hits and then 01 hits and then, you know, openclaw hits and like, you know, these are open. These are, these are like overnight, like radical, overnight transformative successes. But they're drawing on an 80 year
Ben Horowitz
sort of wellspring backlog, you know, of ideas and thinking.
Marc Andreessen
It's not just that it's all brand
Ben Horowitz
new, it's that it's an unlock of all of these decades of like, very serious hardcore research. If I were 18, like, this is 100. This is what I would be spending all of my time on. This is like such an incredible conceptual breakthrough.
Podcast Host (possibly from 16Z or Lydian Space)
Before we get into today's episode, I just have a small message for listeners. Thank you. We will not be able to bring you the AI engineering, science and entertainment content that you so clearly want if you didn't choose to also click in and tune into our content. We've been approached by sponsors on an almost daily basis, but fortunately, enough of you actually subscribe to us to keep all this sustainable without ads, and we want to keep it that way. But I just have one favor to ask all of you. The single most powerful, completely free thing you can do is to click that subscribe button. It's the only thing I'll ever ask of you and it means absolutely everything to me and my team that works so hard to bring the inspace to you each and every week. If you do it, I promise you, we'll never stop working to make the show even better. Now, let's get into it.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Hey, everyone. Welcome to the Lydian Space Podcast. This is Alessio, founder of Kernel Labs, and I'm. I'm joined by Sprix, editor of Late in Space.
Podcast Host (possibly from 16Z or Lydian Space)
Hello. And we're in a 16Z with a. Marc and Giesen, welcome.
Marc Andreessen
Yes, Yes. A and What? Half of 16? Something like that?
Podcast Host (possibly from 16Z or Lydian Space)
A1.
Marc Andreessen
Exactly.
Podcast Host (possibly from 16Z or Lydian Space)
Apparently this is the final few days in your current office. You're moving across the road.
Ben Horowitz
We have some projects underway.
Marc Andreessen
But yeah, actually this is the original.
Ben Horowitz
We're in actually the original office. We're in the whole thing.
Podcast Host (possibly from 16Z or Lydian Space)
It's beautiful.
Marc Andreessen
Great. Thank you.
Podcast Host (possibly from 16Z or Lydian Space)
So I have to come out. This is a. You know, I wanted to pick a spicy start in October 2022. I just made friends with Run and I wanted to give him something to sort of be spicy about. And I said, it'll never not be funny that a 16Z was constantly going, the future is where the smart people choose to spend their time. And then going deep into crypto and not in AI. And that was in October 2022. And Rune says there was an internal meeting at A16Z to reorient around Genai. Obviously you have. But was there a meeting? What was that?
Marc Andreessen
I mean, I don't. Look, I've been doing AI since the
Ben Horowitz
late 80s, so I don't know.
Marc Andreessen
As far as I'm concerned, this stuff
Ben Horowitz
is all Johnny come lately.
Marc Andreessen
Yeah, I mean, look, we've been doing
Ben Horowitz
AI our entire existence. I mean, we've been doing AI machine learning deeply. We've been doing this stuff way from the beginning.
Marc Andreessen
Obviously, AI is just core to computer science.
Ben Horowitz
I actually view them as quite continuous. Ben and I both have computer science degrees.
Marc Andreessen
Ben and I actually both are old
Ben Horowitz
enough to remember the actual AI boom in the 1980s. There was a big AI boom at the time, and there was one under names like Expert Systems and the era of Lisp and Lisp machines. I coded in Lisp. I was coding in Lisp in 1989 when that was the language of the AI future.
Marc Andreessen
Yeah.
Ben Horowitz
So this is something that we're completely comfortable with and been doing the whole time and are very enthusiastic about.
Podcast Host (possibly from 16Z or Lydian Space)
Is there a strong. Like this time as different? Because my closest analog was 2016. 17 milsors on the AI boom. And it petered out very, very quickly
Marc Andreessen
just in terms of investment, sort of.
Ben Horowitz
Sort of investment excitement.
Marc Andreessen
Although that's really when the Nvidia phenomenon really, I would say it was in that period when it was very clear
Ben Horowitz
that at the time the vocabulary was more machine learning.
Marc Andreessen
But it was very clear at that
Ben Horowitz
time that machine Lear was hitting some sort of takeoff point.
Marc Andreessen
Well, and as you guys.
Ben Horowitz
You guys have talked about this at length on your thing, but, you know, if you really track what happened, I think the real story is it was the Alexnet basically breakthrough in like 2013. That was the real knee in the curve. And then it was Obviously the transformer breakthrough in 17 and then everything that followed.
Marc Andreessen
But you know, look, machine learning, you know, there were, you know, look, I mean, look, I've been working, you know,
Ben Horowitz
I've been working with one of my, you know, kind of projects, working with Facebook since 2004 and on the board since 2007. And of course, you know, they started using machine learning very early and you know, have used it basically, you know, for like 20 years for content feed optimization and advertising optimization and obviously many financial services, many companies, many different sectors have been doing this.
Marc Andreessen
And so it's like one of these things.
Ben Horowitz
It's not a single thing. It's like layers, right? And the layers arrive at different paces, but they kind of build up. They kind of build up over time. And then look, in retrospect, it was 2017 was kind of the key point with the transfer transformer.
Marc Andreessen
And then, as you guys know, there
Ben Horowitz
was this really weird four year period where it's like the transformer existed and then it was just like, let's go.
Marc Andreessen
Yeah, well, but between 2017 and 2021, I mean, that was the era of which, like companies like Google had internal
Ben Horowitz
chatbots, but they weren't letting anybody use them. And then OpenAI developed chat GPT2 and then they told everybody, this is way too dangerous to deploy. We can't possibly let normal people use this thing.
Marc Andreessen
And then you guys, I'm sure, remember AI dungeon. So there was like a year where
Ben Horowitz
the only way for a normal person to use GPT3 was in an AI dungeon.
Marc Andreessen
Yeah.
Ben Horowitz
And so we would do this. You'd go in there and you'd pretend to play Dungeons and Dragons. In reality, you're just trying to talk to GPT.
Marc Andreessen
And so there was this long.
Ben Horowitz
Big companies are cautious. And the big companies were cautious.
Marc Andreessen
By the way, it took open AI. They talk about this.
Ben Horowitz
It took OpenAI time to actually adjust, kind of redirect their research path.
Podcast Host (possibly from 16Z or Lydian Space)
I think it was at Rosewood. Right. The dinner that founded OpenAI was right there.
Marc Andreessen
But that dinner would have taken place in 2018. The formation of OpenAI as late as 2018.
Podcast Host (possibly from 16Z or Lydian Space)
Sorry, no, I'm wrong. They just celebrated a 10 year anniversary. So it is 2025.
Ben Horowitz
Yeah.
Podcast Host (possibly from 16Z or Lydian Space)
So 2015.
Marc Andreessen
Yeah, 2015. Yeah, 2015. But then Alec Radford did GPT1 in
Ben Horowitz
what, probably 17, 18. 17 18.
Marc Andreessen
And then they didn't really.
Ben Horowitz
And then GPT3 was what, 2020.
Podcast Host (possibly from 16Z or Lydian Space)
20 2020. Because that became copilot immediately.
Marc Andreessen
Even OpenAI, which has been the leader
Ben Horowitz
of this thing in the last Decade even, they had to adapt and lean.
Marc Andreessen
And so, yeah, I think it's just
Ben Horowitz
this process of basically sort of wave after wave, layer after layer building on itself.
Marc Andreessen
And then you kind of get these
Ben Horowitz
catalytic moments where the whole thing pops. And obviously that's what's happening now.
Podcast Host (possibly from 16Z or Lydian Space)
Is it useful to think about, will there be an AI winter? Because there's always these patterns, like, is this endless summer? It's something I constantly think about because do I just get endlessly hyped and just trust that I will only be early and never wrong, or will there be a winter?
Marc Andreessen
So there's something about, say the following. There's something about AI that has led
Ben Horowitz
to this repeated pattern. And you guys know this summer, winter,
Marc Andreessen
summer, winter, summer, winter, summer, winter. And it goes back 80 years. 80 years.
Ben Horowitz
So the original neural network paper was 1943, which is amazing that it was far back that long.
Marc Andreessen
And then there was, if you guys
Ben Horowitz
have ever talked about this on your show, but There was an AGI conference at Dartmouth University in 1956, 55, and they got an NSF grant for all the AI experts at the time to spend the summer together. And they figured if they had 10 weeks together, they could get AGI out the other end.
Marc Andreessen
And they got their, by the way, they got the grant, they got the
Ben Horowitz
10 weeks, and then 1955, no AGI.
Marc Andreessen
And like I said, I lived through
Ben Horowitz
the 80s version of this where there was a big boom and a crash.
Marc Andreessen
And so there is this thing, there is something about AI that causes the people in the field, I would say, to become both excessively utopian and excessively apocalyptic.
Ben Horowitz
And it's probably on both sides of the boom bust cycle. You kind of see that play out.
Marc Andreessen
Having said that, I think what's actually
Ben Horowitz
happened is just we now know in
Marc Andreessen
retrospect an enormous amount of technical progress
Ben Horowitz
that built up over time.
Marc Andreessen
For example, we now know the neural
Ben Horowitz
network is the correct architecture.
Marc Andreessen
And I will tell you, there was a 60 year run where that was
Ben Horowitz
even 70 years where that was controversial.
Marc Andreessen
And we now know that that's the case. And so everything we're building on today
Ben Horowitz
derives from the original idea in 1943.
Marc Andreessen
So in retrospect, we now know that these guys were right. They would get the timing wrong and
Ben Horowitz
they thought capabilities would arrive faster or it could be turned into businesses sooner or whatever.
Marc Andreessen
But they were fundamentally, the scientists who
Ben Horowitz
worked on this over the course of
Marc Andreessen
decades were fundamentally correct about what they were doing.
Ben Horowitz
And the payoff from all their work is happening now.
Marc Andreessen
The way I about what's happening is
Ben Horowitz
basically, I think about, basically the period we're in right now is it's, I call it 80 year overnight success, which
Marc Andreessen
is like, it's an overnight success because it's like bam. ChatGPT hits and then 01 hits and then openclaw hits. And these are overnight, radical, overnight transformative successes. But they're drawing on an 80 year
Ben Horowitz
sort of wellspring backlog of ideas and thinking.
Marc Andreessen
It's not just that it's all brand
Ben Horowitz
new, it's that it's an unlock of all of these decades of very serious hardcore research and thinking.
Marc Andreessen
Look, there were AI researchers who spent their entire lives, they got their PhD, they researched for 40 years, they retired. In a lot of cases, they passed
Ben Horowitz
away and they never actually saw it work.
Podcast Host (possibly from 16Z or Lydian Space)
So sad.
Marc Andreessen
It is sad. It is sad.
Podcast Host (possibly from 16Z or Lydian Space)
Hinton was like the last guy.
Marc Andreessen
Yeah, well, there were the guys, Alan Newell, I mean, there's tons of John McCarthy. John McCarthy was one of the inventors of the field. He's one of the guys who organized
Ben Horowitz
the Dartmouth conference and he taught at Stanford for 40 years and passed away, I don't know, whatever, 10 years ago or something. Never actually got to see it happen.
Marc Andreessen
But it is amazing in retrospect.
Ben Horowitz
These guys were incredibly smart and they worked really hard and they were correct.
Marc Andreessen
So anyway, so then it's like, okay,
Ben Horowitz
as they say, history doesn't repeat, but it rhymes.
Marc Andreessen
It's like, okay, does that mean that
Ben Horowitz
there's going to be another basically, boom, bust cycle?
Marc Andreessen
And I will tell you, look, in a sense, yes, everything goes through cycles
Ben Horowitz
and people get overly enthusiastic and overly depressed and there's a timelessness to that.
Marc Andreessen
Having said that, there's just no question. So the format, the four most dangerous
Ben Horowitz
words in this time is different.
Marc Andreessen
Do you know the 12 most dangerous words of investing?
Podcast Host (possibly from 16Z or Lydian Space)
No.
Marc Andreessen
The four most dangerous words in investing are this time is different.
Ben Horowitz
The 12 most dangerous words.
Marc Andreessen
And so like, I'll tell you what's different. Like now it's working like, like there's just no, I mean, look, there's just no question. And by the way, I'll just give you guys my take, like LLMs, like from, from basically the ChatGPT moment through to spring of 25. I think you could still, I think well intentioned, well informed skeptics could, oh, this is just pattern completion.
Ben Horowitz
And oh, these things don't really understand what they're doing and the hallucination rates are way too high. And this is going to be great for creative writing and creating. Shakespearean sonnets as rap lyrics or whatever, it's going to be great at all that stuff. But we're not going to be able to harness this, to make this relevant in coding or in medicine or in law or in fields that really matter. And I think basically it was the reasoning breakthrough, it was 01 and then R1 that basically answered that question and basically said, oh no, we're going to be able to actually turn this into something that's going to work in the real world. And then obviously the coding breakthrough over, basically the coding breakthrough that kind of catalyzed over the holiday break was kind of the third step in that. But he was like, all right, if Linus Torvalds is saying that the AI coding is now better than he is,
Marc Andreessen
that's never happened before. That's the benchmark that's never happened before. And so now we know that it's
Ben Horowitz
going to sweep through coding and then
Marc Andreessen
we know that if it's going to
Ben Horowitz
work in coding, it's going to work in everything else. Right? It's just because that's like the hardest in many ways. That's the hardest example. And now everything else is going to be a derivative of that.
Marc Andreessen
And then on top of that, we
Ben Horowitz
just got the agent breakthrough with openclaw, which is fantastic, which is amazing and incredibly powerful. And then we just got the auto research, the self improvement. We're now into the self improvement breakthrough.
Marc Andreessen
So the way I think about it
Ben Horowitz
is we've had four fundamental breakthroughs in functionality, LLMs, reasoning agents, and then now RSI and they're all actually working. And so I'm just, as you can
Marc Andreessen
tell, I'm jumping out of my shoes. This is it.
Ben Horowitz
This is the culmination of 80 years worth of work. And this is the time it's becoming real. I'm completely convinced.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
I think the anxiety that people feel is like during the transistor era, you had Moore's Law and it's like, all right, we understand why these things are getting better. We understand the physics of it. With AI, it's so jagged in the jumps, like you said, it's like in three months you have this huge jump and people are like, well, this can keep happening, right? But then it keeps happening, it'll keep happening. And so how do you think about also timelines of what we're building? I think we always have this question, we guess, which is like, you know, should you spend time building harness for a model versus like the next model just going to do it one shot in the leading space? And how does that inform how you think about the shape of the technology. You know, you talk about how it's a new computing platform. If you have a computing platform, then like every six months it like drastically changes in what it looks like. It's hard to build companies on top of it.
Marc Andreessen
Yeah. So a couple of things. So one is like, look, Moore's law was what we now call a scaling law.
Ben Horowitz
Like Moore's Law was a scaling law. And for your younger viewers, Moore's law was every chip, chips either get twice as powerful or twice as cheap every 18 months.
Marc Andreessen
And it's gotten more complicated in the last few years.
Ben Horowitz
But that was the 50 year trajectory of the computer industry.
Marc Andreessen
And then by the way, and that's
Ben Horowitz
what took the mainframe computer from a $25 million current dollar thing into the phone in your pocket, being a million times more powerful than that for 500 bucks.
Marc Andreessen
And so that was a scaling law. And then key to any scaling law, including Moore's law and the AI scaling
Ben Horowitz
laws, is they're not really laws. Right. They're predictions.
Marc Andreessen
But when they work, they become self fulfilling predictions because they set a benchmark
Ben Horowitz
and then the entire industry, all the smart, the industry kind of work to make sure that actually happens.
Marc Andreessen
And so they kind of motivate the
Ben Horowitz
breakthroughs that are required to keep that going.
Marc Andreessen
And in chips that was a 50 year, that was a 50 year run.
Ben Horowitz
Right. And it was amazing. And it's still happening in some areas of chips.
Marc Andreessen
I think the same thing is happening
Ben Horowitz
with the core scaling laws. The core scaling laws in AI, they're
Marc Andreessen
not really laws, but they are basically, they're predictions.
Ben Horowitz
And then they're motivating catalysts for the research work that is required to be and by the way, also the investment dollars required to basically keep the curves going.
Marc Andreessen
And look, it's going to be complic
Ben Horowitz
and it's going to be variable and there are going to be walls that are going to look like they're fast approaching and then they're going to be, engineers are going to get to work and they're going to figure out a way to punch through the walls. And obviously that's been happening a lot.
Marc Andreessen
And then look, there's going to be
Ben Horowitz
times when it looks like the walls have, the laws have petered out and then they're going to pick up again and surge. And then it appears what's happening to the eye is there's now multiple scaling laws, there's multiple areas of improvement, and I think, I don't know how many more there are already yet to be discovered. But there are probably some more that we don't know about yet.
Marc Andreessen
For example, there's probably some scaling law
Ben Horowitz
around world models and robotics that we don't fully understand. Kind of acquisition of data at scale in the real world that we don't fully understand yet. So that one will probably kick in at some point here. There's a bunch of really smart people working on that.
Marc Andreessen
And so, yeah, I think the expectation
Ben Horowitz
is that the scaling laws generally are going to continue.
Marc Andreessen
Yeah, the pace of improvement will continue to move really fast to your question on what to build. So I'm a complete believer the scaling
Ben Horowitz
laws are going to continue. I'm a complete believer the capabilities are going to keep getting amazing leaps and bounds.
Marc Andreessen
The part where I kind of ways
Ben Horowitz
a little bit with what I describe as the AI purists, which I would characterize as the people who are in
Marc Andreessen
many ways the smartest people in the
Ben Horowitz
field, but also the people who spend their entire life at a lab and I would say have very little experience in the outside world. The nuance I would offer is the outside world of 8 billion people and institutions and governments and companies and economic systems and social systems is really complicated. And 8 billion people making collective decisions on planet Earth is not a simple process of.
Marc Andreessen
Just like, you see this happening now,
Ben Horowitz
it's like a bunch of the AI CEOs have this thing which is just
Marc Andreessen
like, well, there's just this. They just all have this kind of
Ben Horowitz
thing when they talk in public where they're just like, well, there's these obvious set of things that society needs to do.
Marc Andreessen
And then they're like, society's not doing any of those things, right? And it's like, how can society not, you know, whatever their theory is, how can society not see XYZ? And the answer is, well, society is number one. There's no single society.
Ben Horowitz
It's like 8 billion people. And they like all have a voice and they all have a vote, like at the end of the day of how they react to change. And then, you know, it just like, it's just human reality is just really complicated and messy.
Marc Andreessen
And so the specific answer to your
Ben Horowitz
question is like, as usual, it depends.
Marc Andreessen
It depends. Look, there's no question people are going
Ben Horowitz
to like, there's no question they're going to be companies.
Marc Andreessen
It's already happening. There are companies that think that they're
Ben Horowitz
building value on top of the models and they're just going to get blitzed by the next model. There's no question that's happening.
Marc Andreessen
But I think there's no question also
Ben Horowitz
that just the process of adaptation of any technology into the real messy world of humanity is just going to be messy and complicated. It's not going to be simple and straightforward. It's going to be messy and complicated.
Marc Andreessen
And there are going to be a
Ben Horowitz
lot of companies and a lot of products, in fact entire industries that are going to get built to basically actually help all of this technology actually reach real people.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
The amount of capital going into these companies. I mean, Dario talked about it on the Door Cash podcast and Door Cash was like, why don't you just buy 10x more GPUs? And he's like, because I'm going to go bankrupt if the model doesn't exactly hit the performance level. How do you think about that? Also as a risk on you guys are investors in OpenAI and thinking machines and world apps, it seems like we're leveraging the scaling laws at a pretty high rate. How comfortable, I guess do you feel with the downside scenario? Say things peter out. You think you can kind of restructure these build outs and capital investments.
Marc Andreessen
Yeah. So I should start by saying so I lived through the dot com crash
Ben Horowitz
and I can tell you stories for hours about the dot com crash and it was horrible. No, it was awful. It was apocalyptic.
Marc Andreessen
By the way, a lot of the
Ben Horowitz
dot com crash was actually, at the time, it was actually a telecom crash. It was a bandwidth crash. The thing that actually crashed that wiped out all the money was the telecom companies. Global crossing.
Podcast Host (possibly from 16Z or Lydian Space)
Yeah, I'm from Singapore. And they laid so much cable over our oceans.
Marc Andreessen
Actually there was a scaling law in
Ben Horowitz
the.com era and it was literally the U.S. commerce Department put out a report in 1996 and they said Internet traffic was doubling every quarter.
Marc Andreessen
Actually in 1995 and 1996, Internet traffic
Ben Horowitz
actually did double every quarter. And so that became the scaling law.
Marc Andreessen
So what all these telecom entrepreneurs did
Ben Horowitz
was they went out and they raised money to build fiber, anticipating that the demand for bandwidth is going to keep doubling every quarter.
Marc Andreessen
Quarter doubling every quarter, though, is like
Ben Horowitz
grains of chess on the chessboard. Like at some point the numbers become extremely large.
Marc Andreessen
Right. And really what happened was the Internet,
Ben Horowitz
by the way, continuously kept growing, basically since inception. It's continuously grown, it's never shrunk, and
Marc Andreessen
it's grown really fast compared to anything
Ben Horowitz
else in human history. But it wasn't doubling every quarter as of 1998, 1999. And so there was this gap in the expectation of what they thought was a scaling law. Versus reality.
Marc Andreessen
And that's actually what caused the dot
Ben Horowitz
com crash, which was companies like Global Crossing way overbuilt fiber, which is sort
Marc Andreessen
of by the way, fiber, telecom equipment.
Ben Horowitz
So all the networking gear and then
Marc Andreessen
by the way, the actual physical data
Ben Horowitz
centers, that was the beginning of the data center build and then data center overbuild.
Marc Andreessen
And so you had that. But it was literally, I think it was like $2 trillion got wiped out, right? It was like a big. And by the way, the other subtlety in it was the Internet companies themselves
Ben Horowitz
never really had any debt because tech companies generally don't run on debt, but
Marc Andreessen
the telecom companies run on debt, physical
Ben Horowitz
infrastructure companies run on debt.
Marc Andreessen
And so the companies like Global Crossing
Ben Horowitz
not just raised a lot of equ, they also raised a lot of debt.
Marc Andreessen
So they're highly levered. And so then you just do the thing.
Ben Horowitz
It's just like, okay, you have a highly levered thing where you're overbuilding capacity,
Marc Andreessen
demand is growing, but not as fast
Ben Horowitz
as you hoped, and then boom, bankrupt. And then it's like they say about the hotel industry, which is it's always the third owner of a hotel that
Marc Andreessen
makes money, it has to go bankrupt twice. You have to wash out all of
Ben Horowitz
the over optimistic exuberance before it gets to actually a stable state and then it makes money.
Marc Andreessen
So by the way, all of those data centers and all of those, all the fiber that they're in use, it's all in use today, but 25 years later. But actually the elapsed time was it took 15 years, it took 15 years
Ben Horowitz
from 2000 to 2015 to actually fill up all the capacity.
Marc Andreessen
The cautionary warning is the overbuilt can happen.
Ben Horowitz
And you get into this thing where basically everybody who basically has any sort of institutional capital is like, wow, it's just, I don't know how to invest in these crazy software things. But for sure I can build data centers and for sure I can buy GPUs and I can deploy compute grids and all these things.
Marc Andreessen
And so if you're a pessimist, you
Ben Horowitz
could look at this and you could
Marc Andreessen
say, wow, this is really set up
Ben Horowitz
to be able to basically replicate, you know, what we went through, what we went through in 2000. Obviously that would be bad.
Marc Andreessen
The counterargument, which is the one I agree with, which is the counter on
Ben Horowitz
the other side, is a couple of things.
Marc Andreessen
One is the companies that are investing, all the companies that are investing the
Ben Horowitz
money are like the bluest chip of companies.
Marc Andreessen
And so back in the global Crossing
Ben Horowitz
it was like an entrepreneur, it was like a new venture. But the money that's being deployed now at scale is Microsoft and Amazon and Google, Facebook and Facebook and Nvidia and these. And now, by the way, OpenAI and Anthropic, which are now at really serious software as companies with very serious revenue. These are very large scale companies with lots of cash, lots of debt, capacity that they've never used. And so this is institutional in a way that that really wasn't at the time.
Marc Andreessen
And then the other is, at least for now, every dollar that's being put
Ben Horowitz
into anything that results in a running GPU is being turned into revenue right away. And you guys know this.
Marc Andreessen
Everybody starved for capacity.
Ben Horowitz
Everybody starved for compute capacity and then all the associated things, memory and interconnect and everything else, data center space. And so every dollar right now that's being put in turning into revenue.
Marc Andreessen
And in fact, I actually think there's
Ben Horowitz
an interesting thing happening which is because
Marc Andreessen
everybody starved for capacity, the models that
Ben Horowitz
we actually have that we can use today are inferior versions of what we would have if not for the supply
Marc Andreessen
Constraints pose a hypothetical universe in which
Ben Horowitz
GPUs were 10 times cheaper and 10 times more plentiful.
Marc Andreessen
The models would be much better because
Ben Horowitz
you would just allocate a lot more money to training and you'd just build better models and they would be better.
Marc Andreessen
And so we're actually getting the sandbag
Ben Horowitz
version of the technology.
Podcast Host (possibly from 16Z or Lydian Space)
No, everything we use is quantized because the labs have to keep the full versions.
Marc Andreessen
We're not even getting the good stuff, but getting the good stuff, even if technical progress stops once there's a much
Ben Horowitz
bigger build of GPU manufacturing capacity and memory, all the things that have to happen in the course of the next
Marc Andreessen
five or ten years, once it happens,
Ben Horowitz
even the current technology is going to get much better.
Marc Andreessen
And then, as you know, there's just a million ways to use this stuff.
Ben Horowitz
There's just a million use cases for this. This isn't just sending packets across a thing, whatever, and hoping that people find something to do with it. This is just like, oh, we apply Intellig in every domain of human activity. And then it works like incredibly well. Here's what I know, here's what I know.
Marc Andreessen
In the next three or four year,
Ben Horowitz
it's like somewhere between three or four years out, basically everything is selling out. So like the entire supply chain is sold out or selling out. And so there's no like, we're just going to have like chronic supply shortage for, you know, for Years to come,
Marc Andreessen
there's going to be a response from
Ben Horowitz
the market that's going to result in an enormous, you know, it's happening now an enormous flood of investment in a new fab capacity and, you know, everything else to be able to do that at some point the supply chain constraints will unlock, you know, at least to some degree that will be another accelerant to industry growth when that happens, because the products will get better and everything will get cheaper.
Marc Andreessen
And so I know that's going to happen. I know that, you know, the deployments,
Ben Horowitz
you know, the actual use cases are like really compelling. And then like I said, you know, with reasoning and agents and so forth. Like, I know they're just going to get like much, much better from here. And so I know the capabilities are like really real and serious. I also know that the technical progress is not going to stop, is accelerating. Like, the breakthroughs are tremendous. I mean, even just month over month, the breakthroughs are really dramatic.
Marc Andreessen
And so, you know, I think if you were a cynic and there are cynics, you can look at 2000, you can find echoes.
Ben Horowitz
But I can't even imagine betting that this is going to somehow disappoint, at least for years to come. I think it would be essentially suicidal to make that bet.
Marc Andreessen
Is it Michael Burry?
Podcast Host (possibly from 16Z or Lydian Space)
That's an interesting guy.
Marc Andreessen
We'll pick on a guy. Let's pick on one guy. Well, because he did, he came out with, he doesn't mind. It was the Nvidia short, right? He came out with the Nvidia short. And then you guys probably talked about this. The analysis now that the current models
Ben Horowitz
are getting better, faster at such a rate that if you're running an Nvidia inference chip today that's three years old, you're making more money on it today than you did three years ago.
Marc Andreessen
Because the pace of improvement of the
Ben Horowitz
software is faster than the depreciation cycle of the chip. And then my understanding is Google is running, I don't know exactly what these are rumors that I've heard, or maybe it's public, but I think Google's running very old tpus very profitably and very profitably.
Marc Andreessen
And so it actually turns out, as far as I can tell, it's actually
Ben Horowitz
the opposite of the Burry thesis is actually he was actually 180 degrees wrong. It's actually the old Nvidia chips are getting more valuable, which is something that's
Marc Andreessen
literally never happened before. It's never been the case that you
Ben Horowitz
have an older model chip that becomes more Valuable, not less valuable.
Marc Andreessen
And again, that's an expression of that
Ben Horowitz
just ferocious pace of software progress, ferocious pace of capability payoff that you're getting on the other side of this.
Marc Andreessen
And so I just, the idea of betting against that, like, yeah, it's like
Ben Horowitz
an invitation to get your face ripped off.
Podcast Host (possibly from 16Z or Lydian Space)
One of my early hits was like modeling the lifespan of the H100 and H2 hundreds and going like, you know, usually they advise like four to seven years and it was, you know, maybe you sort of realistically care, cut it down to 2 to 3, but actually it's going to up and not down. I think that's the dream. We are finding utilization and I think utilization solves all problems. You can find use cases for even memory. We're having a shortage, right? And even the shittier versions of memory that we do have, we are finding use cases for it. So that's great.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
How important is open source AI and kind of like edge inference in a world in which you have three years of supply crunch, do you think in the, if you fast forward like five years, like how do you think about inference in the data center versus at the edge?
Marc Andreessen
Well, so just to start. Yeah, so I think, I think open
Ben Horowitz
source is very important for a bunch of reasons. I think edge inference is very important for a bunch of reasons. I think just practically speaking, if we're just going to have fundamental construct supply crunches for the next, I mean, you guys know, if you just project forward demand over the next three years relative
Marc Andreessen
to supply, one of the main predictions
Ben Horowitz
you can do is what's going to, what's going to happen to the cost of inference in the core over the next three years and like it may rise dramatically, right?
Marc Andreessen
Like, so what is, and then is,
Ben Horowitz
you know, like the big model competitors are subsidizing heavily right now, right?
Marc Andreessen
And so what will be the average
Ben Horowitz
person's, you know, per day, per month token cost, you know, three years from now to do all the things that they want to do. And I don't know, it's going to be, I mean, you guys probably have friends. I have friends today who are paying $1,000 a day for OpenClaw for claw tokens to run OpenClaw, right? And so, okay, $30,000 a month, right.
Marc Andreessen
And by the way, those friends have
Ben Horowitz
like a thousand more ideas of the things that they want their claw to do, right? And so you could imagine there's like latent demand of up to, I don't know, five or 10,000 a day of tokens for a fully Deployed personal agent.
Marc Andreessen
And obviously consumers can't pay that, but it gives you a sense of the
Ben Horowitz
future scope of demand.
Marc Andreessen
And so Even if there's a 10x
Ben Horowitz
improvement in price performance, that still goes to $100 a day, which is still way beyond what people can pay.
Marc Andreessen
So there's just going to be ferocious demand. By the way, the agent thing, the other interesting thing is I think the agent thing. So up until now a lot of
Ben Horowitz
the constraints have been GPU constraints. I think the agent thing now also translates into CPU constraints. Constraints.
Podcast Host (possibly from 16Z or Lydian Space)
CPU and memory.
Ben Horowitz
Yes, CPU and memory. Right.
Marc Andreessen
And so like the entire chip ecosystem
Podcast Host (possibly from 16Z or Lydian Space)
is just going to get wait for network constraints. That would be the killer.
Ben Horowitz
It's all bottlenecked potentially for years.
Marc Andreessen
And so I think that Brad and I think it's actually possible, I mean generally inference costs are going to keep coming down.
Ben Horowitz
But I think, let's put it this way, the rate of decline I think may level out here for a bit because of these supply constraints.
Marc Andreessen
And then at some point maybe the
Ben Horowitz
lab stops subsidizing so much and that again will be an issue.
Marc Andreessen
And so there's just going to be so much more demand for inference than
Ben Horowitz
can be satisfied kind of with the centralized model. And then you guys know this, but like all the, just the dramat, I mean just the dramatic innovations that have happened in the Apple silicon to be able to do inference is quite amazing. The level of effort being put, like the open source guys are putting incredible effort into getting, you know, this recurring pattern where the big model will never run on a PC and then six months later, oh, it runs on a PC.
Marc Andreessen
Right.
Ben Horowitz
It's like amazing. And there's very smart people working on that.
Marc Andreessen
So there's all that. And then look, there's also, you know,
Ben Horowitz
there's also like other, there's other motivators. There's other motivators which is just like, okay, how much trust are the big centralized model providers? You know, how much trust are they building in the market versus, you know, how much are, you know, at least for in certain cases with some people, for certain use cases is people being like, well, I'm not willing to just like turn everything over. So there's all the trust issues by the way. There's also just like straight up price optimization. There's many uses of AI where you don't need Einstein in the cloud, you just need like a smart local model. There's also performance issues where you want to, you know, you want, you know, you're going to want your doorknob to have an AI model in it, you know, to be able to, you know, do you know, to be able to do access control. Obviously, like everything with a chip is going to have an AI model in it, and a lot of those are going to be local.
Marc Andreessen
And so, yeah, no, like, I think,
Ben Horowitz
I think you're going to, to have.
Marc Andreessen
And then you're, by the way, also wearable devices.
Ben Horowitz
You know, you don't want to do a complete round trip. You want, you know, whatever your smart devices are, you want it to be like super low latency.
Marc Andreessen
Yeah.
Podcast Host (possibly from 16Z or Lydian Space)
The question, do we care who makes it? One of the biggest news this week was the collapse of AI2, the Allen Institute, one of the actual American open source model labs. And I'm not that optimistic on American open source. Like, you guys invested in Mistral and Mistral is doing extremely well outside of China. China. That's about it.
Marc Andreessen
Yeah, we'll see. We'll see. Look, number one, I do think we care. I do think we. I do think we care who makes it. I would say this.
Ben Horowitz
The previous presidential administration wanted to kill it in the us they wanted to drown in the bathtub. And so they wanted to kill it. So at least we have a government now that actually like, actually wants. It wants it to happen.
Podcast Host (possibly from 16Z or Lydian Space)
You're in the council. Yes.
Ben Horowitz
And the new and the PCast. Yeah.
Marc Andreessen
So for whatever other political issues people
Ben Horowitz
have, which are many, you know, this administration has, I think, a very enlightened view and in particular an enlightened view on AI and in particular on open source and AI. And so they're very supportive.
Marc Andreessen
My read is the various Chinese companies
Ben Horowitz
have a very specific reason to do open source, which is fundamentally they don't think they can sell commercial AI outside of China right now, or at least specifically not in the US for a combination of reasons.
Marc Andreessen
And so they kind of view, I
Ben Horowitz
think open source AI as a bit of a loss leader against basically domestic paid services and then kind of ancillary products. They're very excited about it, by the way.
Marc Andreessen
I think it's great.
Ben Horowitz
I think it's great that they're doing it. I think Deep Seq was like a gift to the world.
Marc Andreessen
I think the great thing about open source, Open source, the impact of open
Ben Horowitz
source is felt two ways. One is you get this software for
Marc Andreessen
free, but the other is you get
Ben Horowitz
to learn how it works. Right.
Marc Andreessen
And so like the paper. The paper. The paper and the code. Right, and the code. And so like, for example, I thought this was amazing. So OpenAI comes out with 01 and it's an amazing technical breakthrough and it's
Ben Horowitz
just like absolutely fantastic.
Marc Andreessen
But of course they don't explain how
Ben Horowitz
it works in detail. And then of course they hide the reasoning traces. Right?
Marc Andreessen
And then everybody's like, okay, this is
Ben Horowitz
great, but like, who's going to be able to replicate this? Are other people going to be able to do this? Is there a secret sauce in there? And then R1 comes out and it's just like there's the code and there's
Marc Andreessen
the paper and now the whole world knows how to do it. And then three months later, every other
Ben Horowitz
AI model is adding reasoning.
Marc Andreessen
And so you get this kind of double. Even if the Chinese models themselves are
Ben Horowitz
not the models that get used, the education that's taken place to the rest of the world, the information diffusion is incredibly powerful.
Marc Andreessen
So that happens. And then, I don't know, we'll see. There are a bunch of American open
Ben Horowitz
source AI model companies.
Marc Andreessen
I mean, look, there's going to be tremendous. There already is.
Ben Horowitz
There's going to be tremendous competition among the primary model companies. There's, depending on how you count, there's like four or five big co model companies now that are kind of neck and neck in different ways. And then obviously both X and then Meta, where I'm involved, both have huge attempts to kind of leapfrog underway. And then you've got a whole fleet of startups, new companies, including a whole bunch that we're back in that are trying to come out with different approaches. And then you've got whatever it is. I don't know how many mainline foundation model companies are there in China at this point? It's probably six.
Podcast Host (possibly from 16Z or Lydian Space)
It's five Tigers is what they call it. Quinn is in questionable because there's change in leadership. Right?
Marc Andreessen
Yeah, but that does that include.
Ben Horowitz
That includes like Moonshot.
Marc Andreessen
Yes.
Podcast Host (possibly from 16Z or Lydian Space)
Deep Seek, Zai Quen 01 is in there.
Ben Horowitz
Right. And then ByteDance.
Podcast Host (possibly from 16Z or Lydian Space)
And then ByteDance would be like the next tier. They weren't as prominent.
Ben Horowitz
They weren't.
Marc Andreessen
Yeah. But at least, you know, Sea Dance
Ben Horowitz
is very inspiring and presumably they have more stuff coming and Tencent probably has more stuff coming and so forth.
Marc Andreessen
And so like, look, here would be
Ben Horowitz
a thing you could anticipate which is
Marc Andreessen
there are not these markets, they're not going to be between the US and
Ben Horowitz
China right now there's like a dozen primary foundation model companies that are at scale, at some level of critical mass.
Marc Andreessen
It's not going to be a dozen
Ben Horowitz
in three years just because these industries don't bear a dozen. There's going to be three or four big winners or maybe one or two big winners.
Marc Andreessen
And so there's going to be a
Ben Horowitz
whole bunch of those guys that are going to have to figure out alternate strategies. And I think open source is one of those strategies.
Marc Andreessen
And so I think you could see a whole. I think the questions like who's going to do open source?
Ben Horowitz
I think that could change really fast. I think that's a very dynamic thing. I think it's very hard to predict what happens.
Marc Andreessen
And I think it's very, very important.
Podcast Host (possibly from 16Z or Lydian Space)
Nvidia is doing a lot.
Marc Andreessen
Well, I was going to say. Well, exactly. And then you got Nvidia. And then just to get this old thing in business strategy, which is called commoditize your compliment. Commoditize the compliment. And it's.
Ben Horowitz
Right.
Marc Andreessen
And so if your Jensen is just kind of obvious, of course you want
Ben Horowitz
to commoditize the software.
Marc Andreessen
And to his enormous credit, he's putting
Ben Horowitz
enormous resources behind that. And so maybe it's literally Nvidia. And I think that would be great.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Yeah. Narrative violation to European projects innovating.
Marc Andreessen
Bam.
Podcast Host (possibly from 16Z or Lydian Space)
I'm hosting my Europe conference soon. And I got both of them.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
They got us. They got us.
Marc Andreessen
Wait a minute. Where was Peter. So where was Steinberger when he did Austria?
Ben Horowitz
Yeah, yeah, he was in.
Marc Andreessen
What? Oh, he was in Vienna. And then. Where is he now?
Podcast Host (possibly from 16Z or Lydian Space)
He's moving to sf.
Ben Horowitz
Okay. Okay.
Marc Andreessen
All right.
Ben Horowitz
Okay, There we go.
Marc Andreessen
And then.
Ben Horowitz
Yeah, the pie guy, right? The pie guys are European.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Yeah, they're also there.
Podcast Host (possibly from 16Z or Lydian Space)
Buddies in Austria.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Mario is also there.
Marc Andreessen
Right.
Ben Horowitz
And are they. Yeah, they haven't announced yet any sort of change or have they?
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
No, they're. They have a company any there?
Ben Horowitz
Okay, good.
Marc Andreessen
Okay, good.
Ben Horowitz
Yeah, good.
Podcast Host (possibly from 16Z or Lydian Space)
Anyways, I think PY and openclaw are very important software things and I just wanted you to just go off on what you think.
Marc Andreessen
Yeah, So I think the combination of the two of them, I think is
Ben Horowitz
one of the 10 most important software.
Podcast Host (possibly from 16Z or Lydian Space)
OpenCloud got all the attention, but talk
Marc Andreessen
about PI is kind of the. Yeah, PI is kind of the architectural breakthrough for those of us who are older. There was this whole thing that was
Ben Horowitz
very important in the world of software basically from like 1970 to. I don't know, it still is very important, but from 1970 through to like basically the creation of Linux, which is basically this thing we used to call the Unix mindset.
Marc Andreessen
Because there were all these different theories.
Ben Horowitz
There are all these different operating systems and mainframes and then all these Windows and Mac and all these things.
Marc Andreessen
And then there was this. But kind of behind it all was
Ben Horowitz
this idea of the UNIX mindset.
Marc Andreessen
And the Unix mindset was this thing
Ben Horowitz
where basically you don't have these.
Marc Andreessen
In the old days, the operating system
Ben Horowitz
that made the computer industry really work in the 1960s was this thing called OS360, which was this big operating system that IBM developed that was supposed to basically run everything. And it was this giant monolithic architecture in the sky. It was a giant cat castle of software.
Marc Andreessen
And by the way, it worked really
Ben Horowitz
well and they were very successful with it. But it was this huge castle in the sky.
Marc Andreessen
But it was this thing that was
Ben Horowitz
almost unapproachable, which is like you had to be kind of inside IBM or very close to IBM, and you had to really understand every aspect, how the system worked.
Marc Andreessen
And then the UNIX Skies, originally out
Ben Horowitz
of AT&T and then out of Berkeley
Marc Andreessen
came out and they said, no, let's
Ben Horowitz
have a completely different architecture. And the way architecture is going to work is we're going to have a prompt and a shell, and then all the functionality is going to be in the form of these discrete modules. And then you're going to be able to chain the modules together.
Marc Andreessen
And so it's almost like the operating
Ben Horowitz
system itself is going to be a programming language. And then that led to the sort of centrality of the shell. And then that led to sort of basically chaining together UNIX tools. And then that led to the emergence of these scripting languages like Perl, where you could basically kind of very easily do this. And then the shells got more sophisticated
Marc Andreessen
and then looked number one, that worked.
Ben Horowitz
And that was the world I grew up in. I was a UNIX guy sort of from call it 1988 to kind of all the way through my work.
Marc Andreessen
And it worked really well. It's in the background.
Ben Horowitz
Normal people didn't need to necessarily necessarily know about it.
Marc Andreessen
But like, if you were doing like
Ben Horowitz
system architecture, application development, you knew all
Marc Andreessen
about it, and then it's been in the background ever since. And you know, look, your Mac still
Ben Horowitz
has a UNIX shell, you know, kind of in there, and your iPhone still has a UNIX shell kind of buried in there somewhere. So they're kind of in there. And then, you know, the Windows shell is kind of, you know, sort of a weird derivative of that. But, you know, but look, the Internet runs on Unix and then smartphones, actually, both iOS and Android are UNIX derivatives.
Marc Andreessen
And so, you know, kind of Unix
Ben Horowitz
did end up winning, but.
Marc Andreessen
But anyway, and then we just started taking that for granted and Then, then. So basically the way I think about
Ben Horowitz
what happened with PI and then with openclaw is basically what those guys figured
Marc Andreessen
out is I always say the great
Ben Horowitz
breakthroughs are obvious in retrospect, right?
Podcast Host (possibly from 16Z or Lydian Space)
Which is the best kind?
Marc Andreessen
The best kind, they weren't obvious at the time or somebody else would have done them already. And so there is a real conceptual leap. But then you look at it sort
Ben Horowitz
of the backwards looking and you're just like, oh, of course, to me those are always the best breakthroughs.
Marc Andreessen
Well, actually language models themselves are like that.
Ben Horowitz
It's just like, oh, next token completion.
Podcast Host (possibly from 16Z or Lydian Space)
Oh, of course, what other objective mattered?
Marc Andreessen
Yeah, exactly, right. But you see what I'm saying, it wasn't obvious until somebody actually did it.
Ben Horowitz
Right. And so the conceptual breakthrough is real in deep and powerful and very important.
Marc Andreessen
And so the way I think about PI and openclaw is it's basically marrying
Ben Horowitz
the language model mindset to the UNIX basically shell prompt mindset.
Marc Andreessen
And so it's basically this idea that
Ben Horowitz
what is an agent?
Marc Andreessen
And as you know, many smart people
Ben Horowitz
have been trying to figure out what an agent is for decades and they've had many architectures to build agents in the whole thing. And it turns out what is an agent?
Marc Andreessen
So it turns out what we now
Ben Horowitz
know is an agent is the following.
Marc Andreessen
So it's a language model, and then above that it's a bash shell.
Ben Horowitz
So it's a unit shell.
Marc Andreessen
And then the agent has access to
Ben Horowitz
the shell, hopefully in a sandbox, maybe in a sandbox.
Marc Andreessen
So it's the model, it's the shell,
Ben Horowitz
and then it's a file system, and then the state is stored in files. And then there's the markdown format for the files themselves. And then there's basically what in UNIX is called a cron job. There's a loop and then there's a heartbeat. There's a heartbeat and the thing basically wakes up.
Marc Andreessen
So it's basically LLM plus shell plus
Ben Horowitz
file system plus markdown plus cron.
Marc Andreessen
And it turns out that's an agent and every part of that other than
Ben Horowitz
the model already completely know and understand. And in fact it turns out that like the latent power of the UNIX shell is like extraordinary because basically like all, like there's just, like, there's just enormous latent power in the shell. There's enormous numbers of UNIX commands, there's enormous number of command line interfaces into all kinds of things already in the, you know, your entire, I mean your
Marc Andreessen
entire, just to start with, your computer
Ben Horowitz
runs on a shell. If you're running a Mac or a phone, your computer, your computer is running on a shell already. And so, like, the full power of your computer is available at the command line level.
Marc Andreessen
And then it turns out it's really
Ben Horowitz
easy to expose other functions as a command line interface. And so this whole idea where we need like, MCP and these, like, fancy protocols, whatever, it's like, no, we don't. We just need like a command command line thing.
Marc Andreessen
So that's the architecture. And then it turns out what is your agent? Your agent is a bunch of files stored in a file system. And then there's the thing that just
Ben Horowitz
like, completely blew my mind when I wrote my head around it as a result of this, which is like, okay,
Marc Andreessen
this means your agent is now actually
Ben Horowitz
independent of the model that it's running
Marc Andreessen
on, because you can actually swap out
Ben Horowitz
a different LLM underneath your agent.
Marc Andreessen
And your agent will change personality somewhat because the model is different.
Ben Horowitz
Different. But all of the state stored in the files will be retained.
Podcast Host (possibly from 16Z or Lydian Space)
Different instruction set, but you just compile them.
Ben Horowitz
Right, exactly. And, sorry, it's like swapping out a
Marc Andreessen
chip and recompiling, but it's still your
Ben Horowitz
agent with all of its memories and with all of its capabilities.
Marc Andreessen
And then, by the way, you can also swap out the shell so you
Ben Horowitz
can move it to a different execution environment that is also a bash shell, by the way. You can also switch out the file system, right? And you can swap out the heartbeat, the Cron framework, the loop, the agent framework itself.
Marc Andreessen
And so your agent basically is basically, at the end of the day, it's just its files. And then there's of. Yeah, it's basically. It's just the files. And then, by the way, as a consequence of that, the agent, and then the agent itself, it turns out a couple important things. So one is it can migrate itself, right? And so you can instruct your agent,
Ben Horowitz
migrate yourself to a different runtime environment, migrate yourself to a different file system, migrate yourself to a different. Swap out the language model. Your agent will do all that stuff for you.
Marc Andreessen
And then there's the final thing, which
Ben Horowitz
is just amazing, which is the agent
Marc Andreessen
actually has full introspection. It actually knows about its own files
Ben Horowitz
and it could rewrite its own files,
Marc Andreessen
which, by the way, is basically no
Ben Horowitz
widely deployed software system in history, where the thing that you're using actually has full introspective knowledge of how it itself works and is able to modify itself like that.
Marc Andreessen
I mean, there have been toy systems that have had that, but there's never
Ben Horowitz
been a widely deployed system that has that capability.
Marc Andreessen
And then that leads you to the
Ben Horowitz
capability that just like, completely blew my mind when I wrap my head around
Marc Andreessen
it, which is you can tell the
Ben Horowitz
agent to add new functions and features to itself, and it can do that. Extend yourself, right?
Marc Andreessen
Extend yourself.
Ben Horowitz
Like, extend yourself.
Marc Andreessen
Give yourself a new capability, right? And so, and so literally, it's just like you run into somebody at a party and they're like, oh, I have my open claw.
Ben Horowitz
Do whatever. Connect to my eat, sleep, bed. And it gives me better advice and sleep. And you go home at night and you tell your claw, or if they're at the party, by the way, you
Marc Andreessen
tell your claw, oh, add this capability
Ben Horowitz
to yourself and your claw will say, oh, okay, no problem.
Marc Andreessen
And it'll go out on the Internet
Ben Horowitz
and it'll figure out whatever it needs,
Marc Andreessen
and then it'll go out to cloud
Ben Horowitz
code or whatever, it'll write whatever it needs. And then the next thing you know, it has this new capability.
Marc Andreessen
And so you don't even have to, like, you can have it upgrade itself
Ben Horowitz
without even having to. Without having to do anything other than tell it that you wanted to do that.
Marc Andreessen
And so anyway, so the combination of
Ben Horowitz
all this is just.
Marc Andreessen
I mean, this is just like a massive, incredible. I mean, it's just incredible. Like, if I were 18, like, this is 100, this is what I would
Ben Horowitz
be spending all of my time on. This is like such an incredible conceptual breakthrough.
Marc Andreessen
And again, people are going to look
Ben Horowitz
at it and they already get this response.
Marc Andreessen
People are going to look at it,
Ben Horowitz
they're going to say, oh, well, where's the breakthrough? Because all of these components were already known before.
Marc Andreessen
But this is the key. The key to the breakthrough was by
Ben Horowitz
using all these components that were known before, you get all of the underlying capability that's buried in there.
Marc Andreessen
And so all. And so, for example, computer use all
Ben Horowitz
of a sudd just kind of falls trivial. Of course it's going to be able to use your computer. It has full access to the shell, right?
Marc Andreessen
And then you just, you give it
Ben Horowitz
access to a browser and then you've got the computer and the browser and off and away it goes. And then you've got all the abilities of the browser also. And so the capability unlock here is profound. My friends who are deepest into this are having their claw do literally like a thousand things in their lives. They have new ideas every day. They're just like constantly throwing new challenges at the thing.
Marc Andreessen
And by the way, it's early.
Ben Horowitz
And these are prototypes. And there are, as you guys know, there are security issues.
Marc Andreessen
And so there's a bunch of stuff be ironed out. But the unlock of capability is just incredible. And I have absolutely no doubt that
Ben Horowitz
everybody in the world is going to have at least an agent like this, if not an entire family of agents. And we're going to be living in
Marc Andreessen
a world where I think it's almost
Ben Horowitz
inevitable now that this is the way people are going to use computers.
Podcast Host (possibly from 16Z or Lydian Space)
I was going to say, for someone who is deeply familiar with social networks, the next step is your claw. Talking to my claw. Posting on claw Facebook, posting their jobs on claw LinkedIn and posting their tweets on claw Xai or whatever. I do think that that is we get into some danger there in terms of alignment and whether or not we want these things to run.
Ben Horowitz
You guys know about rentahuman.com yeah, Rentahum.
Podcast Host (possibly from 16Z or Lydian Space)
I mean it's Fiverr, it's TaskRabbit. Sure, of course, Mechanical Turk.
Marc Andreessen
Yeah.
Ben Horowitz
But flipped, right? The agent hiring the people. Which of course is going to happen.
Marc Andreessen
It's obviously going to happen.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
I'm curious if you have any thoughts on the engineering side. So when you build the browser, the Internet, just a bunch of, of mostly plain text file plus some images and today every website and app is like so complex and like somehow, you know, the browser kept evolving to fit that in. Are there any design choices that were made like early in the browser and kind of like the Internet and the protocols that you're seeing agents similar to this, like, hey, this thing is just not going to work for like this type of new compute and we should just rip it out right now there
Marc Andreessen
were a whole bunch, but I'll give you a couple. So one is. And we didn't.
Ben Horowitz
And you know, to be clear, like this, this was not, you know, this was totally different. We have the capabilities we have today because we didn't have the language models
Marc Andreessen
underneath this, but we did have this
Ben Horowitz
idea of that human readability actually mattered a great deal. And specifically in those days it was not so much English language, but there was a design decision to be made between binary protocols and text protocols.
Marc Andreessen
And basically every basically old school systems
Ben Horowitz
architect that had grown up between the 1960s and the 1990s basically said the Internet. What do you know about the Internet? It's star for bandwidth. You have these very narrow straws.
Marc Andreessen
Look, when we did the work on Mosaic, people who had the Internet at
Ben Horowitz
home had a 14k kilobit modem, right? So you're trying to like hyper optimize every bit of data that travels over the network.
Marc Andreessen
And so obviously if you're going to
Ben Horowitz
design a protocol like HTTP, you're going to want it to be highly compressed binary protocol for maximum efficiency, and you're going to want to have it be like a single connection that persists. And the last thing you're going to want to do is like bring up and tear down new connections. And definitely you're not going to want a text protocol.
Marc Andreessen
And so of course we said no,
Ben Horowitz
we actually want to go completely the other direction. It's obviously we only want text protocols, by the way, same thing in HTML itself. We want HTML to be relatively verbose. You know, we want the tags to actually be like human readable.
Podcast Host (possibly from 16Z or Lydian Space)
We want to use the inefficient things possible.
Marc Andreessen
Yeah, we want to do the inefficient things.
Podcast Host (possibly from 16Z or Lydian Space)
You're the original token maxer.
Marc Andreessen
Yeah, exactly, yeah. Basically it's like. Well, yeah, well, actually this was actually the conscious thing which basically says just assume a future of infinite bandwidth build for that. And then basically what it was is it was a bet that if the system, if the latent capabilities of the
Ben Horowitz
system were powerful enough, and that was obvious enough to people, that would create the demand for the bandwidth, that would cause the supply of bandwidth to get built, that would actually make the whole thing work.
Marc Andreessen
And then specifically what we wanted was
Ben Horowitz
we wanted everything to be human readable, because at the engineering level, we wanted people to be able to read the protocol coming over the wire and be able to understand it with their bare eyes without having to disassemble it or whatever, have it converted out of binary, all the HTTP and everything else, it was always text protocols.
Marc Andreessen
And the same thing with HTML in many ways. Some people say that the key breakthrough
Ben Horowitz
in the browser was the View Source option, which is every web page you go to, you could View Source, which means you could see how it worked, which means you could teach yourself how to build new web pages.
Marc Andreessen
There was that. So human readability. And again, human readability in those days
Ben Horowitz
still meant technical specs, now it means English language. But there is an incredible latent power in giving everybody who uses the system the option to be able to drop down and actually understand and see how it's working. And that worked really well for the web, and I think it's working really well for AI.
Marc Andreessen
That was one.
Ben Horowitz
What was the other?
Marc Andreessen
A big part of the idea of
Ben Horowitz
web servers was to actually surface the underlying latent capability of the operating system and to be able to surface also the underlying latent of the database. Because basically what was a web server. What is a web server fundamentally? Architecturally? It's the operating system. So it's the operating system's ability to, you know, it's running on top of an OS, so it's the OS's ability to manage the file system and do everything else that you want to do and process everything. And then of course, a lot of really, you know, a lot of websites are front ends to databases. And so you wanted to unleash the underlying latent power of whether it was an Oracle database or some other postgres or whatever it was.
Marc Andreessen
And so a lot of the function
Ben Horowitz
of the web server was to just bridge from that Internet connection coming in to be able to unlock the underlying power of the OS and the database.
Marc Andreessen
And again, people looked at it at the time and they were like, well,
Ben Horowitz
does this really matter? Is this important? Because we've had databases forever and we've always had user interfaces for databases. And this is just another user interface for a database.
Marc Andreessen
It's like, okay, yeah, fair enough.
Ben Horowitz
But on the other side of that, it's just like this is now a much better interface to databases and one that 8 billion people are going to use and is going to be far easier to use and far more flexible. And you're not just going to have old databases. Now you have a system where people can actually understand why they want to build a million times more database apps than they had in the past. And then the number of databases in the world exploded.
Marc Andreessen
And so again, this goes to this
Ben Horowitz
thing of like building, building in layers.
Marc Andreessen
Some of the smartest people in industry
Ben Horowitz
look at any new challenge and they're like, okay, I need to build a new kind of application. So the first thing I need to do is build a new programming language, right?
Marc Andreessen
And then the next thing I need
Ben Horowitz
to do is build a new operating system, right?
Marc Andreessen
And the next thing I need to
Ben Horowitz
do is I need to build a new chip, right?
Marc Andreessen
And they kind of want to reinvent everything. And I've, I've always had, maybe it's
Ben Horowitz
just, I don't know, pragmatic mentality or something, or maybe an engineering over science mentality. But it's more like, no, you have just like all of this latent power in the existing systems and you don't want to be held back by that, their constraints. But what you want to do is you want to kind of liberate that power and open it up.
Marc Andreessen
And so, and I think the web
Ben Horowitz
did that for those reasons. And I think it's the same thing now that's happening.
Podcast Host (possibly from 16Z or Lydian Space)
It's a good perspective from the web.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
The programming languages is another good thing. We have Brett Taylor on the podcast and we were talking about Rust. And you know, Rust is memory safe by default. So why are we teaching the model to not write memory unsafe code? Just use Rust and then you get it for free. How much do you think there's like time to be spent, like recreating some of these things instead of taking them for granted? I'll be like, oh, okay, Python is kind of slow. Python, typescript, That's.
Ben Horowitz
Yeah.
Podcast Host (possibly from 16Z or Lydian Space)
As imperfect as they are, they are the lingua franca.
Ben Horowitz
I mean, I think this is going to change a lot because I don't think the models care what language they program in. And I think they're going to be good at programming in every language and I think they're going to be good at translating from any language to any other language. Okay, so this gets into the coding side of things. I think we're going through a really fundamental change. And look, I grew up, I grew up hand coding. I grew up hand coding. Everything I did was actually, everything I did actually was written in C. Back
Marc Andreessen
in the days, I wasn't even using
Ben Horowitz
C or like Java or any of this stuff, right? And so everything I ever did, I was like managing my own memory at the level of C. And then I'm still from the generation that I knew assembly language so I could drop down and do things right on the ship.
Marc Andreessen
And so all of us, we've always
Ben Horowitz
lived in a world in which software is like this precious thing that you have to think about very carefully and it's really hard to generate good software and there's only a small number of people who can do it. And you have to be very jealous in terms of thinking about how do you allocate, what are your engineers working on on, and how many good engineers do you actually have and how much software can they write and how much software can human beings kind of maintain.
Marc Andreessen
And I think all those assumptions are
Ben Horowitz
being shot right out the window right now. I think those days are just over. And I think the new world is actually high quality. Software is just infinitely available. And if you need new software to do xyz, you're just going to wave your hand and you're going to get it. And then if you don't like the language it's written in, you just tell the thing. All right, now I want the rush
Marc Andreessen
version, or by the way we're about
Ben Horowitz
to go through computer security is about to go through the Most dramatic change ever, which is, number one, like every single latent security bug is about to be exposed. So we're going to have like the, we're set up here for like the computer security apocalypse for a while. But, but, but on the other side of it now, we have coding agents that can go in and actually fix all the security bugs. And so how, how are you going to secure software in the future? You're going to tell the, tell the bot to secure it and it's going to go through and fix it all.
Marc Andreessen
And so this thing that was this
Ben Horowitz
incredibly scarce resource of high quality software is just going to become a completely fungible thing. You're just going to have as much as you want.
Podcast Host (possibly from 16Z or Lydian Space)
Right.
Ben Horowitz
And, and that has like, you know, that has like tons and tons of consequences in some sense. The answer to the question that you think is just somewhat, I don't know, simple or something or straightforward, which is just if you want all your software and rust, you just tell the bot you want all your software in rust.
Marc Andreessen
Things that used to be hard or
Ben Horowitz
even seem like an insurmountable mountain to get through all of a sudden I think become very easy.
Podcast Host (possibly from 16Z or Lydian Space)
I think Brett had a theory that there would be a more optimal language for LLMs. And so the contention is there isn't. Like, just don't bother, just whatever humans already use. LLMs are perfectly capable of porting.
Marc Andreessen
I think we're pretty close to being,
Ben Horowitz
I don't know if this would work today. I think we're pretty close to being able to ask the AI what would its optimal language be, and let it. And let it design it.
Marc Andreessen
True. Okay, here's a question.
Ben Horowitz
Are you even going to have programming languages in the future or the AI is just going to be emitting binaries?
Marc Andreessen
Let's assume for a moment that humans aren't coding anymore.
Ben Horowitz
Let's assume it's all bots. What levels of intermediate abstraction do the bots even need? Or are they just coding binary directly?
Marc Andreessen
Did you see? There's actually an experiment, Somebody just did
Ben Horowitz
this thing where they have a language model now that actually emits model weights for a new language model.
Marc Andreessen
Right. And so will the bots be predictable? Yeah. Will the bots literally be emitting not just coding binaries, but will they actually
Ben Horowitz
be emitting weights for new models?
Marc Andreessen
Directly and conceptually, there's no reason why they can't do both of those things. Architecturally, both of those things seem completely possible.
Podcast Host (possibly from 16Z or Lydian Space)
Very inefficient.
Marc Andreessen
You're basically very inefficient.
Podcast Host (possibly from 16Z or Lydian Space)
Simulation of A simulation. In a simulation inside of weights.
Marc Andreessen
Yeah, very inefficient. But look, LLMs are already incredibly inefficient. Ask. Favorite thing, Ask Claude, Ask.
Ben Horowitz
Two plus two equals four. Right. It's just like whatever, billions and billions of times more inefficient than using your pocket calculator.
Marc Andreessen
But yet the payoff is so great
Ben Horowitz
of the general capability.
Marc Andreessen
So anyway, I kind of think in 10 years I'm not sure there will even be a salient concept of a
Ben Horowitz
programming language in the way that we understand it today. And in fact what we may be doing more and more as a form of interpretability, which is we're trying to understand why the bots have decided to structure code in the way that they have.
Podcast Host (possibly from 16Z or Lydian Space)
If you play it through, you don't need browsers, then that's the depth of the browser.
Marc Andreessen
Well, so I would take it a
Ben Horowitz
step further, which is you may not need user interfaces.
Marc Andreessen
So who is going to use software in the future?
Podcast Host (possibly from 16Z or Lydian Space)
Other bots.
Marc Andreessen
The other bots. Yeah.
Podcast Host (possibly from 16Z or Lydian Space)
You still need to, I don't know, pipe information in, do we? And out.
Ben Horowitz
Really?
Podcast Host (possibly from 16Z or Lydian Space)
Well, what are you going to do then?
Ben Horowitz
Are you sure you're just going to
Podcast Host (possibly from 16Z or Lydian Space)
log off and touch grass?
Marc Andreessen
Whatever you want. Exactly. Isn't that better?
Podcast Host (possibly from 16Z or Lydian Space)
I want software to do stuff for
Marc Andreessen
me, but isn't that better? I mean, look, you know, I don't know, look the arguments here, it was
Ben Horowitz
not that long ago that 99% of humanity was behind a plow, right? And what are people going to do if they're not plowing fields all day to grow food? And it just turns out there's much better ways for people to spend time than plowing fields.
Podcast Host (possibly from 16Z or Lydian Space)
Doom scrolling.
Marc Andreessen
Exactly.
Ben Horowitz
Talking to their friends.
Marc Andreessen
And look, and I'm not an absolutist
Ben Horowitz
and I'm not a utopian and to be clear, I have an 11 year old and he's learning how to code and I think it's still a really good idea to learn how to code and so forth. But if you project forward, you just have to think forward to a world in which it's just like, okay, I'm
Marc Andreessen
just going to tell the thing what
Ben Horowitz
I needed do to. It's going to do it and then it's going to do it in whatever way is most optimal for it to do it.
Marc Andreessen
Unless I tell it to do it.
Ben Horowitz
Non optimally.
Marc Andreessen
Like if I tell it to do
Ben Horowitz
it in Java or in Rust or whatever, it'll do it, I'm sure. But if I'm just going to tell it to do it, it's going to do it in whatever way is the optimal way to do it.
Marc Andreessen
And then if I need to understand
Ben Horowitz
how it works, I'm going to ask it to explain to me how it works. And so it's going to be doing its own interpretability.
Marc Andreessen
It's going to be the engine of
Ben Horowitz
interpretability to explain itself.
Marc Andreessen
And I just am not convinced that. I'm not convinced that in that world
Ben Horowitz
you have these historical.
Marc Andreessen
The goals of the abstractions will be
Ben Horowitz
whatever the botany network.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Yeah, well I'm curious if that's true, then shouldn't the model providers be building some internal language representation that they can do extreme kind of like RL and reward modeling around? Because it's like today they're kind of like tied to TypeScript and Python because the users need to write in that language versus they can have their own thing internally. And they don't need to teach it to anybody, they just need to teach their model. And I think that's how you get maybe diversion between the models, like going back to like the PI open cloud thing. It's like, oh, I built all the software using the OpenAI model and now switch to the anthropic model. But the anthropic model doesn't understand the thing. So it feels like there still needs to be some obstruction, but maybe not. Maybe that's the lock in that the model provider is supposed to have.
Ben Horowitz
I don't know. I'm not even sure that's lock in though because why can't the second model just learn what the first model has done?
Marc Andreessen
Exactly. Okay, give you an example. So as you know, models can now reverse engineer software. Binary.
Ben Horowitz
Isn't it this whole thing now where people are reverse engineering like Nintendo game binaries.
Podcast Host (possibly from 16Z or Lydian Space)
Yeah.
Marc Andreessen
So you have like, we've seen a
Ben Horowitz
bunch of reports like this where somebody has like a favorite game from the 1980s and the source code is like long dead, but they have like a binary burned into a chip or something and now they're reverse engineer to get a version that runs on their Mac. Right.
Marc Andreessen
And so if you reverse it, this is why I kind of say if
Ben Horowitz
you're reversing like x86 binaries, then why can't you reverse engineer whatever they create?
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Yeah, and because we're all on UNIX based system, it has to be reversible because it needs to run on the target.
Marc Andreessen
Yeah, basically. And so I just think it's this
Ben Horowitz
thing where it's just like.
Marc Andreessen
And by the way, and everything we're describing is something that Human beings in
Ben Horowitz
theory could have done before, but just with enormous. But it was just always like cost and labor prohibitive.
Marc Andreessen
Reverse engineering.
Ben Horowitz
I learned how to reverse engineer. Human beings can reverse engineer binaries.
Marc Andreessen
It's just for any complex binary I need like a thousand years to do it.
Ben Horowitz
But now with the model you don't.
Marc Andreessen
And so all of a sudden you get these things or another way to think about it is so much of
Ben Horowitz
human built system system sort of compensate for the human limitations. And if you don't have the human limitations anymore, then all of a sudden you have.
Marc Andreessen
And it's not that you won't have
Ben Horowitz
abstractions, but you'll have a different kind of abstraction.
Podcast Host (possibly from 16Z or Lydian Space)
I have two topics to bring us to a close and you can pick whichever ones. Just talking about protocols. Was it you or someone else? I forget my Internet history who said that the biggest mistake that we didn't figure out in the early days was payments.
Ben Horowitz
Yes.
Podcast Host (possibly from 16Z or Lydian Space)
Was that you?
Marc Andreessen
Yes.
Ben Horowitz
402. 402 payment required.
Podcast Host (possibly from 16Z or Lydian Space)
We have a chance now. I don't think we're going to figure it out. I don't know. What's your take?
Ben Horowitz
Oh, I think we will. Yeah. No, now I think it's going to happen for sure.
Podcast Host (possibly from 16Z or Lydian Space)
Yeah.
Marc Andreessen
Yeah. And there's two reasons.
Ben Horowitz
Example for sure. One is we actually have Internet native money now in the form of crypto, stable coins and crypto. And this is. I think this is the grand unification basically of AI Crypto is what's about to happen now. I think AI is the crypto killer app, I think is where this is really going to come out.
Marc Andreessen
And then the other is it's just,
Ben Horowitz
I mean, it's just.
Marc Andreessen
I think it's now obvious.
Ben Horowitz
It's like obviously AI agents are going to need money and it's already happening. Right.
Marc Andreessen
If you've got a claw.
Ben Horowitz
If you've got a claw and you want it to buy things for you, you have to give it money in some form.
Podcast Host (possibly from 16Z or Lydian Space)
I would say the adoption is probably like 0.1% if that.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
But.
Marc Andreessen
Yeah, well, today. Yeah, yeah, yeah. But think forward.
Ben Horowitz
Like where is it going forward? Thinking the ultimate principle of everything and everything that I think we do is it's the William Gibson quote, which is the future is already here. It just isn't distributed. Isn't distributed yet. My friends who are the most aggressive users of OpenClaw just like have given their clause bank accounts and credit cards
Marc Andreessen
and not only have they done it, it's obvious that they needed to do it because it's obvious that they needed
Ben Horowitz
to be able to spend money on their behalf.
Marc Andreessen
It's just completely obvious. And so. And again, like, so the number of
Ben Horowitz
people who have done that today to your point is like, I don't know, probably 5,000 or something, but it'll grow.
Marc Andreessen
That's how these things start, actually.
Podcast Host (possibly from 16Z or Lydian Space)
I mean, since you keep mentioning.
Marc Andreessen
And by the way, openclaw, by the way, if you don't give it a
Ben Horowitz
bank account, it's just going to break into your coin.
Podcast Host (possibly from 16Z or Lydian Space)
It's going to be high agency.
Marc Andreessen
It's going to break into your bank account anyway and take your money. So you might as. You might as well do it.
Ben Horowitz
You might as well do it.
Marc Andreessen
By the way, I really love. I got to tell you, I really love the phenomenon. I love the yolo. I'm not doing it myself, to be clear, but I love the people that
Ben Horowitz
are just like, yeah, what is it? Skip.
Podcast Host (possibly from 16Z or Lydian Space)
Skip dangerously way. It's a Facebook thing.
Marc Andreessen
Okay.
Podcast Host (possibly from 16Z or Lydian Space)
Because in Facebook they have this culture to name the thing dangerous so that you are aware when you enable the flag that you are opting into a dangerous thing.
Ben Horowitz
Okay, good.
Podcast Host (possibly from 16Z or Lydian Space)
They brought it into OpenAI.
Marc Andreessen
And of course that makes it enticing.
Podcast Host (possibly from 16Z or Lydian Space)
Sam runs codecs with skip permissions on his laptop.
Marc Andreessen
Yes, 100%. And so I think the way to actually see the future is to find
Ben Horowitz
the people who are doing that.
Marc Andreessen
There's a madness. Log everything.
Podcast Host (possibly from 16Z or Lydian Space)
Just watch it. Watch the.
Marc Andreessen
But, like, let's actually find out what
Ben Horowitz
the thing can do. And the way to find out what the thing can do is just like,
Marc Andreessen
yeah, let it try everything.
Ben Horowitz
Let it unlock everything.
Marc Andreessen
By the way, that's how you're going to find all the good stuff it
Ben Horowitz
can do, by the way. That's also how you're going to find all the flaws.
Marc Andreessen
I think the people who turn that
Ben Horowitz
on for bots are like, they're like martyrs to the progress of human civilization.
Marc Andreessen
Like, I feel very bad for their descendants that their bank accounts are going
Ben Horowitz
to get looted by their bots in
Marc Andreessen
the first, like, 20 minutes. But I think the contribution that they're
Ben Horowitz
making to the future of our species is amazing.
Podcast Host (possibly from 16Z or Lydian Space)
It's like gentleman science.
Marc Andreessen
Yes, yes, yes. It's Ben Franklin out with. Trying to. Trying to get lightning to strike his.
Ben Horowitz
His balloon and seeing if he gets electrocuted.
Marc Andreessen
It's Jonas Salk with the polio vaccine, injecting it. Yes. So, yes, I think we should have flags and we should have monuments to
Ben Horowitz
the people that just let OpenCloud run their lives.
Podcast Host (possibly from 16Z or Lydian Space)
More anecdotes. What are the craziest or interesting things that people listening to this should go home and do.
Marc Andreessen
I mean, the extreme thing is just
Ben Horowitz
like the straight yolo, just, yeah, turn your light on.
Podcast Host (possibly from 16Z or Lydian Space)
That's a general capability. Is there, like a specific story that was like, wow. And everyone in the group chat just lit up.
Marc Andreessen
I mean, like, you know, so there's tons of. There's already tons of health.
Ben Horowitz
You know, there's. The health dashboard stuff is just. It's just personal health. Absolutely amazing.
Marc Andreessen
The number of stories on.
Ben Horowitz
I just don't want to violate people's. You know, obviously personalized.
Marc Andreessen
But, you know, one of the things
Ben Horowitz
openclaw is really good at is hacking into all the stuff in your lan. It's really good. So, you know, Internet of things, AKA Internet of shit.
Podcast Host (possibly from 16Z or Lydian Space)
Like, super insecure, but great. Discoverable.
Marc Andreessen
It's discoverable. OpenClaw is happy to scan your network. Network, identify all the things. And then my friends who are most
Ben Horowitz
aggressive at this are having OpenClaw take over everything in their house. It takes over their security cameras. It takes over whatever their access control systems. It takes over their webcams. I have a friend whose claw watches him sleep.
Marc Andreessen
Put a webcam in your bedroom, put the claw in a loop.
Ben Horowitz
Have it wake up frequently, and have it watch and just tell it. Watch me sleep.
Marc Andreessen
And I've seen the transcripts, and it's
Ben Horowitz
literally like, Joe's asleep.
Marc Andreessen
This is good. This is good that Joe's asleep because I have his health data and I know that he hasn't been getting enough sleep.
Ben Horowitz
And so it's really good that he's getting sleep. I really hope he gets his full whatever, you know, five hours of REM sleep.
Marc Andreessen
Joe's moving.
Ben Horowitz
Joe's moving.
Marc Andreessen
Joe might be waking up. This is a real. If Joe wakes up now, he's going to ruin his sleep cycle. Oh, okay. It's okay. Joe just rolled over.
Ben Horowitz
Okay.
Marc Andreessen
He's gone back to bed. Okay, good.
Ben Horowitz
All right. Okay, I can relax.
Marc Andreessen
This is fine.
Podcast Host (possibly from 16Z or Lydian Space)
He's monitoring the situation.
Marc Andreessen
Monitoring the situation. And being a bot, like, you know, is just like, very focused, right? It's just like this is like his reason for existence is to watch Joe sleep. And I was talking to my friend who did this. It's like, on the one hand, it's
Ben Horowitz
like, all right, this is weird and creepy, and maybe this has taken over my life.
Marc Andreessen
And then the other thing is, you know, what if I had a heart
Ben Horowitz
attack in the middle of the night, this thing literally would freak out and call 911.
Marc Andreessen
There's no question this thing would figure
Ben Horowitz
out how to alert medical authorities and probably summon SWAT teams and do whatever would be required to save my life.
Marc Andreessen
And so it's like, yeah, that's happening.
Ben Horowitz
What else? There's a company, Unitree that makes the robot dogs. I actually have one at home, which. It's actually really fun.
Marc Andreessen
The Chinese companies, the Chinese companies are
Ben Horowitz
so aggressive at adopting new technology, but they don't always, like, let's say, take the time to really package it, package it and maybe think it all the way through.
Marc Andreessen
And so at least the unitary dog I have, so it has a old non.
Ben Horowitz
LLM just control system, which by the way is not very good. It markets well, but in practice it's not that good. It has trouble with stairs and so forth. And so it's not quite what it should be.
Marc Andreessen
But then the language model thing comes out in the voice.
Ben Horowitz
So they add LLM capability and then they add a voice mode to it.
Marc Andreessen
But that LLM capability is not at
Ben Horowitz
all connected to the control system.
Marc Andreessen
So you've got this schizophrenic dog that is a complete idiot when it comes to climbing the stairs, but it will happily teach you quantum mechanics in a plummy English accent. It's just absolutely amazing.
Podcast Host (possibly from 16Z or Lydian Space)
Jagged intelligence.
Ben Horowitz
Yeah, talk about jagged.
Marc Andreessen
And then now, obviously what's going to
Ben Horowitz
happen in the future is they're going to connect together.
Marc Andreessen
But, but right now. And so right now it's not that useful.
Ben Horowitz
And so I have a friend who has one of these who had his claw basically hack in and rewrite the code, write new firmware, write new firmware for the, for the unit robot.
Marc Andreessen
And now it's. Now it's an actual pet dog for his kids.
Podcast Host (possibly from 16Z or Lydian Space)
You could do the before, after, like the motion.
Marc Andreessen
Yeah, it's. He said it's completely different. He said it's a complete transformation. And whenever there's an issue in the
Ben Horowitz
thing now the claw just like rewrites the code, you know, you know, you. Goes in, does, does the code and so it kind of goes to your thing here.
Marc Andreessen
So. So like all of a sudden this
Ben Horowitz
is why we want to think about AI code. AI coding is not just like writing new apps, it's also going in and rewriting, writing all the old stuff that should have worked, that never worked.
Marc Andreessen
And so like, I think, I think
Ben Horowitz
basically, I think the Internet, the Internet of shit is basically over.
Marc Andreessen
Like, I think everything.
Ben Horowitz
There's a potential here where like all these devices in your house that have been like, basically marginal or, you know, basically dumb all of a sudden. They might all get really smart.
Marc Andreessen
Now, smart home, you have to decide if. Yes, there are horror movies in which this. Of which this is the premise. And so you have to decide if you want this. But this is the first time I
Ben Horowitz
can say with confidence, I now know how you could actually have a smart home with 30 different kinds of things with chips and Internet access, where it actually all makes sense, it all works together, and it's all coherent in the whole thing.
Marc Andreessen
And to have that unlock without a
Ben Horowitz
human being having to go, do any of that work? Like,
Podcast Host (possibly from 16Z or Lydian Space)
I'm waiting for a story. Mark, I can't let you open that fridge door, you know, like, exactly, Exactly.
Marc Andreessen
Yes, yes.
Podcast Host (possibly from 16Z or Lydian Space)
Because you're not supposed to eat right now.
Marc Andreessen
I have all of. Yes, I have every shred of health information, you know, and I know you think you're doing, you know, da, da, da, anything, you can do this. But, you know, this is a.
Ben Horowitz
Are you really sure?
Marc Andreessen
You told me last night you really
Ben Horowitz
don't want me to let you do this. So I'm sorry, but the fridge door is locked.
Podcast Host (possibly from 16Z or Lydian Space)
Open the fridge doors.
Marc Andreessen
Exactly. And by the way, I know you're supposed to be studying for a test, so why don't you go. When you can pass the test, I
Ben Horowitz
will open the fridge door for you.
Podcast Host (possibly from 16Z or Lydian Space)
Final protocol, and then we can wrap up. Proof of human.
Marc Andreessen
Yes.
Podcast Host (possibly from 16Z or Lydian Space)
Right. That's the last piece that we got to figure out.
Marc Andreessen
Yeah. So I would say there's two massive, I would say, sort of asymmetries in the world right now where we've known these asymmetries exist.
Ben Horowitz
And we. We societally have been unwilling to grapple with them. And I think they're both tipping right
Marc Andreessen
now, and they're the same thing.
Ben Horowitz
It's virtual world version. It's a physical world version. So the virtual world version is the bot problem. We're just like, you know, the Internet is just, like, awash in bots. Internet's awash in fake people. It has been forever, by the way.
Marc Andreessen
A lot of that has to do
Ben Horowitz
with lack of money.
Podcast Host (possibly from 16Z or Lydian Space)
And so this is My spicy take was these two are the same thing, and corporations are people, too. Interesting.
Marc Andreessen
Yeah, yeah, yeah.
Podcast Host (possibly from 16Z or Lydian Space)
Okay, so a bank account is proof of human.
Marc Andreessen
Yeah, okay. Yeah. Until you give the bots bank accounts. Yeah, exactly, exactly. So, okay, yeah, so there's that. But, yeah, look, I mean, every social
Ben Horowitz
media user knows this. The bot problem is a big problem. The bot problem has been a bigger problem forever. It's a huge problem, and it's never really been confronted directly at Any point.
Marc Andreessen
By the way, the physical world version
Ben Horowitz
of this is the drone problem, right? And so we've known for 20 years now that the asymmetric threat, both in actual military conflict, but also in just, like, security, like security on the home front. The big threat is the cheap attack drone, right? The cheap suicide drone with a bomb.
Marc Andreessen
And we've known that forever.
Ben Horowitz
And by the way, like, you know, it's very disconcerting how, like, every, you know, every office complex in the, you know, in the world is, like, unprotected from drone attacks. Every. Every stadium, every school, every prison. Like, it's like, okay, we've known that.
Marc Andreessen
We've never done anything.
Podcast Host (possibly from 16Z or Lydian Space)
What are you going to do about it?
Marc Andreessen
Yeah, one possibility is just leave them
Ben Horowitz
unprotected forever and live in a world of, like, asymmetric terrorism forever or. The other is take the problem seriously
Marc Andreessen
and figure out the set of techniques
Ben Horowitz
and technologies required to be able to deal with that. Whether those are lasers or jammers or early warning systems. Systems or personal force fields.
Marc Andreessen
Kinetic, Personal dune. Personal force fields. Exactly. And in both cases, these are economic asymmetries. These are economic asymmetries.
Ben Horowitz
Right, because it's really cheap to field a bot, but it's very hard to tell something a bot. It's very cheap to field a drone. It's very expensive to defend against a drone.
Marc Andreessen
But you see, what I'm saying is
Ben Horowitz
it's the virtual version of the problem, and it's the physical version of the
Marc Andreessen
problem, the virtual version of the problem.
Ben Horowitz
What we need, quite literally, is proof of human.
Marc Andreessen
The reason is because you're not going
Ben Horowitz
to have proof of bot, especially now that the bots are too good.
Marc Andreessen
The bots can pass the Turing test. And if the bots can pass the Turing test, then you can't.
Ben Horowitz
You can't screen for bot.
Marc Andreessen
You can't have proof of not a bot. But what you can have is you
Ben Horowitz
can have proof of human. You can have, you know, cryptographically validated. This is definitely a person.
Marc Andreessen
And this is.
Ben Horowitz
And then you can have cryptographically validated, this is definitely, like, something that a person said. This video is real. Right?
Podcast Host (possibly from 16Z or Lydian Space)
Just to double click on. Do you think Alex Blania with World. Do you think he's got it, or is there an alternative?
Marc Andreessen
Oh, so, I mean, there's going to be. I think there'll be. I think many people will try.
Ben Horowitz
We're one of the key, you know, participants in the World project, so we're
Marc Andreessen
part partisans, but yeah, I think so. We think world Is exactly correct. And the reason is it has to be proof of human, because you can't do proof of not bot.
Ben Horowitz
You have to do proof of human. To do proof of human, you need biological validation. You needed to start with this was actually a person. Because otherwise you have bots signing up as fake people. So you have to have something, you have to have a biometric and then you have to have cryptographic validation and then the ability to do the lookup.
Marc Andreessen
And then by the way, the other
Ben Horowitz
thing you need, which you also need selective disclosure. So you need to be able to proof a human without revealing all the underlying information. By the way, another thing you're gonna need, you're proof of age, right? Because there's all these laws in all these different countries now around. You need to be 13 or 16 or 18 or whatever to do different things. And so you're gonna need, you know, sort of validated proof of age, you know, to be able to legally operate. Right? And so that, that's coming. And then you're gonna want like proof of credit score and, you know, proof of like, you know, 100 other things.
Podcast Host (possibly from 16Z or Lydian Space)
That's a tricky one.
Marc Andreessen
It is a tricky one. But you're, you're gonna, there's no reason, like if somebody's checking on your credit, somebody shouldn't give you an example.
Ben Horowitz
Somebody shouldn't need to know your name in order to be able to find out what, whether you're credit worthy, independently
Podcast Host (possibly from 16Z or Lydian Space)
verifiable pieces of information.
Marc Andreessen
Pieces of information it's selectively disclosed. And this is the answer to the
Ben Horowitz
privacy problem writ large, which is I only need to prove what I need to prove at that moment.
Marc Andreessen
So you're going to need that.
Ben Horowitz
And I think their architecture makes sense.
Marc Andreessen
So that needs to get solved. I think language models have tipped. The bots are now too good. And so they're undetectable.
Ben Horowitz
And so as a consequence, we now need to go confront that problem directly. And then, like I said, and then the other problem is we need to go actually confront the drone problem. The Ukraine conflict has really unlocked a lot of thinking on that. And now the Iran situation, situation is also unlocking that. And so I think there's going to be just like this incredible explosion of both drone and counter drone.
Podcast Host (possibly from 16Z or Lydian Space)
Our drones are better than their drones. As long as you keep it that way.
Marc Andreessen
Yeah, encounter drones.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
I think we can sneak in one more question. I'm trying to tie together a lot of things that you said over the years. So at the Milken Institute debate with Thiel, which is Amazing. You talked about the lag between a new technology and kind of like the GDP impact of it. The other idea you talked about is bourgeois capitalism and how, you know, this kind of managerial class was needed because of this complexity. And I think if you bring AI into the fold, you have like much higher leverage of people. So like, if you have, you know, the Musk industries and you give Elon AGI, you can run a lot more things at once.
Ben Horowitz
That's right.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
And then you have the social contract. And I know you retweeted a clip of Sam Almond saying, we're rethinking the whole thing. And you're like, absolutely not.
Marc Andreessen
Yes.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
And I was at an event with Sam last night and he actually said in the last couple of weeks, it felt like now people are taking this that seriously. So I'm just curious, like how you're seeing the structure of organization changing, especially when you invest in early stage companies and. Yeah, just like how the impact of work structure and all of that is playing out.
Marc Andreessen
Yeah. So there's a whole bunch of, there's
Ben Horowitz
a whole bunch of times. I know.
Marc Andreessen
Yeah.
Ben Horowitz
By the way, we'd be happy to spend more time, but we could, we could spend more time on all that. So just for people who haven't followed this.
Marc Andreessen
So this term managerial comes from this
Ben Horowitz
thinker in the 20th century, James Burnham, who just one of the great kind of 20th century political thinkers, societal thinkers.
Marc Andreessen
And he sort of said, and he
Ben Horowitz
was writing in like the 19th century,
Marc Andreessen
1940s, 1950s, and he said kind of the whole history of capitalism up until
Ben Horowitz
that point had been in two phases. Number one had been what he called bourgeois capitalism, which was, think of it as like name on the door, like Ford Motor Company, because Henry Ford runs the company and it's like a dictatorial model. And Henry Ford just tells everybody what to do.
Marc Andreessen
And he said the problem with bourgeois
Ben Horowitz
capitalism is it doesn't scale because Henry Ford can only tell so many people to do so many things and then he runs out of time in the day. And so he said the second phase of capitalism was what he called managerial capitalism, which was the creation of a professional class of managers that are trained not to be like car experts or to be whatever experts in any particular field, but are trained to be experts in management. And then that led to, you know, the importance of like Harvard business, you know, business schools and management consulting firms and all these things.
Marc Andreessen
And then you look at every big company today and like most of the executives at most of the fortune of
Ben Horowitz
500 companies are not domain experts in whatever the company does. And they're certainly not the founders of those companies, but they're professional managers.
Marc Andreessen
And in fact, in the course of
Ben Horowitz
their careers, they'll probably manage many different kinds of businesses. They'll rotate around and they might work in healthcare for a while and then work in financial services and then go work in something else, come work in tech.
Marc Andreessen
And what Burnham said is, he said that transition is absolutely required because the problem with bourgeois capitalism is it doesn't scale.
Ben Horowitz
Henry Ford doesn't scale.
Marc Andreessen
And so if you're going to run
Ben Horowitz
capitalist enterprises that are going to have millions to billions of customers, they're going to be operating a level of scale and complexity that's going to require this professional management class.
Marc Andreessen
And he said, look, the professional management class has its downsides.
Ben Horowitz
They're not necessarily experts at doing the thing. They're not as inventive. They're not going to create the next breakthrough, your thing.
Marc Andreessen
But he's like, whether you think that's
Ben Horowitz
good or bad or whatever is what's going to be required.
Marc Andreessen
And basically that's what happened.
Ben Horowitz
And so he wrote that book originally in 1940. Over the course of the next 50 years, basically managerialism, I mean today, up till today, managerialism basically took over everything. And what I'm describing is basically how all big companies run and how all governments run and how our large scale nonprofits run and kind of everything runs.
Marc Andreessen
Basically what venture capital does is we
Ben Horowitz
basically are a rump sort of protest movement to that to try to find the next Henry Ford or just to say Elon Musk or the next Elon Musk or the next Steve Jobs, the next Bill Gates, the next Mark Zuckerberg. And so we start these companies in the old model, right? We start them out in the Henry Ford model. And so we start them out with a founder or a founder with colleagues, but there's a founder CEO.
Marc Andreessen
And then we basically bet that the
Ben Horowitz
startup is going to be able to do things specifically innovate in ways that the big incumbents in that industry are not going to be able to do. And so it's a bet that basically by reason, lighting this sort of name on the door kind of thing, this new innovative thing with a king monarchical
Marc Andreessen
political structure, that they're going to be
Ben Horowitz
able to innovate in a way that the incumbent is not going to be
Marc Andreessen
able to because the incumbent is being
Ben Horowitz
run by managers, right?
Marc Andreessen
And by the way, and of course,
Ben Horowitz
venture being what it is, sometimes that works, sometimes it doesn't. But we're constantly doing that.
Marc Andreessen
But I've always viewed it my entire
Ben Horowitz
life as like, we're like raging against the dying of the light. We're sort of constantly trying to fight off managerialism, just basically swamping everything and everything getting basically boring and gray and dumb and old, right? And we're trying to keep, keep some level of energy, vitality in the system. AI is the thing that would lead you to think, wow, maybe there's a third model, right? And way to think about it would be maybe it's a combination of the two. Maybe the new Henry Ford or the new Elon or the new Steve Jobs. Plus AI is the best of both, right?
Marc Andreessen
Because it's sort of the spark of
Ben Horowitz
genius of the name on the door model, the Henry Ford model. But then it's give that person, AI superpowers to do all the managerial stuff and let the boss draw the managerial stuff.
Marc Andreessen
That may be the actual secret formula. And we've never even known that we wanted this because we never even thought it was a possibility. But I mean, you know, this, what is the thing that these bots are
Ben Horowitz
really good, they're really good at doing paperwork.
Marc Andreessen
Like they're really good at filling out forms, like, they're really good at writing reports, they're really good at reading, they're really good at doing all the managerial work.
Ben Horowitz
Like they're amazing at it.
Marc Andreessen
And so, yeah, so I think the 100%, I think the answer very well
Ben Horowitz
might be to get the best of both worlds by doing this.
Marc Andreessen
And then the challenge is going to be twofold. The challenge is going to be for
Ben Horowitz
the innovators to really figure out how to leverage AI to actually do this. Right?
Marc Andreessen
And then, and then the other challenge
Ben Horowitz
is going to be for the, for the incumbents that are managerial to figure out like, okay, what does that mean? Because now they're going to be facing a different kind of insurgent competitor that has a different set of capabilities than they're used to.
Marc Andreessen
And so this really, I think, is
Ben Horowitz
going to force a lot of big companies to kind of figure out innovation. Either say figure out innovation or die trying.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Do you feel like that structure accepts, accelerates the impact on the actual GDP and economy? If you look at SpaceX, it's like the growth is so fast and instead of having these companies kind of peter out in growth and impact, they can kind of keep going, if not accelerating.
Marc Andreessen
That's for sure the hope, the challenge.
Ben Horowitz
And look, the AI utopian view is of course, and that's going to be the future of the economy and it's going to grow a 10x and 100x and a thousandx. And we're entering this regime of much higher economic growth forever and consumer cornucopia of everything. And it's going to be great. And I hope that's true. I hope that's, that's like the, you know, that's the current kind of utopian vision. I hope that's true.
Marc Andreessen
The problem is, goes back again.
Ben Horowitz
The real world is really messy. And I'll give you an example of how the real world is really Messy. It requires 900 hours of professional certification training to become a hairdresser in the state of California.
Marc Andreessen
So it's like 35% of the economy, something like that.
Ben Horowitz
You have to get some sort of professional certification to do the job, which is to say that the professions are all cartels, right?
Marc Andreessen
And so you have to get licensed
Ben Horowitz
as a doctor, you have to get licensed as a lawyer, you have to get licensed, licensed as a. You have to get into a union,
Marc Andreessen
by the way, to, to work for the government.
Ben Horowitz
You need to be you.
Marc Andreessen
You have both civil service protections and
Ben Horowitz
you have public sector unions. You have two layers of insulation against ever getting fired for anything or anything, anything ever changing.
Marc Andreessen
I'll give you another example.
Ben Horowitz
The, the dock work. The dock workers went on strike a couple years ago because they're, you know, robotics.
Marc Andreessen
You know, if you go look at
Ben Horowitz
a modern doc, like in Asia, it's all robots. If you go to American dock, it's like all still guys, dragon, dragon stuff by hand. The dock workers went on strike.
Marc Andreessen
It turns out there are 25,000 dock
Ben Horowitz
workers working on docks in America. It turns out they have incredible political power because it's one of these unified blocks of things. They won their strike and so they got commitments from the DOC owners to not implement more automation.
Marc Andreessen
We learned a couple of things in that.
Ben Horowitz
So number one, we learned that even
Marc Andreessen
a union as small as 25,000 people
Ben Horowitz
still has like tremendous political stroke.
Marc Andreessen
We also learned that it actually turns
Ben Horowitz
out the dock workers union has 50,000
Marc Andreessen
people in it because they have 25,000 people working at docks. They have 25,000 people during full pay paycheck, sitting at home from prior union agreements. From prior union agreements. I'll give you another great example. There are government agencies, there are federal
Ben Horowitz
government agencies where the employees have civil service protections and they're in public sector unions. There are entire federal government agencies that struck new collective bargaining agreements during COVID where not only are they have their jobs guaranteed in perpetuity. But they only have to report to work in an office one day per month.
Marc Andreessen
And so there are entire office buildings
Ben Horowitz
in Washington D.C. that are empty 29 out of 30 days of the year that are still operating and we're all still paying for.
Marc Andreessen
And then what they do, it turns
Ben Horowitz
out what the employees do is they're very smart in this way. And so they figure out they come in on the last day of a month and the first day the next month.
Marc Andreessen
And so they're in the office two days per 60 days, which means these buildings are empty for 58 days at a time. And you see where I'm heading with this? This is like locked in, right? This is like locked in in a way that has nothing to do with like.
Ben Horowitz
And people say capitalist. It's like anti capitalistic. It's like, it's, it's basically, it's restrictions on trade, it's restrictions on the ability to change the workforce.
Marc Andreessen
And so, so much of our economy is, you know, I'm describing the entire
Ben Horowitz
healthcare system, I'm describing the entire legal profession, I'm describing the entire housing industry, I'm describing the entire education system, right?
Marc Andreessen
K through 12 schools in the United States, they're a literal government monopoly. How are we going to apply AI in education? The answer is we're not. Because it's a literal government monopoly.
Ben Horowitz
It is never going to change the end. And there is nothing to do, by
Marc Andreessen
the way, you can create an entirely new school system. That's the one thing you can do,
Ben Horowitz
is you can do what Alpha School is doing. You can create an entirely new school system.
Marc Andreessen
Other than that, you're not going to
Ben Horowitz
go in and change what's happening in the American classroom, like K12. There's no chance. The teachers are 100% opposed to it. It's 100% not going to happen.
Marc Andreessen
So you see, what I'm saying is there's this massive slippage that's going to take place. Both the AI utopians and the AI
Ben Horowitz
doomers are far too optimistic.
Marc Andreessen
You see what I'm saying? Because they believe that because the technology makes something possible, then 8 billion people
Ben Horowitz
all of a sudden are going to change how they behave. And it's just like, nope.
Marc Andreessen
So much of how the existing economy
Ben Horowitz
works, it's just like wired in.
Marc Andreessen
And so we're going to be lucky as a society.
Ben Horowitz
We're going to be lucky if AI adoption happens quickly, right? Because if it doesn't, what, we're just going to have a stagnation.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Mark, I know you got to run yeah.
Podcast Host (possibly from 16Z or Lydian Space)
We all know. Or stay. Welcome. But it was such a pleasure talking to you. We're truly living in an age of science fiction. Coming to real life.
Marc Andreessen
Yes. Yes.
Ben Horowitz
Could not be more exciting.
Podcast Host or Interviewer (possibly Alessio from Kernel Labs)
Thank you.
Ben Horowitz
With you guys. Awesome. Thank you.
Podcast Host (possibly from 16Z or Lydian Space)
That's it.
Ben Horowitz
Good. Thank you.
Marc Andreessen
That's it.
Date: April 3, 2026
Host(s): Latent.Space (with possible guest hosts/interviewers Alessio from Kernel Labs, Sprix, and others)
Guests: Marc Andreessen, Ben Horowitz
This episode is a wide-ranging and deep discussion with Marc Andreessen and Ben Horowitz on the state of AI, the evolution of foundational models, the infrastructure race behind agents, the promise and challenges of open-source AI, and how organizational and economic structures may transform (or not) as a result of AI’s explosive progress. It also features Andreessen reflecting on the historical arc of software and hardware, the role of the browser and Unix, and why—despite cyclical tech hype—he believes that “this time is different.” The conversation covers both practical and speculative ground, with insights into current agent architectures (like OpenClaw and Pi), scaling laws, capital investment, open-source trends, and the perennial friction between technological potential and social inertia.
From Moore's Law to AI Scaling Laws
Infrastructure and “Sandbagging” Capabilities
Importance of Open Source
Global Dynamics in Open Source AI
On AI Hype Cycles:
"There's something about AI that causes the people in the field to become both excessively utopian and excessively apocalyptic."
—Marc Andreessen [07:35]
On Code Agents:
"If Linus Torvalds is saying that the AI coding is now better than he is, that's never happened before..."
—Marc Andreessen [11:05]
On Open Source Diffusion:
"Even if the Chinese models themselves are not the models that get used, the education that's taken place to the rest of the world, the information diffusion is incredibly powerful."
—Ben Horowitz [30:07]
On Agent Portability:
"You can instruct your agent, migrate yourself to a different runtime environment, migrate yourself to a different file system, migrate yourself to a different... Swap out the language model. Your agent will do all that stuff for you."
—Ben Horowitz [38:34]
On Security and Yolo Users:
"I think the people who turn that on for bots are like, they're like martyrs to the progress of human civilization... I feel very bad for their descendants that their bank accounts are going to get looted by their bots in the first, like, 20 minutes. But the contribution that they're making to the future of our species is amazing."
—Marc Andreessen [56:38–56:48]
The episode’s tone is enthusiastic, reverent of technical progress, and at times incredulous about the pace of change; but it’s also seasoned with realism, caution, and a deep understanding of the non-technical forces that shape adoption.
Marc Andreessen and Ben Horowitz blend historical perspective with day-to-day engineering and investing realities, repeatedly emphasizing that:
For more exclusive interviews, news, and deep dives into the engineering and business of AI, check out https://latent.space.
End of Summary