
Loading summary
Paul Raitzer
The VC money is funding companies that will build the equivalent of human workers and far beyond that because they don't sleep, they don't need benefits, they don't need time off, they cost $20,000 a month and they do the work of 10 people that cost a half a million a year. Like, yep, it's coming fast. Welcome to the Artificial Intelligence show, the podcast that helps your business grow smarter by making AI approachable and actionable. My name is Paul Raitzer. I'm founder and CEO of Marketing AI Institute and I'm your host. Each week I'm joined by my co host and Marketing AI Institute Chief Content Officer Mike Kaput as we break down all the AI news that matters and give you insights and perspectives that you can use to advance your company and your career. Join us as we accelerate AI literacy for all. Welcome to episode 139 of the Artificial Intelligence Show. I'm your host Paul Raitzer along with my co host Mike Caput. We are recording 11am March 10, Mario Day for all those who celebrate. I was just telling Mike, my family is big into Nintendo and Mario Kart and Lego and they just dropped like a Lego Mario Kart thing today, which is pretty exciting. All right, so back to AI. This episode is brought to us by Goldcast. Goldcast was the presenting sponsor of our AI for Writers Summit. That just happened last week. It was incredible. Thank you to everyone who came to the Writers Summit. We had 4,600 people from 96 countries attend the Writers Summit. Pretty remarkable. It was a virtual event. So if you, if you weren't aware we were doing it, it was a half day virtual event and it was amazing. And the Gold Cast technology platform was essential that we're not only they presented the sponsor, they were the platform that we use to run that conference. We do three virtual events per year right now and, and Goldcast is the platform we use for all of them. So not only is it a great platform for those events, they have an AI powered content lab that takes all of our event event recordings and instantly turns them into ready to use video clips, transcripts and social content, which saves our team tons of manual work and hours. So if you're running virtual events and want to maximize your content effortlessly and create a great experience for your attendees, check out Goldcast at Goldcast IO that is Goldcast IO and then also you've heard me mention this a few times recently. We are currently collecting data for our fifth annual State of Marketing AI report Last year. Last year's report shared never before seen data from almost 1800 marketers and business leaders on how they actually use and adopt AI. This year we're aiming for even more respondents and you can help out by going to stateofmarketingai. Com. You will see a link at the top to participate in the 2025 survey. You can also download the 2024 report while you are there. So again, that is stateofmarketingai.com and once we publish the 2025 report, you will get an email with a copy to review and download that report. Okay, so it was a It was a huge week in AGI Artificial Superintelligence News. Anybody who gets my Executive AI Insider newsletter on Sundays, this was like the theme of the week for me. You know, as Mike and I were going through, there was almost like 50 topics this week that we looked at. The thing that jumped out to me just immediately when I looked at it was AGI and AI's impact on jobs. And so that's where we're going to kind of start and linger for these first three main topics is sort of this overall theme of AGI, which is artificial general intelligence, asi, which is artificial super intelligence, and what this might mean to the near term future. Because it's there's a lot of chatter, there's a lot of buzz. And like I said in the newsletter, either they're all wrong or we should be doing more to prepare.
Mike Kaput
Well, how about this for an opening statement and title here, Paul the Government Knows AGI is Coming. That is the warning that serves as the title of a new episode of the Ezra Klein show, which is a podcast in which the journalist interviews Ben Buchanan, who is the former special advisor for AI to the Biden White House. And in this episode, both Pine and Buchanan agree that AGI, or systems that can do any type of cognitive task that a human can do, is likely to arrive in the next few years. Klein starts this episode by saying, for the last couple of months, I've had this strange experience. Person after person from artificial intelligence labs, from government has been coming to me saying it's really about to happen. We're about to get artificial general intelligence. What they mean is that they have believed for a long time that we are on a path to creating transformational artificial intelligence capable of doing basically anything a human being could do behind a computer, but better, says Klein. They thought it would take somewhere from five to 15 years to develop, but now they believe it's coming in two to three years during Donald Trump's second term. In this episode, Klein and Buchanan cover a lot of ground related to what this all means. They talk about AI competition between the US and China, how the Trump administration will approach AI, and what AGI could mean for jobs, national security, and cybersecurity. Now, this probably may be one of the more important interviews you listen to this month, or maybe even this year, if things play out. You know, Buchanan clearly knows his stuff, shares a lot of great perspective from his time working on AI in the White House. But also, this podcast leaves a lot of things unanswered. Klein strongly argues that we're not remotely prepared as a society for what's coming in the next few years, especially when it comes to AI's impact on. On the economy. So, Paul, I'll turn it over to you here. Why don't you walk us through what you found most worth paying attention to in this very extensive and kind of unnerving interview.
Paul Raitzer
Yeah, it's definitely worth listening to. And we'll link to the opinion piece in the New York Times that has the full transcript as well. So if you prefer to read it, it's a good way to go through it. Yeah, I mean, there's just a lot of noteworthy things to touch on here. So first, if people aren't familiar with Ezra Klein, he has been writing New York New York Times opinion pieces since 2021. He was the founder and editor in chief and then editor at large of Vox, has the Ezra Klein show, obviously, which is number nine in terms of Apple Podcast top shows charts. So He's a top 10 podcast in the world on Apple podcasts, I assume similar in Spotify. So he's someone that a lot of people listen to. And he. It was a very aggressive interview. Um, you know, I think Buchanan, who I wasn't familiar with, honestly before this, I'm sure we saw his name. I don't know that we've ever talked about it on the show. He was obviously involved in the Biden White House pretty significantly. So I did look into him a little bit. Cause I was curious, like, who this guy was that played such a key role. And his background is very, very heavy. National security and cyber security. So he's the former director of Cyber AI Project at Georgetown center for Security and Emerging Technology. He's currently an assistant professor at Johns Hopkins University's Director for Technology and National Security for the National Security Council for one year during the Biden White House. He did his postdoc at Harvard Kennedy School, Belfor center, where he was working on cybersecurity project. So he's heavy, heavy and this is important context to the conversation. To know his background is actually in cyber security and that the Biden White House had someone with a cyber security background sort of leading the charge tells you where they think the conversation needs to be at when it comes to this stuff. So I, I want to start with in the opening of the opinion piece, and I think he said something similar on the podcast. Klein says, if you've been telling yourself this isn't coming, I really think you, you need to question that. It's not web three, it's not vaporware. A lot of what we're talking about is already here right now. I think we are on the cusp of an era in human history that is unlike any of the eras we have experienced before. And we're not prepared in part because it's not clear what it would mean to prepare. I think that's a very important point. We don't know what this will look like, what it will feel like. We don't know how labor markets will respond. We don't know which country is going to get there first. We don't know what it will mean for war. We don't know what it will mean for peace. And while there is so much else going on in the world to cover, I do think there's a good chance that when we look back on this era in human history, AI will have been the thing that matters. We're at this moment of a big transition in policymakers, and they are probably going to be in power when artificial general intelligence or something like it hits the world. So what are they going to do? What kinds of decisions are they are going to need to be made? And what kinds of thinking do we need to start do doing now to be prepared for something that virtually everybody who works in this area is trying to tell us as loudly as possible is coming? So that, to me is just kind of like encapsulates what we've been saying on the show, Mike. Like, this is. This isn't just us. It's not like a couple of talking heads on a podcast who've been following AI for a while who think it's important. This is fundamentally like, across organizations, across government, across society, the people in the know are trying very, very hard to get everyone else to pay attention. But as Klein illuminates right away, nobody has a plan for this. And this is what I keep preaching is like, let's just be proactive. So, Mike, you had touched on this definition, but I think it's important that, you know, Buchanan talks about A canonical definition he stressed right away. It was kind of funny. Klein called him out on this. He's like, I don't like AGI as a term. And he's like, we get it, man. Stop telling it with every time you use the term term. So a system capable of doing almost any cognitive task a human can do. Now this is Buchanan. I don't know that we'll quite see that in the next four years or so, but I do think we'll see something like that. Where the breadth of the system is remarkable, but also its depth, its capacity to in some cases exceed human capabilities, regardless of the cognitive discipline. Klein then says, systems that can replace human beings in cognitively demanding jobs. And Buchanan says, yes, or key parts of cognitive jobs. So then when we get into the AI and government now this is. I actually like paused it. I was listening to this in my car and I paused it after hearing this part and I'll explain why in a second. So Buchanan says, what's fascinating to me is that this is the first revolutionary technology that is not funded by the Department of Defense. Basically, if you go back historically, over the last hundred years or so, nukes, space, the early days of the Internet, the early days of the microprocessor, the early days of large scale aviation, radar, Global positioning system, the list is very, very long. All of that tech fundamentally comes from Department of Defense money. It's the private sector inventing it, to be sure, meaning AI. But the central government role gave the Department of Defense and the US Government an understanding of the technology that by default it does not have an AI. It also gave the US Government a capacity to shape where that technology goes. By default, we don't have. What he's saying is most of the innovation, especially the last 50 years, came out of DARPA, Defense Advanced Research Projects Agency in the Department of Defense. Meaning they either invented it or they were funding the private development of these technologies. So they were on the inside as it was emerging and they could better plan ahead. The US government has been funding AI for, for the last 10, 20 years through DARPA. But they got caught off guard by generative AI. And all that basically happened over the last three years. They were not prepared. They're not the ones that built it. The, the top language model didn't come out of Darpa. It came out of OpenAI, which the government had no involvement with. It originated out of Google's labs, which the government didn't have access to. So that's a really important point that they've basically been playing Catch up trying to understand this technology. And it appears one of the most important people in that process is a cybersecurity guy. So it tells you, again, like, the importance. So then they get into AI in China, which they spent a good portion of the conversation on. And I think the real key here is as soon as Klein brought up China, Buchanan directed it to cybersecurity. So this is why his cybersecurity background is so important. So it helps illuminate how the government thinks about AI. First and foremost, this is national security and military dominance. So jobs in the economy are secondary. It's not that the government isn't aware it might have this massive impact. They're just far more concerned about military dominance and national security, which is what DARPA's existence is all about, is military dominance and protection of democracy in the us. So in the. In the AI in China debate, Buchanan says it's pretty out in the open that if you had a much more powerful AI capability, that would probably enable you to do better cyber operations on offense and on defense. What is cyber operation? He asks. Breaking into an adversary's network to collect information, which, if you're already collecting in a large enough volume, AI systems can help you analyze. We actually did a whole big thing through DARPA, which I mentioned, called the AI Cyber Challenge, to test out AI's capabilities to do this. And I would not want to live in a world in which China has that capability on offense, defense, and cyber, and the United States does not. Meaning he's seen what they're capable of doing with the current AI, and they can project out what they'd be able to do with more powerful AI. And they know they don't want China getting there first. They did touch on cyber security in these AI labs, which Mike, you and I have talked about in these shows before. I remember specifically an instance where Dario Amade was talking about, you know, basically, we spend probably billions on trying to protect our models and our weights that within anthropic, only a few people even know the weights to the system. But he said, like, if a foreign government wants it, they're going to get it. Like, these people are really good at this, and no matter how strong our protections are, they're going to get it if they want it. And so this whole idea that these foreign actors are trying to hack in through cybersecurity or through cyber, but also at San Francisco parties where all these AI researchers sort of openly talk about what they're doing and what they're working on. So I this was another instance where I paused and I was like, oh my God. Like, nationalization of these labs actually seems like something that the Biden administration very likely considered and that the current administration I don't think would be as likely to consider. But you start to understand why nationalization of the labs might actually be a strategy that's explored. Because if they become convinced that they need to get there first and these models are going to become more and more powerful than the government wants full control of protecting those models. So that was really interesting. And then the one where my ears really perked up was when Klein asked about Marc Andreessen and I don't remember episode Mike, what episode it was. Yeah, it was like January or something. We talked about that.
Mike Kaput
I think it was beginning of the. Right around the beginning of the year.
Paul Raitzer
Okay, yeah. So we'll put the link in the show notes. But if you don't recall Marc Andreessen, who A16Z Andreessen Horowitz, the VC firm, he had this very interesting quote where he claimed that he was in a meeting with someone from the Biden administration, I, I assume in 2024, where they basically told them, don't worry about investing in startups doing AI. There's only going to be two or three labs that the Biden administration in the second term is going to make sure that all of this is centered on two to three companies. Again, they didn't say nationalization, but basically that they could then better control and protect these models. And at the time we thought, that's really weird. And I would be, I would be shocked if they said it. But that was the, the argument Andreessen gave as to why they threw their support behind Trump and why they then pushed very heavily for Trump to get elected. So I've been anxiously awaiting the other side of this story. And this is the first time I've heard anyone who might have been in the room. So Klein says, were you part of the conversation that Andreessen was describing? Ben said, I met him once. I don't know exactly. He then said Andreessen talked about concerns related to startups and competitiveness. And I think my view on this is look at our record on competitiveness. And it's pretty clear that we wanted a dynamic ecosystem. Now, I do think there are structural dynamics related to scaling laws and the like that will force things toward big companies that I think in many respects we were pushing against. But I think our track record on competition is pretty clear. That is a very clear non answer, in my opinion. Did you Read it the same way, Mike. I was like, well, that didn't answer the question.
Mike Kaput
Oh yeah, I was so excited for the next pair. I was reading the transcript like this morning again. I was so excited for the next paragraph and I was like, like a few words in. I was like, you're not going to.
Paul Raitzer
Answer this, are you? Yeah, no. So he basically was like, I might have been in the room to the conversation he's referring to, but maybe that's not exactly what was said. So then Klein says, the view that I understand Andreessen arguing with, which is a view I have heard from people in the AI safety community, but is not a view I had necessarily heard from the Biden administration, was that you will need to regulate the frontier models of the biggest labs when it gets sufficiently powerful. And in order to do that, you will need controls on those models. You just can't have the model and everything floating around so everybody can run this on their home laptop. So, yeah, we didn't get the answer I was hoping for. I don't know who else might have been in that room. I kind of got the impression it probably came from a meeting with Buchanan, but he just didn't want to like get into the specifics there. It was a very politician like answer for a non politician.
Mike Kaput
It really was.
Paul Raitzer
So then the thing, Mike, that jumped out to me. And we'll time this timestamp. This is kind of like the second major topic was when Klein and Buchanan talked about the impact of AI on jobs. So Klein says one of the other things that Vance. So this is going back to JD Vance's AI Paris Summit talk or manifesto from a few weeks ago that we covered on the podcast and we'll drop that link in the show notes as well. One of the other things this is Kleinigan, One of the other things that Vance talked about and that you said you agreed with is making AI quote pro, pro worker. What does that mean? So Buchanan then said, I think we want to have AI deployed across our economy in a way that increases workers, agencies and capabilities. And I think we should be honest that there's going to be a lot of transition in the economy as a result of AI. Transition is doing a lot of work in that sentence.
Mike Kaput
No.
Paul Raitzer
He continues, I don't know what that will look like. You can find Nobel Prize winning economists who will say it won't be much. You can find other folks who will say it will be a ton. I tend to lead toward the side that says it's going to be a lot, but I'M not a labor economist. The line that Vice President Vance used is the exact same phrase that President Biden used, which is, give workers a seat at the table in that transition. Which I just laughed, honestly, when I heard that line that means literally nothing like it. One of the most useless lines. So Klein then says, and this is where it got kind of chippy. I would say, like, Klein was going hard here. And that was the note I made to myself, like, wow, he's 51 minutes. He goes really hard on the end jobs, right? So Klein says, I will promise you. And this is what I've been saying, I will promise you. The labor economists do not know what to do about AI. You were the top advisor for AI. You were at the nerve center of the government's information about what is coming. If this is half as big as you seem to think it is, it's going to be the single most disruptive thing to hit labor markets ever, given how compressed the time period is in which it will arrive. It took this again, Klein continues, it took a long time to lay down electricity. It took a long time to build railroads. AI is going to come really quickly. It's going to be harder for the big firms to integrate it. But what you're going to have is new entrants who are built from the ground up, where their organization is built around one person overseeing these, like, seven systems. This is the part I just, I was like, whoa. He said, so you might just begin to see triple the unemployment among marketing graduates as people who run Marketing Institute. That one again, sort of caught my attention. He then says, there are just a lot of jobs that are doing work behind a computer and. And as companies absorb machines that can do work behind a computer for you, that will change everything. And he says to Buchanan, you must have heard somebody talking about this. You guys must have talked about this. Buchanan again, kind of sidesteps this. And this was became his answer basically for everything we did talk to economists and to try to texture this debate in 2324, 2023, 2024. The trend line is even clearer now than it was then. We knew this was not going to be a 2023, 2024 question. Frankly, to do anything robust about this was going to require Congress. And that just was not in the cards at all. So it was more of an intellectual exercise than it was a policy. Now, I found this fascinating, Mike, because all of 2024, during election season, I kept saying, you don't hear anything about AI. Neither side was talking about AI. And then as soon as the administration flips it, it just dominates the conversation. And my belief at the time was because you couldn't win votes, talking about it like there was no point in talking about it because one, they didn't have answers about what it meant, two, the public didn't seem to care enough to take a side in this debate. And so what we have here is the Biden administration basically saying, we know this is going to decimate the economy and jobs, or might be great for the economy, gdp, but like jobs, it's probably going to decimate in the near term, but it's not going to be on our watch. If we don't, we win this election and we're going to need Congress and like we just can't do anything about this. So we explored it a little bit and then I'll kind of like wrap up here. Mike with Klein gave his example of using Deep Research, which we've talked about as one of those moments for us. We're like, whoa, like this changes things for the future of work. So Klein says, I recently used Deep Research, which is a new open AI product. It's on their pricing tier. Most people, I think, have not used it. He's correct. But it can build out something that's more like a scientific analytical brief. In a matter of minutes. Klein continues, I work with producers on the show. I hire incredibly talented people to do very demanding research work. I asked Deep Research to do this report on the tensions between Mandisonian constitutional system and the highly polarized nationalized parties we now have. I don't even know what that means. I need Deep Research to explain to me what that sentence means. And what it produced in a matter of minutes was at least the median of what any of the teams I've worked with on this could produce within days. I've talked to a number of people at firms that do high amounts of coding and they tell me that by the end of this year or next year, they expect most code will not be written by human beings. And then Mike, like, this is a lot. But Klein wasn't the only one talking about AI and jobs this week. So why don't you kind of talk us through a couple of the other things? Because again, what I said in the newsletter, what I let out with this is when you zoom out, you just see the trends emerging and like this on its own was noteworthy. When in the context of the other stuff Mike's about to walk through, all happening in a five day period, you start to realize something different is happening. And again, either they're all wrong or we need to be doing more as a business world and as a society to be prepared.
Mike Kaput
I'm going to dive into that in one second. I want to add one final note here that just made me laugh out loud in disbelief is that, you know, you said Klein was really pushing him on stuff and he was like, hey, why didn't you think, why didn't you game this out? Why didn't you think more about this? Did you have conversations? And he even says at one point, did you drop this into like quad and game out what could happen? And he literally says no, because the government, like basically alluding to the government had restrictions on using the technology. And Klein says, well, that's a bit damning in and of itself, isn't it? And they kind of move on. So I was like, we are starting from a place that is way further behind than where I would have anticipated.
Paul Raitzer
Yeah. And that's like, again, it's a theme of this show all the time is I keep trying to stress to people if you think someone else is out there doing this research, they're not. Like this came up in the situational awareness episode. Mike, we did those two episodes back to back on Leopold Ashenbrenner, Situational awareness. And that's what he said. He's like, dude, if you think someone else is figuring this out, there's like 200 of us in Silicon Valley who are even aware of what's happening. So that's it. Like there is not some army coming that's going to like figure this all out for everybody.
Mike Kaput
All right, so you talked about the Klein episode and then you're talking about AGI and ASI AI and jobs in the Exec AI newsletter. Now, tying this all together, we are seeing, like you mentioned, some of these signals that something is up because one of the things that came out recently is according to the information, OpenAI executives have apparently told some investors that the company plans to sell a variety of AI agents, agents that seem pretty explicitly targeted at doing the type of knowledge work that we all do today. So this is straight from the information. Quote, OpenAI executives have told some investors they plan to sell low end agents at a cost of $2,000 per month to quote, high income knowledge workers, mid tier agents for software development costing possibly $10,000 a month and high end agents acting as PhD level research agents which could cost $20,000 per month according to a person who's spoken with executives. So that in and of itself is quite big news if that ends up coming to fruition. And kind of at the same time, we've started to see some more of these projects and papers come out that strongly suggest agents and reasoning models, some of them using RAG or chivo. Augmented generation may be able to transform how some of these really highly paid knowledge work jobs in fields like finance and legal are done. So one quick project to Note is called NDEX. This is an agentic AI assistant that's been publicized by OpenAI on their website because it's built on their technology. NDEX's agents autonomously process financial reports, market data and firm specific knowledge to complete tasks, all thanks to OpenAI's reasoning models. And interestingly, using reasoning models, they're able to achieve the high levels of accuracy that are critical to this type of financial services work. They basically call it an AI financial analyst. There's also a paper that just came out that got a lot of attention called AI Powered Lawyering, AI Reasoning Models, Retrieval, Augmented Generation and the Future of Legal Practice. So this dived into 80 plus pages of research that looked at what it was like when lawyers started using some of the most advanced reasoning tools. They found, for instance, that law students using OpenAI's 01 preview saw work quality increase and saw time savings of 12 to 28%. And thanks to RAG based AI with access to legal material, the hallucinations using this technology were reduced to a human level. So the whole point here is we're starting to see these domain specifications, AI assistance, or some might call them replacements to this type of really sophisticated knowledge.
Paul Raitzer
Not the actual companies themselves.
Mike Kaput
They will not say that. Correct. So to kind of wrap this all up, this is why the tech journalist Alex Cantrowitz we've talked about a bunch, he does big technology. He chose this week to write this article literally titled okay, I'm Starting to Think AI Can Do My Job after all, in which he concludes that some work that once seemed safe now looks like it's directly in the path of machines. And then, last but not least, and then, Paul, I want to turn this back over to you to kind of get your take on what OpenAI is doing. There was a ton of like firestorm and buzz on the Internet over this AI agent out of China called Manus M A N U S. Now, we have since found that this is probably just a wrapper around Claude that uses some agentic capabilities. But people are sharing all sorts of links and demonstrations of this thing, calling it a truly autonomous general agent that can go do plenty of stuff for you without human Involvement. So it doesn't look like we're quite there yet or there's a lot more to that story. But Paul, kind of maybe walk us through, tie these threads together. We've got this big, bold statement from OpenAI that they're going to charge all this for agents. Like, what's going on here?
Paul Raitzer
Yeah. So the man is thing I was watching over the weekend because it was, I mean, Friday it was like blowing up. It was like the deep sea Guest kind of like where everyone all of a sudden was the only. Well, that. The MCP thing that like we did that, but like that was crazy too. Yeah. So then like yesterday I saw somebody who basically got the system to tell it that it was using like Claude 3.7, I think Sonnet to do what it was doing. And then it was connected to like dozens of tools. Regardless, it was definitely like a more advanced computer use demo than we have seen. That I think does show the promise. I don't think you look back and be like, oh, Manus was like this great breakthrough. But I think it, it moved the conversation forward about what these AI agents with computer use will be able to do and, and maybe accelerate the timeline in some ways, which again, all this is inevitable. It's just how quick it happens and how fast it diffuses throughout society and the economy. So on the OpenAI pricing thing, like we'd heard the 2000amonth floated and I said at the time, like, no brainer, it's only $24,000 a year. Like that's you're paying that like to do when you make the business case for it. 20,000amonth is a different story. Also, I think demand would skyrocket. Now they don't have $20,000 a month. You're talking about $240,000 a year, which means you're now in the realm of like financial analysts, attorneys, hedge funds managers, AI researchers, computer programmers. Like that's the people making, you know, 200 to 500,000 a year. Where to your point, Mike? If we're talking about replacement value now, I'm like, yeah, because that one, $20,000 a month can do the work of five of those people. Once they, you know, a year from now or whatever, we fast forward and the capabilities are there, reliability is there. So while they're not saying replace your workers, if you go to the NDEX site, which again is in the financial world, this is straight up the messaging from their homepage, the autonomous financial analyst. It says, meet Index, your next financial coworker. That's like softening things a little bit. Then they say the first AI agent for financial services. Optimize your team's most common workflows and enhance the quality of every output. And then they have scale your workforce, multiply your results, use index to launch multiple tasks that will continue working in the background. Like having an AI workforce 24 7. You know what's great about an AI workforce, Mike? They don't need benefits, they don't need paid time off.
Mike Kaput
Yep.
Paul Raitzer
Their mood never changes. They just do what you tell them to do 24, 7. As long as you got enough Nvidia chips humming in the background. So again, our whole point with all of this is not that Mike and I are proposing a future where digital workers take over the workforce. All we are telling you is the VC money is funding companies that will build the equivalent of human workers and far beyond that because they don't sleep, they don't need benefits, they don't need time off. They cost $20,000 a month and they do the work of 10 people that cost a half a million a year. Like y. It's, it's coming fast. And I think that's the whole point of like the first conversation leading off to this Klein thing is like the government isn't prepared for how fast. The labs aren't doing the research to tell you how fast. Like, but it's, it's coming and, and like we need to do more. Like there's still time to prepare especially as like the downstream industries like you know, I don't know, like manufacturing and healthcare and to a degree retail. Like these industries, they're going to take a few years. It's not like we're going to flip a switch. And by the end of 2025, it's just everywhere. But it's a hundred percent going to be infused into financial companies and hedge funds and law firms and AI research firms. Like it's, it's going to be there, it's going to be this year. Start to have a disruptive impact.
Mike Kaput
Yeah. And the scariest thing in a way though I give them a lot of credit is Klein asked some questions in that interview that I was like, these are the most in depth and smartest questions anyone's been asking about this so far.
Paul Raitzer
Like. Right.
Mike Kaput
And it's like aiming it out.
Paul Raitzer
Yeah. And like I would love. Well I, you know, I don't know if J.D. vance is the right guy to do this because I don't know that he would have any depth as answers. But I would love like Andreessen But I, I honestly feel like there's just these people who are so pro acceleration that they, they. The answer is always, we'll figure it out. It will create more jobs like it's gonna. It always does. But Klein's questions, to your point, like how do you possibly answer those questions with any depth whatsoever? And that's my concern is like the people who are driving this innovation don't have good answers to any of the hard questions about the impact.
Mike Kaput
So to kind of wrap all this up with a bow. This was not the only discussion of AGI and even super Intelligence that was happening from some of these major players. Like at the same time some, several major AI players, coincidentally or not, depending on what you want to think here, have released some updated thoughts on how we need to approach AGI. So OpenAI recently published an article titled How We Think about Safety and Alignment. In it they bluntly state, quote, as AI becomes more powerful, the stakes grow higher. The exact way the post AGI world will look is hard to predict. The world will likely be more different from today's world than today's is from the 1500s. But we expect the transformative impact of AGI to start within a few years. They then outline their current thinking on how to develop safe, beneficial AGI. This is a process though that they that emphasizes the principle of iterative deployment. So basically gradually introducing increasingly capable AI into real world settings, not keeping it bottled up in a lab. They argue that by releasing systems incrementally, we can better identify and manage potential risks. And they highlight several risks they're working to mitigate, like human misuse, misalignment and broader societal disruptions. Anthropic also released its own recommendations on how to keep what it calls powerful AI. That's kind of their term for AGI, which they expect to emerge in the late 2026 or early 2027. They published this guidance on how to keep it safe and their recommendations emphasize the urgency for the US government to prepare strategically for the economic and national security challenges that powerful AI will bring. They suggest a six part approach that includes things like enhancing national security, testing for AI systems and tightening export controls. On top of all this, there's a new report that came out called Super Intelligence Strategy. It's making waves primarily for the people behind it. It's co authored by Dan Hendricks, who's the director of the center for AI Safety and an advisor to XAI and Scale AI. Also Alexander Wang is co author, Scale AI's founder and CEO, as well as Eric Schmidt the former CEO of Google. In this report, they propose a framework that mirrors Cold War nuclear strategies. They literally define this idea called mutual assured AI malfunction. And this is basically akin to the nuclear deterrence strategies used during the Cold War.
Paul Raitzer
And it's mutually assured destruction.
Mike Kaput
Mutually assured destruction, yes. The idea that we would both annihilate each other if even some of these.
Paul Raitzer
One noob shoots, we shoot them all. That's, that's the idea of. Yes.
Mike Kaput
And so this kind of builds on that idea, saying that any country that aggressively attempts to monopolize super intelligence will inevitably face covert sabotage by rival nations seeking to prevent a destabilizing imbalance. So they basically say look to enforce stability. They argue for, you know, AI focused espionage, sabotage, and strategic transparency. Verifying rival states compliance without restrictions, revealing sensitive information about how far along they are as we're designing really advanced AI. So, Paul, that is a lot to unpack. A lot of it is kind of terrifying. But I guess to really sum up what I'm taking away from this OpenAI is like, guess what? Safety equals releasing this stuff. Anthropic is providing guidance, but the train is leaving the station. And we also have, you know, literally treating this like nuclear weapons technology in terms of nation state competition. Do I have that right?
Paul Raitzer
Yeah, I mean, there's no sugar coating on this episode. Like, let's, let's just be straight up. This is a problem. Like there, there is a lot of very dangerous territory ahead. And anything that they're talking about already in superintelligence strategy and anthropics, powerful, it's happening already. Like, this isn't, this isn't three years from now. We should be thinking this way. This is like, there's already leaders that are thinking this way. The, all the AI labs know foreign actors are trying to infiltrate their systems, if not already being aware that they have infiltrated their systems. So like in, in the US we know that China and Russia probably are within our electrical grids. They're probably within the infrastructure that powers the country. In a similar way, we're probably in their infrastructures. And the whole idea there is like, don't take down our infrastructure, we don't take down yours. That's basically what this is like. The labs know that the foreign actors will be trying to get access to their systems. The government knows this is happening. So they're, they're fully aware of the national security risks of what they're doing. The jobs and the economy thing, again, kind of bringing it back to that. Like Dario and Sam are fully aware that what they're doing, the thing they're driving and not just, not just them. Throw Google in the mix and Meta and all the others, that they're the ones who are building the technology that's likely going to be massively disruptive to industries and professions, but they have no idea what it looks like in this instance. OpenAI literally says quote the exact way. As you already highlighted, the exact way the post AGI world will look is hard to predict. The world will look likely be more different from today's world than today is from the 1500s.
Mike Kaput
That's a crazy analogy.
Paul Raitzer
That's like Middle Ages right.
Mike Kaput
After. It's like, yeah, the early. I actually fun fact, put this into Grok and a couple others. I said look, here's what I am now, 38 year old man in 2025. What if I went back to the 1500s, what would that look like? And it's just wild answers like colonial English, you know.
Paul Raitzer
Okay, so there was that. That reminds me, we'll have to put the link in the show notes. Tim Urban wrote this great post about like AI where it was, I forget what he called it. It was that factor where you like things would be so different, you would literally just die. He's like, if you go back to this period, you're like, you're just dead because you can't comprehend how different it is. Or like if you came forward from the past, you would get to that point, be like, oh my God, like I just died. Like it's just nuts.
Mike Kaput
That's why I mentioned it, how crazy this analogy is. And Sam knows what he's doing in it. Or open AI knows what they're doing in it.
Paul Raitzer
Yeah. So that means they think that like the next five years is so different. It's basically like taking a leap forward like 500 years. So and, and the thing that's very clear now, as I said earlier, they're not going to solve this. They're not going to sit down and play out what does a post AGI world look like in education, in business, in your profession, your industry? They're not going to do it. Which means it's on governments, think tanks, associations, individual businesses, the consulting firms. Every research report I see at a consulting firms is asking people who have no idea about AI, what's the future of your business because of AI. So they go and like talk to a bunch of CEOs who themselves aren't really sure about it. Certainly couldn't like tell you what AGI and Sire and like, the impacts of it. And yet that's what the consulting firms are giving us is, like, These predictions about 2030 based on who? Like, people who've never sat down and actually thought about post AGI world. So I don't know, Mike, like, this is. I've mentioned this a couple times on the show, but we're going to launch a Road to AGI and Beyond podcast series as part of the Artificial Intelligence show. And I was looking at my schedule, trying to figure out when can I actually do this. So the plan right now is to launch the first episode on March 27th. So again, we're going to continue doing our weekly episodes. The idea with The Road to AGI series is to start with an updated AI timeline. So I did the first one back in March 2024 on episode 87, and then I actually played that out in my Road to AGI keynote at Macon last year. We'll put the links to both of those. You can watch the full keynote. The idea here is to try and figure out what happens next, what it means and what we can do about it through interviews with people who are actually on the frontiers in all these key areas. So we're going to start releasing them at the end of March as, like, regular episodes. My goal is going to be, like, every other week. We'll see how the schedule plays out. But the whole idea is, like, what are the impacts of continued AI advancement on business, the economy, education and society? So what I want to do is interview experts related to, like, AI literacy, AI models, cybersecurity, economy, energy, infrastructure, future of business, future of education, future of work, government, legal, scientific breakthroughs, societal impact, supply chain. These are just some of, like, the topics where I want to go and get, like, the top minds who are actually thinking about AGI and beyond in those areas and, like, find out what is actually happening and hopefully throughout this series, start to, like, see around the corner a little bit. I don't. I don't know. Like, I don't. I feel like sitting here doing. Just talking about every week does nothing. And this kind of goes back to, like, the AI Literacy project when I launched that, it's like, let's just do something. Like, I don't know what comes of it, I don't know what we learn, but just highlighting the fact that it's a problem is doing nothing. So, like, let's go try and do something about it with that series.
Mike Kaput
I love that. I really look forward to it because, yeah, you're right. There's not enough creativity and commentary around what this stuff actually looks like. All right, so let's dive into rapid fire for this week. There are still a couple more AGI, ASI type topics, but we've also got some other things on the docket.
Paul Raitzer
But first, it's truly dominated the news. I think it's crazy.
Mike Kaput
Yeah, you gotta pay attention when this many things related to it come at once. First up here, Ilya Sutskever. His startup, Safe Superintelligence. SSI has secured approximately 2 billion in funding at a 30 billion valuation. The startup has no product, it has just 20 employees. And its fundraising success, according to a recent report in the Wall Street Journal, appears to be driven by one thing and one thing only, which is Ilya himself and his reputation in the AI world research community. According to this report, top venture capital firms like Sequoia Capital and Andreessen Horowitz have poured money into SSI based largely on their faith in Ilia's technical brilliance and vision. The good luck figuring out what they're trying to do. Exactly. They operate very secretly. They have a bare bones website that has like a 200 word mission statement. Employees are apparently discouraged from mentioning that they even work at the place on their LinkedIn profiles. They have no plans to release any products until they develop what the industry calls super intelligence, an AI system that can outsmart everyone in every single field. So Sutskever has told his associates he is not developing advanced AI using the same methods that they used at OpenAI where he used to work. Instead, he has identified a different mountain to climb that is showing early signs of promise. Paul, we've talked plenty about Ilya, but we have to mention this again based on everything we've talked about related to AGI and ASI this week. But what kind of jumps out? One investor in this report called this a super high risk bet. Because aren't you basically betting one person's approach can not only solve superintelligence, but safe superintelligence? Like, how likely is that to be the case?
Paul Raitzer
Yeah, my guess is they're all going into it assuming the money's gone, because there's a. There's a reasonable chance. Whatever the pursuit is, whatever they've unlocked or think they've unlocked in terms of a path forward, my guess is he's not telling anybody that, like these VCs aren't, you know, you're just kind of trusting that they've got a different path to go. There's no way he's disclosing to them what that path is. There's no plan for revenue, that not only is there no product or revenue, there's no plans for product or revenue. And there is a reasonable chance. Keep in mind, Ilya, if you haven't been following along for a while, he's the guy who triggered Sam Altman getting fired. He's the co founder of OpenAI who became so concerned with the direction of OpenAI and it ends up their plans to release their reasoning model, which was Strawberry at the time that Ilya led on that he, he led to his demise briefly at OpenAI and then they couldn't work things out and he eventually, you know, leaves and does his own thing. So there's a chance that whatever Ilya unlocks, he decides isn't actually safe. And so like, they don't ever bring anything to market. So, yeah, I mean, I'm guessing that these VC firms are like, well, let's throw a billion at this and like, let's see where it goes. If nothing else, it gives us a front row seat to wherever may happen. Which, by the way, is what Elon Musk did with, with DeepMind before it got acquired by Google back in the day. He made friends with Demis Hassabis, became so concerned with what Demis knew and where they were building with DeepMind, then it gets acquired by Google, which triggers elon to build OpenAI with Sam Altman as a counterweight to it. So, like, this is all like, in some ways like history repeating itself. But I don't know, I mean, if you had to stack up the most respected AI researchers in the world and maybe in history, he's, he's on the Mount Rushmore. I mean, this is, this is a top three to five researcher, if not the most respected of all of them. So everyone's going to pay attention to what he does.
Mike Kaput
In some other news, a new AI startup with their own ambitious vision for superintelligence has emerged from stealth mode this week. So this is called Reflection AI. And they have raised 130 million in funding at a 555 million valuation to build what they call autonomous coding agents. So they believe this represents a crucial step towards achieving superintelligence. Now, this company was founded by Misha Laskin and Ionis antonoglu, who are two elite researchers from Google DeepMind. Antonoglu was a founding engineer at DeepMind who helped create AlphaGo, the breakthrough AI system that defeated world champion Lee Sedol at the board game Go in 2016, which is a moment many people consider a watershed in AI history. Now, unlike the coding assistance Tools out there that just help you write code more efficiently. Reflection AI aims to create fully autonomous agents that can handle entire programming tasks from start to finish. Now they believe that by combining reinforcement learning with large language models, they can tackle the essential complexities of software development. And early results suggest their models outperform traditional code generation approach approaches by a wide margin. Now, as they develop this technology, they plan to expand the capabilities of their coding agents. The vision is that eventually developers become directors of autonomous coding agents and in the long term this could extend to all knowledge work, not just coding. Laskin actually said, quote, our team pioneered reinforcement learning and large language models. And we decided that now is the time to bring both of these advancements together and build out a practical superintelligence that will do work on a computer. Now, Paul, we're seeing a lot of like agent startups out there, a lot of autonomous coding agents. Seems like with the background of these guys, this one might be a bit special.
Paul Raitzer
Yeah, and I, you know, I think this is a lesson we've mentioned many times on this show, which is you follow the top researchers from the top labs. It's, you know, Noam Shazir, you know, when he launched character AI, I think we talked about that on the show. And then he eventually goes back to Google. So Gnome was at Google multiple times, goes, that builds character AI. Google acquires the technology that they didn't buy the company, they, I don't think they could, but they basically aqua hire him and the team back for a few billion dollars. Like the top researchers are fundamental to understanding the research direction and to following along kind of what develops in this space. So yeah, like will this one work out? I don't know. Will they eventually get pulled back to DeepMind for a couple billion dollars in two years? Maybe, but it's always noteworthy. Now the question here is why pursue autonomous coding agents? You hear us talk about that a lot. You hear that, what was the thing called? Manus.
Mike Kaput
Manus.
Paul Raitzer
Yeah, yeah, yeah, Cursor. You hear about all these things. Here's why. AI researchers, there's tens of thousands of AI researchers, there's probably a few hundred, maybe up to a thousand who would be like top tier AI researchers that everyone would compete for and would pay million dollar plus bonuses to get them to come to their labs. The, I'm not an AI researcher, but my understanding of the space, one of the key values or traits of an AI researcher is their taste, their, their, their knowledge of which direction to pursue. So all of these labs are trying to get to AGI and beyond. The reason Ilya is so valued is because he has a history of very high taste, meaning he tends to know which research direction to go in that leads to the greatest valued output. So if you're sitting in a major lab today, you all kind of have the same idea of how these models are improving. But you got to pick where your Nvidia chips are going to get used and which things your top researchers are going to work on. So is it multimodal? Is it improving memory? Is it planning capabilities? Is it improving context window? Is it computer use? Is it reasoning? Is it agents? Is it reinforcement learning? Is it understanding world models? You have to make bets as to where to put your energy. So what does an autonomous coding agent do? It gives you almost infinite shots on goal. You can now be running these things, pursuing all of these paths through low val, like low compute experiments, that then when you hit on something, you go. And so that's what these labs do. They, they take all of these experiments, they fight over compute access within the companies every day. It happens at Google, it happens at Meta, it happens at OpenAI. They fight over access to compute to run their experiments, to prove their hypotheses. And once you approve a hypothesis, you go. So like reasoning models were that, that's what, that's what Ilya did with Strawberries. He proved the test time compute scaling law was likely going to hold and that enabled OpenAI to double down on reasoning. So that's why this matters. It's why any, it's why we keep talking about these like coding agents. You may be like a VP of Marketing or a CEO being like, what do I care about coding? You care about coding agents. Like they drive everything once they solve how to do this.
Mike Kaput
And it's probably likely at least an element of a lot of the talk around AGI and asi. Even if this stuff feels far away, the moment you start cracking some of these autonomous coding agents, it's the moment we have kind of a fast takeoff. Right, Where. Yeah.
Paul Raitzer
Cause you can run millions of experiments instead of dozens.
Mike Kaput
Right. All right, next up, we just wrapped up last week our AI for Writers summit, which is a half day virtual event that had 4,500 plus registrants from 90 plus countries. And this entire event was about how writers can begin to reimagine their work and careers in the age of AI. So Paul, to kick that event off, you gave a keynote on the state of AI for writers and creators, which was an overview of how the latest AI models are reinventing The Future of Creativity. And as part of the keynote, you debuted something called the Human to Machine Scale for Writers, which is a framework anyone can use to better understand their way forward with AI. Could you walk us through that scale and what inspired it?
Paul Raitzer
Yeah. So we'll put the link to a LinkedIn post that I shared at the end of last week that actually has the 12 slide excerpt from the full presentation that plays out this whole human to machine scale for writers. In essence, what I did is I iterated on a framework I had developed a few years back called the Human to Machine Scale, that actually looked at levels of autonomy, like, what is the human's role at a use case level when AI is applied to their job or to the tasks within their job. And so as I was trying to like, answer this question, when should we use AI to write? I realized I could probably actually adapt that human to machine scale to this. And so that's basically what we did is I hear from professionals all the time, specifically creative professionals who struggle with this question of, like, when do I let the AI help? Let what? Do I let it actually do? The writing for me, because I'm a writer, it's like my art, my passion. It's the thing that gives me fulfillment. Like, if people aren't familiar with me, like, that's my background. I actually came out of journalism school. I've authored three books. We do the podcast. Like, I consider myself a writer and storyteller by trade. And for me, writing is a very important part of my process. Like, it's how I think, it's how I learn topics, that's how I develop an understanding. Um, it's. I can't just take an article, have AI spit out a summary for me, and then talk to you all about the key points in it. It doesn't work for me. I don't develop a true comprehension of the topic. And so like, the litmus test I gave, I think during the talk, because again, like, I didn't script the talk, so I don't. I'm not actually sure exactly what I said, but I think I said something to the effect of anybody can use deep research or like ChatGPT to write a summary of a topic topic, but to actually understand that topic in a deep way to the point where you could be a thought leader on it. Imagine throwing all that aside and sitting there for 30 minutes and answering questions about the topic. That's my goal with everything we do with this show, is like, I want to be so deeply ingrained in the things we analyze the things I read and watch and listen to that I can throw away any script and just talk about the topic, right? And so that's like kind of one of the fundamental things I shared with this idea is you have like, level zero is all human. It's the human is the sole creator. Your voice matters tremendously. The, the audience expects authenticity. They expect you to just be sharing your knowledge. So that's all you. Level one is mostly human. That's where the author is still leading the human author. But you're using AI for things like research or refining your work or brainstorming. Level 2 gets into half and half. It's like a co writer situation where the author and the AI truly start to work together. There's an increasing focus on efficiency of rewriting, but the voice and the human touch still matter. Level 3 gets into mostly machine. That's where it's largely AI driven. The AI is probably writing the first draft. The human maybe tweaks it, refines it, approves it. So efficiency starts to take on far greater meaning. And then level four is all machine, where the human's basically removed from the loop. It's an AI writer purely. It autonomously writes the stuff with little or no human oversight. And so in the. Again, I would encourage people to go download the PDF from my LinkedIn post because it goes into like examples and characteristics at each level and then it gives some tips at the end, like, when does more human writing matter and when is it more okay to work with machines? But the big point I made is it's not a binary decision, do I or do I not use AI? It sort of like exists on this spectrum and that spectrum, the level 0 to level 4, in the sense that's is very subjective and personal. The thing, the thing I didn't really address during the talk that's important is like, some people aren't very good writers and like, they want to express themselves, but they don't have the ability to. And so like, level two in the co writer situation may be the sweet spot for you because you're not a writer by trade. Whereas for me, I would say probably like 80 to 90% of mine is level zero. Podcast stuff. My keynotes, my LinkedIn posts, I have zero use for AI for that stuff. Stuff like, I want that to come from me. And the process is the purpose is what I said on LinkedIn, like, going through the process is why I do it. But there's a lot more that's become level one, where it's still mostly me, but I'm increasingly using AI on the research front, outlining, refining, brainstorming. And that's okay as long as it's clear with the people reading it or hearing it. And so, yeah, I mean there's thank you to everyone who's commented on that LinkedIn post. There's like, I, I don't maybe 100 comments by now. And I it sounds like it was helpful framework for people, so, you know, definitely go check it out. It was, honestly, it was one of those things I finished at 11pm the night before the talk. So no one had seen it except my daughter. I was laying in bed with my daughter. Like, I was like, can I just show you this? Because I got to make sure this makes sense. And so she, yeah, she's the only one that even seen the framework before I did the talk the next morning.
Mike Kaput
That's awesome. So Google is doubling down on its incorporation of AI into search. The company announced last week it'll show AI overviews for even more queries and add Gemini 2.0 to AI overviews to make those results more useful. It's also getting closer to debuting AI Mode. AI Mode is a new feature that will generate the answer to a search query based on everything in Google's search index, basically just like you'd expect From Perplexity or ChatGPT search. Currently this is only available if you pay for Google One AI Premium. They're like paid tier service, but it will be rolling out a bit to users in the future. Now with all these updates, the official line here is kind of that more AI overviews, more AI in search. None of this will really cannibalize people going to websites via links, which is the behavior, of course, that powers today's SEO and search ad ecosystem. Google claims that people are still clicking in and going to websites through AI overviews, and the AI overviews and AI mode will bring new people to Google for new things, according to the Verge. But there is some other data that seems to tell a different story. So Forbes actually reported that some new research from a content licensing platform called Tolbit, which was shared exclusively with Forbes, says the AI search engines said 96% less referral traffic to new sites and blogs compared to traditional search. So the report actually analyzed 160 websites that included some news sites, consumer blogs over the last three months of 2024 to kind of understand how this was all working. So Paul, like we keep hearing that SEO isn't necessarily dead. It's just gonna change. Like, do you believe that? I mean, we're going to need to make sure, of course, we show up in LLMs, but beyond that, it just seems like this whole traditional model is on its way out.
Paul Raitzer
Yeah, I mean, all I can say is like, from my personal experience, I certainly go to fewer links. I mean, if I go to Google and I'm doing research, I'm clicking on every link and I'm curating it and you know, if I think about research for the show or research for, you know, writing a book or research for planning a trip, like if I go into Google and I type links and I get 10 links or however many it is, I'm going to click them. If I go into Google and I get an AI overview that answers my question directly, even if the links are prominently shown, I generally look at the links to make sure they're pulling from legitimate sources that I would trust. And if they are, I'm kind of assuming it gave me the answer I needed. Or if I use deep research, the better it gets, like, the less I need to go into the citations, I just look and make sure they're legitimate. So I'm not saying my personal use is representative of the the market.
Mike Kaput
Right.
Paul Raitzer
But those seem like really logical assumptions. Like my hypothesis would be, sure you'd have less traffic coming from it. So regardless of what Google and others say, I just have to believe that how people consume information and is dramatically going to change for sure. So yeah, what it does to SEO, I all I will say is on our Intro to AI class I teach, every month we're getting way more questions about how do I show up in learning in language, large language models.
Mike Kaput
Right.
Paul Raitzer
Like chatgpt than I used to get. So I think people are starting to catch on to the fact that maybe that's the new SEO is like, how do we show up in ChatGPT and AI overviews? Is it different or the same than past search and how the algorithms work?
Mike Kaput
Next up, Andreessen Horowitz has come out with their latest Top 100 Gen AI Consumer Apps Report. So this report, which comes out every six months, ranks the top 50 AI first web products by unique monthly visits per similar web and the top 50 AI first mobile apps by monthly active users per sensor tower. Some highlights from this latest report. ChatGPT's explosive resurgence. We talked about how it has reached 400 million weekly active users as of last month, and the mobile story is equally impressive. ChatGPT is consistently growing its active user base by 5 to 15% every month over the past year and approximately 175 million of those 400 million weekly active users now access it through the mobile app. Second is the meteoric rise of Deep Sea. So this they launched their public chatbot on January 20, 2025 and they accumulated enough traffic in just 10 days to rank as the second most popular AI product globally. In January, the Chinese hedge fund backed AI tool reached 1 million users in 14 days, which was slower than ChatGPT's five day mark, but then surged to 10 million users in just 20 days, which according to Andreessen outpaces ChatGPT's 40 day timeline. By February, they had claimed the number two spot on mobile as well, capturing 15% of ChatGPT's mobile user base with engagement levels slightly higher than competitors like Perplexity and Claude. Now, in total on this list there were 17 new companies that entered the rankings. AI video apps are on the rise. They are quote bringing the true usability with reliable outputs. According to A16Z, there are three new entries on the list of those video apps. Hailuau at number 12, Clingai at number 17 and Sora from OpenAI at number 23. AI coding tools are also really taking off. These include agentic integrated development environments or IDEs and text to web app platforms for non technical users. So tools here include things like Cursor, which we've talked about at number 41 and bolt at number 48. So Paul, this certainly seems to be a solid barometer of some recent trends we've seen in AI largely like did anything jump out to you here?
Paul Raitzer
Top web products? I don't see meta AI anywhere and I don't see Gemini anywhere. It's probably not a good sign. Yeah, top, top gen AI mobile apps. Gemini's coming in at 22. Yeah, I mean the tops are interesting, but I also think the middle to back of the top 50 or non existent on the top 50 omission too of where the market is. So yeah, it's, it's fascinating. I do think the deep sea thing is just, it's gotta just burn anthropic and Meta in particular. I would imagine Google to a degree too with Gemini that they just sort of show up out of nowhere and skyrocket up there with none of the marketing that these other ones have had.
Mike Kaput
Yeah, well like we talked about last week, also likely a reason Meta is spinning out its own meta AI app. Right. Getting left off all these lists and all this attention.
Paul Raitzer
Yep.
Mike Kaput
All right, so in some other news, according to Y Combinator managing partner Jared Friedman, a quarter of startups in YC's current W25 batch now have 95% of their code bases generated by AI. Now what's really interesting here is these aren't non technical founders building businesses by leveraging AI as a crutch. Friedman emphasized, quote, every one of these people is highly technical, completely capable of building their own products from scratch. A year ago they would have built their product from scratch, but now 95% of it is built by an AI. So essentially developers are starting to become directors of AI systems rather than hands on coders describing what they want built and letting AI handle the implementation details, which Y Combinator says has some big implications. So for one, it dramatically accelerates development cycles. It also lowers the barrier potentially for creating software, allowing people with good ideas but limited coding experience experience to bring their visions to life. However, there are some new challenges here. YC general partner Diana Hu noted during a discussion that even when relying heavily on AI, founders still need the skill to evaluate the quality of the generated code. And YC CEO Gary Tan emphasized the point further, raising a crucial question about the long term sustainability here of this approach. He said, quote, let's say a startup with 95% AI generated code goes out and a year or two out they have a hundred million users on that product. Does the code fall over or not? Paul, what can we learn here about the bigger picture? This isn't just about coding or Y Combinator. It just seems like the barriers to building are falling so fast, thanks to AI.
Paul Raitzer
Yeah, it's one of my hopes actually for what I think will be significant job displacement in the coming years, is that I think we're going to go through like a renaissance of entrepreneurship. This entirely new age of entrepreneurship where everyone can be an entrepreneur, where, you know, if you don't have a job or you're coming out of college or you know, you're looking for a transition that you, you can build something because one, two years out, you know you're going to be able to just use words to build apps. You can do it now in some early demos and stuff, but I think that it's a chance to offset the disruption is through growth of startups.
Mike Kaput
Very cool, very exciting as well. So in some other news, Morgan Stanley has released a new research report diving into the fast growing market for humanoid robots. They're calling this new frontier the physical embodiment of AI. They have compiled what they call the humanoid 100, a select, carefully selected list of publicly traded companies that represent different parts of the humanoid robot ecosystem. So basically it's a Guide to which companies are poised to benefit as humanoid robots go from experiments to actually moving to homes, offices and factories. So they segment all these companies into three big categories, which include the brain, which includes foundational AI models, semiconductors and software. The body, which represents components like sensors, actuators and batteries and integrators, which are companies currently building full scale humanoids or capable of doing so in the near future. Interestingly, more than half of these companies are already actively involved in humanoid robot development, and nearly half are seen as having significant potential to join the market soon. It also turns out that Asia, especially China, is leading the humanoid robot race. Over half of the listed companies involved in humanoids and more than three quarters of the integrators actively developing full humanoids are based in Asia. Now, one last point here, it's really interesting is that Morgan Stanley frames the global market size, the tam, the total addressable market for humanoid robots, at a staggering $30 trillion, roughly equivalent to about 30% of the global economy. In practical terms. By 2040, they expect 8 million humanoid robots operating in the US alone, replacing jobs worth 357 billion annually in wages. By 2050, that number could reach 63 million humanoids, replacing nearly 3 trillion in annual wages. So, Paul, you and I have talked a lot about this idea that the potential for an industry or area of work to be disrupted will be a function of how much the reward is for disrupting it with smarter technology. And it seems like there are some particularly rich rewards for disrupting physical labor.
Paul Raitzer
Yeah, when I talk about job disruption, I'm not even talking about the, the physical labor. Right. So this is a whole nother ball game. And I, I do think we're still a few years away from, you know, these things truly working. There's amazing demos happening. You'll see these incredible videos from figure and other places like that. I don't think there's a reality anytime soon, but I do think by the end of this decade this starts to come into view. And I think I talked about that on a recent episode of the show. I think you start to see some specific industries that get impacted in the next few years here and then eventually into the consumer world. The other thing I mentioned on previous episode was like, you want to look at the next investing frontier is find the robotics supply chain. And here comes this report, perfectly framed this out for us. So it's. They probably just used OpenAI deep research to like do it and then like put a cool visual. No, I'm just kidding. Morgan Stanley, I'm sure Spent tons of time. So thank you for doing it. Saved me from having to do it with deep research.
Mike Kaput
I love that. Yeah, so you're welcome, audience. Go check it out. Maybe you want to go make some investments. All right, so to end up here this week we are going to revisit our recurring segment here on listener questions where we are answering the questions that listeners have about AI. We get tons of these each week, so we want to start answering them as best we can. And this week's question, Paul, is what is the biggest misconception about AI right now, in your opinion?
Paul Raitzer
Yeah, there are a lot. But let's zoom this in on, on business because I've been in some meetings even in the last couple weeks where I saw this playing out again is I think that AI is seen as this overwhelming and oftentimes abstract thing that we have to wait until we get the data right or we have to wait until it and legal like give us clearance to go or we have to wait until we get licenses to something and people are just waiting for permission to move forward and oftentimes delaying adoption or piloting projects because they don't really understand it. And so it's just easier. They got other things to deal with. So I think the biggest misconception is that it's hard to get started like that. You can't just find a couple of use cases like use ChatGPT, build a custom GPT, run a deep research project, like just do something that is part of your usual workflow, part of the tasks you already do and just go find a way to use these tools that don't need any proprietary data, don't need it or legal involved. It's just like, let me go see if I can save myself a few hours or let me go see if I can improve this presentation a little bit with this technology. So I think that's the biggest thing is that it's hard to get started. And it's not like, I think if you, if you just find the right use case, you can go and I mentioned earlier, we teach this Intro to AI class every month. I think I'm on like the 45th one or something. I started doing this in November 2021. We'll put the link in, but you can sign up for free. And I just go through like this 30 minute intro and then we do 30 minutes of Q& A. And I promise you, like if, if you don't know where to start, like you'll know where to start after that talk like it gives you enough to just go and get rolling with some private projects. So that's my biggest thing. And I guess my biggest urge to you would be like, just, just do something. You know, just get going. So, yeah, I think it's a great question. Keep them coming. Quick programming note. Mike and I are both out next week, so we're gonna skip March 20th, March 17th. I feel. I actually feel like, bad doing this. I'm like, anticipating the, like, the, the messages we're gonna get about this, but we're not going to be around Friday or Monday to record this thing. So we're gonna skip a weekly episode on the 17th. We will be back on the 24th with the weekly. And then that's the week that we'll also plan to do the special edition, the first episode of the Road to AGI and beyond series. So you'll get a Tuesday and a Thursday that week, but nothing next week. Follow me on LinkedIn. I'll. I'll put the, you know, key things as they're happening. And if you don't subscribe to the SmartRx Exec Insider newsletter, get that. I'll still publish that on Sunday like I always do. We'll put the link to the show notes in there, but it's SmartRx AI and then just click on newsletter. So I publish that every week and it's kind of like a preview, too. So I'll cover the stuff we're not going to be getting to on the podcast next week.
Mike Kaput
Yeah. And I would also just add there. While I don't ever want to skip a week with our audience, I think the content of this episode is more than enough to think about for two weeks. So maybe listen to this again next week. Yeah. This is an opportunity, perhaps a sign from the universe to spend a little time considering the implications.
Paul Raitzer
I agree, Mike. I think you and I could probably both use the week to ponder some of the stuff in this. I may actually go back and listened. I've never listened to one of our episodes. I may go back and listen to the first, like 30 minutes of this one because I. I think that there's just a lot there that has much deeper meaning and impact than might appear right away. And it's good. It's. Honestly, there's a lot of the stuff we touched on there is feeding into my, like, version two of the AI timeline. There's a lot of things I've kind of been trying to piece together in my head, and that is part of it.
Mike Kaput
Cool. Can't wait.
Paul Raitzer
All right, thanks, everyone. For being with us. As always, we appreciate you listening and watching on YouTube and we will be back on March 24th. Thanks for listening to the AI Show. Visit marketingai institute.com to continue your AI learning journey and join more than 60,000 professionals and business leaders who have subscribed to the weekly newsletter, downloaded the AI blueprints, attended virtual and in person events, taken our online AI courses, and engaged in the Slack community. Until next time, stay curious and explore AI.
The Artificial Intelligence Show - Episode #139 Summary
Title: The Government Knows AGI Is Coming, Superintelligence Strategy, OpenAI’s $20,000 Per Month Agents & Top 100 Gen AI Apps
Release Date: March 11, 2025
Hosts: Paul Roetzer and Mike Kaput
1. Government Awareness and the Impending Arrival of AGI
The episode kicks off with a deep dive into the recent revelations from Ezra Klein's podcast episode featuring Ben Buchanan, former Special Advisor for AI to the Biden White House. Paul Roetzer highlights the urgency emphasized by Buchanan and Klein regarding the imminent arrival of Artificial General Intelligence (AGI).
Buchanan underscores the lack of preparedness within government structures despite recognizing AGI's potential. He points out that unlike past revolutionary technologies predominantly funded by the Department of Defense (e.g., nuclear technology, the internet), AI innovations like those from OpenAI have emerged from the private sector, leaving the government playing catch-up.
2. Impact of AI on Jobs and the Economy
A significant portion of the discussion centers around AGI's disruptive potential on the job market. Klein asserts that labor economists are ill-equipped to address the rapid changes AI will bring, likening the transformative impact of AGI to the introduction of electricity or railroads.
Klein emphasizes the unprecedented speed at which AI advancements are occurring, making it challenging for both workers and institutions to adapt. Buchanan echoes these sentiments, highlighting the absence of robust policy frameworks to manage the transition.
3. OpenAI’s AI Agents and Pricing Strategy
One of the standout topics is OpenAI's ambitious plan to introduce AI agents priced up to $20,000 per month. These agents are designed to perform high-level knowledge work, potentially replacing multiple human employees.
Projects like NDEX, an AI-driven financial analyst, exemplify how reasoning models are enhancing accuracy and efficiency in specialized fields like finance and law.
4. AI Startups and Autonomous Coding Agents
The hosts discuss the emergence of startups focused on creating autonomous coding agents. Reflection AI, founded by former Google DeepMind researchers, aims to develop agents capable of handling entire programming tasks autonomously, signaling a significant leap towards superintelligent systems.
Additionally, Ilya Sutskever's Safe Superintelligence (SSI) startup has secured substantial funding despite having no product, underscoring the high-risk, high-reward nature of superintelligence ventures.
5. AI in Search and Implications for SEO
Google's recent enhancements to its search functionality, incorporating AI-generated overviews and the introduction of Gemini 2.0, are scrutinized for their impact on traditional SEO practices. While Google claims these features won't cannibalize website traffic, independent reports suggest a significant drop in referral traffic to new sites and blogs.
The conversation touches on the evolving landscape of SEO, where visibility within large language models (LLMs) like ChatGPT may become the new frontier for search optimization.
6. Y Combinator’s AI-Driven Startups
Y Combinator's recent report reveals that a quarter of startups in its current batch rely almost entirely on AI for code generation. This shift signifies a transformative change in software development, reducing barriers to entry for entrepreneurs and accelerating development cycles.
The hosts discuss the potential for AI to democratize entrepreneurship, enabling individuals with innovative ideas to bring products to market with minimal coding expertise.
7. Humanoid Robots and the Future of Physical Labor
Morgan Stanley's report on the "physical embodiment of AI" explores the burgeoning market for humanoid robots, projecting a total addressable market of $30 trillion by 2040. The report anticipates millions of humanoid robots entering various sectors, significantly impacting job markets and economic structures.
8. Listener Questions: Biggest Misconception About AI
Addressing listener inquiries, Paul identifies the prevailing misconception that AI integration is inherently complex and requires extensive permissions or data setups. He encourages businesses to start small, leveraging AI tools to enhance existing workflows without significant barriers.
9. Upcoming Initiatives and Series
In response to the dire discussions surrounding AGI and ASI, Paul announces the launch of the "Road to AGI and Beyond" podcast series. This initiative aims to explore the multifaceted impacts of AI advancements through expert interviews and in-depth analysis, providing listeners with a clearer vision of the future landscape.
10. Conclusion and Final Thoughts
Paul and Mike conclude the episode by emphasizing the rapid pace of AI advancements and the critical need for proactive measures across sectors. They highlight the importance of AI literacy and encourage listeners to engage with upcoming content that delves deeper into the implications of AGI.
Key Takeaways:
This episode serves as a comprehensive exploration of the multifaceted advancements in AI, the strategic responses from governments and businesses, and the profound societal implications on the horizon.