← The Times Tech Podcast
The Times Tech Podcast
Anthropic's warning: AI will start building itself
00:37:23
Cisco's Jeetu Patel on the dangers of the agentic era
Loading summary
Transcript95 lines
- [00:03]
A
Checking out online Apple Pay makes it simple. When you tap the Apple Pay button, you can review your card information and shipping details. Need to make a change? Just tap to update your details before you pay. Then all that's left. Simply authenticate your purchase with face ID to checkout in seconds. Make online shopping a breeze with Apple Pay. Today's markets move fast. Get the insights you need in 10 minutes with the Barclays Brief, a new podcast from Barclays Investment Bank. Through sharp dialogue and scenario based analysis, our leading experts analyze key market themes each week. So whether you're managing a portfolio or leading a business, the Barclays Brief podcast can help you make smarter decisions today. Stay sharp, stay briefed. Find Barclays Brief wherever you get your podcasts podcasts.
- [01:08]
B
Hello and welcome to the Times Tech Podcast, where every week we unpack how technology is reshaping business, culture and everyday life. I am Danny Fortson out here in
- [01:17]
A
Silicon Valley where he's trying to keep his children occupied during the summer holidays. And I am Katie Prescott and in the city of London. And Danny and I are on YouTube.
- [01:28]
B
On the YouTubes find us. Isn't this a glorious time to be alive?
- [01:35]
A
So if you want to, you know, watch instead of listen, head to the Times business page on YouTube.
- [01:41]
B
It's a website called YouTube.com they show short form and long form videos there.
- [01:47]
A
Goodness me, I must check it out.
- [01:49]
B
Yeah, it's a new thing. That's a new thing. Techmology.
- [01:54]
A
Good to know. We're keeping up.
- [01:56]
B
So what have you been up to?
- [01:58]
A
Oh, I have been hobnobbing. Oh yes, I've been hobnobbing with friends of the POD in West London because it is London Tech Week here, which brings not only the great and the good of British tech, but also lots and lots of your fellow San Franciscans to London to talk about technology.
- [02:21]
B
I always feel like these things are like there's all this hype, right? And then you go to the big conference or the big do, and then you just find yourself like walking around from one venue to the other tent, drinking bad cop like lukewarm coffee. You're like, oh, I've got to go see that session. And then you go sit in the session. After, like three minutes, you're scrolling on your phone and you're like, what am I doing with my life?
- [02:45]
A
Actually, it has been fantastic. There's one main stage at Tech Week. The Prime Minister launched the event. It's been really notable that over the past few years the Prime Ministers have started turning up for it. And I think it Says a lot about how tech's been rising up the agenda. Lisa Su from amd, friend of the pod, flew over just as her cousin Jensen Huang did last year. So lots of big announcements from the government about investment in tech, but also from the us. It was a bit strange this year, I have to say, because the theme on the stage all the time was sovereignty. It was British tech. How can we promote British AI? How can we invest in British businesses? How can we make sure that British companies are winning British government contracts? And so you had this almost slightly awkward tension between the sort of geopolitical split push against the us. Almost like talking behind the back of the most popular person in class or something. It's like, oh, look, they're the big successful one, but we want to be like that too. But then at the same time welcoming lots of American companies to the UK who were talking about investment here, that created a tension, I would say, at
- [04:05]
B
the event, because there's the sovereignty bit and then there's the social media bit and it's all swirling.
- [04:10]
A
Exactly. And the Prime Minister on stage is opening the event to an audience of tech business leaders and policy people. Issued an ultimatum to us Tech about, look, you've got to stop children being able to exchange nude images on their phones or we're going to, you know, pass legislation in the next three months.
- [04:32]
B
Reasonable.
- [04:33]
A
It feels reasonable. But it was a slightly unusual message at a conference to promote Rah.
- [04:41]
C
Rah.
- [04:42]
A
Yeah. There wasn't a T shirt canon.
- [04:46]
B
No, this wasn't even. I'm not. I'm so glad I wasn't there. If I'm not getting hit in the face with a balled up T shirt at high speed, I'm not going.
- [04:56]
A
Is that. Is that the bar? If you. Everyone, if you want Danny Fortson at a conference, you need to shoot him in the face with a T shirt.
- [05:02]
B
Exactly. Otherwise, what is the point?
- [05:05]
A
So that. That landed, I think, slightly awkwardly. Obviously it wasn't meant for that audience. Right. It was the rest of the UK that was listening to that and it played really big in the news here. But I think the fact he was. There was also a bit of a damp squib for the tech community because he's very much seen as on his way out. His position is very shaky as Prime Minister. So there wasn't, I would say, the House view. There wasn't sort of overwhelming delight with
- [05:33]
B
his message because on one hand you have like this whole social media ban kind of movement that's happening around the world and you have all These lawsuits, which we've talked about on the pod here, like, there definitely seems to be like this huge shift. It feels like the public is very much like, yeah, ban social media for kids. It seems like politically a really easy choice to make. But at the same time, to your point, you're talking about tech sovereignty. How can we convince these big US Tech companies to invest on our island? I think that's the tension, right. Of like, this is the thing that everybody wants. But I'm sure in the back rooms you have tech companies being like, yeah, that's a, that's a nice social media law you have there. It'd be a shame if we stopped investing in your country.
- [06:20]
A
Yeah, our $5 billion that we were going to put into your data centers over the next three years. It was really notable that the event headlined with British Prime Minister followed by Lisa Su. And so it still feels just as it did with Jensen Huang last year. So it feels like we're bringing in the big US tech titans, but I should say the British heavy hitters were out in force as well. So Mattie, the boss of 11 Labs was on stage. Alex Kendall from Wave. There's some really big British names too. So it was good. I certainly wasn't wandering around checking my phone. But we're only halfway through the week, Danny. I mean, there's still Founders Forum to come tomorrow.
- [07:02]
B
There's Founders Forum. There's this company, they fire rockets into space. Can't remember what they're called. Anyway, I think they're having an ipo. Kind of big. That's happening. Yeah.
- [07:14]
A
God, I'm so glad I'm not a Sunday journalist, given that's happening on Friday night in London.
- [07:19]
B
Thank you. So, yeah. So it's such a big week out here and we should say, before we move on to what else is happening, we have a great guest this week, do we not?
- [07:30]
A
We have got an amazing guest, actually, who is helping us with the Times Tech Summit this year.
- [07:36]
B
Yes, it is Jeetu Patel. He is the President and Chief Product Officer at Cisco. They're building the hardware and software that kind of enables this whole AI boom. He's an expert in all things agentic. And, you know, don't sleep on Cisco. They were the dot com darling then they were the dot com kind of dog. And they're now worth half a trillion dollars. And they've just come roaring back because they made up all these big bets on AI and G2's right at the heart of that. So we're going to have him to Talk all things AI later on in the pod.
- [08:12]
A
While we're on the subject of AI, yeah, there was another small development this week, wasn't there? This blog that Anthropic put out. Yet another bombshell post from Anthropic, When AI Builds Itself. So this was all about recursive AI, which I guess you've been saying is a big theme in Silicon Valley at the moment.
- [08:38]
B
Yeah, that's right. I feel like if you want to understand what Silicon Valley is thinking, take half an hour and you will understand. One is there's a video on YouTube, that YouTube.com website for videos. Yeah, by Tom Blomfield, who founded Monzo. He's now, he's a partner at Y Combinator and he gave like this 13 minute talk to the current batch of startups at Y Combinator called how to Build a Self Improving Company. And it's all about this notion of like, basically Your job in 2026 is to build a different kind of company where you spend all your time shoveling. Your job is to give as much context to your favorite AI, whatever it may be. So that means all your emails, all your text messages, put microphones in your recording in your meeting rooms, transcribe those, just feed as much data in as you can. And then this brain has control of an army of agents that kind of improve the company while you sleep, you wake up, there's a new prototype, there's a new product, there's like a bunch of sales calls that have happened, whatever it may be. So you take that and then like overlaid on that is this, this other piece from Anthropic, which as you say, is called When AI Builds Itself. It's this blog post they just put out that explains what they're seeing. And it's kind of crazy. They were saying like, if you go back like a year and a half, low single digits of their code was like written by their coding agent. Now it's over 80%. And they're like, the role of humans is changing pretty rapidly and basically it's shrinking. And they don't really have any answers as to how this goes or where this goes. But it's another kind of scary example of what this all means for us humans.
- [10:33]
A
I should say, looking at some of the startups that have raised the most money in the UK over the past six months. Recursive AI, it's raised $500 million and ineffable intelligence, both working in this space, and they're only a few months old. That's the astonishing thing so it feels like this is really the next focus for everyone's attention.
- [10:58]
B
Yeah. And that's what Blomfield said at Y Combinator. He said companies that are basically leaning into this idea of a company brain commanding an army of agents are getting to demo day. Like, each batch has three months to work on a product, all leading up to demo day, where they get up on stage, say, this is who we are, this is what we make. Please give us money. Venture capitalists, they're getting to demo day with five times more revenue per employee than historically over the past 20 years.
- [11:27]
A
It's worth just reading a bit of the Anthropic blog because it ends on this very stark warning, which is basically, everyone should probably stop. So it says, if it were possible to effectively slow the development of this technology, to give ourselves more time to deal with its immense implications, we think that would likely be a good thing. But basically said, if you slow down, it lets the least cautious actors catch up, which could leave everyone less safe. So they say without a global coordination mechanism, companies and governments will have to make difficult decisions about safety while under competitive and geopolitical pressures, which is quite a big statement for a company developing this.
- [12:07]
B
And, you know, here in the States, kind of the background music to all of this is China. And every time someone says something like what, what Anthropic just said, there is like, you know, we should really probably slow down because this is getting, you know, this is escalating quickly. You have somebody else who said, look, if we slow down, China's not. And this is like nuclear weapons and we cannot afford to, quote, unquote, lose to China. So full steam ahead. And then overlaid on that is the IPO piece. So we have SpaceX this week. OpenAI just filed, Anthropic has filed. So $3 trillion IPOs these companies have raised in OpenAI and Anthropic, I believe, more money than any company has ever raised, ever. I think OpenAI has raised $175 billion. They have investors who want their money back. So the financial incentives are immense. So I just think between the financial incentives and that whole we're in a race with China, no one's going to slow down.
- [13:12]
A
It's really noticeable that that was all anyone was talking about at London Tech Week. The stuff about technological advances wasn't really there. It was all about geopolitics. I mean, you spoke about China there, but there was a huge amount of hand wringing here. As you can imagine, with the background of OpenAI's IPO being announced, but also SpaceX is coming up about where the money was going to come from in Europe to keep up with the US and to make sure that there is some semblance of tech independence here. I interviewed the new boss of Deliveroo on stage, who's a Finn responsible for Slush, which is like the big tech conference in Europe. And he was saying it's really worrying that Spain is one of the fastest growing economies. And that's because of tourism, he said, because of people going there to sun themselves. And I've heard also, you know, comparisons between the tech scene, unfavorable ones, and fashion here. So there's a real worry about how on earth when you're talking about those huge numbers and that speed of change, that anyone can catch up here. One of the investors on stage with George Osborne and that whole panel with George osborne from now OpenAI was about sovereignty. A German investor called Judith Dudda who said, if we don't drastically change course on AI in Europe, we'll end up politically sidelined with an economy that's stagnating tech, we can't govern and without the ability to continue with social welfare systems. So there was, It's a serious topic of conversation here and you can feel everybody getting worried about it. And, you know, I've covered the sector for a long time and it's been an issue, I mean, since even work. Before I was a journalist, I remember working for an entrepreneur in London. This sort of issue of, you know, where's the funding going to come from? Why is the US the best place to scale a business? The sale of Google DeepMind was constantly brought up as this sort of source of pain. Why did we sell this British gem to America? So that's always been there as a thread, but it just feels really loud at the moment.
- [15:32]
B
And it's. What's so interesting is like me being here. Nobody is even stopping for a moment to even think about what's happening over there. And then over there, that is the rest of the world, where hundreds of millions of people live and like the largest, one of the largest kind of economies in the world. And people are like freaking out rightfully about how they kind of fit into all of this and how they're going to leverage it.
- [16:00]
A
And I think it's really important that US companies do wake up to this because it is going to affect them. Things are changing here about how money is spent, how big contracts are awarded, you know, big government contracts to US firms. People are really, really mindful of that. So if people Aren't thinking about it. I think they soon will be.
- [16:25]
B
So self building AI was not on the agenda.
- [16:29]
A
I think people were talking about a bit. But on the main stage it was really these sort of geopolitical concerns, talk of job losses and worries about the idea that you'll be able to start a company with many agents and you won't need to hire staff at all. Ivan Zhao, the co founder and CEO of Notion, based between New York and San Francisco, spoke about this.
- [16:54]
B
It feels like there's a lot of talk about we're going to live in the future. That one person can create a billion dollar business and the world be run by one person startups or zero person startups. Personally I prefer not to live in that world. We care a lot at Notion. We care a lot about human values, the value such as human teamwork and camaraderie. I think those are good values that we bring into the next generation knowledge work. And therefore it's meaningful not just for in terms of productivity but in terms of preserving good human value to bring teamwork into how agent works. And usually, at least at the moment, a company will be run by a CEO and cfo. So multiple people have to make decisions. So a company will be entity with multiple people. Therefore it's quite valuable to make sure we figure out how to get AI agents to work with a team of humans. What do you think? So are you going to work? I mean you and Norman, you guys have a special relationship as previously discussed.
- [17:53]
A
Well, seeing as you're not, you know, you're not here next week, maybe we'll get Norman to co present the program. There's an idea everyone, that's actually scary. Don't do that because he's very funny.
- [18:03]
B
I order you to not do that
- [18:07]
A
because that might cross the tech agenda. He sends me a little briefing every day.
- [18:11]
B
Yeah, see no, that's, that's scary. That's scary. This is a, a micro example of the great job fears we're talking about all the time. Our guest today will certainly have some thoughts on all of the above. It is Jeetu Patel. He's the President and Chief Product Officer at Cisco and we're going to talk to him about this new era of self building AI, self improving AI and why it could have great consequences and also disastrous consequences for cybersecurity and everything else. That's in just a moment.
- [18:52]
A
Nothing tests my patience quite like sitting on hold listening to the same four bars of music on repeat. It turns out all that time adds up the average person spends over 40 days listening to that dreaded hold music.
- [19:06]
B
40 days.
- [19:08]
A
And this episode is sponsored by Paloa, the AI platform built to make that a thing of the past. Paloa's AI agents are available 24 hours a day, seven days a week, fluent in any language and smart enough to remember every customer across every interaction because no one should have to explain themselves twice.
- [19:27]
B
From payment processing to roadside assistance, flight rebookings to appointment scheduling, Parloa delivers the kind of customer experience that turns a one time buyer into a customer for life.
- [19:39]
A
See Parloa's AI agents in action at parloa.com that's P-A-R L O A.com. Checking out Online Apple Pay makes it simple. When you tap the Apple Pay button, you can review your card information and shipping details. Need to make a change? Just tap to update your details before you pay. Then all that's left. Simply authenticate your purchase with face ID to checkout in seconds. Make online shopping a breeze. With Apple Pay still waiting in line Again, that's time you'll never get back. Save time and money with stamps.com over 4 million businesses have skipped the line with stamps.com join them to save up to 90% off carrier rates from your computer or phone right now. Print postage for certified mail, registered mail and packages in seconds. Then schedule a pickup right from your home or office for a limited time. Go to stamps.com and use code podcast for a free welcome gift. Taxes and fees apply.
- [20:56]
B
Welcome back to the Times Tech Podcast. Our guest today is Jeetu Patel, the president and Chief Product Officer at Cisco. Cisco essentially built the foundation of the modern Internet. It was founded in the 80s by a group of Stanford scientists and pioneered the first commercially successful router, which is basically a specialized computer that allows completely different networks to talk to one another.
- [21:18]
A
And during the.com boom, they briefly, very briefly, became the most valuable company in the world. And then of course, we all know what happened next. There was the crash, and ever since then they've been working their way back up. But a few years ago they made a big bet on AI and now they build their own silicon, design the systems that it powers, write the software, and provide the security that watches over it all. Their share price is now higher than it was in 2000, but it's been a long journey and it only got there again earlier this year.
- [21:51]
B
Yeah, so while you might not have bought a Cisco product today, if you use the Internet, connect to the office, wi fi or streaming video, your data is almost certainly passing through their hardware and the company is now valued at a cool $470 billion. Half a trillion dollars. Not bad. Welcome to the podcast G2. I think I want to start with something really basic, which is, you know, I grew up in the Bay Area, so I know all about the kind of Cisco lore, but a lot of people don't. Can you talk about what Cisco is today?
- [22:24]
C
Sure. I've been here for six years. I wasn't here for the ups and downs that happened in the past. But I will tell you that the reason the ups and downs happen is when you have a massive platform shift and a mega trend that's occurring in the market. If you actually catch the wave, you tend to enjoy the fruits of the momentum of the market. And if you don't catch the wave, you, you don't enjoy those fruits. We missed the cloud wave, but we are, you know, squarely, extremely well positioned for the AI wave. We were very careful not to miss the AI wave, but it was also kind of, you know, lucky for us that the capabilities that we had actually formed the critical infrastructure for the air. Like we have high performance, low latency, energy efficient networking, we've got optics, we make our own silicon, we actually have security for, you know, kind of protecting agents from the world. Also have security for protecting the world from agents and the way that they behave. We've got observability, we've got a data platform, we've got applications. So like there was this vertically integrated platform, full stack, that was fully co designed that we were unique enough to be able to really capitalize on. And by the way, the AI wave requires that like without GPUs, without a network are not that useful. And so the way that you should think about Cisco right now is it's the critical infrastructure for the AI era.
- [23:54]
A
Could you sum up very simply and briefly then what your customers are buying from you and who those customers are?
- [24:02]
C
Yes. Basically the way you should think about Cisco is we are an infrastructure company. So if you happen to be. There's three big outcomes that we help drive for our customers. The first one is because of the AI move right now, there's a tremendous amount of investment that's happening in data centers. And these data centers need to be AI ready. So we provide them all of the apparatus that's needed for data centers being AI ready on the networking, security, observability side of the house. And the way we think about it is that's where the digital workers live. The second outcome then is all of the workplaces where people work Whether it be a campus, a branch, an office, a factory floor home office, you know, a restaurant that needs to be, you know, future proofed for AI as well. There's a big movement that we should talk about right now. But inferencing is going to happen everywhere. And as inferencing happens everywhere, you'll see people buying like little Mac Minis that are sitting by their laptop, that are running agents. And so inferencing is happening on everyone's desk side, not just in the cloud. That's the second big area of outcome is future proof people's workplaces. And then the third one is this notion of have resilient infrastructure. We call it digital resilience, where if you do happen to have an outage or a breach of some sort because of security, how quickly can you actually get back up on your feet as a company so that you don't have massive amounts of downtime, which can be a business ending event? So those are the three big outcomes we, we solve for.
- [25:33]
B
Before we kind of get into the nitty gritty. I just want to talk about this moment in which we find ourselves in the market. We're recording on Wednesday before the big SpaceX IPO. You've had OpenAI and Anthropic both file. So the idea is that in like the next six months or nine months, we're gonna have $3 trillion IPOs. And it feels like, you know, we're both in California, like the gold rush is happening again. And I'm just wondering from where you guys sit, how sustainable does this feel? Does this feel to you? Because you're the one selling this kit to the companies that are building the systems and running the systems. What's your take from where you guys sit?
- [26:21]
C
The very common question that gets asked is, are we in a bubble? And it's a multi layered answer. And let me actually first start with two things can hold true at the same time. We are in the midst of the most seismic platform shift that has ever been experienced by humanity. And there also might be some companies that have frothy valuations. None of the three that you talked about are in that category, by the
- [26:45]
B
way, so that's none of those.
- [26:47]
A
Well, we'll see what happens on Friday.
- [26:50]
C
No, I'll tell you why, because I think there's a very sustained demand for what they're doing. And we should talk about this in detail. The second big thing to keep in mind is we are right now constrained in three major areas. If you think about what would make us not be able to harness the full potential of AI. There's three major kind of impediments. The first one is there's an infrastructure constraint. We just don't have enough power, compute, network bandwidth and memory in the world to go out and satiate the needs of AI. That's number one. Number two, there's a trust deficit. If we don't trust these AI agents, we're not going to use them. And so you have to make sure that you establish trust in the delegation that you do. The difference between simple delegation versus trusted delegation is the difference between market leadership and the extinction on one side if it's just simple delegation and market leadership if it's trusted delegation. So I think there's a huge kind of opportunity over there. And then the third one is these agents make decisions on our behalf. The difference between an agent and a chatbot as we move to this agentic era is that these agents are like digital co workers. They get augmented to our teams and they're going to conduct tasks and jobs for us almost fully autonomously. And as that happens, you have to feed it context, because that's how they make decisions. You and I ingest so much context every single day, and that's how we live our lives and we kind of connect things together. If you don't give that context to agents, they'll still make decisions. They just won't be great decisions. So there's a context gap that needs to be where the agents have to be enriched with context. All of these three things are constraints right now. But when you say, are we in a bubble? You have to compare it to what was happening in the 90s when people equated to the late 90s and the dot com bubble. The infrastructure was built out anticipating demand. Right now the infrastructure is being built out. And the moment the infrastructure is made available, the demand is consumed. And that demand is not consumed just for vanity purposes. People are using these products on a daily basis and it's become a habit. And that is how they get work done. Like, we have 30,000 engineers and these 30,000 engineers use these tools to code, and we don't actually. We now have a product that is 100% written with AI, no human lines of code. By the end of the year, we left six products, 100% written with AI. By the end of next year, we will have 70% of our entire portfolio that'll be 100% written with AI. That's crazy to imagine, but that's happening. So there's an intrinsic demand signal and a Value creation that's occurring right now. And so we have to. So I think there's going to be. This is a secular shift, not just a blip that's going to happen or like a quick spike and then everything's going to go back. That's at least my take on it. But that doesn't mean that you're not going to have a few frothy companies that get, you know, overvalued. But that's the definition of a secular shift, is you have a lot of experiments that happen during that course of time.
- [30:01]
B
How long before you have an agent on your board?
- [30:03]
C
I. I'll give you an example of what we're thinking about right now. Wouldn't it be great if every single person had a digital chief of staff that attended every meeting that they were in at the end of the day, gave you a summary that said, hey, here's all the meetings that you attended, only for you, this is the context that you need to have. And boy, wouldn't it be nice if nothing slipped through the cracks. Because right now what ends up happening is like, I'm, I'm not the most kind of, you know, I'm more left brain than right brain. I'm, I'm, you know, and so when you, when you start thinking about what happens in a day, if I sit in 10 meetings, invariably I'll forget something that someone said that I'm not going to follow up on. And then that was a huge waste of time for people because a lot of people prepared, they were in the meeting. Ideally, wouldn't it be great if you had a digital chief of staff in that meeting? By the way, that does not change for a board of director as well. Like, wouldn't it be great if you had someone that actually was providing the right level of, you know, governance input? They were providing the right level of strategic input. They were able to concatenate information and provide original insights as we were having strategic discussions. Super valuable to have on a board.
- [31:10]
A
But how long until it happens?
- [31:14]
C
I think right now, if there's a credible idea, no idea has passed a couple years. The biggest thing that happened in this industry was, which was actually a genius move, and frankly, anthropic gets a lot of credit for it. The genius move was they decided that coding was the app that they were going to go after first. And what that did was it made this entire, like, Claude code now builds Claude code and Codex builds Codex. And because of that, that exponential curve has become a vertical line. And then these models are becoming Self recursive and they're learning all the time and they're teaching themselves as they're actually going out and serving queries. So what I tell my team is if you test something out and it doesn't work, the normal human tendency is to say I'm going to put it aside for about six to 12 months, I'll come back to it later maybe. Or I'll just give it up and say this never worked. I'm like now what you have to assume is that if it doesn't work today, you have to assume it's going to work in the next two to three months. And the amount of time it's going to take you to plan is going to be far greater than the amount of time it's going to take for them to fix the product to make it work.
- [32:22]
A
Should we pick up on this idea of recursive AI? It's something we've been discussing in the program today. Clearly we had that warning from Anthropic this week on it. What are you seeing there and what are your views on it and its uses?
- [32:36]
C
It's actually not that different from humans. Humans are self recursive in nature, right? Like we continue to keep learning. And every single time, like even if you ask a professor or teacher when you're teaching, are you learning? You are. Because as you're teaching people, there's different ways to articulate the idea that comes to your mind and you're making connections within your mind. And so you're constantly learning and training your mind, even when you're going out and importing knowledge. I think models are starting to get to be in that kind of domain. It's, it's, it's pretty exciting because the class of problems we'll be able to solve with this is, I don't think it's actually sunk into people. People, you know, kind of listen to it. It sounds good. But think about every disease that we'll be able to solve at some point in time in the not too distant future. Think about poverty being eradicated in massive scale. Think about how education would be disseminated to every human on the planet. And there's equal rights of participation that anyone has because knowledge no longer becomes this kind of scarce commodity that only a few people have. Those are exciting parts of the future. Now by the way, you have to be super cognizant of not having rose colored glasses and understanding the risks of these technology as well, which we should talk about. But the upside is undeniable at this point and what will happen in these things is you'll always have these waves where people will be like, this is going to replace all humans, and humans won't have any value to add to society. And then literally the next week, people will be like, this thing doesn't work. And I'm just going to. It was just a passing fad, but the reality is there's a sustained level of improvement that's happening. And when you look back five years from now and say, imagine how we lived our lives back before ChatGPT came about, it'll seem very foreign, just like it seems very foreign right now. And you live your life without a cell phone or constantly being connected.
- [34:30]
B
Right, right. And then so shall we end on some scary stuff. Cyber security.
- [34:36]
C
Okay, so on safety and security, I think there are three things that need to happen in safety and security. Firstly, these agents are going to be attacked by the world. You're going to have prompt injection attacks, you're going to have data poisoning efforts so that you can alter the behavior of agents. So what you'll need to do is you need to make sure that you protect that agent from the world. So there's a whole bunch of safety and security capabilities that need to be in place so that you could protect the agent from the world. Number two, these agents themselves are non deterministic because they run a non deterministic model. They're kind of unpredictable. And the way I think about agents is they're like teenagers, you know, they're supremely intelligent, they have no fear of consequence, and as a result, they can sometimes do really stupid stuff. And so what you have to do is you have to be able to intercept it. And you have to be able to assess the behavior of an agent algorithmically and know that when this behavior is not being exhibited, you know that something is wrong and you have to keep an eye and be able to intercept it. So the second thing you have to do is be able to protect the world from agents. Protect the agents of the world, protect the world from agents. And assuming that every bad actor, every adversary, every threat actor that you have in the world is going to use AI to exponentially increase the amount of attacks that come our way on critical infrastructure or on any infrastructure, we cannot go out and combat those attacks at human scale. We're going to have to do that at machine scale. We are, of course, spending hundreds of millions of dollars, billions of dollars towards this problem right now. And I'm pretty optimistic about the kind of things that we're doing where I think for the first time in the bull case scenario, you might actually have the defender have the advantage over the adversary, which has never happened in the past. In the past, the adversary has always had the advantage because they have to be right once defenders be right every single time. This is the first time that the tables might turn. On the other hand, if we don't effectively operate at machine scale and try to do things in the traditional way, you know, catastrophic effects in society. Because think about a power plant going down, a hospital going down. Human lives will be cost if that happens. So I think that's the area that we are spending an enormous amount of energy. That's where I don't have my rose colored glasses. I actually think about the downside, pessimistic scenarios all day long.
- [37:10]
B
Well, so what do you. So I have thoughts about. I have so many thoughts about G2 and what he was saying.
- [37:15]
A
He said right at the start, you know, he was. He's obviously hugely optimistic about the power of AI and that there are many upsides. But it was quite clear to me, talking to everyone at the conference this week that, you know, there's huge concern about. He talked about eradicating poverty, but also what it means for people who are left behind, who aren't sitting in a very cushy, well paid tech job. Actually does feel like to me, particularly here in Europe, there's a real two speed economy at the moment and things. While the future with AI might look very rosy, I think we've got quite a rocky road together.
- [37:59]
B
Indeed, indeed. But wait, but wait, wait, what's that? What's that sound?
- [38:11]
A
What's going on? No, I don't.
- [38:13]
B
That's the listener email. KLAXON
- [38:18]
A
Cool. Oh, wow, look at this. Yeah, we have had a few emails kindly sending their regards to Norman, my AI agent. And this week we've had one from John Dudley. I must tell Norman, actually. He'll be completely delighted. John says, hi, folks, I enjoyed last Friday's pod. One thing, this is important. It's not confidential that Anthropic have filed something with the SEC as they are free to announce that it's the content of the filing that's confidential. This is standard practice as it gives the company and the SEC the opportunity for a private review before the public filing of the S1 listing document. Keep up the good work and give my regards to Norman from John. He is right because we were joking last week because Anthropic pinged round an email saying confidential filing to the sec which made it sound like it was like we've got a secret, but we're going.
- [39:11]
B
Announcement. Announcement. Here's our secret plan. Yes.
- [39:15]
A
When actually they weren't saying it was confidential. They were saying it's a filing which we have made and it's of a certain type of, of a confidential type.
- [39:23]
B
Fair. Fair point.
- [39:23]
C
Does that make sense?
- [39:24]
B
Thank you, John. Thank you, John, for being such a, an assiduous listener.
- [39:27]
A
And Norman will be so pleased. I mean, he always likes being recognized.
- [39:31]
B
I don't want to kind of keep bagging on my. Your guy Norman. But like, he doesn't have feelings, okay? He's just a guy and he's not gonna replace me. He is not gonna replace me.
- [39:42]
A
We'll see when you're in Mexico. All sorts of cats away.
- [39:47]
B
Anyhow. Well, that. That is it for this week's episode of the Times Tech Podcast. If you have any other questions, topics, ideas, opinions you want to get in touch with us about, you can email us at techpod@thetimes.co.uk tech pod@thetimes.co.uk I am not here next week.
- [40:08]
A
Have a good break.
- [40:09]
B
I refuse to be replaced by a machine.
- [40:12]
A
Can't do anything about it. Danny.
- [40:13]
B
I'm putting that on the record.
- [40:15]
A
Okay, well, we'll let you know how we got on.
- [40:18]
B
Well, hopefully I'll be back. Hopefully I'll be back, everybody. This might be it for me.
- [40:26]
A
This episode of the Times Tech Podcast was sponsored by kpmg.
- [40:31]
B
One of the themes we keep coming back to is the gap between AI ambition and real world application.
- [40:37]
A
And that's where KPMG is focusing its work, helping organizations move beyond pilots and think about how AI can change the way the business operates and how it fits into wider processes and decision making.
- [40:50]
B
You can find all their insights and how they can help your organization make the difference through successful AI workforce adoption. Visit kpmg co.uk AI insurance isn't one size fits all. That's why drivers have enjoyed Progressive's name your price tool for years now. With the name your price tool, you tell them what you want to pay and they'll show you options that fit your budget. So whether you're picking out your first policy or just looking for something that works better for you and your family, they make it easy to see your options. Visit progressive.com find a rate that works for you with the name your price tool, Progressive Casualty Insurance Company and affiliates Price and coverage match limited by state law.