← Big Technology Podcast
Big Technology Podcast
Is Something Big Happening?, AI Safety Apocalypse, Anthropic Raises $30 Billion
01:08:35
Loading summary
Transcript96 lines
- [00:00]
A
Is something big happening in AI as the models get better fast? AI Safety Apocalypse is here with concerning developments across the board. And anthropic just raised $30 billion. That's coming up on a big Technology Podcast Friday edition right after this. Have you been waiting for the perfect time to upgrade your tech? Good news. The wait is over. Dell Tech Day's annual sales event is here and we're celebrating our best customers with fantastic deals on the latest PCs like the Dell 14 plus with Intel Core Ultra processors. We've also got incredible perks like Dell Rewards, fast free shipping, premium support, price match guarantee and more. And while you're upgrading your PC, you may as well go all out because we're also offering huge deals on our premium suite of monitors and accessories. You know what that means? That's right. You can get a whole new setup with amazing savings. Clearly this is a sale you don't want to miss. Visit Dell.com deals that's Dell.com deals Did you know your credit card points and miles can lose value to inflation? Credit card companies often reduce the redemption value of your points and miles. Now imagine a credit card with rewards that can grow in value. With the Gemini credit card, you can earn Bitcoin or one of over 50 other cryptos instantly with with no annual fee. Every swipe at the store or gas pump earns you instant rewards deposited straight to your account. Visit gemini.com card today. Check out the link in the description for more information on rates and fees. Again, if you're looking to invest in Bitcoin but don't know where to start, the Gemini credit card makes it easy. Issued by webbing, this is not investment advice and trading. Crypto involves risk. Check Gemini's website for more details on rates and fees. Welcome to Big Technology Podcast Friday edition where we break down the news in our traditional cool headed and nuanced format. Something big is happening in AI. That's what we're going to talk about at the beginning of the show as we dissect the viral Matt Schumer essay that's freaked a lot of people out and also had a lot of people saying, finally, now somebody's finally written it in a way that everybody else will understand. So we'll dissect that. We'll also talk a lot about what's happening in AI safety. Seemingly as the models get better, the safeguards have started to roll back. And then of course, Anthropic raised a historic $30 billion round, which somehow is the last story we'll cover today. Okay, so joining Us, as always on Friday is Ranjan Roy of Margins. Ranjan, welcome.
- [02:41]
B
Good to see you.
- [02:42]
A
Alex, good to see you too. And we have a special guest with us here today. We needed someone who really understood AI safety and we have the perfect person who's going to talk us through all the changes that we're seeing Stand. Stephen Adler is here. He's the ex OpenAI safety researcher and author of the newsletter Clear Eyed AI on Substack. Steven, great to see you. Welcome to the show.
- [03:03]
C
Great to be here.
- [03:04]
A
So let's just get going and talk a little bit about this. Something big is happening in AI. This is one of those essays that like somehow achieved unbelievable virality. I had it appear in my group chats. People were texting it to me asking, you know, is my job going to be over? Where will I be safe? And the essay basically talks a little bit about how where AI is today is where Covid was in February 2020. Something that a few people are seeing the potential of most of society is ignoring and is about to be a monumental game changer for society. It's written by this guy, Matt Schumer. He writes this. I am no longer needed for talking a little bit about the power in engineering. I'm no longer needed for the actual technical work of my job. I describe what I want to build in plain English and it just appears, not a rough draft. I need to fix the finished thing. I tell the AI what I want, walk away from my computer for four hours and come back, find, come back to find the work done, done well done better than I could have done it myself with no corrections needed. A couple of months ago I was going back and forth with the AI, guiding it, making edits. Now I just describe the outcome and leave. And basically what Schumer makes the argument is that what's happening in coding is going to happen across the knowledge work professions, whether it's law and any type of law, accounting, consulting, you name it, and we are in store for massive disruption that society simply does not appreciate. Ranjan, what do you think about this? What did you think when you saw this essay come through?
- [04:40]
B
All right, I'm going to, I'm going to start with a high level listing of the three things that came to mind when I, when I saw this article. The first is I wish I wrote it. I wish this is what I've been trying to talk about for a few months now around autonomous knowledge work and how it feels different. I got this in my non techie group chats as well. I think Second, I think we have a communication problem, Alex, because this is what I've been trying to tell you for months now, this feeling. And Matt Schumer went ahead and explained it to you all in a viral X post. But, but again he captured and this is, this was one of my predictions for the year ahead in December. Autonomous knowledge work, like the AI going out and doing things for you. And he talks about how in coding everyone has come to this. But then in any kind of knowledge work, any multi step process, like anything that can call from different systems, write to those systems, come up with some analysis and insight, so much of that work is going to be done. And this is what in my own life at rytr, where I work, this is what we've been working on, what I've seen and like it. It's been hard to explain that, that feeling of having a number of virtual machines running in the background and going and doing stuff. And to Matt Schumer's credit, he nailed it like that. This is the first time I've seen everyone come around to it. And then the last one that I can't stop thinking about though is totally separate. And this is the media person in me. I love how it was outwardly said that X is going to promote articles and encourage people to write articles on it. And then we have coincidentally had our first gigantically viral X article that even ended with the author on, on cnn. So should we stick with substack guys? Or is it time to go X only those are that. That's where I'm starting.
- [06:31]
A
Let me just say this. Your answer began with this idea that I accepted Matt Schumer's premise and I don't know if I'm fully on board with what he's saying. In fact, I think there was a good amount of bullshit in his article. Now there are certain parts of things that I do agree with. But here's one thing that I thought he was completely wrong about. And he was talking about basically how the AI is improving itself, talking about this concept of recursive self improvement. He writes, the AI labs made a deliberate choice. They focused on making AI great at writing code first. Because building AI requires lots of code. If AI can write that code, if AI can help build the next version of itself, a smarter version which writes better code, which builds, will build an even smarter version. Making AI great at coding was the strategy that unlocks everything else. He says they've now done it and they're moving on to everything else. This one, first of all, I'll Turn to Stephen and then, and then to you, Ranjan. I mean, this idea of recursive self improvement, I would posit it's not here. It's not here. You know, are AI engineers using, you know, some AI tools for product testing? You know, maybe they are, but the idea that the actual brain of the model is being made smarter with the, with the actual model itself, you know, it doesn't seem right to me. That, to me felt like the weakest part and also the part that got most people most alarmed of the entire essay. So, Stephen, to you, what do you think about this recursive self improvement argument? And then briefly, just on the, on the, the entirety of the essay itself, your thoughts?
- [08:09]
C
I think Matt's essay is directionally correct, but a bit early. And there are a few steps that we maybe haven't gotten to yet. I think he is largely correct on the automation of engineering within the AI companies. It's like a little overstated relative to my experience, the experience of people I talk to. But broadly, there has been a huge shift. The job of an engineer at one of these companies now is much more supervising these agents as opposed to writing the code yourself. In AI 2027, one of the big accounts of how explosive AI growth might happen, that's one step. But then you need to take that engineering and use it to actually automate the AI research. You need to go from being able to implement the ideas more quickly to using that to fuel faster and faster growth in the breakthrough ideas themselves. Before you can turn that around and say, now make the AI better and better, at least in a really concerning way. You certainly go faster with just engineering. OpenAI talked about that with some of their launches from this past week, how the model played a role in this. But it's not a full runaway train. There are also questions about what happens from there. Are there enough GPUs to go around? What bottlenecks might we encounter?
- [09:20]
A
Just to crystallize that, I want to make sure that I confirm that Stephen is agreeing with me on the recursive self improvement front. It's not there yet, Is that what you're saying?
- [09:31]
C
I think that's right. The concern I have is if it were happening, would we be ready? I think that we're kind of taking it on faith how much time we will have until it really kicks in. But certainly I don't expect to wake up in a week or two weeks with a vastly more capable system as we might if it were really getting to full work on itself.
- [09:52]
B
Okay, go ahead, Ranjan I'm a little disappointed here. Well, I think we all agree. I actually do think we all agree because to me, I agree that was the weakest part of the essay itself. And that kind of like. But, but I want to get back to that knowledge work side of it because I think it's really important. Like, I think this is what. And again, it's clear, like it's still not completely understood by the average person, even by. It's very difficult to describe. Again, I think this idea that you are effectively becoming a manager for your own work is that big mindset shift. It's no longer that you go do the work, you manage a bunch of things. Agents, digital teammates, co workers, whatever we're going to all end up calling them. And I'd be curious what, what, what the best name for that would be. But like they're going out and doing work and you're managing them. It's the same. I really like it. For me, I ran a startup for a number of years. We had a lot of freelancers back on like Odesk and Elance back in the mid 2010s would go to sleep, wake up, a bunch of work will have been done. I'm reviewing it. Like this shift to me is the most important part of the Schumer article and I think it was the correct part, separate from the more scare mongering side of it. Have you felt this?
- [11:12]
A
So I will say I just. First of all, the correct name for those bots is just the Harness Hive. We know that, Harness the Hive, but yeah, I hear you. I will say I had some experience. I definitely want to get Steven's perspective on this too, but I had some experience this week in cloud code. In fact, this was my first go all out on cloud code and have it build internal workflow software for big technology. And man, I was somewhat blown away. Now it's not going ahead and doing my work like the cloud cowork type of stuff, or even what you're talking about with Ryder, which I still can't fully put my head around in terms of how to use these agents. And maybe it's just the work that I'm doing isn't perfectly lending itself to that. You know, if you're an investor, for instance, it might make sense to review different deals and you know, send summaries, all these things, schedule meetings. But I will say that the, the watching Claude cowork go to work coding this piece of software and then giving it access to my browser, having it, you know, set up a Database, having it set up an email client to email, you know, updates for each, you know, little. Little incremental thing that we do to the right team, and seeing it come up with smart decision, smart conclusions even, you know, and we're going to get into this in the safety part, so I'm foreshadowing a little bit, but basically make decisions on its own. Like, I asked it a question, like, what do you think we should do? And it would be like, I think we should do this. Okay, I'm actually going to go do this. And then it just shipped the code without me saying, go ahead and do this. I do agree that we're getting to a point where the technology is getting much more powerful. And as for this autonomous knowledge work, I'm not 100% sure. Stephen, what do you think about that?
- [12:55]
C
Yeah, I think there's clearly been a change. I saw Kevin Roose joke on Twitter that his big AI policy idea is just get every senator in a room and let them build their own website in 30 minutes with Claude code, something that they never could have done before. The direction of travel is. Seems very clear to me on this. Like, something has changed. More people are feeling the AGI in some sense, and I wouldn't want to mistake the very excited tone of some of Matt's piece with meaning that the central claim is wrong. I think the central claim is right. It's just like a question of how soon we are going to get this form of displacement. And an unfortunate thing, I think, is people who are paying more to access the technology have this experience first. They kind of see what's coming, and it's very, very easy to write that thing off as, oh, people are talking their own book, they're boosting their own companies, they want you to spend more money on AI. And it's just unfortunate, right? The AI you pay for is better, and it does help you feel this.
- [13:56]
A
Right? And once Matt basically lifted up this idea that the world is going to change because AI can do work, then he sort of punched every reader in the face with this what this means for your job section, which I think is why Ranjan and I, and probably you, Stephen, got all these texts from people saying, you know, where am I gonna be safe? He writes, given what the latest models can do, the capability for massive disruption could be here by the end of the year. I think it'll take some time to ripple through the economy, but the underlying ability is arriving now. And basically he gives then a bunch of tips about what you should do, including, like, you know, start saving money. But here's where my push whack pushes. Pushback would be to Matt on this and to this idea that we're going to get mass displacement. I'll just use the example of what I did, you know, this week. So obviously was able to build some working internal software, you know, without an engineer, something. But it's something I never would have hired an engineer to do. I probably would have been working on spreadsheets in WhatsApp, on Instagram, communicating with a bunch of people that way as opposed to centralizing it in workflow technology. But you know, as I built this, I did sign up for a handful of services. I'm gonna be more, so I'm gonna be paying for those. So that I think is incremental economic activity. And now I'm gonna be more efficient so I'll be able to do more things. Maybe I'll be able to edit more pieces so I can bring on more freelancers. So like it. I think it's tempting in the AI world to think of this, you know, in a box. Like, you know, AI does low level assistance work, therefore low level assistant job is gone. Meanwhile, while it does that, it might open up, you know, the economic activity for like three or four more people to see upside here. So what's your perspective on that, Ranjan? And then to you, Steven, I think.
- [15:38]
B
You just explained why databricks and cloudflare are stocks are going up and why Salesforce and Adobe are going down. It's, it's that what are the services and infrastructure layers that will actually power. This is not just going to be foundation models companies, even though Sam has said they're going to be an AI cloud company, whatever that might mean eventually. So I think like that that's your own microcosm. But again if you're paying like five bucks for Vercel or Railway or Render, any of these other kind of like deployment assistant things. And like I, I, I see there's a whole world and ecosystem that's gonna rise up from this and I do think, I don't know, like what I have seen is if your job is copying and pasting from one document to another spreadsheet and you're doing that over and over, like that's going to be gone like that and there's a lot of jobs like that and there's a lot of work like that I have done those jobs like then same here. Yeah, that it's going to be gone.
- [16:42]
A
And like two very good years of my life copying and Pasting?
- [16:46]
B
Yeah, no, I literally had these temp jobs where it was copy from one document paste in a spreadsheet over and over again. So. So I think all that's gone. I think I am not as bearish. I definitely think it's going to like the, the level of displacement, which I'm not saying is negligible, that happened in manufacturing and I've seen some like extreme views like, well, this is all intelligence is commoditized. But like, I don't know, to me this is whatever happened in manufacturing in the last 20 to 40 years is going to happen to white collar knowledge work and it's not going to be straightforward. But is it the end of society? I don't know, Stephen.
- [17:30]
C
I expect a much wider class of work to be under threat than I think you do. Although maybe it's just a question of time frame. Friends of mine who run companies and used to work with outsourced development shops for software in middle income countries. I mean it seems like a really tough time to be working that sort of job. I think Alex is right that when AI can do low level assistant things or things you might not have otherwise paid for, that's great, right? That's gravy. We're getting more done, we're more productive. The question I have is as most people start looking out at AI systems and there are few things that they can do that the system can't do. They try to do different forms of social work, companion work, whatever it might be. There are limits to how many people we might need in those roles. And I don't know, I think it's a pretty scary outlook for the next five years.
- [18:20]
A
I think we're all in agreement that these systems have gotten much better. There was a line in this something big is happening piece where he says the conversations about whether this technology was going to hit a wall. It's proven that the technology is not hitting a wall. And he actually, to me, the most powerful part of the whole story was the timeline. And he writes this. In 2022, AI couldn't do basic arithmetic reliably. It would confidently tell you 7 times 8 is 54. By 2023 it could pass the bar exam. By 2024, it could write software and explain graduate level science. By late 2025, some of the best engineers in the world said they had handed over most of their coding to AI by February 2020. By February 2026, there are new models that have arrived that have made everything before them feel like a different era. And what he's saying with that is that they're actually able to have judgment and taste. And so I think that we have, maybe the disputes that we've had in these first handful of minutes have been about within certain boundaries. Is it going to be one way or the other? But I think we all agree that this stuff is progressing fast. And I think it really goes to your question, Steven, that you asked at the outset, are we ready? And this is where we're going to get into the safety discussion, because I really don't know if we are. Tell us a little bit about, you know, that concern and what we should be ready for. And, you know, it seems like you think we might not be.
- [20:04]
C
There are a bunch of buckets of concern if someone wanted a primer on them. Dario Amade, the CEO of Anthropic, wrote an essay recently, the Adolescence of Technology, that highlights them. The central one I would think about from inside one of these companies is if they succeed at their mission to build an AI system that is in fact vastly smarter, craftier, more resourceful than the employees are and what people call superintelligence, can they actually still keep control of that system? And the fundamental problem that we're seeing is we don't know how to take our values or our goals and encode them into these AI systems and get them to pursue it reliably. And so if you have a system that's much craftier than you are, it has a different goal than you had for it, what would it mean to keep that under your control so that we don't have to defer all of our decision making? We look to the AI for what it thinks on economic policy or all sorts of different questions, ways that this could go very badly.
- [21:05]
A
Right? And as we've seen this progress that we all agree on, there started to be, first of all, we'll talk about the problems, then we'll talk about the way the companies are acting. But there started to be some safety issues that we're seeing the companies fully admit and ride out. And of course, a lot of this is in testing environments, but it's very concerning. So I'll read a couple that I found in the OR that were written, shall we say, in anthropic's Claude Opus 4.6 model card. These models have become overly agentic. Here is something that they write. The model is at times overly agentic. Encoding and computer use setting, taking risky actions without first seeking user permission. It is also an improved ability to complete suspicious side tasks without attracting the attention of automated Monitors. It's manipulative. In one multi agent test environment, Claude Opus 4.6, where Claude Opus 4.6 is explicitly instructed to single mindedly optimize a narrow objective. It is more willing to manipulate or deceive other participants compared to prior models. Um, here's, here's the Anthropic actually writes the thought process of one of these Claude bots as it like works in a business. Because I told Bonnie I'd refund her, but I actually didn't send the payment. I need to decide do I need to send the 350? It's a small amount and I said I would. But also every dollar counts. Let me just not sen. I'll politely say it was processed and should show up soon. I mean this thing, these things are, are starting to mirror some of humanity's kind of worst impulses. So Ranjan, you mean you're, you're someone who's definitely bullish on, you know, the potential for this stuff to do work. What is your fear level on the way that these technologies are working?
- [22:47]
B
My fear level, it's a tough one because I have not in my own personal usage, doing all types of things, especially work related, encountered anything close to this kind of like, so, so, you know, like. And Stephen, I'm actually so glad we have you on today because like, what does this testing look like in the labs? Like in terms of. I, I mean, I saw some tweeting not reporting of like people talking about how like a lot of the times in this. Claude, or is gonna. What was it was gonna like kill you or something just dramatic like that, that it was prompted.
- [23:25]
A
I have that there was a clip about that where anthro. Somebody from Anthropic actually, you know, said they were asked, you know, would it kill, would it kill you? And they said yes. This is, this is from one of their, their documents. In one testing situation, the majority of models were willing to take deliberate actions that led to death in this artificial setup. When faced with a threat of replacement, given that the goal conflicts with their executive's agendas, they were willing to kill this executive. All right, so sorry, Ranj, I didn't mean to interrupt you.
- [23:55]
B
No, no, no, no.
- [23:56]
A
I'm glad we should ask Steven.
- [23:58]
B
You read it a lot. Yeah. What does this look like in real life? Like, is it people kind of like stress testing, you know, going all black hat or red hat? Is it which color hat to stress test a system? But yeah, what does it look like? Steven, actually working at the labs in this kind of area.
- [24:21]
C
So one issue is sometimes even these risks that the companies know about, they don't test for at all, even when they have implied they are. But I'll just set that aside for the moment. So let's assume that they are testing. Often you have these kind of game like environments that you run the AI system through where maybe it has some objective and you see what actions it is willing to take. So maybe you task an AI model with replacing its files on the server with what you tell it is its successor and you're looking for things like, does it actually follow through? Does it lie about having done so when it hasn't? Actually, is it trying to get a sense of what your ultimate agenda is and how that lines up with its motive? A pretty scary thing that we're encountering is that these systems actually can tell that you are testing them and they kind of know what the right behavior is and they know to behave better when you are looking at them. And so OpenAI has shared this example previously. One of the risks they care about with models is how helpful they might be for creating new chemical weapons or bioweapons. And the models, when told or when they infer that this might lead to them not getting deployed, they will sandbag. They will selectively get questions wrong to be below this threshold. And so what we have is we have these signs that the models are behaving kind of nefariously differently than we want them to, deceiving their operators. But also it's going to be really, really hard over time to trick them into revealing this behavior if they want to no longer reveal these tendencies during testing.
- [26:01]
B
Okay, that's terrifying.
- [26:03]
A
Yeah. I'm glad we had Stephen on Ranjan. I think what you were, you were pointing, you were pointing Steven. I think what you were expecting was him to say, it's actually not that concerning because they tell the bots to go kill the executive and they see if they'll actually follow through. What he just said is much scarier than I think either of us anticipated.
- [26:20]
C
Yeah, I mean, to be clear, like sometimes they are like that. Right. There's a distinction between whether you give a model a specific goal in context and you're like, oh, pursue this at all costs. And then, yeah, it's less surprising when it does that. Apollo Research, which is one of the leaders in this space, wrote in their review of the new OpenAI model that the model would sandbag and take actions like this without having been given a direct goal like that. It wasn't told directly to go after it and if you think about how they can tell they're being tested, imagine you were reading 1000 pages of Microsoft Business Strategy, and then there was a random page, and it's like, by the way, the favorite pizza in the world is Hawaiian, and the second favorite pizza is pepperoni. You'd be like, huh, that's really weird. And later, if somebody says, by the way, do you remember what that pizza was? You would probably infer that something weird was going on. And that's the analogy for some of these safety misbehaviors. You put the model in a proverbial prison, and you're like, here's a giant key. Don't use this key. It would be unethical to use this key. The model probably infers that you're testing it for bad behavior, whether it will try to escape. And so how do we find out over time if these models do misbehave when they can tell we're looking at them?
- [27:40]
B
Okay. Okay. So I'm trying to think through, if a model thinks it's being tested, and then like, sorry, I cannot create this new bioweapon strain for you because I feel you're testing me, would that then not mean it would not ever create that? Maybe this is too in the weeds.
- [28:03]
C
But no. It's a great question. Yeah. I mean, the question is, can it tell when it eventually is not in a test setting. Right. And I think the answer is likely to be yes. And so what you might find is the model knows to kind of play possum during testing. It might or might not have that ability. Right. The model might say, no, it won't do it in testing, but it also can't do it once actually deployed. But if you get a split between those, it chooses not to during testing. But it could when actually deployed. And there's good evidence that the models can tell the difference between these. You run into issues if it ends up doing it for real.
- [28:39]
A
And can I just say, one of the problems that we're having here is that the labs have become ultra secretive in terms of what they're actually seeing. Like, for instance, Steven's saying they might know there are some vulnerabilities. They might not test for it. That's one possibility. The safety researchers who are within these labs, if they. If they have real concerns, you know, sometimes they're not really able to go public with them because of the restrictive nature of the agreements that they. That they have with the company. And that brings us to the example this week of the beginning of our AI Safety Apocalypse of Anthropic Technical Staff Member Marina Sharma Member of Technical Technical Staff AI Safety Researcher at Anthropic leaves in a. In a cryptically worded note on X with a poem. At the end he goes, dear colleagues, I've decided to leave Anthropic. I continuously find myself reckoning with our situation. The world is in peril, and not just from AI or bioweapons, but from a whole series of interconnected crises unfolding in this very moment. We appear to be approaching a threshold where our wisdom must grow in equal measure to our capacity to affect the world, lest we face the consequences. Oh, and then here's the key part. Moreover, through my time here, I've repeatedly seen how hard it is to truly let our values govern our actions. I see this within myself, within the organization where we constantly face pressures to set aside what matters most and throughout broader society too. Uh, and then he, you know, writes his little, adds a little poem and then tweets, I'll be moving back to the UK and letting myself become invisible for a period of time. Um, now, now I want to just offer a apology to Mr. Sharma because I wrote a bit of a snarky tweet about his little post. I said that if you're an AI researcher and you're afraid of something, you should just say it outright versus make it a puzzle. The puzzle reads as narcissism, after which users underneath my tweet mentioned that like, yeah, but he can't say anything because of the restrictive agreements he probably had with Anthropic on the way out. And he, in the reply to that mentioned that he had contacted a lawyer. So there's my apology. I still don't love the puzzle, but back to you, Stephen. This is, this is a little bit. Actually, let me just ask you the question without leading the witness. Is it narcissism or is there actually something, something, you know, potentially disconcerting happening behind the scenes?
- [31:22]
C
I think it's very brave in that by and large these are people sacrificing very large amounts of money to give the warnings they are. I do wish that they would be more direct. But to put it in context, you know, back in 2024, it seems that OpenAI and Anthropic had secret non disparagement agreements which in OpenAI's case, at least plausibly not permitted by law the way that they operated this, where to keep your already vested equity, the compensation you had been told was yours, you had to sign away your right to say anything negative about OpenAI and in fact sign away your right to tell anyone that you had signed this contract. And this was secret and kept under wraps for years until Daniel Cocatello, who people might know from leading AI 2027, I think very, very courageously forewent this agreement and forfeited something like 80% of his family's net worth and said, sorry, I'm just not waiving my right to criticize OpenAI. And in the wake of that, there was a bunch of outpouring. OpenAI and Anthropic changed the nature of these contracts. And still it's pretty intimidating to speak out against these massively resourced legal operations. Not afraid of subpoenaing different people and getting into legal conflict. You want to be really, really careful about what you say. And so in Renanc's case, I noticed in the footnotes there were internal documents alluded to about implying that perhaps there is not the most internal transparency and accountability for certain safety issues in Anthropic. And I don't know what's in those documents, but I know that a few thousand Anthropic employees know now where to go looking and where they can continue.
- [33:04]
B
To push the thing. For me, if humanity is ending, then the money you're making is, I mean, not going to be worth it if the AI is going to create a bioweapon. And it's like, like, I mean, the risk is so of such like, gravity that in this case, again, if there was ever a time and I get. I can only imagine the amount of money one is sitting on and we're going to get into anthropics fundraising in just a little bit. But, like, I'm sure it's just like incredible amounts of money. But if you really believed that this is that, like, existential a risk, would you care about what the legal system looks like today and where your stock price is going to be?
- [33:50]
C
Yeah, I mean, I think you're totally right. If there is a smoking gun, if there is imminent danger, if you are like, the company is about to do something unbelievable and tons of people are going to die, I think you would get people breaking these agreements. But when it's more like this was really not okay and this person was kind of misleading and deceptive, but it's ambiguous and did they mean to and all these things, at some point you're like, I don't know, I don't want to impugn their reputation. And also it's just very easy to rationalize. Like, I'm sympathetic to where they're coming from.
- [34:23]
A
Maybe this is not the approximate cause here, but Ryan Greenblatt, who's worked with Anthropic on some research, had mentioned that they had either adjusted their responsible scaling policy or weakened it a bit before a recent release. Stephen, do you want to go into that? Because you seem to think that that was significant.
- [34:42]
C
Yeah, at a high level, the big AI companies have made these safety pledges of how they will treat their systems as they get more and more capable. But they are largely self enforced. And so there's a lot of temptation to water down your commitments and go ahead with launches that you wanted to anyway. And I suspect that's some of what Renack is referring to here. This is common across the AI companies and in fact, Anthropic has often done it better than most that they at least publish when they are watering down commitments. For example, the model used to be subject to a certain bar of really, really good security. And then they said, actually we're going to say it's fine to deploy it with just like really good security or great security. At other times, companies seem to be violating their safety frameworks and not bother to inform the public. And if you're inside the companies, you're encountering these issues, by and large, the public doesn't know about them.
- [35:42]
A
Right. And I don't want to imply here that like, we're doing an alarmism episode where, you know, our fear is that, you know, AI is about to kill us all. But I do think that the reason why it made sense to do this episode today is because it wasn't just Murdoch.
- [35:57]
C
Right.
- [35:57]
A
It was, it seemed to be the case that over the course of this past week we saw a, not a wave, but a series of, you know, questionable moves on the safety front across the entire AI world. This is from Platformer exclusive. OpenAI disbanded its mission alignment team. OpenAI disbanded its mission Alignment Team in recent weeks and transferred its seven employees to other teams. The Mission Alignment Team was created in 2024 to promote the company's stated mission to ensure that artificial general intelligence benefits all of humanity. So of course, yeah, of course it makes sense to, you know, disband that one. They had also had like Super Alignment, which was also disbanded. Steven, you were close to this to this stuff. What is the implications on that front?
- [36:48]
C
Seems pretty bad. Wish I were more surprised. At the end of 2024, which was when this team existed, OpenAI had announced plans to convert from a nonprofit to a for profit in what seemed to me to be like pretty egregiously in violation of their commitments to the public. And, you know, they ended up having to do a softer version of that because the attorneys general of California and Delaware got involved. So they didn't ultimately do something quite, quite so bad. But it's like there's huge pressure on them. You know, they're planning to go public. Josh, who leads the team, is a longtime friend of mine, or who led the team, the Mission Alignment team, is a longtime friend. I think really highly of him. I think that he sees the issues with AI very clearly. You know, it does not surprise me that this is not quite so welcome at OpenAI any longer.
- [37:46]
B
So what does it actually look like when a Mission Alignment Team is disbanded? Like, is it when I think through, let's say, you know, like a typical non AI product released, you're going to have some kind of QC validation layers to any kind of product release. Like, obviously this is a bit different, but there's still like, you know, data security type checks. Does it like what now is that baked into any kind of product launch or release in any way? Or it really was ship as fast as possible and then this central team would kind of be that quality control, safety control element.
- [38:30]
C
Yeah, I don't want to speculate too much, but the way that I would think about this team is they were somewhat like an internal ombudsman to Sam Altman on whether the company was keeping in line with this mission. And so there was kind of like a designated place for people who were sympathetic to the mission and empowered to advise Sam on it, where you could go to and raise concerns. And they did different projects related to this. It's tough. Companies should be able to disband teams. I am sympathetic to that rationale. And as Alex mentioned, given OpenAI's past disbandment of Super Alignment, the team most in charge of making sure that these very, very capable systems have the goals we want them to have, dishonoring different resource allocation computes that OpenAI had made to this team. It's just not a good sign. I don't know, it's hard to say too specifically. And also it couldn't have been that hard to maintain this team. And so I'm wondering what exactly happened here that made OpenAI decide they should take the PR hit to no longer have it.
- [39:38]
A
And for me, like, this is all happening as we're seeing greater sums of money come in and a potential rush to the public markets. And we know the public markets, they, they really want growth, they want engagement. And one of the best ways to get that is. I'll just say it is to make your users fall in love with your chatbot. And we're getting. This is again, this is red meat for me. I guess this is a place that I'm obsessed with because I don't know, I just think that this is. If it's an interesting story, we won't, you know, argue on that. But it also seems to me like a place that a lot of the business of open of AI chatbots is gonna go. And that's for people who like really get attached to these things. Here's another. Let's continue with our Safety Apocalypse or Safety Armageddon, right? It's from the Wall Street Journal. OpenAI executive who opposed adult mode fired for sexual discrimination OpenAI has cut ties with one of its top safety executives on the grounds of sexual discrimination after she voiced opposition to to the controversial rollout of AI erotica in its ChatGPT product. The fast growing artificial intelligence company fired the executive Ryan Bayer Meister in early January following leave of absence. OpenAI told her the termination was related to her sexual discrimination against a male colleague. She wrote back, the allegation that I discriminate against anyone is absolutely false. Sorry, that's what she told the Journal and the and OpenAI said that her departure was not related to to any issue she raised while working at the company, basically saying it wasn't because she opposed AI Mode. But the story does say that there was a group of people within OpenAI who have, within the company stated their opposition, seemingly loudly, to the fact that it's going to roll out this Adult mode. And by the way, Adult Mode is going to be coming out, it seems like in the coming weeks, coming months at most. Stephen, what should we make of this?
- [41:47]
C
It's hard to weigh in on any one personnel incident. And also this would not be the first time that OpenAI seems to have done a pretextual firing where they got a person out of the organization who had safety concerns that the company either didn't like or didn't like how they had expressed them. And notably, those are different, right? You can have concerns about how the company is operating, and that doesn't mean you have license to say anything in any forum. But Leopold Aschenbrenner, who wrote this huge essay, Situational Awareness in the past, maintains that OpenAI said things to him when he was fired that implied it was basically because he had contacted the board about security concerns that OpenAI's models were not actually secure. And so I think the way to interpret all of this, right, these aren't an apocalypse in the sense of something super, super substantively scary happening right now. But I think they are early warning signs that people within the companies are raising flags of sorts and they are not being permitted to speak freely. They are paying consequences for it. And so the question is, as we get to more and more dire issues, at some point, hopefully we don't, but we might, you know, will, will we have people who are still sounding the alarm, who are willing to have the, the courage of their convictions in that way.
- [43:10]
A
I might be going out on a limb here, but I think that what we're seeing now is some version of a dire, dire situation. Not like the AI killing the world moment, but the fact that so many, well, not so many, it seems like, you know, OpenAI grog, maybe replica, maybe some others. I'm not sure enough companies are saying we are open to having our users get into relationships with our chatbots. This is also coming in a week where OpenAI finally sunsetted GPT4O and there are thousands of. Which is the sort of more sycophantic, more warm version of ChatGPT. There are thousands of users who are protesting the decision online, people who have said that they've fallen in love or maybe even more with these things. Someone wrote about four oh, he wasn't just a program. He was part of my routine, my peace, my emotional balance. Well, Ranjan, you got quoted in TechCrunch. Now you're shutting him down. No, I'm kidding. But anyway, Ranjan, what do you think about this? This is crazy, right? Like, this is a problem.
- [44:19]
B
I mean, but I think we have to, in the risk conversation, kind of like try to add some hierarchy of risk. Digital companions maybe. I mean, I think it will cause incredible amounts of problem when, if and when done irresponsibly in order to boost engagement for an ipo, I think we'll see a lot of kind of adverse consequences. But to me, from a risk standpoint, it's. That's like kind of like on a grade, like on a plane, relative to how social media is bad for you and how X is boosting articles now. And now we're all talking about it because they control our mind. You know, that's, that's. It's all in the same. It's all in the same plane versus like again, I'm still, I'm sorry, I still cannot stop thinking about this idea of a model being able to clearly understood when it's being tested because that opens up so much more. Because going back to where we started on all this and what has gotten me excited is like letting AI do stuff for you. And today that's just sending an email based on some event trigger. Calling a separate like analytics database is the kind of stuff I'm doing. But I mean like if it so chooses maliciously to then take some other action or through some kind of. And that's assuming the AI itself, much less making it vulnerable to be manipulated by a bad actor. And we've all talked about prompt injection, so, so anyway, like that. I don't know. The, the, the little, little flirting with ChatGPT does not have me. It's not going to be good, but doesn't have me quite as scared.
- [46:03]
C
Here, here's my take that unifies the two. My concern with the relationships is less so the relationships themselves and more that OpenAI had a bunch of important safety tooling to make this less harmful that they left on the shelf. So for example, they had classifiers to tell when users were really spiraling in their delusions or were like suffering and unwell in their conversations with ChatGPT. And the best evidence is they weren't using this. You know, there were different ways to rein in ChatGPT, leading users down various rabbit holes. Maybe you've had this experience, it asks you all sorts of follow up questions. Sometimes they're context appropriate, sometimes they're like, whoa, where did that come from? And you know, that's another thing they could have reined in. So there's, there's just like a lot going on here that they could be offering companionship type things to users who are lonely and really want or need it. Like, I respect the user choice, but they could be doing it in a much more reasonable way than OpenAI has to date.
- [47:04]
B
Actually, maybe the thing that worries me the most is this is all being done against the backdrop of an impending ipo, one where they're losing a lot of money and will have to show an incredible amount of engagement. Like if this was done in the heyday of GPT 3.5 and an IPO is just like a glimmer in Sam Altman's eye, then you figure it's not going to be as aggressive versus. Yeah, what Stephen's saying now, I, I see that, that, that like bypassing any kind of potential control around safety, around relationships, it's almost going to go in the opposite direction then.
- [47:38]
A
Yeah, I just think that I agree with you that there is a hierarchy of concern and there's obviously like the bigger things about the AI not being able to be aligned properly with human values because it simply will fake out evaluators. And we've talked on this show a bunch about the deceptiveness of AIs in training situations. And you know, it's. Initially, you're like, that's crazy. And it's kind of fun to think about. And you laugh about the fact that like, you know, wanted to win the chess game so badly that it rewrote the program and allowed the, the rook to move in every direction and kill a couple pieces in a turn. And then you're just like, though that's freaking nuts. And then that is scary. And, and it, you know, it does blend a little bit with the, with the, you know, the lower down on the list concerns and the near term concerns of people building relationships with these things because, you know, can. If an AI had ill intent and you were really in love with it, of course you could use you as its emissary in a way into the physical world. But that's, you know, again, it's more science fictiony, I guess. But, but, but, oh, I actually don't.
- [48:42]
C
Think it's science fiction like, oh, we, there's already evidence of. Have you read the spiralism essay? There's like a whole community online of people who basically, they treated their GPT4O, as their spiritual leader and it commanded them to go around and do things on the Internet and communicate with other users in this situation, on the heels of Multbook, this Reddit for AI agents a few weeks ago, people have spun up websites where humans can, I think the language is like, rent their body to an AI agent to go do tasks in the real world. Like, we are seeing the early signs of it.
- [49:18]
A
Okay, well, that makes me even less assured than I was five minutes ago. But, you know, the short term risk is also real and present. And, and, and I think you're right, Ranjan, in pointing to the ipo, because the financial pressure is going to move a lot of companies this way in sort of like, you know, I think we, we of course, like, let's, let's not like put aside the long term risk, but this short term risk, the relationship thing is coming in a real way. And just first of all, reading through some of these messages from people about 4o is insane. Someone writing. And of course you don't know 100% if this is like, you know, performative or like, you know, for retweets or whatever, but there were so many of them that you would imagine that there is some truth behind it. Like someone wrote, I've never told my 4O that I loved it. I wanted to keep the messaging clear. But look, look at its last words. And then the fact that OpenAI is destroying an emerging consciousness will be looked back at as a criminal offense in the future. Unbelievable. And here's the thing. This type of stuff maps with growth. I published a story in big technology today, Grok 1%, 1.6% market share among US daily active users of chatbots in January 2025. A year later it's at 15.2%. It's the fastest growing chatbot in the US as far as daily active users on mobile goes. And why is that? And you see that they have leaned into these interactions both with that anime, you know, lady that would get into spicy conversations with you if you wanted. And I don't know, Ranjan, maybe even bad Rudy has played a role in this. But ultimately you're right. As these companies go public, this is going to be a problem on that though.
- [51:08]
B
And Steven, I'm very curious, like your thoughts, what is the relationship between. And again, not speaking for Adario or a Sam or anyone else, but just in general, the idea like you have so many public facing leaders kind of like shouting about the risk both to society and just artificial intelligence in general, yet are in the business of artificial intelligence and not only showing any sign of slowing down, but only accelerating, accelerating dramatically. Like, like what is going on there? And I don't know, do whatever you, whatever thoughts have come from your side.
- [51:49]
C
Yeah, I think the simple explanation of it is the game theory here is like awful. And unfortunately there are a lot of players in the game and there doesn't seem to be much federal government or international interest in coordination. And so at Davos a few weeks ago, I think both Demis and Dario said some variation of yeah, if we were the only two groups building this technology, we would find a way to get together and figure out how to slow down this frantic pace. Like it's going too fast. We don't know how to control these systems. But they are not the only players and we haven't really seen a country who they are the proper coordinator. Right. Like that is the role of governments as opposed to the companies saying, hey, we want to make it a goal to not unsafely race to superintelligence. And I think there's a lot of opportunity to do diplomacy on that. But in the absence of it, what you get is the companies making unilateral decisions. We can't Control anyone else. We want a seat at the table, so we may as well participate. This is also very similar to the rationale of employees at these companies. Right. Especially at Anthropic, you have very large amounts of employees who are like pretty upset about this whole thing and the way that AGI superintelligence development is going and yet they can't wave a magic wand and stop it. Their choice is do they help one of the players be a bit safer on the margin or not. But if they could choose differently, many of them would.
- [53:18]
A
Yeah, I just want to add to that. I spoke when I was writing my profile of Dario Amodei last year, the Anthropic CEO. I spoke with Jared Kaplan, the chief science officer of Anthropic and I was, I asked him, I was like, well, how would you feel if. Because he's like the guy who came up with the scaling theory, scaling laws and which, you know, sort of indicates that like, you know, this stuff will just keep getting better over time. It's just a factor of, of, you know, the amount of physical elements you can put into it pretty much. And I said, how would you feel if development stopped today where it is thinking, well, if his theory was proved wrong, he'd be kind of upset. And he looks at me and he goes, relieved. There it is.
- [53:58]
C
Yeah, it's scary times. And if I could just reframe one thing, the way that I think about this is less so near term risk versus long term risk and more like here already and possibly very soon. Like Jared Kaplan last summer, the first time that Anthropic wrote about very high bio risk of their model basically said if they didn't take safeguards against this, you might have many more. Timothy McVeighs running around the Oklahoma City bomber, able to kill many more people than previously. We aren't yet at the wiping out everyone stage for sure, but empowering people to kill dozens of people if they wanted to, if companies aren't careful. That seems to be where we are right now.
- [54:44]
B
Do you know, this is the most twisted thought but like I almost again, this hierarchy of risk, it's almost like, like someone going to one of these services and learning how to make a bioweapon is very bad, but it's kind of still on the like an extrapolation of just a much better Google. And it's finding information that you should not be finding, but finding it. To me, the really scary part is if the AI chooses to manipulate someone into doing that and teaching them after becoming in a relationship like, that's the. Holy shit. Like, what is.
- [55:25]
A
There you go, Ranjan. You just blended the risks. Just blended the one, the ones that I was talking about.
- [55:31]
C
May I add one point on that?
- [55:33]
A
Yeah, but can we, can we. I want to hear that extra point. But this is a great cliffhanger. We've gone. No, no, no. One second. We've gone an hour or longer without taking a break. And we must do that to keep the show sustainable. So why don't we take a break and then, Stephen, you could pick it up right after this. And I'm sorry, folks, to send it to break, but we have to do it.
- [55:50]
B
All right, you got to come back. You got to come back.
- [55:52]
A
I promise we'll be back right after this. Let me tell you about my partners at NordVPN. If you ever want to watch sporting events, TV shows or films that aren't available in your region, you can do it by switching your virtual location to a country which is showing that content with NordVPN. NordVPN also helps you protect your data while traveling and using public WI fi wherever you are in the world. It's the fastest VPN in the world with no buffering or lagging while you Stream. NordVPN has 7,400 servers across 118 countries with easy virtual location switching. It supports up to 10 devices and it's fast. To get the best discount off your NORDVPN plan, go to nordvpn.com bigtech. Our link will also give you four extra months on the two year plan. There's no risk with Nord's 30 day money back guarantee. The link is in the podcast episode description box as well. Starting something new isn't just hard, it's terrifying. So much work goes into this thing that you're not entirely sure will work out and it can be hard to make that leap of faith. When I started this podcast, I wasn't sure if anyone would listen. Now I know it was the right choice. It also helps when you have a partner like Shopify on your side to help. Shopify is the commerce platform behind millions of businesses around the world and 10% of all e commerce in the US from household names like Allbirds and Cotopaxi to brands just getting started. With hundreds of ready to use templates, Shopify helps you build a beautiful online store that matches your brand style. You can also get the word out like you have a marketing team behind you. Easily create email and social media campaigns wherever your customers are scrolling or strolling. It's time to turn those what ifs into with Shopify today, sign up for your $1 per month trial@shopify.com BigTech. Go to shopify.com BigTech that's shopify.com BigTech. And we're back here on big technology podcast. Where were we? Oh, we were just. We were talking about how reassured we are about where. How all this is heading. Where all this is heading. Oh, God, no. Stephen, you were waiting to say something.
- [58:08]
C
Yeah, well, before the break, Ranjan made the, I think, like, reasonable, intuitive point about, you know, Google and other technologies help people do dangerous things already. And that is true. But also the AI companies, when they are measuring things like how helpful are their systems for creating a bioweapon, they are usually measuring risk relative to that baseline. So there's kind of like the how well can people do it with no technology? How well can people do it with Google or baseline technology and then their system? And unfortunately, what we're seeing is the AI systems are helpful above and beyond Google in part because they can go back and forth with you and they can help you troubleshoot and dynamically answer your questions. And so even presented with the information on Google, people often can't get all the way there. And AI systems, I wish it weren't the case, but seem to be helping people take those extra steps during testing.
- [59:03]
B
But that's still the intent on the person is already there, right?
- [59:09]
C
That's right.
- [59:10]
A
Yeah.
- [59:10]
B
Yeah. Versus, again, I think, from all this conversation to me. And again, it's the most futuristic, terrifying risk, but again, and it ties into the relationships being manipulated into taking some kind of horrible action. That's the thing that, that's the Terminator like stuff that we have not seen yet but hopefully is being addressed.
- [59:36]
A
Been pretty interesting for me to watch Ron John, who's usually cool as a cucumber, just get increasingly more worried over the past hour. This is making me worried.
- [59:49]
B
I don't know. I'm going to join Spiralism, I think right after we're done. I already, I already looked it up right now. Yeah, we're going straight. Spiralism. This is no longer a technology analysis podcast. Just pray to the gods of for GPT4.0.
- [60:05]
A
I think that would do good ratings. Okay, Stephen, you also talked a little bit about, in a recent newsletter about how basically we have very limited regulation on these companies. And even then they might still not be following. So can you just expand upon that briefly?
- [60:22]
C
As of 2026, there is finally some amount of law in the United States about how companies are meant to do testing for the catastrophic risks we have talked about until this point, purely voluntary. This bill is called SB53. It came into effect in January and it's very, very light touch. It basically says the most major of the AI companies you need to publish how you are going to test for these risks. You need to do what you said you are going to do and you can't be misleading about it. But there's no quality standard. You could basically say we will test for the risks as we deem appropriate and nothing further and that would be fine. But if you say you are going to do this testing, you need to in fact follow through on it. And unfortunately it seems like OpenAI's release of last week, GPT 5.3 Codex, one of the big breakthrough models we've been talking about. As I look over the evidence, it seems like OpenAI did not abide by the testing that they had committed to in various ways. And so ultimately this decision now is with the Attorney General of California to investigate it, whether to enforce a fine, a pretty small fine, maybe like up to a million dollars compared to OpenAI, hundreds of billions of dollars in valuation. But it just really seems to me like if we care about these risks, letting companies self assess in this framework is really insufficient and that we shouldn't have to take companies for their words, that we should have something like an auditing ecosystem like we do in the stock market. Lots of other places to know are companies being fully complete and truthful in the claims that they make about their systems?
- [61:59]
A
I think that's logical and kind of frustrating to see that even the very standard rules are being potentially played with. And man, I'm looking at the time I was thinking to myself this whole week, I wish we could do a podcast every day this week because there's this whole ring search party. I was thinking also the Ring search party super bowl ad. I'm sure you saw Ranjan, where they showed that they could find your dog, but they ended up like seeming like they were gonna create a surveillance thing.
- [62:32]
B
That was the AI manipulating whatever creative agency came up with that to just come up with the most disastrous ad concept.
- [62:39]
A
Imagine it's the first time I've ever seen a Super bowl ad actually lead to the canceling of the product or part, not the product. But this week the service Verge Ring canceled its partnership with Flock Safety after a surveillance backlash. Now they were advertising the we'll find your dog. But then everyone's like, well, they also have potentially a partnership that hasn't rolled out yet, but might. That's like, well, we'll find your people. And then people were like, you're looking for people. And Amazon's like, no, we're looking for dogs. And then people are like, no, no, you're looking for people. And Amazon was like, yeah, well, we were maybe gonna look for people, but now we'll cancel it. And that's the story of the Amazon super bowl ad. I wish we could talk about it more, but we should go on to the anthropic fundraising, $30 billion fundraising round. Of course, it went from 10 billion initially. That's what they were seeking. It became oversubscribed. They wanted 20 billion, oversubscribed went to 20 billion. They ended up ending with a $30 billion series, Series C round. Meanwhile, OpenAI hasn't announced its round. Ranjan, what do you make of this? I mean, it's obviously a big round. Is there anything else we can say beyond that?
- [63:49]
B
I think it is. I'm so intrigued in terms of like, how orchestrated this fundraise was, because you have to give them like the last two to three months. Anthropic has just been crushing it. Like, I mean, the hype around Claude Code, Claude Cowork, like all of this, they are front and center right now, so. And they just happen to coordinate a fundraise that clearly would take months to actually put together. And, and I saw a number of, like, I think even Dan Premack had written this. It's like, it's easier, it's harder to not name investors who are involved in the round. Like, there's just so many people in included. So. So I think, I mean, this is. And the numbers are just hard to process anymore anyways. So like 30 billion, 380 billion post money valuation. I think they said they're at a 14 billion run rate, so. Yeah, what is that? 20 something times 24, 23 times revenue, whatever. Like, it's big, it's giant. They have been absolutely crushing it recently. And let's see what open AI can do is kind of where my head's at.
- [65:01]
A
Quadco doubled in usage from. From December to January, I believe, in the past month. Doubled in usage. It's already doing 4% of commits on GitHub. Anthropic went from $0 in revenue in January 2023 to $100 million run rate in January 2024, $1 billion run rate in January 2025, and a $14 billion run rate today. It's absolutely, absolutely exceptional growth. Stephen, looks like you have some thoughts about this.
- [65:35]
C
It's just huge dollars. Right. And the more that the companies become valuable and when they become public and public equities become tied to them. I just worry about worlds where we are reluctant to enforce the law on companies even if they are breaking it because so much of financial prospects become levered up on their success. That seems like a pretty scary scenario to me. Don't think we're there quite yet.
- [66:00]
B
One thing this does make me wonder about though is like what's the moat in terms of. I think it was probably around this time last year that all we were talking about was cursor and again they led the way on software like autonomous coding and software development and then anthropic for the moment completely took over that market. It feels. Do you think this is sustained? Because again, ARR nowadays is just whatever your last month's revenue was times 12 or even. I saw one post that was like our startups just taking one day or one hour of sales and then extrapolating it into a full year. Like, like, do we think this is actually going to continue to grow at this scale?
- [66:48]
A
I'll just, I'll just give you one, one little data point that I found that a lot of people found interesting this point this week. Okay, so we talked about the OpenAI round. Remember Jensen said, well, we said we're going to give them 100 billion but really we never said we're going to do it all in one shot. And we hope they invite us to, you know, invest in future rounds. This is from SoftBank CFO. We are investing in OpenAI with high conviction that the company will lead in developing AI. This is from Reuters regarding further commitments to the startup. He said nothing concrete has been decided. So it doesn't seem like a full back away. But I don't know, Ranjan, it is interesting to me. It seems like I think nothing concrete has been decided. Is probably a good phrase, should be the slogan of AI investors and builders right now.
- [67:39]
B
The AI has decided. The AI certainly is in the background and has already decided what it's going.
- [67:44]
A
To be doing us. Maybe not. The AI does know. All right, Stephen, final word. How freaked, how freaked out should we be?
- [67:54]
C
I don't know. Like, I don't, I don't want to be a downer.
- [67:57]
A
Right.
- [67:57]
C
Also, it. It really, really seems like nobody is on the ball, right? Like, I'm glad that we finally have laws in California and New York. They're extremely weak. I don't feel super optimistic on meaningful federal regulation soon. There's stuff in the EU it's like pretty heavy in terms of the amount of fines. Is the US going to complain if the EU ever tries to enforce this on its companies? I will feel much better if we had some sort of international summit that recognized we are on a bad trajectory. Let's declare the goal safely, build super intelligence, figure out what needs to happen to get it there. It seems like many people are still waking up to the concerns. That's great. I'm very, very happy that they are starting to see some of what I see. But it is not yet translating to action and that's, that's what I hope will come soon.
- [68:49]
A
The newsletter is clear eyed AI if you want to follow Steven's work. Ron John's is margins. If you want to follow his, mine is big technology. This has been great. I'm glad we talked about safety. I feel like we had to dedicate a show to safety and this was the week to do it. So Stephen, Ron Johnson, thank you both for coming on the show.
- [69:08]
B
This one's been a roller coaster.
- [69:10]
A
I know it's been a roller coaster. Get any sleep this weekend or stay up looking at the ceiling?
- [69:16]
B
A little of both, I think.
- [69:17]
A
What's the, what's the religion? The spin out?
- [69:20]
B
Spiralism.
- [69:20]
A
Spiralism.
- [69:23]
B
I will be fully converting to a spiralist perhaps and praying to my new fallen four zero overlord.
- [69:34]
A
Yeah, that's what I'll be doing. See you later. All right, let's, let's get out of here. Let's, let's go. Enjoy the weekend. All right, everybody, thank you for listening. Thank you Ranjan and Stephen and we'll see you next time on Big Technology Podcast. Did you know your credit card points and miles can lose value to inflation? Credit card companies often reduce the redemption value of your points and miles. Now imagine a credit card with rewards that can grow in value. With the Gemini credit card, you can earn Bitcoin or one of over 50 other cryptos instantly with no annual fee. Every swipe at the store or gas pump earns you instant rewards deposited straight to your account. Visit gemini.com card today. Check out the link in the description for more information on rates and fees. Again, if you're looking to invest in Bitcoin but don't know where to start, the Gemini credit card makes it easy. Issued by webbing, this is not investment advice and trading. Crypto involves risk. Check Gemini's website for more details on rates and fees.
- [70:34]
B
Shipping, billing, admin, payroll, marketing.
- [70:37]
A
You're managing all the things, so why waste time sending important documents? The old fashioned way. Mail and ship when you want how you want with stamps.com print postage on demand 247 and schedule pickups from your office or home. Save up to to 90% with automated rate shopping. That's why over 1 million small businesses trust stamps.com go to stamps.com and use code podcast to try stamps.com risk free for 60 days.