← Big Technology Podcast
Big Technology Podcast
DeepSeek's Fallout For AI Companies, OpenAI’s Path Forward, Siri Somehow Got Worse
00:58:39
Loading summary
Transcript65 lines
- [00:00]
Big Technology Host
Let's assess the fallout of the Deep Seq moment and how it changes things for OpenAI, Anthropic, Nvidia and others. Plus Apple makes Siri dumber and iPhone sales are falling. We'll cover it all on a Big Technology Podcast Friday edition right after this from LinkedIn News.
- [00:17]
Ranjan Roy
I'm Leah Smart, host of Everyday Better, an award winning podcast dedicated to personal development. Join me every week for captivating stories and research to find more fulfillment in your work and personal life. Listen to Everyday better on the LinkedIn podcast network Apple Podcasts or you get.
- [00:32]
Big Technology Host
Your podcasts welcome to Big Technology Podcast Friday Edition where we break down the news in our traditional cool headed and nuanced format. Well last Friday we spoke with you about Deep Seek and over this past week it seems like it's really changed the entire conversation in AI. So we obviously covered it on Friday. We had MG Siegler come in for an emergency podcast on Monday. Today we're going to pick up that conversation and talk a little bit about now that we have a little bit of distance from the actual news itself, what it going to mean for almost every tech company in the AI AI game today. And then we'll also talk about Apple and how Siri has become even dumber with Apple Intelligence. Joining us as always to do it is Ranjan Roy of Margins. Ranjan, what a week it's been. Welcome back to the show.
- [01:19]
Ranjan Roy
I can't believe the deep seat sell off was only five days ago. Now these weeks, these weeks are getting longer.
- [01:26]
Big Technology Host
I think that's crazy and it's very interesting that Nvidia was the one that was hitting. I guess Nvidia has been a symbol for artificial intelligence and maybe the AI bubble if you think it's a bubble. But there are some others outside of Nvidia that I think it's worse for and we can talk about that a little bit today. So let me just kick it off because I about to publish a story on Big Technology talking a little bit about the four areas of margin in AI and where this week's news leaves OpenAI. So I was speaking with you know, a source this week who's working in the industry who basically put it this way, you can get margin in four areas of the AI business. There's hardware and Nvidia is taking all of that. There's data centers so you have Azure and Amazon's AWS and Google Cloud taking all of that. There's AI model building where there's not really a margin especially which we see this week After Deep Seek has basically shown that we're going to be on a curve where these models will just get cheaper and cheaper to run. And if you're licensing them from an OpenAI, it'll get about as close to free or the energy that you need to run them as possible. And then there's applications and that's the ChatGPT and the replicas of the world that use this technology to build. And so basically the assessment is the biggest takeaway from this week is that if OpenAI thought it was running an API business or a model building business before this week, right now there's clarification. It's all about the applications, it's all about ChatGPT. Good news. It has the leading application and the AI application world, but it certainly shakes up the broader picture for the company. So, Ranj, I'm just gonna put it to you. I'm curious how you react to all that and where you think OpenAI is after this past week.
- [03:08]
Ranjan Roy
Well, my first reaction is I'm very glad that I. I've been ranting that LLMs will be commoditized for I think about a year and a half now. And now it seems to be the conventional WIS fact that we're starting the conversation here, saying that models will provide no margin versus the idea that actually that's where the like insane profits would be. That wisdom, I mean, that's completely flipped on his head now. It's almost the assumption after R1 and deepseek that that that there will be no economic incentives for. From the model side. It's interesting how you put it though, because remember OpenAI in the financial projections that leaked, I believe it was going to be 80 or almost 85% of the revenue was supposed to come from the application layer. The consumer subscription side versus Anthropic is actually one that gets even more concerning here because they were betting on the API layer, the model layer, the fact that people would pay them lots of money for access to the models directly. So even in this framework, it almost bodes worse for Anthropic than Open a OpenAI here.
- [04:23]
Big Technology Host
Yeah, I think that this was really vindication week for us on a couple of fronts. You sent the product is all that matters. And me whispering over the past couple weeks that Anthropic might be in bigger trouble than a lot of people are anticipating we'll cover. Dario Amodei had a really interesting post about this Deep Seek moment and we're going to cover that in a moment. But you know, it's interesting Because I'm actually leading my story off with the revenue numbers about how ChatGPT was supposed to always be the lead for OpenAI and not the API. But there's one thing I can't square with that. Like you would think that this would be total vindication for their strategy and like actually a good thing for them and maybe they might even eventually use different models within Chat GPT if we end up in this world where everything is commoditized, which is something I hadn't considered before but I'm going to mention in the story. But the surprising thing to me has been how flat footed OpenAI has been in their response to Deep Seek. Now obviously it's a moment that will probably shake you if you're a model builder because you've been not, let's say surpassed but you know, effectively equaled by an open source model coming out of China that is so much cheaper to run. And we talked about it last week that the big deal in this moment is not that that took less money to train and that's obviously under question, it's the fact that you can use the API for much cheaper. And I was speaking with a developer this week who said basically it's $60 per, I think million tokens to use the OpenAI 01 model and it's $2.19 to use the Deep Seek R1 model, both comparable reasoning models. And it even goes up to, let's say $10 if you're using an API provider that's going to make it a bit stable, but it's so much cheaper. And then you look at like what has OpenAI been doing these past couple days in terms of its messaging? And it's been terrible and they've been the ones that have been so good at the PR side of things. I'm just gonna talk a little bit about what Sam Altman has does. So first of all he says next phase of the Microsoft Open AI partnership is going to be better and much it's going to be much better than anyone is ready for. With some awkward selfie with him in Satya Nadella. Then he talks about addresses deep seek R1 directly. He says deepseek R1 is an impressive model, particularly around what they're able to deliver for the price will obviously deliver much better models. And it's also legitimately invigorating to have a new competitor. We will pull up some new releases and then he says looking forward to bringing you all AGI and beyond. I mean that to me reads as sort of Panic and shock from Altman and I wouldn't think it would be the case. If it is, as we're all agreeing, an application world at the end. What do you think?
- [07:02]
Ranjan Roy
Well, so separating it out from the application side, the most important part of his statement I think we should get into, because there's been a lot of controversy around it, is he makes sure to say and believe more compute is more important now than ever. I think that's the central question for the entire technology industry. It's underlying the entire Nvidia story. I mean, I've seen so many sell side analyst notes, you know, where the. Clearly there is a heavily invested interest in Nvidia and some cost into Nvidia, where people are just, you know, just, you know, hitting the bandwagon, saying this actually means there's going to be more compute than ever needed. And Sam saying it too, because this was the week, remember Stargate was the middle of last week. The idea that investing $500 billion would be required. And then SUDD Deep Sea comes along and the initial chatter is it's only 6 million. And then there's been plenty of reporting around. Originally the Chinese quant hedge fund, I think they, I saw some number in the FT, it was like had already had around like $1.2 billion in GPUs invested. And so basically, and we all know that the $6 million cost attributed to it was only on the inference side of R1. So overall it was not $6 million to actually create the R1 model, but overall it showed us it can definitely be done for significantly cheaper than 500 billion. And overall, the amount of the compute no longer means victory. And I think that is a fundamental shift that Sam Altman and OpenAI have gone so far down the road of those with the most compute will win. That's been Mark Zuckerberg's attitude. Even Satya Nadella has pushed this kind of thesis. So to me, no one is still everyone, the entire industry, at least out of Silicon Valley, is still trying to hold dear to this idea that the more compute you have, you will win.
- [09:12]
Big Technology Host
And so do you think that's why OpenAI has been so shaken this past week? Because basically they were going to have that compute advantage. And now, you know, maybe it doesn't matter as much. I mean, we're going to, obviously we're going to get into Jevons Paradox as we're required to. I mean, obviously this is a contractual thing. We're going to get into that. The Nvidia section and the Microsoft section. But like, let's focus on OpenAI for a minute. I mean, again, going back to our question here, if it's all about ChatGPT, and that is the leader, and they've shown that they've been able to innovate with things like Operator, which I think we're going to get your thoughts on in a moment, and ChatGPT voice mode, which is pretty cool. And they have. They've gone from, let's say, 100 million to 300 million weekly users of Chat GPT in, you know, in just a year, which is massive growth and shows that there's real promise for the app side of AI, even though I. I'd like it to be bigger. But anyway, that's a story for another day. So what, what's the big deal again, if, you know, this compute advantage or this compute lead doesn't make a big of a difference just as long as AI can surge forward.
- [10:24]
Ranjan Roy
Well, that's exactly why this is. Their reaction is so fascinating to me because I have definitely argued that OpenAI's greatest asset has actually been their product. Their product jobs, that ChatGPT, the UI behind it, the like, overall experience, their voice mode, incredible products. Operator, which I have played with a lot, I spent probably like 12 hours last weekend trying to use, is not a great product. It's an interesting product. It's not a great one yet, but. But they've had an advantage on the product side. So on one side, it's odd to me that they don't just kind of say, you know what, we're going to win on product and we're going to have great models behind it. But then you. It's kind of when you go back and remember, at their core, which Sam Altman has said many times, they're a research house that kind of accidentally walked their way into a business. And at that point, you can almost picture the ego side of it, the. The kind of like more competitive side that they don't want to lose that battle, they don't want to lose the actual foundation model creating who's going to get to AGI first. They care more about that then hitting their $340 billion valuation, which there was reporting that SoftBank will potentially invest in this week. 25 billion at a 340, I think. So they're still. I really believe Sam Altman cares more about having the better models getting to AGI faster than the business side, because this doesn't fundamentally change at least what's been reported around their business plan.
- [12:02]
Big Technology Host
Yeah. So let me See if I can do my best to sort of tie it up. Now that we're talking about it, I'm thinking it through. I think it's important for OpenAI to lead in models because if you lead in models you can dictate where the product goes. And honestly that's why, you know, everyone wants to be able to do that. And when you have open source in particular open source come and maybe not grab the lead, but basically show that it can play in your ballpark, then you're in trouble because open source is a sort of swarm of developers. It's Deep Seek that's going to build on Meta and Meta that's going to build on Deep Seek and all the other developers that are going to customize and push forward. And if they are, if open source is the one that leads over proprietary, you could end up seeing the product game potentially spin out of OpenAI's control. Just to throw out like a crazy example like let's say open source gets to AGI before for OpenAI does well, then you know, the products that are going to be built on that will be, you know, by definition better than the chat GPT. So if you're open AI, it's also like even if your model business is not going to be the breadwinner, really is incumbent upon you to be able to lead this race. And that's why, you know, you would. We're going to talk about Meta in a moment, but you would think that Meta is devastated by this moment because they've been, they've been sort of outflanked by Deep Seq. But it turns out like actually the strategy, you know, might be proving true.
- [13:28]
Ranjan Roy
Well, no, I think that this idea that a bigger model or better model means a better product is the underlying thesis or thought process of a lot of Silicon Valley. But again, I disagree with it. And let me get into Operator. So operator is OpenAI's new kind of like browser Take Computer Takeover browser. It has a built in browser but it can do things and take actions across the web for you. So I was doing a test, I've been, I'm working on a medical innovation fund as a nonprofit and I've been having to kind of go through a lot of medical research papers and I'll manually pull all the author's names into an airtable and then look up, you know, like LinkedIn profiles, Google Scholar, PubMed profiles. So it seems like a pretty straightforward. This whole world of agentic that we've been promised seems pretty straightforward. So I went to Operator and I paid the 200 bucks for ChatGPT Pro and I kind of, it is really cool. Like it's actually like you give it a prompt and you say here's a list of papers, go find the authors, put them into airtable. Then go to Google, search the author's name, find these links and paste the URLs back into airtable. Seemingly like not an overly complex thing, it worked two or three times really well and it was mesmerizing because you're literally watching it and it's a built in browser in the operator interface and like you're watching it do this and just click around and actually copy and paste links. So you start to see the promise. Then the most fascinating part was it got lost in airtable. Like it started just clicking on random things. You can almost see it just like losing its place and losing its flow and rhythm and just it completely broke. So then you take control. You can actually kind of like assume control back in the browser, try to redirect it. And I could not get it to work again. Or then it started copying in completely incorrect things like it just does not work even close to where the promise is. But you see where it could be going. But again this is the product they have released. Sora, very similar huge promise. We waited like a year and a half. Sora is available for I think all ChatGPT plus subscribers right now. I have not seen anyone posting cool demos or all those kind of things, so. So the last two products that they have launched have been pretty much flops. So I think that's why they, they are still working under the assumption that Operator, if the model development becomes so good then that's the only way this kind of like browser takeover behavior will work. So they're still betting that the model will solve everything.
- [16:23]
Big Technology Host
This is why you need better AI, don't you think? Like better models will make sure that Operator works better. And in fact they were asking Kevin Wheel, who's the head of product, what's coming next for OpenAI and what kind of moat does OpenAI have? He says we're about to launch some models that are meaningful, meaningfully ahead of the state of the art. And some people are speculating that's oh three or who knows, maybe we'll see GPT5 finally. So don't you think these two work in concert?
- [16:52]
Ranjan Roy
Yes. No, it's, it's tough because on one hand the the coolest part of the experience and again I'm going to give full credit, it was a really really fascinating. Kind of like, holy shit, this is the future moment. So I'm still going to give them credit on that. Just the way the entire overall UI and just experience of it, but still as you're using it, you're like, is this really the way I need to set this up? In reality, I could have written a PDF parser that did the same thing using AI and Claude. I do this stuff regularly. Extracted authors names done right, written some like this is. It was basically web scraping. So the web is such a messy thing that how many people are really going to derive value from this kind of tool? So it actually made me question like, is this the way. And I saw some posts as well around like could websites change the way they're structured so they're more open and easy for an agent to access? Maybe that starts to be an interesting thing. But the idea that we need a model that's so smart that it'll actually understand the first time how to use a pretty heavy tool like Airtable, I don't think we do need that. I think the way this, this whole battle will be built, like one will actually be around, you know, creating an airtable connector that's already just pre programmed and not LLM based to actually do this kind of work. So, so I don't think I, I still embarrassed that there we're going to see some such a smart model in the next few years that'll actually get the complexity and like of the entire web. I, I don't see that happening.
- [18:36]
Big Technology Host
It's one of the interesting things about looking at Deep Seek with its reasoning model is it will show you its chain of thought and you can actually see the model kind of struggle its way through trying to find exactly what you're intending with your prompt. And so like there was this concept of like, oh, the prompt engineer is going to be the new job. And it's already getting to the point where you don't need to write the best prompt because the models will sort of get to that point eventually. And I think that is sort of why being able to watch that within deepseek's consumer app is the reason why it ended up going so crazy and taking over the top app spot above ChatGPT and the rest. And in fact I think that's probably like the biggest risk for OpenAI is like who cares if the model's a little better or a little cheaper? And we can argue about whether it was, but the fact that the Deep SE app went to the top of the app Store that to Me might be why they had such serious concerns. And before we, we move on, I do want to move on to what Dario from Anthropic said. Just want to talk about a couple things about the open AI business. First of all, no one paid attention to it this week, but there was a report that OpenAI has now made four times the amount of its nearest competitor on the Chat GPT app since it launched at 529 million. It's not a massive number, but this group called App Figures now estimates that the AI app market is $2 billion this year. And as things like operator get better, that's going to be even bigger, an even bigger number. So we're starting to see this AI app market materialize even again if it's not as big as I would want it to be. And then it sort of leads into this next part, which Ranjan, you've already brought up, which is that OpenAI is trying to raise again at a crazy number. They are in talks. This is according to the Wall street journal, to raise 40 billion in the funding round. That would value them as high as 300 billion. Yes, the 3,40 billion number was tossed out, but I guess they've come back to earth a little bit and now it's looking like 300 billion. I mean, late last year, OpenAI raised 6.6 billion at 157 billion valuation. And we said, right. What did we say when that came out? Oh, they're probably going to need to raise again at the end of the year, 2025. They're already raising in January.
- [20:51]
Ranjan Roy
Oh my God, I loved this. You couldn't give me enough news this week. But then Masa son had to come in and just push the idea of, instead of, you know, the world is like, is OpenAI finished? And he said, no, let's come in and add another 15 or 25 billion. Add, bring in 40 billion and pump this from up to 300 billion. But I mean, it's, it's amazing. It's, it's. There's not much you can rationally or analytically say about this. All you can do is just sit back and enjoy that. Masa is once again right in the center of things.
- [21:32]
Big Technology Host
I just found a great quote from Masa. I guess he said this last year he was talking about Gates and Zuckerberg. He says, those are one business guys. Bill Gates just started Microsoft and Mark Zuckerberg started Facebook. I am involved in a hundred businesses and I control the entire tech ecosystem. These are not my peers. The right comparison for Me is Napoleon or Genghis Khan or Emperor Quinn, who's the builder of the Great Wall of China. I am not a CEO. I am building an empire. What a guy I.
- [22:02]
Ranjan Roy
Is that from. So Lionel Barber, who was the editor in chief of the FT when I was there, he just came out with a book. It's called Gambling man the Secret Story of the World's Greatest Disruptor, Masayoshi Son. Is that where this. Because I saw this quote everywhere and I was trying to find, like, the actual where it was originally from.
- [22:22]
Big Technology Host
Yes, it's from that book.
- [22:24]
Ranjan Roy
Okay, I'm. I'm going to. I'm going to buy that right now. Lionel. I'm reading it. Yeah.
- [22:29]
Big Technology Host
One last thing. Can we put to bed this idea of the subprime AI crisis which we talked about last year? I'm very curious what you think about this. This idea that these companies had raised, you know, so many billions of dollars that startups were going to put their technology in their products and then they were going to depend on it, and then eventually those rates were going to have to go up and kill the startups and kill the entire AI world. It was a very interesting theory, but now that we. We've seen that rates will go down to just about zero to use this technology, do we still believe in subprime AI crisis?
- [23:02]
Ranjan Roy
So again, it was a really interesting theory from Ed Zitron. The idea that, yeah, startups that are building the costs will only escalate the actual input costs of these AI models. So they're subsidized now. At some point it'll catch up and it'll bring everyone down. That's why this is such an exciting moment. To me. That's the biggest news of the week. Separate from the financial markets and the considerations on what this means for Nvidia, everyone out there now has access to very good models cheaply. And that means that the product side, the application side, this is like Andreessen's time to build. Like, let's get out there. Everyone starts tinkering with everything and not having to worry about getting some inflated API bill. Like, this is it. This is going to happen and that this is going to keep happening. And now the entire industry is going to start thinking about not funneling all the investment dollars other than Masayoshi Son to the model builders. But to me, you can imagine there's going to be hundreds of new startups where capital will flow to that will actually be more on the application layer and actually solve problems and be interesting for regular business people. Or just regular people and not just OpenAI making a few products and us all being stuck with them. So that's why, I mean this to me was such a big week, aside from all the actual, I don't know, market and global geopolitical implications. But it just means this is where the world is going in the next year or two. And that's far more interesting to me.
- [24:41]
Big Technology Host
Yeah, when we let off our show last week, I was like, ranjan, what do you think about Deep Seek? And your immediate reaction not thinking was.
- [24:47]
Ranjan Roy
I love it, I still love it, I still love it.
- [24:50]
Big Technology Host
And what we're saying right now sort of plays perfectly into this piece that Dario Amodei, the CEO of Anthropic put out where he talks about on Deep Seek and export controls. He says, and this is sort of going to our point, the efficiency innovations DeepSeek developed will soon be applied by both US and Chinese labs to train multi billion dollar models. These will perform better than the multi billion dollar models than they were previously planning to train, but they'll still spend multi billions. The number will continue going up until we reach AI that is smarter than almost all humans at almost all things, which I think he breaks is coming in a couple of years. I think his post was excellent and it also is like I kept reading posts by like Dario Amodei and Andrew Ng and Yann Lecun and I was just like, oh yeah, like this is real and it's going to spread into the other models, basically making models that are much, much cheaper to run, which should spur that, you know, spark of building. And, and the only thing is like you just said, this might not be good for the proprietary builders. So I was interested to see it in Dario's post. What do you think's going on here?
- [26:01]
Ranjan Roy
Reading the post and again it was like a very good in terms of him talking about the what the actual like genuine innovation from the, from deepseek side around their models were and recognizing there was genuine innovation happening. But the push on export controls, I think, I mean, and I'm curious your thoughts on this. It's, it's, it's such a difficult question because on one side is it going to be enough the fact that Deep Seek open source this and I mean literally it's on AWS now and like it's not some like only in China thing. It's not that kind of like bifurcated world of only like the west versus China. It's more integrated than that and it did it to me. One of the interesting Parts is and again plenty of debate around what the actual GPU count is for the quant hedge fund that you know, spun this out. But overall it does feel like or there's been plenty of arguments for the idea that because of export restrictions it almost forced the additional innovation and efficiency like because they still did not have unfettered access to the Nvidia state of the art chips that they had to, they had to innovate around it. Which is really interesting on already. But what does that mean about how we approach this? And especially of all people anthropic, a model builder whose entire financial forecast is predicated on selling models like to kind of lean into. This is a national security thing and I'm always, I'm very been pro ban TikTok and in other areas really cognizant of the, you know, like national security implications of a lot of this. I am curious like they've already shown us it's not effective anyways. So I don't know. I think it was a little self serving.
- [28:02]
Big Technology Host
Oh definitely. And this is like gonna go to like the practical theory of how CEOs act which is in their own self interest.
- [28:09]
Ranjan Roy
Yeah, fair.
- [28:10]
Big Technology Host
You know, it's like very interesting to like see everybody on X reacting to what Dario's saying by saying like this is an unprecedented level of cope and he's just trying to hamstring, you know, the Chinese companies now that they've, you know, released a reasoned model and he doesn't have one and he's just upset about this like as if you're supposed to do anything else as a CEO then try to look out for your your own interests. I don't think it looks good for him, but I don't think it really matters.
- [28:36]
Ranjan Roy
Well Dario, I can just beg you now that we all have access to cheaper models, can you please make Claude the paid subscription level not hit my rate limit when I'm halfway through a project because it's one of the most frustrating things.
- [28:52]
Big Technology Host
So there's going to be some problems there. Maybe they're just going to try to sell themselves now that I guess acquisitions are legal again in America.
- [29:01]
Ranjan Roy
Yes, that's a, that's actually a. I mean back on the political side it. I think the whole changed M and A environment actually is really worth watching with a lot of these companies because there was kind of this assumption, I mean over the last couple years that especially once you're hitting these like many billions of dollars in valuation that M and A is essentially off the table. So that that'll be pretty interesting, but also, I mean and we haven't even mentioned Google in all of this. Google has been making some pretty big strides, at least on the model building side, even on the application layer side. So you then you start to get into which company really needs an Anthropic again. Claude's a great product, but at what price?
- [29:46]
Big Technology Host
Yeah, I mean maybe it'll be a capitulation sale to Amazon, but even Amazon is in good shape this week after deepsea had put Deep Seek in its product and Andy Jesse bragged about it. There's plenty to talk about it later, but we're talking about now. It just, you know, it took a week and it's there and I think all in a, in a minute it is the best model in aws and that's going to lead to more building through aws. So I think that they're probably doing jumping jacks over at AWS hq.
- [30:14]
Ranjan Roy
Yeah, remember we had the theory that Amazon was going to Amazonify this whole space by like bringing you into the AWS ecosystem, offering you the fancy expensive models. Like actually they were going to Deep Seek with their Amazon Nova, their new foundation model suite, which was supposed to be winning on cost. That was kind of our thesis anyways, that they were going to just bring you in, let you use the high price stuff and then give you the Amazon Basics version. And now they got Deep Seek already, so. So I think they have actually played this pretty well then if they haven't invested and just kind of been sitting to the side.
- [30:55]
Big Technology Host
Definitely. And just it's telling that it was Jassy that was out there tweeting about it yesterday. It clear it's clearly important to the, to the company. All right, one last thing on Anthropic. This is from Hugging Face co founder Tom Wolf. He says if both Deep Seek and Anthropic models had been closed source, yes, the arms race interpretation could have made sense. But having one of the models freely available for download and with detailed scientific report renders the whole closed source arms race competition argument with artificial intelligence unconvincing, in my opinion. Here's the thing. Open source knows no border, both in its usage and its creation. And I think that like to just put a point on the first half of this conversation, it is. This has just been the week where it's been the open source week. And good for open source, good for the companies that benefit from open source, like let's say the metas and the Anthrop and the, and the Amazons. Bad for the proprietary Model builders. And it brings us right into the Meta thing, actually, which is like a lot of this commotion over Deep Seek was began when there was a screenshot passed around of like a blind post saying Meta engineers had been freaking out about the fact that Deep Sea had surpassed their open source models. And there's like now reporting that top executives within Meta are worried that the next iteration of Llama won't perform as well as Deep Seek. But ultimately I think that as they digested it, people like Jan Lecun who's going to be on the show in a couple of weeks, and Mark Zuckerberg were basically like, yep, it's going to be open source. We will take what they did and put it into our models and we're going to ultimately, you know, be in the right place, which is that we're going to help develop AI that's available to all. It's going to be on our terms as long as we can keep our lead. Right? That's the big question. And then we're going to benefit.
- [32:52]
Ranjan Roy
Well, this is one thing I've not been fully clear because like, if we're talking about does the value accrue to the model layer or the application layer, Meta is in a position where they should probably be able to do some pretty amazing things. At the application layer one, you have distribution that absolutely no other company or nothing in the history of mankind has had in terms of your billions of users that you can push products onto. And Meta AI obviously already, I mean image generation, it's fun to play with in the Ray Bans. It works incredibly well. Even the real time language translation is getting pretty good. So getting good products in front of people at that point I do wonder why do they care so much about having the winning model? Because in reality they can build it with Deep Seq if they want. I mean, they're building it with Llama right now, but. But what the massive incentive is. Originally I remember thinking like it was all done in an awesomely like, you know, in an amazing way to undercut the OpenAI's and the all the other paid players. But I, it's, I'm still a little bit confused on that.
- [34:11]
Big Technology Host
I mean, I do think, like I said earlier, that everybody wants to dictate how this goes so they kind of have an idea of where it's going and they can lead like the product development and have people that are developing on their tools and making it better as opposed to somebody else's. You really want to be in the pole position there, but it's again, it's not the end of the world for meta if Deep Seek just kicks their butt and they're like, all right, well we'll just put this into messenger and maybe people will use our chatbots that which I don't think they use right now. Even though they're talking about how they want the billion user assistant. I don't think anybody is. Maybe some people. But top of mind the fact that like meta has an assistant, it's still not really competing with ChatGPT as far as I can tell.
- [34:52]
Ranjan Roy
I actually, I use it for like quick fun image generation with my son. Like just because it's right there in WhatsApp search. Like I actually, I'm convinced that probably a large percentage of their AI assistant usage because it's built into the search bar essentially is people accidentally trying to search for something and ending up using meta AI. But it's actually, it's good. I mean it's not. I've never spoken with anyone who's using it as a more dedicated chatbot or chat assistant. Like most, most of us use ChatGPT and Claude and others. But if for like quick one off questions, it's, I feel it's again the distribution side of it. It's right there in the apps that people are in all day long anyways, it sits in terms of pole position. I think it's, it's definitely has an advantage.
- [35:45]
Big Technology Host
Yeah. And it's just going to get better over time as, as let's say the, you know, let's say these open source models do achieve AGI. Right. To just go with the crazy example. Well, you can then deliver that to a billion users and you don't have to rely on OpenAI to do that or billions of users for that matter. There's, there's still a lot of let's, you know, what if though on this front and let's quickly talk about this Jevons paradox thing. So this was Satya Nadella's reaction to it. He says as AI becomes more efficient and accessible, its adoption will soar, transforming it into an indispensable commodity. I think we mostly share his opinion on that. I think you definitely do, Rajan. But my only question is if AI gets exponentially cheaper, you know, then will we see an exponential rise in applications? Because on the application side like we have ChatGPT, we have these metabots, then we have some stuff in enterprise software like Salesforce's agents and then of course there's coding applications. But after that, for as powerful of a Technology that AI is, I don't know if we've seen the applications that I would anticipate.
- [36:49]
Ranjan Roy
Well, let's start with. So Jevons paradox is not actually a paradox where it's not a logical contradiction, it's just kind of, it was a bit counterintuitive at the time. So that's been frustrating me I think more than anything because it's just completely sounds like one of those things that people have been using because it sounds smart, but we're still going to have to talk about it. And it's the idea because everyone is. And again, to me it actually is intuitive. As any kind of resource becomes more efficient and accessible, it'll actually grow in overall aggregate demand and output because people will figure out more uses. And I mean, I think at the core this is it. This is what we've been saying and this is now the thousands of startups building interesting apps on top of it. And finally the promises that we've been made for so long and have not been realized will be realized because people will actually pay attention to building cool experiences and products using AI. It's not just Microsoft's of the world and OpenAI's of the world and only a few and then others trying to build stuff but being really limited based on, you know, the actual cost input side of it. So I think it is real. It's like the idea that AI is going to become much more deeply integrated into everything we do in a good way, I think is going to be real and this makes it a lot more real.
- [38:18]
Big Technology Host
So do you think that this is unfairly punishing Nvidia or do you think it makes sense because there's been more uncertainty that's been added in. Like we were. The AI industry was moving on. Like I don't know if a linear path is the right way to put it, but on a path and now the path sort of changed directions, I think.
- [38:36]
Ranjan Roy
Yeah, I definitely think it's fair. The biggest change is for the last two years the Nvidia story has been ironclad. Like, and every earnings report, the every growth, I mean, so the valuation just becomes richer and richer and the overall market cap grows and grows. But no one could question it. There was absolutely no doubt. I do think again the Nvidia story has fundamentally changed. And I'd mentioned this before, but it's almost fascinating to me when you remember, think about that $3 trillion market cap, how much money is tied into this company because every sell side analyst report, just the emails left and right like Everything is show. Everyone is just like this means nothing. The story's still great because the amount of just vested interest in this company right now means that people are going to fight for it. People are going to fight to make sure the story doesn't go away. But it was always a story and they were realizing it pretty well. But now there's at least a seed of doubt that was not there in the last few years that at a certain point, do we need better and better chips? Is that where the battle's going to be won? Because then there's no competition. Do we need more and more compute? And even if the world needs more compute, do they need the latest Nvidia chips to realize actual utility and applications? Maybe not. There's at least a little bit of doubt. So I think the recovery here over the last few days is warranted. That, you know, it was a pretty sharp sell off for a company that size, but I did. So the invincibility of Nvidia for me is gone.
- [40:20]
Big Technology Host
There's still so many unknowns, right? A lot of this is based off of things that should happen, right? Like because this, because Deep SEQ was able to develop with like lesser chips, then if you actually put those innovations and you use the better chips and use more of them, then they should deliver better innovation. But this is all based off of hypotheses, right? Not like a rule, just a hypothesis. Like it's not a law. And so I, yeah, I totally understand why people would be a little wary about Nvidia. And when you trade a company like that, you trade probabilities. So did the uncertainty sort of change, change the probability that they would dominate? Yeah, maybe a little bit. By the way, breaking news. This is from Tech Meme. They, they're quoting wired sources say OpenAI plans to release O3 mini today with 0301 level reasoning and 4O level speed. As the company staff is galvanized by Deep seeks success. So it's game on.
- [41:12]
Ranjan Roy
I guess it's game on. But just make Operator a little better before you do that. Guys. That is like, I mean it still, it still baffles me. And I say this again because I'm not an AI researcher. I am just a technology person that's using all these different apps and technologies, like building some stuff. But like, like why are they so focused? Like they release Sora with so much fanfare, it's basically useless for the vast majority of the world in its current incarnation, Operator, huge release, not really usable enough. People show some demos and there's endless Twitter threads of like 10, like amazing ways you can use Operator. But in reality, no one is using Operator today in an actual, like day to day way that helps their work. So I just rather than focus on making that stuff good and being so caught up in the model battle, it feels like to me that if that mentality never changes, that $300 billion valuation looks even richer.
- [42:27]
Big Technology Host
But you're underestimating pride here. You know, there is a level of pride that's involved and that's probably what's happening. So. Okay, let's quickly hit some of the misconceptions about Deep Seek. We can just go through this real quick. We talked about last week the, it was a misconception. We talked about last week that, you know, they said that they trained just for 5 million. I think we can both agree now that they trained for a lot more. And 5 million was just their last training run or even though it's impressive for a training run, it doesn't fully incorporate the cost. So we should definitely note that.
- [42:59]
Ranjan Roy
Yeah, no, no, I think it seems to be like everyone is accepted. It's not 5 or 6 million. It's something more. But it's still not 500 billion or 100 billion or it's not, it's not at that scale. And I think that that still means that the story is, is very important. And then also again, even amidst the export controls and then you get into, did they circumvent them, when did they circumvent them, what chips exactly did they get and did they build on? But whatever it is, it was not some super cluster of the most advanced upto date chips. And so it still reminds us that kind of, that necessity breeds innovation or whatever the quote is, is still definitely part of this, part of this story.
- [43:47]
Big Technology Host
Yeah, And I said this on cnbc, like it's not the process as much as it is the output. And the fact that they were able to run reasoning at such a cheaper cost is the thing that matters most. And people can complain about the way they did it, they can complain about the fact that they're talking about a different number of chips. But ultimately, like the process has galvanized. I mean, the output has galvanized Silicon Valley. Like you're hearing from Altman and Amade, and that's the bottom line. The other, the other thing that's been interesting has been the anger, it seems like from Microsoft and OpenAI where, and from others where it seems like OpenAI had that deep seq, had effectively copied some of the stuff that they were doing or, like, maybe taken their data. This is from Bloomberg Microsoft probing if Deep Seq Link group improperly obtained OpenAI data. Microsoft and OpenAI are investigating whether data output from OpenAI's technology was obtained in an unauthorized matter. Microsoft security reachers in the fall observed individuals they believe may be linked to Deep Seek exfiltrating a large amount of Data using the OpenAI Application Programming Interface, or API. This led us to a, I think, quite funny headline at 404 Media, OpenAI furious Deepseek might have stolen all the data that OpenAI stole from us. Ranjan, you're pretty good at, like, sort of assessing, like, when it's fair for tech companies to take content and when, you know, it's all right to rip it off or rip other people's products off. Is this like a sort of nefarious move from Deep Seek, or is this like somebody in a glass house throwing rocks?
- [45:27]
Ranjan Roy
I think glass house and rocks, especially OpenAI. So you have on one side the kind of like, I mean, certainly larger question that I've still predicted will be answered in some capacity around, like, individual artists work or, you know, creating in the style of specific artists, or certainly the New York Times lawsuit. But then even at scale, if we remember, OpenAI apparently had been scraping YouTube, like, at a large scale for their initial data sets. So I think. And the entire world seemed to have reacted in a pretty similar way, where obviously it's a bit rich from all companies, OpenAI kind of going down this route. I don't. I don't believe they had released any kind of official statement. So at least to their credit, these were off of kind of like just more like either leaks or just genuine reporting that they're looking into this or exploring it. But, yeah, I don't think anyone anywhere is going to have any sympathy for OpenAI in this matter.
- [46:35]
Big Technology Host
Yeah, I'm on the same page there. And it was like, it wasn't done through hacking, it was done through the API. So, like, I guess, cry me a river.
- [46:43]
Ranjan Roy
Yeah, I mean, it's the YouTube example perfectly, like, and it's big platform against big. Well, actually small platform against big platform in this case, but just using the actual available technology and probably breaking the terms of service a little bit and then using that to get started.
- [47:02]
Big Technology Host
Okay, so I want to take a break, but before we do, I should say that we have a discord now. So Ronjan and I had been talking about starting a discord as these stories had continued to break and there was more to talk about, and we were kind of curious what the audience was thinking throughout the week. So that Discord is now open. It is open to Big Technology paid subscribers. So if you go to bigtechnology.com, you can see there's a post that says let's talk Deep Seek, AI, et cetera on Big Technology's new Discord server. If you're a paid subscriber, you just scroll to the bottom, there's the invite link. If you're not, you could just sign up and then scroll to the bottom and there's the invite link. It's been kind of fun. We're just about wrapping day one, and there's been some really good conversation there already. Alex Damos, the security researcher, is in there telling us right now about how Deep Seek's security issues really are compared to all the hype. Like, what happens if you download Deep Seek? Are you in trouble? So thank you for the idea, Ranjan. It's been, it's been fun getting it off the ground and I hope listeners will join.
- [48:03]
Ranjan Roy
I actually learned, I think, more from just a few comments from Alex Stamos around what are the actual security concerns or considerations on Deep Seek than pretty much everything else I read this week. So, like actually at a very technical level, even on like having to myself look up what safe tensors are and other like really deeply technical terminology. So we're it's off to a good start today.
- [48:27]
Big Technology Host
Yeah, it's been cool getting it off the ground. And again, you could go if you want to join, just go to bigtechnology.com, click the let's talk deepseek AI etc on big technologies new discord server link and then join us. We'll see you over there. All right, take a break and when we come back, we're going to talk about how Siri's still terrible, or maybe it's even worse, and then briefly touch on Apple earnings and then we'll get out of here. So we'll see you right after the break.
- [48:53]
Ranjan Roy
Have you been feeling the effects of stress, burnout or anxiety at work? Workplace culture is changing, but we're not done yet. Listen to the Anxious Achiever podcast to rethink the relationship between your career and your mental health. Hear stories from psychologists, entrepreneurs, even athletes and celebrities. Learn how they balance success and ambition with staying mentally healthy and walk away with practical advice you can implement today. Get the Anxious Achiever wherever you find your podcasts.
- [49:25]
Big Technology Host
And we're back here on Big Technology Podcast Friday Edition. So we've talked about Deep Seek the entire episode so far, which I think is merited. But we're not going to let the week go away without talking about this great post by John Gruber on Daring Fireball titled Siri is super dumb and getting dumber. I mean the the long and short of it is that basically he had a friend who asked Siri won the super bowl, who won each super bowl And Siri got 34% of those right which is truly disastrous. And basically Gruber's point is Apple got this gift of generative AI. It put it into Siri and somehow it made Siri worse.
- [50:06]
Ranjan Roy
It definitely the summary notifications have been getting worse and worse or just realizing how much use how useless those have been getting is just becoming even more and more acute. In my day to day Genmoji were fun for a minute and I ranted a bit about this week. So I'm glad that even Gruber who is about as long time an Apple fanatic as it gets the fact that he is recognizing and ranting himself about how bad it is but it really calls into question where are they in all of this. The only thing though, I don't know. I'm curious do you think this is good for Apple this week reminding us that the entire direction of the AI industry is in question. So maybe them screwing up the first phase of this battle so badly actually means they'll be okay and they can start fresh.
- [51:02]
Big Technology Host
It's definitely the Galaxy brain take here. It was kind of interesting watching so the Apple earnings came in yesterday. They sold less iPhones in this Q4 than they did in the year previously. So iPhone sales are going down. Apple intelligence is garbage and yet you look at what happened deepsea comes out actual AI innovation. There's panic and a sell off. Apple made Siri worse and is selling less iPhones and the stock is up 6% on the week. It really is amazing. I I don't know I I really it to me I'm a little bit puzzled at the the buying activity on Apple. I just don't see what the news is maybe services they beat on services revenue so that's pretty impressive. But we talked about it that when Apple intelligence came out it wasn't going to lead to a super cycle. It hasn't led to a super cycle and I think Mark Gurman put it well pretty pretty well today he said Apple intelligence is a half baked marketing strategy that was rushed in response to OpenAI and Google Gemini. Yet Apple had no choice. It is exactly the right thing but they shouldn't have Been in that position in a first. In the first place. So I guess like what the market is saying, you know, why it sent it up this week. Of course there's the services beat. But even after Deepsea came out and I just think it's a pretty simple thing which is just that you can build more with Deepseek and Apple has got to find a way to build consumer products and it can maybe use open source to do it, but I don't know, do we have faith Apple's going to do it? I don't.
- [52:36]
Ranjan Roy
Well, I was thinking because even that idea that the marketing drove the product side of it with Apple, which usually it's the other way around. To me the most fascinating part of this is, and I think a lot of companies, and Apple probably is the one most troubled by this is the kind of the dichotomy between normal everyday users and call it the industry. And by the industry I mean the actual, the technology focused people working in the companies, the investors focused on the companies. There's such a distance between what any normal person wants or expects from AI and what these companies are pushing. And to me that, that that distance has actually been these kind of like the core part of Apple's errors in this that they're more focused on the market and probably their own competitors and even their own employees and what they're thinking about rather than what the everyday consumer is thinking about. Because again, I can promise you, no, most certainly non tech focused iPhone users were not clamoring for Apple intelligence. And I think even most technology advanced Apple users could easily install ChatGPT and whatever else on their iPhone and still be fully locked into the Apple ecosystem. So the idea that they needed to do this, I actually disagree with Mark Gurman that they had to do this. I think they could have still just sat back. The only reason they would have had to do it is for the market. And I mean apparently it's still kind of working. Apparently the average Apple investor has not actually tried to do a basic task with Siri, but it's still working.
- [54:27]
Big Technology Host
I guess I just want to end with this. I love the how it started, how it's going meme and I saw one come across my X timeline this week that just really sort of captured it all. How it started is the Think different campaign with these beautiful black and white images that can note like if you're an iPhone user, you're just kind of more artistic, iconoclastic, you have more taste. And then I've been in and okay. And then the Second image is how it's going, and it's. Imagine it Genmoji. And it is a sunny side up scrambled egg with hands and feet.
- [55:02]
Ranjan Roy
This is what people want. This is what they've been clamoring for and why they will spend it, will launch an entire new iPhone super cycle. The Sunny side Up egg with hands and feet.
- [55:16]
Big Technology Host
I mean, I've been in Miami for most of the week this past week, and these, I don't know if they're in New York yet, but these Genmoji billboards are everywhere and they're terrible. They really don't say anything. And if that's your AI play, Lord help you.
- [55:31]
Ranjan Roy
I saw some. Some posts around. Like, everything they've offered feels like something that Tim Cook is the only user of. Even notification summaries. Like, again, they're relatively useless and almost counterproductive, but I can see if you're Tim Cook, maybe they're kind of useful. I could see Tim Cook really being into Genmoji, just, he's just churning out, tossing out Genmoji left and right. I mean, someone's got to be using it.
- [56:03]
Big Technology Host
All right, well, I will make like a Genmoji as a big scrambled egg with one hand up and say, have a great weekend.
- [56:10]
Ranjan Roy
Have a good one.
- [56:11]
Big Technology Host
All right, everybody. Thank you, Ranjan, and thank you all for listening. We'll be back on Wednesday. Actually, I'm speaking with Nvidia Executive, so that'll be fun to air on Wednesday. And then Ronald and I will be back on Friday to break down the week's news. Thanks again for listening and we'll see you next time on Big Technology Podcast.