Loading summary
A
Well, on the front of the Wall Street Journal today, this is how you know, this is the whole AI 2027 Washington waking up. The AI stories are making it to the front page, the world news section, not just the business and finance section. More and more. So the picture is about the heat wave, but the lead, the story with the largest text is about artificial intelligence. China resets the AI race with the United States as security models mark gains. We're going to get into it. This is a fascinating debate because I thought that we'd have a conclusion to the open source AI debate. By now either they would, the frontier would have collapsed and there would be perfect commoditization or they would have fallen.
B
It'll never be a conclusion. It'll just go, it's over. We're so back. It's over.
A
If you're in open source AI, that's exactly how it feels. The big story is centered around GLM 5.2 from Z AI. It was officially released June 13, so it's taken a couple weeks for it to really break through to the front page of the Wall Street Journal. But they're seeing some strong performance on benchmarks, some positive reviews from developers. I have a whole review from Tyler we can go through in a little bit. But we're now entering another round of debates around open source AI. What can the model actually do? Is this a threat to national security? What are the geograph geopolitical ramifications here? And so I'm sure this will be an ongoing conversation throughout this week, probably next week, we have some guests lined up to help contextualize it. But laying down the facts from the journal, Security researchers said that a new AI model released this month by China's Zhipu AI, also known as Z AI, can match the latest US models when it comes to finding security bugs. A development poised to reset the global tech race and pressure the White House in its overhaul of US AI policy. So unlike models from Anthropic or OpenAI, Zepu's GLM 5.2 is open weight. You can just download it, run it anywhere. You don't need to go to an API, you don't need to go to a private company and pay them. You can run it on your own server, provided you have the electricity and GPUs to do so. It is expensive to run as we'll go into, but it is open weight. That means it can be downloaded, run on hardware operated by anybody, and can be modified and used without supervision. Scary stuff. Open weight models are ideal for users who want unfettered access to systems they control, but they're also ideal for hackers who want to run them in the shadows.
B
Unfettered Intelligence.
A
Unfettered. Ooh, that's.
B
We were completely out of names for new neolabs.
A
That's a good Neolab name. Yeah.
B
Unfettered Intelligence.
A
Unfettered intelligence is good. GLM 5.2 has ranked as one of the top 10 most used AI models, according of data from OpenRouter, a company that provides access to more than 400 AI models. And what a fantastic business. Alex Atala over there, absolutely cooking it. Openrouter. It's such an exciting way to plug into the AI, the AI race without actually needing to play the. Play the benchmark game so much. Be the front door anyway in some benchmarking tests. According to cybersecurity company Semgrep, GLM 5.2 bested Anthropic's clawed Opus 4.8 model, which was released in May. When given Further instructions, Opus 4.8 and GLM 5.2 can match mythos in bug binding ability, according to researchers. So prior to this launch, and there's a chart that we should pull up here about overall AI capability, we can talk to Tyler about what this chart actually means, but there was this narrative brewing that open source AI was slowing down relative to the closed source frontier. And I saw a lot of American AI fans sort of cheer for this. Hey, we have the capital markets, we have the data centers, we have the research. And so we are able to push the frontier at a different rate. And if we're actually growing at a faster rate in America within the closed source labs, that will compound and there will be a stronger takeoff in the American closed source AI industry. Now, this chart sort of goes back and forth and there's some debate over it. It's in the newsletter. You can go sign up@tbpn.com while we're pulling that up. Let me tell you about Codex. Codex is a powerful workspace for getting work done with AI agents. Whether you're writing code, analyzing data, creat content, or automating business workflows, Codex helps you move projects forward from start to finish. This chart, which we can pull up, shows progress from GPT 4.0 to 0103 mini 03 opus 4 GPT 5.5.2 opus 4.6 GPT 5.4 GPT 5.5 showing a linear trend in this Elo, which is
B
a blend, says GLM 5.2. Sounds too much like a gray market peptide.
A
It actually does it does sound a lot like that. And then you can see the red line. Are the Chinese models which are also improving over time but at a slightly lower rate. And so the question was, are they going to plateau? While America's progress continues to advance this latest model, GLM 5.2, seems it's very hard to apply it to this particular benchmark because this ELO was. Can you give us some background Tyler, on where this chart came from, what this is demonstrating?
C
Yeah, so this is by Casey, I think that's how you pronounce it. The center for AI Standards and Innovation, they have this way to calculate like the ELO model. It's basically approximation of a bunch of different benchmarks. Some of those like are proprietary, like they're not open. So it's actually hard to run these also because I was basically trying to bench like all the recent models since this was published. It was, I want to say May 1st.
A
Yeah. It'd be great to throw 5.6 SOL myth and fable. It would be great to just continue this chart because it's an interesting trend.
C
So a lot of those benchmarks aren't actually public, so it's very hard to estimate. But I tried, I got. You can look at like some of the benchmarks that are public that you can reference. You can kind of match them up to previous models. 5.2 Looks like it is like a big step up from the like Chinese trend line. Right. I think the group of benchmarks that were chosen for this ELO definitely accentuate the gap between us and Chinese labs. I think there's a bunch of other like groups like Epoch AI has done a chart. They basically a relatively stable gap between closed source and open source models.
A
Yeah.
C
Since like 2023, like a long time.
A
Yeah. And perhaps at this point the, the discussions should be more centered around cost per task more than cost per token.
C
Yes, definitely. Because even like you know, new models a lot of times when they come out like, okay, maybe the token price is actually the exact same, but the token efficiency is much better than when you do a lot of these tasks. It's not the price per token, it's price per something completed and then you actually see it go down.
A
And there's a lot of test time scaling laws where you can just throw a million dollars of compute at a particular problem and all the models do really well at it. But it's completely non viable for any real enterprise use case and probably not even viable if you're trying to be a nefarious hacker or something.
C
Yes, Most people are saying like 5.2 is very token hungry.
A
Right.
C
So it uses a lot of tokens. So maybe it definitely is much cheaper than the Frontier models on a per token basis. On the per token basis.
A
But on the per task basis it might be more expensive.
C
Yeah, I mean that's still. It's generally not. But on specific tasks you can get, you know, if you have low thinking models, low thinking mode on the closed
A
source ones you can see well, let's revisit John Ludig's post from 2024 May 2024. This is pre Deepseek talking about he his prediction about why the future of foundation models is closed source. He got a lot of pushback from this because a lot of people like open source models. But he laid out a thesis around closed source data. Flywheels, exponential capex, intensivity of training. And he said open source will have a home wherever smaller, less capable and configurable models are needed. Enterprise workloads for example. But the bulk of the value creation and capture in AI will happen using frontier capabilities. The impulse to release open source models makes sense as a free marketing strategy and as a path to commoditize your complements. But open source model providers will lose the capital expenditure war as open source ROI continues to decline. And that was the thesis around the time that the open source AI discussion was primarily driven by Mark Zuckerberg's work at Meta on the Llama family of models. The idea was that Meta would benefit from attracting talent. It was good marketing. It told the story that Meta has an AI story and has AI talent in house, even if they weren't monetizing it and sharing, you know, a really fast takeoff in ARR around those models. It showed that hey, they're able to develop these models and that might help them cut their costs in the long term. Very interesting that that wound up being very different in 2026. Looking at the news today, which we'll go into about them spending a lot on ge, there's been reports about them spending a lot with other closed source frontier labs that they should have commoditized with their open source plan. But nonetheless that was the idea with Meta. But then China sort of woke up and the deep seats and deep seats launch at the start of 2025 and the game theory became way more complicated. So George Hotz sort of summed this up nicely. He has a take in AI will be massively deflationary. A post from just a few weeks ago as to why China benefits from investing in open source more than American firms. He says this explains why Chinese the Chinese are giving the much more moderate resources to train models away for free. They love to see deflationary economics in the US it is not, it is much less of a service based economy. And so if they can go and give away free tools that deflate the value of the service sector, that is an advantage to the Chinese economy, in his formulation. He says even if you don't regulatory capture the US government, nobody is getting a monopoly on AI. We don't live in a unipolar world anymore. And so he likens what's happening in D.C. to sort of rearranging deck chairs on the Titanic. It's a very fun, fun piece. So we're back to this discussion of what are the consequences and the impacts of open source models, particularly in the United States. And there's been this clip that's resurfacing from Dario Amadei when he was testifying in front of Congress in 2023. And it's now recirculating and it was reposted like he just said it and he did not. So be clear about that. This is from three years ago, but some of his predictions were very prescient as of where the frontier is today. So he said, I'm very concerned about where things are going. If we talk about two to three years for the frontier models for the biorisks, sort of a bad transcription of what he was saying. He's talking about 2025, 2026. Remember he was saying this in 2023. We're there now. I think the path that things are going in terms of the scaling of the open source models, I think it's going down a very dangerous path. And again, if the path continues, I think we could get to a very dangerous place. So he was worried about cybersecurity and bio risks being open sourced and then not having a counterweight to that. Now the good news is that we've Talked to the CEOs of cybersecurity firms like Crow and Palo Alto Networks, and they've been working with Mythos and GPT 5.5 Cyber for months now to harden systems from LLM driven attacks. And so there's still this gap between closed source and open source models. And that gap allows white hat hackers to implement fixes before black hat hackers have a chance to exploit easy bugs. There still will be a bigger discussion here though in DC over the next few months as the frontier models roll out and the gap doesn't appear to be widening at the moment. So security, security stances must adjust. It's not a closed source is falling behind. So it's never going to be an issue. There will be this gap and how the American cybersecurity industry and eventually the biosecurity industry implements changes and fixes before open source catches up or commoditizes and makes that particular capability widely available is going to continue to be important. So let's go over to Tyler's quick review of GLM 5.2. Why don't you take me through your bullet points and you can tell us like what is the shape of this model? How are the reviews?
C
Yeah, so I think so far one of the main things is like people are saying it's oh, it's distilled. Right. This has been a big thing with a lot of these open source models, especially Chinese ones. Oh, the only reason that they're good is because they're distilled. It's very hard to actually figure out how true this is. It certainly seems like there's some, you know, I think it aspects of anthropic models.
A
Didn't anthropic openly accuse Alibaba of distilling
C
a number of these labs?
A
Yeah, and there's also been a big like professionalization of the gray market where a whole bunch of different sort of individual groups will connect a whole bunch of different entities and users.
B
Subscriptions.
A
Subscriptions and APIs to then create a front end to like the model that can be served at a very high rate through a vpn. Most likely. What's interesting is that you'd think that if you were going to do a training run you would just find and replace on the other lab's name before you hit run. Is that not something people can do? I don't understand.
C
Yeah, I mean it also depends on what you're actually like. Maybe you're not directly distilling on the API, but you're turning on public GitHub repos and those were all used, those were all made with, with closed source models then you're kind of like distilling but it's not really like is this really count as distilling? I don't know. Yeah, but so if you are like, if you're convinced that these are like super distilled, the only reason that they're good is because they're just basically taking the closed sourced labs.
A
There's also this weird thing with distilling where as more and more of the public Internet and GitHub broadly and open source repos become LLM outputs. If you train on that, you are in some ways distilling because an LLM has a quirk like, it's not this, it's that in text. And you wind up training on a whole bunch of Amazon Kindle books, you're going to wind up learning it's not this, it's that. And the same thing applies for different code conventions in open source repos that have effectively been completely been rewritten by closed source models.
B
Yeah.
C
So I think it's safe to say that we've generally seen that distilled models generally will generalize worse.
A
Right.
C
So you'll see really good benchmark scores. Maybe they're benchmarks, maybe they're not. But even if they're not like directly benchmarks, you still find that they generally.
A
Yeah, they're kind of accidentally benchmaxing.
C
Yeah, yeah. So you should always. So I think initially you should just be a little bit suspicious of these super high benchmark scores.
A
Yeah. But they lack that big model. Je ne sais quoi.
C
Yeah. And this is like anecdotally reinforced. A bunch of people been saying, you know, for coding, these models are really great glm. It's a very good model for creative writing or something like this, where you'd imagine it's a bit harder to kind of benchmax this.
A
I wonder, have people been testing it with the Tiananmen Square bench? Does it reject that stuff? Because it felt like that was something that was widely misunderstood by American audiences. That in fact that might not be the biggest deal for the ccp.
C
Yeah. Also I think, you know, even if that's true, like the model is open source, you can kind of just fine tune it to like, sure. Not maybe it's a bit harder than that, but I think you can kind of get around like that kind of stuff.
A
Okay.
C
Yeah.
A
So we talked about the token hunger and the API price and in general, I mean, you said, I'm not convinced that there's a big market for this class of model, especially as frontier models get more efficient. If you look at OpenRouter, the most used models are the smallest open source models presumably being used for specific tasks that need to be repeated over and over again.
C
Yes. I think like what we've seen is a marginal IQ point of the models is like extremely expensive. Frontier models are getting very expensive. People have to cut back. They're token maxing. This is like massive bill on their balance sheet or whatever. It seems like there's now basically like two classes of models that people really use. There's like the frontier ones and they're using coding agents. They need the best thing. If you're doing cyber, you just need the best model because the risk of someone hacking you, it's so great. You just need the best thing. You pay whatever it is. And then there's the second class which is these very small, very fast, very cheap models that you can use for these kind of point solution things. Maybe you have some orchestration where using a really big model to have these little agents using these very cheap models. I think in the middle it's hard to actually figure out what is the real use case. Maybe it's like hobbyists using these coding agents and they don't want to pay the super expensive tokens of the closed source labs. You see this on open router where like what are the top models by token like usage? It's these very small models. It's like deep SEQ Flash.
A
Yeah, you're spamming them for like, you know, every receipt that goes into ramp gets processed by an LLM. At this point, does it need to be a frontier model telling me that I spent $10 on a coffee? No, it can just do standard OCR.
B
That'd be my preference.
A
Yeah, you want super intelligence overseeing your expenses most likely. But no, you use the right tool for the job and that's clearly what's happening on.
C
But also I think like it is a very good model. Right. Like we should not fully dismiss, I think the idea that, oh, the gap is widening. We really don't have to worry about these models. I think they are like very good.
A
Yeah, yeah, yeah.
C
And maybe if you're super worried about distillation, maybe something changes if the mod are kept to these big partners. Like what we've seen recently with government coming in. But I think we can't really fully dismiss these labs.
A
Yeah, it throws a little bit of a wrench in the monetization potential. Like how long can you monetize a new frontier model? That's more tricky. And then the other one is just like if you're going to keep a model behind KYC or behind an approval for specific companies, like the government has been sort of edging towards and moving towards. It gets a little bit tricky if all of a sudden you just wait three months and oh, I was waiting to get approved for this one for like GPT7 or whatever, but by the time the government got back to me, my company got access to GLM6 and it's close enough. And so that, that just throws another wrench that I Think the government will have to figure out how it puzzles together with the rest of the strategy, which has been. Yeah, back and forth as always.
B
Google caps matters. Gemini use as AI demand strains capacity in the financial times, surging appetite for advanced models is turning computing power into the tech industries scarcest commodity. And they have a picture here of a Google Gemini bicycle which looks fantastic.
A
What does that have to do with Meta though?
B
I think that was just the best Google Gemini picture. Google has put limits on Meta's use of its Gemini AI models after the social media giant sought more computing capacity than the rival tech group could provide. In the latest evidence of the infrastructure constraints facing even the world's largest AI providers, Google told Meta around March that it could not provide all of the Gemini capacity the company wanted to purchase, according to three people familiar with the matter, in a move that has disrupted and delayed some of Meta's internal AI projects. So I don't know, how much should we. Yeah, yeah, so, so one Google spent
A
$200 billion on CapEx.
B
Okay, so, so, so of course like around this time, token maxing was becoming a thing. A lot of every company in the world, at least every tech company in the world, kind of going a little bit crazy from a spending standpoint. You know, I could see Meta going and like wanting to basically buy a bunch of capacity and then being told like, hey, we can't fulfill that. But I'm, I'm wondering, is it worth reading?
A
I mean it sounds extremely bullish for Google, like if they're asking.
B
And this tracks with what they talk about on earnings calls. Yeah, yeah, yeah.
A
Google cloud.
B
But acceleration, you do have to wonder like, could distillation be, be part of this, this story is, is that, could that be a factor here? I've, I have no idea.
A
Zero Hedge said Meta puts limits on Claude and Kodak sphering distillation the information.
B
But, but, but, so this story is different. This is Meta telling its own employees don't use Claude and Codex in certain parts and certain parts of our business because we don't want, we don't want to accidentally do distillation is what matter is saying. So that's, that's different. I was wondering like, is Google thinking like, whoa, that's a lot of, you know, yeah, cool it, you know. Owing to the restrictions which remain in place, as well as the broader push to streamline AI costs, Meta has encouraged staff to be more efficient with AI tokens. Several other Google clients have been affected by the restrictions, although to a lesser extent Meta has been particularly impacted because of its exceptionally high demand for Google's models.
A
Interesting.
B
Very interesting. On the topic of meta Meta Shared this morning, what they do a new milestone. It is a mind reader. Mind reader non invasive brain detects decoder research brain to QWERTY v2 building on v1, which was published today in Nature Brain 2, QWERTY v2 is the highest performing end to end pipeline capable of real time sentence decoding from raw brain signals. It advances beyond character level performance to decoding words and semantics, enabling accuracy for overall communication. So if you thought Instagram was listening to you, if you thought it was listening to your conversations, now you can have a new conspiracy at home, which is that they might be just listening to your thoughts.
A
Do you know the device? They say this is a non invasive device. I just shared an image of this device and I want you to tell me, do you consider this non invasive or invasive? Look at this image of the Magneto Encelaf graphy device.
B
No, you got to go. You need to scroll up a little bit because you can't even see the whole thing here.
C
It's not invasive because it looks like
B
the device could actually potentially carry on for like a whole half of the.
A
It really does seem like it's a. Just put yourself in this, in this room sized device. No, of course this will shrink up.
B
I'm giving him credit here. Non invasive, non invasive.
C
Okay.
B
As long as he.
A
You're putting this thing on, you're daily driving this thing.
B
I don't know if I'm ready to daily. I don't know if I'm ready to daily it. This will be a cool demo. Like this will actually, when you can just walk in, sit down in a chair and see your thoughts on a screen.
A
No, we were debating earlier. My buddy Rob Taft's been on the show twice, dropped five predictions in Forbes recently. We can go through them. At some point he's gonna come on the show. But four of the five were very, very like reasonable. You know, anthropic's gonna be bigger and TSMC is gonna face more competition. And then he predicts that in 2030, telepathy will be commonplace, which is a very aggressive prediction in my estimation. How Terry Semel fumbled Yahoo's Facebook deal. How much is Facebook worth? 5 billion? 10 billion? 15 billion? Whatever the number, it's probably a lot more than the 1 billion that Yahoo could have bought it for a year ago. As Yahoo continues its soul searching, here's an unpleasant rendition of Semel's catastrophic decision, courtesy of Wired. When Yahoo came Calling with a bid of $1 billion in cash. The pressure became too much. Zuck relented. In July of 2006, he was just like 18 months into building the company, something like that, verbally agreeing to sell Facebook to Yahoo. He said yes. He said he was going to sell Facebook to Yahoo, allegedly. Strategically, it seemed like a good match. Yahoo had hundreds of millions of users, but its foray into social networking was struggling. Facebook had cool tools and was looking for a mass audience. The timing, however, could not have been worse. In the days after Zuckerberg agreed to sell, Yahoo announced it was projecting slower sales and earnings growth and that the launch of its new advertising platform would be delayed. Its stock price tumbled 22% overnight. Terry Semel, Yahoo's CEO at the time, reacted by cutting his offer from 1 billion to 800 million. He just took 20% off. But Zuckerberg, who had been warned about Semel's reputation for last minute renegotiations, walked away. And that's probably reasonable. I mean, if they're cutting the price there, you have to imagine that as it gets papered, you get cut down again, then the earn out, you get cut down again, and all of a sudden you're walking away with barely anything. But two months later, Semel reissued the original $1 billion bid. But by then, Zuckerberg had convinced his board and executive team that Yahoo wasn't a serious partner and that Facebook would be worth more on its own. He rejected the offer and became famous as the cocky youngster who turned down $1 billion from Wired.
B
Legendary.
A
Legendary. It's so interesting to imagine the road not traveled there because the, the dynamic, the way Facebook is built as a social network, like could it have been successful under Yahoo's stewardship, or would it have been less exciting, attract less talent, ultimately been disrupted? And would they have had the capital and the guts to go and buy WhatsApp and then also buy Instagram, you know, to actually maintain the dominant position in social networking. What do you.
B
I think Yahoo should make another offer. I would like to see Yahoo make another bid.
A
Hey, Meta's trading down just keeps going. If it continues at this trend, 99.99%
B
might be able to pick up at this trend anyway. Chip makers are profiting off AI at the expense of just about everyone.
A
This is on the COVID of the business and finance section.
B
Today we are witnessing an extraordinary transfer of cash from the providers of AI and perhaps one day AI users to memory chip makers. Take us away, John.
A
Yeah. The explosive growth in Micron Technologies, profit in the latest quarter is extraordinarily good news for its shareholders, but it comes at the expense of the artificial intelligence companies to which it sells fast memory chips. Micron, along with the Korea with Korea's Samsung Electronics and SAM and SK Hynix, are to AI what oil producers are to the airlines, makers of an essential input that this year suddenly became much more pricey because there is extremely limited capacity to make the high bandwidth memory that AI needs and it takes years to build production facilities. Soaring data center demand simply jacked up prices. Micron soaring profits are for its customers soaring costs we are witnessing an enormous transfer of cash, they said. Profits shift of this scale are rare events and investors should be paying attention to where the money's coming from, where it's being spent and how long it will keep flowing. In the quarter ended May 28, Micron increased prices for DRAM chips more than 60% on the previous three months, while increasing shipments by a low single digit percentage, it said last week, prices for NAND flash memory, also used in data centers, jumped more than 80%. Usually memory doesn't matter that much, but for Micron, customers paid $18 billion more. And that was just in the quarter. Prices quadrupled in a year and it's hurting outside AI too. Apple last week raised prices for MacBooks more than 15%. Closer to home for me, the memory I bought on Amazon.com a year ago to build a super quiet computer. I hate fan noise. Good color commentary here. Has tripled in price and now costs more than the cpu. For an industry in which prices usually drop every year, it's a huge turnaround in consumer electronics. Passing on higher prices helps limit demand for chips, just as higher oil prices reduce consumption. But the AI companies aren't passing on higher prices because they are able to throw money at supply problems. The problem in AI is that the end users aren't covering the cost of the service. With big losses being recorded by AI model producers, everything is still priced to bring in new customers, yet not yet to make money. So higher input costs create a nasty problem. Either losses will either be bigger or higher prices will be needed, putting off potential customers. And you can see the price of Micron's stock price has been through the roof as the company joins the one trillion dollar club.
B
Tyler, how many trillion dollar companies are there in Europe?
C
Out of curiosity, I'm going to go with zero.
B
That's true.
A
NBCUniversal and sky will separate the company's connectivity business from its film theme park and streaming operations. Oh yeah, Universal Studios Comcast plans to separate its media and connectivity business, building
B
the anderil of theme parks.
A
It does seem like a.
B
Could there not be an opportunity to create a net new theme park business with. With a modern technology stack?
A
It's very expensive. Everything needs to be like the modern technology stack in theme parks is expensive.
B
You don't believe in the theme park capital markets?
A
I don't know. I've known people that have worked on theme parks at Disney and it's tricky because you have to amortize a ride over like 20 years and so you'll go.
B
It seems like an absolutely brutal business. That is probably harder today because at the time that a lot of these parks were built, you didn't have infinite online entertainment for every single sub niche instantly available.
A
I mean, there's a whole bunch of trend pieces right now about how IRL experiences are seeing higher than ever pricing in the face of. You could just watch the Knicks game on TikTok highlights, but people still forked over $5,000 to go see the game. And so, you know, you have that like, barbell strategy where Thrive is buying a stake in the San Francisco Giants, a baseball team that should face competition.
B
The NBA team. Yeah, to Vegas. But at the same time, there is maybe an opportunity that came out. There's more sports betting volume than all sales of movie tickets, theaters, theme park parks and like a couple other these IRL categories.
A
Up or down,
B
lower, less, like. And the stat was like volume. And so it's not exactly like a proxy for like revenue, but still meaningful. Chamath raised $135 million Series A for 8090. They got sales, they got Salesforce ventures, they got Wonderco, they got Craft and they got launch.
A
It's the besties.
B
They got the besties.
A
They got the besties together.
B
You think Friedberg's got to be in.
A
That's the production board.
B
Oh, the production board, yeah.
A
Friedberg's fine.
B
Great.
A
So, yeah, you actually have all three of the other besties. And we will see you tomorrow. Goodbye.
TBPN Diet: "Open Source vs. Closed Source, Memory Chips Eat AI Profits, Comcast Restructures"
Hosts: John Coogan & Jordi Hays
Date: June 29, 2026
Episode Runtime: ~30 minutes
This episode dives into the rapidly evolving debate between open source and closed source AI models, the surging cost of memory chips (and their impact on AI industry profit margins), and a key restructuring at Comcast. John and Jordi, joined by recurring guest Tyler, dissect hot news from the Wall Street Journal and the Financial Times, offer sharp commentary on Meta’s AI strategy, debate the economics of foundation models, and close with a lively aside on theme parks and sports betting.
The Big Story:
Capabilities & Concerns:
Benchmarks & The ELO Score:
Cost per Task vs. Cost per Token:
Deflationary Tactics & Geopolitics:
Security Impact:
“If the path continues, I think we could get to a very dangerous place.” (A quoting Amodei, 11:09)
Distillation Debate:
Practical Utility:
Quote:
“Does it need to be a frontier model telling me I spent $10 on a coffee? No, it can just do standard OCR.” (A: 17:12)
“You use the right tool for the job and that’s clearly what’s happening.” (A: 17:29)
Google’s AI Supply Limits:
Meta Internally Restricts AI Model Use:
Non-Invasive Mindreading:
2030 Telepathy Prediction:
Micron, Samsung, SK Hynix Profits Surge:
Europe’s Trillion-Dollar Company Count:
“How many trillion-dollar companies are there in Europe?” (B: 29:16)
“Zero.” (C: 29:19)
Comcast Restructuring:
Modern Theme Parks & IRL Experiences:
On Open Source AI Progress:
“If you’re in open source AI, that’s exactly how it feels. ‘It’s over. We’re so back. It’s over.’” — Jordi (B: 00:49)
On the Shift to Open Weight Models:
“Open weight models are ideal for unfettered access… but also for hackers who want to run them in the shadows.” — John (A: 01:39)
Benchmarks & Distillation:
“Distilled models generally will generalize worse… You should always be a little bit suspicious of these super high benchmark scores.” — Tyler (C: 14:40)
On Meta’s Missed Sale to Yahoo:
“He rejected the offer and became famous as the cocky youngster who turned down $1 billion.” — John (A: 25:29)
On Theme Parks:
“Could there not be an opportunity to create a net new theme park business with a modern technology stack?” — Jordi (B: 29:39)
“Everything needs to be like the modern technology stack in theme parks—it’s expensive.” — John (A: 29:52)
John, Jordi, and Tyler blend sharp analysis with humor and skepticism (“Unfettered Intelligence”—would-be AI lab name, 02:34), challenging industry cliches and adding perspective to core tech news cycles. The consensus: the frontier between open and closed source AI remains dynamic, with cost, risk, and regulatory responses all in flux. The practical market fit for AI is at the extremes—massive, costly models for mission-critical work, tiny efficient models for repetitive tasks—with consolidation among infrastructure providers threatening to squeeze AI startups. Meanwhile, the biggest profits are flowing to chip makers, not AI model providers. Add in mind-reading demos and sports betting economics for a quintessentially TBPN flavor.
This summary captures the most salient content from the episode—key data, opinion, and debate—with references and memorable quotes to anchor each major segment.