BG2Pod Episode 20 Summary: AI Scaling Laws, DOGE, FSD 13, Trump Markets

Release Date: November 21, 2024

In Episode 20 of BG2Pod, hosts Brad Gerstner and Bill Gurley engage in a dynamic and insightful discussion covering a spectrum of contemporary topics, including AI scaling laws, advancements in autonomous driving technology, regulatory reforms under the Trump administration, and market projections for 2025. This summary delves into the key points, notable quotes, and overarching themes explored throughout the episode.

1. AI Scaling Laws and Industry Implications

Discussion Overview: The conversation opens with an exploration of AI scaling laws, focusing on whether current models are approaching their performance limits, especially in pre-training. The hosts reference a Bloomberg headline addressing struggles faced by major AI players like OpenAI, Google, and Anthropic in advancing their models.

Key Points:

• Empirical Nature of Scaling Laws: Dario emphasizes that scaling laws are not immutable "laws of the universe" but rather empirical observations that may not hold indefinitely. He states, “Scaling laws are not actually laws of the universe, but they are simply empirical regularities” ([02:42]).

• Potential Limitations: The discussion touches upon the concerns raised by industry leaders like Ilya and Andreessen Horowitz’s Mark and Ben about the sustainability of scaling laws. Dario adds, “There may be a disagreement between some people, but the breadth of the feedback suggests something's up.” ([04:10]).

• Vectors Beyond Pre-Training: Bill notes that while pre-training gains might be decelerating, other vectors such as post-training scaling, data quality, and inference-time reasoning continue to offer growth opportunities. He remarks, “When you scale up pre-training, a lot of the low hanging fruit was plucked.” ([07:42]).

Notable Quotes:

• Dario: “You don't have to [rely solely on pre-training]. We can disagree on this, but we can shift directions.” ([05:50]).

• Bill: “As we look at the aggregate at all these various vectors on which we're scaling intelligence on a combinatorial basis, it may be just as good or even better.” ([07:42]).

2. Developments in AI Technology: Memory, Actions, and FSD 13

Discussion Overview: The hosts transition to advancements in AI technology, particularly focusing on memory enhancements and the rollout of Tesla’s Full Self-Driving (FSD) 13.

Key Points:

• AI Memory Enhancements: Recent releases by Google Gemini and Microsoft’s Mustafa highlight significant strides in AI memory capabilities. Dario reflects, “The more memory one of these systems can have, the more useful it becomes to each individual.” ([14:32]).

• Tesla’s FSD 13: Bill provides an in-depth analysis of Tesla’s upcoming FSD 13, projecting it to achieve a milestone of 25,000 miles per critical disengagement, potentially reaching 500,000 miles by mid-next year. He explains, “If 2024 was the ChatGPT moment for full self-driving, next year really is the year of achievement of a safety standard that allows Robo Taxi to go into action.” ([17:15], [26:02]).

Notable Quotes:

• Bill: “We're talking about a multi-year undertaking, but I think it is a massive advantage.” ([36:21]).

• Dario: “There's a step that they need to take, and I think there's some natural learning that comes from that.” ([30:15]).

3. Regulatory Changes and Robotic Taxis

Discussion Overview: The episode delves into the Trump administration’s initiative to establish a national framework for regulating self-driving cars, shifting from a state-by-state approach.

Key Points:

• National Framework Proposal: The Trump administration aims to centralize the regulation of autonomous vehicles to streamline operations for companies like Tesla and Waymo. Bill states, “It's going to be beneficial to Tesla and Waymo and anybody else who's in the full self-driving game.” ([50:56]).

• Infrastructure and Liability Concerns: Dario raises questions about the necessary infrastructure for autonomous vehicles and the potential need for insurance reform to mitigate litigation risks. He comments, “They should think about liability limitations, especially on arbitrary jury awards.” ([39:37]).

• Ownership Models: The conversation explores different ownership models for robotic taxis, contrasting Waymo’s model of owning and operating the fleet with Tesla’s potential model of leveraging privately owned vehicles. Dario notes, “Who's going to own these vehicles?” ([34:25]).

Notable Quotes:

• Bill: “I think this is going to be a massive undertaking, but if you see it working in a few markets, I think we will.” ([36:21]).

• Dario: “Maybe the containers work on a rail yard. Right? Who owns these things? They move around, but someone owns them.” ([34:25]).

4. Government Efficiency and Policy Reforms

Discussion Overview: A significant portion of the episode is dedicated to discussing the Trump administration’s creation of the Department of Government Efficiency, driven by figures like Vivek and Elon Musk, aiming to reduce federal spending and regulatory burdens.

Key Points:

• Ambitious Reform Goals: Bill highlights the administration’s bold plans to abolish several government departments, citing Milton Friedman’s rapid-fire interview advocating for minimal government intervention. He mentions, “Department of Agriculture, abolish. Commerce, abolish. Education, abolish, gone.” ([42:16], [42:42]).

• Constitutional Considerations: The hosts discuss the potential constitutional challenges related to the Impoundment Control Act of 1974, which restricts the executive branch's ability to withhold funds appropriated by Congress. Bill explains, “If they can get Congress to cooperate, then there is no constitutional issue.” ([47:38]).

• Impact on Government Spending: Dario underscores the necessity of shrinking government size to manage the national deficit, arguing that improved efficiency could unleash economic growth. He states, “Improving efficiency can lead to a reduction in government and an acceleration of growth.” ([43:27], [47:38]).

Notable Quotes:

• Dario: “Transparency can be a hell of a disinfectant.” ([43:27]).

• Bill: “Once in a generation, reset in the balance of power between the individual and the state.” ([50:56]).

5. Market Insights and 2025 Outlook

Discussion Overview: Concluding the episode, Brad and Bill share their perspectives on the market landscape heading into 2025, considering both positive catalysts and potential headwinds.

Key Points:

• Positive Drivers:

  • Tax Cuts and Reduced Regulation: Anticipated tax reforms and deregulation are expected to stimulate economic growth.
  • Tech and Infrastructure Super Cycle: Continued momentum in the technology sector, bolstered by AI advancements, alongside infrastructure investments.
  • Corporate Earnings Growth: Companies like Snowflake and Microsoft have demonstrated substantial earnings growth, driven by AI efficiencies and margin expansion.

• Negative Factors:

  • Tariffs and Consumer Debt: Potential imposition of tariffs may negatively impact retailers, while rising auto delinquencies indicate consumer financial strain.
  • High Market Valuations: Elevated market multiples, with the S&P trading at around 24x and NASDAQ near 29x, suggest limited room for broad market gains.

• Investment Strategy:

  • Selective Stock Picking: Emphasis on identifying top-performing tech companies that benefit from AI-driven growth and margin improvements.
  • Avoiding Market Breadth Risks: Recognizing the likelihood of significant dispersion within the market, where a handful of companies outperform while others lag.

Notable Quotes:

• Bill: “If I had one takeaway, it’s that we’re seeing a deceleration in the rate of improvement on pre-training, but it doesn't necessarily matter to the consumption on the Nvidia side.” ([52:02]).

• Dario: “It makes sense to me that you're going to have enterprising young people leasing these cars.” ([37:22]).

Conclusion

Episode 20 of BG2Pod offers a comprehensive exploration of critical issues at the intersection of technology, regulation, and market dynamics. Brad Gerstner and Bill Gurley provide valuable insights into the evolving landscape of AI, the imminent advancements in autonomous driving, and the transformative potential of government efficiency reforms. Their forward-looking analysis underscores both opportunities and challenges that investors and industry stakeholders must navigate as we approach 2025.

Notable Final Quote:

• Bill: “The rate of change has never been higher in technology, and the rate of change of this election is massive.” ([61:27]).

Disclaimer: The views expressed in this summary are based on the podcast participants' opinions and are not to be construed as investment advice.