Techmeme Ride Home - Friday, December 27, 2024

Host: Brian McCullough
Podcast: Techmeme Ride Home
Duration: 15 minutes
Episode Title: A New “Definition” Of AGI
Release Date: December 27, 2024

1. Microsoft and OpenAI's For-Profit Transition Challenges

Timestamp: 00:04 - 07:07

Brian McCullough opens the episode by delving into the ongoing negotiations between Microsoft and OpenAI regarding OpenAI's transition to a for-profit entity. The core issues revolve around Microsoft's equity stake, continued revenue sharing, and the exclusivity of Microsoft as OpenAI's cloud provider.

• Equity and Revenue Sharing:
  “They’re trying to work out details like the use of OpenAI's IP, the continued collection of 20% of OpenAI's revenue, and more.”
  (00:04)

• Negotiation Focus Areas:
  The discussions have been centered on four main areas:

  • Microsoft’s equity stake in the new for-profit OpenAI.
  • Maintaining Microsoft as the exclusive cloud provider.
  • Duration of Microsoft’s rights to use OpenAI’s intellectual property.
  • Continuation of Microsoft's 20% revenue share from OpenAI.

• OpenAI’s Growth and Future Projections:
  OpenAI is experiencing rapid growth, projecting revenues to reach approximately $4 billion in 2024 and scaling up to $100 billion by 2029, primarily driven by ChatGPT.

• Investor Implications:
  If OpenAI fails to finalize the transition within two years, investors from the recent capital raise stand to reclaim their investments with added interest, totaling around $7.2 billion.

2. A New Definition of Artificial General Intelligence (AGI)

Timestamp: 07:07 - 12:54

McCullough reveals a significant development: a previously undisclosed 2023 agreement between Microsoft and OpenAI that redefines AGI based on financial metrics.

• Redefining AGI:
  “For OpenAI and Microsoft, AGI has a very specific definition, the point when OpenAI develops AI systems that can generate at least $100 billion in profits.”
  (07:07)
  This financial threshold signifies the moment AGI is achieved, potentially altering the partnership dynamics between OpenAI and Microsoft.

• Implications of the New AGI Definition:
  Once this milestone is reached, Microsoft may lose the rights to utilize OpenAI’s technology, ending their exclusive collaboration.

• Sam Altman's Perspective:
  OpenAI CEO Sam Altman has nuanced views on AGI, considering it akin to a median human coworker and suggesting its impact may be less monumental than traditionally thought.
  “AGI is basically the equivalent of a median human that you could hire as a co-worker,”
  “My guess is we will hit AGI sooner than most people in the world think and it will matter much less.”
  (07:07)

• Future of AGI and Super Intelligence:
  Altman emphasizes that superintelligent AI, which can tackle significant global challenges like curing diseases and space colonization, remains the true end goal.

3. Emerging AI Models: Deepseek V3

Timestamp: 07:07 - 12:54

McCullough transitions to discussing Deepseek V3, a new AI model from Chinese company Deepseek, highlighting its significant advancements and open-source availability.

• Deepseek V3’s Achievements:
  “They claim it outperforms top models like GPT4O,”
  “Deepseek V3 is open source, so that’s also notable.”
  (07:12)

• Technical Specifications:

  • Parameters: 67,071 billion total with 37 billion activated per token.
  • Efficiency: Trained using innovative methods reducing costs drastically.
    “Completed Deep Seq V3's entire training in about 2,788K H800 GPU hours, or about $5.57 million,”
    (07:12)
  • Comparison to Other Models:
    In contrast to Llama 3.1’s $500 million training cost, Deepseek V3 achieved superior performance with significantly less investment.

• Industry Impact and Open Source Benefits:
  Deepseek V3’s open-source nature fosters competition and reduces monopolistic tendencies in the AI industry.
  “The work shows that open source is closing in on closed source models, promising nearly equivalent performance across different tasks.”
  (07:12)

• Accessibility and Pricing:
  The model is accessible via GitHub under an MIT license, with commercial API access available at competitive pricing.

4. Weekend Long Read Suggestions: Industry Insights

Timestamp: 12:54 - 21:15

Brian presents a curated selection of in-depth articles covering various tech and societal trends.

a. The Video Game Industry’s Crisis

• Financial Struggles and Industry Shifts:
  The New York Times explores the declining returns on investing in high-fidelity graphics in video games, using Sony's “Marvel's Spider-Man 2” as a case study, which had a development cost of around $300 million.
  “Cinematic games are getting so expensive and time consuming to make that the video game industry has started to acknowledge that investing in graphics is providing diminishing financial returns.”
  (13:59)

• Changing Consumer Preferences:
  Former Square Enix executive Jacob Novak notes a shift towards games like Minecraft and Roblox, which prioritize gameplay over graphics.
  “What does my seven-year-old son play? Minecraft? Roblox? Fortnite?”
  (13:59)

b. The Rise and Fall of the Hoktua Meme

• Viral Memes and Personal Branding:
  An Atlantic piece recounts Hayley Welsh’s experience with the Hoktua meme, highlighting the challenges of viral fame and monetization.
  “A friend persuaded her to come out of her room only because other people were profiting off of her selling bootleg merch...”
  (13:59)

c. The Death of the Paper Passport

• Technological Advancements in Travel Security:
  Wired discusses the global movement towards passport-free travel, with countries like Singapore leading trials that link passport information directly to smartphones for seamless verification.
  “Information historically stored in your passport's NFC chip, including facial data, is instead stored digitally and linked to your phone.”
  (13:59)

• Security Concerns and AI Scams:
  The episode also touches on the rise of AI-driven scams, such as voice and video cloning, emphasizing the need for family passphrases to verify identities during emergencies.
  “You should consider doing this too, no matter what your situation.”
  (13:59)

5. Sponsored Segments and Advertisements

Timestamp: 07:07 - 21:15

The episode includes sponsored content promoting the Washington Post and Shopify, emphasizing their respective offerings:

• Washington Post Subscription:
  Encourages listeners to subscribe for comprehensive news coverage, including an audio feature for on-the-go updates.

• Shopify Promotion:
  Highlights Shopify’s robust e-commerce solutions, including enhanced checkout experiences and conversion-boosting features.

6. Personal Stories and Safety Tips

Timestamp: 12:54 - 21:15

Brian shares a personal anecdote about implementing family passphrases to combat AI-driven scams, reinforcing the importance of security measures in the digital age.

• Family Passphrase Implementation:
  “We did this this week because the family was all together and we could collectively decide on a password we'd all remember...”
  (12:54)

• Advice on Creating Secure Passphrases:
  Recommendations include avoiding easily guessable information and using unique, memorable phrases.
  “Consider anything that you or your loved ones post online as data available to scammers...”
  (12:54)

• Emergency Verification Methods:
  Suggests using secondary verification steps, such as confirming a shared passphrase via a secure method, to prevent fraudulent requests.
  “If you receive a call from a nephew who says they are in an accident and need money... you can say cool 100%. I can help you. I just texted you a word.”
  (12:54)

7. Closing and Additional Promotions

Timestamp: 21:15 - End

The episode concludes with a final advertisement encouraging donations to Doctors Without Borders, highlighting ways to maximize charitable impact through various donation methods.

• Call to Action for Donations:
  “Together, we go further explore ways to give@doctorswithoutborders.org.”
  (21:15)

Key Takeaways:

• Microsoft and OpenAI are negotiating the terms of OpenAI’s transition to a for-profit model, with significant implications for their partnership and future revenue sharing.

• A new financial-based definition of AGI has been established, potentially altering the trajectory of OpenAI’s collaborations and technological deployments.

• Deepseek V3 emerges as a groundbreaking, cost-effective, and open-source AI model, challenging established players and democratizing AI advancements.

• The video game industry faces a fundamental shift as high-fidelity graphics investments yield diminishing returns, prompting a reevaluation of development priorities.

• Advancements in travel security are moving towards a passport-free future, leveraging digital technologies, while the rise of AI-driven scams underscores the necessity of robust personal security practices.

Notable Quotes:

• “For OpenAI and Microsoft, AGI has a very specific definition, the point when OpenAI develops AI systems that can generate at least $100 billion in profits.” — Brian McCullough (07:07)

• “AGI is basically the equivalent of a median human that you could hire as a co-worker.” — Sam Altman (07:07)

• “A friend persuaded her to come out of her room only because other people were profiting off of her selling bootleg merch...” — Jacob Novak (13:59)

• “You should consider doing this too, no matter what your situation.” — Brian McCullough (13:59)

This comprehensive summary encapsulates the critical discussions and insights from the episode, providing listeners and non-listeners alike with a thorough understanding of the latest developments in the tech world.