Big Technology Podcast: Is Generative AI Plateauing?, Booming Blue Sky, Apple’s Smart Glasses Play

Host: Alex Kantrowitz
Guest: Ranjan Roy of Margins
Release Date: November 15, 2024

Introduction

In this Friday Edition of the Big Technology Podcast, host Alex Kantrowitz delves deep into the current landscape of generative AI, the surge of the Blue Sky social network, and Apple’s foray into smart glasses. Joined by Ranjan Roy of Margins, the episode navigates through heated debates, emerging trends, and practical applications shaping the tech industry today.

Is Generative AI Plateauing?

A significant portion of the discussion centers around the pressing question: Is Generative AI plateauing? The conversation ignites with concerns that the training methods propelling generative AI might be hitting diminishing returns.

Key Points:

• Scaling Laws and Their Implications: Ranjan expresses optimism regarding the current state of AI models, emphasizing the untapped potential in productizing existing technologies. He states, “There’s so much work to be done… translating that into helping you do your job better” ([04:32]).

• Concerns Over Model Improvements: Alex counters by highlighting reports suggesting that advancements in foundational models like OpenAI's upcoming Orion are yielding smaller performance gains despite increased computational resources. He references statements from industry leaders like Ilya Suspect and Ben Horowitz, underscoring a potential slowdown in AI progress ([05:36]).

• Business Implications: The conversation touches upon the financial aspects, noting OpenAI’s recent $6 billion VC round. Ranjan critiques the focus on R&D over operationalization, suggesting it might hinder long-term industry growth ([08:45]).

• Shift to Practical Applications and Reasoning Models: Alex introduces the concept of reasoning in AI models, where models like OpenAI's Orion can "think" more deeply before responding, potentially bridging the plateau ([12:04]). Ranjan agrees, pointing out that targeted synthetic data and reasoning models like those developed by Writer.com represent promising directions ([15:20]).

Notable Quotes:

• Ranjan Roy: “I think what’s going to happen with this is… building tools people use rather than just saying AGI and GPT 5” ([05:36]).
• Alex Kantrowitz: “The number of people using ChatGPT and artificial intelligence products is soaring. The rate of improvement… is slowing down” ([03:57]).

Booming Blue Sky: A Sustainable Alternative?

The episode transitions to the rise of Blue Sky, a new social network that has recently surged to 15 million users, partly due to a mass exodus from Twitter/X.

Key Points:

• User Retention and Growth: Ranjan observes that Blue Sky is attracting a significant number of previous Twitter users, particularly those engaged in detailed discussions on topics like economics and tech ([45:31]).

• Comparisons to Twitter and Threads: While some critics, like Max Reed, argue that Blue Sky resembles a large Discord server with limited appeal, Ranjan counters by noting a diversification in content types, including sports highlights, which broadens its user base ([47:34]).

• Practical Challenges: Despite the growth, practical issues persist. Both Alex and Ranjan recount instances where Blue Sky lagged behind Twitter and Threads in delivering real-time information, such as during a recent fire in Hudson Yards ([48:31]).

Notable Quotes:

• Alex Kantrowitz: “Max Reed… says Blue Sky is acting more like a large Discord server… a flash in the pan” ([46:42]).
• Ranjan Roy: “The actual technology behind any of these apps is not that complicated. It’s purely about the content and the people involved” ([45:31]).

Apple’s Smart Glasses Play

Exploring Apple’s venture into smart glasses, the discussion highlights the company’s internal efforts and the broader implications for the AR/VR market.

Key Points:

• Apple’s Initiative “Atlas”: Alex reveals that Apple is conducting an internal study, code-named Atlas, to explore smart glasses, led by the Product Systems Quality Team within hardware engineering ([50:53]).

• Comparative Analysis with Competitors: Ranjan shares his experience with Snap Spectacles, praising their ease of use and potential for widespread adoption. He underscores the necessity for Apple to swiftly develop a competitive product to stay relevant ([51:47]).

• Market Expectations vs. Reality: Despite Apple’s reputation for innovation, Ranjan criticizes the Vision Pro as a flop, indicating a gap in delivering truly useful AR products. He emphasizes the importance of user-friendly design and functionality for mass adoption ([52:34]).

Notable Quotes:

• Alex Kantrowitz: “Apple is exploring a push into smart glasses… it’s very interesting to me that smart glasses are already becoming a thing” ([50:53]).
• Ranjan Roy: “This is the form factor of the future. This is like what we're going to all own some kind of glasses” ([51:47]).

Practical Applications of AI Today

Beyond generative models, the podcast sheds light on current real-world applications and their transformative impacts across various industries.

1. Rytr’s Fundraising Triumph:

   • Overview: Generative AI startup Rytr secured $200 million in funding at a $2 billion valuation by developing targeted foundation models for enterprise solutions.
   • Impact: Ranjan highlights how Rytr focuses on solving specific business problems, differentiating itself from more generalized AI providers ([27:29]).

2. Chegg’s Downfall Due to AI:

   • Overview: The Wall Street Journal reports that AI tools like ChatGPT have significantly disrupted Chegg, an online education giant, causing its stock to plummet by 99% from early 2021.
   • Implications: This serves as a stark example of how AI is reshaping industries, making traditional models obsolete ([30:11]).

3. AI in Ad Agencies:

   • Overview: AI-driven efficiency has forced ad agencies to reevaluate their billing models. With AI automating repetitive tasks, agencies are shifting from hourly billing to outcome-based pricing.
   • Future Outlook: Ranjan envisions this trend extending to other sectors like law and healthcare, revolutionizing traditional pricing structures ([34:19]).

Notable Quotes:

• Ranjan Roy: “We’re going to start to see some new pricing structures… something around outcomes” ([35:54]).
• Alex Kantrowitz: “Chegg stock is down 99%… it's already showing how standard AI has become in education” ([31:34]).

Conclusion: Building and Innovating Forward

As the episode wraps up, both hosts emphasize the critical need for ongoing innovation and practical application of existing AI technologies rather than solely chasing the next big model.

Key Takeaways:

• Focus on Practical Tools: Ranjan advocates for leveraging current AI capabilities to build tools that solve real-world problems, ensuring broader adoption and lasting impact.

• Emerging Technologies and Market Dynamics: The discussions on Blue Sky and Apple’s smart glasses illustrate the dynamic nature of the tech industry, where user engagement and practical functionality determine long-term success.

• Adaptation Across Industries: The stories of Rytr, Chegg, and ad agencies underscore AI’s pervasive influence, prompting industries to adapt swiftly or risk obsolescence.

Final Thoughts: Alex concludes by reiterating the importance of building and breaking through existing technological challenges to unlock AI’s full potential. The episode encapsulates a balanced view of optimism and realism, urging stakeholders to focus on meaningful applications while navigating the evolving tech landscape.

Selected Notable Quotes with Timestamps:

• Alex Kantrowitz [03:57]: “The number of people using ChatGPT and artificial intelligence products is soaring. The rate of improvement for basic building blocks underpinning these products is slowing down.”

• Ranjan Roy [05:36]: “There’s just so much work to be done… making it work as well as possible.”

• Alex Kantrowitz [12:04]: “OpenAI researcher says having the bot think for just 20 seconds in a hand of poker step by step got the same boosting performance as scaling up the model by a hundred thousand times.”

• Ranjan Roy [15:20]: “Using really targeted synthetic data for more targeted models is actually a really interesting space… incredibly promising.”

• Alex Kantrowitz [46:42]: “Max Reed… says Blue Sky is acting more like a large Discord server… a flash in the pan.”

• Ranjan Roy [51:47]: “This is the form factor of the future. This is like what we’re going to all own some kind of glasses.”

• Ranjan Roy [35:54]: “We’re going to change the way different industries price… something around outcomes, around the amount of compute that is consumed.”

• Alex Kantrowitz [36:23]: “It's time to build Ranjan, it's time to build.”

This comprehensive summary captures the essence of the episode, highlighting critical discussions on the current state and future trajectories of generative AI, social networks, and smart technology. By weaving in notable quotes with precise timestamps, listeners—or those who haven't tuned in—can grasp the depth and nuances of the conversations explored in this edition of the Big Technology Podcast.