AppStories Podcast Summary: "An Apple Intelligence Wish List"

Release Date: January 19, 2025

In this episode of AppStories, hosts Federico Viticci and John Voorhees delve into the future of Apple's artificial intelligence (AI) initiatives. Titled "An Apple Intelligence Wish List," the discussion centers around their aspirations for Apple's AI developments, particularly focusing on enhancing Siri's capabilities, integrating AI more deeply into the Apple ecosystem, and improving productivity tools. Below is a detailed summary capturing the key points, insights, and conclusions from their conversation.

1. Introduction and Setting the Stage

The episode begins with a light-hearted exchange about cultural superstitions surrounding unlucky days. John shares, “In America you have Friday the 13th as your unlucky day, right? In Italy we do, we have Friday the 17th which is today because you.” Federico responds humorously, setting a friendly tone before transitioning into the main topic.

2. Enhancing Siri with Advanced AI Capabilities

The core of the discussion revolves around evolving Siri into a more conversational and intelligent assistant, akin to ChatGPT.

• Conversational Siri and Large Language Models (LLMs):

  Federico expresses his hope for a more conversational Siri in iOS 19, envisioning a Siri app that leverages a large language model for ongoing, natural language conversations:
  “I hope that in iOS 19 we are going to see a more conversational Siri in the sense of credible ChatGPT alternative in the form of a Siri app that lets you use a large language model to have ongoing, persistent conversations with Siri” (01:59).

  John concurs, emphasizing the necessity for Apple to catch up with competitors:
  “Apple has to do it. You look at ChatGPT... ChatGPT is consistently in the top five most downloaded free apps on the App Store.” (04:40).

• Current Limitations and Potential Enhancements:

  John highlights Siri's current shortcomings, such as inaccuracies in responses:
  “Just yesterday I asked Siri what. What's the weather going to be in two hours? And instead of telling me what the weather was going to be in two hours, it told me what the weather was going to be at 2pm” (03:39).

  They discuss the challenge Apple faces in matching the functionality of existing LLMs like ChatGPT, Gemini, and Claude, noting Apple's current AI is about two years behind the competition.

3. Multiple Models and Integration with Apple Ecosystem

The hosts explore the possibility of Apple deploying multiple LLMs tailored for different tasks and devices.

• Variety of Models:

  Federico speculates on Apple's strategy for LLM deployment:
  “I think they're going to do multiple models, they're just not going to tell you about it because I think because it'll be simpler, it's a marketing thing” (07:29).

  John adds that smaller models could operate locally on devices, while more powerful ones rely on cloud computing:
  “A 1 point, 1.5 gigabyte model, the mini model is stored offline on your phone... the bigger ones, it goes out to private cloud compute” (07:50).

• Deep Integration with Apps and Data:

  John emphasizes Apple's advantage in integrating AI with its proprietary ecosystem:
  “Apple Intelligence as a whole has access to your apps, to data from your apps... something that a Siri large language model could do.” (06:21).

  This integration would allow Siri to interact with applications like Reminders, Apple Notes, and Obsidian, providing a more seamless and context-aware user experience.

4. Research, Writing Tools, and Productivity Enhancements

The conversation shifts to how advanced AI can revolutionize productivity and multitasking within the Apple ecosystem.

• Dedicated Research and Writing Tools:

  John envisions AI-driven tools that assist in research and content creation:
  “I want to see a dedicated research and writing tool integration... multisessional add documents and audio...” (09:43).

  Federico shares his experience using ChatGPT for research, highlighting the efficiency AI can bring:
  “I was using ChatGPT for that and it was perfect for that because then I could get the links and I would just go straight to the Apple tech specs to confirm that it wasn't making anything up.” (14:18).

• AI-Assisted Multitasking:

  John discusses the potential for AI to manage workspaces and automate repetitive tasks:
  “Allow me to spend less time managing my files, renaming files or organizing them in folders, allow me to use a larger language model to... assemble a workspace for me.” (16:10).

  Federico adds that AI could help in arranging screens and managing workflows more efficiently:
  “I think that AI can help... arrange that screen exactly the way you want it and then tell your Siri AI this is the way I want to work...” (23:15).

5. Developer Tools and API Integration

The duo underscores the importance of providing robust tools for developers to integrate Apple's AI capabilities into third-party applications.

• Siri LLM API:

  John raises the need for an API to allow developers to harness Siri's LLM:
  “Is there going to be a Siri LLM API... a native API for apps to handle processing of data.” (25:25).

  Federico suggests expanding current frameworks like App Intents to better support AI integrations:
  “Just like look at how many iOS apps you see that have a ChatGPT integration that maybe lets you rephrase text...” (26:00).

• Expanding App Intents and Shortcuts:

  Discussion includes enhancing App Intents and Shortcuts to support more actions and triggers, facilitating the creation of complex automations and AI-driven functionalities within apps.

6. Enhancements to the Photos App

The hosts express their desire for Apple to incorporate more advanced AI features into the Photos app, building on existing capabilities.

• Advanced Editing and Organization:

  John hopes for features inspired by tools like Pixelmator:
  “I really want to see what Apple does with those apps that they now own this year... super resolution features...” (27:19).

  Federico emphasizes improving tagging and automating photo management:
  “Maybe expand how tagging works, different kinds of automation to take kind of the tedium out of managing a photo library.” (28:22).

7. Future Outlook and Apple's Potential

Concluding the episode, Federico and John reflect on Apple's position in the AI landscape and its potential to innovate beyond current offerings.

• Apple's Unique Position:

  John believes Apple has the opportunity to surpass competitors by leveraging its control over hardware and software:
  “Apple, Google is actually Apple's main competitor in this space... Apple owns the platform, they own the ecosystem.” (16:10).

  Federico adds optimism about Apple's ability to integrate AI more deeply and innovatively:
  “I think it's time especially and I think Apple is particularly well poised to break free from the chatbot.” (28:22).

• Long-Term Vision:

  Both hosts agree that the advancements in Apple’s AI will be an ongoing discussion for years, anticipating significant developments by 2026 and beyond.

Notable Quotes

• Federico Viticci:

  • “I hope that in iOS 19 we are going to see a more conversational Siri in the sense of credible ChatGPT alternative...” (01:59)
  • “Just imagine being able to create an agent that... mark it as important... rename it with the current day.” (19:50)

• John Voorhees:

  • “Apple has to do it. You look at ChatGPT... ChatGPT is consistently in the top five most downloaded free apps on the App Store.” (04:40)
  • “Apple Intelligence... access to your apps, to data from your apps... something that a Siri large language model could do.” (06:21)

Conclusion

In "An Apple Intelligence Wish List," Federico Viticci and John Voorhees articulate a visionary outlook for Apple's AI future. They emphasize the need for a more sophisticated, conversational Siri, deeper integration of AI within the Apple ecosystem, enhanced productivity tools, and robust support for developers. The hosts are optimistic about Apple's potential to not only catch up with but also surpass current AI offerings through innovative features and seamless integration across its devices and services. As AI continues to evolve, Apple is poised to play a pivotal role in shaping the user experience on its platforms.

For more insights and updates, listeners are encouraged to join Club MacStories at club@macstories.net and explore additional content through their subscription service.

Timestamp Reference:

• [01:59] - Federico discusses iOS 19 and conversational Siri.
• [03:39] - John highlights Siri's current limitations.
• [04:40] - John emphasizes the necessity for Apple to enhance Siri.
• [06:21] - John talks about Apple's access to apps and data.
• [07:29] - Federico speculates on multiple Siri LLMs.
• [07:50] - John discusses local and cloud-based models.
• [09:43] - John envisions research and writing tool integration.
• [14:18] - Federico shares using ChatGPT for research.
• [16:10] - John discusses AI-assisted multitasking.
• [19:50] - John elaborates on creating AI agents with Shortcuts.
• [23:15] - Federico talks about arranging workflows with AI.
• [25:25] - John raises questions about Siri LLM API.
• [26:00] - Federico suggests expanding App Intents for AI.
• [27:19] - John hopes for advanced AI features in Photos.
• [28:22] - Federico and John discuss AI's role in photo management.