WavePod Logo

wavePod

← Back to The Creative Penn Podcast For Writers
Podcast cover

Producing AI-Narrated Audiobooks Using ElevenLabs With Simon Patrick

The Creative Penn Podcast For Writers

Published: Fri Jun 27 2025

Is the high cost of audiobook production holding you back? What if you could create a high-quality audiobook for a fraction of the traditional cost? In this conversation, Simon Patrick explores the world of AI narration with ElevenLabs,

Summary

Detailed Summary of "Producing AI-Narrated Audiobooks Using ElevenLabs With Simon Patrick"

Podcast Information:

  • Title: The Creative Penn Podcast For Writers
  • Host/Author: Joanna Penn
  • Description: Writing Craft and Creative Business
  • Episode: Producing AI-Narrated Audiobooks Using ElevenLabs With Simon Patrick
  • Release Date: June 27, 2025

Introduction

In Episode 816 of The Creative Penn Podcast For Writers, Joanna Penn delves into the realm of AI-narrated audiobooks with special guest Simon Patrick. The discussion centers around leveraging ElevenLabs' technology to produce high-quality audiobooks, contrasting the costs and benefits of human versus AI narration, and exploring the innovative features that make ElevenLabs a standout choice for authors.

Meet Simon Patrick

Timestamp: [02:36]

Simon Patrick, founder of 10 Times Better Books, joins Joanna Penn to share his journey into AI-audiobook narration. Motivated by the high costs of professional narrators and the limitations posed by platforms like Audible’s ACX, Simon sought a more affordable and flexible solution. His experience as one of ElevenLabs' early adopters and beta testers has positioned him as a knowledgeable advocate for AI-driven audiobook production.

Notable Quote:

Simon Patrick: "I honestly wanted to cry. I like, I genuinely get emotional about it even now. It’s just like I want us as authors, publishers, to put our time and energy into creating incredible stories and getting our words out into the world and just make everything around that as simple as possible, using tech where we can."
[12:22]

Why Choose ElevenLabs?

Timestamp: [06:58]

Simon highlights ElevenLabs as the most realistic and expressive AI narration platform available. Unlike other solutions, ElevenLabs offers a vast library of voices and complete creative control over the final audio files. This flexibility allows authors to produce audiobooks at a fraction of the cost of traditional narration without compromising on quality.

Key Points:

  • Expressiveness and Realism: ElevenLabs' AI voices are notably more natural and lifelike compared to alternatives like Amazon’s Virtual Voice (AVV).
  • Creative Control: Authors can choose from thousands of voices, assign different voices to characters, and download audio in formats suitable for various distribution channels.
  • Ownership: With a commercial license, authors retain full ownership of their audiobook files, enabling broader distribution beyond platforms like Audible.

Notable Quote:

Simon Patrick: "What I love about it is the complete creative control it gives me... I own what I've created with 11 Labs, it’s a commercial license, so I can put them into book funnels, audio delivery service. I can put them on my website."
[09:45]

Cost-Effectiveness of AI Narration

Timestamp: [05:53]

Simon contrasts the exorbitant costs of professional narrators, which can range from $3,000 to $7,000 per audiobook, with the affordability of AI narration using ElevenLabs. This significant cost reduction makes audiobooks accessible to indie authors and those with limited budgets, democratizing the audiobook market.

Notable Quote:

Simon Patrick: "The fact we can create well-narrated audiobooks for $100 to $200 plus a few days learning and production on each one is just incredible."
[11:05]

Practical Tips for Using ElevenLabs

Timestamp: [14:46]

Simon shares five essential tips for authors looking to utilize ElevenLabs for AI narration:

  1. Start with the Pro Package:

    • Tip: Invest in the $99/month Pro package to ensure high-quality audio output (192kbps), necessary for professional distribution.
    • Quote: "You need the pro package which is $99 a month because that is what outputs 192kbps."
      [15:05]

  2. Choose the Right Voice:

    • Tip: Spend time experimenting with different voices to find the one that best suits your book's tone and characters.
    • Quote: "Spend time choosing or making your voice... don't waste time and credits to generate it."
      [16:10]

  3. Avoid Getting Overwhelmed:

    • Tip: Approach the Studio tool with a mindset of directing your audiobook, allowing for creative control without feeling pressured.
    • Quote: "It's like you're directing an audiobook... have fun with it."
      [18:26]

  4. Allocate Time for Proofing:

    • Tip: Be prepared to spend two to three times the length of your audiobook on editing and refining to ensure quality.
    • Quote: "Be prepared to spend two or three times the length of the book proofing it, crafting it."
      [19:24]

  5. Wait for Version 3 for Fiction:

    • Tip: For fiction authors, it’s advisable to wait for ElevenLabs' Version 3, which offers enhanced expressiveness and emotion tagging.
    • Quote: "If you're doing fiction books, you should wait for version three to be available."
      [21:34]

Voice Cloning and Monetization

Timestamp: [30:17]

The conversation shifts to the intriguing topic of voice cloning. Simon discusses the ethical considerations and practical steps involved in licensing one’s voice for commercial use. He emphasizes the importance of high-quality recordings and provides tips for authors interested in monetizing their voice clones.

Key Points:

  • Quality Matters: Use a good microphone and a quiet environment to record clear and consistent voice samples.
  • Variation in Delivery: Vary tone and volume without adopting distinct character voices to maintain consistency.
  • Ethical Considerations: Decide whether to enable live moderation, which restricts the use of your voice in potentially harmful contexts.
  • Monetization Tips: Avoid sharing your public voice name to prevent unauthorized use and conduct thorough research before licensing.

Notable Quote:

Simon Patrick: "Deliver it consistently in terms of the voice you're using, but vary the delivery in terms of giving it all energy... the AI will pick up on all of that."
[32:00]

Introduction to Eleven Reader

Timestamp: [38:26]

Joanna introduces Eleven Reader, an emerging platform from ElevenLabs that allows authors to publish their audiobooks directly. This platform enables listeners to choose from various AI voices, enhancing the user experience by offering personalized narration options.

Key Points:

  • User Flexibility: Readers can select from multiple voices, tailoring the listening experience to their preferences.
  • Ease of Use: Authors can upload their EPUB files, and Eleven Reader handles the conversion and publication process.
  • Mainstream Adoption: High-profile publications, such as Melania Trump's memoir, are available on Eleven Reader, signaling the platform's growing acceptance.

Notable Quote:

Joanna Penn: "This is the future of publishing. You know, here's my AI voice clone and it's on 11 reader."
[40:15]

Conclusion and Future Offerings

Timestamp: [42:14]

As the episode wraps up, Simon shares his upcoming ventures, including courses and services aimed at helping authors harness AI tools for audiobook production. His endeavor, Novel Productions, seeks to empower authors by simplifying the technical aspects of AI narration, allowing them to focus on storytelling.

Key Points:

  • Educational Courses: "AI Audio for Authors" will cover platforms like ElevenLabs and guide authors through the entire AI narration process.
  • Services for Authors: Offering production assistance to create high-quality audiobooks.
  • Community Engagement: Encouraging authors to join his community for access to resources and support.

Notable Quote:

Simon Patrick: "We're stealing from you, Joe, in terms of the idea of being an AI-assisted art as an author production house."
[43:45]

Final Thoughts

Joanna Penn and Simon Patrick conclude the episode by emphasizing the transformative potential of AI in audiobook production. They encourage authors to explore these technologies to democratize access to high-quality audiobooks, ensuring that compelling stories reach a broader audience without prohibitive costs.

Notable Quote:

Joanna Penn: "Happy writing and I'll see you next time."
[45:08]

Key Takeaways

  • Affordability: AI narration with ElevenLabs offers a cost-effective alternative to professional narrators.
  • Quality and Control: ElevenLabs provides high-quality, expressive voices with extensive creative control.
  • Practical Guidance: Authors should invest in the Pro package, meticulously choose and refine voices, and allocate ample time for editing.
  • Ethical Voice Cloning: Voice licensing requires careful consideration of potential uses and ethical implications.
  • Emerging Platforms: Eleven Reader represents the future of flexible and user-driven audiobook publishing.

For more insights and resources on AI-narrated audiobooks, visit The Creative Penn or explore ElevenLabs at elevenlabs.io.

No transcript available.