The Nathan Barry Show – Episode 120
"How I Helped Grow Diary of a CEO to 14M Subscribers" with Grace Miller
Date: March 19, 2026
Guest: Grace Miller, Head of Failure and Experimentation at Flight Story
Episode Overview
In this in-depth episode, Nathan Barry speaks with Grace Miller, the Head of Failure and Experimentation at Flight Story—the powerhouse behind "Diary of a CEO" and other hit shows. They dive into the real experiments (and failures) that fueled Diary of a CEO’s rapid growth to over 14 million YouTube subscribers. Grace shares actionable insights on channel strategy, leveraging YouTube features, designing experiments, building a culture that embraces failure, and the future of AI in the creator economy. This episode is a must-listen for creators seeking practical playbooks for audience building, retention, and working smarter on modern platforms.
Main Themes
- Experimentation as the engine of creator growth: real-world case studies from Flight Story.
- Scaling YouTube shows while maintaining quality and engagement.
- The value of embracing and learning from failure in creative teams.
- Leveraging YouTube (and social) features for audience and revenue growth.
- Building a high-performance, knowledge-sharing creator company culture.
- The rising impact of AI and localization on content reach.
Key Discussion Points & Insights
1. The Wild Growth of Diary of a CEO (04:09 – 05:16)
- Grace marks her four-year anniversary at DOAC, celebrating growth from 100k to over 14M subscribers.
- Flight Story now manages multiple podcasts—including Begin Again, Hot Smart Rich, and more, applying insights across diverse shows and formats.
“When I started four years ago, we were on 100,000 subscribers on YouTube and then now up till today, we're at over 14 million. So it has been insane growth…”
— Grace Miller (02:28)
2. Building and Testing Channel Strategy (05:16 – 10:30)
- Clips Experiments—Doubling output with DOAC Clips didn’t double views; instead, views per clip fell and the total channel views plateaued.
- Algorithmic learning: Posting multiple times a day can cannibalize placement in recommended feeds.
- Channel splitting: Large creators run several channels to separate content verticals—both for volume and distinct audience targeting.
“We thought, okay, if we put two [clips] out every day, we'll double views…It didn't double views. It actually decreased reach…”
— Grace Miller (05:27)
- Shorts Channel Dilemma—Tested both separate and combined shorts channels. Consolidating shorts and long-form onto one main channel now yields faster growth and smoother viewer funnels.
“We now fully believe on the same channel is the best way… The actual conversion funnel is so much smoother.”
— Grace Miller (12:27)
3. YouTube Features Underutilized by Creators (15:36 – 19:38)
- Posts (Community Tab): Heavily underused; great for engagement and cross-promotion on days with no new video content.
- Polls/Feedback Posts: Post interactive content and ask for viewer input and feedback, closing the audience-product loop.
- Chapters: YT’s 'Jump Ahead' feature and chapters allow for easier navigation, aid retention, and expose which segments are stickiest.
“I think posts people obviously are not even thinking about or maybe thought wasn’t very useful. But that is a big one.”
— Grace Miller (16:53)
4. Growth Experiments—Failures and Wins (27:06 – 35:38)
Small Win: Using the Collab Feature
- Dual publish on both creators’ pages yields crossover in both algorithm placement and audiences.
- Tagging creators in video titles: some benefit, but the collab feature itself has more impact.
Big Win: Localization & AI Dubbing
- Started with small AI localization experiments years ago; now a major driver of growth.
- AI-dubbed content allows tapping non-English audiences from the same channel, mirroring MrBeast’s model.
- Currently, YouTube’s built-in translation is good but limited (works only for videos under one hour). Often, external tools and manual QC are needed for long-form podcasts.
“We just started the Spanish Spotify channel as well. On the 1st of January, it launched… We've been testing it for a few years, but this truly is the year and the growth has just been insane…”
— Grace Miller (33:47, 34:44)
5. Designing & Logging Experiments (35:45 – 39:32, 68:57 – 71:20)
- Experiments must align with company KPIs—whether that’s subscribers, retention, or views.
- Many creators claim to experiment, but without stated success criteria and measurement, “it’s not an experiment.” (06:01)
- Knowledge base: A central, searchable database (soon to become a platform) logs all experiments and results, breaking down silos and accelerating shared learning across Flight Story.
“We look at the company overall goals and KPIs first […], and every single experiment should be aligning to either learn new knowledge of how you can get there or gain more subscribers.”
— Grace Miller (35:53)
6. Key Metrics and Myths for Creator Growth (37:33 – 42:14)
- Core metrics depend on business objectives: community engagement? Go heavy on returning viewers, retention, and subscriptions.
- “Returning viewers” segment is a high-potential audience for deeper engagement and monetization.
- Playlists are a “slept on” feature—customizing names and content in playlists improves recommended traffic.
“You always want a specific percentage of new people returning. That means they're coming back for more. They're hooked.”
— Grace Miller (39:33)
7. The Culture of Failure and Experimentation (54:22 – 66:17)
- Embracing Failure: Flight Story publicly ‘awards’ Experimenter of the Week—status is given to trying, not just winning.
- Failure is only celebrated if there is a concrete learning attached.
- “I don’t know” is an encouraged response from team members—builds psychological safety and unlocks learning from failed attempts.
“The whole mindset that we've—or Steve has created, which has been amazing—is making sure that no matter what, when someone fails, it's as long as they share a learning from it. It is congratulated.”
— Grace Miller (57:53)
8. The Future: AI Across the Creator Business (72:13 – 79:09)
- AI is integrated across every function: translation, thumbnail design, script writing, content repurposing, and industry news aggregation.
- Experiments include AI podcasts, translated agents, and automations to reduce manual workload.
- Human vs AI: The demand for authentic, imperfect, human stories will remain—even as AI avatars and clones proliferate.
“Honestly, it's across every area. I don't think anyone doesn't use AI in Flight Story.”
— Grace Miller (72:13)
9. Audience Quality over Quantity (80:24 – 83:12)
- Both Nathan and Grace champion targeting and serving the “right” audience over striving for viral mass views—especially for monetization and long-term community loyalty.
- Strong communities fuel organic word-of-mouth and sustainable growth.
“I am actually in that camp. I am in the idea of creating a community that are super highly engaged because that will grow.”
— Grace Miller (81:29)
10. Personal Experimentation and Lead Indicators (85:21 – 89:30)
- Grace applies the experimentation mindset to her personal brand: trialing Instagram reels, hooks, fonts, and carousel formats.
- Focus is on consistent posting (controllable input), not just follower count or lagging metrics.
“It's the taking more shots. Even though I know there's the whole debate of quality versus quantity … I still think the more shots I'm taking, maybe one in seven will do. Okay. The other six might fail...it's taking the chance to put it out there…”
— Grace Miller (89:00)
Notable Quotes & Memorable Moments
-
On embracing experimentation:
“It's not an experiment unless you define the criteria.”
— Nathan Barry (06:01) -
On posting frequency:
“Upload one video a week, you have one opportunity… Upload 10 a week, you have 10 opportunities to go viral.”
— Grace Miller (67:57) -
On culture:
“Failure is not celebrated. Failure and learning from it is celebrated.”
— Nathan Barry (58:01) -
On AI’s “human” counter-movement:
“People are now putting in spelling errors on purpose to then make it seem more human.”
— Grace Miller (77:12) -
On community:
“Long form... is actually where you're building that community. People are willing to sit here and listen to you for an hour. They actually are interested in you.”
— Grace Miller (82:00)
Important Timestamps
- 00:00 – 04:16: Introduction, background on Diary of a CEO and Flight Story
- 05:16 – 10:30: Experiments with Clips and Shorts – failures & learnings
- 12:27: Shorts on main channels vs. separate channels
- 15:36 – 19:38: Underutilized features: Posts, polls, and feedback loops
- 22:11 – 23:42: Using Chapters & YT’s “Jump Ahead” for retention
- 27:06, 29:23, 30:19: Collab feature, localization, and dubbing experiments
- 35:45, 36:19: How Flight Story designs & selects experiments
- 39:33: Importance of returning viewers & engagement
- 54:22, 55:08: Culture of failure, public recognition, and psychological safety
- 72:13 – 79:30: AI tools and automations across Flight Story
- 80:24 – 83:12: Importance of audience quality in creator strategy
- 85:36 – 89:00: Personal brand experiments—input vs. output metrics
Suggested Actions for Creators (from Grace’s Playbook)
- Deploy YouTube Posts/Community daily, especially on non-video days.
- Embrace and log failed experiments: focus on learnings, not just results.
- Consolidate Shorts and long-form on main channels for single-audience flywheel.
- Prioritize “returning viewers” and playlist structuring for retention.
- Start experimenting with AI for translation, production workflows, and content repurposing.
- Build a culture that rewards experimentation (not just wins) in your team or community.
- Commit to consistent “shots on goal”—track input metrics (posting frequency) as much as outputs.
Where to Follow Grace Miller
- Instagram: @GraceExperiments
- LinkedIn: Grace Miller
- Follow Flight Story shows & experiments for firsthand playbooks
This episode is essential listening for creators, operators, and marketers wanting to supercharge their experimentation, build lasting communities, and win in the next wave of the creator economy.