Loading summary
Grace Miller
When I started, we were on 100,000 subscribers on YouTube. Now we're at over 14 million.
Nathan Barry
My guest today is Grace Miller. She's the head of failure and experimentation at Flight Story, the company behind the dire of a CEO podcast and a bunch of other big shows. If you're growing a YouTube channel, what do you set as your core metrics?
Grace Miller
I definitely would say. I just said to Steve, I was like, we really need to do this. And the growth has just been insane.
Nathan Barry
Grace walks through, through the YouTube experience. They've run some that worked and some that failed in a huge way.
Grace Miller
YouTube community now it's called Posts. Lots of people don't share on it. I'm intrigued to why people don't share because I think it can be a really good growth hack. There's so much on YouTube that can be experimented with. Chapters is a massive one.
Nathan Barry
What's another experiment that was maybe at
Grace Miller
a different scale, a big one right
Nathan Barry
now, is this episode was a fascinating look behind the scenes into one of the world's largest podcasts. And so if you're as obsessed with creating great content as I am, you're going to love it. What are three examples that you're like, okay, every creator should be doing this.
Grace Miller
The first one is something to do with whatever content you're posting. Second one is something like a poll or an engagement post, so getting people actually interacting with it and commenting. And then I say the third one.
Nathan Barry
Oh, Grace, welcome to the show.
Grace Miller
Thank you for having me.
Nathan Barry
Okay, so the head of Failure and Experimentation, that is a title that I have never heard before. Is it a title that you've heard before with other creators?
Grace Miller
Before I came into the title, no. Now since being in the title, there's a whole lot of experimentation. I didn't even know that existed. And I think in the creator space, creators experiment themselves, but they just don't call themselves head of experimentation.
Nathan Barry
Right.
Grace Miller
So it's more of a behavior than I would say it is a title alone.
Nathan Barry
Yes.
Grace Miller
And that everyone should be doing it. But it's really cool to have the title and now meet other people in the industry with similar titles as well now.
Nathan Barry
So I want to dive into a couple of the experiments, maybe some that failed and some that succeeded.
Grace Miller
Yes.
Nathan Barry
And we can talk about, you know, both aspects of it.
Grace Miller
Yeah.
Nathan Barry
But before we do that, for anyone who doesn't know dire of a CEO flight story, all of that, like give the high level context and maybe a few numbers because the scale is pretty ridiculous.
Grace Miller
Yes. It's actually my four years Today at the DARA of a CEO.
Nathan Barry
Oh, congratulations.
Grace Miller
I know it's well flown by.
Nathan Barry
Thank you for celebrating your ANSW anniversary here on the show.
Grace Miller
Had to come talk about it.
Nathan Barry
Yes.
Grace Miller
But the diary of a CEO has been around for about five and a bit years now.
Nathan Barry
Okay, that's. I would have thought it was way longer than that.
Grace Miller
Yeah, more when I say five and a half years to camera on YouTube, full scale production. And when I started four years ago, we were on 100,000 subscribers on YouTube and then now up till today, we're at over 14 million. So it has been insane growth over. Well, that's four years. Over four years it's gone from 100k to 14 million, which is wild. And it's also gone almost developed as a podcast from when I first started listening. It was very entrepreneurial, business focused. Now it's developed with Stephen as he's grown up and become even an even more diverse entrepreneur. And it's now covering topics all around the world from people that are the best in their industries. And a year and a half ago we started Flight Story, which is the media company that the diver CEO is now under and that's a podcast agency, but also has creators as well. So the thesis behind it is we create media companies or podcasts and help creators develop in that. So we've gone from just the driver CEO to also podcast with Paul Brunson. He has a podcast called Winnie's Talk. We have one called Begin again with Davina McCall, who's UK broadcast icon. And then the line with Dr. Kristen Holmes from Whoop, which is really, really interesting. It's all about her interviewing coaches or sports people and how they have become the best in the industry. And then we recently didn't start this one from the beginning, but Hot, Smart Rich with Maggie Sellers. So she started her podcast a year ago and then a few months ago Flight Story partnered with her to help her build it even further. So they're the current podcasts on our site?
Nathan Barry
Yeah. Oh, that's amazing. So you get to learn not only from Diary of a CEO but also from all these other shows that. That you're running.
Grace Miller
Yeah, we learn from all the other shows and then we also have other divisions. So we have a flight socials division, which is creators, specifically on short form. We also have a product division, so get to learn a lot from E Com and um, and then also flight books, which is physical books and helping publish creators as authors.
Nathan Barry
I love that. Okay, so diving into some experiments.
Grace Miller
Yes.
Nathan Barry
What's an experiment? That you ran that you think would be interesting to share with the, like, the professional creators who, you know, would
Grace Miller
be fascinated by that, that failed or succeeded.
Nathan Barry
Ooh, whichever one you want to start with.
Grace Miller
I think one that was really interesting is we have a DOAC clips channel, which is still horizontal clips on YouTube, but it's shortened versions. So.
Nathan Barry
So there's not shorts, it's.
Grace Miller
Yeah, it's shorts. It's clips, we call them clips. And then it gets confusing with long, short form social media. But it's 10 to 30 minute cut downs of the podcast.
Nathan Barry
Okay.
Grace Miller
And we experimented. We actually put one out every day and we experimented with doubling output. So we thought, okay, if we put two out every day, we'll double views.
Nathan Barry
Right.
Grace Miller
Basic hypothesis, and I think with experimenting it can be as simple as that to see does it or does it not work. We put it out and it was a massive failure. It didn't double views. It actually decreased reach than what we thought would happen. So we thought, okay, say we get 10,000 views on each clip. We're like 20,000 views. No, it was so much lower than what we actually expected to happen from it. And so it's, we've then pivoted back and we're like, okay, we'll go back to one episode or one clip a day to then retest and see what other areas we can experiment in.
Nathan Barry
So the measure of success for this experiment, because that's a very, A lot of people are saying like, oh, let's try this. And they're like, great, what's, what's your hypothesis? What, you know, how are you measuring success? And a lot of people are like, oh, well, I was just trying an experiment. It's like, it's not an experiment unless you define the criteria. Yeah, but your measure for success was total views on the channel.
Grace Miller
Yes.
Nathan Barry
So not views per clip necessarily.
Grace Miller
No. Yeah, we were, we thought, okay, in a 30 day period, how many more views can we get? And does that equate to the time or effort that's been put into creating those clips? And so making sure it balances out that the views are justified by how much more work is going into it? And it wasn't. It didn't work at all.
Nathan Barry
So. So total views in the 30 day period stayed flat or went down.
Grace Miller
Went. Stayed flat.
Nathan Barry
But they didn't on double the number.
Grace Miller
Yeah, our hypothesis was double and they did not get to anywhere near double.
Nathan Barry
And then, so for that to be the case, views per clip.
Grace Miller
Yes.
Nathan Barry
Went down pretty substantially.
Grace Miller
Yeah.
Nathan Barry
Okay, do you have a theory on
Grace Miller
why I actually think it's something to do with the algorithm and maybe posting multiple clips a day. I know other channels can do that. Um, but seeing the growth of our current clips channel, then going to two clips a day, it's finding its place in the algorithm, I think. And when you look at the YouTube algorithm, how many times if you actually really delve into it, very nerdy. But how many times do you see a video in your feed from the same creator over and over. So you're almost cannibalizing your own content if you're posting multiple a day.
Nathan Barry
Because you probably to show that.
Grace Miller
Yeah, yeah, maybe within the subscriptions feed you might come up multiple times. But I think in the like homepage feed that you're rarely seeing unless it's on different channels. So for example, the sidemen, I follow multiple of their accounts. So I might get a short, then a long form, then another long form, but from a different channel. When it's on the same channel, I actually don't think you can get as many placements on a homepage fee.
Nathan Barry
So is that why you see so many creators running two, three, sometimes four YouTube channels?
Grace Miller
Yeah, I think so. And I think yes. Last night I was speaking to some of the creators and one couple said they had six channels and I thought that's interesting. And combined I think they had about 60 million subscribers.
Nathan Barry
Okay.
Grace Miller
But the proof is there, I think if they're not only for volume, but I actually think for topics as well, especially on YouTube, knowing why people are coming. And so they had a gaming channel or a lifestyle channel and so they were fairly distinct.
Nathan Barry
It was just the clips versus.
Grace Miller
Yeah, it wasn't. I don't think this was volume. It was definitely keeping different topics apart. Which is another thing because I think people go into YouTube and they go, especially if they're more lifestyle or vlog and think, I'm going to service everyone. It's like actually you really have to know what people are coming for and whether it's you as a person or a podcast and understanding why they'd come back and keeping the topics similar but still diverse enough to bring in new people.
Nathan Barry
So how many channels do you have for Diary of a CEO?
Grace Miller
We have. So we have our main channel and then we have the clips channel, which is the short form, well, horizontal short form clips. Then we have a separate shorts channel which we tested on, but now we've gone back to shorts on our main channel. So that was kind of. I want to dive into that left aside. And then we also have behind the diary, which is Steve's vlog.
Nathan Barry
Okay. So four channels.
Grace Miller
Three. Three Diary. Yeah, but we're. Yeah, the shorts one's been made redundant.
Nathan Barry
Some. Some of these other channels that you're running.
Grace Miller
Your.
Nathan Barry
Sorry, let's take another podcast that you're running. You know, now you're sort of spinning it up and, and you know, growing a new show. Are you running one, two, three channels for one of those shows?
Grace Miller
What's the process one right now. So the goal behind it is grow that one channel and then we can spin off.
Nathan Barry
And what's the mark where you would think about, oh, maybe it's time to spin off. Is that 50,000 subscribers, 500,000.
Grace Miller
I think it actually depends on where. Like a multitude of factors. So we have so many different frameworks depending on where we want something, whether it's a podcast being acquired or how we want an episode to go out. And I actually think it's a multitude of things from views subscribers, but also retention. So how engaged are they? Would those people convert to another format? And also the length, if your podcast is 30 minutes, you're probably not going to go and create another channel of 30 minute clips.
Nathan Barry
Right.
Grace Miller
Whereas if it's for example, like a human where he's four hours, of course he has the chance to cut it down. Yeah. And I think it brings a different audience as well. So short form. Short form clips where they're horizontal. We need a better name.
Nathan Barry
Yeah.
Grace Miller
It's a distinct. But I would say for human, he could definitely do that because they would bring a different audience to who would come and consume the full length. But you then also get the conversion of people jumping over to the full length.
Nathan Barry
Right, okay. And then something that is widely debated and it sounds like you've experimented both ways, is whether or not your shorts, the vertical YouTube shorts, should be on the main channel or should be separate. Like Pat Flynn would be an example with his Pokemon channel, Deep Pocket Monster. He has his long form horizontal channel, which I think is a million and a half, 2 million subscribers. And then he has a shorts channel that's also a million and a half 2 million subscribers. And he says that they're entirely different viewers. Like there's overlap but like it's. It's not the exact same people.
Grace Miller
Yeah.
Nathan Barry
And so he's very much in the camp as last time I talked to him of like, keep them separate.
Grace Miller
Yeah.
Nathan Barry
What's your take on that?
Grace Miller
We experimented with it for a While and on YouTube shorts specifically we tested off channel and on channel we tested off channel first because we obviously thought as every YouTuber thinks it's going to cannibalize your long form content because it's bringing a different audience. But there's a lot of missed opportunities. So you can't link the video on your main channel. If you're posting a short and it's on a separate channel, the short is on your main channel, you can link it. So people are going directly from the short to the long form. Super easy conversion funnel. And so. But again then it begs to the question of what I said before, of taking up places on a feed. Do you still get the same placements if it's all in one channel? We now fully believe on the same channel is the best way.
Nathan Barry
Okay.
Grace Miller
And we tested that across all of our podcasts. So we tested it on some of the newer podcasts first, which is a really interesting dynamic. And they're actually growing faster than the diary of a CEO if they were where the Diavoco was now. And so tested it, it actually works. It converts. Obviously they have shorter average view duration because they're coming from a short form video, but the actual conversion funnel is so much smoother and you're getting all of the views on your main channel. So YouTube's seeing that as more people coming there rather than separating out people going to other channels and not coming to that main channel. So we've seen a lot faster growth since then. So.
Nathan Barry
So when you say you tested it, a lot of people would you look? I look at the tests that they ran and I'm like, you did it and you went off of vibes.
Grace Miller
Yeah.
Nathan Barry
What I want to know is how would, how did you actually measure those tests and what, you know, what was the time period? How would you know? Like. Okay, we fully believe based on this data that this is the right decision for us.
Grace Miller
Yeah, we, we have a bit of a cheat code because we have other podcasts. So it's, it's slightly easier because we can test things on a podcast and then apply it and test it to other podcasts to see does that hypothesis still hold. So we tested it on other shows that were actually starting out so you can kind of see the growth more. And it was understanding how many people convert from those short form. Does it hurt the long form? Because I know people say putting short form then cannibalizes your average view duration of your long form episode.
Nathan Barry
I've heard that a lot. I saw someone on X saying that like, you know, they were very strongly saying like, you should never do this, never Combine them.
Grace Miller
Yeah.
Nathan Barry
And then I talked to the team at 7X Content who edits this show. Right. And they, they work with a lot of, you know, a lot of YouTubers, a lot of podcasts, and they were like, yeah, I mean, they're in the same camp as you. Like now I'd keep them on the same channel.
Grace Miller
I know it's been almost like a myth for a while. And I do understand. Maybe it's also different industries and niches.
Nathan Barry
Right.
Grace Miller
That would have different behaviors. Because I think as much as things can be applicable to all of YouTube, there's some things that could just be a specific niche as well. Like the way mrbeast edits would be very different to the way a podcast should edit because they're different types of retention and different lengths and understanding. Maybe you're not going to cut a podcast every three seconds to a different angle because it would be jarring for someone, but then someone beast esque would probably be able to do that and get away with it to keep retention. So I understand why people might still be worried about the shorts, but we've seen really great growth from it. And it's not about the views haven't dropped, put it that way.
Nathan Barry
Yeah.
Grace Miller
Long form views haven't changed at all when we added shorts. Okay.
Nathan Barry
That's helpful to know. I think a lot of people love that example and I love how you're saying we have multiple shows and so you can test that. You actually could have a control group and it's like we're not quite statistical significant in like testing this across a hundred shows, but you know, you can do it across a handful. What are some of the other myths or mistakes that you see people making? Or they're like, oh, I believe this. And you're like, I don't think that's true.
Grace Miller
Ooh, I think YouTube community, or now it's called Posts. Lots of people don't share on it.
Nathan Barry
Okay.
Grace Miller
But I, and I think more because of time. But I, I'm intrigued to why people don't share because I think it can be a really good growth hack.
Nathan Barry
Okay.
Grace Miller
Because you're getting a placement in the feed when you share. I would not to give away all my tips and tricks, but I would put it on a day that you're not sharing any other content.
Nathan Barry
Okay. So you might, if you're doing three clips a week or like your long form and then three clips a week, it's like, okay, well there's three more days that you didn't post anything.
Grace Miller
Yeah. And if you see it, the more you think about posts, you'll probably see them way more. But. But they are always in your feed, they're in the subscriber feed, they come up in the homepage feed. And I think they're really underutilized. Cause I've done a lot of deep diving into them and when I go on pages, hardly anyone uses them. And then the creators that do use them are obviously popping up because YouTube's algorithm says, oh, it's a post, we're going to share that. So I think posts people obviously are not even thinking about or maybe thought. Thought wasn't very useful. But that is a big one. That is kind of another way to get in that algorithm, I think, from
Nathan Barry
working on the software side of things, where I know that you end up with a product manager who owns a certain feature, you know, within a company and they have metrics for usage and adoption and all of that. And so you know that their job is to drive adoption in that. And so I think about something like post or community where there is a product manager at YouTube who, their job is to drive that. And so they're like, okay, what levers can I pull? And so like, oh, if someone uses this, then we're going to get it featured here.
Grace Miller
Yeah.
Nathan Barry
And so it's like, give them what they want because they're here to reward you.
Grace Miller
And they put, they create the features for a reason, right? And then for example, like when you jump on that feature, they are going to push you like Instagram with the current translations feature, they're going to push people that say, yeah, I'll add that onto my video.
Nathan Barry
Right?
Grace Miller
Because they want people to be using the feature. So why not actually go and be a first mover in that area and try the feature out. And so I think definitely the post feature, the other ones on YouTube translations is a big one that's coming out because they've obviously allowed audio tracks now to other creators. And the thumbnail testing and title testing tool that I think is now available to everyone.
Nathan Barry
Okay.
Grace Miller
Is maybe one of the most interesting tools that we've finally been able to use because it's based on statistical significance. Whereas all of the other tools before were amazing for thumbnail testing. But they don't have the backend data to be able to prove what does and doesn't work on YouTube. So it's finally, it's like, yes, we finally have a tool that is actually in app and we can use, that has real data.
Nathan Barry
So what kind of content should someone be putting in posts, like what are three examples that you're like, okay, every creator should be doing this.
Grace Miller
Yeah, I'd say the first one is something to do with whatever content you're posting. So whether it's the next day after it's like, hey, this just came out. Because we've tested that and we've seen when you put a post out, people then go through to that episode and it's really interesting to experiment with it because you can see a spike when people go to that, from that post to the episode. So it's not just, oh, I'll put out the post and hope it does something. You can really see the data. Second one is something like a poll or an engagement post. So getting people actually interacting with it and commenting so that the algorithm saying, oh my God, this person is really engaged with that content and then they're going to be serving you the other content. Yeah, definitely. And then I say the third one maybe is something to get feedback from the viewers. So not only in the comment section, but being able to actually have almost like a conversation thread with them to get real feedback to help you produce better content. Whether it's a podcast and what guests they want next, whether it's a challenge, videos and they suggest new challenges. But actually getting them in that feedback loop can be really valuable first party information as well.
Nathan Barry
Well, what's fascinating about that is you could have a basic flywheel that gets you all of those things. So you're saying I'm going to be posting video content four times a week, the long form and then three shorts or clips and then you know, fill in the other days with posts and they're pretty, you know, we're talking it could be a 15, 20 minute lift total for the week to add in posts.
Grace Miller
Yeah, it's. And it shouldn't be hard to do something like that. It could be really quick. It could just be a quick sentence and call to action, then a link to your episode.
Nathan Barry
Have you tried like LinkedIn style posts where it's actually storytelling or something else? That's.
Grace Miller
Yeah, we experimented. If you scroll quite far back, it was maybe a year and a half ago in our posts and we experimented with different quotes actually maybe even. Yeah, I'd say a year and a half ago. And we experimented with different quotes, photos, behind the scenes, really tested like what works, what doesn't. To see like even though you have like almost like carousel or multi image options. See, like does that get better engagement than just text? Yeah. So there's so much just in one Tiny feature that people aren't even using to then build out.
Nathan Barry
And you found that it was worth going into that level of detail. Or you said you scroll way back. And so that makes me think that it wasn't as worth the effort.
Grace Miller
I think it depends on what you're trying to do. Like, that was great for if you just want engagement on that specific post. We do more now linking through to the episodes. Or alternatively, you can also see that we'll do posts that link through to our clips channel. So we'll post on the main channel
Nathan Barry
saying, hey, this clips lets you cross promote.
Grace Miller
Yeah. So instead of like what I said before about shorts not being able to cross promote if they're on a different channel, it's kind of a hack where you can promote on posts and link another video. So I could, if I had a YouTube channel, I could link your video on my post? Basically.
Nathan Barry
Yeah, well. And what's interesting is you might pick up someone where it's like, okay, I saw that this two and a half hour episode with Jefferson Fisher dropped and I would love to watch that, but like, I don't have to, you know. But then you link to the clip of it.
Grace Miller
Yes.
Nathan Barry
That's 15 minutes. It's like, all right, well, I'll. Yeah, like that will be my gateway into the episode.
Grace Miller
Oh, 100%.
Nathan Barry
And go from there.
Grace Miller
Yeah. But there's so much on YouTube that can be experimented with. Like, that's really. Post is so tiny compared to. Yeah. Other things. Like Chapters is a massive one. Specifically in podcasting, I think people sometimes skip over because it seems like putting chapters in. Yeah.
Nathan Barry
Okay.
Grace Miller
There's some podcasts still that I'm like, why don't you add Chapters? But I don't know if they're maybe experimenting with it for retention and average view duration.
Nathan Barry
So are you. Okay, so let's talk about Chapters. It sounds like that's another thing that you believe that other, you know, podcasts on YouTube should adopt.
Grace Miller
Yes. Yeah. Or creators as well. I think if you're making a vlog, that's an hour or an hour and a half, even 45 minutes to be able to allow people to skip. Because YouTube created the jump ahead feature where if they see someone skipping though,
Nathan Barry
jump ahead to that.
Grace Miller
Yeah. And it basically it pops up. It says jump ahead and you can click that and it takes you to the section in the video where most people have skipped to, which is almost a growth hack to see. So I could do it on someone else's podcast and look at it and see where people are skipping to. And usually you'll see a lot of people skip the start if it's a trailer or a summary, because they're like, I already know I want to watch this.
Nathan Barry
I watched the trailer on Instagram. That's what got me here on the shorts. Yeah.
Grace Miller
And so you can really see throughout how it progresses in the skip ahead or jump ahead. Sorry. But then chapter wise, it actually gives people, if you're adding chapters, a section to know what to skip to in a good way because you don't want people coming and then bouncing because they can't find the section that they wanted to come for. But also then you don't want to hurt retention. So it's an interesting balance of making the chapters worthwhile clicking for, but then not too obvious that they then skip to them.
Nathan Barry
That's interesting balance. Okay. Are there any other either myths or mistakes that you see people making thumbnails?
Grace Miller
So many different. I think people try and copy other thumbnails. And I actually saw not going to name the creator, but I saw they copied the exact thumbnail and title for an episode.
Nathan Barry
Okay.
Grace Miller
And it didn't get anywhere near. I think it didn't even get over 100 views. But the episode on Dark, actually, this is a great myth. I'm going to restart the story because I think it could be really interesting. A creator copied the exact thumbnail and title of a Diary of a Sea episode, and the dark episode got a few million views. That creator only got 100 views on the episode. And I think what's really interesting is people can think, oh, title, thumbnail copy algorithm thinks I'm the same creator or channel. And it's breaking that myth of being actually. No. If you create original content that people are going to like, they'll probably stick around for longer than actually just trying to copy someone else. And you'll probably see a million channels on YouTube now looking the exact same thumbnail style with the white text, red highlight. And it's finding your own spin on it. Even if you have still the two faces of the creator, the host and guest, and still have text in the middle, I think there's a way to take a spin on it and even the whole format like I saw or I know a creator in the US who has started a podcast, interesting name called the Rub Down.
Nathan Barry
Okay.
Grace Miller
But the concept, when he showed me it, it gave me goosebumps because it reminded me of early days of Chicken Shop date with Emilia. And his concept is instead of sat in chairs, they're on massage Tables getting a deep tissue massage while having a conversation. I don't think you get the same eye contact as our conversation, but I think it's a really interesting spin on podcasting. I'm like, that is nice to see people changing it up, Revolutionizing what podcasting is and trying new things instead of just sticking to the traditional thumbnails that are out there or the titles.
Nathan Barry
Right. Yeah. There's so many things in that where, you know, you think about the hook that you're going for and is it memorable? Could you talk about it? And it's like, oh, we have another 90 minute long form podcast interview with the same guests as everyone else.
Grace Miller
Yeah.
Nathan Barry
And you can't really, like if we think of word of mouth as a growth angle. Like, I. I can't articulate that show in an interesting way or that sort of thing. But you're talking about this show, the Rub down.
Grace Miller
Yeah.
Nathan Barry
Right. It has a title where you're like, what's going on there?
Grace Miller
Y.
Nathan Barry
You're saying like, this is a little wild, but they're getting massages on massage tables. Well, you know, it gives you something that you can talk about and explain. And someone's like, I don't know how I feel about that, but I guess I'll click the thumbnail and watch it.
Grace Miller
And now. And now I bet you'll see it in your feed somewhere. And you're like, oh my God, that's that podcast. And it really stands out. And it was like, chicken shop date. She's in the chicken shop.
Nathan Barry
Right.
Grace Miller
I know it technically wasn't a podcast, but it is a YouTube format. And I think it's finding that even the format of MrBeast Now, I would say people call the MrBeast format, whereas really it's almost like challenge videos or. Yeah, but yeah, almost becoming the new genre of your YouTube or podcasting format is quite an interesting new experiment and strategy to go down.
Nathan Barry
Okay, so now I want to go into an experiment that worked.
Grace Miller
Yes.
Nathan Barry
What's one that comes to mind that you're like, okay, this is something that you learned a lot from. And. And it drove results for the channel.
Grace Miller
A small one or a big one?
Nathan Barry
Let's do both. Let's start small and then go big.
Grace Miller
A small experiment we've been running is the Collab feature on YouTube where the video appears on the creator's page. Well, both creators pages. So if I posted a video, it would appear on mine, but also if I tagged you, it would appear on yours. And it's a really interesting dynamic because you're getting the views and subscribers from both pages engaging and so you're able to see how it reaches new algorithms. And I think it's worth playing around on every channel because you'll have different experiences to what we would have experienced. But you'll find it interesting to see where does it get served and also understanding how does the other person who's tagged have an audience that comes and maybe has a different retention or they might come from different places rather than the homepage. They're all coming from external. So seeing how that works, it's been a really interesting. And not only the collab but also the tag feature in titles. So seeing whether that does or doesn't work, I actually, I think collab works really well. I'm not sold on the title tagging feature yet.
Nathan Barry
How did you design the experiment around collabs?
Grace Miller
Yeah, it's more. Less statistically significant and more. I kind of. Not to go too deep into experimentation, but I kind of see it in a few ways of some are great stat Stig. Stat sig. What? Some are great statsig experiments, some are more knowledge based experiments. So I see it as if we can test this and see can we learn more about the algorithm that will then help us with other experiments. That's going to be a win. So it's more for the tagging. What can we learn that will help us? So can we learn more about other creators algorithms and how they work? Do they work the same as ours or not? But also setting it. We set parameters of how many views or new followers do we hope to get from this episode and did it hit that or did it just exceed it by tagging that person as well? And what sort of growth has that had from it?
Nathan Barry
Yeah, that makes sense. Okay, what's another experiment that was maybe at a different scale?
Grace Miller
Yeah, a big one right now, which I touched on before is localization and dubbing and I was chatting last night to some of the creators about it as well and I didn't realize how many other people are doing it. And the industry is really picking up on it right now. So not only YouTube but also Instagram now has the feature of the translations and we've been experimenting with it for. We started three years ago, testing wasn't the time, but we started testing seeing what worked, what didn't tested different channels. So there's kind of different ways you can do it. You can do human translations or AI translations and then YouTube's obviously added the feature now where you can add the translations to Your video. So instead of what Mr. Beast used to have was his English channel and a Spanish channel, he now has all of his audios in one channel. So you're not only having English subscribers, you're able to have subscribers all over the world on one channel.
Nathan Barry
Okay.
Grace Miller
And I would bet money on it that that's why his growth has been so big, because he's had so many languages at his global audience. Yeah, it's. It's such an easy growth hack. Obviously it takes time and effort to make sure the quality is good. And I know a lot of theirs were still human dubbing, but with AI dubbing now.
Nathan Barry
So is that where are you cloning a voice in 11 labs? And then.
Grace Miller
Yeah, there's so many. There's. So YouTube has an in app feature.
Nathan Barry
Okay.
Grace Miller
I sound like I'm selling for YouTube.
Nathan Barry
I mean, YouTube has done a lot for you and Steven. So, you know, you can.
Grace Miller
We actually can't use it because. So YouTube's in app feature. But you can only use it for under one hour. So your clip has to. Or episode has to be under one hour.
Nathan Barry
And you're like, that's not how we work.
Grace Miller
Yeah. I'm like, why? Why not slightly longer, but so they've built an amazing tool that you can use it in app. I think there's a lot of work to go though. Like, it's good, it's not controversial. Not amazing. Right. And even I just said amazing tool. But I think it's a really good build on what other platforms have offered because they currently a lot of platforms weren't offering localization. The fact YouTube and now offering localization across so many different audios and then being able to get creators to post that they're not only reaching like a wider audience themselves as YouTube as a platform, but creators are also benefiting from it as well, which is nice. So to use that has to be under one hour. I think there's some improvements to go right now from conversations I've had. A lot of people are still using outside platforms and importing the audio. And then the other part is it's audio only right now on YouTube, so you can't do lip syncing.
Nathan Barry
Right.
Grace Miller
Whereas Instagram's feature is incredible. I got a video the other day in Hindi and I could. It was English. I didn't even realize you're speaking Hindi until I saw the tiny translated button. So I think seeing what Instagram is doing is really, really cool, how innovative it is. But it's. I love YouTube because they experimented it and they were a first mover of testing what worked and what didn't, and they're building it themselves to try and get better. So. And they've got translated thumbnails as well now, which has been a really interesting.
Nathan Barry
So we do this thing on the podcast, we always talk about how to grow creator businesses. And I've realized I don't actually talk about my business. Sometimes people will ask in the comments though, what do you actually do? Are you just a podcaster full time? So I'm interrupting this show to tell you that I actually run a software company that is built entirely to help creators grow their online business. It's called Kit. You can check us out@kit.com and it's just the place where all the top newsletter creators, podcasters, authors grow their email newsletters connect with each other to grow faster and so much more. So if you're looking to increase revenue, automate more in your business, and just generally make this year even more successful, go check out Kit. You can sign up at Kit. Com. We have a full migration service where we'll bring you over to Kit totally for free. It's been a labor of love to build this business over the last 13 years. We've got a dream list of clients on there, everyone from James Clear and Tim Ferriss to Dua lipa and Matthew McConaughey. So it's a pretty special group of customers and a really great team just who's really here to help you be successful in your business. So then is that the DOAC team is translating or dubbing off site, off platform, and then uploading these files?
Grace Miller
Yeah. So it started as an experiment.
Nathan Barry
Okay.
Grace Miller
So there's no. We don't even have a production team doing it yet. Our production team is still doing English, even though Berta, who's one of the amazing producers, she is actually Spanish. So it could be perfect. Yeah, because she'd be able to fully translate and quality check the episode. But the translation started as an experiment. We were the best way possible. Having conversations with people and heard localization translations. Coming up more. And I just said to Steve, I was like, we really need to do this. We've been testing it for a few years, but this truly is the year and the growth has just been insane in 2025 and then now, obviously seeing it grow in 2026, we've got some big goals, but we just started the Spanish Spotify channel as well. On the 1st of January, it launched. So very new things to come. Spotify doesn't have the feature of Adding the audio yet, but we'll see what happens in localization.
Nathan Barry
And does YouTube split out the views based on like, do you get analytics of how many are viewing in each language?
Grace Miller
Yeah, you get everything from views retention and, well, AVD and being able to see like even the countries based on them. So if it was Spanish, are they Spain or Latam and really understanding. But it's just the whole world out there of how do you dub? I know some people have created or like some creators have built their own dubbing tools because they didn't find any on the market that were good enough. So I think, I think there's lots of tools out there that are good enough though. And it's about like what level you're at. But I actually don't think any are 100% perfect yet because the AI has still got a long way to go. But I think the best part is trying it and starting to get the views and experimenting with it. And then when the AI is 100% ready, you're already so far down the line that you're not starting from zero.
Nathan Barry
Yeah. Okay, so I want to know, going back to experimentation as a whole, how you think about designing an experiment?
Grace Miller
Yes.
Nathan Barry
Like, do you have specific criteria that you're going through a process and then how you measure it? The. It's the time that you're going to run the experiment with the original hypothesis. All of that.
Grace Miller
Yeah. So we look at the company overall goals and KPIs first. So whether it's yearly, five yearly, whatever your team sets us, maybe even monthly. And we'll look at overall company or podcast goals, then the team goals and say, what do we want to work on? And there's a really interesting photo our manager showed us of arrows pointing in all different directions and then arrows all pointing in one direction, same direction, the
Nathan Barry
same number of arrows and all of that. But like, are you making a tiny bit of progress in many areas? Are you?
Grace Miller
And I think that's the key to experimentation, is people can be, oh, I'm going to. Or people. I think people will say, I'm going to try something new and experiment. But it might be so off piste towards what your goal is that actually what is the point in doing it? So say your goal is to hit 10,000 subscribers on YouTube. What do you need to get there? Every single experiment should be aligning to either learn new knowledge of how you can get there or. Or gain more subscribers. And if you're doing something that's like so far removed from that experiment, I think it's about refocusing and sometimes we've run really random experiments that actually I'm so far down the rabbit hole that we're like, bring it back. What do we need to learn from this? And going back and saying, okay, how do we get to that answer? And that's what helps the most. I think the ones, they don't have to be, as I said before, they can be really simple experiments and don't have to be massive life changing things. But the little ones were 1%, as lots of people say, can add up to those goals that you really want to achieve.
Nathan Barry
If you're growing a YouTube channel, what do you set as your core metrics? Maybe what are the things that people get caught up in? And you're like, that doesn't actually matter versus what on a day to day basis or monthly? You're like, no, this is what I'm actually measuring and judging success based on.
Grace Miller
I definitely would say, well it really depends on what the goal is. If it's having a small community of really engaged people, then you'd look at subscribers and retention. If you are wanting more mass, it could still be subscribers, but maybe it's views and you're willing to sacrifice retention. I think you can do all three though, I think, but it takes a bit longer.
Nathan Barry
Okay.
Grace Miller
And what I think the other people, the other people I think people forget is it is a long game. Lots of YouTubers and creators I've met have been doing it for 10 plus years, right? And obviously they've got lots of subscribers now. But at the start, like Sean does Magic who did the talk Yesterday, he had 800 subscribers for two or three years until he started getting subscribers. And I think a lot of people would quit and go, oh, but I'm just going to stop now, I'm not even getting views. And so it's the mentality to keep going. But in terms of what you'd actually look for, I think for the long game, if it was a podcast or a creator that wants to do similar content, building up your subscribers but also keeping views and retention high. So how do you keep it engaging throughout? How do you, whether that's chapters so people know where to go and can continue to be engaged, whether it's engaging with comments so people feel like they actually know you and they keep coming back, whether it's the post and asking what people want so you can make actual content around what people are looking for. And then the other side of it is being so interested and actually caring about the analytics to find out what is valuable to you and what's not. So one of my favorite analytics that YouTube added recently is like new versus returning versus casual viewers.
Nathan Barry
Okay.
Grace Miller
And seeing how many people are new to your channel, you obviously always want a specific percentage of new people returning. Good. Casual. How many casual viewers do you want? You want a lot more returning. That means they're coming back for more. They liked your videos, they're hooked. Yeah. And I think casual, fine. It's good that they come back. You're never going to say no to a view, but I think you really want to try and build out that returning or more engaged area and say like, hey, keep coming back. How can we keep you. Obviously they'll move to a different section later on, but how do we keep you returning and interested in our content?
Nathan Barry
Is there anything that you've done across either DOAC or the other shows that has made the biggest difference to getting those returning viewers?
Grace Miller
We've actually it's one of our experiment focuses right now.
Nathan Barry
Okay.
Grace Miller
So on begin again you'll see we've done almost like a themed month around health. So all the guests are around health. It's around wellness. Obviously start of the year. Perfect timing. So for January, they all have a similar topic. So I was thinking if someone's interested in one health guest, they'll probably be interested in multiple. So being able to hopefully bring them back. And so that experiment is still running. Other ones are things like a playlist. I should have said this before. When you're like, what YouTube features? Obviously we can talk about it now. Playlists are maybe a slept on area as well.
Nathan Barry
Okay.
Grace Miller
If someone likes your content and they're in that place, they're going to be recommended more of the same videos. So whether it's finance, whether it's content creators and learning how to develop their platforms, the more you can almost tailor that content to them so they finding it better. And also then the algorithm realizes and they're like, oh, they've maybe watched four videos out of this playlist. Even if they haven't clicked in the playlist, I'm going to serve them more in the recommended. And so we've seen that. And also playing around with the names of the playlist as well.
Nathan Barry
What's an example of that?
Grace Miller
Instead of just finance, it's like the best ways to make money or the best ways to save money.
Nathan Barry
How to build wealth. Yeah, something along those lines.
Grace Miller
Searchable or engaging. Rather than just finance.
Nathan Barry
Let's be a little bit more interesting.
Grace Miller
And we've Seen that, like, if you even played around with testing different names, say you chose one playlist and over the space of three months. I know that sounds long, but because you want to give the algorithm enough time to find it, changed it every few weeks, you'd see how the. Yeah. Different views change.
Nathan Barry
I mean, it's fascinating the amount of information that YouTube gives you.
Grace Miller
Yeah.
Nathan Barry
Like, both YouTube and Instagram are amazing as platforms of, like, look, we'll tell you exactly what works and why and all of that. And a lot of creators are not actually using that. And I always think back to the, you know, the product manager.
Grace Miller
Yes.
Nathan Barry
Who has their own KPIs and they're running their own experiments of, like, how do I get. How do I drive user creator behavior on the platform?
Grace Miller
Yeah.
Nathan Barry
And so it's like they're giving you the tools so that you can do the thing that they want you to do. And so, like, work with them.
Grace Miller
It's spot on. And they want to know as well.
Nathan Barry
Right.
Grace Miller
You get so many of the specific product managers. There's been some, like Spotify ones, for example, that come and say, can we get your thoughts on that tool?
Nathan Barry
Right.
Grace Miller
Because they really want to know, did it work? What could have been better? And so there's so many that we've been asked about, and I'm sure other creators or even could share feedback as well to then build that relationship of providing what does and doesn't work, because that's the only way they're gonna be able to develop better tools as well is by getting real feedback.
Nathan Barry
The other thing that I would say is you can find out who all these individual product managers are because they're all on LinkedIn. They're all, they're all out there. And you might say, like, okay, of course Spotify is reaching out to Dyer of a CEO because it's one of the biggest podcasts. But you know me, I have this little show. But, you know, knowing from behind the scenes in software, like, the product managers want to hear from the whole range because they know, oh, this works for big shows, but we actually have to get the long tail going.
Grace Miller
Yeah. And that's how they found me for that. One of the meetings, it was on LinkedIn. I posted about a feature and said, this is a really cool feature. Spotify has launched. And the product manager literally messaged me and said, can we go on a call so I can learn about what you think of it? And I was like, it's so, so good.
Nathan Barry
Because they all have goals around user research and Understanding this and so you can talk to them and then you can just ask, hey, would you mind giving me feedback on this? And they're like, oh, we're actually behind the scenes, we're trying to push this metric. So this is how it works.
Grace Miller
Yeah, it's I think the connection side as well, of learning from other creators or the platforms and understanding actually it's not so much a competition.
Nathan Barry
Yeah.
Grace Miller
Like, I listen to podcasts. I'm not only going to listen to one podcast.
Nathan Barry
Right.
Grace Miller
I can listen to other podcasts or YouTubers. Like, there's no. There doesn't have to be the secrecy. I think the sharing of knowledge can be super valuable to help everyone get better as well. Because everyone's trying to learn how does the algorithm work, what works, what doesn't.
Nathan Barry
So I want to go to. Even on a show the size of diary of CEO, you know, you're 14 million subscribers, there are episodes that get millions and millions of views and there are episodes that get thousands of views. And, you know, you all put out a lot of episodes. What do you notice in those trends where, you know, you might expect this one, okay, this one's gonna do really well. And it actually doesn't come anywhere near to reaching the same number of people versus the ones that do quite well.
Grace Miller
Yeah, I think sometimes we're surprised.
Nathan Barry
Yeah.
Grace Miller
For example, Dr. Tara Swart, who's a neuroscientist, she is one of our best performing episodes and I don't think anyone would have ever guessed it. No. Which is amazing. I love that when it's is an outlier and you're like, wow, what can we learn from that? And I think the other way around is when something doesn't go as well. And I think there's a few reasons. It could be that the topic and the guests just aren't right. And also to preface, there's a lot that don't go out as well, that don't even make it to going out.
Nathan Barry
What percentage of recorded episodes do you think actually get published? Is it 90%?
Grace Miller
Yeah, I say 90% or maybe higher. So it's only a small percentage, but it's. If this. The quality is not good enough, it needs to be really valuable. Like there has to be so much value in that podcast. And especially Steve is amazing. He has the highest standards I've ever met in the best way possible. And he cares so much about the quality of the podcast. And I think that's why it has been such a success, is making sure that everything that goes out is Somewhat valuable in whatever topic it is to people instead of putting something out. Because, oh, no, it's a Wednesday. We don't release on a Wednesday. But it's a Wednesday and you have
Nathan Barry
to get something out.
Grace Miller
Yeah. Which I know is what a lot of people do, because you're like, oh, God, I promised to do this and I have to put something out. Whereas actually having quality episodes is what is going to keep people coming back. And the more I think about it, the more I think, gosh, if you have one chance, maybe one chance to get someone to listen to an episode and they happen to click on the episode that's subpar, and then they never come back forever.
Nathan Barry
They think of the show as like, exactly. And always, I was gonna check out Grace's content, but I actually wasn't that great, you know? And you're like, that was one.
Grace Miller
Yeah. And it's. That's scary. So it's like, why would you put out something subpar? Because that could be the one piece of content that people see and go. And that's when they make their judgment. And even though that sounds crazy, it is probably true. Like, people do judge so fast on whether they like or dislike something. And I listened to one podcast. There was a man, which I thought was kind of motivating, but he was shouting down the podcast microphone. And I was like, okay, it could be motivating, but I thought, I wonder if he does this every episode. And thence he did. But I thought, it's interesting, the dynamic of, for example, the one you did with the whiteboard. I was like, I love that. I want to go back and watch more. And the consistency, I think, and quality is super important.
Nathan Barry
I would see it as a red flag on a podcast if you release 100% of your episodes. And I think that might be controversial because you have to. In order to not release 100% of your episodes, you have to offend people. And because it means, like, we recorded an episode and it was not good enough to release. So I.
Grace Miller
Going to tell me that after.
Nathan Barry
This is my nice way of saying
Grace Miller
that, like, hint, hint, delete the files.
Nathan Barry
No. So there was an episode, I guess I've. I've done a few over 100 episodes on the show, and there's two episodes that I haven't released. I'll use one as an example. I won't, like, throw out the guest in particular, but we were recording in a hotel room, which is always hard to do. Like, got the hotel suite, set up all this gear, hired a videographer to do it and everything. And it just wasn't. There was a bunch of things working against us.
Grace Miller
Yeah.
Nathan Barry
Like the fire alarm had gone off at 4am that morning in the hotel and so that was a little rough, you know.
Grace Miller
Yeah.
Nathan Barry
And then I had made the decision. I was recording four podcasts that day, which that was really pushing it. You know, we had all day for it. But like that was before the, the fire alarm at 4am we had some AV issues, all of that. And I didn't bring the energy. I like could not get, you know, the guests didn't want to share specific numbers and that was hard, like because it's something we do on the show is we talk very specific things they didn't want to. I was like, I think that'd be fine. I couldn't draw it, you know. Yeah, all that didn't work. And so going back to the guests later and saying like, hey, we, you know, we owned it. Like this was our mistake, you know. And we said we will fly you out to our studio. Like we're not going to release the episode. Yeah, we would love to re record it. If you're up to. We will fly you out. We'll pay all the expenses, we'll, you know, all of this. But if we're going to do it, it needs to be at this bar for quality. And I'm so sorry, like it's on us.
Grace Miller
And. Yeah.
Nathan Barry
And all that. And they, they took it well.
Grace Miller
Yeah.
Nathan Barry
I don't think they were too terribly offended.
Grace Miller
I think it's good if they take it well though because it's also the self awareness of them realizing maybe they didn't perform as well. And how can they. We've had some that have said like how can they improve? Which is actually really nice. Like that's so self aware to be like, what can I improve on? That didn't go right. But you've got to have the high standards because that's why people keep coming back.
Nathan Barry
Yeah. And so I guess for anyone listening, I would ask that as a plug of like if you've done hundreds of episodes, is there at least one that you haven't released? And if the answer is no, then I would argue that you're not holding the right bar for quality.
Grace Miller
Yeah, yeah, it's true. So true.
Nathan Barry
Another thing that I've heard is, well, actually I can say specifically who it was. So I was talking to Ramit Sethi. He recently hit a million subscribers on his YouTube channel for his podcast and all that. And he told me that maybe a Year or two earlier as he was maybe a hundred thousand subscribers, something like that. He was like, okay, I want to grow my YouTube channel specifically. And he has this amazing podcast about money for couples. Yes. And so it's like psychology and money and relationships and all this stuff together. And he doesn't care about personal finance tips. He cares about like why as a couple, the husband has the weird spending habits and how they're, you know, like any of these things. He's getting into it. Right. His whole thing is he loves a Reddit post about like my wife or my husband is doing this and he's just like, please come on my podcast. You know, he's what he posts all the time.
Grace Miller
I need to listen. I've listened to his doc episodes, but I need to listen.
Nathan Barry
It's so good. But he was asking all these YouTube experts, okay, how do I grow my podcast on YouTube? Because all of his videos are putting out and they were like, make YouTube videos, not podcasts. Go make YouTube videos. And so what he did is he started interspersing, you know, he still has the podcast is the main thing, but he started going and making, you know, 15 to 25 minute YouTube videos around a specific topic. It might cut in clips from the podcast, but. But it was cut for retention and all. And it was like a classic YouTube video. And that is what made the difference in growing the show. I was worried as you're saying that, you know, I was like, wait, isn't this gonna like fragment our audience on the channel and people are coming for different things? He said it worked really well. But I'm curious about that of podcasts for retention and average view duration is a very hard thing to do. So one, how do you think about that? And two, is it something that you've considered of like going and making much more YouTube specific content rather than pure podcast?
Grace Miller
Yeah, that's really interesting. I wonder if it's also because it's a specific genre finance, and maybe people are happier with shorter clips to quickly learn, whereas podcasts or some podcasts maybe are more educational or storytelling. So you're willing to sit there for the length of a movie.
Nathan Barry
So that, I mean, that's a good point of being really cautious. Not or not, not even cautious. Being really aware of who you're taking advice from and if they're in the same genre or these other things where you're like, oh, what this gaming channel, I'm going to implement that. And you're like, Nathan, you don't have a gaming YouTube channel. Like, you're as far away from that as possible. Like you should probably. Yeah, you know, you could be curious about it but like, please don't copy and paste it.
Grace Miller
I usually have a slide in my presentations. Well, one says, are you curious? But one slide says, don't trust what others say. And I say that
Nathan Barry
Grace says, don't trust people.
Grace Miller
I don't trust anyone. I do trust what others say, but I think the whole point of that is take what they say and go and test it for yourself. So obviously he did. He went and tested it on his channel, saw if it worked. I'm sure if he tested five and went, oh my God, this has way worse performance then he'd be like, great, let's pivot and stop and go back to the long form podcasts. But I think you can take it, learn and then take like put your own spin on it to see how could it work for your channel. Rather than just taking something going, I have to do this. There's some things that could work across everything, whether it's something analytical or a specific feature like a post. But I think for retention based and specifically content that is a style, whether it's podcast or YouTube, traditional or vlogs, I think they all have different styles of attention. Like vlogs, people might play in the background most of the time and I'm happy to listen to it from far away. I'm not really gonna Skip usually. Whereas MrBeast, you might watch and really intentionally watch and then for a podcast you might put it on your TV. And TV is massive on YouTube now. And so we're seeing, I would actually say there's really different behaviors and retention across all the different genres on YouTube. So taking knowledge from one into the other can be valuable, but making sure it actually applies and testing it on your own one is worthwhile.
Nathan Barry
First in your title, I'd expected to be the head of experimentation, but you have this word in here, a failure where the people are like, well, I don't like that. I don't want to fail in my relationship. I don't want to. I especially don't want to fail at work where, you know, my job might be on the line or any of those things. How do you go about first building your own relationship to failure where you're fully embracing it. You know, you and I are on stage yesterday talking about failure and showcasing all of that because that's what the, you know, the team here at the Billion Follower Summit, they're like, do talks around failure. And so, okay, we can do that. But how do you shape your own relationship to failure?
Grace Miller
Well, my microphone was actually failing yesterday on stage, which was hilarious. And I was going to call out and say this is a failure.
Nathan Barry
I was very glad that they sorted out the microphones before I came on. Right after you. So thank you for being the guinea pig.
Grace Miller
That's right. But no, I think yeah, when we're younger we are taught to avoid failure. So when you get into adulthood it's really hard to be like, oh, now I just want to fail because you don't have the experience. Like why do we study for a job? Like why do doctors study? It's because they need to learn. It's like if we're not taught that failure is okay throughout school, throughout university or in life, how do you then get comfortable with it? You don't. And so the whole mindset of and why I'm trying to share more about failure to the world is it's the biggest brands, celebrities of like even entrepreneurs, they have all failed. And I know you talked about that yesterday as well. But without those things and without them being comfortable with failure, they wouldn't have got there or they wouldn't have tried to get there. And my favorite one is obviously J.K. rowling and was turned down by 12 book publishers before they published Harry Potter which is the bestselling book series in history. And I just think, God, how do you have the motivation to go to 12 publishers and, and still think this is something and it's really the self belief of to continue going. But in work it can be really hard because you're working for someone else. You're like, oh, I have KPIs to hit, I have to impress my manager if I want a promotion or a pay rise. And so how do I actually make sure I'm doing my best? And but for failure it really has to be a company wide thing to encourage it. So whether it's a culture change, whether it's management saying we want to start doing this, but it's really a mindset of saying failure is going to help us grow because the more things we can learn from what didn't work, the faster we can grow.
Nathan Barry
Right.
Grace Miller
Because if we're not trying anything, we're not going to learn at all. We're just going to keep doing our regular day job. If we're trying things, some things will work, some things won't. And whether that's a subject line on an email, you might test too. One might flop, one might do amazing, or maybe both will flop. Who knows, but we're actually testing it to see what works, what doesn't. You're just doing one. You're never going to know. You're going to have put that one subject line out and gone, cool. Could it have done better? Maybe. Or maybe it would have done worse, but we would have learned from that. And so the whole mindset that we've or Steve has created, which has been amazing, is making sure that no matter what, when someone fails, it's as long as they share a learning from it. It is congratulated. It is like, thank you for sharing that because you have helped to do something new in the company or try something that's different to help us grow. You are helping the company grow by failing.
Nathan Barry
Oh, that's so interesting. So the learning is the key thing. Failure is not celebrated. Failure and learning from it is celebrated.
Grace Miller
You can't celebrate failure alone. You have to actually add a learning to it, because failing. Cool. Like, if I smash this glass in the water. Fine. What, on the floor. Sorry. Yeah, I could smash the glass. Yeah, I've smashed it. What do I do next time? Don't touch the table. But I think what's the learning side is super important to then say, okay, how do we do this better next time? Do we continue down that experiment and try and find the way that does work? Or is that so far removed that it's just going to keep failing? And we know, don't do that again. Try this other way. But it is, I think, the best part that Steve says when someone shares a failure, he's like, thank you for actually going and trying something because that shows you care and you are willing to go and try something new to help this company grow as fast as possible. And he doesn't care that it's a failure. He's like, you just wanted to try, and that is what matters most. Rather than you just sitting there going, I'm not even going to try.
Nathan Barry
There's. I've heard someone phrase it as, in life, I want to commit, you know, sins or crimes of commission, not omission. Meaning, like, I never want to get in trouble or not succeed in my business or my goals or whatever else because I omitted something because I didn't take action.
Grace Miller
Yeah.
Nathan Barry
I want to do it because I took action and it ended up being the wrong action. And I learned from it.
Grace Miller
Yeah.
Nathan Barry
Right. And so, so many people. So many people are paralyzed to try things because they're like, what if it doesn't work?
Grace Miller
Yeah.
Nathan Barry
And, you know, it's one of those It's. It's a total cliche, but it's so true of great. If you don't do. Didn't work.
Grace Miller
Yeah.
Nathan Barry
You have 100% chance of it not working if you don't take action. And then so anything, any possible chance of succeeding requires taking that action.
Grace Miller
Yeah. And I think you always regret not trying, but I don't think you'd ever regret failing and finding out the answer.
Nathan Barry
Right.
Grace Miller
So why would you not at least try and see what does and doesn't work? But it's also hard because you can be in the mindset of the public embarrassment of failure. And I think that's probably what stops people most. And even I grew up in Australia, and I think definitely there, when you're surrounded by all the people you went to school with or university or your first jobs, and you're like, oh, my God, all these people are going to judge me. And then when I moved to London, completely changed. Nothing had I didn't care about public judgment, whether that's because no one in England really knew who I was, but I was just willing to try and fail. And even though they could maybe have seen what I post online and judge, what am I going to do? Like, they're the ones judging. And I loved what Vincent said yesterday in his talk. He said when people say negative comments to him online, he said, I don't want your negativity. You can keep it and you can go and have the negativity. And I was like, that is such a great way, like a mindset to be in of if you failed or have a negative experience. You don't have to worry about public perception or take it with you. It's like, move on, learn and we can grow.
Nathan Barry
Yeah. It's so interesting of thinking about, like, what's the worst case that could happen? Right. You put out content and it's not good. And it's like, well, you know what YouTube's gonna do? They're gonna see in the stats that it's not good and they're not gonna show it to anyone.
Grace Miller
Yeah.
Nathan Barry
You know, so you're like, it's barely going to be seen.
Grace Miller
That's true. It's like, it doesn't matter. But also then you can learn from it and be like, why didn't that work?
Nathan Barry
Right?
Grace Miller
Why did it not get the views? Was I boring? Did I have no inflection or tone or intonation? Was it a topic that wasn't popular online and, like, finding out why? And you know what's interesting is I actually Think we learn more from that than all of the viral ones. Because sometimes you have a viral video and you'll go, what did I actually do in that that I can then replicate? You can do it most of the time and you'll see YouTubers or content creators that will rip off a video 10 times, which is amazing. Get more views, Go do that. But I think you can learn a lot more from what didn't work and be like, why did the retention only last 3 seconds on a 30 second clip? Or finding out those answers.
Nathan Barry
I love Vin's example of like just rejecting someone's negativity because it's like, okay, the thing I'm most afraid of is people commenting in a negative way or that sort of thing. My go to response is when someone says something kind of nasty is I just go, you must be fun at parties. And that usually gets a bunch of. But you know, his example of like, oh, I, I reject your negativity. Like, you can keep that.
Grace Miller
Yeah, it's like psychic.
Nathan Barry
Or the other one that I've seen people use is, I think that would have been better as an inside thought. Some people like where you just reflect it back.
Grace Miller
I just have never, I can't even fathom not to go down the topic of comments, but I have never commented anything negative. So I just don't understand how people can comment something negative. Especially because people are putting themselves out there online and I'm like, that takes a lot of guts because they are willing to maybe fail. So to then go and comment something negative on someone's post, like, how sad that we should all be. Obviously everyone's entitled to their opinion, but we should be celebrating people going and trying and doing something and trying new things. But I love that content creation in general is such a new industry and career. Like there's so many people doing it as a career now, which is incredible.
Nathan Barry
Yeah. So I want to go back to the culture inside of flight story around failure because that there's, you know, these unspoken rules or, you know, that shape a culture. Yeah. And I want to know how Steve and the rest of the leadership like really shape that and say, okay, not only do we celebrate failure, but how we learn from it. And like, what are those, those rituals or those little things that if you were implementing it in another company, you would do.
Grace Miller
We, for the public recognition side, we have an experimenter of the week trophy. So it's this big trophy and a voucher that someone gets for sharing an experiment. It doesn't matter whether it succeeded or failed. But it's the awareness in the team that this is what we celebrate. We celebrate someone trying and they have got this for this week because they did something. So that is one of the public recognition ways. The other side is Steve just really cares about our team and if he sees someone experimenting, trying, even failing, he'll drop a message and be like, thank you so much for doing that, or I can see you're working really hard. Thank you so much for putting in all that effort or the quality of what they're doing. And it's so nice that he cares. And I think when you to create a culture where people are willing to fail, the people at the top. So all of our amazing C Suite as well, our CEO Georgie, they have to have relationships with the people on the team so they feel comfortable enough to say, hey, this didn't work. Work.
Nathan Barry
Right.
Grace Miller
And this is why. And then they go, okay, well, what do we learn from it next time? It's not always positive.
Nathan Barry
Yeah.
Grace Miller
Like, it's not like we go, woo, we failed. Yes, like that.
Nathan Barry
We didn't hit any of our goals.
Grace Miller
Like, it's not always like that. Yeah, obviously we want to hit our goals. We wouldn't want be the second biggest podcast in the world if we didn't want to hit goals. And it's what we're striving towards. We're not, we don't go, oh, we are going to fail. We want to succeed, but we know there's going to be failures along the way. And that's. It's the accepting of that. And so, yeah, Steve, Georgie, our amazing C Suite team are always willing to go, okay, it didn't work. What can we learn? And they even say, Georgie's famous line, which I love, and everyone in the team is encouraged to say is, I don't know. Yeah, I don't know the answer to something. And not to look stupid, it's to be genuinely honest and say I don't know instead of making up something.
Nathan Barry
Right.
Grace Miller
And so it's the whole psychological safety of the team feeling comfortable to say I don't know or I failed, and this is why. And being able to build on from that and you're going to learn. And the learning is so much more valuable because that is what we know. What does and doesn't work on YouTube or what doesn't doesn't work in social media marketing.
Nathan Barry
Yeah. Especially when you're taking it across not just one show, but a bunch of shows. And you're saying, like, look, this is part of what we Bring to the table if a creator wants to launch a show with Flight Story. Right. Is that you're getting all of these learnings.
Grace Miller
Yeah. And we do it with brand partners now as well. It's like when we have ad reads in a podcast, we go and then test their ad read. How do you get the best retention in an ad read? Because most people skip an ad.
Nathan Barry
Right.
Grace Miller
So how do we make people want to stay? And it's not. Yeah. It's not just experimenting on the podcast. It's experimenting in any area possible.
Nathan Barry
Yeah. And carrying that through.
Grace Miller
Yeah.
Nathan Barry
I'm thinking a lot about what gives status in an organization, because whether we like it or not, humans love to play status games, you know, usually subconsciously. And so if you think about like organization design and culture, it's like, okay, well what gets status in the organization? Is it working super long hours? Is it achieving, you know, key results and like that being really visible. And so what I hear you saying is that experimentation get status because, you know, you have a specific award around it. Like, it's pretty overt. And so thinking about that, in each organization, like at Kit, we, we do a lot of experimentation, but we have, we don't have those rituals around really celebrating it. We more tend to celebrate the wins.
Grace Miller
Yeah.
Nathan Barry
Than the, than the experiment itself.
Grace Miller
Most companies do.
Nathan Barry
Yeah.
Grace Miller
Yeah.
Nathan Barry
And so that's something that I'm working on shifting because then it's, you know, right now it's, it's around how do I get a win? Which is great. We should be trying to do that. Yeah, yeah. But you know, you're saying actually it's. It's the pure number of shots on goal or, or that sort of thing.
Grace Miller
It's. It's always the more shots you take. So if you're uploading content on socials, if you upload one video a week, you have one opportunity.
Nathan Barry
Right.
Grace Miller
You upload 10 a week, you have 10 opportunities to go viral. So what is the better option? The 10, obviously, obviously it takes more work, but you have way more opportunities. And so in the 10 experiments I shared, seven are probably going to come back average. You might get two failures, maybe one success without success could be exponential. And the failure side of it, it's interesting. Obviously, it's amazing to share successes or reward success. But I think what can be missed is actually what didn't work. And we do that across all of our shows and bring it together. It's like, is the same thing not working. But also, if something didn't work, could we then make sure that it doesn't get tested everywhere else. If it doesn't need to be. If we know solely that that is not going to work, don't waste your time. Everyone else, the 10 other, if you had 10 shows, 10 other shows don't need to go and waste their time testing it if we know it doesn't work. So it's valuable both ways of the successes of what does work. But also you don't need to go in test things if it doesn't work.
Nathan Barry
How do you log all of the, you know, the shared knowledge from those experiments? Because you have a growing team. People get hired between other teams and companies. You know, you're not gonna retain everyone for all time. And as you're like, okay, we went from 20 people to 40 to 100 to, you know, you need to transfer that knowledge. Look, what systems do you have in place for that?
Grace Miller
Yeah, it's currently a database of all the experiments. But the goal this year which we're currently building is a platform where people can go and input their own experiments to. So previously it's them sending them, but now they'll be able to almost own it. And you can go in, see your experiments, see other people's, their face will be on it. So you can see, hey, Nathan's always running heaps of the experiments, what's going on here? Is he the only one experimenting in the company? Whereas then we'll be able to see what teams are experimenting the most. Are there lots of social learnings we can then take onto another area. And also I think what can be maybe siloed in companies is different areas of social or marketing or production. Whereas there's actually learnings we can take across multiple of them. And so for example, if a specific type of content worked really well on YouTube we could cut it down short form, then put it in email. Then maybe we go and put it in our do a spin off or a special segment of it for our paid community. Then maybe we could take it to a live show. If it's something that could be created into a live show. So the experiments can apply to so many areas. So there's not just one team which is, yeah, I find quite interesting of it shouldn't be ever siloed. It should be the knowledge sharing.
Nathan Barry
Yeah, so I mean the key takeaway there is you have to have a database where you are logging your experiments and that could be as simple as a notion table where each thing gets submitted there and it's tagged by. Yeah the team and the category like this was A copywriting experiment. This was a retention experiment. And then what you can do is now you can have AI, you know, summarize learnings from that. Or you can say, hey, I'm designing an experiment like this to solve that. Has anyone in the company done an experiment like that? And Claude would be, or notion AI or whatever would be very happy to say, like, well, here's the three most similar experiments that have been done in the company. Two of them were done before you joined the team or whatever else. But no, the exact thing you're testing has not been documented in this.
Grace Miller
Yes. And also retesting things. So if someone's tested it and it's six months later, you might go, oh, actually we need to retest that. And see, especially on socials, things move so fast. Does it still hold? Does it not hold? And how long should we retest it within and keeping all the data in there? Like, I know booking.com has an amazing one. Obviously it's easier because they own the platform so you can get proper statistical significance. Whereas some of ours, as I said, are more knowledge based experiments, but we're still able to put them in learn and then apply them to other places. But it's the knowledge sharing 100% that is so valuable.
Nathan Barry
Yeah, that makes sense. I touched on AI for a second. How are you using AI across Flight Story and especially in the podcast production process, but really across the company, because I know that Steve and the whole Flight Story team are pretty obsessed with learning and implementing AI.
Grace Miller
Yeah, honestly, it's across every area. I don't think anyone doesn't use AI in Flight Story. And we had an AI agent competition last year, which was really fun because I'd never thought about building an AI agent. It's not really my area. But stopping my work to then go and try and challenge myself to build it was super interesting. And the things you can build if you take a little bit of time to learn it. When I'm not a developer, I'm not a coder was super valuable. So I built a tool that could translate our social media clips and then upload them themselves as well. Okay, so not I didn't code anything. Like I didn't build an 11 labs, but it was able to use software like 11 labs to then go and almost replace a social media manager. And we're seeing a lot of different AI tools starting to replace certain areas of jobs, but also speed up the process.
Nathan Barry
Yeah.
Grace Miller
So being able to help speed up production, being able to help speed up even designing thumbnails. Especially if it's something that's the same thumbnail every time. But maybe swapping out a guest face or text makes it really easy for AI to do descriptions, titles, even inputting, say you were scripting and for a social clip and inputting your voice into GPT or your tone of voice, sorry, it's GPT so it understands you and then it's coming out straight away perfect in your tone of voice. And the whole team use AI across the board to try and help speed up but also improve the quality of what we're doing.
Nathan Barry
Well, it's a great example, you know, from we're talking earlier about dubbing the clips or the episodes.
Grace Miller
Yeah.
Nathan Barry
And you're saying, well, that would be nice to be able to do, but I don't have a dedicated team member that I could put on that. You're like, well, you can build an agent that will take the file that was uploaded here and go and you know, use the transcript, create this and you know, use the off the shelf tools and run that as an automation so that, you know, now we're just into quality control.
Grace Miller
Yeah.
Nathan Barry
And. And you can reach this new audience without actually having to, you know, do two hours or four hours of work per episode on them.
Grace Miller
Yeah. And it can be basic things. It could be like you want to stay across all of the new features on social media channels and you set up a GPT or an agent to do that for you and it's like
Nathan Barry
giving you a digest of what's changed in Instagram or.
Grace Miller
Yeah. And it's super basic, but it's like, then you don't have to have someone because previously, for the last four years we've had channels called Industry News. Staying ahead where we share, where we go and share them. And I'm like, why am I still doing it? Personally, I do like it because it teaches you something of going to look
Nathan Barry
for and you see what's interesting, what other team members found interesting.
Grace Miller
Yeah, yeah. So I see the value in the human side still, but I actually think to not miss something, it can be really valuable to make sure that no one has missed a specific major update. And so that's a tiny, simple one of being sent news updates, but could speed up the process of needing to take 10 minutes out of your day to go and find those things.
Nathan Barry
Right. Were there any other agents from the agent challenge that stood out that you were like, ooh, this was particularly excellent.
Grace Miller
Ooh, so many. There was some production ones. One of them that wasn't in the AI agent Competition, but has been interesting to see progress is we'd be tested AI podcasts for a little while. So we tested a version with Steve's voice and it's still progressing the test, to be honest, because it's evolved into something else that's launching soon. But even testing the design and getting imagery and things. And it's interesting how far it can be pushed with AI. And I know there was a content creator at the summit who has now got quite a few channels of AI avatars that he's got millions of subscribers on of these avatars on YouTube. And I just thought it's interesting that use of AI, obviously, AI can also help us speed up our work or improve our work. But still, the AI tech side of the production is. Yeah. Interesting to see where that future will go. And will people still be interested in adopting it and watching content like that, or do they want the human people?
Nathan Barry
Right. I mean, do you have a perspective on where the creator economy goes in this world of AI?
Grace Miller
I think it will go down the AI route, definitely. Of translations, I would be intrigued to see. I think there will definitely be AI avatars or AI podcasts. How quickly they get adopted, I'm not sure, purely because I think people are still now converting to wanting humans and human opinions. And even there's the whole debate online right now of is social media too perfect now with AI? And people are now putting in spelling errors on purpose to then make it seem more human. And I'm like, gosh, how sad that we were trying to put spelling errors to make it seem like actually it's me. Whereas like most of my content I write myself. I don't really even use ChatGPT to come up with ideas. I'm like, this is coming to my head. I'm just gonna write it and post on LinkedIn. But I know obviously it's amazing.
Nathan Barry
Cause the people who use AI for their LinkedIn posts in the most basic way, you're like, I can see through it a mile away. And I'm just not. I'm gonna scroll right past it.
Grace Miller
Yeah. And it's like, I do still like the human side. And I think. And I think most people will be on that for a little longer. What do you think, Nati? Where do you think it will go?
Nathan Barry
I mean, it's obviously going to augment every single workflow, allow people to build, like, substantial reach with small teams. You know, I saw a creator, her name's Allie, and she does a lot of painting and art, and she ran a whole series of of ads, like, so short form reels and all that run as. As ads on Instagram and. And Facebook. And it's like, hey, this is Ali's AI clone. And, you know, and she's able to do these different things. And, you know, now she's on a boat painting, and then she's over here and wow. You know, and it looks like her, but it's clearly AI and she names that it's. Yeah, it's her AI clone. And she did it in an interesting way and it was about retention and. And then I got one of her other ads and it was definitely her, you know, an actual video of her. And so the dynamic, like, going back and forth, she stopped the scroll by saying, you know, and she kept her attention up in these different. With her AI avatar. So that's all really interesting. I also see creators, especially on YouTube, there's a wave of people who are. It's kind of like putting the spelling errors in, but going to much more analog formats, like creators who are shooting on camcorders, where you're like, wait, you're going to 1997 technology, you know.
Grace Miller
Yeah.
Nathan Barry
Because. And you're. You're recording on actual, you know, the film cassettes or whatever. And. And because they're saying, oh, we're going the opposite direction. And so it's less about polish and it's back to storytelling and human connection.
Grace Miller
Yeah.
Nathan Barry
So I'm obviously making, you know, similar to you making a huge investment in the creator economy and. And all of that. I don't think it'll go anywhere, but I think that people will continue to crave human connection and human stories.
Grace Miller
Yeah.
Nathan Barry
Over the, like, polished. Perfect.
Grace Miller
Definitely. And I think as well, what will then happen with events like this.
Nathan Barry
Right.
Grace Miller
Like, where people who were so excited to see MrBeast or other creators is then, like, if they're an AI avatar, who are you excited to see? Like, who do you run up to? Where's the human side of being excited to see your favorite creator in real life?
Nathan Barry
This event has been fascinating because if you just, you know, you hang out in the hotel lobby where all the speakers are or whatever else, and you just meet tons and tons of people and. Right. And we're, you know, flying. My flight was almost 15 hours, right. To get here to Dubai, and it's so worth it. And not just because you can see, you know, Mr. Beast walk by and go, oh, he's taller than I thought he was, you know, or connected with all these people, but it's about the human connection and I think that's going to continue to ramp up.
Grace Miller
Yeah, it's spot on. I agree.
Nathan Barry
One other question that I want to ask, and this is entirely a selfish question, and so I typically save it towards the end. This is the. A question about getting the right audience. So something that I do for my show is I care not about views. I care about attention from the right people. And so with our podcast team, they'll often say, hey, do an episode for beginners, and title it like this and all of that. And I'm like, I'm never gonna do an episode for beginners because there's tons and tons of content out there.
Grace Miller
Yeah.
Nathan Barry
And so on one hand, we're like, hey, we wanna reach more people. We want more views. But I'm saying I only want to reach the creators who have, you know, who are making hundreds of thousands of dollars. I care about the right people, not the most people.
Grace Miller
Yeah.
Nathan Barry
And that goes against most advice on YouTube or if someone's like, okay, here's how to get more views for your podcast.
Grace Miller
Yeah.
Nathan Barry
How do you think about these. These shows or channels that have a very targeted audience that they're after and, like, seeking out the right views versus as many as possible.
Grace Miller
I am actually in that camp. I am in the idea of creating a community that are super highly engaged because that will grow. And there's usually more people like that community. So even if it was only a thousand people at the start, or even 100 people that are really highly engaged and love your content and subscribed and do everything you say because they take it as biblical, they are going to know other people like them and they're going to say, hey, you need to come watch this.
Nathan Barry
Right.
Grace Miller
Or, I really liked this. And share it to their community online or on their Instagram page, and people like them will see it. So I actually think, even though people want a viral video, especially on short form, I think viral and short form can absolutely mean nothing in, like, the context of your career, because you can go viral and a video every week and it might not actually help progress anything. Whereas when you look at long form, it's actually where you're building that community. People are willing to sit here and listen to you for an hour. They actually are interested in you and, like, you provide really good information. I want to keep coming back. And that, I think, is better quality than something like a challenge video where people might watch for 10 minutes, have an affiliation, or know your face, but not actually be willing to say, you did a course. Come on your course. Or buy your tech if you were selling or whatever, like products and that real community side, I think that is so much more valuable long term than a view or a viral video could ever get. And having a niche specifically because I know what I'm coming to you for. Like what we said before, that podcast is known for X.
Nathan Barry
Right.
Grace Miller
Whereas you could be like, oh, the podcast talk about this, this and this and this. And I don't even remember what the name is. Whereas it's like, I know I'm going to that creator for this. Like Colin and Samir. You know what, you go to their content.
Nathan Barry
It's very focused.
Grace Miller
Yeah, yeah. Which is amazing. And I'm like, I actually thought it was cooler to see Samir than MrBeast.
Nathan Barry
Yeah.
Grace Miller
I obviously love what Mr. Beast does, but I was like, Samir, I was like, that's so cool. He's. He's so amazing. But it's obviously in the industry. But I think being in that industry, like, can be so much more valuable to the people there. And it will grow. And it's a long game anyway, no matter what industry you're in, whether it's doing Mr. Beast s videos or Colin and Samia, it's still going to take a while to grow. No matter whether it's growing to 100,000 or 100 million.
Nathan Barry
Yep. That was. I had the same experience as you did. So at the speaker's dinner last night, right? There was this. I mean, I say speakers dinner.
Grace Miller
Yeah.
Nathan Barry
There's like, there's hundreds of speakers at this event, so it's wild who they've flown in and, and all of that. But there was this group and it was Mr. Beast and the yes theory folks. And you know, I was looking at this like, group of maybe 12 people or whatever, and you're like, oh, there's hundreds of millions of YouTube subscribers represented by this, this little circle. But, and, but I had the exact same thought, right? Like, Samir and Jimmy were sitting next to each other and I was like, oh, I really want to say hi to Samir.
Grace Miller
Yeah.
Nathan Barry
You know, and I know, like, we've talked on the phone and we met before and all that, but it was one of those things where I. He, like, waited until he got up because I was like, there's no way I'm going to come and interrupt. Also, like, Jimmy has his security standing around and all that, but once Samir left that conversation, then I like, made sure to seek him out.
Grace Miller
And I think it's cool. Like, I just thought, well, and I think that's nice is creators that are. That have. But I think it's dedication. Yeah, it's like dedicated. Really niche, interesting topics to talk about rather than. I don't even know if I met Mr. Beast. I don't know what I talked to him about. Maybe YouTube, but it's not as specific as like the conversation you could have with Samir.
Nathan Barry
Yeah.
Grace Miller
Be so interesting. So. Yeah, I agree. It's so funny.
Nathan Barry
Okay, so the last category of experiments that I want to know about is the experiments that you're running. Personally, I see you building your personal brand, posting a lot. Like what's something that you're experimenting with either that you've recently learned or the experiments that you have out there that you're still waiting to see the results from.
Grace Miller
Yeah. I had previously for the last few years only focused on LinkedIn and now I thought actually I need to diversify and I'm experimenting with Instagram now. So pushing out the boat a bit, doing more, more video content. But also there's so much to experiment with on reels, even on carousels alone. So how do I make sure the retention stays up? What sort of hook do I add is the font? Because there's so many videos with fonts out there that you can't even read. How do you make sure the font's engaging? What's the ideal length? So this. Honestly, it's a challenge. And especially while having a full time job and trying to do content creation on the side, it's a challenge, but the best way possible. Because not only am I learning from creating content, I'm then able to take those learnings and experiments and apply them back to my work at Flight Story, which is really interesting to have kind of a whole full flywheel of testing, learning and then applying it back to my full time work.
Nathan Barry
I like that. What would you say is the 80, 20 or the 9010 of the most effective things for you as a creator? Building your personal brand when you have like such a narrow window of time. Yeah, because I don't think that Flight Story is a four hour work week. You know, type the vibes I get is everyone is very committed, working very, very hard.
Grace Miller
We have a call at 11pm tonight on a Saturday. So that's not often. But yes, the times I being here. But yeah, it's I. When I come up with ideas, I just write them in my notes and put them all away for later. Because if I'm on the train or something, I'm obviously not filming it then. And a lot of it is done on my weekend. So a lot of it is trying to fit as much in in the evenings or the weekends. I have a train journey to and from work. So I also try and do a bit of editing then. But also realizing when is the time to delegate and pass things off and say actually I need someone else to edit this for me or do it. But I really want to challenge myself right now to do it. To learn more. More.
Nathan Barry
Yeah.
Grace Miller
About what works, what doesn't on socials. Why. And it's a good challenge. Like I want to try and see how do you get a video that's super engaging? Or how do I increase shares on a video that people go actually I want to share that with a friend that was really good or that really resonated and learning and putting. I. It's about putting the time into it though. Because that's when it really happens. Is it's not going to happen if I post once a month. The growth will happen when it's once a day.
Nathan Barry
Right. What's a metric that you're targeting in your personal brand right now?
Grace Miller
I Not really a specific number of followers or anything. It's more how often can I post?
Nathan Barry
Yeah.
Grace Miller
I would love to get to posting once a day, specifically on Instagram. I just need to get the time to film more content and I have videos edited, recorded. I need to edit them. So it's that time and dedicating the time to put into it. But it's. Yeah. Output right now rather than any specific number.
Nathan Barry
Well, I think it's such an important thing of the takeaway that I want people to have from what you just said is focusing on lead indicators versus lagging indicators. Right. And you said what I can control.
Grace Miller
Yeah.
Nathan Barry
Is the effort that I put in.
Grace Miller
Yeah.
Nathan Barry
You know, okay, we're posting once a day. I can control that. I can't control how many views something gets. No, I can have the inputs and the learnings and if I keep iterating then presumably given enough time we'll get
Grace Miller
to the output and it's the taking more shots. Like the more. Even though I know there's the whole debate of quality versus quantity and I agree. I still think even if you're going for quantity, you still need a high quality video. If I'm choosing to post every day, but I still think the more shots I'm taking, maybe one in seven will do. Okay. The other six might fail. And I'm sure you'll. People will look at my channel and be like, oh God, she's failed. So many times. But it's the taking the chance to put it out there, seeing what works and what doesn't. And what can I learn to grow from that?
Nathan Barry
And then I think there's also something of being hands on yourself, of seeing exactly like now because I've studied a little bit more and starting to learn Instagram more, I go through and I realize, oh, this video is designed to get comments or this video is designed to get shares and. And you can see the little things that if I wasn't like really trying to study it myself, I wouldn't have picked up on. If I was just like, oh yeah, hire a team and they'll and delegate. Who wouldn't have picked up on any of that?
Grace Miller
Yeah, I love, I love the whole strategies and I think love LinkedIn. But what you can do on Instagram and what you see other content creators doing styles or tiny little hacks.
Nathan Barry
Right.
Grace Miller
It's interesting of how it can develop and grow. Yeah.
Nathan Barry
Yeah, that sounds good. Grace, this has been amazing. Where should people go to follow you as you build your personal brand and learn from your experiments and your failures and all of that?
Grace Miller
My Instagram is Grace Experiments and then my LinkedIn is just my name, Grace Miller. And then obviously watch all of the flight story shows. I don't have a podcast, but I work on so many amazing podcasts and obviously this podcast they should listen to. So go for a second time and listen to it again.
Nathan Barry
Sounds good. Thank you so much for coming on.
Grace Miller
No, thank you for having me.
Nathan Barry
If you enjoyed this episode, go to YouTube and search the Nathan Barry show. Then hit subscribe and make sure to like the video and drop a comment. I'd love to hear what some of your favorite parts of the video were and also just who else you think we should have on the show. Thank you so much for listening.
"How I Helped Grow Diary of a CEO to 14M Subscribers" with Grace Miller
Date: March 19, 2026
Guest: Grace Miller, Head of Failure and Experimentation at Flight Story
In this in-depth episode, Nathan Barry speaks with Grace Miller, the Head of Failure and Experimentation at Flight Story—the powerhouse behind "Diary of a CEO" and other hit shows. They dive into the real experiments (and failures) that fueled Diary of a CEO’s rapid growth to over 14 million YouTube subscribers. Grace shares actionable insights on channel strategy, leveraging YouTube features, designing experiments, building a culture that embraces failure, and the future of AI in the creator economy. This episode is a must-listen for creators seeking practical playbooks for audience building, retention, and working smarter on modern platforms.
“When I started four years ago, we were on 100,000 subscribers on YouTube and then now up till today, we're at over 14 million. So it has been insane growth…”
— Grace Miller (02:28)
“We thought, okay, if we put two [clips] out every day, we'll double views…It didn't double views. It actually decreased reach…”
— Grace Miller (05:27)
“We now fully believe on the same channel is the best way… The actual conversion funnel is so much smoother.”
— Grace Miller (12:27)
“I think posts people obviously are not even thinking about or maybe thought wasn’t very useful. But that is a big one.”
— Grace Miller (16:53)
“We just started the Spanish Spotify channel as well. On the 1st of January, it launched… We've been testing it for a few years, but this truly is the year and the growth has just been insane…”
— Grace Miller (33:47, 34:44)
“We look at the company overall goals and KPIs first […], and every single experiment should be aligning to either learn new knowledge of how you can get there or gain more subscribers.”
— Grace Miller (35:53)
“You always want a specific percentage of new people returning. That means they're coming back for more. They're hooked.”
— Grace Miller (39:33)
“The whole mindset that we've—or Steve has created, which has been amazing—is making sure that no matter what, when someone fails, it's as long as they share a learning from it. It is congratulated.”
— Grace Miller (57:53)
“Honestly, it's across every area. I don't think anyone doesn't use AI in Flight Story.”
— Grace Miller (72:13)
“I am actually in that camp. I am in the idea of creating a community that are super highly engaged because that will grow.”
— Grace Miller (81:29)
“It's the taking more shots. Even though I know there's the whole debate of quality versus quantity … I still think the more shots I'm taking, maybe one in seven will do. Okay. The other six might fail...it's taking the chance to put it out there…”
— Grace Miller (89:00)
On embracing experimentation:
“It's not an experiment unless you define the criteria.”
— Nathan Barry (06:01)
On posting frequency:
“Upload one video a week, you have one opportunity… Upload 10 a week, you have 10 opportunities to go viral.”
— Grace Miller (67:57)
On culture:
“Failure is not celebrated. Failure and learning from it is celebrated.”
— Nathan Barry (58:01)
On AI’s “human” counter-movement:
“People are now putting in spelling errors on purpose to then make it seem more human.”
— Grace Miller (77:12)
On community:
“Long form... is actually where you're building that community. People are willing to sit here and listen to you for an hour. They actually are interested in you.”
— Grace Miller (82:00)
This episode is essential listening for creators, operators, and marketers wanting to supercharge their experimentation, build lasting communities, and win in the next wave of the creator economy.