Podcast Summary: DTC Podcast - Ep 520: How Pilothouse Tests 30+ Creatives Weekly on Meta: A Practical Guide | AKNF

Release Date: June 27, 2025

The DTC Podcast, hosted by the DTC Newsletter and Podcast team, delves into the dynamic world of direct-to-consumer (DTC) ecommerce, exploring strategies around marketing, funnels, and scaling operations. In Episode 520, titled "How Pilothouse Tests 30+ Creatives Weekly on Meta: A Practical Guide," the conversation centers on optimizing creative testing on Meta platforms, leveraging AI-driven advertising systems, and navigating the evolving landscape of ecommerce marketing.

1. Current Landscape of Meta Advertising

Eric Dick initiates the discussion by providing a market temperature check on Meta advertising:

• CPMs Decline: "CPMs have been down a bit the past month. Cost of traffic is more affordable right now." (00:00)
• Rising Returns: "Overall returns seem to be climbing a bit." (00:00)
• Seasonal Lull: July and August are typically slower months; hence, it's essential to "stock the pond as much as possible" during this period to build momentum for the busier Q3 and Q4 (00:00).

Taylor adds that the platform is in a transitional phase, adjusting post major holidays like Mother's Day and Father's Day, with brands preparing for increased activity in the latter half of the year:

• "We’re just a few days from the official start of summer... brands are starting to get ready for going up in volume and being prepared to jump into Q3, Q4." (02:13)

2. Creative Testing at Scale on Meta

The core of the episode revolves around scaling creative testing, where Jacob inquires about the methods employed by Pilothouse to manage high-volume testing:

• Cody Plofker's Post: Discusses testing over 30 creatives weekly using Ad Set Budget Optimization (ABO) (03:55).

Taylor emphasizes the nuanced approach to testing, highlighting that strategies vary based on brand needs and account specifics:

• "Some brands... launch net new concepts directly in a scale campaign. There are some brands I work with where I run the ABO structure given the creative volume and the performance of ABO." (04:41)

Eric Dick elaborates on the purpose-driven testing:

• For quick identification of winning ads, Advantage Plus may be more effective.
• For apples-to-apples comparisons, especially when testing creative variations like color schemes, ABO ensures equal spend for meaningful insights (06:31; 08:14).

3. Meta’s AI Delivery Systems: Andromeda, Lattice, and GEM

The discussion touches on Meta's proprietary AI systems that drive ad delivery and optimization:

• Andromeda Lattice and GEM: Referenced as Meta's advanced algorithms aiming to enhance ad performance through self-learning mechanisms.
• Jacob's Query: Seeks clarification on how these systems influence testing strategies (10:05).

Eric Dick explains:

• These systems are integral to Meta's AI-driven approach, where manual intervention via ABO might seem contrary to Meta's push for automated optimization.
• However, a balance is necessary as these AI systems are still evolving, necessitating strategic manual oversight (10:36).

4. Strategies for Creative Testing: ABO vs. CBO

Taylor and Eric Dick discuss the pros and cons of Ad Set Budget Optimization (ABO) versus Campaign Budget Optimization (CBO):

• ABO allows for controlled testing with dedicated budgets per creative, facilitating detailed insights.
• CBO, particularly Advantage Plus, leverages Meta's AI to dynamically allocate budgets towards high-performing creatives, potentially faster in identifying winners (12:26; 13:53).

Jacob raises concerns about wasted spend and the hit rate of creatives in ABO, to which Eric responds by highlighting the importance of:

• Allocating sufficient budget per creative to give them a fair chance.
• Utilizing broader metrics beyond conversions, such as clicks and add-to-carts, to inform decisions (08:14; 09:17).

5. Challenges in Health and Wellness Advertising on Meta

The episode addresses specific challenges faced by health and wellness brands:

• Data Limitations: Restrictions on personal identifiable data and conversions hinder effective audience targeting and campaign performance.
• Health and Wellness Death Spiral: As discussed by Jonathan Snow, the inability to track purchases leads to poor campaign performance and budget inefficiencies (19:43).

Eric Dick advises:

• Utilizing third-party reporting tools like North Beam to bridge data gaps.
• Mapping out pre and post-campaign data to maintain insights despite Meta's limitations (19:43).

6. Alternative Platforms: The Rise of Applovin for Health Brands

With Meta's constraints, many health and wellness brands are pivoting towards Applovin:

• Increase in Adoption: Brands seeking better data tracking and performance metrics are allocating more budget to Applovin.
• Performance: Applovin remains a strong contender in the ecommerce space, offering robust creative options and scalable advertising solutions (20:47; 21:01).

Taylor notes:

• While Applovin has its challenges, its growth potential makes it a valuable platform, especially as brands near Q4 and seek diversified advertising channels (21:18; 21:23).

7. Leveraging Seasonal Events: Prime Days and Beyond

The conversation highlights the strategic use of Prime Days in Meta advertising:

• High Buying Intent: Prime Days generate significant consumer intent, which brands can capitalize on through targeted campaigns.
• Campaign Strategies: Brands run Prime Day sales on their websites, sometimes aligning prices with Amazon to capture both Meta-driven and Amazon-driven traffic.

Eric Dick emphasizes:

• Focusing Meta campaigns on driving purchases directly through their platforms or websites rather than diverting traffic to Amazon, preserving profit margins (22:31; 22:55).

8. Conclusion and Forward Look

As the episode wraps up, the hosts express optimism for the approaching Q4, anticipating robust campaign performances driven by strategic creative testing and leveraging multiple advertising platforms.

Eric Dick summarizes:

• "It seems like it's going to be a good one," referring to the anticipated success in Q4 marketing efforts (22:40).

Notable Quotes:

• Eric Dick: "CPMs have been down a bit the past month. Cost of traffic is more affordable right now." (00:00)
• Taylor: "Some brands... launch net new concepts directly in a scale campaign." (04:41)
• Jacob: "When you're testing a lot of different concepts in an ABO, you're forcing spendies. Things scale too slowly." (10:10)
• Eric Dick: "If you're just testing to find the winner, Advantage Plus probably makes more sense now." (06:31)
• Taylor: "Meta's kind of stance... is really lean on the machine learning and like just keep fueling it with content." (11:51)

This episode provides invaluable insights for DTC brands navigating the complexities of Meta advertising, emphasizing the importance of strategic creative testing, understanding platform-specific algorithms, and adapting to evolving ecommerce trends. By balancing automated systems with manual strategies, brands can effectively optimize their campaigns to achieve sustained growth.