The Monopoly Report: Episode 23 Summary – Rick Bruner on The Value Proposition of Measurement

Release Date: March 26, 2025

In Episode 23 of The Monopoly Report, host Alan Chappelle engages in a thought-provoking conversation with advertising measurement expert Rick Bruner. This episode delves deep into the intricacies of advertising measurement, highlighting the critical distinction between input metrics and outcome metrics, and explores the challenges posed by major tech companies' walled gardens in providing transparent and reliable measurement tools.

1. Introducing Rick Bruner

Rick Bruner brings over two decades of experience in advertising research and analytics to the table. Beginning his career at DoubleClick in 2004, where he led the research department, Bruner later transitioned to Google post-acquisition, overseeing research for North American ad sales. His career trajectory includes significant roles at Viacom and Marketing Evolution, culminating in founding Central Control, a company dedicated to leveraging high-quality experiments for measuring advertising efficacy.

Rick Bruner [02:15]: "I've been in this field of advertising research and analytics for certainly more than 20 years."

2. The Fundamentals of Advertising Measurement: Inputs vs. Outcomes

Bruner underscores the importance of distinguishing between input metrics—such as impressions, reach, frequency, and audience definitions—and outcome metrics, which focus on the actual impact of advertising, specifically incremental sales. He emphasizes that while input metrics are essential for understanding what is being delivered, it is the outcome metrics that truly reflect the return on investment (ROI) advertisers seek.

Rick Bruner [04:21]: "The outcomes is what I focus on in particular... it's really the outcomes that are the key piece and the one that's more neglected by the industry generally to measure them."

3. The Critical Role of Incremental Sales Measurement

At the heart of effective advertising measurement lies the ability to quantify incremental sales—sales that occur as a direct result of advertising efforts. Bruner argues that without accurately measuring these outcomes, advertisers are left in the dark about the true efficacy of their campaigns, relying instead on less reliable attribution methods.

Rick Bruner [06:42]: "I've have a good understanding of the inputs side of the equation too... but to my mind it's really the outcomes that are the key piece and the one that's more neglected by the industry generally to measure them."

4. Embracing Scientific Rigor: Randomized Controlled Trials

Bruner champions Randomized Controlled Trials (RCTs) as the gold standard for measuring causality in advertising. Unlike quasi-experimental designs or mixed models, RCTs provide the most reliable evidence of whether advertising efforts are truly driving incremental sales.

Rick Bruner [09:17]: "I'm in market selling the gold standard, which is randomized controlled trials, which science agrees is the best way to measure cause and effect."

5. Navigating the Challenges of Walled Gardens

A significant portion of the discussion centers on the challenges posed by major tech companies—often referred to as "walled gardens" like Google and Meta—in delivering transparent and effective measurement tools. Bruner criticizes the reliance on proprietary algorithms and black-box optimization tools, such as Google's Performance Max (PMax) and Meta's Advantage Plus, which limit advertisers' ability to conduct independent and accurate measurements.

Rick Bruner [10:53]: "They have about 75 other ways available to you to measure effectiveness, most of which are not as high quality evidence attribution... their new programs... is a dangerous proposition to let the seller grade its own homework."

6. Geo Experiments as a Solution

To circumvent the limitations of walled gardens, Bruner advocates for the use of geo experiments—large-scale geographic experiments that randomize designated market areas (DMAs) into test and control groups. By deploying ads in test areas and withholding them in controls, advertisers can accurately measure the impact of their campaigns on incremental sales using reliable, privacy-agnostic data.

Rick Bruner [10:53]: "We randomize them, which is that gold standard, into test and control groups and have media companies serve the ads in the test group and not serve any ads in the control group."

7. Addressing Privacy Concerns in Geo Measurement

While geo experiments offer a robust method for outcome measurement, Bruner acknowledges the inherent privacy challenges, particularly when targeting small zip codes that may inadvertently reveal personal information. He suggests strategies such as aggregating zip codes or implementing registration requirements with non-identifiable burner IDs to mitigate these concerns.

Rick Bruner [19:22]: "If people were to appreciate why this is important and worth doing and the media companies were to establish on this, it would solve so many problems."

8. Incentive Structures Hindering Accurate Measurement

Bruner highlights the conflicting incentives within the advertising ecosystem that deter advertisers from adopting rigorous measurement practices. Agencies, for example, may prioritize higher-spend areas where they receive greater commissions, regardless of the true ROI. Additionally, the allure of easy, albeit less accurate, measurement tools often leads advertisers to settle for subpar methodologies.

Rick Bruner [24:04]: "Nobody dies if you get the ad budget wrong. And lots of people have conflicting incentives to improve it."

9. Case Studies: Companies Leading the Way

Bruner cites companies like Netflix, Booking.com, Airbnb, Uber, and Wayfair as exemplars in adopting rigorous measurement practices. These organizations invest heavily in scientific measurement teams, enabling them to make data-driven decisions that optimize their advertising spend and enhance market competitiveness.

Rick Bruner [26:36]: "Booking.com, Airbnb, Uber, Wayfair. They have teams of people doing this kind of thing."

10. Conclusion: The Path Forward for Advertising Measurement

The episode concludes with a reflection on the necessity for the advertising industry to embrace scientific measurement methods. Bruner advocates for industry-wide standards and collaboration to overcome the barriers posed by walled gardens and internal incentive misalignments. By prioritizing accurate outcome measurement, advertisers can ensure their budgets are effectively driving incremental sales, ultimately leading to more informed and strategic advertising investments.

Rick Bruner [28:45]: "Causality is hard for people to grok. It really is. It's weird."

Notable Quotes

• Rick Bruner [04:21]: "The outcomes is what I focus on in particular... it's really the outcomes that are the key piece and the one that's more neglected by the industry generally to measure them."
• Rick Bruner [09:17]: "I'm in market selling the gold standard, which is randomized controlled trials, which science agrees is the best way to measure cause and effect."
• Rick Bruner [10:53]: "They have about 75 other ways available to you to measure effectiveness, most of which are not as high quality evidence attribution... their new programs... is a dangerous proposition to let the seller grade its own homework."
• Rick Bruner [19:22]: "If people were to appreciate why this is important and worth doing and the media companies were to establish on this, it would solve so many problems."
• Rick Bruner [24:04]: "Nobody dies if you get the ad budget wrong. And lots of people have conflicting incentives to improve it."

Final Thoughts

Rick Bruner's insights shed light on the critical need for accurate and transparent advertising measurement. As the industry grapples with increasing complexities and the dominance of major tech platforms, the adoption of scientifically rigorous methods like randomized controlled trials and geo experiments becomes imperative. For advertisers aiming to maximize ROI and maintain competitive edge, embracing these measurement strategies is not just beneficial—it is essential.

For more in-depth analyses and discussions on big tech's antitrust issues and their impact on the advertising economy, subscribe to The Monopoly Report and stay informed with the latest insights from industry thought leaders.