Podcast Summary: Behind the Numbers – Why Measurement Is Harder Today, and The Ways It Needs Improving with Nielsen: Part 2
Episode Date: November 10, 2025
Host: Marcus (EMARKETER)
Guests:
- Max Willins (Principal Analyst, EMARKETER)
- Alison Gensheimer (Head of Performance Marketing, Nielsen)
- Matt De Vit (SVP and Head of Advertisers and Agencies, Nielsen)
Main Theme
This episode explores the evolving challenges in marketing measurement, focusing on why measurement is harder for advertisers today and what needs to improve. The conversation centers on industry fragmentation, shifting metrics, and actionable advice for marketers looking to reassess and navigate the complex measurement landscape.
1. The State of Measurement: Harder, Not (Necessarily) Worse
-
Complexity and Fragmentation
- Matt De Vit notes that measurement isn’t necessarily worse today but is definitely harder due to data fragmentation and lack of transparency. Previously, disparate data sources could be stitched together more easily; now, there are far more data silos that don't connect. ([05:38])
- Notable Quote:
"When I first started in marketing analytics, we were able to bring together disparate data sources more easily... Now, it's more fragmented than ever before." ([06:34])
- Identity challenges and walled gardens (closed ecosystems) hinder holistic measurement.
-
Volume vs. Value of Data
- Discussion about whether more data is better, or if better models and transparency matter more. Having more data isn't always the solution, especially when insights from different sources don’t talk to each other.
-
Increased Channel Complexity
- Alison Gensheimer underscores the challenge as people bounce between channels more than ever. Past systems for re-linking fragmented data often break, forcing continual reinvention. ([07:40])
- Notable Quote:
"We used to kind of be able to piece it back together. Now it's like every time we find a way... we lose that way and have to start over, try something new." ([07:48])
-
Pressure from Leadership
- Max Willins highlights growing pressure from CFOs and leadership to prove ROI with precision, adding to the difficulty in an increasingly complex ecosystem. ([09:00])
- Notable Quote:
"You also have the CFO going... you have to prove this works. A directional thing is not going to cut it." ([09:24])
2. "Easier" Isn't Always "Better": Shortcuts and Trade-Offs
-
Go-to Solutions & Risk Aversion
- Marketers increasingly rely on solutions that pass the internal scrutiny ("get through the meeting") but may not be holistic or long-term focused. This breeds a culture where risk-averse, tried-and-true solutions are favored (“nobody ever got fired for buying IBM” principle). ([10:57])
- Notable Quote:
"In the absence of that clarity... you just kind of reach for the thing that passes muster with other stakeholders." ([11:10])
-
User Experience vs. Measurement Depth
- Digital platforms have made campaign management and basic measurement very easy, but this simplicity often masks the lack of holistic insights across platforms. ([11:31])
3. Changing Metrics and Redefining Success
-
Shift from Top-of-Funnel to Outcome-Driven Metrics
- Alison argues that marketers are adept at working with what they have, even as metrics shift from reach and frequency to true business outcomes – but this shift requires a new definition of what success means. ([12:24])
- Notable Quote:
"It's not as much of a transition as redefining what success looks like in this new space." ([12:27])
- Marketers must regularly defend and explain their chosen KPIs, unlike other professions where metrics go largely unquestioned. ([13:35])
-
Importance of Help and Cross-Functional Collaboration
- Alison suggests marketers should not hesitate to ask for help, particularly leveraging data science teams and holistic business data, not just marketing stats. ([14:09])
-
Brand Building vs. Short-Termism
- Matt emphasizes the foundational value of brand-building, which is harder to measure but crucial for market share growth. He cautions against obsessing over short-term performance at the expense of long-term equity. ([15:20])
- Notable Quote:
"If you're a large brand... the goal is to increase your market share. A lot of it starts with brand building... and that is hard to quantify in the short term." ([15:24])
-
Diverse Measurement Methodologies
- Max shares research showing 88% of marketers plan to invest in at least one of five measurement approaches, and most in more than one, revealing a widespread appetite for multi-faceted measurement. ([17:50])
- Notable Quote:
"We are seeing signs that marketers are... doing what they can to sort of look at this from multiple angles." ([17:53])
4. Actionable Advice and Recommendations (Summary Begins ~[19:30])
-
Follow the Customer
- Alison’s advice: Align measurement strategies with the actual customer journey/experience—even when the data is messy. ([19:53])
- Notable Quote:
“If you follow the customer, you can't go wrong.” ([20:13])
- Don't get stuck in “spreadsheet land”; look at the big picture and seek out partners who share your appetite for solving today’s and tomorrow’s challenges.
-
Plan Deliberately
- Matt recommends rigorous preparation ("Boy Scout model: be prepared")—focus not just on allocating spend, but truly understanding who the audience is and delivering tailored, distinctive messages. ([21:27])
- Avoid commoditizing budget allocation; strategy must drive planning, not just optimization for lowest CPMs.
-
Know What Drives Your Results
- Max warns against 'black box' measurement solutions. Marketers must understand the mechanics behind the models they use; otherwise, they risk trading one opaque system for another. ([23:11])
- Notable Quote:
"Make sure you understand where the results come from... because you don't want to trade one black box for another." ([23:11])
5. Notable Moments & Quotes with Timestamps
- On Data Fragmentation:
"Fragmentation is a fundamental problem for things like holistic measurement and transparency." – Matt ([07:15]) - On the Marketer's Scrutiny:
"No one walks up to an accountant and says, 'No, I completely disagree.' But marketers... their metrics are disagreed with, their KPIs are challenged, they're sent back to the drawing board." – Alison ([13:35]) - On Brand Building:
"A lot of that is just creating... the mental availability of your brand... a baseline you build performance off of." – Matt ([16:16]) - On the Need to Ask for Help:
"I think what I want to just ask everybody else to is ask for help... because you are doing it on top of your day job." – Alison ([14:02]) - On Deliberate Planning:
"I think one of the initial solves is, be really deliberate in planning... Not just big channel allocations, but who is my customer? Where are they? Build plans to reach that audience with a distinctive message." – Matt ([21:27]) - On Understanding Measurement Models:
"Make sure you really understand how the different inputs that go into it tune the results... you just want to have that visibility." – Max ([23:11])
6. Timestamps for Key Sections
- 00:00–04:51: Introductions and Icebreakers
- 04:51–10:57: Is Measurement Harder or Worse Today? Why?
- 10:57–12:24: Digital Measurement, Ease vs. Holism
- 12:24–19:30: Transitioning & Redefining Metrics; Marketers’ Resilience
- 19:30–23:57: Advice for Marketers: Navigating the New Measurement Landscape
- 23:57–end: Episode closeout and further reading
TL;DR
Measurement is objectively harder today, not for lack of effort but due to data fragmentation, channel complexity, and executive pressure. Marketers must redefine “success” beyond old-school metrics, adapt to new measurement realities, ask for help, and understand the mechanics of their models. The key advice: Follow the customer, plan deliberately, and demand clarity in measurement tools—because as the industry evolves, only holistic, transparent practices will drive confident decisions and true value.
