Podcast Summary: Voices of Search

Episode: The Evolution of Engagement Metrics Over the Next 18 Months

Date: September 18, 2025
Host: Tyson Stockton
Guest: Daniel Hurwitz, Informatica

Main Theme & Purpose

In this episode, host Tyson Stockton and guest Daniel Hurwitz explore how engagement metrics in SEO and content marketing are evolving, particularly as more user interactions happen within AI-driven experiences (like "AI mode" in Google). They discuss the increasing fragmentation of data, the challenges in measurement, and how strategies and reporting must adapt for the future.

Key Discussion Points & Insights

1. Increased Fragmentation of Engagement Metrics

• Daniel Hurwitz: Engagement data is becoming "more fragmented and less measurable" due to AI-driven experiences.
• Current analytics tools do not capture user interactions within AI summaries or AI agents, making traditional tracking harder.

"I mean, the fact that we can't track metrics from AI overviews or AI mode in Google Search Console is honestly insane. So it's like we're just kind of flying a little blind."
(Daniel Hurwitz, 00:55)

• The absence of granular data means marketers operate with limited visibility, especially regarding AI-generated content consumption.

2. The Challenge of Attribution in AI-Driven Environments

• The guest raises concerns: How do we track the experience of an AI agent visiting a website? Are traditional user metrics still relevant?
• There's an expectation that, for at least a year, uncertainty will persist about what can be measured and attributed.

"Are we going to get the same kind of user metrics that you would from a human user at a browser? I mean, I don't know if that's answerable."
(Daniel Hurwitz, 01:10)

• Predicts a shift toward an "impression model" with less clear-cut attribution than previously possible.

3. Google’s Traditional Engagement Metrics vs. AI Mode

• Tyson Stockton: Historically, Google has used direct signals from users' website behavior (via Nav Boost and similar signals) to judge ranking appropriateness.
• He questions how Google will now measure "engagement" when much of the user experience is completed within search surfaces (SERPs) or AI-generated answers, rather than on the actual website.

"If that experience is happening within the actual SERP page or AI mode, are they measuring like, well, how long did they stay on the prompt answer, or how well it satisfied?"
(Tyson Stockton, 01:38)

• Concludes that SEOs must adapt their understanding of user metrics and reporting frameworks.

4. AI’s "Black Box" Effect and Data Transparency

• As understanding improves, the system seems to become more opaque.
• AI features like 'fan out query'—where Google issues multiple background queries to generate an answer—further obscure what's being measured.

"Just as we were able to pull back the curtain, there's another black box is how it feels."
(Daniel Hurwitz, 02:26)

• There's skepticism that Google will ever provide detailed data on these new types of interactions to SEOs.

Memorable Quotes

• "I think it's just going to be more fragmented and less measurable. I mean, it already is."
  (Daniel Hurwitz, 00:55)

• "We're going to move more toward this kind of impression model with less clear attribution metrics."
  (Daniel Hurwitz, 01:19)

• "It's just like, just as we were able to pull back the curtain, there's another black box is how it feels."
  (Daniel Hurwitz, 02:26)

• "Are they measuring like, well, how long did they stay on the prompt answer or how well it satisfied?"
  (Tyson Stockton, 01:38)

Timestamps for Key Segments

• 00:43 – The Big Question: How will engagement metrics evolve with increasing AI-mode experiences?
• 00:55 – Fragmented and Less Measurable Metrics: Daniel outlines current and future tracking challenges.
• 01:38 – Google's Traditional vs. New Engagement Models: Tyson compares old and emerging measurement paradigms.
• 02:26 – Another Black Box: Daniel voices concerns about AI-driven opacity and data access.

Conclusion

This episode underscores a major shift for SEOs and marketers: With the rise of AI-powered search and information delivery, engagement metrics are becoming more fragmented, less transparent, and harder to attribute. SEOs must rethink traditional approaches to data collection and reporting, expecting the field to further fragment and for familiar metrics to evolve over the next 18 months.