Perpetual Traffic Podcast Summary
Episode: How to Tell If Your Agency Is Performing (Not Just Reporting)
Date: March 10, 2026
Hosts: Ralph Burns (Tier 11), Lauren Petrullo (Mongoose Media)
Main Theme
This episode addresses a pervasive issue in digital marketing: distinguishing between agencies that drive real business growth versus those simply reporting flattering metrics. Ralph and Lauren explore how business owners and marketing leaders can assess if their marketing agency is actually performing— not just creating attractive dashboards—by asking the right questions, challenging internal and platform-reported data, and maintaining focus on ultimate business goals.
Key Discussion Points & Insights
1. The Danger of Vanity Metrics and Misleading Reporting
- Agencies may manipulate reporting to make results look better, especially when using in-platform dashboards (Meta, Google, Attentive).
- Example: SMS agencies like Attentive may claim 80% of sales due to wide attribution windows, distorting the real contribution to overall revenue.
- It’s essential to always align reported metrics with a business’s “source of truth”—typically a CRM, Shopify, or back-end system.
Quote:
"Women lie. Men lie. Numbers don't lie. But numbers sure can be manipulated."
– Lauren Petrullo (02:23)
2. Attribution Models—and Agency Incentives
- Each ad platform seeks to claim as much conversion credit as possible.
- Agencies may rely on in-platform attribution models, which inflate success by double-crediting conversions across multiple platforms.
- The crucial task for the business leader is reconciling these claims with actual sales/revenue (the company’s true north).
Quote:
“If your agency is relying on the in-platform metrics, it’s a warning sign.”
– Ralph Burns (09:02)
Quote:
“Your source of truth… is the ultimate checks and balances for your entire business because that's where you're collecting the money.”
– Ralph Burns (09:34)
3. What to Measure – Going Beyond the Dashboard
- Dashboards are a springboard for meaningful conversations, not the conversation itself.
- Important metrics: new customers, repeat customers, opt-in rates, AOV, LTV, and how these contribute to business goals.
- Watch out for agencies targeting only retargeting audiences; this can inflate ROAS while hampering true growth.
Quote:
“The dashboard allows us to have solution-forward questions that the agency may not be responsible for, but they have the responsibility to bring up the discussion.”
– Lauren Petrullo (05:06)
4. Ensuring Tracking Works & Experiencing Your Own Funnel
- Validate tracking setup—many issues arise from broken or outdated tracking and site elements.
- Regularly go through your own sales funnel as a customer to catch issues first-hand.
Quote:
“Go actually purchase something from your business... experience what a new shopper is actually experiencing and then tell your agency what you thought.”
– Ralph Burns (16:01)
Quote:
“Every time you have a new employee that starts your business, have them go through the journey… that works, that didn’t work.”
– Lauren Petrullo (19:18)
5. Critical Questions for Agencies
The hosts outline pivotal questions a VP of Marketing should consistently ask their agencies to move beyond surface-level reporting:
Weekly Performance Calls
-
Performance Check:
- “Is the performance that happened last week on par with what you expected? Where are we now?”
- (20:35)
-
Initiative Focus:
- “What is the KPI or initiative you’re most focused on this week to drive better value?”
- (20:55)
-
Outcome Forecast:
- “What’s the anticipated impact or outcome you’re looking to achieve by the next call?”
- (21:23)
-
Biggest Bottleneck:
- “What is the biggest bottleneck for you having success in my company right now?”
- (23:35)
Monthly/Quarterly Review
-
What Did We Learn?
- “What did we learn last month that changed how we’re running things this month?”
- (34:26)
-
Alignment to Goals:
- “How does that change get us closer to our goal?”
- (34:54)
-
Anticipated Impact:
- “What is the forecasted or anticipated impact from the initiative(s) being carried over?”
- (37:12)
Quote:
“You don’t want rote answers… you want to make them think. All the KPIs… are steps along the way to achieve the goal… you should have alignment with your agency.”
– Ralph Burns (22:53, 34:54)
6. Warning Signs and Response Quality
- Watch for blame-shifting, lack of preparation or insight (“immediate default to blame” at 27:47).
- Positive responses include clear ownership, actionable plans, and evidence of strategic thinking.
- The best agencies proactively identify problems and propose solutions.
Quote:
“If I'm asking you a question… and the first things that come out of your mouth are, ‘well, you need to do…’ …that’s not what I’m talking about.”
– Lauren Petrullo (27:48)
Quote:
“If you feel a lack of confidence in the answer… that’s hard… confidence helps, experience helps, and comprehension helps.”
– Lauren Petrullo (30:35, 32:26)
7. The "Owner’s Money" Litmus Test
- Ask: “If you were spending your own money in this account, what would you do differently?”
- Even if it’s not their money, it encourages agencies to rethink and recalibrate with stewardship in mind.
Quote:
“If you were spending your own money in this account, what would you do differently than what we’re doing now?”
– Ralph Burns (39:15)
Quote:
“It’s never going to be their money… but hypothetically, I would love to think that they think about it as if it were their own.”
– Lauren Petrullo (40:21)
Notable Quotes & Memorable Moments
-
“Your agency shouldn’t be reporting well, it should be performing well.”
– Ralph Burns (opening theme, 00:13; repeated, 43:10, 44:14) -
“The dashboard is a springboard, not the focus of the discussion.”
– Lauren Petrullo (05:06) -
“In-app ROAS is a false god… people are so addicted to this false metric now.”
– Ralph Burns (15:09) -
“90% of stuff isn’t going to work. We’re going to swing and a miss. But I want to know and understand what we’re trying and have a plan.”
– Lauren Petrullo (28:53)
Timestamps for Key Segments
- 01:16: Introduction of main question: “The three questions every VP of marketing should ask their agency…”
- 02:23-03:27: Discussion on attribution windows, platform reporting, and manipulation of numbers.
- 09:02-10:39: The dangers of relying on in-platform metrics; importance of verifying with backend “source of truth.”
- 16:01-19:18: Ensuring correct tracking; the importance of experiencing your own customer journey.
- 20:35-24:57: The “three questions” for weekly agency check-ins and how to foster proactive discussion.
- 27:47-30:28: What bad answers look/sound like and communication cues for agency evaluation.
- 34:26-37:12: Critical questions for monthly/quarterly review; focus on learning and impact.
- 39:15-42:26: “If it were your money…”—a provocative question to prompt deeper agency stewardship and solutions.
- 43:10-44:14: Recap and emphasis on performance (not just reporting) as the ultimate agency accountability.
Takeaways
- Use dashboards and reports as a starting point, not the end; always tie them to real business outcomes.
- Regularly ask pointed, objective-focused questions of your agency; listen not only for answers but for mindset and proactive responsibility.
- The agency relationship should be collaborative and dynamic, always oriented toward driving growth—not just justified reports.
- Don’t let your agency or your platforms define your success; maintain ownership of your “source of truth.”
- Being a great client/leader means holding agencies accountable while empowering them to think critically and partner in the company’s growth.
Episode’s Closing Mantra:
“Your agency shouldn’t be reporting well. It should be performing well.”
– Ralph Burns (44:14)
For additional resources and actionable templates mentioned, visit perpetualtraffic.com.
Hosts:
- Ralph Burns (Tier 11)
- Lauren Petrullo (Mongoose Media)
Listen to future episodes for deeper dives into campaign construction, attribution, and marketing leadership.