The first sign that your AI implementation is about to fail

Summary

---

Podcast Summary: MarTech Podcast ™

Episode: The first sign that your AI implementation is about to fail
Host: Benjamin Shapiro
Guest: Steven Roach, VP of Ecosystems and AI at Qualified Digital
Date: September 25, 2025

---

Episode Overview

In this episode, Benjamin Shapiro interviews Steven Roach, VP of Ecosystems and AI at Qualified Digital, on the critical considerations for successful AI implementation in marketing technology. The conversation delves into overlooked trends, the importance of orchestration and human oversight, and a looming shift in AI model architecture driven by emerging technologies like Mamba. The episode aims to arm listeners—particularly marketing leaders—with insight into identifying early signs of AI project trouble and preparing for the next wave of Martech innovation.

---

Key Discussion Points & Insights

1. Overlooked AI Trends in MarTech

[01:39 - 02:50]

• AI-enhanced MMM (Marketing Mix Modeling):
  Steven emphasizes that traditional MarTech approaches are rapidly evolving. Leveraging “next-gen neural networks,” organizations can improve accuracy and efficiency in predicting customer behavior and optimizing workflows.
  • Quote: “Take MMM for example… Next gen neural networks… enhances what we currently have in place. So evaluation, enhance, and then we continue to progress over time.” – Steven Roach [01:42]
• Continuous Improvement:
  Evaluating, enhancing, and systematically progressing are “powerful steps that are often overlooked,” vital for keeping AI projects effective and relevant.

2. The Role of Orchestration and Guardrails

[02:15 - 03:15]

• AI Orchestration vs. Agent Implementation:
  Steven cautions against the notion that orchestration will completely take over AI agent roles. Instead, orchestration (the management and alignment of multiple AI components and processes) is critical for integrating AI safely and effectively.
  • Quote: “Orchestration is a key part of how AI is involved in your organization… having those guardrails is going to be a major piece to that as well.” – Steven Roach [02:55]

3. Technical Advances: Mamba and Shifts in AI Architecture

[03:16 - 04:43]

• What is Mamba?
  Mamba is introduced as a new coding library/language poised to replace or augment transformers—a fundamental component of existing large-language models (LLMs).
  • Quote: “Mamba is a specific coding language… replacing transformers… it speeds up every aspect of your model.” – Steven Roach [03:29]
• Impact on Analytics Pipelines:
  Mamba’s integration promises faster, more efficient AI operations, especially as large portions of analytics shift away from traditional transformer architectures.
• Hybrid Approaches:
  The likely future is a hybrid implementation—using both Mamba for speed and traditional transformers for established analytics.
• Host’s Reaction:
  Benjamin Shapiro, expressing both curiosity and concern, sums up the feeling of many marketers facing fast-paced technological change.
  • Quote: "You're speaking a language that is way too technical for me to understand, but I'm excited and fearful of Mamba now." – Benjamin Shapiro [04:43]

4. The Non-Negotiable Need for Human Oversight

[01:15, Throughout]

• On several occasions, Steven alludes to the necessity of human oversight as a “non-negotiable” component—especially as complexity and risk increase in AI tools’ deployment.
  • Quote: “Having those guardrails is going to be a major piece…” – Steven Roach [02:55]

---

Notable Quotes & Memorable Moments

• Steven Roach on the AI evolution:
  “You want accuracy, you want speed, but how do you get there? …evaluation, enhance, and then we continue to progress over time.” [01:45]
• On Orchestration’s Importance:
  “Orchestration is a key part… having those guardrails is going to be a major piece.” [02:55]
• Host-Guest Banter on Mamba:
  “Mamba like Kobe Bryant, the black Mamba?” – Benjamin Shapiro [03:21]
  "Yes, sir!" – Steven Roach
• Facing the Future:
  “You’re speaking a language that is way too technical for me to understand, but I’m excited and fearful of Mamba now.” – Benjamin Shapiro [04:43]

---

Timestamps for Key Segments

• 01:15 – Introduction to Steven Roach & Episode Focus
• 01:39 – Under-the-radar MarTech AI trends and enhancements
• 02:15 – Importance of continual evaluation and human oversight
• 03:16 – Introduction to Mamba and emerging AI architectures
• 04:28 – Host reaction and summary of technical shift
• 04:51 – Episode close and contact info

---

Tone and Language

The conversation is direct, insightful, and sprinkled with playful banter—especially around technical jargon and the naming of new AI technologies (“Mamba”). Steven Roach balances deep technical explanations with an emphasis on practical, actionable precautions for marketers and technologists.

---

Summary Takeaways

• Savvy marketers should watch for AI-driven enhancements in traditional Marketing Mix Modeling and analytics.
• Human oversight and orchestration are crucial for any AI implementation to avoid failure.
• A significant, foundational shift is coming to AI model architectures—be prepared for new tools and hybrid approaches (like Mamba).
• Marketers need to stay alert, adaptable, and proactive as AI technologies evolve at an unprecedented pace.

---

Transcript

[Podcast Announcer]

The Martech Podcast is a proud member of the I Hear Everything Podcast Network. Looking to launch or scale your podcast, I Hear Everything delivers podcast production, growth and monetization solutions that transform your words into profit. Ready to give your brand a voice? Then visit iheareverything.com.

[Marketing Expert]

From advertising to software as a service to data across all.

[Marketing Analyst]

Of our programs and clients, we've seen a 55 to 65% open rate.

[Marketing Expert]

Getting brands authentically integrated into content performs better than TV advertising. Typical lifespan of an article is about 24 to 36 hours.

[Marketing Analyst]

We're reaching out to the right person with the right message and a clear call to action. Then it's just a matter of timing.

[Podcast Announcer]

Welcome to the Martech Podcast, a member of the I Hear Everything Podcast Network. In this podcast you'll hear the stories of world class marketers that used technology to drive business results and achieve career success. Here's a host of the Martech Podcast. Benjamin Shapiro.

[Benjamin Shapiro]

I'm Benjamin Shapiro and joining me today is Steven Roach, the VP of ecosystems and AI at Qualified Digital, which helps Fortune 500 brands transform customer experiences through data driven solutions. And today Steven will reveal exactly when human oversight is non negotiable in your AI stack. What MarTech trends are you watching that most marketing leaders are missing?

[Steven Roach]

I think the advancements of AI in our traditional Martech phrases. Take MMM for example, Next gen neural networks which accurately predicts or measures your customers or your internal overall workflow. For mmm, it enhances what we currently have in place. So evaluation enhance and then we continue to progress over time. I think those are very powerful steps that are often overlooked and I think that's those are the key things that takes us to another level. You want accuracy, you want speed, but how do you get there? And I think those are great steps to support that argument. There's other things that are out there. I think one of the more major things and something that we touched on is does AI orchestration is going to take over the full AI agent implementation? I don't think it's going to. I think there's advancements. But orchestration is a key part of how AI is involved in your organization in today's world. And having those guardrails is going to be a major piece to that as well. A more technical aspect of the things or I can get really into the weeds when it comes to transformers and how it's used in Mamba. Mamba is going to be the next wave of how data analytics is actually involved.

[Podcast Host]

Mamba like Kobe Bryant, the black Mamba yes, sir. Okay. Why the snake? What is Mamba?

[Steven Roach]

Mamba is a specific coding language. So what's currently happening during studies is they're replacing the Codex of Mamba and replacing it or replacing transformers? Transformers allows machine learning to operate as best as possible. And a lot of things when it comes to overall analytics that are currently being done in Python, replacing it with Mamba, it speeds up every aspect of your model. There is a road, and I do believe that this is going to be a more hybrid way of moving forward, is having both Mamba workflows and your traditional transformers moving forward. So having that Codex, whichever one that you choose to involve, is going to run a little bit more smoothly. With Mamba, your more traditional analytics, or just AI in general, is going to be using Transformers, which is currently being used today.

[Podcast Host]

There's a fundamental architecture change coming that's going to impact how all of the LLMs and all of your analytics operate. You're not going to be transformer based. You're going to use this other. Let's call it a language called Munch.

[Steven Roach]

Yes.

[Podcast Host]

Okay.

[Steven Roach]

Library.

[Podcast Host]

You're. You're speaking a language that is way too technical for me to understand, but I'm. I'm excited and fearful of Mamba now.

[Benjamin Shapiro]

All right, that wraps up this episode of the Martech podcast, thanks to Stephen Roach, the VP of Data Ecosystems at Qualified Digital. If you'd like to get in touch with Stephen, you could find a link to his LinkedIn profile in our show notes or on martechpod.com or you can visit his company's website, which is Qualified digital dot com. If you haven't subscribed yet and you want a daily stream of marketing and technology knowledge in your podcast feed, hit the subscribe button in your podcast app or Visit us on YouTube and we'll be back in your feed next week. All right, that's it for today, but until next time, my advice is to just focus on keeping your customers happy.

[Podcast Host]

Foreign.

[Podcast Announcer]

Thanks for listening to the Martech podcast, and I hear everything. Production. Looking to launch or scale a podcast like this one for your brand? Then visit iheareverything.com.