Loading summary
A
Foreign. Analytics topics covered conversationally and sometimes with explicit language.
B
Hi, everybody.
A
Welcome.
B
It's the Analytics Power Hour. This is episode 294. Yeah, probably right after the old RTO policies got rolled out, you probably got another executive communication about going AI first or whatever the hell that means. And let's be honest, I think we're all making pretty heavy use of AI now in some capacity. But what does that even mean exactly? And specifically in our world of data, I mean, should I just be uploading all my data to Claude and letting it come up with my analysis, or is it in planning where you are constantly having to tell ChatGPT not to jump the gun and start writing SQL when you're just exploring some concepts or ideas and I don't know. So welcome to the AI Analytics Power Hour. I guess this time we're going to talk about it, not just using it yourself, but how to think about rolling AI out across your team or your organization. As always, I'm joined by my co hosts, Julie Hoyer. Welcome.
A
I'm back, actually. Welcome back. Oh, my gosh.
B
Yeah, of course. It's like you've never been.
C
It's been a while.
B
It has been a while. And Mo Kiss. How you going?
D
I'm going pretty good.
B
Outstanding. And I'm Michael Helblank and I'm excited for our returning guest. John Lovett is the VP of Analytics at SEER Interactive. He previously held leadership positions at Further and Web Analytics Demystified as well as many other companies. He's the author of at least a couple of books, the most recent one being the new big book of KPIs for key performance Indicators. And today he is our guest. Welcome back to the show, John.
A
Thank you so much. It's great to be here.
B
Awesome. Well, it's great to have you back finally. It's been a long time, so it's a long time coming. But I think what drove us to this was specifically how it seems like you and all the team at SEER are really diving headfirst into using AI in significant ways across your organization and across the teams to do your work, to bring new ideas to life. And so just talk a little bit about sort of what it's like inside your four walls and like how. How AI is impacting your work.
A
Yeah. Yeah. Well, I'll start by saying, so I've been in here now for a little over three and a half years, and the last 18 to 24 months of that, I've just been immersed in it and I'm not Like talking as a AI enthusiast. I leave my analytics division, I hold a P and L, and basically I'm making hard bets. And as the kids say, I've got some receipts to show for it. So I do want to say, though, that at our company, obviously I'm going to talk a lot about my experiences and how I rolled it out to my team. But the first thing I really want to say is that kind of getting your hands dirty with AI isn't optional anymore. You kind of said this in your preference, Michael, but doing it without accountability is really how you lose credibility. Every story I'm going to tell today is. Is about building infrastructure that makes AI trustworthy and not just fast and not just do more. But this is a little trite, but I've got a. I developed this when I first got to seer. The tagline for my division is we build trust in data and we empower people to use it, to use their data. And that hasn't changed with AI. AI has come along, but that's really fundamental, is trust in data and really being able to use it. So that's kind of the first thing that I'll say about that. Um, and if you indulge me and let me ramble a little more, just talking about SEER as a whole, like I couldn't. Well, what I've been able to accomplish starts at the top. And shout out to Will Reynolds, the man, the myth, the legend. He's the CEO. In fact, he doesn't like to call himself CEO of seer, but he founded seer. And he basically said, guys, listen, we are all in on AI, and everybody here needs to get on board or you don't need to, but there's the door. And made it such that we had a big pivot, like in. I want to go back to December 2025. It was a mandate for every single person in our company. I think we were about 175. We're closer to 200 people now, had to take AI, an AI training course and get certified in AI. So it was like mandatory requisite. Everybody gets trained. And then we rolled around to summer of 2025 and Will said, listen, everyone at this organization, from associate all the way up to executive Senior vp, has agency to be able to take license to develop with AI, build prototypes, show them to your clients as prototypes, get feedback, and let's get them into production if people like them. So the company as a whole basically said, we're all in on this. We're going to give you the tools we're going to give you some training and let you loose on this and really make it a part of our culture at the. At the. At the company and make it such that it was a part of everybody's. Everybody's job. So I'll pause there. I've got more on that, but I'll pause there for a minute.
C
So even with the leadership mandates, I mean, that is pretty big to hear. Like, such big pivots and saying, you know, they wanted it company wide. And that's awesome to hear because it gives. It sounds like it gives you and your team a lot of opportunities and the invitation to, like, go try things out with AI, see what works, get ahead of some of these, like, trends, or figure out, like, what it could be best used for. But I am curious, like, even smaller, before the leadership mandates or right afterwards, what was your first thought around it, John? Or what was your first, like, even small step because you were running a whole team, you know, how did you then, as a leader of an entire delivery team of analysts, like, go about that?
A
Yeah, you know, honestly, it was kind of like staring at a blank piece of paper, like, what do I do with this? I was just like everybody else. And I think my first experiences, which I do encourage people to try, are just use it for your personal life. Like, I would literally open my refrigerator door, take a picture with Chatgpt, and say, what can I make for dinner? And it would look at it and say, like, oh, you've got pasta sauce there. I see some tomatoes and I see a bell pepper, like, here's a recipe for you. And then I would just start using it and talking to it. My family and I took a trip to Ireland last Thanksgiving, back in 20, 20, 24. And basically, I had to build our itinerary. And so we're driving around Ireland, and of course, I had to put the chat t Irish accent on my. On the. On the talker. And so my wife called it my AI girlfriend. It was like, I was like, where should we go today? What restaurant should we go to in Galway? And it was like, it was giving me recommendations, and they were great. It told me where to stay. The funny things that started happening when I would talk to it and tell it things, you know, I said like, hey, I've got three teenage boys. Here's the things we like to do. This is what we want to try to do in Ireland. It was like a month later, and I'm in the kitchen and I'm asking it something, probably what to cook, because I Rely on that a lot. It thinks. I thought I liked to cook. And I say, I only ask you because I hate to cook. I just need the ideas. And it said to me, how are the boys doing? What would they like for dinner? And that for me was like, like. And of course, like, this was my.
D
Oh, see that? I feel like that would scare the shit out of me.
A
It totally scared me because I was like, what? I Like, I almost dropped the phone because I was like, how do you even know that? And then the voice said back, well, you told me that you. I know that you went to Ireland with your boys and you talk about them a lot. And it brought that up in conversation. And that for me was like. Like blew my mind in terms of what the possibilities were. And that was all just like my personal life before I really even started getting into it with, with work.
D
So can I. Can I ask a little bit? It sounds like I've had a similar experience, right, where like, there's been a lot of support, leadership down in terms of, like, everyone at the company has been given access to every single tool that they could possibly want. Enterprise grade. And I do personally think that is a absolute game changer, is like, I'm not going to tell you which tool to use. You can use any tool. But talk to me about the team experience, because I do feel there are those that are like, yep, I'm going to roll my sleeves up. I'm going to, like, get my hands. That sort of stuff. And there are folks that are really scared. And, you know, you know, they have that, like, it's going to take my job. Like, how did you navigate that, like, team dynamic of the folks that are super keen versus the ones that are, like, very apprehensive?
A
Yeah, yeah. And I can definitely associate with that. There were people on my team that were like, let me add it. I'm all in. Others that are like, I don't think so. I'm skeptical. Um, one of the things that we did as an organization that I think helped open the door a lot, and this was early last year. So actually it might have even been 2024, like early 2025. We as a company, every division looked at every single deliverable that we had. What do we regularly produce for clients? What are our workflows? How do we work? And then built this huge list of, if we do all these things, where can we start? AI that would help us to do these things faster, more efficiently, better. And we came up with a list at that time of 15 different workflows deliverables, processes that we did on a regular basis. And then we said like, okay, we're going to prioritize this subset. In Horizon 1, we called them, we have horizons of work. Horizon 1 is going to be this first build horizon, you know, and we had a series of them in horizon one. Then we go to horizon two and horizon three is like kind of bigger think, thinking, stacking them all on top of each other. But that really gave us the opportunity to think about the day to day work that we do and how AI can be a part of that. And I reiterated at every team meeting, at every meeting, I'm going to hold it up for you guys. I don't know if you'll see it, but I keep a sticky note. You probably can't read this, but on my, on my monitor that says, how can AI help me do this? And I genuinely think about that. It's right here on my monitor. I have to look at it every minute because I encourage my team, like, you're going to do something, think about if AI can help. And there's plenty of things that AI cannot do for you, but there's a lot that it can do. So that was sort of a door opener for people to say, oh, I do this every day. One quick example I'll give you is like, we're an agency, right? And despite me trying to squash this as much as I can, we live and die by the billable hour. So we have to track time cards, right? And I've got team members that do it religiously and team members that just don't. And they're not part of their workflow, not part of their habit. We built an agent that said, like, hey, connect our, our in. In our case, it's a Claude instance to my calendar, to my wrike, which is our project management. We've got connections to all of our platforms. But I can say, hey, look at my calendar, um, and see everything that's on there and populate my timecard for, for today or this week. And just that alone, I was like, you know, I spent maybe less than an hour on that every day, but now I'm like, boom, I got it and I can do it. And that same tool that I built to do that, now every morning I get in and I say, what's my morning briefing? What is the most important thing I have to do this day? And it goes to my inbox, it goes to my slack, and goes to all these different tools that I use every day. And it can say like, oh, you've got a podcast tonight with the. With the greatest podcasters on the planet. You need to prep for that. And so it will tell me kind of the most important things to do. And that for me has been like a. Such an eye opener to say, like, you know, I would sit at my desk on Mondays, like, oh, crap, what do I have to do this week? And I would write it out with a pencil on a piece of paper. And now I can just ask my. My AI partners, like, how do I, you know what's important to me? And that's been a big change as well.
C
Did you. Okay, this is a little nitty gritty, but I am cur. Some people still love, like, I still love to write, like a to do list. Obviously, that's not AI friendly by any means, unless I put it somewhere digitally. You do. Okay, so I'm. I'm curious, like, do you then, to help with that workflow of utilizing AI to surface things to you, are you actually, like, snapping a picture of your physical to do list? Are you retyping them? Are you dropping slacks to yourself so that your AI will read it?
A
Like, a lot of times, and maybe. This is me, old guy, old school. I take notes when I'm on a call with a client and they're just riffing and talking about stuff, and I'm either trying to capture requirements or figure out what's important to them. I want to be in that moment. And for me, even though 99. Whenever. Whenever I can, I have a transcriber that's recording the call so I can have the whole transcript and we can talk about that later. But that's critical for me going back to. But I'm still taking those notes because when I go to write a scope of work or proposal or just update a report for a client or whatever I'm trying to do, that to me is like, okay, my brain interpreted this. I wrote it down. I know I need to get this done. I generally don't take pictures of that and put them into Slack. Some. A lot of times I will send myself Slack messages for reminders, but more often than not, those are links and different things that I want to come back to. But I do rely on pen and paper for kind of my thinking process to help me do things. And I still haven't gotten away from the satisfaction of checking something off the list, which is that's. I give that to myself.
C
Oh, that's so good.
E
Michael, quick question. How many times have you solved this same analytics problem this month?
B
Oh, probably enough times that I'm considering invoicing myself. Step one, one, fix GA4, source medium. Step two, lose the will to live.
A
Cool.
E
So let's stop living like that. Prism by Ask why lets you save your best workflows as skills portable expertise you can reuse across data sets and tools.
B
Okay, so like, normalize Utms, dedupe leads, merge Facebook and Google spend to maybe rename 37 versions of newsletter into one civilized channel.
E
Exactly. You build it once, then you run it again instead of recreating it like it's Groundhog Day, but with more spreadsheets and less Bill Murray.
B
I mean, I like Bill Murray, but I do like fewer tabs.
E
Plus, you know. Well, there's Andy McDowell as well, but really? Plus jam. Jam memory. It remembers context across sessions. Like your org's definition of active user, which table is the source of truth in that one cursed date range where tracking, alas, broke.
B
So I don't have to start every meeting with. Before we begin, here's the lore of our metrics.
E
Yeah, or re. Explain that revenue means net of refunds here, not whatever looks best on the slide.
B
Okay, well, my dashboard has now been personally attacked.
E
Well, sounds good. My mission. My mission is complete. But skills plus memory means Prism gets smarter about your world over time. Your processes, your definitions, your shortcuts.
B
So it's like an assistant that actually remembers my preferences. Like I'm not getting from most of my streaming apps.
E
Exactly. So if you want early access, you can go to ask why and join the wait list.
A
Speak.
E
Speaking of WaitList, use code APH when you sign up, and you will be bumped right to the top of that list.
B
Okay, good deal. I'm already on the website.
E
Well, we've been doing this ad spot for a while. I hope you, Michael, have already gone to the website and signed up. But for anyone else, that's Ask the letter Y AI and use code APH
B
Yeah, I'm putting myself in the place of the user. It's called empathy, Tim.
E
Oh, well, I don't understand.
B
Over here. Saving time and my sanity using these skills.
A
Yeah, it's too good.
B
I take my notes online, but. But same thing. Where I've got the transcript plus the notes, and sometimes I can push them together into the prompt and use both. But.
A
Yeah.
C
Okay. Small tangent. Well, I'm just curious. So, John, you have your three boys, and I have a few wonderful people in my life that are, you know, their teenage years getting ready to go to college, and I fell into a very interesting conversation, and so I'm curious if, like, what you tell your boys, like, going into college, or maybe they're already in college, out of college, but, like, in the AI Times, I was talking to someone and they were telling me that, like, they aren't great at taking notes. And I kind of panicked for them thinking, you're about to go to college, like, you have to get really good at taking notes. And they said, yeah, but there's AI but as we just talked about, like, there still is this analyst skill of hearing certain things from a stakeholder or still having your own, like, mental filter, right, of, like, what you think is important or you really want to reiterate on, or you want to build a story later. So to be able to jot it down. And it is a skill, I think, to actively listen, you know, take your notes, whether you're typing or writing. And I suddenly got a little worried, and I didn't want to, like, harp on them saying, like, well, you really need to, like, learn how to do it. But it had me thinking, what are your thoughts?
D
I. I still take notes as well, even though there's, like, a transcribe function. For me, I wouldn't say it's necessarily. Sometimes it is like, what is the. The key points that I'm taking away that I really want to follow up? But I actually think it's how I listen. Like, for me, how I absorb the information. If I'm not taking notes, I will. My brain will probably go off on five different things. So I wonder if it's, like, more a style thing than a, like, AI, not AI thing.
B
I have noticed in meetings, I will summarize and repeat in the meeting sometimes so that the AI picks up on it better. And that's a change I've noticed. Just for the transcript, I'll be like, okay, so to summarize, we're probably going to make sure we do this, this, and this. And then I know that the AI then will come through the meeting transcript and be like, oh, I'll pull that out as a to do. So, like, even my style of conducting the meeting is shifting a little bit behind it, because I know that then I don't have to write that down. I get. The AI will surface that as to do. But yeah, it's crazy how we're adapting.
A
We joke about that. I do that too, where we're like, hey, transcriber, remember this piece? And, like, we kind of joke. And I did literally just take out a pen and paper because I don't want to forget the Questions here, but. So, Julie, starting with the question. I definitely worry about the future for kids. My oldest is about to turn 21, which is a frightening thing in and of itself. He's. He's off at college in North Carolina and was a very. He helped me may listen to this. Because such a proud dad. He changed his major. He was a finance major. He changed his major. And I said, what'd you change to? And he's like, dad, I entered the business analytics program in the business school. And I said, what?
D
I was like, shut the front door.
A
And I said, you do know that's what I do, right? And I never thought he noticed. And he's like, yeah, Dad, I know that's what you do. So, like, such a proud dad moment. But he's never been. I actually wrote a blog post about this. He's had dyslexia. He's had learning challenges. He switched high schools because he wasn't getting the support that he needed. To your point, his handwriting, even as a, you know, adult, was horrific. Like, he just didn't read like anybody else. He didn't. He didn't do things like everybody else. When he did math, he did it all in his head. He didn't write out the problems. And so he just thinks differently. And so he has been a very early adopter of AI. And for good or for bad, he's also, as a high school student and now a college student, figured out, how do I use tools like chat TPT and what have you, and then not have my teachers think that I wrote it with AI. So he's got the anti AI tools to figure that out. Which, honestly, like, I'm like, buddy, I'm going to pay for that subscription. I'm going to Pay for your ChatGPT subscriptions or whatever he needs. Because I want my kids, when they get out of college, to have this as part of their skill set. My. My middle son is a junior right now in high school, and he's. We're looking at colleges. We went to Syracuse a couple of weekends ago. And like, those are my questions. I want to know from universities, how are you guys going to teach AI? Because the university that says to me, oh, it's off limits. They can't use it. I'm going to be like, you know what? You're not going to prepare my kid for the workforce. So that might not be the way I want to go. And I just think it's a matter of, like, we took notes. We listen and think with our brains and our hands. And record things. My kids like, they're on their phones. They're, you know, they, they don't actually know how to talk on a phone. They text and what. I don't know if you guys have younger kids, but like when you call a kid on the phone these days, they don't, they're like, they don't even say hello. They don't even say what. They just, it's weird. They know how to like.
D
No, but they know. I mean my 3 year old knows how to like pinch and zoom and swipe and you're like, what the. Yeah, it's wild.
A
So I just think that that learning style I'm seeing with my own children shift and I want to. And I tell them like, you may not plagiarize. Don't just take it and copy and paste it. You have to put your brain into this. It's going to give you an output, but the output it gives you is generic. And until you put your voice into it and teach it and put your brain into it, that's when it becomes a partnership, not just a dictation machine or an answer engine. It's really when you start to leverage the value of it. And there's little tricks that I do. We could talk about later about like I teach AI my voice. I said like, I uploaded my books, I uploaded my blog posts. I said, I uploaded like email examples. I said, this is how I write, this is how I talk. And I want you, when you're writing on my behalf, to mirror this, to use this, to add this to your knowledge so that when you're generating something for me, it sounds like me and it's legitimate like me and like all my, all of my agents and tools, no EM dashes, you know, I sign off. Cheers. So my email messages, I like, I have all these little quirky things that I want to say. I'm like, no jargon, don't use buzzwords. Like I, you know, those I put like things that I am like, you know, like, no, by charts, like stuff like that that are like, you know, I'll put those into my instructions. And in fact, if anybody wants this, I can give this as a resource. But I built. We were first to choose at our company. I haven't made the choice yet, but it's like, do you want to go with ChatGPT or Claude? And I was like, well, if I give up one, how do I take all that teaching and learning that I taught it and bring it to the other? And so I developed a guide to Be able to take out of the. The model and say, what is my personality? What do you know about me? How do I talk? How do I think? How do I act? And then give me that as instructions that I can upload to my next agent so that it teaches it what I am like. And I found that to be like a transferable thing that I could say, like, oh, if I suddenly lose access to one of these tools, you, how do I not lose all that history with, with what I've told it? Darn it.
D
Okay, John, you're brilliant. And yes, we want all the resources. Absolutely. Because I'm literally doing that at the moment. Like, no comment on politics at the moment. But yes, migrating from one tool to another. But okay, what you're talking about is like fundamentally leading from example, putting in the time and effort to do it well back to your team. I am sure there are people that are dabbling and just producing utter. And as someone on the receiving end of reading lots of. It's like that exploration period, I, I guess I just like, I want to better understand is like, you have gotten to the value point. I'm, I think, probably quicker than most. How are you? How do you help your team get to that value point more quickly? Because the, the, the feedback is always, I'm busy, I don't have time. And I'm the first to say all of those things. How did you create the time for both yourself and then your team to get to value faster?
A
Yeah, yeah. So time is, you know, you still have to do your day job. So for me, I do end up working more. I try to tell my team not to do that, but sometimes it happens. But putting that aside for a second, one of the things I did early on last year, I'm a huge believer in conversational analytics. I think it's coming. I think it's coming for us all. And so I built a conversational analytics, which is how do you get an MCP to communicate with whatever LLM you choose, ChatGPT, Claude, whatever you want with. I started with GA4 because that's what we had most access to. And I expanded it to BigQuery. And I said everybody on the team has to make these connections, use the mcp, follow the instructions, set it up so that you have the ability to talk to your data with. With these tools. And so some begrudgingly, as we started, some jumped right into it, some were slower to act. One of the, I think it was not even a week. It was the first few days of doing this exercise and one of the analysts on my team sent out on our company, Wide Slack. Oh, my gosh. Our blog post just went viral. We had a huge spike in traffic. It's amazing. This blog has never seen this much traffic. And Will, our CEO, he's got all the agents and the MCP connected as well. He likes to. He's a big runner, right? He's a marathoner. So he talks to it when he's running through his headphones and using Claude as he's running. And he's like, hey, so and so just posted this post. So we had this big viral spike and. And he started asking questions. He's like, I'm just curious, where did this traffic come from? And the agent responded and it's talking to him, oh, it looks like 99% is from China. And then he goes deeper and he goes, oh, really? Like, what kind of traffic is this? Did they bounce right away? What did they engage? And they were like, no. All the visits were sub 1 second or whatever it was. Come to find out it was a bot, you know, So a bot was hammering our site. My analyst team was like, hey, we made this great discovery. Look at me. I got this new conversational analytics thing to work. And that was a, like, screech, hit the brakes, like, needle off the record moment for me. I was like, wait a minute, I got to put some controls on this. So it was that same week I had. I had seen, actually, I think Tim Wilson reposted. Oh, and I'm going to forget his name. Twyman's Law. I'll come back, we'll get this in the show notes. Who gave me the reference? I wrote a. I wrote a LinkedIn post about it. But Twyman's Law, for those who don't know, is essentially, if any number looks too good to be true, it probably is. And Twyman never really published this. It was like word of mouth and it got around and it's become this marketing staple. And so I was like, hey, that would really work for my conversational agents. Why don't I build that in to say, if you're seeing this huge spike in traffic and it's anomalous and it doesn't match any of the other patterns and the data doesn't match, question it and dig in. And that was really a groundbreaking moment for me to say these things. A lot of you, they're going to tell you. And if anybody's used ChatGPT, I definitely call that the yes man in my arsenal or my toolkit. If you will, because it's always like, john, you look great today. That shirt looks awesome on you. You cooked the best dinner ever. It always gives me props and like, yes. And that's what he was doing. It was like, you found an amazing insight. Look at this. And then you put something like the guardrails on it, like Twyman's Law, to be able to say you can't just allow the number like that, you need to verify it. And since then, I've actually adapted it to. Not to get too. This isn't too technical, but all of these models that we use, or most of them, are all probabilistic, right? So you ask GPT question, Claude, Gemini, whomever you want, and it's going to give you probably the answer. It's doing word by word and what's the next logical word and how does it go? And so if you ask it, what's two plus two? They say, I've seen this enough, it's probably four. But when you're asking it to do analysis and the metrics and dimensions and all these different things, it sometimes with 1000% confidence, tells you you had this massive traffic spike, you got a viral sensation on your hands and it thinks it's true. And so I figured out a way to be able to take those probabilistic models and build into my instructions, deterministic instructions. So I say, never give me a number. Like every number that you generate, I want to see the SQL query, I want to see the math behind it and I want to know the logic. I want to know what's missing from the data and I want to know what you can't show me reliably. And that has also helped me to provide those guardrails. So I started with Twyman's Law, but I've evolved it to have this deterministic layer to say, like, don't just give me a number, I want you to perform the calculation. And I actually have SQL built into my instructions that says, like, how do you do this and how do you get at it? And that for me is really up the reliability of the answers that I get because it will give you garbage and junk and mislead you out of the gate unless you put those, those filters on it.
D
So what's your perspective then on, like, you've applied that to your own instances and like Will is, you know, a phenomenal, phenomenal leader who, like, gets the data side right, but there are lots of stakeholders who don't, who won't build that. So, like, Is your thinking then that you need to find a way to apply those guardrails for everyone in your company? Or like, how do you scale that?
A
Yeah, so great question. So remember I mentioned that we've all had agency to build our own agents and experiment and do things. Like I am, I am the vibe coding master. Like, in fact I was up till 2am last night just vibe coding because I was having so much fun. And so I just build these prototypes and I build them for me and I build them and I play with them and I see what works. I iterate on them. We do at Air have we just had our first release day. So release day was we had, I believe it was 11 agents that got released to the company. So these are somebody's vibe coded that went to our engineering team. They stress test them, they productionalized them, they made them ready for the whole company to use. And, and that is where I get things like Twyman's Law, the data guardrails into production for everybody. And we have, as a company, the engineering team has built out. We call it the SEER mcp. And the SEER MCP has connections to our data sets. It's got connections to all of our sales transcripts, it's got connections to every one of Will's presentations. It's got connections to every one of our town halls. Like you can get so much information from this one SEER MCP that that is how we productionalize things. We bring them as an organization to once they've been vibed and tested and tried, we productionalize them by having it go through a relatively specific process. But everybody's encouraged to bring the ideas kind of back to the original question is like, for my team, I built an innovation AI innovation lab. And we've got weekly meetings, they're optional, I usually have them on Fridays. And I've got a core team that prioritizes ideas and puts things on our roadmap for delivery. But everybody is allowed to bring ideas, everybody brings challenges. And this is something I'm playing with or this is how I'm trying to work through this issue. And so that just opens up the door to possibilities and everybody trying things and everybody getting excited about what they can possibly do with AI that can help them. So that's been a big lift for us as well.
C
I'm curious. I. Because I've seen it so many times, I'm sure all of us have like again, new a new technology. It's very exciting to use it. John, I'm curious How did you. Because it sounds like you guys have gotten to the point where you're very focused on problem solving. But, like, what you're saying with your Friday meetings, right, of like, bringing ideas or problems things are trying to work on, like, how do you keep your team? Or in the beginning, how did you get your team to really think of using AI as a tool to solve specific problems? Like, is that a fight you're still fighting? Do you feel like you guys are pretty mature in that thinking? I'm curious how you got there, if you are.
A
Yeah, yeah. So it. It is definitely a tough one. I'll give you another real world example. So it was three weeks before the Olympics were about to start. I'm a huge Olympics fan, and I think it was a Saturday morning. I'm whatever, you know, scrolling on my phone and I said, hey, what if I ran the world's largest geotest to test a bunch of prompts and see what kind of data I can get back about the Olympics? That LLM model, this is you typing in a prompt to chatgpt, Perplexity, Claude all the different models and seeing what responses come back. I developed five hypotheses. So, like, narrative persistence is one. Like, how long does a narrative stick before it changes temporal velocity? How soon when an event happens, or let's say somebody is awarded a medal? Do the AIs pick up on that and see? I looked at social proof. Does social presence make a difference with which how frequently athletes showed up in LLM responses? So I had these five hypotheses and I basically, I wrote a blog post about it. I was so excited at all this data collecting, and I put out a general thing to the team. I was like, hey, guys, I'm the only person working on this project right now. Everybody's invited, come on, jump in. Like, give me some help. And it was. It was crickets.
D
Like, oh, I was going to be like, no one responded, right?
A
Because, like, nobody. Everybody's like, I got my day job. I got all this stuff to do. Like, and again, like, this is sort of that. I don't want to call it apathy, but, like, I'm afraid of it. I don't know how to do this. I don't know what you're asking me to do. I've never done that before. How do I do this? And so the Olympics started. I had three ways. Pre Olympics, during Olympics, and post Olympics. And obviously we're in that post Olympics phase right now. During the Olympics phase, nobody responded to me. It had been Three weeks, almost a month. And I said, you know what? I, I can't have this. I went to four of my people on my team and I said, I need you to be a leader here. I need you to. Here's the hypothesis. It's framed. All you have to do. I built an agent to be able to analyze the data. It had all my guardrails in it. It had the hypotheses, it had what we were testing and it was showing data and I was doing preliminary results. I said, I need you guys to log in here and either prove or disprove these hypothesis hypotheses with the data. And every single one of the four people I asked was like, I will do that. And again, I had to think about how I was going to write it. I used my agents to help me, like, what's a persuasive message that people with not a lot of time are going to want to do this and adapt to this? And, you know, so I was thoughtful about.
D
Do you think it was, do you think part of it was like just a bystander effect? Like you kind of ask everyone and everyone's like, as soon as you went
A
to people individually, that could very well be. And again, that's part of, you know, I, I've got a big team. I don't see everybody every day. And so I'm reaching out to people that I see on Zoom, maybe once a week or just at big meetings. And me reaching out and saying, like, hey, I need your help on this. This is an important project for us. This is going to help us know what to test with regard to geo. It's going to tell us about how the models think and how we can use that to build tests and experiments and really understand what's going on. And so everybody's on board. We've got a div. All hands tomorrow and we're not even done the analysis. And everybody, every one of. I'm the fifth person, there's five hypotheses and we're all going to do five minutes on what are we learning so far? What have we found? Like, how is this going? And it was that little nudge, that personal touch, that reaching out directly that helped me get my team on board. Because everybody, you know, when you do ask that bigger question, there's a lot of, like, he's not asking me. I can kind of shirk off into the shadow and see who else will step up first. So that was a big one for me and I'm super excited about the results. Like, I've already found so many fascinating things just through this research already. So you know that that's something that maybe by the time this. Actually, it probably will be by the time this is published, you can check out the GEO results.
B
Yeah, I like that. I find that for certain people, they just jump in and start doing their own AI process. And other people need AI defined into the process for them. And I think that's sort of where I've seen, like, I was talking to somebody recently and they were like, trying to, they're like, I need my team to be doing this. And I was like, well, why don't we set up a process where they. You take them through these steps and one of the steps is you go do this thing with AI and now you're putting an AI enablement step into the process, just making it part of the standard process for them. And it was like, oh, yeah, that'll totally work. And so some people just need you to like, give them like the, the layout, the. How do I do these steps? Even though, like a lot of us, because we're the way we are with analytics and in curiosity and asking why, we'll go into the AI and be like, I want to set up a series, I want to set up a process or a. We'll just start with the AI and work through and learn as we go. And then other people need, like, I need you to tell me exactly how to do it, but AI can be part of it as part of that. So it's very interesting because I'm watching adoption like this too, and I'm sort of like, yeah, not everybody is just going, jumping with both feet, so how do I get them active? And that was one of the ways that we kind of thought through about that. It was just sort of like, okay, well, one of the steps is you go to the AI and you do this, this, this, and this with it, and that's how you get through the process.
A
I love that example, Michael. One of the things that sort of runs in parallel with that, when I use AI to do something, if I like, let's say it's an analysis, I'm just like, hey, I'm trying to understand why does this brand get a bunch of citations but not a bunch of mentions. And I do an analysis, I get a good output that I like. I usually go back and forth with the AI and, and I'm a, maybe I'm a beneficiary of having lots of tools, but I'll take a cloud output and throw it over to ChatGPT and I'll say, what do you think of this? And it says like, oh, that's pretty good, but you forgot these three things. And then I'll read it and edit it and I'll put it back in Claude. And I was like, hey, how about this? And I say, wow, that's really smart. Those are good ads. So I play them off one another. But the one thing that I always do, and this is maybe a limitation of tools in 2026, is I use Ninja Cat, I use Claude, I use Gemini, I use, basically use everything. But I am so worried about losing my work. And so it's like that whole thing like, you didn't save your file and your computer stopped and you lost it. I tell it. And so I hit Context Windows. We have, like, you hit your limit for the company this month. You can't log in for 24 hours. As soon as I think that's going to happen, or as soon as I get an output that I like, I tell the agent, write me instructions so that I can replicate this and give those instructions to another agent and teach another agent how to do what we just did. And that for me, I can then pick up and say, like, hey, guys, I show my team like, I built this analysis. Here's something that we do every day. Here's an agent that will help you do this. You can ask it any question, and it's going to guide you down this path of using the right information, asking you questions to be able to get to the right outputs that are going to produce something that's relatively consistent. And for me, that's been a huge unlock because those people who are like, I don't know what to do with this thing. I don't know how to build an agent. They can certainly use an agent and they can certainly use something like that to help guide them through an analysis or really any type of workflow.
B
How.
C
How have your analysts felt? Because, Mo, you and I have talked about this on previous episodes of, like, the shift in work of looking at a blank page and you're creating your own thing, your own work, your own thinking, your own analysis, right? Compared to, if you are using AI to give you something to react to, it's a completely, like, different process in your brain. So I'm. I'm curious, John, along those lines, what has been the reaction or the feedback from your team? If they're using AI in these tools for an analysis? How have they liked, disliked, you know, pros and cons of using AI to Start an analysis and they're like checking the work, they are confirming what AI has found. Things like that.
A
Yeah, I think. And it definitely happens. I would say that the first reaction of the team is this is just slowing me down. Like I have to ask it all the questions, do all the things I would do the analysis for and then I have to go make sure it didn't hallucinate or give me bogus answers, you know. And so it does slow you down at first and it does make you go a little bit slower to say I'm going to question that. I'm going to be curious about it. You know, the, the whole part of AI is going to do the job of the analyst. It can help to surface insights and get things. But if you don't have the curiosity, if you don't have like a spidey sense for that number ain't right. Like it will just give you junk. So I would say that initially it does take longer to do things and you know, this might take us on a tangent, but what we're doing for that today is my team still builds dashboards, we still have reports and that is our source of truth. We get our data, we pump it through our tools. We use tools like funnel and we pump it to BigQuery and we can do queries out of there. I find out the specific regex for the queries and I replicate that in my tools and my agents so that when I'm doing an analysis I can look at my dashboard and say, okay, LLM visibility rate is 42% share voice is whatever. What does it say in the agent? And if they match, then I feel good about that. And I'm like, okay, this matches my source of truth. If it's way off, I'm like, okay, why was it off? What was going on here? What was happening? So we've tried to build in those things where we can say like, let's have a source of truth. And it used to be for me, like I would ask it a question and then I would go to GA4 or Adobe analytics and like, all right, let me dig up this number. And honestly, like I'm so far out of those tools from the day to day perspective, I'd be like clunking around, be like, oh, how do I find? I don't even know what explorer to build to get to this number, you know, versus having the conversational agent when I could just ask it things. My team was great at that. They would do an analysis and then they would verify in ga or whatever platform so we could see those two things. But having that source of truth and having that dashboard, I'm still going to, you know, we will still rely on those. It's not going to. AI isn't going to kill the dashboard just yet, but I think it's an important resource to have for that validity, for the data quality, for the ability to make sure it's not, you know, you're not getting AI slob.
C
Have you guys then turned the corner where you're seeing efficiency gains from your new process of using AI like in your day to day work? And then second part of the question, I'm going to hit you with two, before I forget my second part of my question. On our International Women's Day episode, Mo, you know, you guys were talking about how maybe efficiency gains is like not the only outcome or great part that could come from AI, but right now that's what people are most focused on. So I'm curious, John, have you guys found the efficiency gains and our efficiency gains, the only positive that have come out of you guys integrating AI into what you do?
A
Definitely the efficiency gains are a big thing. You know, for us, it's been a lot about, hey, we've got this process that we do, it's part of our workflow. Now when we do it, we can repeat it across client to client to client. You know, that's, that's agency life, right? It's like we're repeating these things. We've got similar analyses, different data sets. That has definitely helped us move faster through these things. You know, the structured prompts, the way that we build methodologies and the way I tend to take, hey, I built this once, give me the instructions to build it over and over again. That has gained us a lot of efficiency and then the ability to upskill employees, right? So it's like I get a new team member or I get a contractor on my team and I can say like, hey, here's an agent that's already built. You can get up to speed much more quickly using this. So those have definitely been the case for efficiency. I think, I think the other thing, the second question, if I'm remembering correctly, Julie, was like, what? What else besides just the efficiency? Is that so?
D
John, there's a concept we talked about a couple episodes and I keep it. It's funny, Julie, that you mentioned it because I was going to bring up the exact same point. So Jim Linki, I think is how you pronounce his name. He wrote a book, the AI Marketing Canvas, and he has this like quadrant thing and you know, talks about internal productivity and that's really where everyone's focused. But the other quadrants are like internal growth. So like using tools to like accelerate your workforce. And then there's like external productivity, which is like a lot more of that, like customer service, how you can use it to like, like have, have productivity gains that, that are for your users. And then there's like the fourth quadrant, which is really like external growth, like using AI to like completely unlock new revenue streams. And I, I do like, my observation is that everyone's really stuck in that productivity, internal productivity quadrant. From what you've shared, it sounds like you're also using it for like internal growth. But I guess, like, is that a thing that you're seeing play out where like the productivity gains just seem to be the thing everyone's so anchored on? And I, the thing I also then want to understand is like, if you are having productivity gains, how are you measuring that?
A
So with I mentioned earlier, the horizon builds that we're doing, every horizon build has assigned productivity metrics, like how much time did it save, how much money did generate? We have KPIs that we build. You guys know I like KPIs, so we get KPIs, that's that we build around each one of those things. So we are measuring productivity in a number of different ways. I think with the growth. This is an interesting one because it is sort of a creeper. It moves more slowly than just the productivity gains. But one example I'll give to you. So I mentioned that we record all our calls. We ask our clients, can we record these calls? And when they allow us to, we do. So we've got all these transcripts. And so my head of BD comes to me and says, like, hey, I've been talking to this prospect actually since October, and we've had a dozen conversations. I built a notebook LM that contains all the transcripts, contains what we talked about. And now here we are in January or February and they just asked for, we think we need to include analytics in the scope. And so everybody's been talking about this project. We've got pricing calculators, we've got scopes of work, we got all these things. And he basically said like, I need you to get up to speed on this. And so I was able to use all of the resources, the transcripts, what the client wanted. I did get on one call with the client and talk to them. And doctor asked my very specific questions. But immediately after that, Call. With having no prior knowledge, I was able to write a scope of work and my BD guy came back to me and he's like, holy shit, John, you nailed it. Like, I can't believe that you got that figured out in such a short amount, amount of time. And you barely even talked about it. Like he just gave me the resources, but I was able to plug in and use my tools to be able to say, what does the client need? How does that match up, match up with my products and services and then what can we offer them that's going to fit what I heard in our conversation. And so that for me was a growth moment where I could say like that really not only did it save me time, like I, it would have taken me months to get up to speed, but I was able to turn that around in like 24 hours and get something that was so spot on that the my bdd. I was like, that's amazing. And hopefully fingers crossed that, you know, the deal comes through. But it was just a good growth moment. That's, that's one example that I could, that can think of there. I think the other thing I'll just mention, you know, productivity is obviously where you want to go. The part of this as being analysts, there is a whole new discipline in, we call it geo, but it's AI search, right? So it's like, hey, we got all these models, people are asking questions, we're moving toward this zero click world where it used to be you ranked on a, on Google or Bing or wherever. Somebody saw your link at the top and they clicked you and they got a visit to your website. Now your brand is getting surfaced via these LLM models. They see your brand, you may or may not get cited and they're like, oh, okay, you know, this is, I'm narrowing my list down, I'm seeing these things, but I'm not even clicking through. And they'll just type in direct to get to that brand's website. And so for me, part of this being that curious analyst and I'm collecting all this data and writing prompts and developing prompt methodologies, I'm like finding wild stuff. Like one example was, hey, in Claude we see mentions, which is like your brand is mentioned and then citations, which is the link to whether it's a podcast episode or your resources, whatever it is. Like all of a sudden in Claude all the citations dropped off December 1st and I'm like, what happened? And just because I'm looking at all this data across all my clients, I was like, oh, Claude really did stop using citations at that point in time and just cut it off. And then the other example, I'm analyzing data, I'm trying to build a report for a client, and I see the data went back to December 15, 2025, and it was the week that ChatGPT announced they were going to start having ads in their free accounts, Right? So you won't have them on enterprise or paid accounts, but the free accounts, you're going to start getting served ads. And I actually looked at the data and I was like, what is going on here? I started to see the nature of the responses change to purchase intent driven responses. They were actually preceding the way that ChatGPT responses to same questions we were asking, like months ago, they were changing this dynamic and I saw all these changes in the responses and I was like, something's going on here. And I connected it to the fact that they just introduced ads. They are prepping, they have been prepping for like a month and a half to get ready for this. So I mentioned that because there is so much to learn about how these models operate. And it's kind of like going back to like search days when you're trying to understand the algorithm. Like, we've got this whole new field of who knows what the hell's going on within these models. It's up to us to. And if anybody tells you they do, like, I'm calling bullshit on that because all we can do right now is experiment, test things, try things and see what works. And honestly, like, in my 20 years in analytics, like, this is the most fun I've had because I'm learning new stuff, I'm playing with new tools, I getting to see all these things. And like, for me, that's growth. Like, I am growing as a professional because my toolkit's expanding. I'm learning all these new things I can tell clients, like, if I can surprise and delight a client by saying, like, look at something I found about you. And I'll just give you one example. My client said, hey, this blog post just popped over the summer. It started ramping up and ramping up. We get all this traffic to it. It's amazing. We're so stoked on this. And on the call with the client, this was like a regular status call. I looked up their prompts and their geo reporting and I found the URL that they had referenced. I said, wow, this is amazing. The last two weeks you guys have gotten 102 citations on this particular blog post, but yet all of those responses Nobody mentions you. You're never mentioned in this set. And the category was like risk management. They have become this authority on risk management that enterprises were citing, brands were citing, you know, Forbes was citing, all these people were citing. But their name never got associated with that because it just wasn't in there. And we developed a simple test. We're like, hey, just don't do it in a pitchy salesy way, but just insert your brand name into, you know, here's a description of what this is. And by the way, our products solve for this in your FAQs. I had a big FAQ section in the blog post. I said, hey, just enter your brand name as you know. When you're closing it out, say like, we do this and here's the product that delivers this. Within two days of that test, mention started showing up in AI overviews, which is one of the fastest to pick up on changes to websites. And I was like, boom, proof point right there. I got the first signal where I was like, that change that they made to their content pages produced a mention which had never been seen before out of like six months of testing. And so, you know, that was only like a couple days into the process. So when I can show a client like that. And then I did another analysis yesterday morning and I'm like, okay, signal strong. And it led me down this whole other rabbit hole of like understanding mentions and citations. And I learned about ghost citations, which I won't get into. But like, this is the fun stuff where it's like, we're curious analysts, we're trying to figure stuff out. And never before has there been this playground of like so much data, so much information that we can just dive into and show clients things they've never seen before. And that for me is, I think that's the growth that, you know, it's gratifying, it's fun, it's exciting and it's definitely keeping me going.
D
Oh my God, John, this is like positively infectious. I love it.
B
Yeah, I know. I'm trying to remember a time when I've seen you like this, fired up. John, honestly, like I've known you for a long time, this is great.
D
But so like you've had, I guess I'm going to say, the privilege of approaching this as a leader who then is trying to bring your team along. There are lots of folks, I would say, who probably had the same level of enthusiasm as you, but might not be in a leadership role. What advice would you give that person, that mid level analyst who's Doing all this playing, they're having lots of fun. But how can they have a ripple effect on their business if they're not in a leadership role?
A
Build something cool. Show it to somebody, you know, like, you know, show it to your manager. Show it to your boss's boss, you know, if. If nobody picks up on it and you think it's brilliant, you know, share it on LinkedIn, share it on measureslack, share it somewhere, get some feedback on it. And if you get that positive feedback where people are like, this is cool. We've actually done this with our blog posts. Like, at Sierra, we're almost not allowed to write a blog post anymore until we seen something on LinkedIn. Like, see how you react, See if you get any comments, see if you get any mentions on it. So test it. Like, play with it. Put it out there. See what you get as a response, you know, and this may be harsh, but if you're an organization and you built something that you know is productive, ads growth, is clever, is, you know, adding to what you do and your leadership doesn't recognize that might be time to look for new leadership. But, you know, that's. It is hard. Like, it's. I would just encourage people to experiment with things. Build things within your boundaries that you're allowed to do and then share. Put them out to the world, you know, and if your leadership won't listen, take it to. Take it to LinkedIn, take it to Measure Slack, Take it somewhere that you can find an audience that thinks that's cool, and you'll grow your brand. That way you'll. You'll be able to. To find your people, I guess.
B
Yeah, that's great. All right, we do have to start to wrap up, unfortunately. This is so good, though. All right, well, one thing we love to do is go around, share our last call. AI is never going to change that. Well, maybe it will. I don't know. But, John, you're our guest. Do you have a last call you want to share?
A
Well, I have two quick ones, but I guess I need to ask permission. Am I allowed to offer another podcast?
B
Yeah, of course. Yeah. Come on. Do you think we follow rules around here?
A
I would bring it anyway, but the Artificial Intelligence show is a podcast. It is run by. I want to make sure I get their names right. Paul. Paul Raitzer and Mike Kaput. And every Tuesday, they put out a podcast and they aggregate all the most recent AI news. And it's brilliant. My wife actually loves listening to it. With me in the car, we listen to it A lot. And she'll be like, oh, their voices are so soothing. But just great intel, great information. This is also the company, I think their company is changing brands Smarter X. They run the Macon conference in Cleveland.
B
I want to say Cleveland, yeah.
A
And Julie, you need to get there because Paul's in Cleveland. Yeah, it's a great conference. But that is also the training that everybody at SEER was required to take was piloting AI. So great resource. They do a free one on one training on a bunch of different things once a week where you can tune in and ask questions. But just a fabulous podcast, a fabulous resource, definitely worth checking out. And then my second one, a very quick hit. I encourage everybody on LinkedIn. There was a community that started and I just happened to see it that's called the GEO community and GEO stands for Generative Engine Optimization. Some people call it AI Search, some people call it all sorts of different stuff. I just happened to be, I saw it, I was like, that seems cool. And first couple posts were very intriguing to me and I started, I started commenting on it and all of a sudden I want to get Rohit Thing is the founder and he's like, hey, would you want to be an admin on this and join me in kind of managing this community? So I think we're only a couple hundred people strong. But if you're curious about JIO and all that stuff, I got super excited about learning. Check out the LinkedIn Jio community. The Jio community. Good resource to get up to speed.
B
Nice. Excellent. Okay, Mo, what about you? What's your last call?
D
Well, I am quite excited, probably not as excited as John, but my good friend Eric Weber is back writing and I'm super, super pumped about it. So he has a great blog from Data to Product on substack and I get it via email. The latest one was the Conundrum on Buy versus Build, which is something I always am super interested to read about.
B
Awesome. All right, Julie, what about you? What's your last call?
C
Okay, my last call is totally not AI industry related at all. My life the past few months, you know, I'm just trying to keep my eyes open in the middle of the night with a little baby. So I've been doing a lot of reading. So my last call is I went down a path of reading some historical fiction books and I read one that was really good. So if anyone's looking for some new reading material, a little break from AI News, maybe, you know, switch it up. It was. And I know this is popular, but it was code name Helene, and it's by Ariel Laughen, if I'm saying her last name right. But either way, really great book. It is about a British spy going to France near the end of World War. So it was a really, like, interesting take. A different storyline that I had not really read about. And it was just an awesome read.
D
Julia, I'm going to sidebar you after this and send you the name of an author who's written like six books very similar to this. I'm going to read this one, but I'll send you mine, too.
B
We got a whole other podcast going here.
A
Yes.
B
I have a last call. So we heard about this, and we're kind of think it's really cool. There's a new visual data visualization contest, but it's for children. So if you have a kid between the ages of 7 and 12, there's two different age groups. I know. So not everybody's kids fit into that category.
D
I can fake he's tall. I can fake his age.
B
Yeah, whatever you want to do. It's like Aussie age, you know, it's different.
A
It's.
B
Yeah, the conversion. All right. Anyways, we think it's a really cool idea. There's some really great advisors behind it, but they're doing a data for kids visualization contest and it opens. The contest opened literally yesterday before the show comes out. So there's still time right now. You can go jump on their site, we'll put it in the show notes and you can check it out. But if you have a kid in that age group, there's three different age brackets, I think, between 7 and 9 and 10 and 12. And so you can kind of work with your son or daughter and just come up with a cool data viz together. It might be a fun little project. So anyway, that was my last call. All right, John, what a pleasure. Thank you so much for coming back on the show. So good to talk to you.
A
It's been fun. It's been great talking to y'.
D
All. It's.
B
Yeah. And I know we're gonna see you at Marketing Analytics Summit, right? In April.
A
So can I do a shameless foot? Am I allowed to do that?
B
Yes, of course. Yes.
A
Yeah. The extra day till Thursday, I am doing a halfway day workshop on conversational analytics and how you can connect your ChatGPT LLM of choice with BigQuery or Google Analytics. And so you'll see it live now at the Marketing Summit in Santa Barbara.
B
Oh, it's funny, John, your blog post inspired me to create My own conversational analytics integration with Google that I built myself because I was like, hey, I should try to build something like this Because I read your blog post and I was like, yeah, this is pretty, pretty cool. And I made some cool things out of it.
A
Anyway, so here you are. So I want to kill you.
B
And it didn't kill me. And I'm okay. I did stay up until 2 o' clock in the morning one time working on it, but that's the fun part, I guess, you know. No, but you don't have to stay up until 2 o' clock in the morning to come to Marketing Analytics Summit. And there's a couple of really important things about that. One is it'll be April 20th and 29th, so John will be there, we'll be there and we want your questions. We actually have a search survey live right now. You can go to analyticshour IO listener. Get that right? Yes, listener. And take our survey and then we will. You can submit questions that we will answer on the show, hopefully. So that's kind of out there right now. We'd love to hear from you what questions you have to help answer live at Marketing Analytics Summit. So that's coming up and so don't miss that. We also love to hear from you every other which away too. So please reach out to us if you're doing cool things with AI, if you're inspired by some of the stuff you're hearing, of course we'd like to hear from you. Obviously when talking to John, it sounds like John, you're pretty active on LinkedIn, so that's a great place to find you and follow what you're doing and interact with you there and then also in the measures like chat group. And we also love to hear from you via email. Email@contactnalyticshour IO. So please reach out. And we have stickers and Tim loves sending them out so you can ask for stickers too. So just send us a little note. All right. I know that I speak for both of my co hosts when I say no matter how AI is changing your work, no matter how you're getting your processes rolled up, hopefully it's being both efficient driving efforts. Efficiency and increasing productivity. But remember, keep analyzing.
A
Thanks for listening. Let's keep the conversation going with your comments, suggestions and questions. On Twitter @analyticshour, on the web at analyticshour IO, our LinkedIn group and the measured chat Slack Group. Music for the podcast by Josh Crowhurst.
E
So smart guys, we're wanted to fit
A
in so they made up A term called analytics. Analytics don't work. Do the analytics say go for it no matter who's going for it. So if you and I were on the field, the analytics say go for it. It's the stupidest, laziest, lamest thing I've ever heard. For reasoning in competition.
E
Tony. No, none of this in the outtakes.
B
Yeah, yeah.
E
None of this.
B
None of this. None of this. Yeah, that's fine. It's. Yeah, that's fine.
D
That's my helps. That's my thinking face. Like, what do you want me to
B
do with that Mo? I'm just. It's fine. People know who we are now. If our listeners are like, I can't believe they didn't look engaged enough in this short video that they put on their website, I'll be like, you know what? That's why we can't have lace things.
A
I love it. I love the images you guys are putting out there. They've been fun to watch.
B
Oh yeah, thanks. AI Studio. Google AI Studio Nano Banana Pro.
A
I just.
B
It's what's hilarious is, is like I don't even have good pictures of all of us. I just grab random headshots and throw them in there and be like, make a picture of this.
A
That's pretty good.
B
Here's something. I don't know if John, if Tim shared the video I created with VO of him and IP walking, but we're not going to put that on social media.
E
That's in the. That's in the side.
B
Yeah.
C
That's the only reason I joined the. The Mass Slack channel. Cuz I heard that there was some
B
fun happening and I created an analytics power hour. Brandon 40 ounce that I'm holding while we're doing it. So.
A
Nice. Nice.
C
Oh my God.
A
Imagery with so.
B
Oh, oh no. John, you got to understand, like I'm fully AI enabled at this point. Like it's. It's a problem.
A
AI enable the dangers.
B
Not good.
D
Rock flag and review your workflows first.
E
It.
Episode #294: Adapting an Analytics Team to an AI World
Date: March 31, 2026
Host(s): Michael Helbling, Moe Kiss, Tim Wilson, Val Kroll, Julie Hoyer
Guest: John Lovett (VP of Analytics, SEER Interactive)
This episode dives deep into how analytics teams can adapt to—and thrive in—an increasingly AI-driven world. The hosts and guest John Lovett bring candid, hands-on insights about the realities, challenges, and opportunities that come with integrating AI across analytics workflows, upskilling teams, and evolving both culture and deliverables. With practical stories, memorable anecdotes, and detailed discussion about rollout strategies and organizational shifts, the episode is essential listening for digital analytics practitioners navigating the "AI-first" edict.
Combating Bystander Effect:
Broad shoutouts for help yield “crickets.” Direct asks were much more successful:
“I went to four of my people... I need you to be a leader here... And every single one...was like, I will do that.” (35:04)
Process Integration:
Michael Helbling: “Some people just need you to... give them...the layout, the how do I do these steps? Even though... others will just start with the AI and work through and learn as we go.” (37:43)
Reusable Prompts as Knowledge Transfer:
Lovett always asks AI agents to write instructions for themselves, so analysts who are more reluctant or unsure have a guided starting point (39:09).
Blank Page vs. Reaction:
Starting with an AI output is a fundamentally different analytic style—some analysts felt it slowed them down at first, but validation practices (cross-checking AI with dashboards) improved trust and workflow (42:00).
Efficiency Gains & Beyond:
This episode balances candid, sometimes irreverent humor with practical, actionable wisdom. The panelists are frank about the messiness of AI adoption but also optimistic and energized. John Lovett’s “doer’s” philosophy—prototype, test, validate, repeat—shines throughout. Whether you lead a team or are an individual analyst, the message is clear: get hands-on, share what you build, keep curiosity alive, and remember that trust, guardrails, and organizational buy-in matter as much as the AI tools themselves.
"All we can do right now is experiment, test things, try things and see what works." — John Lovett (52:50)
For more details, visit the Analytics Power Hour website or connect with the hosts and guest on LinkedIn or Measure Slack.