
Loading summary
Pura Brand Voice
Close your eyes. Summer smells like sunshine, fresh citrus and salty air. What if your living room could feel just like that? With Pura's new summer collection, it can restore your sense of well being with fragrances designed to move with your day. From bright, energizing mornings to soft, relaxing evenings. Make the invisible unforgettable. This season, visit pura.com to find your new favorite summer scent.
Liberty Mutual Spokesperson
And Doug, there's nowhere I wouldn't go to help someone customize and save on car insurance with Liberty Mutual. Even if it means sitting front row at a comedy show.
Greg Kilstrom
Hey everyone, check out this guy and his bird.
Mike Taylor
What is this, your first date?
Liberty Mutual Spokesperson
Oh no. We help people customize and save on car insurance with Liberty Mutual together. We're married. Me to a human, him to a bird. Yeah, the bird looks out of your league. Anyways, get a quote@libertymutual.com or with your local agent. The agile brand.
Greg Kilstrom
Welcome to Season seven of the Agile Brand where we discuss the trends and topics marketing leaders need to know. Stay curious, stay agile and join the top enterprise brands and martech platforms. And as we explore marketing technology, AI, E commerce, and whatever's next for the Omnichannel customer experience. Together we'll discover what it takes to create an agile brand built for today and tomorrow and built for customers, employees and continued business growth. I'm your host Greg Kilstrom, advising Fortune 1000 brands on martech, AI and marketing operations. The Agile Brand podcast is brought to you by Tech Systems, an industry leader in full stack technology services, talent services and real world application. For more information, go to teksystems.com to make sure you always get the latest episodes, please hit subscribe on the app you listen to podcasts on and leave us a rating so others can find us as well. Now onto the show is the most effective way to understand real human behavior. To simulate at first agility requires a willingness to test ideas that sound strange at first, like asking bots to act more human by narrowing their point of view, or treating synthetic Personas as real sources of insight. But when applied correctly, this thinking unlocks entirely new ways to scale customer understanding. Today we're going to talk about how synthetic research is reshaping how we understand audiences and how asking the right questions can make these insights feel far less synthetic and far more human. To help me discuss this topic, I'd like to welcome Mike Taylor, Founder and CEO of Ask Rally. Mike, welcome to the show.
Mike Taylor
Yeah, thanks Greg. Yeah, good to be here and happy to dive into this. There's a lot of opinions online about this topic, so hopefully we can wade through them.
Greg Kilstrom
Yeah, definitely, definitely. And it's something of personal interest to me as well. Definitely fascinated by it. Before we dive in though, why don't we start with you giving a little background on yourself and your role at Ask Rally?
Mike Taylor
Yeah, so previous to this, I created a marketing agency. It was a growth hacking agency back when growth hacking was cool. And I guess you can kind of think about it as like agile applied to marketing in some ways. But yeah, I did that for six years, grew to 50 people in New York and London and Europe and then I left in 2020. It was like tired of managing people who managed other people who managed other managers. I wanted to get back to technical stuff. So I was learning how to code at that time, got access to GPT3 and was blown away, like, wow, this is amazing. You know, so, so dug really deep into that, consulted for a while, became a prompt engineer, or I've called myself that for years and created a book on prompt engineering that was published by O'Reilly last year. And then thanks to all that stuff, ended up starting my own business, tech business, Ask Rally, in the synthetic research space at the beginning of the year. So that's what I'm working on full time now.
Greg Kilstrom
Wonderful, wonderful. Yeah, I can empathize with the marketing agency. I sold mine in 2017, so it's definitely fun times, but not always fun times, I guess.
Mike Taylor
Yeah, we could definitely share some war stories.
Greg Kilstrom
Yeah, that's the subject of another podcast probably. So let's dive in here and you know, definitely want to talk, want to talk about synthetic Persona. Synthetic research. You've used the term Persona of thought prompting and have scaled synthetic Personas into, you know, some real decision tools for brands. Maybe just to. We've, I know we've talked about this on the show before a couple times, but for those that are less familiar, why don't we start with you just, you know, defining what is synthetic research for someone who, you know, not quite familiar with it.
Mike Taylor
Yeah. So the way I describe it to my 6 year old daughter is when you talk to the computer, the computer pretends to be real people and then you can use that to ask questions that you otherwise wouldn't be able to ask that many people. So she hopefully gets that. Hopefully that resonates to other people. But yeah, that's fundamentally what's happening here is you will talk to one, you know, 5, 10, 100, 5,000% is the most, most I've had, but you'll have them role play as potential customers or potential users of your product or potential people who you're trying to reach. And you'll do traditional market research like surveys, maxdiff analysis, usability studies, message testing. Really anything that you would normally do with real people you can do with synthetics. And the benefit is that it's like a thousand times cheaper and faster than doing it. So even if you can't always get the exact same results you would get if you went out and did a study, we're using this a lot in areas where you just could never possibly do market research at that scale. Test every single ad that you run or explore 100 product ideas, things that you just ridiculously slow and expensive to do normally.
Greg Kilstrom
So it's, Yeah, I mean it's, it's speed, it's scale and I would assume it's, it's cost too. Right. Because I mean it's expensive to do focus group research and stuff. So it's really kind of all of the, it's, it's the, the good, fast, cheap kind of the, the antithesis of that, Right?
Mike Taylor
Yeah, exactly. And, and, and in some cases actually it's not even really comparable to market research because you might not even be able to do market research in that space. Like it, like you can if you're, if your product is mainstream consumer, then you can go and Give, give out $100Amazon gift cards and get people to join the focus group, but they might not actually even respond in a way that's predictive of the consumption habits. Right. So there's all sorts of issues with traditional market research as well. And you know, quite often the people you're trying to reach, they're just not going to be swayed by that Amazon gift card. Like if your audience is like CEOs of 5,000 person companies or whatever, how do you go and get those guys into a focus group? So yeah, the people are using it, I think to fill in the gaps around scenarios where there is no real world comparable.
Greg Kilstrom
Yeah. So for those skeptical, I mean, I know a lot of people in market research and great super smart people and great at what they do. For those that are asking, you know, can the synthetic Persona really, you know, ever represent like niche human behavior? You know, what, what would you say to that? You know, what, what, what are the cases where it can work really well?
Mike Taylor
Yeah. So just out of the box with the, you know, state of the art models today when we compare the AI results to real world studies, like we ask the same questions with the same kind of definitions of who should participate in the study. It's like 50, 60% accurate or similar out of the box and with some testing and calibration we call it, where we optimize the responses until they get more realistic. We're seeing 70, 80% accuracy, so definitely good enough to be directionally correct. You know, it's never going to be the only thing that you do. And in fact I would say that quite often it's itself like making the business case to do more traditional research. So we worked with a big holding company agency on a credit card project and the reason why they were doing this max diff analysis that we did was they were using it for a pitch. When you're doing a pitch, you can't really, I mean you run a marketing agency, it's like it's always this trade off, like you can't really just do all the work, it costs too much money. But they want to at least see what type of work you could be doing for them in order to make the decision. So you end up having to do a bunch of work on spec. And in this case they're doing the AI version on spec and then pitching for the real study that they're going to scale up. But the synthetic study can then also inform the parameters of the, of the human study. Right. So you know, some of the questions we revised after seeing that the AIs stumbled on those questions or didn't give us the type of responses we wanted. So I think that it's this kind of nice symbiosis between them. I don't think it's either or.
Greg Kilstrom
Yeah, yeah, that makes sense. And yeah, I mean, you know, just like there's skepticism, I would say, on the, you know, how accurate the AI is. I think the, the thing that is under underreported or not talked about as much is how unpredictable humans are and biased humans can be as well, you know. So you mentioned the incentive. Again, I'm not a professional market researcher, but I'm going to make an assumption that there are certain people that take incentives to answer a survey and certain people that don't. And yeah, again, it's going to completely vary based on what the incentive is and so on and so forth. But it's like there's not, not bias when you, when you ask humans. But I guess that that throws another wrinkle into it as well. Because how do you account for human bias in something like synthetic research and an AI?
Mike Taylor
Yeah, exactly. I mean, it's always a difficult thing. And funnily enough, like in this specific AI industry, we have the opposite problem of most AI tools, which is they want to try and remove the bias and we actually want to introduce it.
Greg Kilstrom
Right, right.
Mike Taylor
Because we want our AIs to be biased in the same ways that humans are biased. Because we want to try and predict where they will act in certain situations. So, you know, if like a really good example is everyone says they want an eco friendly car and then when it comes down to it, they buy the suv.
Greg Kilstrom
Right.
Mike Taylor
And you know, there's all sorts of scenarios like that where there's like a gap between the intentions that people have or what they say in their focus group versus what they actually do when they're in the market. And so if you just query the LLMs, they actually share that same bias. Right. Like they say that the eco friendly car is what they would buy. So a lot of the work we've been doing is to try and actually calibrate it towards the point where the AIs are speaking more truthfully about what people actually will do. And that's something that's quite nice because you can't do that with real people very easily. You can't just like find the right prompt to get them to tell the truth. Right. Whereas with AI, you actually can keep testing until you find the truth seeking prompt.
Greg Kilstrom
Yeah, yeah, well, and I mean, I think that also makes the case for what you're saying earlier, which is, you know, a mix of synthetic and real world. And I would, you know, I would add to then the, the actual, like behavioral activities that they have. Right. Like it all, it all kind of needs to get, get reconciled. Right. Because I mean, you know, at the end of the day, how do you uncover the biases that help, you know, point the synthetic in the right direction? Like how, how is, is that, is that you know, kind of observing after the fact?
Mike Taylor
Yeah. What we try and do is we'll take various studies that we know are problem studies. Like, you know, our customers come to us and say, hey, I don't think this is quite right or whatever.
Greg Kilstrom
Yeah.
Mike Taylor
Or we'll, we'll, we're reading a lot of the research papers to see. You know, there's actually like a real deep amount of research here from social scientists because this is like a playground for them. Right. Like, yeah, it's pretty amazing to be able to do this. And, and there's like, there's fewer ethical quandaries than there would be if you were trying to, I don't know, trick real people into things one way or no. That's where a lot of our focus is in trying to figure out what models are better at predicting real world behavior, what prompts, how many examples do we have to give them of what realistic responses look like that sort of thing.
Greg Kilstrom
Let's, let's go back to kind of that symbiosis between synthetic and real world. So you mentioned, you know, this could be, you do synthetic first to get some sort of directional guidance on what to do and then take it into the real world. Is that, is that generally how, like, can you talk through, like, how, how does that work best?
Mike Taylor
Yeah. So you never have the right answer. You never have the complete answer. Nobody's ever going to come to you and say, if you launch the product in exactly this way, it will work. So you're only trying to improve the odds. And there are two major things you can do to improve the odds. One is you can avoid costly mistakes. So you can avoid doing something that is predictably bad, or you could identify untapped opportunities. And so I would say that typically you start with synthetic research just because it's cheaper, faster, and in the early days of an idea, you're just kind of looking for a steer. You're like, there's all these opportunities, which one should I pursue? I have all these names. Like, which name is interesting? I have all these potential ideas to test. And especially if you're using AI to generate ideas as well, you could have hundreds or thousands of potential paths. So a lot of the times it's just narrowing it down and you don't actually know. You can't, you can't go out and test a thousand different names for your brand.
Greg Kilstrom
Right.
Mike Taylor
You're just never going to have like the budget to do that. But you might be able to test 10. Right? So if AI, if I AI can bring you down from a thousand to 10, then you can build the business case to say, okay, we're going to go after these 10. Or if you disagree with the AI, then it gives you something interesting to explore because you're, hold on, well, why did I disagree with that? Like, what is it that I like about that name? And then it kind of gives you a bit more of a chance to react against what the AI is telling you. Like, sometimes our customers get better results just by like having a reaction and going, huh? Like, okay, like why do I want to fight for this name? Like, what is it? That is not being said here?
Greg Kilstrom
Yeah, right, right. So how does this compare to like using predictive analysis? So, you know, just looking at, you know, Current customer available data, let's just say. But, you know, current customer stuff and, you know, running predictive models. Like, what are maybe the pros and cons of doing something like this versus. Versus predictive.
Mike Taylor
Yeah. So GPTs are predictive models themselves, but they've been trained on every single variable like, that's online. So, you know, there's the thousands or trillions of parameters. Right. For GPT4 or that class model. So you can simplify it and say, I'm going to build a predictive model. I'm going to say that, say I'm trying to predict what movie is going to be a big hit this summer. I can go, okay, well, movies about vigilante orphans who are wealthy seem to do really well. You know, Batman, Iron man, you know, like Counter, Monte Cristo, Zorro, There's a whole deep bench of movies like that. But then you go, okay, well, how come Iron man was so much more successful than the Batman franchise? It's not just because of the underlying character. In fact, for the longest time, Batman was way more successful than Iron man until Marvel got their act together and did. And now they're trying to revive Batman and make that big. So there are all these smaller variables of timing, current culture, even within the movie franchises. Some of the Batman movies, like Christopher Nolan ones, have done way better than some of the others. So at some point, you just can't really understand all of the variables. But you have access for a couple of dollars to this incredibly predictive model that is to some degree, a human brain simulator that has been trained on every human brain that's been on the Internet. They are just a very, very good baseline to start with. And you can add traditional predictive models into this as well and kind of weight your decision in some way. But this is the type of model that you could only dream of as a researcher to, you know, previously. And now you have it available in an API, and that's. That's pretty powerful.
Greg Kilstrom
Yeah, yeah, definitely. So, I mean, yeah, it sounds like. And I, in my experience, too, it's like that the narrow. The predictive, like just on a narrow set of data, you're not taking into account all of the other factors because, I mean, we're, as humans, we're influenced by lots of everything, if not lots of things. Right.
Mike Taylor
So it's.
Greg Kilstrom
It's not just a narrow set of characteristics in a spreadsheet or something like that.
Mike Taylor
Right, Exactly. Yeah.
Greg Kilstrom
Yeah.
Mike Taylor
And, you know, at the end of the day, they've seen, like, these models have seen how People interact in different scenarios, so they, you know, especially if you don't know that much about the customer, like, you can get a pretty good sense of who that customer is and get out of your own head. I think so. You know, would I listen to this model instead of Steve Jobs if he was giving me advice? Right. Or like one of the great, like, you know, product thinkers or marketing thinkers of the world? No, I'd probably wait their advice higher, you know, but do I have access to that? No. So, like, you know, especially if I'm on my own building my business or like, I'm preparing a presentation and I don't have any resource where I can go, you know, talk to someone who has deep expertise in that. In that field. This is an, you know, a really good alternative. Yeah.
Greg Kilstrom
And I mean, even if you could talk to Steve Jobs, it might be interesting to see what this also says. Right. I mean, it's. Isn't it. Because there, I mean, everyone is fallible and there's, you know, there's a lot of. I think, I mean, what I'm hearing you say is, you know, it's not. It's not that there is one single source of truth and everything like that, but all these things are very beneficial to be able to look and compare and even to use the, you know, to prompt someone to, you know, ask deeper questions and stuff. Is that. Does that. Is that correct?
Mike Taylor
Yeah, exactly. You can iterate, whereas you can't really do that very easily with a focus group. Right. Like, you have to schedule it, you know, talk to people, you know, or surveys. Like, wait till. Wait till the responses come in, and then you're like, oh, I wish I would have asked this question. You know, you had to kind of follow up. Like, one of the things we find is people will take the results of the research they've done already and then create percentage based off that. So, like, we did 126 customer interviews when we launched, and then we have that as like an audience in rally that we ask questions about when we're deciding what to build. So, like, it's a kind of a way of continuing that focus group.
Greg Kilstrom
Yeah, yeah. So can you talk a little bit about Ask Rally and how does it work and things like that?
Mike Taylor
Yeah. So it is basic core level, similar to ChatGPT, except you're chatting with many GPTs at once. So you put out a question, you get 100 responses, for example, and you can create those Personas so you can go in and define your audience and then generate the Personas. We also have a bunch of pre created Personas for you to try in different fields. Like we have one that matches U.S. census data, for example. Like if you're going after the US market and then you can just ask questions, you ask follow up questions. Or you could also do voting as well. So you can do polling and say like, okay, which of these options would you choose? You can upload images and videos specifically with the Google models. So we have Google Gemini, we have OpenAI's models, we have some open source models and the anthropic models as well. So yeah, people can switch between them.
Greg Kilstrom
That's great. So as we wrap up here, a couple things for you. What do you think is the biggest misconception or misunderstanding about synthetic research? Synthetic Personas good or bad?
Mike Taylor
Yeah, I would say that a lot of the misconceptions about synthetic Personas are not specific to that industry. Either you believe in AI and you use it for everything or you see it as like a threat or a scam. And there's no way I'm going to convince you other way. Right? Because I'm, you know, it's not my job to convince people of that. Like, they'll figure it out eventually, you know, but, but like I think you have some people in the industry who have taken a stance against AI, generally speaking, like, because, you know, they're annoyed that people's jobs might be at risk, which is I think perfectly valid like response or they don't like the copyright angle that they're training on copyrighted material or you know, for one of, or just like, you know, they've, they made an offhand comment at a conference and people responded well and they thought they were going to, I'm going to make this my whole personality to hate on AI. Right. And that's fine. And at the end of the day people have to make their bets. But I think if you already believe in the power of AI and you're using ChatGPT or Claude or whatever to get feedback, then you just kind of understand this intuitively and you're going to use it. But almost everything that they could complain about with AI is also a problem with humans too. That's what I find. So whenever I see they go, oh, what about the hallucination? I'm like, have you talked to a consumer? Because they make stuff up all the time, right?
Greg Kilstrom
Yeah, I love it. Well, last question for you. I like to ask this to everybody on the show. What do you do to stay agile in your role and how do you find a way to do it consistently.
Mike Taylor
Yeah, good question. I came from an economics background, so when I was studying in school we were learning all about Japanese manufacturing was the cool thing at the time to learn and so that was ingrained into me, Kanban boards and all that stuff from the very beginning. So I would say I'm an agile native in that respect. That's always just been the way I operate and I don't know if I'd be able to operate in any other way. It's probably why I've navigated towards startups and stuff rather than waterfall processes. So it's almost like I'm like a fish in water and I can't describe the color of water because it's like everything I see. But yeah, very specifically I would say one of the things I like to do is think about how my beliefs have changed with new information. So like a Bayesian kind of way of thinking is how you might describe it. So I never say yes or no. I always kind of adjust mentally. I think about I'm adjusting my probabilities. So like if I run a test and something fails, I don't say I'm never going to do that again, I just say I'm less likely to try that next. Right now the other things that I could have done just got a little bit higher in the list and that dropped a little bit lower. So I think if you think that way gives you the mental agility, I think, to contradict yourself and you need to be able to do that when you're operating under uncertainty, which is the case when you're building an AI startup.
Greg Kilstrom
Yeah, yeah, Love it. Well, thanks so much for joining again. I'd like to thank Mike Taylor, founder and CEO of Ask Rally, for joining the show. To learn more about Mike and Ask Rally, you can follow the links in the show notes. Thanks again for listening to the Agile Brand brought to you by Tech Systems. If you enjoyed the show, please take a minute to subscribe and leave us a rating so that others can find the show as well. You can access more episodes of the show@theagilebrand.com that's theagile brand.com and contact me if you're interested in consulting or advisory services or are looking for a speaker for your next event, go to www.crowd greggkillstrom.com that's G R E G K I H L S t r o m.com the Agile brand is produced by Missing Link, a Latina owned, strategy driven, creatively fueled production co op. From ideation to creation they craft human connections through intelligent, engaging and informative content. Until next time, stay curious and stay agile.
Liberty Mutual Spokesperson
The agile brand.
Pura Brand Voice
Refresh your space for summer during PURA's Summer Savings event. Enjoy 20% off site wide with exclusive savings on our smart home fragrance Diffusers. It's the perfect time to upgrade. Visit pura.com whether it's a birthday trip,
Liberty Mutual Spokesperson
a family reunion, or just a fun getaway, booking a VRBO vacation rental means no worrying about surprises. Verbocare and 24.7Life support have your back if something's off. The Loved by Guest filter helps you find top rated homes, and verified reviews mean real feedback from real VRBO guests so you know exactly what you're booking.
Greg Kilstrom
Honestly, I just booked my VRBO because there was a sweet wine fridge.
Liberty Mutual Spokesperson
Hey, we all have our reasons. Don't walk into a surprise if you know you VRBO terms apply. See vrbo.com trust for details.
Episode #717: Understanding Customers By Simulating Them First
Guest: Mike Taylor, Founder and CEO of Ask Rally
Date: August 11, 2025
In this episode, Greg Kihlström delves into the world of synthetic research and AI-powered Personas with Mike Taylor of Ask Rally. The discussion centers on how simulating customer behavior using AI can supplement—or, in some cases, substitute—traditional market research. The conversation explores the practical benefits, limitations, and intersection between synthetic Personas and real-world human behaviors, offering a fresh perspective on understanding audiences at scale.
[05:12] Mike Taylor:
[06:39] Greg Kihlström & [06:55] Mike Taylor:
[08:14] Mike Taylor:
[11:03] Mike Taylor:
[14:14] Mike Taylor:
[16:19] Mike Taylor:
[21:07] Mike Taylor:
[22:19] Mike Taylor:
[24:12] Mike Taylor:
This episode bridges the world of classic market research with the cutting edge of AI and synthetic Personas. Mike Taylor unpacks both the capabilities and realistic boundaries of simulating customers, emphasizing speed, scalability, and supplementing—not replacing—human insight. The talk sums up that the most strategic brands will blend AI-driven simulation, real behavioral data, and human expertise for a richer, more agile understanding of their audiences.
For more: