← The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
#746: Microsoft's Kelly Soligon on personalizing the DTC customer experience
00:22:17
Loading summary
Transcript43 lines
- [00:01]
Podcast Host / Announcer
What makes a leader worth following? What should you really care about in your job? As technology is changing so quickly, is it just gonna be about machines talking to other machines? I mean, should you quit your job and start something on your own, what would that take? What does success and risk look like when we're all at the starting gate together? These are the questions we answer each week on Lead Human with Jack Myers and Tim Spengler. Join us each week and subscribe at your favorite podcast platform and YouTube. We'll tell stories, we'll hear from some of the best, and we'll try to figure this out together.
- [00:35]
Pura Brand Advertiser
Refresh your space for summer during Pura Summer Savings event. Enjoy 20% off site wide with exclusive savings on our smart home fragrance Diffusers. It's the perfect time to upgrade. Visit pura.com
- [00:52]
Kelly Sulligan
the Agile brand
- [00:55]
Greg Kilstrom
Foreign.
- [01:01]
Greg Kilstrom (Closing Remarks)
Welcome to Season seven of the Agile Brand where we discuss the trends and topics marketing leaders need to know. Stay curious, stay agile and join the top enterprise brands and martech platforms as we explore marketing technology, AI, e commerce and whatever's next for the Omnichannel customer experience. Together we'll discover what it takes to create an agile brand build built for today and tomorrow and built for customers, employees and continued business growth. I'm your host Greg Kilstrom, advising Fortune 1000 brands on martech, AI and marketing operations. The Agile Brand Podcast is brought to you by Tech Systems, an industry leader in full stack technology services, talent services and real world application. For more information go to teksystems.com to make sure you always get the latest episodes, please hit subscribe on the app you listen to podcasts on and leave us a rating so others can find us as well. Now onto the show.
- [01:59]
Greg Kilstrom
When we as consumers are saturated with marketing messages, how can brands cut through the noise and create truly resonant experiences that go beyond transactions to create genuine long term customer relationships? Agility requires a willingness to constantly adapt and evolve your strategies based on real time data and customer feedback. It also demands a culture of experimentation and a commitment to iterating quickly on what you learn. Today we're in New York City at Content Square's CX Circle and we're going to talk about leveraging AI and personalization to drive success in direct to consumer marketing. To help me discuss this topic, I'd like to welcome Kelly Sulligan, VP of Consumer Digital Direct Sales at Microsoft. Kelly, welcome to the show.
- [02:41]
Kelly Sulligan
Great. Thanks for having me Greg.
- [02:42]
Greg Kilstrom
Yeah, looking forward to talking with you here. Before we dive in though, why don't you give a little background on yourself and your role at Microsoft, of course.
- [02:49]
Kelly Sulligan
Well, as you said, I lead our digital direct sales business and that's a fancy way of saying that I lead our global e commerce business for consumers. So if someone comes to Microsoft.com and they buy an Xbox or a Surface laptop, that's my team running that consumer engine or the direct to consumer channel for Microsoft. We operate in over 180 markets, have over 10 billion visitors annually to our consumer facing properties and it's a really fun role. I've been at Microsoft 23 years, about half the time in the commercial space and about half the time in the consumer space. So really love what I'm doing.
- [03:22]
Greg Kilstrom
Nice, nice. Love it. So yeah, let's, let's chat. So you just wrapped your session here at CX Circle talking about AI and personalization for Microsoft's DTC business. As you said, what's the one thing you want people to walk away with the talk that you just gave?
- [03:37]
Kelly Sulligan
Yeah, great question. I was able to share really where we've been focused in the last year around AI innovation and how that affects personalization as well. And we've been doing some really interesting things in our voice of customer business. We get over 4 million pieces of feedback from customers annually. Tons of different channels. It could be, you know, service, customer service transcripts, it can be post survey, purchase feedback, etc. And so we're using AI just to get clarity within that feedback. As you can imagine, 4 million, the quality varies pretty, pretty wildly. And so we're using AI to help us identify high quality feedback and then quickly take action on it to improve our customer experience. That's one of the areas that we're really excited about. We also launched a virtual store assistant that's a generative AI experience. It replaced a chatbot that was pretty archaic and is really, I think, meeting the needs of customers where they are today. You're able to across our shopping journey from shopping all the way to support customers are able to interact in a human way, ask questions. The virtual assistant gains more clarity you can do if you're shopping for a laptop, for example, it can do compare charts right there in the chat stream and help the customer buy the device right there or get, you know, answers to their support. And so we're excited about that. It's been a really great high satisfaction experience for our customers. And then in personalization I've been really proud of the progress we've made. We've moved from more of a kind of like a experimentation sidecar if you will to having personalization embedded across our customer journey. And again we're using AI to help us do this because there's, I mean I only have so many humans on my team and so of course, you know, we're really, we turn to AI to say how can you look at our high intent signals, you know, like add to cart and help us reorder product cards, help us show additional offers to customers. And so that's all been, you know, all of these three examples are how we're using AI just to improve our customer experience and our operations of our E commerce channel. It's super exciting, you know, like this pace of innovation. It's also making me think forward to the future of what is the role of agentic commerce. And you know, how do we take our store assistant further? How would someone shop within ChatGPT? So just a lot of opportunities for us to continue to focus and really rapidly evolve our customer experience.
- [05:56]
Greg Kilstrom
Yeah, yeah, definitely. And so you know, some people listening out there might be struggling with 4 million data points. You're talking about 4 billion here, a little few more. And you know, this just bring, you kind of touched on this already but you know, personalization at scale, you know, and we're talking a massive scale at this point. And so you know, I feel like we've been talking about one to one personalization for you know, at this point decades. It feels like at least it's you know, with a combination of all of those data points being collected plus AI. How has that kind of changed the perspective on you know, being able to really meaningfully do personalization at scale?
- [06:40]
Kelly Sulligan
I don't think without AI you can do it at scale. I mean we were trying, you know, you're doing kind of one off experiments and you're making progress there of course and you're creating better customer experiences. But you know, the type of volume that we have, I think you have to be employing AI tools and experiences to do that. I've really liked the ability as well to go beyond clicks and like optimizing on the click to optimizing on a high value engagement. And so as an example for us I would say adding to cart is a high value engagement or cart completion. And so I've been able to train the AI models to be able to show oh this customer is high intent. Okay, how do we show them a different set of products that matches and is a winning offer for them. Now that before would have been super manual to do but now with the AI models that we're Employing and the personalization there, we're able to do that at scale, and we're seeing really measurable results for our business. And so I think you also have to make it a core capability for your business and something that, as a leadership team, we want to invest in. We think personalization is key to unlocking better customer experiences, making your sites stickier and more engaging for the customer. So you have to be doing it at scale to get to that. And so it's been a really fun journey. I like to say it's more of our core capability now versus something that a few people worked on. Like, everyone is invested in personalization, and we're seeing the results from that as well.
- [08:04]
Greg Kilstrom
Yeah, I mean, it's one of those things where the numbers were always, you know, the research was always there. They poured out. It's just when you actually start doing it. And again, you know, I mostly work with enterprises too. You know, when you actually start doing it, it's like you uncover the silos, the hurdles, the, you know, the scaling issues. So.
- [08:23]
Kelly Sulligan
And I think there's another point there. I'm talking about, like, do more of it. There's also, like, really understanding what the business impact of it is and determining where you want to put your chips. Because, yeah, you could personalize everything and you could be running every a model, you know, 24 hours a day, but is it really resulting in measurable business impact? And so I think that's another learning we've had of what, you know, I talked about the high, you know, intent actions is focusing there, because if not, you're just kind of personalizing everything, and it's hard to parse out where you're truly having impact. And so I think that's something to consider. Yes, it's great, great to have the ability to scale, but then think about where you can have the most impact from that.
- [09:04]
Greg Kilstrom
Yeah, so you mentioned agentic, so let's go. You know, I feel like Gen AI was like all the ra. It still is, but, you know, new buzzword. Yeah. Agentic is the term du jour. I guess so, you know, not only are they customer facing, but they're also employee facing as well. You know, talk a little bit more about, you know, how agents have impacted the buyer experience and your approach.
- [09:31]
Kelly Sulligan
Sure, yeah. This has been one of the things we've been most excited about in the past year. We launched our Virtual Store assistant a little over a year ago. We've had over 1.7 million AI conversations with our generative AI virtual store assistant. And it's really helping customers get to, you know, their end game faster in the shopping space. It's helping them compare products, it's helping them you'll get recommendations, configure a product, you know, buying a laptop, there's lots of options. And you know, I work in this space and I'm still like, hey, which version do I want? And so that store assistant can really guide a customer through what are you looking to do? Like how much memory do you need? How much processing speed do you need in human terms, not in tech specs. And that's one of the things I love about it the most. And it can help people complete their purchase support. It's helping people, you know, do the basics like order, lookup and returns and shipping information. But it can also then determine when it's going to be most high value to hand you to a human. Because I think there's still a role like the agents can do a lot, the block can tackle things, but there's sometimes a spot where a customer is going to really benefit and have a better experience with your brand if they talk to a human. And so it can hand off very elegantly to a human and really get the customer, you know, to the resolution that they need. So we've been loving it. We have plans to expand it internationally. We're looking at new modes, you know, it's chat based typing right now. But like what role would voice play in that? What role would vision potentially play in that? And so we're excited to keep expanding there and we've also are thinking about how when you come to Microsoft.com would you just interact with this agent? Instead of maybe clicking through a navigation or searching in the site, you would just interact with an agent there to find, you know, maybe shopping information, maybe corporate information. And so we're excited about the future of that within our own site experience.
- [11:28]
Greg Kilstrom
So taking into account like agents operating, you know, optimally, you know, what are some of the important elements that you need to take into account to, you know, get set things up for success?
- [11:41]
Kelly Sulligan
Yes, they can go wrong. You know, I think we've all seen some public examples of that. And so, you know, I'm not a technologist, so I know that this is, there's a lot more under the hood here. But I would look at kind of three different elements when you're creating an agent, really being first up front about what your use case is, clear intent, give the agent some guardrails because without that context, you don't know where, where it's going to go. And so I think you have to start with like, what is the use case for me? You know, if it's in a customer experience, what are the parameters of that, where I want it to operate? Second, I think you got to look at data quality and governance like, you know, garbage in, garbage out in the old data world. It applies here as well too. And so you have to, you know, really be thinking about what is your data model, your governance of that to ensure, you know, accuracy, to ensure transparency, privacy, etc. So I think that is the second pillar. And then finally, I would say the humans are still important. You can't just set it and forget it. You need to have the right level of human monitoring and checking the customer, especially when it's in a customer experience, checking that experience and saying, hey, is this what we wanted to represent as a brand? Is this what we wanted customers to see next in their journey? And checking that and then optimizing, tweak the model, tweak the parameters and optimize from that. But I really think you have to like, you think about those three areas, clear intent and use case. What's our data model and the governance of that and then how do we monitor it and optimize it as the CX leaders?
- [13:18]
Greg Kilstrom
Yeah. So customer feedback, I mean as we've seen today, it comes in many forms. Can you share a moment where voice of the customer data like surveys and messages told you one thing while behavioral data told you something else?
- [13:34]
Kelly Sulligan
Sure. I love voice of customer data. I get a lot of it too, which is great. And having the AI tools to be able to really identify the high quality feedback is important. You know, as I thought about this question, we had an example of where we were seeing from our post purchase surveys, five stars. This is great. So seeing that I'm like, okay, this is a clear winner for. But then I was looking at more of our behavioral and transactional data and seeing a higher than average return rate on the product. And so it's like you're hearing from the customers this, but then I'm seeing their actions be different. And I also find, I don't know if you find this too. Like the people who fill out surveys, for the most part they're either super happy or they're super mad.
- [14:17]
Greg Kilstrom
It's a very particular subset.
- [14:19]
Kelly Sulligan
Exactly. And so you have to take that with a grain of salt as well. And so it's a data point, but then how do you dig further and tie that data point then to like some more, you know, behavioral data that you see or you know, your business data. If I see high returns, I'm like, oh, we got a problem there. And so I think it's really narrating those things and like, you know, data, this is true of like stats. I remember this from a stats class. They can tell any story you want. And so it's really, I think, coupling the data you have with, with what you're seeing in your true customer behavior as well as in your business results and putting that puzzle together and just say, okay, how big is this problem or how small is this problem?
- [14:59]
Greg Kilstrom
Hopefully, you know, yeah, I guess so what, what is. I know every situation is gonna be different, but like, do you have a thought process or rule of thumb of like, how do you know which sources to listen to when and stuff?
- [15:12]
Kelly Sulligan
It's not like an exact science. I will say we have used an AI model and that identifies high quality feedback. So it's specific, it's actionable and it's linked to a real experience. You know, if somebody gives me a piece of feedback that says slow, like what can I do with that? But somebody's giving me some actionable feedback that's specific. And we, so that is our definition of high quality. Our AI model picks that up and puts it at the top of the list for our analysts to look into further. We further then married that with what we call basically high value engagement actions. And so I would look at something like add to cart and cart completion and average order value number of products in the cart. And so those are some high intent and high value engagements for us. And so we're saying, hey, the high value feedback that is also really critically linked to one of our KPIs there around add to cart or cart completion, boom, that goes to the top of the list because there I see I have a real opportunity to fix something for customers and I have a real opportunity to probably make some more money. And so that's the mental model we've been using to kind of pass through all of this, you know, then you have to say, can I fix it? You know, there has to be the realism factor. They're like, sometimes it can't fix everything.
- [16:28]
Greg Kilstrom
Yeah, it might be in the top, I just envision a quadrant, but like it might be in the top. Right, but it's going to take, you know, a year.
- [16:36]
Kelly Sulligan
Yes, exactly. And so then, then you get creative, like, what else could we do? You know, And I think that's where some cool innovation and breakthrough thinking can come of. Like, hey, the standard way of doing this is going to take us a long time. What can we do differently here that might be better for the customer?
- [16:50]
Greg Kilstrom
Yeah, yeah. So, you know, we've talked quite about AI being used in quite a few different ways here. What's a, what's a prediction for, you know, how AI is going to change e commerce over the next few years? I. Five years feels like way too far to like, I can't predict five years. Let's say, let's say a year. Let's say we're having this conversation a year from now. What are, what are we talking about here?
- [17:16]
Kelly Sulligan
Yeah, I, I just think about my own searching behavior as a consumer and how much that has changed in the last 12 to 18 months. I used to open up a web browser and search for a product. Maybe I'd go to directly to the brand if I knew what I wanted or to a retailer site, but I would search within their site, that type of thing. Now I open up Copilot or I open up ChatGPT and I'm doing my searching right there. Like what's the best laptop for me? What hotel should I book in New York City? Like, I'm looking for somebody to give me the answers quickly. And so I look at just how my own searching behavior has changed in the last 12 to 18 months and say if I'm experiencing that, millions and zillions of other people are experiencing that as well too. And, and so we in E commerce have to adapt for that. I truly believe that shopping in the future is going to be agent driven or influenced to some extent. You saw OpenAI announced yesterday they are agentic commerce within chatbots, partnering with Shopify and Stripe for the payment side. That's brilliant. I think that is where shopping is going to be. You're in, you're using chatbots, your personal AI assistant, to help you determine which laptop to buy. And then you're just buying right there in this stream. And I would imagine a great customer experience where I can go back to that chat and I can see my order information, I'm getting my shipping information from when in there. You know, it's a really great customer experience. And so I really think we're preparing to say, hey, gosh, all these AI agents, chatgpt, Copilot, Gemini, you name it, these are great new traffic sources for us because people are using this as part of their daily life to get answers, to find information, to do research on things they want to buy. Why not enable purchase within there? And so for, for me, I'm really thinking about what do I need to do with APIs? What do I need to do with my data to make it discoverable by these personal AI agents that people are using and make me Shopping should be seamless. I'm an E commerce leader. Like I'm like it should be so easy to shop and that to me is a new easy channel for customers to shop through. And I think it's happening fast. Like just like you said, like no way we can predict five years from now. Like I think this is happening so rapidly and so just sitting back and waiting. I don't think as an E commerce leader you can do that. You got to have some chips on the table and be experimenting and learning and you know, not everything's going to work but what do you learn from there and take forward into the next rev? But I think our customer experience experiences are going to look a lot different very quickly.
- [19:48]
Greg Kilstrom
Yeah, yeah. Well, we'll have to talk in a year and compare our predictions here, so that's great. So. Well Kelly, thanks so much for joining today. One last question before we wrap up here. What do you do to stay agile in your role and how do you find a way to do it consistently?
- [20:04]
Kelly Sulligan
Great question. You know, I think for me it has to start with I have to have energy. I think moving fast can, you know, it can wear you out if you don't take care of yourself. And so I'll start from kind of a personal side on this. I think it is very critical for all of us to make time for ourselves, for our well being, mental, physical, you know, spiritual, emotional. And so I really, for me, I know I do my best work when I'm energized. And so I exercise every day. I have to take that walk, I have to, you know, take that class because that refuels me and gives me the energy then to be put in these positions where I have to be agile and know I'm getting some stress. But okay, I've taken care of myself. So you know, it's kind of like you put, put your mask on first, you know, because you got to take care of yourself first. So that applies to all of life for me, not just work.
- [20:50]
Greg Kilstrom
Yeah, yeah.
- [20:51]
Kelly Sulligan
But then second, I've been really focused on curiosity and how do I expose myself to different perspectives so that I'm constantly learning. And so I really try to actively dedicate time to meeting with people within Microsoft, meeting with people within my industry, but also just meeting with people outside of my industry because I feel like some of my greatest ideas and thinking have come when I've talked to somebody who's in a completely different, you know, space than me and they're like, oh, here's what we're doing with our customers. I think, oh, that can work. Like there's that kernel in there that I could bring to my business and make it relevant to what we're doing. And so I really try to block out some time. I try to have like coffee dates two to three times a week, meeting different people. Like I will take, you know, anybody reaches out is like, if I want to learn about your business, I'm like, yes, and I want to learn about yours, you know, because I just think being curious and exposing ourselves to different perspectives is where you kind of get the best quality of work. And, you know, if you keep listening to yourself and hearing the same thing over and over again, you get the same results. That's not where breakthrough comes. And so I feel like just I've really been trying to lean in on curiosity, you know, to the extreme lately.
- [21:58]
Greg Kilstrom
Yeah, I love that. Again, I'd like to thank Kelly Sulligan, VP of Consumer Digital Direct Sales at Microsoft, for joining the show. You can learn more about Kelly and Microsoft by following the links in the show notes.
- [22:10]
Greg Kilstrom (Closing Remarks)
Thanks again for listening to the Agile Brand brought to you by Tech Systems. If you enjoyed the show, please take a minute to subscribe and leave us a rating so that others can find the show as well. You can access more episodes of the show@theagilebrand.com that's the agile Brand and contact me if you're interested in consulting or advisory services or are looking for a speaker for your next event, go to www.gregkillstrom.com that's G R E G K I H L s t r o-m.com the Agile brand is produced by Missing Link, a Latina owned, strategy driven, creatively fueled production co op. From ideation to creation, they craft human connections through intelligent, engaging and informative content. Until next time, stay curious and stay agile.
- [23:03]
Kelly Sulligan
The agile.
- [23:12]
Podcast Host / Announcer
ACAST powers the world's best podcasts.
- [23:16]
Greg Kilstrom
Here's a show that we recommend.
- [23:21]
Jameela Jamil
What if you laughed all through your commute? Or if you heard the funniest story while at the gym?
- [23:26]
Kelly Sulligan
Well, now you can.
- [23:27]
Jameela Jamil
I'm Jameela Jamil and guests on my new podcast Wrong Turns share their most mortifying and hilarious disaster stories. I'm talking people like Mae Martin, Bob the Drag Queen, Catherine Ryan, Jake Johnson, Margaret Cho, Simon Pegg, Penn Badgley, and so many more. So listen wherever you get your podcast past wrong turns where dignity goes to die.
- [23:51]
Podcast Host / Announcer
ACAST helps creators launch, grow and monetize their podcasts everywhere.
- [23:57]
Pura Brand Advertiser
Acast.com refresh your space for summer during Pura Summer Savings event. Enjoy 20% off site wide with exclusive savings on our smart home fragrance Diffusers. It's the perfect time to upgrade. Visit pura.com.