← The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
#736: Taking ROI models from confusion to clarity with Carlos Manalo, The Office of Experience
00:34:55
Loading summary
Transcript47 lines
- [00:00]
A
If you love podcasts, and obviously you do, you need to check out Castro. It's a podcast player designed for people who subscribe to a lot of shows but don't have time to listen to everything. Castro helps you cut through the noise, manage your shows, and simply enjoy listening. It's the podcast player built for podcast enthusiasts. So download Castro and start listening today. That's Castro. C A S T R O Enjoy listening the Agile Brand.
- [00:30]
B
Foreign.
- [00:35]
A
Welcome to Season seven of the Agile Brand where we discuss the trends and topics marketing leaders need to know. Stay curious, stay agile and join the top enterprise brands and martech platforms as we explore marketing technology, AI, E commerce, and whatever's next for the Omnichannel customer experience. Together we'll discover what it takes to create an agile brand build built for today and tomorrow and built for customers, employees and continued business growth. I'm your host Greg Kilstrom, advising Fortune 1000 brands on martech, AI and marketing operations. To make sure you always get the latest episodes, please hit subscribe on the app you listen to podcasts on and leave us a rating so others can find us as well. Now onto the show. Are your technology and marketing investments driving real business value or are you simply throwing money at the latest trends? Agility is being able to react to change while knowing which strategies, processes and technologies are ultimately moving the needle and driving real business outcomes. This episode is brought to you by the Office of Experience, a design driven, digital first vertically integrated and collaborative agency that believes in the power of ideas and the strength of people. Today we're going to talk about taking ROI models from confusion to clarity. Specifically, in the B2B E commerce space, we'll explore how to build models that truly reflect business value, avoid common pitfalls, and unlock exponential growth. To help me discuss this topic, I'd like to welcome Carlos Manalo, Co CEO and Co Founder at the Office of Experience. Carlos, welcome back to the show.
- [02:10]
B
Thank you. Always excited to be here and always excited to share what we can to make sure that our friends and peers across all of the diaspora of what we do in B2B E commerce can actually make a dent into the universe.
- [02:24]
A
Yeah, love it. Love it. Yeah. And always, always love talking with you here. So looking forward to this. Before we dive in, if somebody hasn't caught you on the show before, why don't you give a little background on yourself and your role at Office of Experience?
- [02:36]
B
Yeah, so I could spend hours on this, but the short version of it is that, you know, I've been around in the industry for over 30 years. You know, I started out in this space that we used to call information architecture, Architecture now user experience. But from there graduated fairly quickly into digital strategy. I've worked client side at organizations like Crate and Barrel and Granger and then the consulting side at organizations like Sapient, now Kublis, bunch of other different places and are now and you know, taken all of that and wrapped that into the proposition that is the office of experience. Now we're about 10 years old, focused heavily on B2B ox. Does a lot of work in experience, marketing and technology. And we love helping move the needle for our customers. Love it.
- [03:29]
A
Well, yeah, let's dive in here. We're going to talk about a few things, but really all around this idea of ROI models and making the most out of them. So I want to start, let's start with the foundations here. So a lot of organizations struggle to even define ROI for their marketing efforts, let alone build a model. So you know, where should companies start when building an ROI model? Especially in the complex world of B2B E commerce.
- [03:56]
B
Yeah. And it's not just marketing, it's about technology as well. Right. So a lot of our work is in replatforming net new investments against that. Where does AI plug in? I mean, I'm sure you and you know, a multitude of the members of the audience are going like how do I cost justify AI?
- [04:15]
A
Right.
- [04:16]
B
So putting a finer point to that, where should you start? Well, you gotta start with what's available. So I always push people to who is your audience and what exactly do they need? Why are they asking this these questions? It's a very different series of answers that you gotta do for your ROI model. If it's the CEO and the CFO versus maybe being a board level presentation versus maybe being the team being proactive and your B2B E commerce product team and your IT team and the market team going, hey, we need to make sure we're getting ahead of this and we need to be able to paint our story for our sponsors. So start with the audience. Who are they? What do they really need? And then step two would be start to manage expectations. So like anything else that is heavily vested in, in financial modeling, which is really what ROI is about. There's a floor in the ceiling to all of this. Right. So you gotta understand, you know, where return on investment can return minimally and what's the potential. And very frequently you end up somewhere in the middle once the teams have coalesced and figured out what the business canvas might look like so again it reiterates step one, start with the audience. Step two, what are the expectations? How do you manage that floor ceiling standpoint? And then step three, this is critical foundationally. ROI should be in everything that you do. And I know that's a big charter, but start thinking about it, bottoms up, into everything and everywhere possible. So by the time you're constructed the business case and what the potential of that may be. Right. Because that's really what an ROI model is. What can we get out of this investment? You're just pulling together all the pieces into a very compelling storyline that everybody can follow on. Because at the end of the day when you're showing your ROI model, sure there's some lagging indicators there, but you're going to be talking about potential and what's leading and that's a hypothesis.
- [06:36]
A
Right, right, right. And so, you know, even taking step one in there, I know you work with a lot of large organizations, you know, in the enterprise, an audience, that's a lot of, there's a lot of detail that could be, there's a lot of audience members, there's a lot of, you know, potential components to that. You know, how much detail is too much detail when constructing an ROI model. And you know, how do you find that balance between, you know, we want to be comprehensive, we want to give the, you know, the right insights but we don't want so much information that it's unwieldy.
- [07:14]
B
So I'll answer that in a couple of different ways, but I'll tell you a story now. Maybe six, seven years ago, eight years ago, you were working with a manufacturer who wanted to set up their, their B2B E commerce site. And you know, the, the founder was still in play. Yeah. And he was an engineer by heart and you know, loved the financial aspects of it, but love attribution and tracking and building his own stuff. So when we started talking about the, the ROI of B2B E Commerce, he wanted a canvas across technology infrastructure, digital marketing. We even built a model around return on experience spend. So how do you make sure that it's converting and all of that. But at the end of the day, if you looked at all the four or five massive swim lanes he wanted to track from an ROI perspective, there was a million items under each one and I had to pull a stop cord and I basically said to the, this gentleman and he was driving his steer co a little crazy with all the things he wanted to track and I basically said let's have a one on one, let Me walk you through this dashboard. You're looking for an ROI dashboard. You want to make sure the teams are accountable and you're spending your money in the right ways. I said, what can you really move on month over month or quarter over quarter? And I built him a little prototype and there was. There was no way he could go through everything. And he was like, all right, Carlos, what should we do? I was like, well, I think you should focus on six to eight items to track, and that could change over time once you line it up. And I know you're a believer in this and Greg. So ROI models should not be evergreen and should be set in stone for the next 20 years. You should calibrate against mission parameters at hand, put a time horizon to it, and once you've solved it and it's going, then you can shift and change in terms of which. Which component of the ROI you're going to be looking at next. So for C Suite, my. My thumbnail recommendation for everybody. Manage their expectations. Ask them what can you consume and what's going to have a material impact on your business. Generally, it's going to land in the six to eight type of range. Why? Cognitive load. And then everybody around and below that. You should be doing your bottoms up modeling along the way anyways, so that you're not reacting to those big asks and you're having to do what my CFO likes to say with his financial brethren. He calls it accident reconstruction, which is the worst spot to be in when you're doing an ROI model.
- [10:02]
A
Right, right. Yeah. I mean, that six to eight, I mean, that definitely tracks with. With my experience as well, is just, you know, there's. There are as. As much as even as large as a company may be. You know, there's only so many things that you can reasonably do as you know, whether it's an executive team or, you know, stakeholder group or whatever. So, you know, and to your. To your point, I think for those that may be concerned that I don't want to be stuck with these eight things for the rest of my tenure. Yeah, yeah, exactly. Like it's. It's something. It can be agile. Right. It can be. It can be modified over time. Right?
- [10:41]
B
Yep.
- [10:42]
A
Want to learn more and join the discussion About Marketing and AI? Attend a premier conference dedicated to marketing and AI. That's Meacon, the Marketing Artificial Intelligence Conference. From October 14 through 16 in Cleveland, Ohio. MEACON brings together the brightest minds and leading voices in AI. Don't miss this opportunity to connect with a dynamic community of experts, visionaries and enthusiasts. The Agile brand is proud to be the lead media sponsor of this important event. Register today@MarketingAIInstitute.com that's MarketingAI Institute.com and use the code AGILE150 for $150 off your registration fee. I can't wait to see you there. So beyond kind of whatever, whatever you want to call it, whether it's over scoping or just adding too many things and too many dimensions to the model, what are some other, you know, pitfalls or things to avoid that you see brands making when they're trying to measure these technology and marketing activities?
- [11:54]
B
Okay. I feel very strongly about this, this spot because it's, this is where the art of the business canvas comes in. Yeah. The worst thing you can do when you get asked to justify or a current program or you have a thesis for a net new one that you're standing up, the worst thing you can do is be reactive. So if you're a VP of E Commerce and let's say you're a year in and they say, all right, great, that now that you've got a year in and that we're making progress against this, what's next? And they say we're, we're going to track it based on these levers and we, we need an ROI model. The worst thing you can do is just react to that. They're not operating that component. They don't know the line level details against it and they will likely have a mission because they're not operating. So what you need to do there is do a yes and shift and pivot and go. Here's the things we were already tracking. I can show you progress against that. Here's where it's going to be going in terms of net new investments. And here's what you, what we should be reviewing as a team for a return on investment. This way you've got joint accountability doesn't take you off the hook. You're the leader.
- [13:14]
A
Yeah.
- [13:15]
B
But they're in it with you and defining the levers that you're trying to move. That's the one biggest thing that, that pitfall that you can hit is just reacting to a series of requirements against this. So like back to my earlier example, same issue. If you just reacted to the ask of the founder and the CEO of that company, 80% of your job would be tracking down KPIs and trying to justify an ROI model against all of it. Right. Which doesn't help anybody. Number two, not focusing on the potential impacts against Time horizons within ROI modeling. There's all this conversation around CapEx, OpEx, what do you attribute? And then there's payback periods. A lot of people are not comfortable with payback periods because you don't know. But if you don't lay that down and say, I think we're going to recoup our investment by year 1.5 and why. And I need these three things in order to hit that mark. Right. If you don't do that, then all you have on your back is a target and not a place of investment. Number three. I'm going to be flippant about this one, but I was at a thought leadership conference that had CFOs. And the panel basically asked a whole series of CFOs, what are you looking for in an ROI model? All of them basically said, whatever you do, don't position it as strategic. Which is really funny coming from CFOs.
- [14:50]
A
Right, right.
- [14:51]
B
And when asked why, it's like, well, it doesn't mean anything. Okay, okay, give us your hypothesis and why you calling it strategic is not justification.
- [15:03]
A
Yeah, yeah, yeah. I mean it, it makes sense. And how many, how often do we hear that word thrown around? Too often.
- [15:09]
B
Anyway, so CFOs are saying that.
- [15:11]
A
Yeah, yeah, yeah. Because they, because I mean, an ROI model, like they're actually interested in the results in the eye.
- [15:18]
B
Yeah, exactly. Yep.
- [15:21]
A
Nice. So, you know, maybe to make it a little more concrete, you know, do you have a specific example of a company that kind of navigated some of this and achieved results from it?
- [15:32]
B
Sure. As you know, we've worked with a lot of big brands in the B2B E commerce space over the last 10 years. So I'll give you two. The first one was a company who wanted to do a replatform and you know, they were told what to do and there was no E Commerce leader in there, so they weren't sure what to do. So they were just executing. And there was no ROI model in the beginning. Midstream throughout the cycle, the sponsor started to look for what the ROI model should be and they just hired the new VP of E Commerce. But then he was reacting to that as well. So they built the ship in flight and we had to help with cost justifying even the smallest of things like where's my truck? And what kind of ROI am I going to get off of investing X amount of dollars to make sure we have a notification strategy Omnichannel. Right. Because every one of those features actually has a pretty good capital outlay and Then there's a payback period but you get a line up. After it all settled, the leader took all of those requirements, boiled it down and basically said to his steerco that these are the things that we should be watching and here's the cadence that I'm going to present this to you so we can make good decisions off of our investment. So the, the learning there is. Even if you don't have a leader in the very beginning or if you don't have a built out ROI model, when you are get asked to expend a certain amount of capital against a large effort, start by doing what I, I was saying in the beginning. Figure out who your audience is, manage expectations, give them what they need and then manage the story of progress along the way so you can get to proving at the thesis. Yeah, so that's one, they were lower in the digital maturity curve but they course corrected after a leader came in who was seasoned. Reset it. Number two, this one is a very mature organization, multiple hundreds of millions of dollars a year in terms of size. But they were going from yearly budgeting and this is much much longer ago, but so maybe there are more players in the space who are at this juncture that they went from yearly budgeting to going oh my God, there's so much potential because they were in a fast clip of innovation and marketing and conversion rate optimization that they were starting to shift to something called zero sum budgeting where all departments of the E commerce team actually had to review all available dollars for investment available month over month so they re they can redeploy where it was needed most that was going to get the most impact. So this is ROI on the fly. But the journey there was going from yearly budgeting to like a month over month zero sum budgeting environment. I can tell you the zero sum budgeting did not work as everybody intentioned. Yeah, they ended up in QBRs quarterly business reviews. There, there always has to be a middle. But even large very well instituted organizations who do this very very well, they still have a long way to go. And again it's managing the thesis against the impact against the horizon and doing it at the right cadences.
- [18:56]
A
Yeah, well, and, and maybe to the, the first example, you know, let's say somebody's listening to this right now and they're like mid, mid flight on something. I mean it's, it's better to do it mid flight than it is to wait until the end. Right? I mean.
- [19:12]
B
Oh my God. Yeah, yeah, yeah. You gotta, you gotta take control of the Wheel because there's a lot of leakage if you just react and imagine the amount of spend if you wait until end of, end of month of end quarter order, depending on what you're investing on, whether it be a campaign, a conversion rate optimization program from product detail page to cart, or a big technical block, or installing AI, generative AI in your product detail page creation. If you wait till the very end, you're going to have a lot more to justify.
- [19:47]
A
Yeah, yeah, yeah, agreed. So I know we've touched on this a little bit, but you know, beyond demonstrating, you know, beyond just demonstrating value, certainly that's a big part of ROI models. But how can they be used to proactively drive strategy and unlock growth opportunity? Not just small growth, but exponential large growth opportunities for B2B E commerce.
- [20:15]
B
So I would assume that a good portion of the audience is rooted in Agile. But what I like to add in terms of continuous improvement on Agile for B2B E commerce is truly employing the scientific method. Right. So it's six steps generally. Observe, question, develop your hypothesis, experiment, conclude, result, and then the whole thing starts all over again. If you do that for marketing, you can shorten those cycles, right? If it's a campaign, you can hyper optimize in weeks. That much?
- [20:49]
A
Yeah.
- [20:49]
B
If you do that for again, use case. How do I employ generative AI so it makes my search and my product details better? Well, there's going to be a bunch of permutations against that, against service categories and product categories. So it may be different for each one. So you got to stand up different experiments and then from a technology side, right. And this happens all the time, we got to optimize our PIM attribution so it shows up better. And there's a data technology lift where we have to take it from five different sources to normalize it, to put it into play. Well, again, what's the current state? What are the questions that are coming up? What's your hypothesis for fixing that? Stand up two or three POCs, particularly now in the age of ML and AI in terms of normalizing all of this data across your technology stack and then how do you bring that to conclusion and forward? Those generally take quarter over quarter or even longer time horizons because of some of the scale that we have to deal with in B2B E commerce. But you, if everybody is used to the scientific method, you can call whatever you want. But if they're used to this optimization type of work track across all fronts, then you can minimize your investment risk because you're Testing and learning along the way. If you test two or three concepts and one's a clear winner than the other two, your ROI potential increases x fold depending on the variance between how well that succeeded and the ones that did it. And you can almost project that actually have a little estimator built against that. Nice.
- [22:33]
A
I know. You do. Yeah, well, and that's, I love hearing that because when I get on my Agile soapbox, I like to remind people that being agile is not being reactive to, you know, it's actually employing things like the scientific method and stuff, not just simply saying, oh well, last sprint didn't go well, let's change everything. And you know, so, so it literally involves a scientific method of, of thinking. So no, that's, that's, that's great to, to reinforce that. Do you have an example of how a client used an ROI model to inform a strategic decision?
- [23:15]
B
Oh yeah, this one's a big one. This one is actually happening unfolding as we're speaking. You've got a client in the B2B space and what's going on right now is we got called in because a replatform did not go well. And replatform dollars, as everybody knows, is, you know, it's a pretty big investment. So there was a draft ROI there, but they did not take into account the cost of change for their customers and the cost of change on the omnichannel on the customer support, client success side and in the sales organization. So now that the platform has been deemed it needs to be redone and reset, we're getting called in to go, well, how do we fill this out? And the new VP of E Commerce has to go actually go in. I don't know how many times they've gone in before into and cost justify the failed implementation and what they're going to do to reset that. And now they have to factor in customer success and sales in, into that canvas.
- [24:26]
A
Got it.
- [24:27]
B
So the ROI model that we're co creating is taking on a bigger thing, but it's no longer ROI of E Commerce, it's ROI of omnicommerce.
- [24:39]
A
Yeah, yeah, got it.
- [24:41]
B
That's a very real story and that's probably happening across all fronts. And yes, there's an AI component to it. Just the AI rows of that business model. It's like, well, where do we get more gain and how does that reduce our cost? And that has to be part of the business justification of this as well.
- [25:06]
A
I know a lot of what we're talking about is, you know, working on the model, how it, how it works and the components that go into it. A huge part of this, and it's kind of a through line through your examples as well is the communication of this as well. So right. You know, we can have the best model possible and be sitting in our, on our, on our laptop and loving it. But if there isn't buy in, if there isn't utilization across the organization, then you know, it can't be truly, truly successful. How do you ensure that everybody from, you know, C suite to the marketing team and beyond understands and benefits from the insights that are generated by these models?
- [25:49]
B
Well, I wish to say that you can do this as a bottoms up and everybody just buys into it and everything's hunky dory. But unfortunately in all the work I've done over the last 30 years, you do have to get executive sponsorship from the very top as high as you can go and as clear as you can get them. So that would be. It goes back to what we were talking about in number one. Like if you have a very strong executive level sponsor at the C suite on the operation side or on the technology side or even if you're lucky the CEO, then the potential for what you're trying to build in cost justify has a lot more success if they're not bought in and you bring forward a radical new concept. Hey, I want to use Gen AI to automate 80% of our work. Sure might look great on paper, but it could affect multiple departments and with that buy in from the top, you're not even your ROI model's not even get to SteerCo because you're going to get challenges from all the other departments who are going to get impacted by what you do. Specific to B2B E commerce, it's just commerce now really. Right. Like it's not digital commerce, it's just commerce. It affects all of these channels and you got to get that organizational buy in. But it goes so much better when you've got a very clear vision from the top as to what you guys are trying to do.
- [27:26]
A
Yeah, yeah. So looking ahead, how do you see the role of ROI modeling evolving in the future of B2B commerce and particularly obviously AI automation? All those things as well are increasingly influencing.
- [27:42]
B
Oh my God. Yeah. Hot topic all across the board, but fully legit and very exciting. So real time analytics is a thing now you can see just on basic use case. I was recently at a trade show where the platform was showing the impact of where the generative bots were coming from and how Much traffic it represented and all that real time. Right. So there was a Geo dashboard and they were doing the attribution against that. So where do I think it's going? Well, clarifying levers, once you've lined that up, there are some universals, like in E commerce is always number of engaged customers, conversion rate and average basket size or average order value. So let's just play that out, right? Like even if those on those three basic levers you can show in real time at the product detail level level how it performs, you can at attribute back to what campaign, you know, for sessions, what's converting from a merch and UX standpoint and then how big the average basket size is from that. And then it tells you in real time where the opportunities may be or the deficits or sub performance are month over month, week over week, however it goes, that's where I think it's going to go. But it's all rooted in the fact that you have to be very clear about the ROI components that you're tracking so that you can deliver off of that real time analytics and bundle that into the story of progress, which I know all these teams want to do.
- [29:16]
A
Yeah, yeah, Love it. Well, Carlos, always great to talk with you. Thanks for sharing today. One last question for you before we wrap up. What do you do to stay agile in your role and how do you find a way to do it consistently?
- [29:29]
B
Oh Lord. Well, I read all of Greg's books, of course.
- [29:35]
A
Of course, thank you.
- [29:37]
B
But he produces at about, I don't know, six a year at this structure. It feels like totally kidding if y' all have not read Greg's books. They're great. But I read a lot. I read business books, I read the blogs, I read quite a bit of what's going on the space. I listen to a lot of podcasts. That's number one. Number two, I talk to a lot of prospects and customers. The more keen you are to actual problems people are having on the operation side of this day to day, the better you are as a, as a consulting company, like Office of Experiences. And then the last bit is I always like to look at Horizon one, Horizon two, opportunities. So how do you stay relevant? Well, it's not just consuming, it's not just hearing, it's also having a point of view. Yeah, like where's this stuff going? What's interesting? What's going to deliver business value? How do I make the customers feel better? And you, you always have to have, you know, an ongoing backlog of next generation thinking And I'm not saying be be a hyper futurist like Greg is, but but be rooted in things that people can actually do to move the levers. And if you orient your horizon one horizon to horizon three thinking against that, it feels like you're just continually making progress, being relevant and just helping people activate. And that's part of the joy of what we do. All right, thanks so much and thank you again for Greg, our host. And thank you everybody listening to this. Feel free to reach out. We're here.
- [31:18]
A
Yeah. Love it. Well, again I'd like to thank Carlos Manalo, co CEO and Co Founder at the Office of Experience for joining the show. And thanks to our sponsor, the Office of Experience, a design driven, digital first vertically integrated and collaborative agency that believes in the power of ideas and the strength of people. Learn more at www.officeofexperience.com thanks again for listening to the Agile Brand. If you enjoyed the show, please take a minute to subscribe and leave us a rating so that others can find the show as well. You can access more episodes of the show@theagile brand.com that's theagile brand.com and contact me. If you're interested in consulting or advisory services or are looking for a speaker for your next event, go to www.gregkilstromcom. that's G R E G K I H L S t r o m.com the Agile brand is produced by Missing Link, a Latina owned, strategy driven, creatively fueled production co op. From ideation to creation, they craft human connections through intelligent, engaging and informative content. Until next time, stay curious and stay agile. The Agile Brand before we continue, I wanted to share a key strategic resource that a majority of the Fortune 500 are already aware of. Finding the best technology, business and talent solutions is not easy. With business demands and competitive pressures mounting, you need to be able to design, deploy and optimize your technology to provide leading customer experiences while driving business growth. Those of you that have been listening to this show for a while know that this podcast is brought to you by Tech Systems, a global provider of technology, business and talent solutions for more than 80% of the Fortune 500. Tech Systems accelerates business transformation for their customers. Whether you're looking to maximize your technology roi, drive business growth, or or elevate customer experiences, Tech Systems enables enterprises to capitalize on change. Learn more@techsystems.com that's teksystems.com now let's get back to the show.