
Loading summary
Dave Gerhardt
Email, in my humble opinion, is still the greatest marketing channel of all time. It's the only way you can truly own your audience today. But when it comes to building those emails, well, if you've ever tried building an email in an enterprise marketing automation platform, you know just how painful that can be. I won't name names, but templates get too rigid. Editing code can break things and the whole process just takes forever when it shouldn't. That's why we love knack here at exit 5. Knack is a no code email platform that makes it easy to create on brand high performance, forming emails without the bottlenecks. If you're frustrated by clunky email builders, you need nac. If you're tired of hoping the email you sent looks good across all devices, just test it in NAC first. And if you're a big team that's making it hard to collaborate and get approvals on your email, you definitely need nac. The best part, everything takes a fraction of the time. You can see Knack in action@knack.com exit5. That's knock.com exit5. Or just let them know you heard about Knack from Exit 5. That's us. You're listening to B2B Marketing with me, Dave Gerhardt.
Unknown Host
1, 2, 3, 4, exit. Hey, welcome. This is a Exit 5 live session. Once a month or so we do these to bring in an expert in B2B marketing to come in and go deep on a specific topic. Our guest today, who I'm going to bring up in a minute, is Pranav. He's the founder and CEO of Paramark and he has an awesome point of view on how to think through marketing strategy, how to measure things, which is a big part of doing this job. And pitch us on a really cool topic for today, which is digging into some actual paid campaigns and we're going to dive into what worked and what didn't with facts only. No opinions. But before we get into that, just let's go in the chat real quick. A bunch of people are already doing it, like right in coming from Dave, Vermont and then also with, with where you're coming from. Like, I want to know, why did you take an hour out of your day to come to this thing live? You certainly could have just gotten the recording. But what is it that made you want to come here live today? Danielle said she'd get fired if she wasn't here. Not immediate, not initially, but I mean, like if came a thing. Absolutely. Carrie's in Raleigh, Jen from London, Carl's in Newton, Mass. Shout out to Newton, Mass. Beautiful Victoria or Vancouver Island. Look, man, we got some sun out here in Vermont today. We're doing great. We got a fig tree, I got a salt lamp. It's all good. So. All right, we're here. We're gonna go for an hour. You'll get the slides, you'll get all that at the end. We got Q and A and everything. Yeah. Why don't you bring in the great. The great Pranav. Who. Big day for the crew over at Paramark. Funding announcement dropped today. I have a funny story for you. So when I was first time head of marketing, I was working at a company called Drift and we raised like $60 million, Series B or something, which today is, you know, pennies.
Pranav
No, it's still. It's.
Unknown Host
I mean, no, it's changing. Sorry, sorry, that was a bad joke. I. I think what happened is like, I think the 2021 funding environment, like, re. Changed everything and now we're back to like your. Was this. Did you not. Was this your c. Would you announce your seed?
Pranav
This is our seed. Yeah.
Unknown Host
Million dollar seed. That seems more right Than like where we were two or three.
Pranav
You ask any of the real OGs, right. They will say no. This is an A. Right. So there's definitely some inflation in our round names and round sizes, for sure.
Unknown Host
We had this big funding announcement and it was obviously the most traffic, the most inbound, the most ever thing to the site. And then for three years after that, basically that thing became the bane of my existence because it was the anomaly in all of the charts. Like every board meeting, every presentation, we'd always wait.
Pranav
Can you go back for a sec?
Unknown Host
What was that spike? That spike?
Pranav
September.
Unknown Host
September 2017. What was that spike? And I have to be like, it's when we raised 60 and it looks, look, I said that. I was like, look, if you guys want to raise $60 million every quarter, like, I'm happy to get you that.
Pranav
The ROI is perfect, Dave.
Unknown Host
The RI is perfect. Yeah. So anyway, and then this is just a. Just a riffing on here on a side note. And then I just had a crazy conversation with my UPS driver and I need to know if this is true. So he was saying that ups, they have the best hiring process. He said, they don't hire felons. He said, FedEx and Amazon, they hire felons and they drive around and deliver packages. And then he said, Amazon drivers. He said, Amazon's driving around and it's legitimately spyware. They have cameras and everything in all of their cars. And so they're delivering your packages but filming your house so they know what ads to serve up to you.
Pranav
Oh, wow. I was wondering where the story was going and I was like, okay, this is a weird tangent, but that's believable to me. Right? Like, why wouldn't you collect that data? You're not, I guess you're not breaking any rules. I actually don't know if you're breaking any rules.
Unknown Host
Yeah, well, so anyway, there's my ad story for the day.
Pranav
So.
Unknown Host
All right, I'm going to kick it over to you. I know your audience, right? Let's, you know, see if we can get you to focus on marketing for about an hour. I know it's a lot. It's very hard to not check your email. My dopamine would be depleted right now if I were you. But we're going to talk about, you guys have pulled a bunch of campaigns from Paramar customers, which is cool. And we're going to dive into like some truth here. One of the hardest parts about marketing is you see people write these articles about breaking down the strategy behind X Brand and like you actually don't really know how the ad ever actually performed. Did it do well or not? So we get to criticize these things on social media, but we don't actually know. I think this is an awesome idea for the session. So I'm going to let you drive and I'll be here. I'll bring in the chat, we'll take questions at the end. And let's go.
Pranav
Awesome. Well, first, hey everyone, I'm Pranav. Dave. Thanks for having us. This is exciting. We get to talk about all the learnings that we are sort of receiving in the last whatever number of months with all of our customers. But I want to start with something just kind of a disclaimer, right? We are very sensitive around customer privacy and so I'm not going to share any names. I'm not going to give you like, hey, this is the customer, this is their ad, this is what they did. But I'm going to talk about generally sort of what's happening and you'll see some statistics and how sort of they measured it. So just kind of a very clear disclaimer there. If you have questions that you want to go specific into certain strategies, you can always reach out to me. I'm happy to have a one on one conversation around specific things or even put you in touch with those customers who ran those tests in case that's helpful. But just want to kind of say that now. I am going to start with we always have this debate. We use the word attribution all the time. And I went to Dictionary.com this morning when I was creating the slides for this and just took a screenshot of what does it mean when people say attributed? And there's actually two different definitions. And I think this is an issue for a lot of people. One of the definitions is the attribute itself, right? The quality or characteristic of a thing, a person, what have you. But that's second on the list. The first definition is this idea of causality is something, a cause of something else. And so when people use the word attribution, when people use attribution, measurement. Are you trying to answer the first question or are you trying to answer the second question? Are you just looking for some type of relationship or are you looking for causality? If you're looking for causality, well, guess what? There's no better way than experimentation. I just went into ChatGPT and I asked the question this morning, what's the best to find causality in marketing? Guess what it says. Randomized controlled trials, AB testing. This is not new. This is the basis of the entire modern society, right? All of science is basically through experimentation. If you don't do experiments, there is no science. And so I start with this topic because if you are really serious about attribution and measurement and you're not thinking about cause and effect relationships, if you're not thinking about experimentation, what are we even doing here? So I'm going to get off of my pedestal here, talk about some examples. But I did want to start with this, right? It's like, you don't have to be perfect, but know what you are doing. And the other thing that really annoys me, we all say in marketing sometimes, let's test it. Let's put it out there, let's test it. Guess what? If you don't have a control, there is no test. You're just throwing spaghetti at the wall and calling it a test.
Unknown Host
90% of the things that I say test it. Test it. Try it. Just try it.
Pranav
Sorry, dude. And it's okay, right? Like, I'm not against just doing it. So my problem isn't with the fact that we all want to do things. Because yes, you can just do things. There's nothing wrong with it. I do things all the time on social media and emails. Like we don't have to test everything, but the words have meanings, right? And if we say that we are running an experiment or running a test that means something. And I'm just asking for, like, all of us to level up our sort of seriousness when we use the words test and experimentation. That doesn't mean you have to experiment everything. You don't.
Unknown Host
I think it's a good foundation because I think it is. Victoria in the chat said, when people run an A B test and change the headline, body and subject all at once, it's like part of the ability to measure what's working in marketing is the ability to, like, take a step back and slow down and pick one thing to go and test. So, so we can learn. There could be multiple factors. Can you school me really quick though, on, like, I wonder if a lot of things that I say often are like correlation versus causation. We could ask ChatGPT if you don't have a pithy line on this, but just like, could you explain the difference between those two?
Pranav
Yeah, it's a good question. So correlation is essentially saying, are these two trend lines moving together? So my impressions on LinkedIn go up, my demos go up. When you map both of those charts together, they seem to move in tandem. That's correlation causation is saying that because I move my LinkedIn impressions up, my demos go up. That because is very important because it's very possible. It's not really cause and effect. It just happens to be the case that you're doing all these things, people are going to your LinkedIn and people are going to your website and booking a demo. Oh, guess what? You launched a podcast ad that you're not counting in this correlation. And that's the real reason why people are going and checking you out on LinkedIn or going to your website. So that cause and effect relationship is what you're truly after if you want to go from correlation to causation.
Unknown Host
Nice. That was a perfect example because it is a trap that we fall into when we see the correlation between those things.
Pranav
Awesome. Okay, now one other thing before I go into examples, and I do want to get there as fast as possible. ChatGPT. These terms, right? So Conversion Lift, if you haven't heard that, oh my God, that is a problem. Meta offers this as a native experimentation tool. LinkedIn is launching it. It's in beta right now. You can call your LinkedIn reps and launch a conversion lift, a B test today if you wanted to, but it's going to be GA in like three or four months. So go check out Conversion Lift Again, go to ChatGPT and just type geotesting. How does it work? Time is testing. How does it work? Holdouts, how do they work? These are just like keywords that I'm dropping to you, but you can just self educate yourself. I don't have to spend a ton of time giving you sort of basic education. Now that we all have an amazing AI assistant at our fingertips all the.
Unknown Host
Time, that was crazy to me. I know this is so obvious, but just to hear you say chatgpt, it talks about the world that we're in. Which even a year ago saying that would have been like, whoa, this guy's suggesting this cutting edge thing to find this information. This is the world we're in now. Yeah.
Pranav
My co founder and I are figuring out if we can sponsor somebody's visa for an interview process. This is like live from last night. And I'm like, he sent me a question like, do you think this is possible? I copy it paste in the chat GPT. Chat GPT is yes, it's possible. Here are the three sources. Send it back to my co founder. We're like, all right, great. So if you have questions about incrementality measurement, ChatGPT is your best friend, really? Okay, I'm going to talk about a bunch of incrementality tests. Geo tests, holdout tests, these are all names for the same thing. And these are real examples from real customers over the last whatever number of months that we've been doing these. How do they work? Very high level. We pick a few geographies where we test a specific channel or campaign and that means that that particular campaign only ran in those geos. And then we look at how the aggregate metric in those geos performed compared to the geos where there was no ad campaign. And then we look at was there lift, was there no lift? What was the cost of any incremental lift that we saw? Okay, first example, I want to start with the easy one. This is like taking candy from a kid. Brand search. If you haven't run this test for your business, what are we doing? Go hop off this webinar right now and run that test. Two examples. There's a Series C company, SaaS company. There's a Series E company, SaaS company. So these are well funded, venture backed businesses. They're spending millions of dollars on marketing. They're spending hundreds and thousands of dollars on branded search ads both on Google and on Bing. So what did we do? We said, hey, we're going to take a few geographies and we use our platform to determine what those geographies are. Where we are Going to cut your branded search spend down to zero. So California, Texas, Massachusetts, whatever those, the algorithm and the, and the machine learning tells us like, here are the states, here's how long you need to do it. Usually that's like four to six weeks. And you don't have to cut your spend down to zero. But in this case, we were like, let's just cut it down to zero because we had some other data that pushed us in that direction. Now I want to see maybe in the chat how many people think that there was no impact or there was a ton of impact on the business.
Unknown Host
Kelvin says no impact. Megan, minimal impact. Lauren, low impact, no impact, no impact.
Pranav
Yeah, all the people who are saying no impact, spot on. And I'm not talking about tens of thousands of dollars here. You guys, like the collected savings here are in the millions on an analyzed basis. Millions. So let that sink in. Right? And I'm not suggesting that, oh, branded search is horrible. You should never do branded search. All I'm showing is real examples of two customers where branded search really did not impact their business. And if you haven't tested this in this fashion, oh, we're talking about the metrics here, Luke, are MQLs, these are Pipe, these are hand raisers, demos. These are like real business metrics. And we're saying that there's all of that stuff got shifted to organic. This is literally the customer said it even before we shared the results with them. Like, hey, we looked at our own internal metrics. Everything shifted to organic. I'm wondering what Powermark's results are going to show. I was like, yep, didn't do anything.
Unknown Host
Megan says. So does this mean they were still seeing the same click and impressions in that geo without paying for branded search?
Pranav
Correct. It all just shifted from the branded search, the sponsored ad, to your organic SEO.
Unknown Host
So literally the end user, the consumer behavior there is. Look for the term skip over the what would have been in the ad anyway, Find the organic listing and click that.
Pranav
Exactly. And here's the thing that happens, right? Talk to these customers. Even when you see these results, it's still scary because what happens is these brands are thinking, well, what if my competitor starts bidding on my terms and start taking attention from us? Well, guess what? In those states where we turned it off, right, we're now running a test for a longer period of time to see exactly that. What is the competitive observation there? But even if there are competitors who are bidding on your terms, think of it this way. The person who was putting it into search and saying I'm looking for Paramark and then just because of a competitor ad, they're like, oh no, I'm not going to do a demo with Paramark. I'm going to go to their competitor. That's a little bit odd. Our customers generally are quite savvy. They're talking to two or three people. They understand all the competitors in the ecosystem. So just the presence of a competitive ad is not the thing that's going to swing the deal 100% towards your competitor.
Unknown Host
It's so funny because everyone in chat was like, obviously there was no impact, but then there's a billion questions on this. So I don't want to take up all the time on this one topic. But this is such a hot topic, like this branded search or not thing. So maybe let's just see if you have opinions and answers to some of these. Judy said, were these customers in competitive spaces? Were these customers in a competitive space?
Pranav
Yeah, they're all competitive.
Unknown Host
Jeanette says, are these well known brands?
Pranav
Yes, very well known brands.
Unknown Host
So does that have it, do you think they're asking because that has some impact on the results here?
Pranav
Well, does it, does it not? Like, look at the numbers. Right. Again, my point is the answer is going to be different for each brand. So don't take that at face value and say branded search is dead. That's not what I'm saying. All I'm saying is like, if you don't test it, how will you know? And guess what? These same customers had high impact, high efficiency channels where they were spending a pittance. A pittance. And so taking this budget from branded search where there's no incrementality and switching it to channels where there is incrementality and doing the opposite of this, which we'll talk about in a couple of examples, right, where you can increase your spend on YouTube on. It's going to sound crazy. PMax on Twitter, on Out of Home, on billboards. And those are showing positive lift. So we'll talk about those examples. But this is not an isolated conversation. Right? You have to think about the whole mix of where are you allocating between different channels?
Unknown Host
And then there's three comments in a row. Was there SEO already strong? I feel like you need to be strong for that to happen. This is dependent on good SEO. This assumes an organic strategy and the site is rather his optimistic, optimized rather than playing for traffic. Any reaction?
Pranav
100%. Yep. SEO was good for both of them and they invest in SEO and you can measure SEO in their models. To see that obviously SEO was doing very well. So if you haven't done any SEO, then yes, this could be for sure.
Unknown Host
Cool, thank you.
Pranav
All right, all right. Now this one is really interesting. This is billboards. Fun little backstory. The CMO is like, hey, we're heavily reliant on Google Search. Most of it is like non branded search, but it's like we're heavily reliant on on Google search and they inherited a new team and a new business. This CMO is like, yeah, our leadership does not buy into all of these brand things that we do because they've been burnt by it before. We did all these things three years ago. The previous leader did it, but it showed no impact. And so we just had to move on from that. What's really happening here is that there was no good measurement in place. So when that previous leader did all that brand stuff, it just didn't show up because it doesn't generate any clicks. So we set up a geotest where they bought a bunch of billboards, but in a very specific part of their target market. And guess what? I'm showing you the data, right? So you're looking at and it's anonymized so hopefully you can't see who it is. But you look at their conversion metric and you look at this observed value which is essentially their success metric, how that performed or the core course of when the test was running. And the control, the control is basically saying what would have happened if you did not run this billboard campaign. Now you have clear call evidence of the lift generated through billboard. And guess what? None of this would show up in any type of click attribution tool and not even their post purchase survey tool. Right? Because that's just people don't put it in. People are lazy. This is an example and this is a company that's saturated their Google search. They have nowhere more to go in Google search. They're looking for additional growth vectors. And this is a prime example of how you can do an AB test in the real world with billboards. And guess what? These were not just the old school billboards. This was digital out of home. If you haven't heard of what digital out of home is, you really do need to go learn. There are a bunch of companies that do this ad. Quick one screen, there's a bunch of others that'll let you buy digital real estate, right? These are digital sort of bus stands or even sort of digital sort of displays on buildings, what have you. So they actually went down that route, not Just sort of the physical billboards.
Unknown Host
This is clicks as the measured metric here.
Pranav
This is actually I can talk about. It's a fintech company and they do some type of a fintech product. And so you have to apply to get qualified for that product. And so we're talking about the applications that customers are going and filling all the way through. You can think of it as like credit cards or loans or. Right, those types of things. But this is B2B. So it's B2B FinTech and it's a high consideration process and purchase. Like we're not talking about sort of a transactional sort of thing that's happening. All right, bunch of questions. I want to take this one. Is this correlation versus causality? This is causality, right? Because we are literally saying that in the test locations we ran billboards and everywhere else in the control we did not have billboards. And we're looking at the aggregate lift in your applications between your test and control. So that's why this is causality and not just a simple correlation. There are so many questions. They do have a large tan. So this is like focused on sort of SMBs, long tail SMBs. So yes, that is something that is relevant here for a business. I'll show you some examples of how Paramark does our own testing, which will be fun. So we'll talk about that. Okay, here's another one that might be a little bit more accessible. So we're now talking about YouTube advertising for a couple of different companies. One is doing hundreds of millions of dollars in revenue. And then there is a series C company. I think this is the same series C company that we talked about earlier. And the first one is very enterprise ish. Right? You have to use this company's product like as a developer, you have to integrate it into your product. There's a high consideration cycle, all that fun stuff. And so they look at MQLs as their measure of success. This might be spicy, but it's fine because for them MQL is literally a hand raiser. This is somebody coming to their website filling out a form to say I want to get in touch with your team to do X, Y and Z. So two very different examples. And this is why I say that any channel being dead or not is not a thing. In the first example there was very clear lift for YouTube for that particular business. We're looking at the pretest period and then we're looking at the test period and we're seeing a clear lift in their measure of success compared to the control in the second case, it's identical. And again, in that second case, we're talking about a collective spend of close to a million dollars a year in YouTube advertising and zero impact, zero lift. Now why is that the case? That particular brand had massive, for whatever reason, YouTube SEO. So they had organic YouTube content that was doing really, really well. And so their advertising was really not breaking through beyond sort of what was already happening on organic. For this other brand, they had no organic content. YouTube did really well from an advertising strategy. So yeah, Questions on this?
Unknown Host
Yeah, I have a question for you. This is. There's a bunch of comments that kind of echoing the same thing and I think we can help people maybe with just like how to think about what the first principle here. So people are saying like, okay, these are great, but these often require huge budgets to run. There's some folks that are on here that are have smaller businesses, smaller budgets. Any fun ideas for what experiments? So I think no matter what, that's always going to be the question is when you see someone spend money, you're going to say, okay, well what's the version of that? And so I don't know if we have a particular example, but Pranav, let's help with just a first principles type of thinking. If I was a smaller brand and we wanted to maybe test into doing something like this, how would you think about that?
Pranav
Yeah, great. I love this. And I do see Savannah's question there. Right. Many of the experiments you're talking about require huge budgets to run. What are medium sized businesses going to.
Unknown Host
Do just to build on that though? For me also, as a first time marketing leader back in the day, I think one of my wrong beliefs though was like, oh, we don't have the budget for this. This is scrappy. We're going to be scrappy. And I actually end up screwing up later because I never did enough testing into the bigger budget. And so like I do think it to like, I was like. And I saw a comment earlier about like, well, yeah, we can't do the test. We're not spending 120 grand a month on this channel. We can't do the testing. Well, I went from no budget to a lot of budget and I didn't have any middle steps. And so I think maybe we can talk about like how to test and learn so that you can feel good about going to spend more money.
Dave Gerhardt
This episode is brought to you by webflow. There's so much buzz right now around AI search, optimizing your site for it and Making your website actually perform in LLMs. They're calling it AI search. They're calling it LLM search. They're calling it Geo. Anyway, it's SEO for these AI tools like ChatGPT. Perplexity, Claude. But let's be real. Does anyone know what they're actually doing yet? What are the best teams doing? I've seen some people chatter about this. It's one of the hottest topics in marketing right now. And webflow is hosting an event that is going to help you answer some of those questions. It's called webflow Conf. It's free, it's online, and it's happening in September, September 17th through 18th. You'll hear from teams like Lattice, ABM and Whiteboard on how they're turning their websites into actual growth engines. Faster testing, smarter personalization, how they're using AI, better web strategy, less time waiting on developers. Plus, webflow is dropping some new product updates that are built specifically for marketers, creators, and teams who care about web performance. You can go check it out right now@webflow.com exit5. That's webflow.com exit5.
Pranav
I love that question. It's fantastic. I put a post out on LinkedIn a few days ago where I had this, like, hypothetical conversation with a hypothetical customer. And it happens sometimes in reality as well, where I'm like, okay, let's do a holdout where we cut spend. They're like, no, no, we can't risk that much. We can't cut spend. Like, what do we mean? Like, how can we not advertise to our audience? We need to be going after growth. I'm like, okay, that's fine. Let's increase spend in a specific geography. Oh, no, no, no. We can't go get additional budget. Like, that's not going to happen. Okay, so you don't want to cut spend, you don't want to increase spend. What are we doing here?
Unknown Host
Right?
Pranav
So first thing, if you want to get growth, if you want to run experiments, you have to take risk. There is no alternative. Zero alternative. If you wanted everything to be a done deal, a plus, guaranteed, proven, before you even did anything, we would all be sipping pina coladas at the beach. Why are we here? Right? Like, that's not how marketing works. That's not how reality works. Now, let's take a specific example. For a small brand. When Paramark starts advertising, guess what? We're not gonna run a national campaign. We're gonna build an account list. We know the thousand companies that we want to go after and we're gonna take our advertising and split that account list into half and say for half of that account list, that's gonna go into my LinkedIn audience, and the remaining half is not going to go into my LinkedIn audience. That's a very simple test. It's not done by GEOs. It's done by account lists. I could structure it differently. I would say, hey, we're based in California, we're based in sf. Our entire team is here. We're only going to advertise in sf. Or let's flip it. We're only going to advertise in New York to see if we can lift our inbound demos from New York. There's nothing stopping you from doing that. We could run that test for $500. You could run that test for $1,000. You can run that test for $100,000. So this idea of you need big budgets to do this type of testing is plain wrong.
Unknown Host
Savannah said, to be fair, we're not talking about not being willing to take risks. We're talking about businesses who have 10k to spend on ads, which eliminates most of the meta experiments that you mentioned. Okay, maybe in that example. Yes.
Pranav
And, yeah, 10K is a great example. Right?
Unknown Host
Yeah, I was going to say there's actually. I bet you there's a bunch of people on this webinar who'd be pumped to have 10k a month to spend.
Pranav
That's right. And I would just not spread that out nationally. I would do it either by geography or some cut of your audience where you can see your end metrics move along with that audience. And Savannah, happy to do some live experimentation, sort of brainstorm with you as well. Like, I do this all the time with people who are also not customers, so we should do that. Okay, here's another one. CTV. So this is Connected TV. This is a series of SaaS company. They again, were reaching a point of saturation. They're like, hey, we want to try some Connected TV ads and see what that does. And same exact thing. The budget was fairly small. It was only about a 30 or $40,000 budget. And that means that the noise is higher. Right. Because when you're spending lesser across a fewer set of geographies, you're not going to get perfect precision. In this case, we did see very clear lift. And so for them, this is the first time that they're going into sort of more of a video, audio type of format. Most of their prior work had been very direct response, bottom of funnel. But they're Reaching a saturation point. They're seeing a little bit of a decline in their business. They're trying to find new avenues of growth. So paid social, paid search, those are not your only avenues. Podcasts, ctv, direct mail, we've seen brands get success with those types of channels. And your budgets don't always have to be in the millions. Even with a 20, $30,000 budget, you can run experiments. Okay, here's a campaign that didn't work. So this is Sequoia backed company. They launched a multi channel test across YouTube, across Out of Home. So Billboard, CTV, Meta, all @ the same time, concentrated on a specific set of geographies. And here's why it didn't work. We saw clear lift, don't get me wrong, it worked, but it was very expensive. The cost per incremental conversion that they were tracking was almost 10x what it was the case for the rest of their media investments. And so yes, you have Lyft, but it's not efficient. And so what do we do now? We're going back and testing individual components within their media plan rather than bunching it all up together and doing smaller tests. And this goes back to that point of like, you don't have to run a massive test, you can run smaller tests to get signal before you ramp up into that bigger budget that you have. Okay, I'm going to skip PMAX because I wanted to. PMAX is performance max. I think somebody asked that question. This is an ad format on both Google and on Bing now, so you should look into it. Many people sort of swear off of PMAX and say it's all trash inventory and it doesn't work and all that fun stuff. But in this particular case we did see a very clear signal that it worked and it's become part of the strategy for that specific brand. All right, I'm going to switch because I think I'm sensing people are like, hey, you're telling us about these big ideas, these big brand campaigns. We don't have the budget for that. We're trying to just execute with 10k, 50k. I'll give you our example. Paramark, we are a 10 person company. We just announced our seed fundraise which has been long overdue. But we make some real money, we generate revenue, we have real customers, as you can tell, and we have a little bit of investment in marketing. So what did we do? We actually for the first time did a pretty big sponsorship and that was with Exit 5. So this is very meta conversation here and I'm showing you Our real stats, how do I run this experiment? Very, very simple. Our consideration cycle is anywhere between three months to 12 months, which means somebody becomes aware of us, somebody does a demo with us. It might take three months to close that customer into closed one, or it might take 12 months to close that customer and to close one. We don't know when we are engaging with them. So when we think about success, I look at the aggregate traffic to our website, this is going to sound blasphemous to half the audience or maybe 90% of the audience here. Now I'm fortunate that I'm a marketer and I'm also the CEO, so I get the skepticism that you might have around that idea. But for us, if we increase overall traffic and we're not doing it in a spammy way, that's a good success outcome for us. So you can see this red line. That's basically our traffic from July of last year to December of last year. It was pretty standard, pretty basic, like it was just running. And most of that was because of all of my LinkedIn activity. That is the first channel that I broke into. That's what I did every day. Showed up on LinkedIn, added context. We were not doing any other advertising, we weren't doing any events, we weren't doing anything other than LinkedIn one channel because we knew, knew that it worked. We were like, all right, we're ready to make some investments into marketing. The first investment that we decided to make was into Exit five. So we're going to sponsor Exit five. We're going to do this bunch of things together and guess what happened? Our traffic literally doubled the moment we started working with Exit 5. I don't need any UTM codes, I don't need any click IDs. There's nothing else that we did. So it was a very controlled test. The only experiment that we ran at that point of time was exit 5 sponsorship and you can see the direct impact. We didn't have to do any holdouts. Right? That's not always necessary. But this is a very simple pre post type of an experiment and you can see that it's staying elevated because of the way that we ran this campaign. Now you can go a little bit more detail. I'm showing you month by month numbers now. I'm going to show you the week by week numbers. This is directly. All of these spikes are perfectly timed with every single campaign that Exit 5 ran for us. Perfectly.
Unknown Host
It's a perfect example of like earlier also like, like throw out exit 5. You could do this with anything. Like when I was a CMO at Privy, we wanted to test podcast ads and we basically found 10 smaller micro niche influencers that were running podcasts. And we ran the campaign over a set of three months. Wish I was a little bit smarter. And this is actually a simpler way to look at it. And just let's map those two things together and let's look at the spikes in awareness and interest in people hitting our site since we started running those podcast ads. This is cool.
Pranav
Yeah, that's precisely it. So when you think about how you're going to now, why do people get into trouble? Because here's what happens and they take that 10,000amonth spend and they spread it. They spray and pray across five different channels at the same time. When you do that, you cannot get clear signal if you don't have sophisticated analytics. Right. So in our case, we don't need any sophistication. We're doing one at a time. We're proving out that Exit 5 sponsorship works for us. And so now that's baked into our, our strategy. And the next investment would be coming in the second half of this year where we're starting to invest much more in events and dinners. And we're going to look at, are we able to increase our traffic or leads or whatever our metric is by another 50%. We're taking big swings. We're not trying to go for like 1% lift, 2% lift. We're taking, hey, how do we double triple our traffic? Because guess what, we're a startup, right? We can't live with 1 or 2% increases. That doesn't work when you're on the VC train. You just have to go for big swings.
Unknown Host
On the point that you mentioned earlier, like when you started writing on LinkedIn, was there a timeframe? Did you know instantly? Because, like, obviously I love this topic of founder, brand and having the founder right on LinkedIn. And this is exactly how I'd want people to look at it. But I feel like oftentimes what happens is people give up too early and so they're like, yeah, I was writing on LinkedIn. I wrote two posts a week for like a month and we didn't see anything from it. Or what they do is they only post with like UTM links and sign up for this webinar and do this thing. From my observation, it's like I saw you kind of commit to, all right, I got this company, Paramark. I have a strong point of view on the market. I'm going to commit to posting to LinkedIn with my strong point of view, a couple times a week for like six months and I'm not going to look at the short term results. And then now a year later you're able to look at it and see those spikes. Like, did you know that going in? I think just like with some of these channels, like these more brand channels, you can't go in there thinking of it from a direct sales standpoint. But when you give it time and then you get a year out, you look at it. The number one driver for us of Exit 5 memberships as an example beyond LinkedIn is our podcast. There's no links on the podcast, it's just people over time listen to the podcast, hear about the community and eventually join.
Pranav
Totally. I'll give you a counter to that, Dave. I'll answer your question directly. But like, look at this example. This is billboards and it's having short term impact on the outcome metric. Not long term, short term. So this idea that brand campaigns only work in the long term, completely flawed. That's bullshit. So if it doesn't work in the short term, highly unlikely. It's going to work in the long term. Highly unlikely, right. It's like saying that somehow you're just going to sit with that idea and it's going to give you some crazy information 12 months from now.
Unknown Host
So it's either going to work right away or it's never going to work.
Pranav
Very unlikely that it will work down the line. Exactly. Now let me answer that specific question to you, right, which is why did I do LinkedIn the way that I did? I don't know why I thought LinkedIn was a good idea. So I don't have the benefit of like going back in time and thinking exactly about it, but I started and for me the results were actually quite immediate. What that means is our ICP was engaging with my content right off the bat. That was like one engagement. I was like, oh, another marketing leader liked my post. That's good. I just got a warm way to connect with that individual. I would go connect with that individual. And so it was kind of immediate. Even if that was not sort of the, oh, I'm getting closed one revenue out of it. But the feedback, the engagement, the activity, the leading metrics were all very positive right off the bat. And so never stopped doing it. I'm like, oh great, like, let's just keep growing this thing. And by now it's reached a point where people literally take my LinkedIn posts and email me and Say, hey, love this post. Can we have a demo? I don't need to prove the efficacy of LinkedIn anymore to myself because, like, we know it works.
Unknown Host
I have to think about this a lot. When, when we were at Drift, we had a podcast and the podcast ended up being the. If you talk to the sales team. Our podcast, which was not about the product that we were selling at all, became the number one driver of Pipeline. Like, until we made basically our first 5 million ARR. And we used to joke, how are we going to measure the podcast? How are we going to measure the podcast? Well, it turns out on all the sales calls, they had basically first found out about us. They started listening to our podcast and became fans of the podcast. And eventually over time, they went to our website. They were deciding to shop Drift versus Intercom versus other thing and they went with us. But if we had gong at the time, like, we could analyze that. I also find myself quoting something you said to me early on. At some point in an interview or something, you're like, we need to stop treating our customers like they're morons. As part of this attribution puzzle. It's like, if I see Pranav online and he says something interesting, I don't need to click on this perfectly tracked link and get credit for that. It's like, oh no, what was that guy's name again? Oh yeah, Pranav.
Pranav
What was the company?
Unknown Host
I go to LinkedIn. Oh, it's Powermark. Boom. Then I go to the Powermark website. We need to give more people, we need to give our, our customers more credit in that, like, if you do something that is memorable, people will find you. And let's focus more on, on the part of, of getting people to, to be memorable, right?
Pranav
A hundred percent repetition is key. And there was an interesting point in the chat about what about if your content isn't working? Yeah, absolutely. When we are talking about tests that didn't work, right? This YouTube example that didn't work, right? This particular customer, it's a great brand. It's like. And they do something that's very relevant for YouTube, but YouTube ads didn't work for them. All it means is that the specific creative offer acution didn't work. Doesn't mean that it will never work. It just means that whatever they were doing at that particular time was not working. And so they have to change something about their creative, about the offer, about the execution of that creative. And that's absolutely sort of critical for any marketing team. Don't give up on A channel just because your first test fails. Okay, this is a fun one. B, 2C example. But I think it's irrelevant. They worked with us for about seven months. They did about seven tests, all failed. Not incremental, no lift. Not incremental, no lift. The eighth test worked. So it's very easy to give up when you do experimentation. It's very easy to say ah, shit, like none of this stuff is working. But it takes a long term commitment to growth because not everything is going to work. Think about it from a sales perspective. You have to hear seven nos to get three yeses. I've lived that life for the last two years. That's the same exact concept in marketing. Seven campaigns are not going to work, but the three that work are gonna make your business amazing. All right, I got super excited there, Dave.
Unknown Host
That's great, man. This is great. This is what I want these sessions to be. This is perfect. Do you have more stuff or do you want to take a Q and A?
Pranav
Let's do Q and A. Like happy to take qa.
Unknown Host
Oh wait, there was a comment about somebody did want the PMAX example. If you wanted.
Pranav
Let's talk about it. Yeah, performance, then let's do Q and A. So this is a pretty big company. They have lots of different channels. Classic, right? Heavy reliance on paid search. And they're running out of sort of real ways to kind of grow that part of their allocation. And Performance Max is this new thing that Google launched. And I do think that this is the future, by the way. So any media buyers who are in the chat, every ad platform is moving towards an algorithmic buying process, which means you just tell us your brand, tell us your copy and messaging and give us your website, we're automatically going to generate a whole bunch of ads. That's like the generative AI part of like ad creation. And then we're also going to use our own machine learning and AI to figure out who to serve those ads to. So you don't have to worry too much about giving us too much detail. We'll just figure it out for you. Performance Max is kind of like that, where they're looking at all the Google properties, whether it's the Discover feed on Google, it's YouTube, it's search, it's shopping, it's wherever else they have access to. And it gets a lot of hate because people say Performance Max is bad inventory. Google is just trying to increase their monetization by giving you bad inventory and just like putting ads there. So we ran this test, the target metric is MQLs which are basically hand raisers for this brand. We only ran it in about 10 states in the US and so PMAX was. Performance max was limited to those 10 states and we observed what the conversions the MQLs were from those 10 states. This is an important point. I think some other people asked. So we're just. The blue line is just showing you MQLs from those 10 states where performance Max ran. And the control is everything else. The other 40 states where performance Max did not run. I'm simplifying the explanation a little bit, but I don't want to get too geeky here. And then you look at what is the lift or the lack thereof and you look at the pre test period to kind of inform yourself on what your test period is as well. And so in this case it worked perfectly for them. Now why did it work for them and it doesn't work for others? I think some people mentioned this here that you have to be very careful about all the exclusions. So this is a media buying thing. You probably don't want to have your branded search placements and Performance Max and you can do all of those exclusions. So only targeting surfaces and inventory that you're not cannibalizing on your non brand search and brand search and other sort of Google properties by running it this way. So there might be people who are more, well, worse than I am on Performance Max in the chat. So if I got anything wrong, please keep me honest. But from a testing perspective, from a measurement perspective, it was very positive for that. All right, there was a good question here. How do you know how long to run the test? You want me to take that one, Dave?
Unknown Host
You think I was going to hit that one?
Pranav
So the answer is actually all based on math. So when you do the experiment design, I didn't show you the process of how you do experimentation design, but you essentially get the. And this is where I plug Paramark. We essentially help you come up with the geographies, the time and the budget that you have to either increase or decrease to get a statistically valid answer. You can think of that whole process as very similar to an AB testing tool. On your website, you know, you have all those AB testing calculators. You just put in some numbers and like hit enter and tells you this is how you, you know how much sample size you need. You're kind of doing that, but it's a lot more sophisticated because you're working with much more messy numbers when it comes to actual sort of Media in the real world. So it could be four weeks, could be six weeks. Typically, it's ranging between that time. If you have very noisy data, that means your data moves very up and down every day, then you need a longer period of time because you're trying to lift above that noise. So I'm getting a little bit data sciencey here.
Unknown Host
I just said my answer is until you get bored, then just change it.
Pranav
That works too.
Unknown Host
Hardest part about turning off the branded search is the cfo. This is back in the day when I used to go to the office. The CFO comes over the desk and he's like, we're not showing up at Google right now. Oh, my God.
Pranav
Yes, yes, yes.
Unknown Host
This has nothing to do with what we're talking about. We should answer people's questions. But could you actually share the summary of. You hired a marketing leader for the first time recently, and you have this very thorough hiring process. And I thought that was interesting. As somebody who has in the past not done great at the hiring thing. Exit 5 team is awesome. I've hired some good people, but I think really treating it. You gave it a really important go at it, and I think it's a cool example. So if you just would riff on.
Pranav
That for a second. Yeah, totally. No, it's a good one. And we should do an episode with Sam on my podcast, because I think it's a good one.
Unknown Host
Danny, I think you gotta wait. I think you gotta wait for a year on that. I just think that that's no disrespect to Sam. It's no disrespect. Like, just things happen, man. It's crazy. Everybody's in love. Everybody's in love with the new hire. Like, you know, the first three months is the honeymoon phase. And like, by month four, you're like, well, anything yet? And then this is slippery slope. So.
Pranav
Well, so this is a really fun one.
Unknown Host
Sam has literally. Sam has entered the chat. I'm paying attention now.
Pranav
I love so Sam. Well, first, if you don't know Sam, go check him out. He's awesome, and he's like a super connector. So I would say that if you want to learn marketing. And also just like, he's spent time at Microsoft, at Shutterfly sunbasket. He actually comes from more of a consumer background. So it was a little bit of a Sam and I kind of figuring out, how is this going to work? So I'm sharing sort of all the background here. And he did a power move in the process even before we started talking about the Role. He gave me leads and one of them converted.
Unknown Host
That's amazing. That's so good.
Pranav
Right? One of them converted and I'm like, wait, what is going on here? Frankly I'm like in an alternative universe, I would go work for Sam. And so that was my thought process on like, hey, if we're going to bring in somebody at a seed stage, right. Where they're a leader, they're a VP and they're sort of pushing us in a very sort of big way, it's gotta be someone that's baller. So to steal Justin's language here now, the interview process itself was with Sam specifically. It was like multiple weeks, multiple months. We riffed on a bunch of ideas, but more concretely, we actually gave him an exercise that was a take home that was like, hey, take this other series B startup. So we didn't give him any cases on Paramark. We actually gave him a case on Evaluate this other series B startup because we wanted to be on neutral ground. This was an important thing for us is like if we gave him everything about Paramark, we would be biased. If he gave him everything about Sun Basket, he would be biased. Right. He just has this information asymmetry there. Let's pick a neutral territory and have him do a whole sort of rundown of positioning, branding, messaging, campaign execution. And I think if I'm not wrong, Sam spent like a couple of days with us in the office. He came on site and he just workshopped that whole thing with us with different people on the team. Right. We've got engineers mostly other than me. And so I'm sure it was a little bit awkward. You should interview Sam about that for him trying to explain marketing to engineers. But that was the whole process and it worked out pretty well. And again like Sam was just had power moves up his sleeves.
Unknown Host
Did you pay him to come hang out with you?
Pranav
Yes, we did. Well, Sam, I see that come up.
Unknown Host
In our community a lot is, hey, I'm interviewing for this job and I'm not. Not that obviously. I think you, you handle it great. There's just something that comes up a lot which is like, hey, I'm interviewing for this role. They want me to make a presentation and basically they're going to steal my strategy and not compensate me for it. And there's a, it's a really slippery slope there.
Pranav
Yeah. So for all of our on sites, if we're doing anything beyond like a day long on site. Right. Which is pretty typical. So if we're doing a take home or what have you, we essentially structured as a paid project, and we agree on that upfront. Right. So we're not saying, like, hey, you do any free work that is expensive, but we do it, like, for engineers. Like, our engineers come on site for three days if they can. If they can carve out the time. If they can't carve out the time, like, one day is fine. Right. So, like, we. We customize it for each person.
Unknown Host
Cool. All right. We'll export all these questions and we'll. We'll give them to you all. I know you all do there. There's definitely a content thing where there's a bunch of questions that we didn't get to. We got a ton of really, really timely, relevant ones in the chat. So I'm not going to do Q and A right now, but maybe. Maybe you all can answer them in some content form or another. We'll give you the export of all this. Thanks, man. This was awesome. This was super fun for me. The chat was awesome. And I messaged something to Daniel during this session, and I just want to give a shout out to the people who came to this. Like, man, there is so much information out there online to treat your job like a craft and to be like, yeah, I could get the recording, but to actually come and hang out and, like, ask questions and take notes and, like, you get what you put in. And I just really appreciate, like, marketers that are here trying to learn, trying to get better. Like, it's very easy to just listen to podcasts and mess around YouTube, like, putting in the time and effort to, like, come in and do something to help you and grow your career and your business. Like, heck, yeah, those are our people. And I love that. I believe in self development and personal development in, at work and outside of work, and so I love that. And Pranav, you're always great, so thank you for doing it. Go check out Powermark. They're doing a great job. Pranav's got to go back to his inbox because this is the best inbound lead day ever. Well, for now, because they announced their seed funding and he came on here and hung out for a little bit. So appreciate it.
Pranav
It's a lot of fun. Great question.
Unknown Host
Good to see you all. We'll see you later. But I was supposed to ask you to rate this, but. Yeah, rate it. Rate it real quick. Where's the poll? Where's my producer, Danielle? So we got a measurement. Measurement. Measurement. We're supposed to do this. Okay, no poll. All right. It was great. 10 out of 10. I see ya. Goodbye, everybody. It was awesome. See y' all.
Dave Gerhardt
Hey, thanks for listening to this podcast. If you like this episode, you know what? I'm not even going to ask you to subscribe and leave a review because I don't really care about that. I have something better for you. So we've built the number one private community for B2B marketers at exit 5. And you can go and check that out. Instead of leaving a rating or review, go check it out right now, now on our website, exit5.com our mission at Exit 5 is to help you grow your career in B2B marketing. And there's no better place to do that than with us at exit 5. There's nearly 5,000 members now in our community. People are in there posting every day, asking questions about things like marketing, planning ideas, inspiration, asking questions and getting feedback from your peers. Building your own network of marketers who are doing the same thing you are. So you can have a peer, your group, or maybe just venting about your boss when you need to get in there and get something off your chest. It's 100% free to join for seven days, so you can go and check it out risk free. And then there's a small annual fee to pay if you want to become a member for the year. Go check it out. Learn more exit5.com and I will see you over there in the community. This episode is brought to you by Ztle. We're halfway through 2025 already, somehow, and one thing's clear. Events are back, baby. I'm all in on events. Here I am, big events guy, niche meetups, conferences, curated dinners, networking, you name it. Everyone's leaning in. I felt this with our business at Exit 5. I talked to a lot of CMOs and marketing people and marketing leaders through Exit 5. Everyone wants something to do with events right now. And that's because events are human. We want to get out there and connect with real people. Events are a core part of our playbook. This year at Exit 5, we've hosted two virtual sessions each month. There's in person stuff, but there's also virtual. We do these virtual sessions each month. One large virtual event, one in person meetup. And right now, already we're deep in the weeds planning our drive conference drive 2025, coming back to Vermont this September. And to do it all, we use Zuttle. Zuttle helps us run a smarter event strategy from driving registrations, managing invites, automating communications, reminders, analytics, tracking their salesforce integration. Also makes it simple to report on pipeline and revenue from events without pulling in ops. On top of that, the differentiator with ZTTL is how their team is insanely good at supporting us. It's all about the people. They always go above and beyond for us, and that's how we've been able to keep the momentum going with 12 plus events already this year and more to come. If events are part of your marketing strategy like they are ours, check out Check out Zuttle Z U D D L. You can look at Zuttle to see how companies like Zillow, motive, Iterable, and US Exit 5 are using Zuttle, the top event platform for business events in2025. Go to zuttle.com exit5 that's z u d d l com exit5 to learn more.
Podcast Summary: The Exit Five CMO Podcast – Episode on B2B Ad Campaigns with Pranav Piyush
Podcast Information:
In this episode of The Exit Five CMO Podcast, host Dave Gerhardt welcomes Pranav Piyush, the Founder and CEO of Paramark. The discussion centers around Pranav's insights into B2B marketing strategies, specifically focusing on real-world test results from various ad channels. The conversation delves deep into the nuances of attribution, causality, and the effectiveness of different marketing channels based on empirical data.
Pranav begins by addressing a common confusion in marketing: the difference between attribution and causality. He references a dictionary definition to clarify that attribution can mean either a characteristic of something or the causative relationship between two variables.
Notable Quote:
"If you are really serious about attribution and measurement and you're not thinking about cause and effect relationships, if you're not thinking about experimentation, what are we even doing here?"
— Pranav Piyush [07:25]
Pranav emphasizes the importance of experimentation to establish causality, drawing parallels to scientific methods like randomized controlled trials and A/B testing. He criticizes the casual use of the term "test" without proper controls, likening it to "throwing spaghetti at the wall."
Pranav shares insights from testing branded search campaigns with two well-funded SaaS companies (Series C and Series E). By cutting branded search spend to zero in selected geographies, they observed no impact on key business metrics such as MQLs (Marketing Qualified Leads) and demo requests. Instead, the traffic seamlessly shifted from sponsored ads to organic SEO.
Notable Quote:
"These are real examples of two customers where branded search really did not impact their business."
— Pranav Piyush [14:07]
The discussion highlights that for companies with robust SEO strategies, branded search ads may offer diminishing returns, allowing significant budget reallocations without sacrificing lead generation.
Pranav discusses a case involving a fintech company that utilized digital billboards as part of their marketing mix. By conducting a geotest—running billboards in specific areas while keeping others as controls—they measured a clear lift in application metrics during the test period. This method demonstrated the effectiveness of digital out-of-home advertising, which traditional click attribution tools failed to capture.
Notable Quote:
"This is an example of how you can do an AB test in the real world with billboards."
— Pranav Piyush [19:50]
He underscores that such campaigns can uncover new growth avenues beyond saturated digital channels like Google Search.
The effectiveness of YouTube advertising varies based on a brand's existing organic presence. For one enterprise-level company, YouTube ads generated a significant lift in MQLs, whereas another Series C company saw no impact due to already strong organic YouTube content. This indicates that the success of paid channels can be contingent on the existing strength of a brand's organic strategies.
Notable Quote:
"There's nothing stopping you from doing that [geo-based testing]."
— Pranav Piyush [24:15]
Pranav introduces Performance Max (PMAX) campaigns on Google and Bing, which leverage algorithmic buying to optimize ad placements across various platforms automatically. Despite some backlash regarding inventory quality, Paramark observed a positive lift in MQLs from PMAX campaigns when properly managed with exclusions to prevent cannibalization of branded search efforts.
Notable Quote:
"From a testing perspective, from a measurement perspective, it was very positive for that [PMAX]."
— Pranav Piyush [43:10]
He advises marketers to carefully exclude branded search terms to ensure that PMAX campaigns complement rather than compete with existing strategies.
Addressing concerns about the feasibility of running such experiments with limited budgets, Pranav provides actionable strategies for small to medium-sized businesses:
Notable Quote:
"There is no alternative. Zero alternative."
— Pranav Piyush [26:49]
He emphasizes that even with budgets as modest as $10,000 per month, meaningful experiments can be conducted by maintaining focus and avoiding the "spray and pray" approach across multiple channels simultaneously.
Pranav shares Paramark's internal experiment with sponsoring Exit Five events. By sponsoring, they observed a doubling of website traffic without the need for additional tracking mechanisms like UTM codes. This pre-post experiment demonstrated a direct correlation between sponsorship activities and increased engagement metrics.
Notable Quote:
"Our traffic literally doubled the moment we started working with Exit Five."
— Pranav Piyush [35:22]
This example illustrates the potency of strategic sponsorships in driving brand awareness and engagement.
Pranav addresses skepticism regarding long-term impacts of marketing campaigns. He refutes the notion that brand campaigns only yield long-term benefits by presenting data from billboard tests that showed immediate lifts in metrics. Additionally, he discusses the importance of persistence in experimentation, citing examples where multiple tests (seven failed before the eighth succeeded) were necessary to achieve significant results.
Notable Quote:
"It's not efficient. But what do we do now? We're going back and testing individual components within their media plan."
— Pranav Piyush [34:16]
This highlights the iterative nature of effective marketing strategies and the necessity of continuous testing and optimization.
For marketers with constrained budgets, Pranav offers practical advice:
Notable Quote:
"We do not have to run a massive test, you can run smaller tests to get signal before you ramp up into that bigger budget that you have."
— Pranav Piyush [28:29]
He encourages marketers to adopt a disciplined approach to experimentation, ensuring that each test is purposeful and measurable.
Towards the end of the episode, Pranav touches upon Paramark’s meticulous hiring process for marketing leaders. He shares an anecdote about hiring Sam, who impressed the team by bringing valuable connections and demonstrating exceptional strategic thinking during a paid interview exercise. This segment underscores the importance of a thorough and respectful hiring process, ensuring that candidates are evaluated fairly without exploiting their efforts.
Notable Quote:
"We essentially structured it as a paid project, and we agree on that upfront."
— Pranav Piyush [49:25]
Pranav advocates for transparent and ethical hiring practices, especially when involving take-home assignments or on-site exercises.
The episode wraps up with Dave and Pranav reflecting on the value of live interactions and continuous learning. Pranav reiterates the significance of disciplined experimentation and strategic allocation of marketing budgets to channels that demonstrate clear incrementality.
Final Notable Quote:
"Seven campaigns are not going to work, but the three that work are gonna make your business amazing."
— Pranav Piyush [41:28]
Differentiate Between Attribution and Causality: Understanding whether you're measuring correlation or causation is crucial for effective marketing strategies.
Experimentation is Essential: Rigorous testing with proper controls can unveil the true effectiveness of various marketing channels.
Budget-Friendly Testing: Even with limited budgets, strategic experimentation through geo-based or account-based segmentation can yield valuable insights.
Persistence Pays Off: Not all experiments will succeed, but consistent testing can lead to significant breakthroughs.
Ethical Hiring Practices: Respectful and transparent hiring processes are vital for attracting and retaining top marketing talent.
This episode provides valuable, data-driven insights into B2B marketing strategies, emphasizing the importance of disciplined experimentation and strategic budget allocation. Pranav Piyush’s real-world examples offer actionable lessons for marketers aiming to optimize their ad campaigns across multiple channels.