
Loading summary
Marcus
Are your brand campaigns as effective as they could be? If you're only getting insights when the campaign is over, then the answer is no. To make better campaign decisions, you need real time measurement. You need lucid measurement by sint. Discover the power of real time brand lift measurement@synt.com insights that's C I N T.com insights hey gang. It's Monday, June, June 2nd. Garjo, Evelyn and listeners, welcome to behind the Numbers, any marketer video podcast made possible by. Since I'm Marcus and joining me for today's conversation, we have two of our senior analysts. One of them covers AI and everything tech. For us living in New York, it's Garjo Sevilla.
Gajo Sevilla
Hi Marcus. Hi Evelyn. Happy to be here with you guys.
Marcus
Hello fella. We're also joined by one covering digital advertising and media based in Virginia, Evelyn Mitchell Wolf.
Evelyn Mitchell Wolf
Hi Marcus. Hi Gajo. Hello everybody.
Marcus
Hello. Today's facts. Pluto is about the same size as Russia. Who knows if this is true? So both of them are about 11.
Evelyn Mitchell Wolf
Million square miles, like Pluto's vault, like surface area. What are we. What do you mean?
Marcus
If you like stretch Pluto out, like if Pluto was like a tennis ball and you like cut it and then stretched it out.
Evelyn Mitchell Wolf
Okay.
Marcus
It would be the similar surface area to Russia.
Gajo Sevilla
So it's smaller than the moon?
Marcus
I don't know.
Gajo Sevilla
I don't know. Just thinking, is it smaller than the moon?
Marcus
Let's, let's figure this out. Is Pluto smaller than the moon? At least that's why you really come to behind the Numbers. We answer the real questions. Yes, it is. It's smaller than the moon. Not by much. By a bit. Yeah, Pluto's about two thirds.
Evelyn Mitchell Wolf
Okay. Anyway, so it's tiny. Yeah, tiny little guy.
Marcus
It's also a lot cold, like a lot colder. Average temperatures of around negative 400 degrees Fahrenheit, about negative 230 for our European friends. So cold like Russia. Anyway, it's not that cold. Today's real topic, how AI is changing search. An AI chatbot is to be embedded in Google Search, writes Lily Jamily of the BBC. Katherine Blunt of the Wall Street Journal was explaining that Google has started rolling out on its search page AI Mode, which answers search queries in a chatbot style conversation without the standard list of blue links. And J. Peters of the Verge was saying Google presented an example of someone using this to do things in Nashville over the weekend with friends who like food, music and exploring. Off the beaten path, AI Mode sprung into action, creating Google curated lists of restaurants good for foodies recommending places with a chill bar atmosphere with live music and highlighting places off the beaten path and suggesting sites featuring good things to do in Nashville. It even created a custom map recommending places to go. Evelyn, what's your biggest takeaway from Google embedding an AI chatbot into search?
Evelyn Mitchell Wolf
Yeah, this is on the scale of like 1 to 10 in terms of big deal. I'd say this is like a six or a seven at least. Um, so it's short term. I don't think it's really going to do a ton because it is for now at least, it's still only accessible via like a separate tab under the search bar. So users have to click into it. They have to seek out that experience in order to to have the experience. And any additional friction is a barrier to adoption. So AI mode being embedded in the legacy Google workflow at all is a big deal. And I think eventually we will see pretty strong adoption because of the proximity to the search habits that consumers have built over decades. But I think the bigger deal here is that Google is sort of completing its menu of Genai powered search options, so they have AI overviews which require nothing extra from consumers to receive them. Then there's the AI mode, which is still very accessible and it is that conversational search interface. And then beyond that is Gemini, which is the chatbot that shares a name with the LLM that powers all three. So lots of different options for consumers, whether they, if they actively want to seek out those experiences or not, which I think is a smart strategy for Google as there are sort of varying levels of desire for those products among consumers.
Marcus
Yeah. Gaja, your biggest takeaway from this.
Gajo Sevilla
So I see this as Google hedging its bets. It's evolving search by including an AI mode, but it's not replacing search completely. And so I think by putting it alongside traditional search results. And you know, like what Evelyn said, the way people are used to searching, it's kind of using it as a client capture strategy. Because sure, if you want a chatbot, you don't have to fire up another app or go to another web page. You're still within Google's wheelhouse. Now, usage will depend, of course, on the quality and how good it is compared to what the competitors are offering, but the fact that it's a click away, I think will, will kind of yield a lot of people to at least experiment with it, and they'll have to do so by choice.
Marcus
Yeah, 1.5 billion people, they said, now regularly engaging with AI overviews. And they said most users are now entering longer and more complex queries, but they also thought that AI overviews was going to trigger more searches and more clicks to other sites. That doesn't seem to be the case. Brightedge was noting that click through rates from Google's search Results are down 30% over the past year and they attributed to the drop to folks becoming increasingly satisfied with AI overviews. Evelyn, you very validly pointed out that before AI overviews debuted, a lot of the Google queries were zero click searches anyway. So there is that part of it. But what do you make of how this is changing people's behavior in terms of searching for things?
Evelyn Mitchell Wolf
So there's actually, I mean Google has said a lot of things and not provided a lot of data to back up their statements. So that's one thing to worth, that's worth mentioning because there are some third party sources in some specifically in the SEO area that have search engine optimization for anyone that is not super familiar with this space. And those sources have not found any evidence that consumers have meaningfully altered their search behavior, including the average length of queries. So I think until we see some real data from Google, I would take most of what they say with a grain of salt because they're trying to shape this narrative. We saw just a few weeks ago Alphabet stock dropped pretty drastically because somebody at Apple, Eddy Q, I can't remember his exact title, but testified in the search antitrust remedy trial that Google search volume had dropped for the first time on Safari, for the first time in like 22 years or something. So that, that kind of, I guess I don't think it's necessarily new news that there are because there are different places that consumers can go to satisfy their search use case, whatever it may be, then of course some people are going to use those options and there will probably be a reduction of search queries on Google. But in terms of how people are asking questions, I mean we don't actually have a ton of insight into that. And I think for the most part, because the proportion of consumers that are using these tools with any sort of regularity is so small, the vast majority of search behaviors aren't going to change if they're still using Google. And you know, AI overviews are still relatively rare. I think they are served on about like just under 15% of Google queries in total. And that that sort of exposure varies from topic to topic. But if, if consumers aren't actively seeking out that kind of genai search experience and they are only just sort of existing and Doing their regular habits and sometimes they're getting hit with an aio. Why would something meaningfully change aside from then maybe they won't click through when that AIO is served if they would have otherwise. So it'll take more time for the vast majority of consumers that aren't sort of predisposed to use these tools and you know, test use cases, see if maybe ChatGPT might be better for this particular thing, if AI mode might be better for this kind of thing. Not everyone is going to want to take the time to figure out what is best serves them in a particular, for a particular question. So they're just going to default to Google. And for now there's still not a ton of reason for them to change their behaviors.
Marcus
They are, yeah, they are looking. People are looking in a lot of different places. I mean Google gets a lot of the credit for being the place where people search for 90% of things or whatever. But when you. We had some research from April of this year and we were asking consumers what platforms they've used for search in the past 12 months and yes, Google came out on top. 93% of people said that. But then Amazon was in second place, distant second, admittedly 56% but then all with about kind of 20 to 50% range. Amazon, YouTube, Walmart, Facebook, Instagram, TikTok, ChatGPT, Yahoo Target. So people are looking in a lot of different places and it seems Gaja, that Google knows that and they're trying to fight off the gains made by these other platforms in terms of search. They 90% share of search is what they had for a long time. That's down a bit from 93% from a few years ago. And Statcounter was saying that actually in the last six months, Google's share of search has been down below the 90% mark for six months, which is the first time that's happened in 10 years. So it seems like Google does know that there are alternatives. How much do you think this development, AI mode, how much can that fight off some of its competitors?
Gajo Sevilla
I think one thing that sticks out to me is this stat from Pearl saying 57.8 of US adults still prefer Google search over AI tools. That's assuming that they know about these AI tools. Okay, yeah, 60%. I mean that, that tells you it's, it's, it's all about habit. The value proposition would have to be pretty evident and, and I guess special and not cost more than Google search for, at least for consumers.
Evelyn Mitchell Wolf
Yeah.
Gajo Sevilla
And when you're, you're looking at these standalone AI search services, there's always kind of a subscription or, or some limit to, to how much you can use the service. Right. So I think those are roadblocks. Will it change? I think sure it will. The, these tools are getting faster, they're smarter, they're, they're starting to buy proper data training sources from publishers. But I think it's going to be a slow burn before, before we see any dramatic move away from Google. At least for most users.
Marcus
They are still so far ahead of everyone else. During the year ending in March, Google had 136 billion monthly visits, which would be 34 times more than ChatGPT according to OneLittleWeb. Com.
Evelyn Mitchell Wolf
Yeah, they have, they certainly, I mean Google has a traffic advantage. And you mentioned the survey that we ran in March too that had Google far and away out on top that that 90% penetration, roughly like near or above 90% penetration holds across demographics. And that's something that is not true for specifically. We're talking about Gen AI first kind of quest platforms like ChatGPT. There are pockets of consumers that, that use them. And TikTok too, right. That's very much a Gen Z kind of destination when it comes to search and really for entertainment as well. But Google consistently across demographics regardless of age, gender, ethnicity, race, income, employment status, employment sector, it's, it is at or near that 90% penetration benchmark. So that is also a huge, huge deal for, for Google and I think distribution actually rather than just pure competition is one of the things that, that keeps Google on top.
Gajo Sevilla
Yeah. Just just to add, they, they do have the power of default, right? I mean on, on Android they're the default search. On iOS, their biggest competitor, they're the default search because of that huge deal that they've had for years with Apple.
Marcus
So yeah.
Gajo Sevilla
That'S something that's going to be a hurdle to overcome. Right?
Marcus
Yeah, I mean it seems like the market believes in Google. Its stock price is double what it was when ChatGPT first came out. We mentioned a bunch of their competitors in terms of searching for things already. One of them, Gajo, is one you were writing about Anthropic launching a web search API for Claude which enables you say, enables real time online research with cited sources. You say this marks a major shift away from traditional keyword based search to AI driven discovery per VentureBeat. Explain to us what you mean by this and why you think that Anthropic's CLAUDE API might reshape search.
Gajo Sevilla
Okay, I want to pretext this by saying that this is still a subscription service that's, you know, available to Claude subscribers and to access the API, you know, they have to pay $10 per 1,000 searches. So this is not a consumer.
Marcus
Okay.
Gajo Sevilla
Sort of product. I see this as an enterprise play. This intermediates Google from search though. Right. Because you can now basically take this API, build it within your internal parameters, tie it into to your business's internal data, and search various sources that you could even choose what to cover and what to avoid. So it essentially gives the power of search to the developers. Right. And that again doesn't require SEO, it doesn't require keyword algorithms.
Marcus
Yeah, sorry, go on, finish. Sorry.
Gajo Sevilla
So it's completely kind of devoid from those trappings of traditional search as we know it.
Marcus
So speaking about traditional search, when me and you were talking, I said, spoke to you last week to talk a bit about this before the episode and we were talking about this idea that websites, you know, the places people land to look for things might start to change. And I read this piece from Patrick Coffey in the Journal. He was saying websites will soon serve primarily as data sources for AI platforms, not destinations for humans. This was a prediction from mailchimp. What do you talk to the listeners a bit about that concept? Our relationship with websites changing?
Gajo Sevilla
Yeah, I mean if, if this search API is as good as Anthropic is saying that it is, it can crawl websites without necessarily needing to click through anything. So those, you know, that would be in conflict with advertising models. So basically the information will, will be accessible. Not only that, it's, it's an AI agent. So it could actually validate the information as it's crawling.
Marcus
Right.
Gajo Sevilla
So there are all these multiple functions that can happen in real time. It's not just searching, it's, it's giving you the best results based on what your requirements are.
Marcus
Yeah.
Gajo Sevilla
And being a real time tool, you know, it could give you the latest news or a stock update on a specific company. What does that mean for the content providers? Right. They need to now find other viable means to monetize their content.
Marcus
Right? Yeah. I mean, circling back to Google for a second, Evelyn, one of my questions with the AI chatbot and how it's disrupting searches is how much this will affect the advertising dollars. As Corey Johnson, chief market strategist for Epistrophe Capital Research, was saying, Google is getting more efficient at answering questions, but less efficient at generating clicks and clicks is how they get paid. So what's your thought on how advertisers and publishers to A large extent fit into all of this?
Evelyn Mitchell Wolf
Yeah, it's a good question. I mean for advertisers I think the biggest question mark right now is where are the ad opportunities? If consumers are going to have their online experiences mediated to a large extent by these gen AI search tools by chatbots and they cannot be reached as reliably on publishers web pages, then there need to be ad opportunities on those mediated platforms as well. And we're starting to get there. AI overviews already have ads. Advertisers don't have a ton of control over what those those formats look like or when they're triggered. It's sort of just part and parcel of Google search campaigns and there's not a lot of visibility into performance either because AIO ads are not broken out separately right now in campaign reporting. So it's kind of a black box of an opportunity here. And also, I mean there are some other genai search interfaces where there are ad opportunities. Copilot, Microsoft's Copilot has some, Amazon's Rufus has some perplexity has sponsored like follow up questions. So not necessarily a typical ad format there, but there's not a lot of influence that brands have over what those look like and what those interactions will be nor does it make sense for them to. Right. Because every conversation will be unique. The ad, if there's going to be an ad in that flow it needs to be suited to whatever the conversation was on top of. We already have personalization of ads to whatever we know about the individual that is browsing the web or whatever it is. So there are a lot of question marks right now for advertisers in the immediate future though it's not that it doesn't mean much, it's just that there's not a ton that advertisers can do right now to change the way they approach search other than trying to pay attention to what's happening from the platforms and pay attention to consumers because consumer behavior is not going to keep pace with the way that platforms are approaching this opportunity. Right. We have AI mode rolling out. It's not something that consumers are asking for, it's something Google is pushing on consumers, at least for the majority of consumers. So it's definitely worth paying attention to. And then on the publisher side, of course this is an existential threat to their business models. For better or worse, ads have funded the Internet as we have known it. So I think in the short term publishers are already starting to feel significant revenue implications from the way things are going. And in the Long term, I think this is going to be a problem for everybody, for advertisers, for publishers, for the platforms, for consumers, where if publishers aren't able to sustain themselves through this monetization upheaval that's happening, there will be fewer reputable publishers to fuel the models. The answers to, like the answer quality, the result quality that these chatbots are able to put together based on the information that's out there on the Internet, will that quality will degrade. Consumers will get mad because they'll notice and then there will be less monetizable interactions for the platforms. It's all, I mean, you can see where the system, like the cracks are in this system. And I think a lot of these platforms, advertisers, everybody, are sort of, they're focused on, on simultaneously the future prospects of what could happen in these kinds of conversations, the exciting ways, the exciting new touch points that could open up for advertisers to talk to their prospective customers and their just general customer base. But then there's also this future where AI could destabilize the way that the ad industry, like the foundation on which the ad industry sits and could. I mean, yeah, there are opportunities in the future, but if the way the Internet works breaks and consumers just can't find the information they're looking for, then they're not going to be there to be served an ad in the first place. So there's a lot of existential threats, I think, for the entire ecosystem, not just for publishers as well.
Gajo Sevilla
Yeah, I think existential is the right word there because. Well, According to Reuters, 45% of digital publishers reported a decline in referral traffic from search just in Q1 2025. Right. That's palpable. Right. So that is really something I don't think anyone was prepared to face right at large. But here we are.
Marcus
I want to talk a bit about that. Just a quick note to conclude on the ads for the AI mode, Robbie Stein, Google's VP of products of Products for Search, was saying that they're considering ways to include ads within AI mode results. So stay tuned for that. But I do want to close the episode out by talking about publishers and there's kind of shifting power within the ecosystem. There was a great piece by Matteo Wong, who writes for the Atlantic, saying the AI search war has begun and tech companies might not be the winners. Interestingly, he explains that initially many Gen AI products were effectively built on stolen information before a wave of content licensing deals came out or came about, I should say, right around the Time the New York times sued for OpenAI. Sorry, sued? Yeah, OpenAI for copy infringement. AI search company Perplexity has admitted that they need publishers to keep creating great journalism loaded up with facts because you can't answer questions or train models. Well, if you don't have high quality, accurate, human made source material, he says. So do publishers actually have more power than it seems? Mr. Wong notes that publishers do have some ability to limit AI search engines reading the websites, but they can also refuse to sign or renegotiate deals. So, Gajo, what's your take on Mr. Wong's article noting that tech companies might not be the winners of AI of the AI search war after all?
Gajo Sevilla
Yeah, I mean, they're, they're facing a very limited, you know, number of sources for, for training data. And what, what happens there is, yeah, they can, they can borrow or copy or steal this information. But you know, we've seen how, you know, content companies and publishers have pushed back, you know, they're gatekeeping their data, they're blocking crawlers, and in some cases they're going into litigation to protect their intellectual property. Right. That just goes to show you that it is really a valuable and I think finite resource, given that, you know, the whole media industry is undergoing tremendous flux. A lot of publications and outlets are closing down or scaling down. So AI is going to continue to demand quality data because otherwise it's just going to start copying and kind of just giving pale versions of results. Right. And if you train your AI on that, it'll become evident pretty quickly that, you know, the quality is going to suffer. So I do agree with that point, Evelyn.
Marcus
It's interesting, this relationship, this evolving relationship between the AI search platforms, companies and publishers, because I'm curious to know what this dynamic is going to look like. I was thinking this through and wondering whether it's going to look more like the deals made between Amazon and Kohl's, where Coles will accept Amazon returns, or whether it's going to be more like kind of NFL and TV network deals. And what I mean by that is Coles needs Amazon, it seems so wondering whether, like the New York times will need OpenAI or as Nicholas Thompson, CEO of Atlantic recently posited, he was saying the Atlantic's contract with OpenAI will expire after two years and is designed to create more leverage when there's another moment of negotiation. So will it be kind of Coles, Amazon, where one really needs the other like that, or will it be kind of like the NFL where every single time the contract, the TV rights are up for a renewal. They're in a much more powerful position to demand more money from the TV and streaming players.
Evelyn Mitchell Wolf
Yeah, I mean, I think it's a good question because historically publishers have needed Google, and I'm going to focus on Google here because they're still, you know, by and large the single most important sort of portal to the Internet that consumers use and the single most important source of referral traffic for publishers at this stage, if we have to say that there is a single most important one. But historically, publishers have needed to allow Google's crawler to index their websites in order to be surfaced effectively to the consumers they're trying to reach. And Google has always held all the power. I do think that, you know, there will be a point of reckoning where Google will realize that it needs publishers to provide the product that it says it wants to provide to consumers. However, I think at this stage, Google has not been making the actions of Google make it pretty clear that Google still views itself as in the position of power over publishers. And so in the very near term, I don't see Google making a ton of concessions to publishers. There will be some content licensing deals here and there, and perhaps when those deals expire, publishers may still have plenty of leverage, but they could also not. Right. Google could decide that, you know, that having that content licensing relationship, if they are not forced to license content by regulators in the future, they may decide that it didn't really actually provide any benefit to Google directly in terms of revenue, and therefore it doesn't.
Marcus
OpenAI case will be pivotal then.
Evelyn Mitchell Wolf
Yes, huge. I think if New York Times wins its copyright litigation against OpenAI, that this whole dynamic could kind of crack wide open. And not a lot of publishers have the resources that the New York Times has in order to fight those kinds of cases in court. So that's huge for the rest of the publishing industry as well. If there's a ruling that stands in their favor, of course, then there would have to be. I still think that the tech platforms are going to take the W in the short term because for as long as we're in this sort of limbo where publishers are still at a disadvantage and there's not regulation, there's sort of a regulatory void where there's not a ton of powerful. The law can't come down on these tech companies every day. They're making a ton of money off of these search products like Google brings in on an average day over $200 million just in search ad revenues alone.
Marcus
Yeah, let's end with this from the piece from Mr. Wong. He says that the search war is an attempt to change how people navigate the Internet, the system through which the contemporary world organizes and disseminates knowledge. But the underlying terrain has not changed. Knowledge, no matter its organization, remains the sum of writing, art and thinking from humanity, not from a bot. That's all true unless people start to value bot made content more and more. We'll see. Evelyn has just been writing some research on this. It's hot off the press. It's called Gen AI Search Advertising Trends 2025 Consumer Adoption Lags Platform Advancements Link is in the show notes. We can head to eMarketer.com if you're a pro subscriber. That's all we have time for today. Thank you so much to my guests. Thank you to Gaja. Thanks everybody and thank you to Evelyn.
Evelyn Mitchell Wolf
Thanks Marcus.
Marcus
Thanks y' all and thanks to the whole editing crew. And thanks to everyone for listening in to behind the Numbers and E Marketer video podcast made possible by since make sure you subscribe and follow if you can. Leave a rating and review. The mood takes you Sarah will be here Wednesday taking a quick pulse check of the Retail World party.
Behind the Numbers: Google Embeds AI Chatbot into Search – But It Might Not Be Enough
Episode Release Date: June 2, 2025 | Host: Marcus | Guests: Gajo Sevilla (AI & Tech Analyst), Evelyn Mitchell Wolf (Digital Advertising & Media Analyst)
In this episode of EMARKETER’s "Behind the Numbers," host Marcus welcomes senior analysts Gajo Sevilla and Evelyn Mitchell Wolf to discuss Google's recent integration of an AI chatbot into its search platform. The episode delves into the implications of this move for search behavior, advertising, and the broader digital media landscape.
The central topic revolves around Google's rollout of AI Mode, an AI-powered chatbot embedded within the search interface. This feature allows users to engage in conversational queries, moving away from the traditional list of blue links.
Key Points:
Notable Quote:
Evelyn Mitchell Wolf (03:32): “AI mode being embedded in the legacy Google workflow at all is a big deal. And I think eventually we will see pretty strong adoption because of the proximity to the search habits that consumers have built over decades.”
The integration of AI Mode has led to a noticeable shift in how users interact with search results.
Key Points:
Notable Quote:
Evelyn Mitchell Wolf (07:03): “Until we see some real data from Google, I would take most of what they say with a grain of salt because they're trying to shape this narrative.”
Google's dominance in the search market is being challenged by various platforms, although it remains the leader.
Key Points:
Notable Quote:
Gajo Sevilla (11:31): “They do have the power of default... they're the default search... that’S something that's going to be a hurdle to overcome.”
The shift towards AI-driven search interfaces poses significant challenges for advertisers and publishers relying on traditional search traffic.
Key Points:
Notable Quote:
Evelyn Mitchell Wolf (18:32): “There are a lot of question marks right now for advertisers in the immediate future... but there's not a ton that advertisers can do right now to change the way they approach search.”
The episode explores the contentious dynamics between AI search platforms and content publishers, highlighting legal and economic tensions.
Key Points:
Notable Quotes:
Gajo Sevilla (24:50): “Publishers have pushed back, they're gatekeeping their data, they're blocking crawlers, and in some cases they're going into litigation to protect their intellectual property.”
Evelyn Mitchell Wolf (27:10): “Google has not been making it clear that they still view themselves as in the position of power over publishers.”
The integration of AI into Google Search marks a significant evolution in how users interact with search engines. While it offers enhanced, conversational search capabilities, it simultaneously challenges established revenue models for advertisers and publishers. The ongoing tug-of-war between tech platforms and content creators underscores a critical shift in the digital media landscape, where the traditional pathways of information dissemination are being redefined by emerging AI technologies.
Final Thoughts:
Notable Quote:
Marcus (30:15): “Knowledge, no matter its organization, remains the sum of writing, art and thinking from humanity, not from a bot.”
For a deeper dive into "Gen AI Search Advertising Trends 2025" and more insights, visit eMarketer.com (link available in show notes).