A (34:21)
Yep. So I touched on this a little bit in the earlier part of our conversation, but I had an international client who wanted to optimize specific GEOs. They weren't in English. And so this was a perfect way for me to test like, okay, how do I help them understand that if we optimize their content foundation is SEO that they'll get, they'll become more relevant for what people are searching for. So most people, most companies, most executives want to rank for a keyword that's well and good. I totally get the vanity, but the reality is there's this myriad of queries that people are typing in that are relevant for your space. So I developed that keyword cosine similarity tool on hugging face as a way into this route. So I developed that, building a way to clean up this list of keywords that you can get, which can be endless, and turning them into things that are really semantically relevant to the space. Then we'll get content from competitors and content from the client site and then bring all these queries together. And what I wanted to build was a visual representation. So this gets into the T SNE products that you can pretty easily build on Plotly. Like I look at the, the source of these, these pages that I've developed for various clients over the years. Like, I don't, I don't know exactly what's going on here. I know it's built on Plotly, but I wanted to do an analysis on the title, the description, the headers, some of the list items, some of the paragraph components that were actually part of the actual article content. Do this for the client, do this for the competitor, and do this for the query landscape. This required building an embedding analysis tool. So I pulled in that multilingual model and I worked on basically crunching all of this data. So I scraped that data, I built some code to actually go through and turn this all into vector embeddings and then plot them into the three dimensional space. That was fun. Just like you can drag it around and it moves around, it looks cool. All these dots in 3D space, which is a simpler representation of that multidimensional space. Where this becomes useful is by turning this into the mean embedding value. So you have the queries, you have the client, you have the competitor turn this into a mean value. And the objective, the hypothesis that I had is if we update the client's content and move that mean value closer to the query, the query mean value, then we're going to be more semantically relevant for the queries, not just the query, but the queries that people are searching for. So what I did is I built this, it looks cool. I had some examples to show the team, they could play around it and move that 3D plotly chart. So that was always fun for them. And I also was able to give the code to the engineers because they wanted to do this internally and scale it themselves. It showed the semantic relevance of the content. And so ultimately we proposed some changes. So this is the SEO part, we proposed changes to the content on the site. So some things, some sections we would update based on the query or the supporting queries, things like the headers, improvements on the title. But I think the difference here is that we got rid of some of the content on the page that yes, design wise, made a lot of sense for the user, but actually it took away from the semantic meaning of the page overall. So we demoted those into like H5s as opposed to H2s. And so what this did was after we did the updates, rescraped the page and rebuilt that plotly T sne we saw that there's a difference in the cosine of the cosine value of the old version and the new version. And so by getting closer, my hypothesis is that you'll actually earn more users, qualified users ideally. We launched this and I was pretty surprised, but like the clicks were up 10%. No, sorry, 10x, not 10%, 10x for this segment. So it wasn't a perfect a B test because it was segmented by, you know, a couple of pages in the larger group of pages. But I have ran this test with other clients and have seen similar results. But, but 10x on clicks, pretty great. That's the biggest number. It was like 8x on impressions, 7x on click through rate and then 50% on the average ranking, which I hate the metric average ranking, it's so annoying. And then also after we got rid of all the results past 100 now like, oh, like where's my ranking, my average ranking going? I don't want to talk about that. So I was able to demonstrate a significant increase in users coming to the site for the primary query. The queries that were coming from the tool that were combed through by doing the cosine similarity analysis. And I was able to demonstrate this in a cool visual that was able to get the buy in from the client. And so this is something that I've been repeating with clients and having really good success with. I haven't had any bad cases where it hasn't worked. That's because we're improving the relevance of your site. Of course you want to do this in a way that is actually useful for the user. You don't want to just do keyword stuffing. That's not helpful. But this was something that I was surprised and basically led into. It's true. You can, I'm. I'm not a developer, but I can make tools, I can give tools to engineers and they can replicate this internally. And that was, that was a lot of fun. I love sharing those types of results for clients.