The Economist has gone public with an experiment: it has created a shadow website featuring an AI-friendly version of its front-of-paywall content. The idea is to improve the odds of this content surfacing in AI answers and responses to AI queries. It’s based on a new standard, llms.txt, which has been described as the robot.txt of AI. What does this mean for communicators? Neville and Shel break it down in this short midweek episode.

Links from this episode:

The next monthly, long-form episode of FIR will drop on Monday, June 22.

We host a Communicators Zoom Chat most Thursdays at 1 p.m. ET. To obtain the credentials needed to participate, contact Shel or Neville directly, request them in our Facebook group, or email fircomments@gmail.com.

Special thanks to Jay Moonah for the opening and closing music.

You can find the stories from which Shel’s FIR content is selected at Shel’s Link Blog. You can catch up with both co-hosts on Neville’s blog and Shel’s blog.

Disclaimer: The opinions expressed in this podcast are Shel’s and Neville’s and do not reflect the views of their employers and/or clients.

Raw Transcript

Shel Holtz: Hi, everybody, and welcome to For Immediate Release. This is episode number 516. I’m Shel Holtz.

Neville Hobson: And I’m Neville Hobson.

Something quiet is happening to the web, and The Economist is one of the first major publishers to talk openly about how it’s responding. A piece published by Digiday last week describes how The Economist is building what its VP of generative AI, Josh Munker, calls two versions of the web.

One version is the one we’re all familiar with: richly designed pages, feature photography, navigation, everything optimized for a human reader browsing with intent. The other version is quite different: stripped back, structured around questions and answers, designed not for you, but for an AI agent acting on your behalf.

Now, if that framing sounds familiar, it should. In episode 515 last week, we spent some time on what Google announced at its developer conference in May: that searching the web will increasingly be done by AI agents rather than by humans, and that people will focus on acting on the information those agents surface rather than clicking links themselves. I made the point then that the question for communicators was shifting from, “How do we get found?” to, “How do we become part of the information environment that AI systems draw from?”

What The Economist is doing is a direct practical answer to exactly that question. And here’s what makes this particularly interesting. The Economist itself published a piece last December describing this shift in precise terms: a move from a pull internet, where people initiate actions, to a push model, where agents act unprompted, setting up meetings, flagging research, handling tasks, often without a human ever typing a query. They wrote about it then as an emerging phenomenon. Now, six months later, their own team is operationally responding to it. They’re not just observers of this trend; they’re participants in it.

The logic behind their approach is straightforward. A growing share of people, particularly in B2B contexts, no longer start their discovery process with a search engine or a home page. They start with ChatGPT or Gemini or Claude. They ask a question, get a synthesized answer, and may never visit the original source at all.

For a publisher like The Economist, that creates an obvious problem. If your content isn’t structured in a way that an AI agent can parse and surface clearly, you effectively become invisible. Not because your content is poor, but because the intermediary can’t read it properly.

So The Economist is experimenting. Right now, the focus is on content that already sits outside the paywall: marketing copy, B2B sales material, the kinds of pages where you want a potential subscriber or corporate client to find you. They’re building parallel versions: the polished human-facing page alongside a clean, agent-readable equivalent. The aim is to show up accurately and usefully in AI-generated answers.

Now, why does this matter to communicators beyond the publishing world? Because what The Economist is describing isn’t a publishing problem. It’s a communication problem.

And it connects to something that one researcher quoted in The Economist’s December piece put plainly: Marketers and communicators may need to pitch not to people, but to agent attention. The audience increasingly will be algorithms, and the humans will act on what these algorithms surface.

Think about your own organization’s public-facing content: press releases, executive bios, policy statements, corporate FAQs, product and service descriptions. All of that content is increasingly being read and summarized by AI agents before it ever reaches a human. If that content isn’t structured to be understood accurately by an agent, you lose control of how your organization is represented in AI-generated answers. And unlike a Google snippet, you may not even know it’s happening.

Alessandro DeSantis, a media consultant quoted in the Digiday piece, puts it bluntly. He calls agent optimization a defensive baseline, not a competitive advantage, but the minimum requirement to remain visible at all.

There’s a deeper question sitting underneath all of this, which we’ll get into: Who do you trust in the AI-intermediated world? What does it mean for the communicator’s job when the first reader of your content isn’t a person at all?

Shel, you and I discussed the Google side of this in FIR 515. Here’s a publisher responding in real time. What’s your take?

Shel Holtz: I have lots of takes on this.

This is, I think, a big issue. The first thing I want to point out is that, as I read the commentary of people who are talking about this, there’s an expectation that in the not-too-distant future, the AI version is all that we’re going to need to publish because we’re going to be publishing for AI as people rely on AI to get their information. I find this a troubling idea.

I think people are ignoring the fact that right now, 25 to 60 percent, depending on the nature of the site, of visits to a website are direct. They are not coming from a search engine. It’s somebody who already knows the URL. As I mentioned in a post I published to LinkedIn last week, nobody going to Amazon starts at Google and says “online retail site” and waits for the URL to come up. They just type Amazon.com.

There are a lot of people who know the URLs. There are URLs published in magazine articles, in advertising, in TV commercials, for example. And then there is the dark web: I send you a link by email or in our Slack channel, and you click it. There’s no search involved at all, so there is no opportunity to see that AI overview.

So I think we have to keep in mind that there are still a lot of people who are coming to our websites, not through Google or some other search mechanism, or starting with Claude or ChatGPT or Gemini or what have you. They’re coming directly to your website, either because they know the URL or it has been shared with them by somebody else. So I think we do need to keep that in mind.

The other reason I think we need to maintain our own websites is because we own them, and we don’t own that intermediary. You publish that Markdown version of a web page and you provide the proper router to it. Was it called LLM text, I think? They’re calling this the robots.txt of the AI era. And it’s going to share with the person who’s making the query what it shares. It may not be exactly what is on your page. So now you’re down to using a third party.

Neville Hobson: Something like that.

Shel Holtz: So, yeah, it’s good to have at least as a statement of record what your original content was. I have some other thoughts about this, but I’ll let you react to that first.

Neville Hobson: Yeah, no, I get it totally. Yet the trend seems to be quite clear. This is the way it’s moving. And I would say that, from what I’ve been reading, not just this, but The Economist is actually a probably good signal for what other media properties may or may not be doing or might want to do, depending ...