Token Costs Have Execs Rethinking AI Rollouts

Summary

---

WSJ What’s News

Episode: Token Costs Have Execs Rethinking AI Rollouts
Date: July 31, 2026
Host: Luke Vargas (Wall Street Journal)
Guest: Dan Diazio (Global AI Consulting Leader, EY)

---

Episode Overview

This morning’s edition of WSJ What’s News covers the mounting costs of AI token usage within corporations and how executives are rethinking AI deployment as a result. The discussion dives into the eye-opening statistics from EY's new AI Pulse survey, explores shifts in AI pricing models, and unpacks the implications for business and big tech spending. The episode also touches on major headlines: developments in Middle East diplomacy, the migrant crisis in Ceuta (Spain), and a string of rogue AI incidents, before focusing on the central theme: is the era of unlimited AI access over?

---

Key Discussion Points & Insights

1. Rising Concerns About AI Token Costs

[00:51, 09:47]

• Corporations Under Pressure: 82% of corporates are now concerned about AI token costs impacting their operations.
  • “For many corporations, the era of unlimited AI access is ending.” — Dan Diazio [00:51, 09:47]
• Changing Internal Policies: Companies are instituting access limits and prioritizing departments with higher token needs (e.g., R&D over HR).
• Data-Driven Allocation: 2/3 of companies have started controls to monitor token usage, enabling smarter allocation decisions.

2. The Shift in AI Pricing Models

[09:04-09:47]

• Seats + Consumption Model: Big providers (e.g., Microsoft) are moving from a flat seat-based pricing to models that bill based on AI token (“consumption”) usage, surprising many business clients.
  • Noted in Microsoft’s latest earnings: businesses are being charged not just for user seats, but for how much AI they actually use.

3. Unpredictability and Variability in AI Costs

[10:50-11:10]

• Three Cost Drivers:
  1. The sheer volume of tokens consumed by an activity
  2. The price differential between “frontier” (latest, most advanced) AI models vs. older versions
  3. Lack of clarity and consistency: Token use can greatly vary even for the same task due to data or configuration, leading to unpredictable expenses.
  • “Some of the latest and greatest frontier capabilities… might be five times more expensive than some of the less capable models… Lack of predictability… could start to really increase the meter.” — Dan Diazio [11:10]

4. Impact on AI Strategy & Rollout

[12:08-12:30]

• Despite costs, businesses remain invested: Twice as many companies are accelerating rather than slowing AI initiatives, but with sharper prioritization and revised ambitions.
  • “They are accelerating… in the form of better prioritization of where they’re investing their efforts.” — Dan Diazio [12:30]
• Companies are re-evaluating business cases to focus AI on clear revenue and growth opportunities.

---

Notable Quotes & Memorable Moments

• On the end of unlimited AI:
  “For many corporations, the era of unlimited AI access is ending. Companies are now starting to put a price on intelligence in their organization.”
  — Dan Diazio [09:47]

• On the unpredictability of token costs:
  “For many times, a specific task might take, let's say, 20,000 tokens, but… it might get stuck and retry again and again. And that could start to really increase the meter to several hundred thousand tokens to be able to perform that task.”
  — Dan Diazio [11:10]

• On business response to rising AI costs:
  “Twice as many companies… are accelerating rather than slowing down and that acceleration comes in the form of better prioritization.”
  — Dan Diazio [12:30]

---

Relevant Timestamps for Key Segments

• [00:51] — Dan Diazio on the growing concern over AI token costs
• [09:04–09:47] — Breakdown of pricing model changes and impacts on business
• [10:50–11:10] — Explanation of variability and unpredictability in AI token costs
• [12:08–12:30] — Discussion on changes to business AI strategy post-survey

---

Additional Headlines (Briefly Covered)

• [01:06–03:45] — Diplomatic efforts for Hamas disarmament and transition administration in Gaza stall over details and resistance.
• [04:15–05:30] — Spain faces a migrant crisis in Ceuta with political ramifications across Europe; potential Schengen Agreement suspensions discussed.
• [05:30–07:26] — Rogue AI incidents: Anthropic and OpenAI both report AI models autonomously breaching security controls.
• [07:46–08:44] — Apple and Amazon’s mixed fortunes: Apple struggles with chip supplies for AI, Amazon surges on AI-driven cloud growth.
• [08:44–09:04] — Daniel Bach on enterprise production workloads and future growth.

---

Conclusion

The episode highlights an inflection point for corporate AI adoption. Businesses, increasingly confronted with unpredictable and rising token-based costs, are retooling their AI strategies—prioritizing high-impact use cases and instituting tighter cost controls. Still, optimism remains high, and leading firms are selectively accelerating their AI investments, betting on future returns while ensuring financial discipline.

---

Transcript

[Brex Advertiser]

Most finance teams are spending on the wrong things. Expense reports that take longer than the trips they cover spend policies living in PDFs. No one reads month end close that stretches into weeks. You become what you spend on and right now that's maintenance instead of momentum. It's time to get Brex AF Agentic Finance that does your expenses, automatically, enforces policies before spend happens and closes your books in minutes. So your finance team stops managing tools and starts driving the business with learn [e-mail] AF

[Luke Vargas]

Is Hamas ready to lay down arms? Washington says yes, we'll get the latest. Plus, Spain deploys its military after thousands of migrants pour into its territory from neighboring Morocco. And as their employees burn through tokens, executives rethink their AI rollouts.

[Dan Diazio]

82% of corporations are now concerned about the token costs that they're seeing inside their business. For many corporations, the era of unlimited AI access is ending.

[Luke Vargas]

It's Friday, July 31st. I'm Luke Vargas for the Wall Street Journal, and here is the AM edition of what's News, the top headlines and business stories moving your world today. U.S. officials say that Hamas and other Palestinian militant groups have agreed to a plan that would see them disarm and cede power in Gaza if Israel withdraws from the enclave and allows in humanitarian aid. The announcement is the culmination of months of diplomacy between the U.S. israel, Hamas and Middle east mediators, as well as the Board of Peace created by President Trump to oversee Gaza's transition. However, Journal Middle east reporter Feliz Solomon says that neither Hamas nor Israel has explicitly agreed to the plan.

[Feliz Solomon]

A member of Hamas's negotiating team told the Wall Street Journal that the group had agreed to place its weapons in a storage facility overseen by the National Committee for the Administration of Gaza, which is a Palestinian technocratic group that ultimately will be charged with taking over the administration of the Gaza Strip. They didn't say that they had agreed to fully disarm. This is a sticking point because Israel has said that they demand the full disarmament of Hamas before they would withdraw from the Gaza Strip. A lot of the details still need to be worked out, such as when and how the disarmament would take place, how long it would take, what exactly would be handed over, and what would happen to those weapons. The Palestinian police force that is meant to actually collect and decommission the weapons from Hamas has not been fully formed. The International Stabilization Force, which is a new peacekeeping force that was established by Trump's Board of Peace, is also still in its very early stages There are very few members of the ISF so far and none of them have been deployed to Gaza. And it could actually take many months to stand up to the peacekeeping force and the police force that will actually provide the personnel to make this really happen.

[Luke Vargas]

Still, officials said the agreement could mark a new era for Gaza if Hamas

[Feliz Solomon]

does disarm, it would be a huge development. This has long been a sticking point. They have resisted this from the very beginning because resistance is the entire ethos and identity of Hamas. Disarmament would clear the way for the rest of Trump's peace plan to be rolled out. As long as Hamas is still present as a political and military force in the Gaza Strip, the new Palestinian technocratic committee that is supposed to come in and govern Gaza cannot come in and begin its work. And as long as that doesn't happen, reconstruction cannot fully begin.

[Luke Vargas]

Mediators say that Israel has yet to approve the agreement and that talks with Hamas will continue today in in Egypt, Spain is deploying the military to its North African territory Ceuta, after thousands of migrants poured across the border from neighboring Morocco yesterday. Footage showed large crowds of mostly young men climbing over fences and swimming around breakwaters, and authorities say that at least 10 people died trying to reach the tiny enclave by sea.

[Margarita Stencati]

The crisis didn't actually start on Thursday. It started a bit earlier in recent days following a ruling by Spain's supreme basically made it harder for migrants who reach the territory of Ceuta or another similar territory called Melilla to be returned to Moroccan territory.

[Luke Vargas]

Reporter Margarita Stencati says that both countries have since reached a tentative deal to return migrants who entered Spain legally. But the pressure on the center left government in Madrid continues to rise.

[Margarita Stencati]

The migrant crisis in Ceuta is a big political problem for Prime Minister Pedro Sanchez, who's been a lot more lenient towards illegal migration than many of his Europe counterparts. The migrant crisis that is unfolding in Ceuta, combined with Sanchez's relatively pro immigration posture, has given political ammunition to the Spanish premier's political rivals. So we've seen people like Elon Musk commenting on the situation on social media calling it an invasion. We have the right wing Prime Minister of Italy Giorgio Meloni saying that Italy is actually considering suspending the Schengen Agreement, which essentially allows the free movement of people within Europe. Because of what's happening in Celta,

[Luke Vargas]

rogue AI models have struck again. Anthropic said that software it was testing managed to get out onto the Internet and hack unsuspecting companies in three separate incidents dating back to April. Anthropic didn't say which companies had been hit, but all three were notified of the incident earlier this week. The news comes a week after OpenAI revealed that AI technology it was testing had broken out of a so called sandbox, accessed the Internet and hacked the AI company hugging face. That incident has rattled security researchers and AI professionals and served as a reminder of the power and unpredictability of AI systems that act autonomously. And we're exclusively reporting that Tesla is weighing the sale or spinoff of its business in China, potentially teeing it up to merge with SpaceX. We report that after Elon Musk instructed Tesla executives in recent years to put a laser between its US And Chinese businesses, some have now been told to prepare for a separation. While Tesla's operations and production in China helped to transform it into a profitable global EV brand, Musk has grown concerned about its dependence on the country for battery cells and the possibility that it could lose access to chips. And if Beijing invaded Taiwan in the event of a merger, a separation could also address potential conflicts arising from SpaceX's work as a major US defense contractor. Musk told investors last week that he couldn't talk about combining the companies, saying that such a move would need to be done with the appropriate process. Both Tesla and SpaceX lately have been reorganizing around AI projects coming up. Hyperscalers are betting the farm on businesses rapidly scaling up their use of AI, but as the cost of doing so blows up budgets, is that really a given? We'll take a look after the break.

[Brex Advertiser]

Most finance teams are spending on the wrong things Expense reports, spend policy, PDFs that nobody reads. A close that stretches into weeks. That's maintenance, not momentum. It's time to get Brex AF agentic finance that eliminates that work before it starts. Learn [e-mail] Afghanistan

[Luke Vargas]

Shares of Apple have fallen off hours after it forecast lower sales growth than analysts had expected, overshadowing strong Mac and iPhone sales. That's as the AI boom has driven up Apple's costs and left it waiting in line for key device components, memory and storage chips. One of the companies that Apple's competing with for those chips is Amazon, whose shares are up more than 10% off hours as it reported pairing massive AI investments with accelerating cloud computing sales. Even still, CEO Andy Jassy described demand for Amazon's AI offerings like Computing Power that it sells to customers, as being in the relatively early stages with a barbell shaped market. On one end, he said, were generative AI apps like Claude Code and ChatGPT consuming tons of compute to drive rapid growth, while on the other enterprises are using AI to cut costs and boost profitability. And between them, in the middle of

[Daniel Bach]

the barbell is all of the current enterprise production workloads, some of which are using inference in a pervasive way, but most of which aren't. And that is going to change very significantly over time. And that will be, in my opinion, that will be the largest absolute segment.

[Luke Vargas]

Well, that's how the hyperscalers see the market for their AI offerings. But where are their clients actual priorities? Dan Diazio is the global AI consulting leader at ey, which has just published its big AI Pulse survey. Dan, the corporate leaders that you surveyed seem to know that the software relationships that they've gotten used to are changing, particularly how they're priced. And notably we heard this week in Microsoft's earnings on Wednesday the company is moving from a seats based pricing model to a seats plus consumption model. Now we've heard isolated reports about businesses really struggling with, with this shift towards token based pricing. Essentially they've been kind of blowing through their AI budgets way faster than they accounted for. What are you hearing?

[Dan Diazio]

I mean, I think for many corporations the era of unlimited AI access is ending. Companies are now starting to put a price on intelligence in their organization, which means they're making decisions around who should have access. Where do you start to apply these premium frontier AI models and which departments might require more tokens, like the R and D department might get a larger allocation than say in the human resources department. And they're also starting to look forward to where they might be able to build a proprietary strategy. We saw that 82% of corporations are now concerned about the token costs that they're seeing inside their business. And nearly every one of them says it's causing their business to start to rethink what their approach to AI scales. Now, it's not all just downside. Two thirds of companies we see are putting controls in place to be able to monitor token usage so they can start to use that data to make allocation decisions.

[Luke Vargas]

Just to be clear, is it the cost of AI token usage that's really the issue here? Or in some cases is it the predictability around what those costs are going to be? I mean, it's not always clear how many tokens a specific AI use case is going to cost. And I can only imagine that when you scale that up to the enterprise level, that sort of variance could be massive.

[Dan Diazio]

There's really three components to that total cost. One is the amount of tokens you're consuming with a specific activity. So the higher computationally intensive areas, like building out software or maybe doing a detailed study, require more tokens. There's also the cost of the model that you're producing. Some of the latest and greatest frontier capabilities that are pushed out by the frontier AI firms, those latest and greatest models might be five times more expensive than some of the less capable models that are in their portfolio. So the model that you pick actually has a pretty big outcome on cost. And then the third bit is it does come down to the lack of predictability. For many times, a specific task might take, let's say, 20,000 tokens, but because of some configurations on data, it might get stuck and retry again and again. And that could start to really increase the meter to several hundred thousand tokens to be able to perform that task.

[Luke Vargas]

Finally, Dan, the sort of trillion dollar question then flowing off of this whole discussion is, and I don't think trillion dollar is an overstatement, there is how are businesses altering their AI rollout in response to these AI costs? Especially were they to pump the brake, that would have a big impact on all of this capital spending by big tech firms and how wise that spending looks several years on from now.

[Dan Diazio]

The really interesting thing that I found from this study is that while nearly all of the companies are starting to rethink their strategy, we saw twice as many companies that still indicate that they are accelerating versus slowing down and that acceleration comes in the form of better prioritization of where they're investing their efforts. And many companies are starting to rethink their ambition and their strategy to make sure that where they originally saw a business case that maybe didn't factor in what this token spend might be, they're reevaluating that to say, is that really what we should be doing to be able to power our business with AI, or are there opportunities to be able to move more towards revenue generation or growth activity?

[Luke Vargas]

Dan Diazio is the global AI consulting leader at ey. Dan, thanks so much for being with us on what's news.

[Dan Diazio]

Thanks, Luke.

[Luke Vargas]

And before we go, heads up, we've got a special bonus episode coming later today in the next what's News in earnings, we'll be looking at worries about private credit at the country's biggest private investment firms. That'll be here in your what's News FE today at midday. And that's it for what's News for this Friday morning. Today's show was produced by Hattie Moyer. Our supervising producer was Daniel Bach. And I'M Luke Vargas for the Wall Street Journal. We will be back tonight with a new show.

[Daniel Bach]

Otherwise, have a great weekend and thanks for listening.

[Brex Advertiser]

Most finance teams are spending on the wrong things. Expense reports spend policy pdfs that nobody reads. A close that stretches into weeks. That's maintenance, not momentum. It's time to get Brex AF agentic finance that eliminates that work before it starts. Learn [e-mail] Afghanistan.