The Agent Cost Explosion: Your P&L Models Are Wrong by an Order of Magnitude
The Paradox No One Modeled
Start with the number that was supposed to settle the cost question. Token prices fell 100x in three years, from $60 to $0.60 per million. Enterprise AI spend went up anyway. The reason is architectural. Agents re-read context, spawn sub-agents, verify their own outputs, and retry failed attempts, and that pattern consumes 60-140x more tokens per task than a simple query. This is not a temporary inefficiency. It is how autonomous agents work. Every cost model built on per-token pricing is measuring the wrong thing.
Token prices fell while per-task consumption rose. Cheaper tokens did not lower the bills.
What the Bills Show
Uber spent its entire 2026 AI budget by April, four months into the fiscal year. A four-person startup is carrying $113K monthly AI bills. Tesla, a company with serious AI infrastructure of its own, is capping employee AI spend at $200/week, with a carve-out for Grok that tells you something about internal product politics. At the AI Engineer World's Fair, 76% of teams said cost constraints were limiting their ambitions.
The market is pricing this. Salesforce took Agentforce to $1.2B ARR, its fastest-growing product ever, and hit a 52-week stock low in the same stretch. AI revenue growth at seat-based incumbents doesn't translate to durable value when cost structures are unsustainable. That is the market's read, and it is not obviously wrong.
Why This Gets Worse Before It Gets Better
The skeptic will say the 60-140x multiplier is an artifact of immature engineering that the next model generation optimizes away. The skeptic is half right. Some of it will come down. But the multiplier is not a bug. Agents re-read context windows, spawn sub-agents, verify their own work, and retry what fails, and each degree of added autonomy piles on more of that overhead. With GPT-5.6 Sol now operating 270+ hours unsupervised, consumption rises faster than the task count does. A roadmap that models today's consumption without modeling that ramp is planning for the wrong bill.
The New Unit Economics
| Metric | Old Model | Agent Reality |
|---|---|---|
| Cost unit | Per token / per seat | Per completed task |
| Budget predictability | Linear with users | Exponential with complexity |
| Optimization lever | Prompt engineering | Routing + caching + distillation |
| Who owns it | Engineering team | C-suite / CFO |
The Strategic Response
The firms holding margin are doing three things. They route work by difficulty, sending simple tasks to cheap models and reserving the frontier for the hard ones through intelligent model routing. They lean on aggressive caching and distillation. And they move to outcome-based pricing that hands cost variability back to the customer. Meta has conceded agents are progressing slower than expected, which buys some time. The tradeoff is whether that time goes into cost-aware architecture now or into discovering the ramp later, when today's bills look small.
What to do
Commission a full AI consumption audit projecting agent-scale costs (60-140x multiplier) against your 12-month roadmap — present to CFO within 30 days
Implement intelligent model routing this quarter — route 70%+ of inference to cheapest-adequate model tier
Redesign at least one product line's pricing from per-seat to outcome-based by Q1 2027
Establish a cost-per-completed-task dashboard as a board-level metric alongside revenue metrics