GGoldwater.dev
All articles
Cost & Reliability6 min read·

The Token Bill Is the New Cloud Bill

Consumption-priced coding agents have no natural ceiling, and the variance is what kills budgets. A FinOps-from-day-one playbook so the token bill doesn't ambush you the way the cloud bill once did.

Earlier this year, one of Microsoft's own product divisions reportedly canceled most of its internal Claude Code licenses — not because the tool didn't work, but because token consumption blew through the division's annual AI budget months ahead of schedule. Sit with that for a second. A company with effectively unlimited engineering sophistication got surprised by an AI bill.

If it can happen there, it can happen to you. And in my experience, it's already happening quietly at a lot of mid-size engineering orgs — it just hasn't hit the CFO's radar yet.

We've seen this movie before

Fifteen years ago, teams moved to the cloud with a data-center mindset. They provisioned like servers were still capital expenses, nobody owned the bill, and three years later an entire discipline — FinOps — had to be invented to claw back control.

Coding agents are replaying that transition at 10x speed. Claude Code bills by token consumption. Devin bills in "ACUs" — Cognition's unit for roughly 15 minutes of autonomous agent work, running about two dollars each on team plans. Every serious agent product is converging on the same model: you pay for compute the agent consumes, not for the human who has a seat.

That's a fundamentally different cost structure from the SaaS your procurement team knows how to buy. A seat license has a known ceiling. An agent that can spawn subtasks, retry failures, and run for hours has no natural ceiling at all. The unit economics are fine — the variance is what kills budgets.

Why agent spend spikes differently

Three patterns I've watched produce ugly invoices:

The retry loop. An agent hits a flaky test or a misconfigured environment and grinds on it, burning tokens on every attempt. A human gives up and asks for help after twenty minutes. An agent will happily spend forty dollars re-reading your codebase overnight.

The enthusiasm curve. Rollouts don't ramp linearly. Usage is flat for three weeks while people are skeptical, then one team has a breakthrough, word spreads, and consumption goes vertical in week six. If your budget assumed the week-three run rate, you're now explaining a 5x overage.

The scope creep of delegation. Once engineers trust an agent with small tasks, they hand it bigger ones. Bigger tasks mean longer autonomous runs, more context loaded, more tool calls. Cost per task grows faster than task count.

None of these are arguments against coding agents. Delegating toil to agents is one of the highest-leverage moves available to an engineering org right now. They're arguments for treating agent spend the way you (eventually, painfully) learned to treat cloud spend.

The playbook: FinOps from day one

Here's what I'd put in place before scaling any consumption-priced agent past a pilot team:

Tag everything at the source. Every agent invocation should carry team, project, and ideally task-type metadata. Anthropic's Compliance API and equivalent admin tooling exist for exactly this. If you can't answer "which team spent what on which kind of work," you can't manage anything downstream.

Set budgets with alerts, not caps — at first. Hard caps during a rollout teach people the tool is unreliable ("it just stopped working mid-task"). Soft budgets with alerts at 50/80/100% teach you what real usage looks like. Convert to caps only after you have three months of data.

Publish cost-per-outcome, not cost-per-token. Raw spend numbers scare finance and mean nothing to engineers. "$14 per merged PR, down from $19 last month" is a number both audiences can reason about. It also surfaces the retry-loop problem fast: a team whose cost-per-merge doubles has agents spinning, not shipping.

Make one person own the bill. Not a committee. The same way a FinOps lead owns cloud spend, someone — usually a platform or DevEx lead — should own agent spend, review the weekly trend, and have authority to intervene.

Model the enthusiasm curve into your budget. Whatever your pilot's monthly run rate is, budget 4–6x that for the quarter after general rollout. If you come in under, great. If you'd budgeted flat, you'd be having the Microsoft conversation.

The uncomfortable trade-off

There's a temptation to respond to all this by locking things down: strict caps, approval workflows for agent runs, limited rollout. I think that's the bigger mistake. The orgs getting real value from coding agents are the ones where engineers use them freely on the boring 40% of their work. Throttle that and you've paid for a tool nobody trusts.

The discipline isn't about spending less. It's about spending legibly — knowing what you're buying, per team, per outcome, so that when the bill triples, you can tell whether that's a problem or a sign the thing is finally working.

Takeaway

Consumption-priced agents are coming to your org whether you plan for it or not. Instrument spend before you scale, budget for the enthusiasm curve, assign a single owner, and measure cost per outcome instead of cost per token. The token bill is the new cloud bill — and this time, you get to skip the three expensive years it took us to learn that lesson the first time.

WG

Wes Goldwater

Director of Engineering at Prosigliere · writing the no-hype playbook for cloud & AI.

Keep reading