Engineering brief

AI bills are rising because intelligence got cheaper, not more expensive

Theo - t3․gg4 min read · saves 14 min

At a glance

The brief is enough

Relevance
Practical value
Radar
Time horizon
Now
Warnings
None

Frontier token prices are up, but the cost to hit a fixed intelligence level has fallen about 20x. Bills grow because cheaper, better models get used more.

Budget and model choices should follow cost per completed task, not token price, or teams will misread rising AI spend.

Watch if you are choosing models for agentic workflows and need to defend rising AI spend to finance or leadership.

Summary

The headline. Frontier token prices rose with models like Astra and Fable, making Sam Altman's 10x cheaper promise look wrong. The host argues token price is the wrong lens. Artificial Analysis data shows the cost to hit a fixed intelligence level fell from roughly 60 cents per task in late 2022 to 2 cents by mid-2024, and from $15 in late 2024 to 16 cents a few months later.

The right metric. The gap between token price and real cost is large. Gemini 3.8 Flash costs $3.75 per million output tokens, less than half of GPT-5 and a tenth of Astra or Fable, yet its token appetite shrinks the advantage to under 3x. GLM 5.3 Flash, at 15 cents input and 50 cents output per million tokens, is a fraction of GPT-5's price and still beats it on many agentic workloads. Model selection needs tokens-per-task data, not price lists.

The Jevons paradox. Rising AI bills do not mean intelligence got more expensive; they mean cheaper capability got used much more. The Jevons paradox: cheaper steam power led to more coal consumption. Models now run for hours and land changes end to end. He says $1,500 a day in token spend is now possible, impossible with GPT-5 because the work could not be done. More spend can be healthy if output is real.

The trade-off. Cheap is not automatically good. Token-hungry models can cancel their price advantage, and the cost curve has sharp cliffs: around the 45 to 46 intelligence level, tasks cost 82 cents, while moving into the 50s costs $3.26, roughly three times more for a few benchmark points. Frontier models still matter when reliability and long-horizon agentic execution are critical. Teams need to map workloads to that curve before assuming a low-priced model is the value choice.

The weak evidence. The argument leans heavily on one benchmark index and the host's own usage, with a lengthy Railway sponsorship in the middle. Some claims are overstated, especially that GLM 5.3 Flash beats GPT-5 at almost everything. Enterprise workloads include compliance, legacy code, caching, and reliability needs that benchmarks do not capture. Still, the direction is credible: cost per completed task is falling fastest in small models with strong tool use.

The management shift. Engineering leaders should rewire AI cost conversations. Stop treating rising spend as an anomaly and start instrumenting cost per completed task, model routing, and usage governance. The useful conclusion is not "spend without limits." It is that the old 10x cheaper promise has been met for fixed intelligence levels, and the real budget question is whether additional token spend produces proportionally more shipped work.

My take

The metric shift is right, and it is the part worth taking to a budget review. Token price tells you nothing about whether a model is worth its cost, and the Artificial Analysis data makes that point hard to dispute. I'd be careful with the conclusion that all rising spend is healthy. A team can burn tokens on long agent loops without shipping more value, especially when evaluation is weak. The useful takeaway is not "spend more happily." It is: build cost-per-task observability, route models by workload, and then let usage grow where the value is proven. That is the difference between AI as a cost center and AI as a value driver.

What to do with this

  1. Instrument token spend per completed task or story across your top three AI workloads within the next sprint.
  2. Run a model routing pilot comparing a frontier model with a cheap agentic model like GLM 5.3 Flash on one real workflow.
  3. Ask your platform team for an AI cost report that separates price per token from cost per task and usage volume.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.