Home › Blog › The Token Price Collapse
AI Compute Stack · Part 13 · Economics

The Token Price Collapse: Why AI Gets 10× Cheaper Every Year, and Who Pays for It

In November 2021 a GPT-3-level answer cost $60 per million tokens. Three years later the same capability cost six cents. Few products in history have cheapened this fast. Yet AI bills are rising, frontier prices are not falling, and the labs selling the tokens are fighting for margin. This guide untangles the three different "prices" of AI, where the savings come from, why cheaper tokens mean bigger bills, and who ends up paying.

FL
FrontierAGI Team
⚠️ How this was researched Everything here comes from web searches run up to 23 October 2026. The trend estimates come from Epoch AI, Andreessen Horowitz (a16z), Stanford's AI Index and an MIT FutureTech paper, mostly via their summaries. Current list prices come from price-aggregator sites and change often; check providers' own pages before relying on them. Token volumes and lab margins come from secondary reporting and conflict. The cost-per-task calculator uses illustrative token counts and success rates. See Reading the numbers.

From $60 to six cents

Andreessen Horowitz partner Guido Appenzeller picked a simple yardstick in November 2024: the cheapest model that scores 42 on the MMLU knowledge benchmark. When GPT-3 opened to the public in November 2021, it was the only model that could, at $60 per million tokens. Three years later the cheapest model to reach the same score, Meta's small Llama 3.2 3B served by Together.ai, cost $0.06: a thousand times less. He called it "LLMflation" and estimated that the cost of a given level of capability falls about 10× every year.

For comparison, Moore's law roughly doubled chip performance every two years. A tenfold fall in price every year is far faster. But the headline hides a twist: the price of the best models has not collapsed, and the amount people spend on AI keeps rising.

1,000×cheaper for GPT-3-level capability, Nov 2021 to Nov 2024 (a16z)
280×cheaper for GPT-3.5-level capability in two years (Stanford AI Index 2025)
9–900×per-year price decline range for fixed capability (Epoch AI)
13.8×jump in daily token use when OpenRouter discounted one model (Jevons in action)

Three different prices of AI

Most confusion comes from mixing up three numbers. Click each.

Price per token vs price of capability vs cost per task

How fast is it falling? Four estimates

Every serious study agrees the price of a fixed capability is falling fast; they disagree on how fast, because they pick different benchmarks, thresholds and time windows.

Annual price decline for fixed capability, by study

Log scale; × per year. Where a study gives a range, the bar shows the central or typical figure and the label shows the range. Stanford's figure is converted from 280× over about two years.

Two price stories: capability vs the frontier

Plot fixed-capability prices next to what the newest flagship costs and two stories appear. Old capabilities become nearly free; the frontier's price falls far more slowly and, in places, rises.

Price per million tokens, 2021 to 2026

Log scale. Fixed-capability lines join the two endpoints each study reports (the path between is not measured). Flagship points are OpenAI list input prices from secondary sources. Hover or tap a point.

Hover or tap a point for details.

The MIT paper's authors reportedly find that the price of running the very latest frontier models is rising, because models get bigger and reason for longer, even as yesterday's capability gets cheaper. Secondary coverage also reports OpenAI raising GPT-5.5's price. The token market is splitting in two: commodity intelligence heading toward zero, and frontier intelligence holding its price.

The October 2026 price ladder

List prices per million tokens span a factor of about 100 from the cheapest capable model to the most expensive flagship. Toggle input and output prices.

Selected API prices, US$ per million tokens

From price aggregators in October 2026; Gemini 4 Argon is an introductory price until 30 November 2026 ($4/$20 after). Check providers' pages for current prices.

Where the savings come from

No single breakthrough explains a tenfold yearly fall. Several independent improvements multiply together. Click a driver.

Six drivers of cheaper tokens

Figures are each source's own claims on its own models and hardware; they are not additive and cannot be compared directly. A 2026 paper, the "Inference Engineering Pareto Atlas", tries to put them on common axes.

💡 How they multiply Suppose hardware gives 2× a year, smaller models reaching the same quality give 2×, and serving software gives 1.5× plus competition trimming margins by another 1.5×. Multiply them and you get about 9× a year, close to the a16z estimate, without any single miracle. That illustrative arithmetic is ours, not a published decomposition.

Cheaper tokens, bigger bills

In 1865 the economist William Stanley Jevons noticed that more efficient steam engines made Britain burn more coal, not less, because cheaper energy opened new uses. AI tokens follow the same pattern.

Token volume is exploding

Secondary reports; Google's figures conflict between sources. Log scale.

Cost per task calculator

The number that matters to a business is not the price per token but the cost per successful task. A cheap model that fails half the time and needs retries can cost more than an expensive one that succeeds first time.

What does one task really cost?

Token counts per task and success rates are illustrative assumptions, anchored to the reported 5–30× token gap between chat and agent work. Prices are the October 2026 list prices above. Failed attempts are retried until success, and each failure also costs the review or rework time you set.

Illustrative: someone has to notice and fix a bad result

Who pays? The squeeze on the labs

Falling prices are great for buyers. For the companies selling tokens, they collide with rising compute bills. Reported gross margins vary with source and method:

Reported AI lab gross margins and targets

Secondary reporting (The Information and analyst estimates); methods differ, especially on whether free users' compute is included.

Those margins are far below the roughly 75% Nvidia earns selling the chips (see Custom Silicon vs Nvidia). The labs' response is the same everywhere: cheaper hardware of their own, more efficient models, and pricing that charges more for the frontier and for priority. Our AI Factory calculator found a gigawatt site needs roughly $2.83 per million tokens just to break even on a six-year payback, under its illustrative assumptions. Budget models listed at $0.10 to $0.50 per million input tokens only work because they are small and run on heavily used, depreciated or highly efficient hardware.

DeepSeek and the price war

China's AI price war began when DeepSeek released its V2 model in May 2024 at prices far below Western rivals. After its R1 reasoning model shook markets in January 2025, DeepSeek cut prices further: from February 2025 it offered R1 75% cheaper and V3 50% cheaper during an off-peak window (16:30 to 00:30 GMT, daytime in Europe and the US). It ended the off-peak discount on 5 September 2025 in favour of flat rates of about $0.56 per million input tokens and $1.68 for output; one report says it later added a peak-hour surcharge in Beijing business hours. Its V4.1 Flash model, with open weights, lists at about $0.30 / $1.20 on OpenRouter.

Open weights matter as much as list prices: once a capable model is downloadable, dozens of hosting companies compete to serve it, pushing its price toward the cost of the hardware. MIT's analysis counts open-model competition as one of the main reasons fixed-capability prices fall.

Price tiers and discounts: a maturing market

MechanismHow it worksExample
Model tiersThe same lab sells small, mid and frontier models at very different pricesGPT-6 Luna $0.10 vs GPT-6 Astra $10 per million input tokens
Batch processingAccept a delay (hours) and pay lessClaude Sonnet 5.5 batch: 50% off
Cached inputRe-used prompt prefixes are billed far cheaperCached input at a tenth to a twentieth of the normal input price (e.g. Sonnet 5.5 $0.20 vs $2; GPT-6.1 Sol $0.10 vs $2)
Long-context surchargeVery long prompts cost more per tokenGPT-6.1 Sol prompts over 272K tokens: $4 / $15 instead of $2 / $10
Time of dayCheaper when data centers are idle, dearer at peakDeepSeek's off-peak discount (2025) and reported peak surcharge
Introductory pricingLaunch discounts to win shareGemini 4 Argon $2 / $10 until 30 November 2026, then $4 / $20

These are the tools of mature utilities and airlines: charge by urgency, time and quality of service. Their spread across AI pricing in 2025 and 2026 is a sign tokens are becoming a commodity priced like electricity.

What it means

🛠️ For builders

Design for the price of next year, not today: a feature too expensive now may cost a tenth in 12 months. Measure cost per successful task, route easy work to cheap models and hard work to frontier ones, and use batch and cache discounts.

💼 For buyers

Expect per-token prices to fall and total bills to rise as agents and reasoning spread. Budget by task volume, and watch hidden thinking tokens.

📈 For investors

Commodity inference is a margin squeeze; profits accrue to those with the cheapest hardware (custom chips, efficient AI factories), the best frontier models, or distribution. Watch lab gross margins against their 70% targets.

Reading the numbers: where sources disagree

ClaimWhat the sources say
"Prices fall 10× a year"a16z's 2021–2024 estimate. Epoch: 9–900× (median 50×, 200× using 2024+ data); MIT: 5–10× for frontier-level capability; a later Epoch estimate (secondhand): ~13×.
Frontier prices "rising 3–18× a year"Attributed to the MIT paper's updated abstract by one summary; we could not confirm it in the abstract itself.
OpenAI's historic list pricesFrom secondary pricing pages; GPT-4 ($30/$60), GPT-4 Turbo ($10/$30), GPT-4o ($5/$15, then $2.50/$10), GPT-5 ($1.25/$10).
Google's monthly tokens480 trillion (May 2025) to ~3.2 quadrillion (May 2026) in one series; another source gives 1.3 quadrillion. Check Google's own figures.
OpenRouter volume~4.5 quadrillion tokens annual run rate (Aug 2026), doubling every 11 weeks, per secondary reporting.
Lab gross marginsOpenAI: ~40% (2024) to ~33% (early 2026) in one analysis vs a ~46% company projection for 2025. Anthropic: 2025 forecast cut to ~40% (~38% including free users).
Driver speed-ups (quantization 4–6×, batching 3–10×, speculative decoding 2–3×)Practitioner and vendor claims on specific setups; not additive.
Price elasticity "10% cheaper → 12–18% more use"Cited in one summary; original report not found. Not used.
Calculator inputsToken counts and success rates are our illustrative assumptions.

🔗 References and papers

🧭 Closing

🎯 The bottom line The price of any given level of AI capability is collapsing, by roughly 5× to 50× a year depending on how you measure, thanks to better chips, smaller and smarter models, serving tricks and fierce competition. But the price of the frontier is not collapsing, agents and reasoning multiply the tokens each task needs, and cheaper tokens unleash far more demand. The result is the paradox of 2026: tokens are cheaper than ever and AI bills are bigger than ever, while the labs selling them earn thinner margins than the chipmakers supplying them. Judge AI by cost per successful task, and plan for next year's prices.