Corerope

The baseline

Two baselines and one metric: dollars and joules per solved task

Whether "1000x cheaper" is achievable depends mostly on which year's frontier serves as the baseline.

The "1000x" claim only means something once the baseline, the unit and the quality bar are fixed. This report measures dollars and joules per solved task at a fixed quality level on a fixed task suite, holding constant a per-user speed target (interactivity), a context-length distribution, and a power boundary that includes prefill GPUs, decode GPUs and idle power. Per-token figures mislead in both directions. At near-identical Artificial Analysis Intelligence Index v5 scores, Claude Opus 5.5 (max) emits ~119k output tokens per task while GPT-6 Astra emits ~27k, a 4.4x gap, and Opus 5.5's 20% per-token price cut was fully eaten by 1.6x more tokens than Opus 5 (Artificial Analysis). Small reasoning models behave the same way: Qwen3.5-9B used ~260M output tokens to run the index against 86M for Qwen3.5-397B (Artificial Analysis). Interactivity matters just as much. On one vendor's hardware, derived energy per token ranges from ~0.36 J (GPT-OSS-120B on B200) to ~10 to 14 J (DeepSeek-R1-class at 300 to 350 tok/s/user on Rubin), a ~40x spread as large as a hardware generation (SemiAnalysis; Silicon Report). Power accounting is not even consistent across sources, since InferenceX counts decode-GPU watts only while CoreWeave's Rubin figures count prefill and decode (SemiAnalysis).

At near-equal scores, output per task differs 4.4x

Output tokens per task on the Artificial Analysis Intelligence Index v5 (October 2026, max effort). A cheaper token buys nothing if a model spends more of them.

Claude Opus 5.5 (max)Index score 58
~119k
Claude Fable 5.1
~78k
Claude Opus 5
~73k
GPT-6 Astra (max)Index score 57
~27k

The index's median output per task rose from ~35k (v4.3) to ~59k tokens (v5) in one revision.

Show the numbers
Output tokens per task
ModelOutput tokens per taskIndex v5 score
Claude Opus 5.5 (max)~119k58
Claude Fable 5.1~78knot given
Claude Opus 5~73knot given
GPT-6 Astra (max)~27k57

Baseline B2024 is a Llama-3.1-405B-class dense transformer in BF16 on H100s with 2024 serving software (continuous batching, no speculation), measured on a decode-heavy agentic and reasoning mix with ~64K mean context. The following arithmetic is derived from the public model configuration and is approximate. BF16 weights occupy ~810 GB, which does not fit on one 8-GPU node, so the baseline needs two nodes (16 GPUs, 1,280 GB of HBM). With 126 layers and 8 KV heads of dimension 128, the BF16 KV cache is ~0.5 MB per token, or ~34 GB per 64K-token sequence, so only ~13 to 14 such sequences fit beside the weights. Each generated token therefore moves ~92 GB from HBM (weights amortized over the batch plus that sequence's entire KV). At measured H100 coefficients of 11.68 pJ per HBM bit and 0.52 pJ per tensor-core FLOP (arXiv 2607.26571), that is roughly 8.6 J of data movement plus ~0.7 J of arithmetic per token: more than 90% of the energy goes to moving bytes, before counting static power. No clean market price exists for this baseline, since Artificial Analysis no longer tracks any provider for Llama 3.1 405B (Artificial Analysis). It has to be rebuilt on rented hardware, which is Epoch's method and lands within 30% of API prices (Epoch AI).

Over 90% of a 2024 token's energy is moving bytes, not doing math

One generated token of the B2024 baseline (Llama-3.1-405B-class, BF16, 16 H100s, 64K context), at H100's measured 11.68 pJ per HBM bit and 0.52 pJ per tensor-core FLOP.

One B2024 token~9.3 J
  • Weight reads (shared by the batch) 5.4 J
  • KV-cache reads (this sequence's own) 3.2 J
  • Arithmetic 0.7 J

Derived, not measured: each token reads ~92.1 GB from HBM (its batch's share of the weights plus its own 33.8 GB of KV cache, with ~13.9 sequences fitting beside the weights). Static power is not counted.

Show the numbers
Energy of one B2024 token
TermJoulesShare
Weight reads (shared by the batch)5.4558.5%
KV-cache reads (this sequence's own)3.1634%
Arithmetic0.77.52%
Total9.31100%

Baseline B2026 is DeepSeek-V4-Pro-class serving at late-2026 frontier quality. The model has 1.6T total and 49B active parameters, FP4 routed experts, FP8 KV, CSA/HCA compressed attention and multi-token prediction (HF DeepSeek-V4), and it runs on GB300 NVL72 racks with Dynamo or SGLang disaggregated wide-expert-parallel serving. InferenceX measures V4-Pro at $0.12 per million output tokens at 27 tok/s/user on GB300 (Silicon Report). On quality, open trillion-parameter MoEs (Kimi K2.6, MiMo V2.5 Pro, DeepSeek V4 Pro) scored 52 to 54 on the April 2026 index against 57 to 60 for the top proprietary models, at "between half to one-sixth of the price" (Artificial Analysis). B2024 is the baseline the question proposes; B2026 is the one that tests whether a program does anything the market will not.

What the market trend already delivers#

EstimateRate at constant capabilityWindow and scopeSource type
Epoch, "Plunging price of thought" (Sep 2026)~47% per quarter, ~13x/yr (math 16-19x, games 7-10x)2023 to 2026, five benchmarksIndependent analyst
Epoch, same report, at SOTA~75x/yr when a level first becomes SOTA, slowing to ~4.7x/yr two years laterSameIndependent analyst
Gundlach et al., "Price of Progress" (Nov 2025)Frontier 5-10x/yr; GPQA Pareto 5.32x; open-weight 4.60x; ~3x/yr algorithmic after removing hardwareApr 2024 to late 2025Academic (MIT/Epoch data)
a16z "LLMflation" (Nov 2024)~10x/yr; 1000x in 3 years at MMLU ≥422021 to 2024Investor analysis
Densing law (Tsinghua)Capability per parameter doubles every ~3.3-3.5 monthsFeb 2023 to Apr 2025, open base modelsAcademic

Sources: Epoch AI, arXiv 2511.23455, a16z, arXiv 2412.04315.

Mid-2024 to November 2026 is about 2.4 years, so the headline trend implies ~250x to ~470x at constant capability, while the most conservative figure (open-weight Pareto at 4.6x/yr) implies only ~40x. The best-documented single case is ~75% on GPQA Diamond, which cost ~$0.30 per question with o3 in January 2025 and $0.0004 with GPT-5.6 Luna, a ~725x drop in under 18 months (Epoch AI). Three caveats matter for planning. These are prices, not costs, so margin compression inflates the headline, which is why Gundlach's hardware-adjusted algorithmic component is only ~3x/yr. Epoch also warns that distilled models score disproportionately well on benchmarks and seem more brittle, and that the decline may slow once models become too small for strong agentic work (Epoch AI). Finally, the trend is the industry adopting the same levers this report analyzes, so a program cannot count the trend and its own levers as separate multipliers.

The market trend alone gives 14x to 471x from mid-2024 to November 2026

Each published rate of price decline at constant capability, compounded over the 2.4 years since mid-2024. Against 2024, much of 1000x is what the market already does.

Epoch, constant capability13x per year; 1000x in 2.7 years
a16z, LLMflation10x per year; 1000x in 3.0 years
Open-weight Pareto (Gundlach)4.6x per year; 1000x in 4.5 years
Algorithmic only, hardware removed (Gundlach)3x per year; 1000x in 6.3 years
Times cheaper at constant capability by November 2026 (log scale)

Derived: rate to the power of the years, as the survey computes it. These are prices, not costs, so margin compression inflates the headline.

Show the numbers
Market trend estimates
EstimatePer yearBy November 2026Years to 1000x
Epoch, constant capability13x471x2.7
a16z, LLMflation10x251x3.0
Open-weight Pareto (Gundlach)4.6x39x4.5
Algorithmic only, hardware removed (Gundlach)3x14x6.3