The baseline
Two baselines and one metric: dollars and joules per solved task
Built fromresearch/01-report-path-to-1000x.md (edit)
The "1000x" claim only means something once the baseline, the unit and the quality bar are fixed. This report measures dollars and joules per solved task at a fixed quality level on a fixed task suite, holding constant a per-user speed target (interactivity), a context-length distribution, and a power boundary that includes prefill GPUs, decode GPUs and idle power. Per-token figures mislead in both directions. At near-identical Artificial Analysis Intelligence Index v5 scores, Claude Opus 5.5 (max) emits ~119k output tokens per task while GPT-6 Astra emits ~27k, a 4.4x gap, and Opus 5.5's 20% per-token price cut was fully eaten by 1.6x more tokens than Opus 5 (Artificial Analysis). Small reasoning models behave the same way: Qwen3.5-9B used ~260M output tokens to run the index against 86M for Qwen3.5-397B (Artificial Analysis). Interactivity matters just as much. On one vendor's hardware, derived energy per token ranges from ~0.36 J (GPT-OSS-120B on B200) to ~10 to 14 J (DeepSeek-R1-class at 300 to 350 tok/s/user on Rubin), a ~40x spread as large as a hardware generation (SemiAnalysis; Silicon Report). Power accounting is not even consistent across sources, since InferenceX counts decode-GPU watts only while CoreWeave's Rubin figures count prefill and decode (SemiAnalysis).
Source: research/01-report-path-to-1000x.md, line 7Edit on GitHub
At near-equal scores, output per task differs 4.4x
Output tokens per task on the Artificial Analysis Intelligence Index v5 (October 2026, max effort). A cheaper token buys nothing if a model spends more of them.
The index's median output per task rose from ~35k (v4.3) to ~59k tokens (v5) in one revision.
Show the numbers
| Model | Output tokens per task | Index v5 score |
|---|---|---|
| Claude Opus 5.5 (max) | ~119k | 58 |
| Claude Fable 5.1 | ~78k | not given |
| Claude Opus 5 | ~73k | not given |
| GPT-6 Astra (max) | ~27k | 57 |
Baseline B2024 is a Llama-3.1-405B-class dense transformer in BF16 on H100s with 2024 serving software (continuous batching, no speculation), measured on a decode-heavy agentic and reasoning mix with ~64K mean context. The following arithmetic is derived from the public model configuration and is approximate. BF16 weights occupy ~810 GB, which does not fit on one 8-GPU node, so the baseline needs two nodes (16 GPUs, 1,280 GB of HBM). With 126 layers and 8 KV heads of dimension 128, the BF16 KV cache is ~0.5 MB per token, or ~34 GB per 64K-token sequence, so only ~13 to 14 such sequences fit beside the weights. Each generated token therefore moves ~92 GB from HBM (weights amortized over the batch plus that sequence's entire KV). At measured H100 coefficients of 11.68 pJ per HBM bit and 0.52 pJ per tensor-core FLOP (arXiv 2607.26571), that is roughly 8.6 J of data movement plus ~0.7 J of arithmetic per token: more than 90% of the energy goes to moving bytes, before counting static power. No clean market price exists for this baseline, since Artificial Analysis no longer tracks any provider for Llama 3.1 405B (Artificial Analysis). It has to be rebuilt on rented hardware, which is Epoch's method and lands within 30% of API prices (Epoch AI).
Source: research/01-report-path-to-1000x.md, line 9Edit on GitHub
Over 90% of a 2024 token's energy is moving bytes, not doing math
One generated token of the B2024 baseline (Llama-3.1-405B-class, BF16, 16 H100s, 64K context), at H100's measured 11.68 pJ per HBM bit and 0.52 pJ per tensor-core FLOP.
- Weight reads (shared by the batch) 5.4 J
- KV-cache reads (this sequence's own) 3.2 J
- Arithmetic 0.7 J
Derived, not measured: each token reads ~92.1 GB from HBM (its batch's share of the weights plus its own 33.8 GB of KV cache, with ~13.9 sequences fitting beside the weights). Static power is not counted.
Show the numbers
| Term | Joules | Share |
|---|---|---|
| Weight reads (shared by the batch) | 5.45 | 58.5% |
| KV-cache reads (this sequence's own) | 3.16 | 34% |
| Arithmetic | 0.7 | 7.52% |
| Total | 9.31 | 100% |
Baseline B2026 is DeepSeek-V4-Pro-class serving at late-2026 frontier quality. The model has 1.6T total and 49B active parameters, FP4 routed experts, FP8 KV, CSA/HCA compressed attention and multi-token prediction (HF DeepSeek-V4), and it runs on GB300 NVL72 racks with Dynamo or SGLang disaggregated wide-expert-parallel serving. InferenceX measures V4-Pro at $0.12 per million output tokens at 27 tok/s/user on GB300 (Silicon Report). On quality, open trillion-parameter MoEs (Kimi K2.6, MiMo V2.5 Pro, DeepSeek V4 Pro) scored 52 to 54 on the April 2026 index against 57 to 60 for the top proprietary models, at "between half to one-sixth of the price" (Artificial Analysis). B2024 is the baseline the question proposes; B2026 is the one that tests whether a program does anything the market will not.
Source: research/01-report-path-to-1000x.md, line 11Edit on GitHub
What the market trend already delivers#
| Estimate | Rate at constant capability | Window and scope | Source type |
|---|---|---|---|
| Epoch, "Plunging price of thought" (Sep 2026) | ~47% per quarter, ~13x/yr (math 16-19x, games 7-10x) | 2023 to 2026, five benchmarks | Independent analyst |
| Epoch, same report, at SOTA | ~75x/yr when a level first becomes SOTA, slowing to ~4.7x/yr two years later | Same | Independent analyst |
| Gundlach et al., "Price of Progress" (Nov 2025) | Frontier 5-10x/yr; GPQA Pareto 5.32x; open-weight 4.60x; ~3x/yr algorithmic after removing hardware | Apr 2024 to late 2025 | Academic (MIT/Epoch data) |
| a16z "LLMflation" (Nov 2024) | ~10x/yr; 1000x in 3 years at MMLU ≥42 | 2021 to 2024 | Investor analysis |
| Densing law (Tsinghua) | Capability per parameter doubles every ~3.3-3.5 months | Feb 2023 to Apr 2025, open base models | Academic |
Sources: Epoch AI, arXiv 2511.23455, a16z, arXiv 2412.04315.
Mid-2024 to November 2026 is about 2.4 years, so the headline trend implies ~250x to ~470x at constant capability, while the most conservative figure (open-weight Pareto at 4.6x/yr) implies only ~40x. The best-documented single case is ~75% on GPQA Diamond, which cost ~$0.30 per question with o3 in January 2025 and $0.0004 with GPT-5.6 Luna, a ~725x drop in under 18 months (Epoch AI). Three caveats matter for planning. These are prices, not costs, so margin compression inflates the headline, which is why Gundlach's hardware-adjusted algorithmic component is only ~3x/yr. Epoch also warns that distilled models score disproportionately well on benchmarks and seem more brittle, and that the decline may slow once models become too small for strong agentic work (Epoch AI). Finally, the trend is the industry adopting the same levers this report analyzes, so a program cannot count the trend and its own levers as separate multipliers.
Source: research/01-report-path-to-1000x.md, lines 13 to 25Edit on GitHub
The market trend alone gives 14x to 471x from mid-2024 to November 2026
Each published rate of price decline at constant capability, compounded over the 2.4 years since mid-2024. Against 2024, much of 1000x is what the market already does.
Derived: rate to the power of the years, as the survey computes it. These are prices, not costs, so margin compression inflates the headline.
Show the numbers
| Estimate | Per year | By November 2026 | Years to 1000x |
|---|---|---|---|
| Epoch, constant capability | 13x | 471x | 2.7 |
| a16z, LLMflation | 10x | 251x | 3.0 |
| Open-weight Pareto (Gundlach) | 4.6x | 39x | 4.5 |
| Algorithmic only, hardware removed (Gundlach) | 3x | 14x | 6.3 |