Cheaper tokens get spent: median output per task rose from ~35k to ~59k tokens in a single Artificial Analysis index revision. Without a counterweight, the core's savings would be absorbed by longer reasoning. The cost model needs only a modest net gain here, 1.5x fewer tokens per task: roughly 4x from the three mechanisms below, minus ~2.7x because a small core tends to think longer.
At near-equal scores, output per task differs 4.4x
Output tokens per task on the Artificial Analysis Intelligence Index v5 (October 2026, max effort). A cheaper token buys nothing if a model spends more of them.
Claude Opus 5.5 (max)Index score 58
~119k
Claude Fable 5.1
~78k
Claude Opus 5
~73k
GPT-6 Astra (max)Index score 57
~27k
025k50k75k100k125k
The index's median output per task rose from ~35k (v4.3) to ~59k tokens (v5) in one revision.
Joule-priced reinforcement learning. The reward is correctness minus a price on each trajectory's energy, computed from the chip's own cost model rather than from a token count. The model learns which steps are expensive on this silicon (deep-core escalations, memory misses, long contexts), not just to write less. Length-only methods already show the room: AdaptThink cut response length 53% while gaining 2.4 points, and ThinkPrune halved length for ~2 points.
Compiled skills. When the fleet solves the same sub-procedure many times (a parsing routine, an API workflow, a unit conversion), it is distilled into verified code or an adapter that later tasks call for nearly zero tokens. Agent sessions reuse 85 to 99% of their context across turns, which suggests heavy repetition, but the share of reasoning a skill library can absorb is unmeasured. Skills would be built only from opted-in or synthetic traces and scoped per tenant.
Grounded latent reasoning. The core reasons for a few steps in continuous vectors, then must write a short text checkpoint of what it concluded. A 2026 latent-reasoning method cut 58% of tokens for 2.8 points. The required checkpoints keep reasoning readable for oversight; dropping them would save more tokens but make the model's thinking harder to monitor, a trade this design refuses.
If these fail and the small core needs 1.5x more tokens than the baseline (the pessimistic case), the energy gain per task falls by a further 2.25x relative to the central case.