Corerope

Part 7

The Amdahl trap and the two-tier fleet

The design / Part 7

If a share f of tasks still runs at baseline cost, the gain can never exceed 1/f. A cheap tier that handles 95% of tasks while the hard 5% go to frontier GPUs is a 20x system, however cheap the 95% is. For 1000x the GPU share must stay near 0.05%, so the hard tasks need a wired home of their own.

Every task stays on wired silicon: a 1% GPU fallback caps the gain at 92x

The two-tier fleet. A router sends each task to the small wired core; only what it cannot do climbs to a larger wired core, and almost nothing reaches GPUs.

Cost model, central case: a GPU fallback share of 0% gives 1,196x less energy per task; 0.1% gives 545x, 1% gives 92x and 5% gives 20x.

Tier B is the same design scaled up: a ~60B-weight wired core on wafer-scale or multi-die silicon, sharing the memory tier, at about 5x Tier A's cost per token. With 5% of tasks escalated, the blended fleet costs 1.2x Tier A alone. GPUs stay only as the safety valve for a disabled core generation. The open risk is the hard-task share: if more than ~10% of frontier tasks exceed what Tier A can do, Tier B grows and the central estimate falls.

Every task that falls back to GPUs pulls the gain toward 1/share

The cost model's central case, run at each GPU fallback share. A share f at baseline cost caps the gain per task at 1/f, however cheap the rest becomes.

  • Energy per task
  • Dollars per task, $3M NRE (via fabric)
  • Dollars per task, $40M NRE (new chip)
  • Ceiling: 1 / share

With no fallback at all: 1,196x less energy, 303x lower cost with a $3M per-model NRE, and 98x with $40M.

Show the numbers
Gain per task by GPU fallback share
Share on GPUsEnergy per taskDollars, $3M NREDollars, $40M NRE (as recorded)
0%1,196x303x98x
0.05%749x263x94x
0.1%545x233x89x
1%92x75x50x
5%20x19x17x

The experiment that would falsify it

Experiment 2

Hard-task share: run a frontier agentic and reasoning suite through 8 to 15B models with retrieval, then 60B models

Tests
The Amdahl section's 5% and 0.05% shares
Pass bar
Tier A solves at least 90%; fewer than 0.1% need more than Tier B
If it fails
The two-tier fleet caps at ~20 to 50x; redesign Tier B larger