Corerope

Invention 1

Split mind, a small reasoning core and a vast lookup memory

The design / Invention 1

The split mind stores knowledge in a lookup memory of tens of trillions of parameters and keeps only reasoning in a ~12B-weight core. Per-token compute then scales with how hard the thinking is, not with how much the model knows. Today a frontier MoE fires ~49B weights per token largely because facts and skills share the same matrices.

The prior art proves the primitive. DeepSeek's Engram (January 2026) adds O(1) hashed N-gram lookups beside MoE layers and offloads a 100B-parameter table to host DRAM with under 3% throughput loss (Engram paper; Introl summary). Meta's memory layers outperform models using more than twice the compute on factual tasks (Memory Layers at Scale).

The new step is the objective. Engram found a U-shaped law: at fixed total parameters and training FLOPs, about 75 to 80% of sparse capacity should go to compute and 20 to 25% to memory. That law prices a memory parameter and a compute parameter equally. At inference on wired silicon they are not equal: a compute weight costs die area and switching energy on every token, while a memory entry costs a few bits of NAND or DRAM and is read only when addressed. If inference cost per useful token is the objective, a memory parameter is roughly 1000x cheaper, and the optimum should move far toward memory. Nobody has published that inference-priced allocation law; deriving it is the first experiment.

The design.

  • A reasoning core of ~12B ternary weights, hybrid recurrent and sparse attention, trained as the only compute path.
  • A memory tier of 10 to 50 trillion parameters at 2 to 4 bits (2.5 to 25 TB), keyed by learned product keys plus Engram-style hashed N-grams, read at every fourth layer with context gating.
  • Roughly 2 MB of memory read per token. At 3 to 5 pJ per bit from DRAM or in-die NAND, that is 50 to 80 microjoules, about a tenth of the core's energy.
  • A fact-free core: during training, fact-bearing spans are routed so their loss can only be lowered through memory reads (knowledge dropout on the core path), so facts are not memorized twice.

Why it could fail. Knowledge and reasoning may not separate cleanly; multi-hop reasoning over facts may need the facts inside the computation, not beside it. Small models also emit more tokens: Qwen3.5-9B used ~260M output tokens on the Artificial Analysis index against 86M for Qwen3.5-397B, which the cost model charges against this invention.

The experiment that would falsify it

Experiment 3

Inference-priced allocation law: cores of 0.5 to 3B with memory tiers 0 to 100x their size

Tests
Invention 1, and where Engram's U-curve moves when memory is priced at its inference cost
Pass bar
A 3B core plus memory matches a model with 3x its active compute on knowledge, within 2 points on math and code
If it fails
Knowledge and reasoning do not separate; the core must grow, and the central case drifts toward the pessimistic one