Mixture-of-experts parameter budgeting

DeepSeek paid for Engram's lookup table by deleting 17 of its 72 routed experts

The Engram explainer sells a second scaling axis beyond mixture-of-experts. The published comparison holds parameters and per-token compute fixed, which makes it a swap.