Teacher compute behaves like a fixed cost and student compute like a variable one, which is why the paper's two recipes point in opposite directions [2]. Train a teacher to serve a single student and the whole teacher bill lands on that one model; inherit a teacher someone else paid for, or spread it across a roster, and the charge per student falls toward nothing [15]. The reported result that distillation wins with many students or an existing teacher [3], and loses when there is one student and a teacher still to train [4], is the same statement read from both ends of that division [15].
The motivation is the serving bill, not the training one. Compute-optimal models get larger as budgets grow, which is what makes them awkward to deploy [5], and the paper cites work putting an LM's inference cost typically well above its pretraining cost [6]. The alternative already in use is overtraining: far more data than compute-optimal, which yields small capable models [7] but pushes them into diminishing returns and many trillions of tokens to get there [8]. Distillation is offered as a way to reach the same small-model capability for less training spend [9].
The ceiling is the part worth pinning down. The advantage holds up to a compute level that scales predictably with student size [3], which makes the crossover a property of the student you picked rather than of the budget you approved [16]. The team most exposed to it is the one following the overtraining playbook: pushing a fixed small model far past compute-optimal token counts [8][16].
There is a reason to be careful about extrapolating the curve. The authors state plainly that there is no consensus on why distillation works, listing dark knowledge transfer, regularization and noise reduction among the competing explanations [11]. A fitted law over an unexplained effect is dependable inside the range it was fitted on and a guess outside it.
The abstract also presents allocation as risk mitigation [14] without printing the constants. "Scales predictably with student size" is a shape, not a number, and neither the abstract nor the introduction supplied here gives the value [17]. Anyone planning to run this arithmetic before committing a cluster has to lift the fitted coefficients out of the paper body and check that their own student sizes and token budgets sit inside the studied range. That is a modest ask, and it is what the contribution actually is: the choice between distilling and training becomes a calculation with inputs a finance function already tracks [1].
