Inference Kernel Verification

A 284B model in 3.2GB of RAM turns sparse MoE into a disk bandwidth problem

A developer streamed a 160GB mixture-of-experts checkpoint off NVMe and ran it in 3.23GB resident. The arithmetic in the write-up says the token clock is set by the drive, not the GPU.