Mistral Small 4

A 30B model that activates 3B still has to keep all 30B in VRAM

NVIDIA's dense-versus-MoE explainer uses Nemotron 3.5 Lightning to walk through per-layer routing. Its own text puts the throughput number and the memory number on two different parameter counts.