Quantization and speculative decoding

NVIDIA's edge-agent case rests on compact open models matching data-center capabilities

Nemotron 3.5 Lightning touches a tenth of its weights per token, which is what makes an agent loop plausible next to the sensors, but memory still has to hold all thirty billion and NVIDIA's own loop still escalates off-device.