Limits of autoregressive decoding

Masked diffusion sampling spends whole-sequence passes to escape the token-by-token loop

Mercury reports over 1,000 tokens per second per user, and Nemotron Diffusion claims 2 to 8 times autoregressive throughput. Both are vendor figures. The sampler that produces them charges for its speed in arithmetic.