Aditya Grover

Inception's 1,107 tokens per second needs a batch size before it enters your capacity plan

Mercury 2.5's diffusion decoder refines many token positions at once, which is why its headline throughput moves with batch size, output length and the reasoning setting Inception ships as an adjustable knob.