Local and Self-Hosted Model Deployment

Ollama, vLLM, SGLang: the throughput ceiling is set by the queue, not the weights

A ByteByteGo teardown of the three open-weight serving engines describes three different request disciplines. Queuing and cache reuse decide what a GPU can serve before the model matters.