LLM Timing Side Channels

One API key per platform puts every customer's system prompt in the same cache namespace

A cache hit answers 13 to 31 percent faster than a miss, and an ICML 2025 audit found seven of 17 live providers sharing that cache across users, though the one demonstrated 100 percent reconstruction ran against self-hosted vLLM and SGLang.