Skip to content

other

Sliding-Window Attention Bounded Replay

Attention technique named in DeepSeek's V4.1 Flash technical report, pairing a local sliding window with a bounded replay of cached state to hold down KV cache size.

Current clusters