Context Window Sizing

The flash_attn error in llama.cpp is a layout constraint, and it decides your context window

llama.cpp will not quantize a V cache without Flash Attention. Which half of the KV cache you can still shrink, and whether you measured it or guessed it, sets the context you can actually ship.