Skip to content

Topic

Linear attention

Attention variants whose compute and memory grow linearly with sequence length by carrying a fixed-size recurrent state instead of a growing cache.

Current clusters