Skip to content

Topic

Sparse activation

Model designs that raise total parameter count while activating only a fraction of the network per token, usually to cut serving cost at a given capability level.

Current clusters