Skip to content

Topic

Context parallelism

A parallelism strategy that splits a model's input sequence across devices, used for long-context language and long-sequence media workloads.

Current clusters