Skip to content

framework

FSDP2

Second-generation Fully Sharded Data Parallel implementation in PyTorch, which shards model parameters, gradients and optimizer state across devices during training.

Known aliases

  • Fully Sharded Data Parallel v2

Relationships

No evidence-backed relationships are recorded.

Current clusters