Skip to content

framework

Megatron-LM

Nvidia's open-source library for training very large transformer models across many GPUs using tensor, pipeline and data parallelism.

Known aliases

  • Megatron

Relationships

No evidence-backed relationships are recorded.

Current clusters