Megatron-LM
GPU-optimized library for training transformer models at scale
Visit tool
docs.nvidia.com
About Megatron-LM
Megatron-LM is a reference example that includes Megatron Core plus pre-configured training scripts, ideal for research teams, learning distributed training, and quick experimentation. Megatron Core is a composable library with GPU-optimized building blocks for custom training frameworks.
Description summarised by AI from the sources listed below.
Key features
- GPU-optimized building blocks
- advanced parallelism strategies
- mixed precision support
- model architectures
Use cases
- research teams
- distributed training
- quick experimentation
Pricing
Pricing model: Open source. Detailed plans are not recorded; check the official website for current prices.
Pricing summarised by AI from the sources listed below.
