Nemo Automodel Distributed Training

Guide for selecting and configuring distributed training strategies in NeMo AutoModel, including FSDP2, Megatron FSDP, DDP, and parallelism settings.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit caff080639

Frequently asked questions

npx get-skill add nvidia/nemo-automodel-distributed-training