Nemo Mbridge Multi Node Slurm

Convert single-node PyTorch distributed scripts into multi-node Slurm sbatch jobs and debug common multi-node failures, covering srun-native and torch.distributed approaches, container setup, NCCL timeouts, and interactive allocation.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit 63c02e122e

Frequently asked questions

npx get-skill add nvidia/nemo-mbridge-multi-node-slurm