Nemo Mbridge Multi Node Slurm

Convert single-node scripts to multi-node Slurm sbatch jobs and debug common multi-node failures. Covers srun-native vs uv run torch.distributed approaches, container setup, NCCL timeouts, OOM sizing for MoE models, and interactive allocation.

NVIDIA-NeMo Updated 986 repo stars
image

File contents

NVIDIA-NeMo/Megatron-Bridge commit 814c677e63

Frequently asked questions

npx get-skill add nvidia-nemo-megatron-bridge/nemo-mbridge-multi-node-slurm