Nemo Mbridge Perf Memory Tuning

Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit 17e5a8549d

Frequently asked questions

npx get-skill add nvidia/nemo-mbridge-perf-memory-tuning-2