Nemo Mbridge Perf Memory Tuning

Techniques for reducing peak GPU memory in Megatron Bridge, including expandable segments, PEFT plus sequence-parallel input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes. Use for GPU OOMs, inadequate memory headroom, LoRA or PEFT activation pressure, memory fragmentation, and memory regressions.

NVIDIA-NeMo Updated 986 repo stars
image

File contents

NVIDIA-NeMo/Megatron-Bridge commit a032b44f3a

Frequently asked questions

npx get-skill add nvidia-nemo-megatron-bridge/nemo-mbridge-perf-memory-tuning