Nemo Mbridge Perf Cpu Offloading

Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.

NVIDIA-NeMo Updated 986 repo stars
image

File contents

NVIDIA-NeMo/Megatron-Bridge commit c8f52df0d1

Frequently asked questions

npx get-skill add nvidia-nemo-megatron-bridge/nemo-mbridge-perf-cpu-offloading