Results for “monte-carlo”
3 skillsNemo Mbridge Mlm Bridge Training
Run Megatron-LM (MLM) and Megatron Bridge training with mock or real data, covering correlation testing, available recipes, and multi-GPU examples.
2.2k · bundle
Nemo Mbridge Resiliency
Configure fault tolerance, straggler detection, preemption, in-process restart, and re-run state machine for Megatron Bridge training jobs.
2.2k · bundle
Nemo Mbridge Perf Cpu Offloading
Configure and validate CPU offloading for Megatron Bridge training, including activation offloading and optimizer state offloading with HybridDeviceOptimizer.
2.2k · bundle