Nemo Mbridge Perf Expert Parallel Overlap

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.

promptingcompany Updated 0 repo stars

File contents

promptingcompany/nv-skills commit b05ac9bffd

Frequently asked questions

npx get-skill add promptingcompany/nemo-mbridge-perf-expert-parallel-overlap-2