Nemo Mbridge Perf Expert Parallel Overlap

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit 1c70fc1301

Frequently asked questions

npx get-skill add nvidia/nemo-mbridge-perf-expert-parallel-overlap