Nemo Mbridge Perf Moe Comm Overlap

MoE expert-parallel communication overlap in Megatron Bridge. Covers dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit 70ffa09961

Frequently asked questions

npx get-skill add nvidia/nemo-mbridge-perf-moe-comm-overlap-2