Results for “mdcg-2019-11”
2 skills
nvidia Nemo Mbridge Perf Moe Long Context
Provides guidance for training Mixture-of-Experts models with long context windows, covering context parallelism sizing, selective recomputation, dispatcher choices, and practical patterns from recent experiments.
2.2k · bundle
nvidia Nemo Mbridge Perf Megatron Fsdp
Enables Megatron Fully Sharded Data Parallel in Megatron-Bridge with configuration overrides, code anchors, pitfalls, and verification steps.
2.2k · bundle