Results for “multiple-choice”
3 skillsMore results
Nemo Mbridge Perf Moe Long Context
Provides guidance for training Mixture-of-Experts models with long context windows, covering context parallelism sizing, selective recomputation, dispatcher choices, and practical patterns from recent experiments.
2.2k · bundle
Mhc
Implements Manifold-Constrained Hyper-Connections (mHC) using Doubly Stochastic Matrices to improve deep learning stability.
54 · bundle