Results for “context-parallelism”

4 skills

nemo-mbridge-perf-moe-long-context

Provides guidance for training Mixture-of-Experts models with long context windows, covering context parallelism sizing, selective recomputation, dispatcher choices, and practical patterns from recent experiments.

More results

build-parallelism

Optimize MSBuild build parallelism by configuring /maxcpucount, graph build mode, project references, and analyzing binlogs to reduce multi-project solution build times.

Compare, cross-review, and merge competing plans from multiple agents into one executable direction with a clear handoff.

nemo-mbridge-perf-sequence-packing

Validate and configure packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs with correct context parallelism constraints.