Results for “megatron-bridge”
17 skills
nvidia Nemo Mbridge Mlm Bridge Training
Run Megatron-LM (MLM) and Megatron Bridge training with mock or real data, covering correlation testing, available recipes, and multi-GPU examples.
2.2k · bundle
nvidia Nemo Mbridge Perf Megatron Fsdp
Enables Megatron Fully Sharded Data Parallel in Megatron-Bridge with configuration overrides, code anchors, pitfalls, and verification steps.
2.2k · bundle
nvidia Nemo Mbridge Recipe Recommender
Indexes Megatron Bridge recipes and recommends the best starting config based on model, GPU count, and training goal.
2.2k · bundle
nvidia Nemo Mbridge Resiliency
Configure fault tolerance, straggler detection, preemption, in-process restart, and re-run state machine for Megatron Bridge training jobs.
2.2k · bundle
More results
nvidia Nemo Mbridge Perf Cpu Offloading
Configure and validate CPU offloading for Megatron Bridge training, including activation offloading and optimizer state offloading with HybridDeviceOptimizer.
2.2k · bundle
nvidia Nemo Mbridge Perf Cuda Graphs
Validate and use CUDA graph capture in Megatron Bridge, including local full-iteration graphs and Transformer Engine scoped graphs for attention, MLP, and MoE modules.
2.2k · bundle
nvidia Nemo Mbridge Perf Memory Tuning
Reduces peak GPU memory in Megatron Bridge training by applying expandable segments, parallelism resizing, activation recompute, and CPU offloading constraints.
2.2k · bundle
nvidia Nemo Mbridge Perf Moe Comm Overlap
Optimizes MoE expert-parallel communication overlap in Megatron Bridge, covering dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.
2.2k · bundle
nvidia Nemo Mbridge Perf Moe Vlm Training
Provides practical guidance for training Mixture-of-Experts Vision-Language Models in Megatron Bridge, comparing FSDP and 3D-parallel approaches with lessons from recent multimodal experiments.
2.2k · bundle
nvidia Nemo Mbridge Perf Sequence Packing
Validate and configure packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs with correct context parallelism constraints.
2.2k · bundle
nvidia Mcore Run On Slurm
Launch distributed Megatron-LM training jobs on a SLURM cluster with a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules, container conventions, monitoring, and per-rank failure diagnosis.
2.2k · bundle
nvidia Nemo Mbridge Multi Node Slurm
Convert single-node PyTorch distributed scripts into multi-node Slurm sbatch jobs and debug common multi-node failures, covering srun-native and torch.distributed approaches, container setup, NCCL timeouts, and interactive allocation.
2.2k · bundle
nvidia Nemotron Policy Generator
Generates custom safety policies for NVIDIA Nemotron content-safety guardrails, producing a Markdown policy, JSON taxonomy, and inference prompts from rough user input.
2.2k · bundle
nvidia Mcore Testing
Guides testing Megatron-LM: test layout, recipe YAML, adding and running unit/functional tests, golden values, marker filters, and CI parity.
2.2k · bundle
nvidia Jetson Package
Selects Jetson-compatible containers, vLLM runtime images, and Jetson AI Lab PyPI indexes based on Orin SM 8.7 vs Thor SM 11.0 and JetPack version.
2.2k · bundle
dotnet Thread Abort Migration
Migrates .NET Framework code using Thread.Abort to cooperative cancellation with CancellationToken in modern .NET 6+.
4k
nvidia Jetson Customize Mgbe
Generates kernel-DT overlay fragments to enable 25G/10G/1G MGBE QSFP interfaces on Jetson Thor, verifying pinmux and integrating with the BSP customization workflow.
2.2k · bundle