Nemo Mbridge Perf Vision Dp Over Cp

Operational guide for sharding a VLM vision encoder across the language model's context-parallel ranks in Megatron-Bridge, including config knobs, code anchors, load-balance pitfalls, and measured impact.

NVIDIA-NeMo Updated 986 repo stars
image

File contents

NVIDIA-NeMo/Megatron-Bridge commit 89d8900fa2

Frequently asked questions

npx get-skill add nvidia-nemo-megatron-bridge/nemo-mbridge-perf-vision-dp-over-cp