Nemo Mbridge Perf Sequence Packing

Validate and use packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs, and applying the right CP constraints.

promptingcompany Updated 0 repo stars

File contents

promptingcompany/nv-skills commit 902ceb7f2d

Frequently asked questions

npx get-skill add promptingcompany/nemo-mbridge-perf-sequence-packing