Nemo Mbridge Perf Sequence Packing

Validate and use packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs, and applying the right CP constraints.

yangwhale Updated 15 repo stars
CloseCrab — AI Agent Bot 框架

File contents

yangwhale/closecrab commit 902ceb7f2d

Frequently asked questions

npx get-skill add yangwhale/nemo-mbridge-perf-sequence-packing