Distributed Offline Packing

Bilingual guide for running offline_packing/auto_pipe.sh across multiple nodes to produce padding-free packed WebDataset shards for SFT, with Energon Metadataset assembly

evolvinglmms-lab Updated
LLaVA-OneVision-2

File contents

evolvinglmms-lab/llava-onevision-2 commit 7b2f0e2e3c

Frequently asked questions

npx get-skill add evolvinglmms-lab/distributed-offline-packing