Megatron Checkpoint Layout

Bilingual guidance for Megatron checkpoint 1D 2D 3D mp_rank layouts across tensor pipeline and expert parallel dimensions

evolvinglmms-lab Updated
LLaVA-OneVision-2

File contents

evolvinglmms-lab/llava-onevision-2 commit 7f6106e8e9

Frequently asked questions

npx get-skill add evolvinglmms-lab/megatron-checkpoint-layout