Kermt Continue Pretrain

Continue pretraining from an existing KERMT checkpoint. The skill validates the user's checkpoint and pretrain CSV, prepares the data into shard/vocab/features form, then launches pretrain_ddp.py inside the kermt container (detached for long runs). Auto-dispatches `--pretrain_mode` based on the checkpoint type (grover_base vocab-only, cmim, or hybrid).

nvidia-bionemo Updated 508 repo stars
Picture from the README

File contents

nvidia-bionemo/kermt commit 7355076057

Frequently asked questions

npx get-skill add nvidia-bionemo/kermt-continue-pretrain