Kermt Add Cmim Pretrain

Convert a grover_base checkpoint (encoder-only or encoder + vocab heads) into a hybrid checkpoint by adding a randomly-initialized cMIM decoder + latent_dist, then continue pretraining on the user's corpus as hybrid (vocab + contrast). Effectively kermt-continue-pretrain with a one-time ckpt-conversion step prepended.

nvidia-bionemo Updated 508 repo stars
NVIDIA BioNeMo Agent Toolkit

File contents

nvidia-bionemo/bionemo-agent-toolkit commit 69b96a81b7

Frequently asked questions

npx get-skill add nvidia-bionemo/kermt-add-cmim-pretrain-2