Nemotron Cascade Rl

Train language models through sequential, domain-wise RL stages (RLHF → Instruction-Following → Math → Code → SWE) without catastrophic forgetting. Exploit policy-dependent training data distribution where previous behaviors persist when reward-relevant. 14B model surpasses DeepSeek-R1-0528 (671B) on LiveCodeBench.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit d0091e63ea

Frequently asked questions

npx get-skill add adu2021/nemotron-cascade-rl