Remit Rl Guided Mid Training

Improve LLM reasoning by reweighting pre-training data during mid-training based on discrepancies between RL-tuned and base models, boosting reasoning performance without external teachers or extra data.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 39cd65a8ac

Frequently asked questions

npx get-skill add adu2021/remit-rl-guided-mid-training