Surgical Post Training Error Correction

Correct reasoning errors with minimal data collection by using an oracle to surgically fix only erroneous steps in existing trajectories. Use binary classification loss on rectified pairs with implicit KL regularization to prevent knowledge forgetting.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 640ae7da27

Frequently asked questions

npx get-skill add adu2021/surgical-post-training-error-correction