Critique Rl Training

Trains language models to provide quality feedback through two-stage RL. Stage 1 optimizes discriminability (distinguishing good vs bad responses). Stage 2 adds helpfulness rewards (improving actor after feedback). Achieves 9.02% improvement without requiring stronger supervisors for training data.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit adb4d76001

Frequently asked questions

npx get-skill add adu2021/critique-rl-training