Slime Preference Optimization

Optimize model preferences by decoupling preference learning from generation quality. Explicitly maximize chosen response likelihood while using token-level stabilization to prevent quality degradation from over-suppressing rejected responses.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit be0c79e02c

Frequently asked questions

npx get-skill add adu2021/slime-preference-optimization