Margin Adaptive Dpo

Adapt DPO temperature parameters per sample using reward model margins, amplifying learning signals for hard preference pairs while dampening easy ones.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 11d9e96a95

Frequently asked questions

npx get-skill add adu2021/margin-adaptive-dpo