Dupo Dual Preference Optimization

Implement dual preference optimization to generate self-supervised feedback without manual annotation by decomposing tasks into known/unknown components and reconstructing hidden information from model outputs.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 93c9178bc4

Frequently asked questions

npx get-skill add adu2021/dupo-dual-preference-optimization