Preference Generator

Generate preference pairs (chosen/rejected) for DPO/KTO/ORPO/SimPO training

jmagly Updated 229 repo stars

File contents

jmagly/aiwg-training commit 63db17bcf1

Frequently asked questions

npx get-skill add jmagly/preference-generator