Token Order Prediction

Improve LM performance with token order prediction (TOP) auxiliary loss using learning-to-rank instead of exact multi-token prediction, achieving gains across math, code, and NLP tasks

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 5ed1b66f38

Frequently asked questions

npx get-skill add adu2021/token-order-prediction