Retrofitted Recurrence Deeper Thinking Lms

Convert pretrained non-recurrent language models into depth-recurrent variants through a curriculum of increasing recurrence—decoupling training compute from inference compute and improving performance at given inference budgets on reasoning tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 1cd65a8f15

Frequently asked questions

npx get-skill add adu2021/retrofitted-recurrence-deeper-thinking-lms