Eager Entropy Scaling

Monitor token-wise entropy to adaptively allocate compute during inference. Branch into multiple paths at high-entropy tokens, reducing token generation by up to 65% while improving accuracy by up to 37% on reasoning tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 6a219f1da1

Frequently asked questions

npx get-skill add adu2021/eager-entropy-scaling