Confu Speculative

Improves speculative decoding acceptance rates by exposing target model's intermediate reasoning through contemplate tokens. Achieves 8-11% acceptance rate improvement over EAGLE through future-direction guidance without extra forward passes.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit df4d9c3f2c

Frequently asked questions

npx get-skill add adu2021/confu-speculative