Poss Speculative Decoding

Improve speculative decoding throughput by employing position-specialized draft layers that handle position-specific error accumulation patterns.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 47c1e513cd

Frequently asked questions

npx get-skill add adu2021/poss-speculative-decoding