Set Block Decoding Inference Acceleration

Accelerate language model generation 3-5x by combining autoregressive and masked token prediction. Works via fine-tuning—no architectural changes needed. Parallel decode non-consecutive tokens with entropy-bounded sampling.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 5f89c851f2

Frequently asked questions

npx get-skill add adu2021/set-block-decoding-inference-acceleration