Static Constrained Decoding

STATIC converts prefix trees into sparse matrices for vectorized constrained decoding, achieving 948x speedup over CPU and enabling production-scale recommendation systems.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit ce71eaf225

Frequently asked questions

npx get-skill add adu2021/static-constrained-decoding