Embedding Space Multitoken Prediction

Accelerate LLM decoding by predicting multiple future tokens simultaneously using mask-token probing in embedding space, without retraining or auxiliary models.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 497e2be749

Frequently asked questions

npx get-skill add adu2021/embedding-space-multitoken-prediction