Dmtd Multi Token

Generate multiple tokens simultaneously by having late transformer layers directly predict multiple outputs after early layer processing. No auxiliary parameters or verification needed. Achieve up to 2x generation speedup.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit ae01fcbf5f

Frequently asked questions

npx get-skill add adu2021/dmtd-multi-token