Speculative Decoding

Speculative Decoding: Accelerating LLM Inference

ComeOnOliver Updated 66 repo stars

File contents

ComeOnOliver/skillshub commit e5d55b8d85

Frequently asked questions

npx get-skill add comeonoliver/speculative-decoding