Speculative Decoding Prompting

How to structure prompts and utilize Predicted Outputs (OpenAI/vLLM) to maximize speculative draft token acceptance rates, speeding up code generation by 3x at zero cost.

alivirgo Updated 3 repo stars

File contents

alivirgo/Major-AI-Skills commit 3313bcb535

Frequently asked questions

npx get-skill add alivirgo/speculative-decoding-prompting