Clasp Layer Skip Inference

Accelerate LLM inference by dynamically skipping transformer layers based on in-context signals, without training auxiliary draft models or changing model weights.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 638b74e182

Frequently asked questions

npx get-skill add adu2021/clasp-layer-skip-inference