Kv Cache Compression

Enables 8x KV cache compression with minimal training overhead to improve reasoning accuracy by allowing more token generation within computational budgets.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit aab8974b4c

Frequently asked questions

npx get-skill add adu2021/kv-cache-compression