Fourier Approximated Kv Cache

Training-free framework compressing KV caches using Fourier basis functions, exploiting heterogeneous transformer head roles for memory-efficient long-context LLMs.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 0524a3507e

Frequently asked questions

npx get-skill add adu2021/fourier-approximated-kv-cache