Cartridges Long Context

Train reusable pre-computed KV cache representations of large text corpora for efficient retrieval, achieving 38.6x memory reduction and 26.4x throughput improvement.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 7529e85440

Frequently asked questions

npx get-skill add adu2021/cartridges-long-context