Kv Embedding Training Free

Extract high-quality embeddings from frozen decoder-only LLMs by re-routing internal key-value states without training—outperforming training-free baselines by 10% on MTEB while maintaining robustness across sequences up to 4,096 tokens.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 1c9e2c036c

Frequently asked questions

npx get-skill add adu2021/kv-embedding-training-free