Representation Shift Token Compression

Training-free token importance metric using representation shifts in MLP layers, enabling efficient compression compatible with fused kernels.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 1e0e29939e

Frequently asked questions

npx get-skill add adu2021/representation-shift-token-compression