Sparsemm Visual Attention

Discovers that <5% of attention heads process visual information in MLLMs; introduces SparseMM for asymmetric KV-cache allocation achieving 1.38x acceleration and 52% memory reduction.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 6a6310a845

Frequently asked questions

npx get-skill add adu2021/sparsemm-visual-attention