Less Is More Sparse Attention

Improves inference efficiency through training-free sparse attention using global token selection patterns aggregated from local attention heads for unified cross-head ranking.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 5f714d34ee

Frequently asked questions

npx get-skill add adu2021/less-is-more-sparse-attention