Psa Pyramid Sparse Attention

Replaces binary keep/drop masks with multi-level pooled key-value representations, allowing queries to access larger receptive fields under same compute budget through hierarchical aggregation without discarding information.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 0f735bae65

Frequently asked questions

npx get-skill add adu2021/psa-pyramid-sparse-attention