Dynamic Mask Sparse Attention

Sparse attention mechanism combining content-aware and position-aware sparse patterns through dynamic masking. Achieves 10x speedup while maintaining model quality on long-context benchmarks through hardware-friendly implementation.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 60fc954b46

Frequently asked questions

npx get-skill add adu2021/dynamic-mask-sparse-attention