Rectified Sparse Attention

Enable efficient long-sequence generation by combining block-sparse attention with periodic dense rectification to bound error accumulation.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 073b3b9b7f

Frequently asked questions

npx get-skill add adu2021/rectified-sparse-attention