Transformer Attention

Use when reasoning about Transformer self-attention, multi-head attention, positional encoding, masked decoder attention, or why attention replaced recurrence/convolutions in sequence models; not for generic NLP or unrelated attention topics.

vectifyai Updated
OpenKB (by PageIndex)

File contents

vectifyai/openkb commit a5b9b92385

Frequently asked questions

npx get-skill add vectifyai/transformer-attention