Triton Cuda Attention

Attention 算子的 Triton-CUDA 实现指南。包含经过验证的 Flash Attention 完整示例、各变体(Causal/GQA/MQA/RoPE)的差异改法、在线 Softmax 算法和常见错误

wenyi-li Updated 10 repo stars

File contents

wenyi-li/awesome-agent-kernel-skills commit a190cb1a65

Frequently asked questions

npx get-skill add wenyi-li/triton-cuda-attention