Kernel Numerics Verifier

Verify forward and backward numerical correctness of a handwritten low-precision GPU kernel against a high-precision oracle and an eager same-dtype baseline. Use for Triton or CUDA kernel correctness; use numerics_debugging to locate an unknown whole-model divergence.

pytorch Updated
torchtitan

File contents

pytorch/torchtitan commit 24a5e87763

Frequently asked questions

npx get-skill add pytorch/kernel-numerics-verifier