TensorLean: Formal verification framework for GPU kernels at the PTX level
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
TensorLean, from researchers at Yale-affiliated authors Wei Qiang, Ganxiang Yang, Ronghui Gu and colleagues, is a Lean-based framework that verifies GPU kernels at the PTX assembly level for all input shapes and thread schedules, within a floating-point tolerance. The authors report checking 149 open-source kernel instances, including 102 from FlashAttention, proving 83 correct and finding 38 bugs. They also report a roughly 15:1 code-to-specification ratio. These figures are self-reported and uncorroborated, and the paper and code are not yet released.