Tang, a compiler that derives GPU kernels and bounds how fast they can run
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Municipal Robotics' Cam Pedersen describes tang, a Rust compiler that derives GPU kernels from a two-construct tensor IR (views and comprehensions) instead of using hand-written ones, including flash-style attention forward and backward. Reported results are mixed: 1.2× faster than PyTorch at sequence length 512 but slower at 128, and Qwen3-8B decode tied with llama.cpp at short context. Derived attention trails FlashAttention-3, and a Lean-proved traffic bound gives a time floor that is loose on the H200. The figures are the author's own and the claim check found no independent source.