The story’s score and claims

Comments on No. 6 of 106 · Municipal Robotics · edition of Thursday 12 November 2026

Tang, a compiler that derives GPU kernels and bounds how fast they can run

Summary

Municipal Robotics' Cam Pedersen describes tang, a Rust compiler that derives GPU kernels from a two-construct tensor IR (views and comprehensions) instead of using hand-written ones, including flash-style attention forward and backward. Reported results are mixed: 1.2× faster than PyTorch at sequence length 512 but slower at 128, and Qwen3-8B decode tied with llama.cpp at short context. Derived attention trails FlashAttention-3, and a Lean-proved traffic bound gives a time floor that is loose on the H200. The figures are the author's own and the claim check found no independent source.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules