Internals of FP8 MMA on Hopper

A blog post by Pieter Tillet's author (unnamed in the text) explains why FP8 matrix multiply on NVIDIA Hopper GPUs needs accumulator promotion. The post attributes Hopper's accuracy loss to a truncating alignment cutoff and a rounding format that zeroes the lowest 10 significand bits, then shows that periodically promoting…