The story’s score and claims

Comments on No. 5 of 123 · Thinking Machines Lab · edition of Saturday 14 November 2026

End‑to‑End 4‑Bit Training

Summary

Thinking Machines Lab describes how it trained Inkling 2 Small with NVFP4 in the mixture-of-experts forward pass and MXFP8 in the backward pass, using re-quantization with stochastic rounding. It also quantizes expert-parallel communication, including combine, with a Hadamard transform and S2F6. The lab reports an 8% pretraining and 20% RL wall-clock speedup over full MXFP8, at about 2% lost compute efficiency in pretraining and no discernible reward change in RL. These figures are self-reported, from the lab's largest jobs, and have no independent source.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules