End‑to‑End 4‑Bit Training
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Thinking Machines Lab describes how it trained Inkling 2 Small with NVFP4 in the mixture-of-experts forward pass and MXFP8 in the backward pass, using re-quantization with stochastic rounding. It also quantizes expert-parallel communication, including combine, with a Hadamard transform and S2F6. The lab reports an 8% pretraining and 20% RL wall-clock speedup over full MXFP8, at about 2% lost compute efficiency in pretraining and no discernible reward change in RL. These figures are self-reported, from the lab's largest jobs, and have no independent source.