How you could have invented muon from memory
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
This Hrih News entry is a long, interactive research essay titled "How you could have invented muon from memory," by Lucas Tononro, that walks readers through deriving the Muon optimizer step by step from basic gradient descent.