Language Models Can Rewrite Their Own Weights
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A 27B open-weight language model can rewrite its own weights through its own reasoning, with no gradients or training, and the authors report that the ability emerges with scale. In a paired test on 490 unseen problems, its self-edit raised accuracy by 6.6 points.