There is no posttraining data commons
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Posttraining has no equivalent of the web-scale text commons that pretraining relied on, argues an essay titled "There is no posttraining data commons." Its author contends that human tasks are situated and ephemeral, so turning them into reinforcement-learning tasks requires preserving a world, intent, tools, and a grader.