Forget about credit assignment in long-horizon agentic post-training
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A blog post argues that Evolution Strategies, which perturbs model weights and needs no per-token credit assignment, may beat policy-gradient methods like GRPO for fine-tuning LLMs on long-horizon agentic tasks.