Benchmarking Coding Agents Under Evolving Requirements
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
FeatureLoop is a benchmark of 61 human-reviewed tasks from 34 repositories that tests coding agents on iterative development, where users add requirements and report failures across successive revisions of one codebase. Each stage is checked with executable tests for new behavior and preservation of earlier functionality.