Introducing OWE-Bench for Long-Horizon Engineering Projects
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Mercor has released OWE-Bench, a public benchmark of 26 long-horizon engineering and research tasks spanning software, physical engineering, machine learning, and scientific computing. Scores are continuous, scaled so a baseline is 0% and the ceiling is 100%, and tasks are graded on hidden inputs.