AI R&D-relevant model capabilities are improving rapidly and are getting harder to measure
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
METR's report finds that AI R&D-relevant capabilities of public models, including Opus 5.5 and GPT-6 Astra, are improving rapidly while becoming harder to measure. Models usually match or beat skilled humans on coding and optimization tasks, and time horizons on a combined suite are doubling roughly every 3.6 months.