Vetto ScienceBench: Expanding Scientific Capabilities of Frontier AI Models
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Vetto ScienceBench is a new benchmark of 50 data-analysis tasks spanning 14 scientific disciplines, built to test whether frontier AI models can do the judgment-heavy analysis that real research requires. The best model passes only 49% of trials, and most models fail over 80% of the time.