SnowPR: Benchmarking Coding Agents on Snowflake's 43M-Line Monorepo
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
SnowPR is a new coding-agent benchmark built from 65 merged pull requests in Snowflake's 43-million-line monorepo, with grading by the hidden tests that shipped alongside each change. Unlike public benchmarks drawn from small Python projects, it reflects large, multi-module Java and C++ work with Bazel builds.