XYBench: Helping with the problem behind the question
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
XYBench is a new benchmark of over 8,000 questions from Stack Overflow, Stack Exchange, WikiHow, and curated examples, built by researchers at Carnegie Mellon, NVIDIA, and Johns Hopkins. It tests whether AI models catch users' misconceptions and steer them toward their real goal.