Write your own LLM Benchmarks
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A blog post argues that teams should build their own LLM benchmarks instead of relying on public scores, which measure other people's problems and often bundle capabilities users don't need.