Claude was faster and cheaper. We took the scenic route anyway
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
The author describes "Verify, Then Vote," a method for picking among answers from several small local language models by checking whether each cited source supports its answer, then applying a fixed rule. On 1,000 questions, accuracy rose from 77.1% under simple majority voting to 85.0%.