Mistrial – Re run your LLM judge and see how often it flips
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Mistrial is an open-source tool that re-runs an LLM judge across repeated trials, judge models, and rubric rewordings to measure how often its verdicts flip.