Promptcheckup – pass/fail check for prompt changes, with 95% intervals
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Promptcheckup is an open-source Python tool that gates prompt changes by running the old and new prompts on the same cases and reporting better, worse, or not sure yet with a 95% confidence interval, usable as a pass/fail check in CI.