Agent's tests passed. Prove they could have failed
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
mustfail is an open-source Python tool that checks whether an AI coding agent's passing tests would actually catch its changes. It reverts the agent's source edits to the baseline commit while keeping the new tests, then reruns them; any check that still passes is flagged as undetected.