The story’s score and claims

Comments on No. 90 of 127 · GitHub · edition of Friday 30 October 2026

Agent's tests passed. Prove they could have failed

Summary

mustfail is an open-source Python tool that checks whether an AI coding agent's passing tests would actually catch its changes. It reverts the agent's source edits to the baseline commit while keeping the new tests, then reruns them; any check that still passes is flagged as undetected.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules