The story’s score and claims

Comments on No. 10 of 62 · GitHub · edition of Sunday 15 November 2026

Honest-tests – detect fake tests and prove them with mutation testing

Summary

honest-tests, an open-source CLI and agent skill from mintwork, targets fake tests written by AI coding agents such as Claude Code, Codex and Cursor. Its audit command flags tests that cannot fail, such as self-comparisons, missing assertions and assertions hidden in try/catch. Its mutate command alters a temp copy of the source and lists changes the tests miss. On the project's own bad fixture, 7 of 10 tests were flagged and the mutation score was 15.4%; these figures could not be independently checked.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules