Honest-tests – detect fake tests and prove them with mutation testing
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
honest-tests, an open-source CLI and agent skill from mintwork, targets fake tests written by AI coding agents such as Claude Code, Codex and Cursor. Its audit command flags tests that cannot fail, such as self-comparisons, missing assertions and assertions hidden in try/catch. Its mutate command alters a temp copy of the source and lists changes the tests miss. On the project's own bad fixture, 7 of 10 tests were flagged and the mutation score was 15.4%; these figures could not be independently checked.