mintwork / honest-tests
Catch AI-written tests that can't fail
Your AI wrote 200 tests. Many of them can't fail. honest-tests finds them, and proves it by breaking your code and watching the tests stay green.
npx @mintwork/honest-tests audit . # find tests that can't fail
npx @mintwork/honest-tests mutate src/pricing.ts # prove it: break the code, see who notices
The problem
Ask an agent to "add tests" and you get a wall of green checkmarks. Look closer: a value compared to itself, a test with no assertion, an assertion inside a try/catch that swallows the failure, a test that checks the mock it just configured. Every one passes. Coverage goes up. Nothing is verified.
honest-tests is a skill that stops Claude Code, Codex and Cursor from writing these tests, plus a CLI that finds them in the suite you already have.
What it does
16 fake-test rules
Tautologies, missing assertions, swallowed failures, asserting on mocks or on literals the test just built, mocked units under test, leftover
.only, and more.Mutation testing built in
Flips operators, constants and return values on a temp copy of your project, runs the related tests, and lists every change nobody noticed.
Agent skill
Teaches the agent to write tests that can go red for the right reason, and to self-audit before it says "done".
PR comments
The Honest Tests Audit Action comments on every pull request with how many of its new tests can't fail.
Every major runner
Vitest, Jest, Mocha, node:test, Bun, Deno, plus pytest and unittest for Python.
SARIF and JSON
Findings in GitHub code scanning, or machine-readable output for any agent.
Install
Claude Code (plugin with skill and slash commands):
/plugin marketplace add mintwork/honest-tests
/plugin install honest-tests@honest-testsCodex and Cursor:
npx @mintwork/honest-tests init codex # adds a section to AGENTS.md
npx @mintwork/honest-tests init cursor # writes .cursor/rules/honest-tests.mdcGitHub Action
Comment on every pull request with what its tests are worth:
- uses: actions/checkout@v7
with:
fetch-depth: 0
- uses: mintwork/honest-tests@v0Open source, MIT licensed
Built in CI and published to npm with signed provenance. The full docs, changelog and issues are on GitHub.