Green doesn't mean right
Also called Verification gap
A passing check only proves what it checked. When one agent writes the code and its tests, all of them can pass while the code does the wrong thing, because the tests came from the same misunderstanding.
Before agents, the person writing the tests had usually spent hours with the problem, so a green run carried that thinking with it. An agent produces code and tests in one breath, from one reading of your brief, in seconds. Green now tells you the two agree with each other.
“The tests are green and I don't trust that yet. List three inputs or orderings your tests don't cover. For each one you think is a real bug, write a failing test and show me the red output before you change any code.”