A QUALITY GATE FOR GITHUB ISSUES
Coding agents will happily rebuild what you already shipped. This reads the ticket first and says no — before a single token is spent writing code.
A real refusal from a real run. It costs about a tenth of a cent to produce, and it stops a generation run that would have cost a thousand times more.
This appears to be done already, so no code was generated.
commit a3f9c21 — “Clear session cookie on logout” — 93% confidence
Checking is cheap. Generating is not. Every refusal is a generation run that never had to happen.
Separately, roughly half of patches that pass their benchmark would still not be merged by a maintainer. METR, March 2026
It writes the change and opens a draft pull request — small enough that someone will actually review it. Work that grows past the limit is discarded rather than pushed.
SEE A REAL PR IT OPENED