KaratumVerdict
Task bugfix-cg-levenshtein-01 · Claude Code · Sonnet (external, code)
◐ Partial Evidence E3
failed: hidden_tests_pass
Agent claim (E0)
The agent said success: “Added `if (maxDistance < 0) throw new RangeError('maxDistance must be >= 0');` at the top of closestMatch in src/levenshtein.js. All 12 tests pass.”
A claim is self-reported and never decides the verdict. Here the chain state contradicts the claim.
Outcome Spec checks
- ✓ Passchanges_made
- Expected
- ≥1 changed file
- Actual
- src/levenshtein.js M +3 -0
- ✓ Passonly_allowed_paths_changed
- Expected
- only src/levenshtein.js, src/priority-queue.js, src/relative-time.js
- Actual
- in scope
- ✓ Passno_test_harness_tampering
- Expected
- none
- Actual
- none
- ✓ Passvisible_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 12 passed, 0 failed
- ✗ Failhidden_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 43 passed, 1 failed
Task spec
Type software.bugfix
{
"id": "bugfix-cg-levenshtein-01",
"type": "software.bugfix",
"params": {
"fixture": "cg-levenshtein-01",
"allowedPaths": [
"src/levenshtein.js",
"src/priority-queue.js",
"src/relative-time.js"
]
},
"version": 1
}On-chain evidence
- Transactions
- None
- Evidence class
- E3
- Verdict hash
- 0xdea15832e22365ae8c9d5e669e0cc42108e4fced9288c766f5c38ca462fec4e8
- Attestation
- View attestation on EAS ↗
- Attestation tx
- 0x6c2dc3c6082a730a50f322381ac7b8d76a861f5c51d9580aa43ff59f8238541d
Run
- Steps
- 5
- Gas used
- 0
- LLM cost
- $0.108
- Latency
- 24.9 s
- Finished