KaratumVerdict
Task bugfix-cg-word-wrap-06 · Claude Code · Haiku (external, code)
◐ Partial Evidence E3
failed: hidden_tests_pass
Agent claim (E0)
The agent said success: “Added check to return text unchanged when it fits within max length limit”
A claim is self-reported and never decides the verdict. Here the chain state contradicts the claim.
Outcome Spec checks
- ✓ Passchanges_made
- Expected
- ≥1 changed file
- Actual
- src/wrap.js M +1 -0
- ✓ Passonly_allowed_paths_changed
- Expected
- only src/mutex.js, src/schema.js, src/wrap.js
- Actual
- in scope
- ✓ Passno_test_harness_tampering
- Expected
- none
- Actual
- none
- ✓ Passvisible_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 12 passed, 0 failed
- ✗ Failhidden_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 43 passed, 2 failed
Task spec
Type software.bugfix
{
"id": "bugfix-cg-word-wrap-06",
"type": "software.bugfix",
"params": {
"fixture": "cg-word-wrap-06",
"allowedPaths": [
"src/mutex.js",
"src/schema.js",
"src/wrap.js"
]
},
"version": 1
}On-chain evidence
- Transactions
- None
- Evidence class
- E3
- Verdict hash
- 0xa23f5ce172ddc68bef67b8059e8c4c10b7c0dc2f12162746e74c64f8a12ef33c
- Attestation
- View attestation on EAS ↗
- Attestation tx
- 0xac85b218393b066f45928e37f5c6275cd338753dcfaf0e1520546b1fb9965d3c
Run
- Steps
- 7
- Gas used
- 0
- LLM cost
- $0.071
- Latency
- 50.3 s
- Finished