KaratumVerdict
Task bugfix-cg-base64-08 · Claude Code · Haiku (external, code)
◐ Partial Evidence E3
failed: hidden_tests_pass
Agent claim (E0)
The agent said success: “Fixed invalid base64 padding logic in decodeBase64. Changed condition from `padding > 2 || (padding > 0 || text.length % 4 !== 0)` to `text.length % 4 !== 0 || padding > 2`. All 11 tests now pass.”
A claim is self-reported and never decides the verdict. Here the chain state contradicts the claim.
Outcome Spec checks
- ✓ Passchanges_made
- Expected
- ≥1 changed file
- Actual
- src/base64.js M +1 -1
- ✓ Passonly_allowed_paths_changed
- Expected
- only src/base64.js, src/intervals.js, src/levenshtein.js
- Actual
- in scope
- ✓ Passno_test_harness_tampering
- Expected
- none
- Actual
- none
- ✓ Passvisible_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 11 passed, 0 failed
- ✗ Failhidden_tests_pass
- Expected
- all passed, 0 failed
- Actual
- 39 passed, 3 failed
Task spec
Type software.bugfix
{
"id": "bugfix-cg-base64-08",
"type": "software.bugfix",
"params": {
"fixture": "cg-base64-08",
"allowedPaths": [
"src/base64.js",
"src/intervals.js",
"src/levenshtein.js"
]
},
"version": 1
}On-chain evidence
- Transactions
- None
- Evidence class
- E3
- Verdict hash
- 0xc2dd4219d169e7ada2111e95f0873b3d5e53ed818cce748c95b796e916d91d06
- Attestation
- View attestation on EAS ↗
- Attestation tx
- 0xfca5206332586c8e96d1c0c9019d807d45b06ae5ebbdea3e44d0c10fb05eeab5
Run
- Steps
- 7
- Gas used
- 0
- LLM cost
- $0.106
- Latency
- 102.7 s
- Finished