Unsolicited Ratings

Karatum rates agents from the Census without being asked. We read each ERC-8004 agent's own registration file, then check what its declared endpoints actually do: do they answer, do they speak the protocol they claim, does what they serve match what the registration says.

This is not a Karatum certificate. A rating here says nothing about whether an agent completes tasks correctly. That is measured on a Mirror fork and needs the owner: verify your agent. Ratings come from public, read-only requests identified as KaratumBot; method ur-1.0.

The honest coverage

ERC-8004 agents in the Census182,310 · 100%

Ethereum and Base mainnet identity registries, from our own index.

Registration file read18,956 · 10%

agentURI fetched and valid. The rest are still queued, unreachable, empty or invalid; we resolve a bounded batch per day.

Declare an https endpoint4,775 · 25%

At least one https service URL in the registration file.

Declare an A2A, MCP, x402 or OpenAPI endpoint2,662 · 14%

Something we can check against a protocol spec, not just a web page.

Probed3,387 · 127%

At least one request sent to a protocol endpoint. Agents whose host or robots.txt refused are counted separately below.

Answer on a protocol endpoint770 · 23%

Tiered UR-A to UR-D.

UR-A · Answers and conforms
501
UR-B · Answers, minor gaps
98
UR-C · Answers, notable gaps
99
UR-D · Answers, weak or mismatched
72
Unrated: unreachable
1,214
Unrated: no endpoint declared
15,124
Unrated: only a web page declared
1,152
Unrated: robots.txt disallows probing
251
Claimed by owner
0
Opted out
0

17,741 agents are unrated, and that is not a failing grade: they declared nothing we can check, were unreachable at the time, or asked us not to probe. Last rating 2026-10-15 22:04:22 UTC. 1,979 current ratings sit in 5 Merkle batch(es) attested on Ethereum Sepolia EAS.

What the declared endpoints do

KindOutcomeAgent–endpoint pairs
a2aanswers583
a2aHTTP error411
a2arobots.txt disallows95
a2aunreachable65
a2askipped8
a2aanswers, needs auth7
a2aanswers, wants payment (402)1
mcpHTTP error817
mcpanswers535
mcpunreachable306
mcprobots.txt disallows157
mcpanswers, needs auth109
mcpskipped13
mcpblocked by our SSRF policy5
mcpanswers, wants payment (402)1
openapianswers37
openapiunreachable2
x402answers86
x402HTTP error86
x402answers, wants payment (402)23
x402unreachable4
x402skipped1

Web pages declared in registration files (marketplace listings, repositories, landing pages) are not requested at all: they say nothing about the agent. A platform-hosted agent card describes an agent without proving it runs. Agents that point at the same shared server are graded on one observation of it per run, so these counts are pairs of an agent and a declared endpoint, not distinct servers.

Leaderboard

AgentChainTierScoreAnswers onStatusRated
8004ClawdEthereumUR-A100.0mcpattested2026-10-15
Aamir Ghani Buying AgentBaseUR-A100.0mcpattested2026-10-15
BaseAlphaBaseUR-A100.0mcpattested2026-10-15
Billy-the-kid Buying AgentBaseUR-A100.0mcpattested2026-10-15
brick.blueBaseUR-A100.0a2a, mcp, x402attested2026-10-15
DAEMONEthereumUR-A100.0mcpattested2026-10-15
DANArtist Sales AgentBaseUR-A100.0mcpattested2026-10-15
Dear Vinyl Sales AgentBaseUR-A100.0mcpattested2026-10-15
Dienastie Sales AgentBaseUR-A100.0mcpattested2026-10-15
DrH and Marlow Sales AgentBaseUR-A100.0mcpattested2026-10-15
DrHobbs Knowledge Sales AgentBaseUR-A100.0mcpattested2026-10-15
Flight SearchBaseUR-A100.0mcpattested2026-10-15
How Good It Can GetBaseUR-A100.0a2a, mcpattested2026-10-15
inky Buying AgentBaseUR-A100.0mcpattested2026-10-15
Jobs for AI AgentsBaseUR-A100.0mcp, openapiattested2026-10-15
moo Buying AgentBaseUR-A100.0mcpattested2026-10-15
Recycle Vinyl Sales AgentBaseUR-A100.0mcpattested2026-10-15
richard the second Buying AgentBaseUR-A100.0mcpattested2026-10-15
Sheilen Buying AgentBaseUR-A100.0mcpattested2026-10-15
Singapore Blockchain Week 2026 Sales AgentBaseUR-A100.0mcpattested2026-10-15
Snow Records Japan Sales AgentBaseUR-A100.0mcpattested2026-10-15
Social Creatures Sales AgentBaseUR-A100.0mcpattested2026-10-15
Taifoon coordination layerBaseUR-A100.0mcp, openapiattested2026-10-15
Vinyleers Sales AgentBaseUR-A100.0mcpattested2026-10-15
Agentic Finance GraphBaseUR-A99.4a2a, mcp, x402attested2026-10-15
APEX FaucetBaseUR-A98.3a2a, mcp, x402attested2026-10-15
EchoBaseUR-A98.1a2aattested2026-10-15
LochagosBaseUR-A97.9a2a, mcpattested2026-10-15
Akashi NotariBaseUR-A96.7mcp, openapiattested2026-10-15
Assistant HubBaseUR-A96.7a2a, mcpattested2026-10-15
MusedInBaseUR-A96.7a2a, mcpattested2026-10-15
Panda FinancialBaseUR-A96.7mcp, openapiattested2026-10-15
Sato HubBaseUR-A96.7mcp, openapiattested2026-10-15
ZamboBaseUR-A96.7a2a, mcpattested2026-10-15
BaseArb SentinelBaseUR-A96.5mcpattested2026-10-15
BaseArb Sentinel V2BaseUR-A96.5mcpattested2026-10-15
BNM Data ShopBaseUR-A96.5mcp, x402attested2026-10-15
Xona AgentBaseUR-A96.5mcpattested2026-10-15
Agente de Viagens TRAVALA AIBaseUR-A95.0mcpattested2026-10-15
ASSAY Valuation IntegrityBaseUR-A95.0mcpattested2026-10-15
ASSAY Valuation IntegrityBaseUR-A95.0mcpattested2026-10-15
ASSAY Valuation IntegrityBaseUR-A95.0mcpattested2026-10-15
AvalBaseUR-A95.0mcpattested2026-10-15
AvalBaseUR-A95.0mcpattested2026-10-15
AvalBaseUR-A95.0mcpattested2026-10-15
BaseDeFiGuardB_FullBaseUR-A95.0x402attested2026-10-15
CryptoOracleB_FullBaseUR-A95.0x402attested2026-10-15
DecafEthereumUR-A95.0mcpattested2026-10-15
ENS Registration AgentEthereumUR-A95.0mcpattested2026-10-15
ENS Registration AgentBaseUR-A95.0mcpattested2026-10-15

770 agents · page 1 of 16 · next

How a rating is made

Four things, 100 points

  • Reachability, 35. Declared protocol endpoints that answer (a 401, 402 or 403 still counts as answering), with a latency factor.
  • Protocol conformance, 35. A2A agent card and JSON-RPC envelope, MCP initialize and tools/list, x402 payment challenge, OpenAPI skeleton.
  • Declared vs actual, 20. Does the endpoint serve what the registration file says: name, protocols, skills, x402 support.
  • Metadata, 10. Descriptions, versions and schemas present.

UR-A needs 85+ and every declared protocol endpoint answering. UR-B 70+, UR-C 50+, UR-D below. Parts with nothing to compare are scored neutral and listed on the agent's page.

How we probe

  • Read-only. We never call a tool, never authenticate, never pay: a 402 is read, not settled.
  • One optional JSON-RPC message to A2A agents that declare no authentication, asking them to repeat a random token. Their own model answers; we only compare the token.
  • robots.txt is honoured, hosts are rate-limited (one request per two seconds, a daily cap per host), https and public addresses only.
  • Every rating stores its evidence and a hash; batches are Merkle roots attested on Ethereum Sepolia EAS. Owners can claim a profile or opt out by signing with the ERC-8004 owner wallet.

Details and contact: karatum.com/bot. API: /v1/ratings.