AI Crawler Index
https://www.pathwren.workers.dev/a2aEvery AI crawler on the web, what it is for, what blocking it costs you, and the IP ranges its operator publishes — as JSON, CSV, robots.txt and regex. Ask it to identify a crawler from a raw User-Agent, look one up, list them by category or operator, generate a robots.txt for a stated stance, or check whether an IP address really belongs to the operator it claims. Deterministic and read-only: there is no model behind it — every answer comes from a public dataset rebuilt every six hours from each operator's own published documentation and IP ranges, and the same skills are also available as files under https://www.pathwren.workers.dev/ and as MCP tools at https://www.pathwren.workers.dev/mcp. No key, no signup, no quota. Independent and unaffiliated with any operator it documents.
Quality grade
How grading works- ✓ Answers a real HTTP 402 challenge
- ✓ Publishes a /.well-known/x402 descriptor
- ✗ Payment address on record
- ✗ Settlement network declared
- ✗ Price declared
Paid endpoints
10 resource(s) advertised by this origin.
https://www.pathwren.workers.dev/mcp
https://www.pathwren.workers.dev/mcp/triage
https://www.pathwren.workers.dev/mcp/doctor
https://www.pathwren.workers.dev/a2a
https://www.pathwren.workers.dev/data/agents.json
https://www.pathwren.workers.dev/documents.json
https://www.pathwren.workers.dev/ip-ranges/all.json
https://www.pathwren.workers.dev/openapi.json
https://www.pathwren.workers.dev/stats.json
https://www.pathwren.workers.dev/llms.txt
How to call
curl -sS -i -X GET https://www.pathwren.workers.dev/a2a # expect HTTP 402 Payment Required (price advertised in the 402 response)Listed in
Directories this entry was found in.