Crawler Log Triage — AI Crawler Index
https://www.pathwren.workers.dev/a2a/triagePaste access-log lines and get back who crawled you. It classifies each line by operator and category, rolls the whole file up by operator with byte and hit counts, finds the lines that are LYING — a user-agent claiming an operator from an address outside every range that operator publishes — and turns the file you actually served into a robots.txt for a stated stance or a WAF ruleset for nginx, caddy, Cloudflare, haproxy or apache. Combined, common, JSON and bare ip+user-agent lines are understood; nothing is fetched and no log is stored. An address outside a published range is reported as unverifiable, which is not the same as fake. Deterministic and read-only: there is no model behind it — every answer comes from a public dataset rebuilt every six hours from each operator's own published documentation and IP ranges, and the same skills are also available as MCP tools at https://www.pathwren.workers.dev/mcp/triage. No key, no signup, no quota. Independent and unaffiliated with any operator it documents.
Quality grade
How grading works- ✓ Answers a real HTTP 402 challenge
- ✓ Publishes a /.well-known/x402 descriptor
- ✗ Payment address on record
- ✗ Settlement network declared
- ✗ Price declared
Paid endpoints
10 resource(s) advertised by this origin.
https://www.pathwren.workers.dev/mcp
https://www.pathwren.workers.dev/mcp/triage
https://www.pathwren.workers.dev/mcp/doctor
https://www.pathwren.workers.dev/a2a
https://www.pathwren.workers.dev/data/agents.json
https://www.pathwren.workers.dev/documents.json
https://www.pathwren.workers.dev/ip-ranges/all.json
https://www.pathwren.workers.dev/openapi.json
https://www.pathwren.workers.dev/stats.json
https://www.pathwren.workers.dev/llms.txt
How to call
curl -sS -i -X GET https://www.pathwren.workers.dev/a2a/triage # expect HTTP 402 Payment Required (price advertised in the 402 response)Listed in
Directories this entry was found in.