Agent Tools
Back to directory
● healthy general

Checks whether a website is accessible and agent-friendly. Fetches robots.txt, .well-known/ai.txt, and sitemap.xml; inspects HTTP headers (CORS, CSP, rate-limit); and returns a readiness verdict. Useful for agents that need to decide whether to scrape, crawl, or interact with a domain before committing to a workflow. Returns allowed/blocked status, disallowed paths, crawl delay, AI-specific rules, and sitemap URL if present. -- reliability 87.19999694824219/100 per Paygent Discover

Category
general
Chains
base
Price

How to call

cURL · x402-fetch / x402-axios will auto-handle 402
curl -X POST https://the-stall.intuitek.ai
/.well-known/x402.json
https://the-stall.intuitek.ai/.well-known/x402