crawl-readiness-mcp
activeMCP server that checks whether a website is set up for AI the way its owner intends: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers read it, and what does its access policy allow? Generates llms.txt, an AI-crawler robots.txt and JSON-LD, reads your Answer Analysis, and checks whether a page permits an AI use.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/Grubbomatic/crawl-readiness-mcp
- Package
- npm: crawl-readiness-mcp
- Run (stdio)
npx -y crawl-readiness-mcpThe usual command for this package registry; check the repository README for required settings.- License
- MIT
- Last update
- 2026-10-29
- GitHub stars
- ★ 0
- Homepage
- www.crawlreadiness.com/mcp
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.