Back to code-only MCP servers

crawl-readiness-mcp

active

MCP server that checks whether a website is set up for AI the way its owner intends: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers read it, and what does its access policy allow? Generates llms.txt, an AI-crawler robots.txt and JSON-LD, reads your Answer Analysis, and checks whether a page permits an AI use.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository
github.com/Grubbomatic/crawl-readiness-mcp
Package
npm: crawl-readiness-mcp
Run (stdio)
npx -y crawl-readiness-mcp
The usual command for this package registry; check the repository README for required settings.
License
MIT
Last update
2026-10-29
GitHub stars
★ 0
Homepage
www.crawlreadiness.com/mcp

Listed in

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.