MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) can access your site. CLI, library, MCP server and GitHub Action.
MIT ★ 3 -
Why Won't AI Mention My Product: see what GPTBot, ClaudeBot, PerplexityBot and CCBot get from your website. https://whywontai.com/
MIT -
Is this website ready for AI agents? MCP server + client for the AgentReady audit: robots.txt rules for 17 AI bots (GPTBot, ClaudeBot, ChatGPT-User, PerplexityBot...), bot challenges, content in raw HTML, markdown, llms.txt, sitemap, JSON-LD, Open Graph,
npm MIT -
Free, open-source CLI and MCP server that checks whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot) and search engines can access your website: robots.txt, llms.txt, sitemap, JSON-LD, meta tags, JavaScript rendering and Common Crawl presence. Runs locally.
npm MIT -
MCP server that checks whether a website is set up for AI the way its owner intends: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers read it, and what does its access policy allow? Generates llms.txt, an AI-crawler robots.txt and JSON-LD, reads your Answer Analysis, and checks whether a page permits an AI use.
MIT -
Can ChatGPT, Claude and Perplexity read and cite your site? Checks robots.txt, edge blocks, llms.txt, schema and JS-only content. Zero dependencies. Also an MCP server.
pypi MIT -
crawlbit-mcpgithub.com/amati032-dev/crawlbit-mcpupdated this year
Four free MCP tools to check whether AI engines can find, read and recognise a website. No account, no API key, no LLM calls.
npm MIT