MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
gptbotgithub.com/BeduSec/gptbotupdated this year
An mcp server for chatgpt still in need of improvement
★ 1 -
robots.txt generator, validator and checker for AI crawlers (GPTBot, ClaudeBot and more). API + MCP server.
MIT -
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) can access your site. CLI, library, MCP server and GitHub Action.
npm MIT ★ 3 -
AI crawler checker: Chrome extension + MCP server that shows which content GPTBot, ClaudeBot and other AI crawlers can't see because it needs JavaScript (raw HTML vs rendered).
npm AGPL-3.0 -
Website analyzer API: detect tech stack (WordPress/Wix/Shopify), SEO issues, AI-crawler visibility (GPTBot/ClaudeBot), real transfer size and keyword targeting. Free tier, no signup. Polish-first. | Prześwietlarka stron — API
NOASSERTION -
Is this website ready for AI agents? MCP server + client for the AgentReady audit: robots.txt rules for 17 AI bots (GPTBot, ClaudeBot, ChatGPT-User, PerplexityBot...), bot challenges, content in raw HTML, markdown, llms.txt, sitemap, JSON-LD, Open Graph,
npm MIT -
Free, open-source CLI and MCP server that checks whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot) and search engines can access your website: robots.txt, llms.txt, sitemap, JSON-LD, meta tags, JavaScript rendering and Common Crawl presence. Runs locally.
npm MIT -
Does blocking GPTBot remove you from ChatGPT? No — OAI-SearchBot is the token that does. Free robots.txt AI-crawler checker (CLI + MCP server) and open data on 165 AI crawlers: which cost you AI answers in ChatGPT, Perplexity and Claude when blocked, and which cost nothing. Includes a 70-store survey.
mcpb MIT -
MCP server that checks whether a website is set up for AI the way its owner intends: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers read it, and what does its access policy allow? Generates llms.txt, an AI-crawler robots.txt and JSON-LD, reads your Answer Analysis, and checks whether a page permits an AI use.
npm MIT -
Why Won't AI Mention My Product: see what GPTBot, ClaudeBot, PerplexityBot and CCBot get from your website. https://whywontai.com/
MIT -
MCP companion to the Prerender Buddy platform for crawler diagnostics and optional workspace evidence.
npm Apache-2.0 ★ 1 -
crawlbit-mcpgithub.com/amati032-dev/crawlbit-mcpupdated this year
Four free MCP tools to check whether AI engines can find, read and recognise a website. No account, no API key, no LLM calls.
npm MIT ★ 1 -
Is this page readable for AI search? Checks crawler access, structure and citability for ChatGPT, Perplexity, Claude and Google AI. CLI and MCP server, runs entirely on your machine.
npm MIT -
A free AEO audit for your terminal and your agent: what AI crawlers can read on any page, with supereo's free MCP tools. CLI, agent skill and local MCP server.
MIT