MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
MCP server for crawling web pages and converting to markdown
npm MIT -
crawlgithub.com/vibheksoni/crawlupdated this year
Async web search, fetch, crawl, and screenshot tooling with SDK, CLI, and MCP interfaces.
★ 3 -
@groundcraft/crawlgithub.com/humphreytheodore/groundcraftupdated this year
Groundcraft Crawl — scrape, search, map and crawl the web through one metered API. CLI, SDK and MCP server.
npm MIT -
Crawl Engine - embeddable TypeScript web crawler with an MCP server for SEO, link, and schema analysis.
MIT ★ 1 -
Naver Finance web crawler with MCP server support - crawl Korean stock market data
npm MIT -
AI-powered web crawler — self-hosted Firecrawl alternative. Crawl, extract, render JS, search. CLI + MCP + REST API + Dashboard.
npm Apache-2.0 -
mcp-web-agentgithub.com/creatorpiyush/mcp-web-agentupdated this year
Token-economical web browsing, scraping, and crawling MCP server. Tiered fetching (static → browser), robots.txt compliance, session persistence, and BFS crawling.
npm MIT -
claude-browser-crawl-cdpgithub.com/gruncode/claude-browser-crawl-cdpupdated this year
Drive a real, logged-in Chrome from Claude Code over CDP — a persistent Playwright REPL, ~25x faster web crawling & automation.
MIT -
A Model Context Protocol (MCP) server providing ethical web crawling and search capabilities
npm MIT -
Local MCP for web search, direct-URL fetch, site crawling, docs export, and bounded smartbrowser local browser actions.
npm SEE LICENSE IN LICENSE -
exa-mcpgithub.com/2aronS/exa-mcpupdated this year
MCP server for web search and crawling using Exa API
MIT ★ 6 -
anycrawl-mcpupdated this year
AnyCrawl MCP Server - Adds powerful web scraping and crawling to Cursor, Claude and any other LLM clients
npm MIT -
anycrawl-mcp-serverupdated this year
AnyCrawl MCP Server - Adds powerful web scraping and crawling to Cursor, Claude and any other LLM clients
npm MIT -
@iflow-mcp/any4ai-anycrawl-mcp-serverupdated this year
AnyCrawl MCP Server - Adds powerful web scraping and crawling to Cursor, Claude and any other LLM clients
npm MIT -
Exa MCP for web search and web crawling!
npm MIT ★ 5,235 -
enhanced-crawl-mcpgithub.com/milhy545/enhanced-crawl-mcpupdated this year
Production-ready FastAPI microservice for web crawling optimized for AI/LLM consumption
★ 1 -
mcp-crawl4aigithub.com/wyattowalsh/crawl4ai-mcpupdated this year
Model Context Protocol server for web crawling powered by Crawl4AI
pypi MIT -
@octivas/mcpgithub.com/octivas/octivas-mcpupdated this year
MCP server for Octivas web scraping, crawling, and search API
npm MIT -
webcontext-aigithub.com/sumeeth-24/webscrapper-aiupdated this year
Turn any web content into clean AI-ready context — with crawling, chunking, semantic search, and MCP tools
npm MIT -
Model Context Protocol server for Spider Cloud web scraping and crawling API - LinkedIn profiles, anti-bot bypass, and more
npm MIT -
webmesh-mcpgithub.com/creatorpiyush/webmesh-mcpupdated this year
Token-economical web browsing, scraping, and crawling MCP server. Tiered fetching (static → browser), robots.txt compliance, session persistence, and BFS crawling.
npm MIT -
The web, saved for your agents. Local-first web retrieval: fetch, extract, save, search, crawl and cite via CLI and MCP.
npm Apache-2.0 -
webcrawl-mcpgithub.com/andyliszewski/webcrawlupdated this year
Lightweight MCP server for web scraping, search, and crawling — local-first with optional Firecrawl fallback
pypi MIT -
searchclaw-mcpupdated this year
MCP server for SearchClaw — Search, Extract, Crawl in One API. The complete web data pipeline for AI agents.
npm MIT -
Anakin plugin for OpenCode: Anakin's hosted MCP server (22 tools for web scraping, search, crawling, deep research, Wire site actions, monitors and browser tasks) plus Anakin skills
npm MIT -
MeshArc web crawler for Claude Code: search, scrape, map and crawl sites, and see what changed between crawls.
MIT -
anti-botgithub.com/TaroYamada08/anti-botupdated this year
Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls. 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
BSD-3-Clause ★ 1 -
A web crawling and conversion system that uses FastAPI and MCP to crawl websites and convert them into markdown.
MIT -
quanticdata-mcpactive
MCP server for the QuanticData API — scrape, search, map, crawl the web and pull residential/datacenter/mobile proxies for AI agents. Connect QuanticData to Claude, Cursor, and any MCP client.
npm MIT -
crawl4ai-mcp-servergithub.com/sadiuysal/crawl4ai-mcp-serverupdated this year
🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.
pypi MIT ★ 118 -
MCP servers for web intelligence - news aggregation, content crawling, SEO analysis, and web monitoring
npm -
quantumproxies-mcpactive
MCP server for the QuantumProxies API — scrape, search, map, and crawl the web through residential proxies, and hand AI agents ready-to-use proxies of every type (residential, mobile, datacenter, ISP, IPv6). Connect QuantumProxies to Claude, Cursor, and a
npm MIT -
Rust MCP web-intelligence server — fetch, extract, crawl, monitor, interact, PDF, semantic search
MIT ★ 2 -
A comprehensive web scraping API with MCP server integration, SDK, and Docker support. Features crawling capabilities, queue management, and TypeScript implementation.
-
web-searchgithub.com/Chi-9966/web-searchupdated this year
MCP server for multi-engine web search, fetch, crawl & vision — Baidu / Bing / DuckDuckGo / SearXNG
MIT ★ 1 -
Compare web scraping, crawling and SERP API pricing and limits against your workload and budget
-
Give Claude live web access via MCP: scrape pages, run Google searches and crawl sites from the chat.
MIT ★ 1 -
A tool for extracting structured content from web pages with customizable selectors and crawling options
npm MIT -
MCP server for crawling and indexing web documentation - works with any website
npm MIT -
MCP server for web search and reading (search, scrape, map, extract, crawl) that Dot, an always-on agent for macOS, uses
pypi MIT -
Web crawling tool that integrates with AI assistants via the MCP
pypi MIT ★ 45 -
Websift — bounded web search, research, mapping, scraping, and crawling over MCP
npm MIT -
A Model Context Protocol (MCP) server for web crawling and news extraction. Enables LLMs to browse the web, extract article content, and process news feeds using newspaper4k and modern web scraping techniques.
MIT ★ 1 -
pangu-mcpgithub.com/Pangu-MCP/pangu-mcpupdated this year
MCP web crawling plugin for Pangu Agent ecosystem · Apache 2.0
Apache-2.0 -
iflow-mcp_laurentvv-crawl4ai-mcpgithub.com/laurentvv/crawl4ai-mcpupdated this year
A powerful web crawling tool that integrates with AI assistants via the MCP (Machine Conversation Protocol)
pypi MIT -
A powerful Model Context Protocol (MCP) server for crawling websites and extracting assets including images and SEO metadata. Built for e-commerce sites and general web crawling needs.
MIT ★ 6 -
MCP server for the Spider Cloud web crawling and scraping API
MIT ★ 2 -
io.speedvault/mcpno update data
Run web performance audits, get code-level fixes, crawl for SEO, and read real-user Core Web Vitals.
npm -
MCP server for podcast discovery through web crawling
MIT ★ 4 -
Zed extension for Olostep, web data infrastructure for AI. Live web search, scraping and crawling API to extract and structure data.
MIT -
Firecrawl web scraping bridge — crawl, scrape, and extract structured data from websites — 5 MCP tools.
go MIT ★ 1 -
Firecrawl Web Scraping Serverno update data
Enable advanced web scraping, crawling, and content extraction capabilities for your agents. Perform deep research, batch scraping, and structured data extraction with automatic retries and rate limiting. Support both cloud and self-hosted deployments with seamless integration into popular MCP clients.
smithery -
crawlforgegithub.com/makaren-pro/crawlforgeupdated this year
Local-first web-context engine for AI agents with async crawling, BM25 retrieval, token-budgeted context, and MCP.
MIT -
MCP (Model Context Protocol) server for Crawl4AI - Universal web crawling and data extraction
pypi MIT -
Web scraping API and hosted MCP server for AI agents. Read public pages as Markdown, HTML, links, or JSON and run bounded crawls with Cloudflare Browser Run.
AGPL-3.0 -
Anakin power for Kiro: live web data (scrape, search, research, crawl, Wire, monitoring, browser) via Anakin's hosted MCP server
Apache-2.0 -
flycrawl-mcpactive
Model Context Protocol (MCP) server for FlyCrawl - Live web scraping and crawling for Claude Desktop & Cursor
npm MIT -
scrapy-mcpgithub.com/eitan3/scrapy_mcp_scraperupdated this year
Headless web-scraping MCP server built on Scrapy: fetch, extract (CSS/XPath), links, tables, sitemaps, robots, and async crawls.
pypi MIT -
Firecrawl Web Scraping Serverno update data
Enable advanced web scraping, crawling, and content extraction with support for JavaScript rendering, batch processing, and smart filtering. Perform deep research and structured data extraction using LLM-powered tools. Monitor credit usage and handle rate limits automatically for efficient and reliable web data integration.
smithery -
让 AI 代理访问互联网:抓取 · 爬取 · 搜索,内置反爬,$0 无密钥。Web research for AI agents: fetch, crawl & keyless search with anti-bot bypass.
pypi NOASSERTION ★ 8