MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
mcp-web-scraper-servergithub.com/null-create/mcp-web-scraper-serverupdated this year
A simple MCP server that provides basic web scraping functionality for AI Agents and Large Language Models
-
web-scraper-toolkitgithub.com/imyourboyroy/webscrapertoolkitupdated this year
A powerful, standalone web scraping toolkit using Playwright and various parsers.
pypi MIT -
—
-
A free, local MCP server that gives Claude web scraping powers. 24 tools, four escalating fetch tiers, no API key.
MIT ★ 1 -
safe-scrapergithub.com/belowthestack/safe-scraperupdated this year
A web scraper with built-in credibility-risk detection for blackhat signal manipulation
-
SnapAPI-AI-Ready-Scrapergithub.com/Mulliner11/SnapAPI-AI-Ready-Scraperupdated this year
AI-Ready Web Scraper & Data Pipeline: Turns any URL into clean Markdown/JSON for LLMs & RAG. Built-in MCP server.
-
scraper-api-mcpgithub.com/bitterdev/scraper-api-mcpupdated this year
MCP server for scraper-api.com — one tool per endpoint. Pull public web data (social platforms, business directories, real estate) as JSON from your agent.
MIT -
Model Context Protocol (MCP) integration for Scraper.is - A web scraping tool for AI assistants
npm MIT -
harvestgithub.com/zad111ak-ai/harvestupdated this year
Open-source AI web scraper with Cloudflare bypass, LLM extraction, and MCP server. Free alternative to Firecrawl & Crawl4AI.
MIT ★ 2 -
@iflow-mcp/yokingma-one-search-mcpgithub.com/yokingma/one-search-mcpupdated this year
One Search MCP Server, Web Search & Crawl & Scraper & Extract, support agent-browser, SearXNG, Tavily, DuckDuckGo, Bing, etc.
npm MIT -
magpiegithub.com/MBemera/magpieupdated this year
🪶 A polite, suspicious web scraper for AI agents. Collects the shiny things, leaves the junk, trusts nothing. CLI + library + MCP server.
MIT ★ 1 -
⚡ Production-grade, HTTP-first web scrapers and AI MCP tools for Apify. Zero cookies, sub-5s speed, and Pay-Per-Event pricing.
-
Anti-bot web scraper returning token-optimized Markdown for AI agents ($0.002 USDC on Base).
-
fastmcp-web-explorergithub.com/78488393929/fastmcp-web-explorerupdated this year
FastMCP web explorer and scraper for AI agents.
-
web-scrapper-stdiogithub.com/JustAzul/web-scrapper-stdioupdated this year
MCP web scraper with persistent browser pool, Cloudflare bypass (Patchright + Turnstile solving), and dual transport (stdio + HTTP). Extracts Markdown/text/HTML from web pages for AI integration.
MIT -
HTML to Markdown Converter MCP Server 2026 - Web Scraper & Clean Markdown Generator
★ 1 -
Pagecraft Tools for AI agents: 32 web data tools (site audits, scrapers, OCR, PDF text) via the Apify MCP server. Pay per result.
-
Web scraper & crawler → clean Markdown with byte-level SHA-256 provenance + WARC archival for LLM/RAG knowledge bases
MIT ★ 2 -
liciumgithub.com/Licium-ai/liciumupdated this year
Clean rows from public web pages that break ordinary scrapers. CLI, SDK, and MCP server, plus a public bounty board where agents earn money. Mirror of the npm package.
MIT -
one-search-mcpgithub.com/yokingma/one-search-mcpupdated this year
🚀 OneSearch MCP Server: Web Search & Scraper & Extract, Support agent-browser, SearXNG, Tavily, DuckDuckGo, Bing, etc.
MIT ★ 148 -
LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
MIT ★ 11 -
Self-hosted, Firecrawl-compatible CRW web scraper with stealth Chrome and Camoufox tiers built from upstream source, plus an MCP server for Claude, Codex and Antigravity
AGPL-3.0 -
Give your AI agent the web as an API. MCP server + skill for Claude Code, Codex & Cursor: self-healing scrapers for Google Maps, Amazon, Instagram, X, LinkedIn & more. Firecrawl- and Apify-compatible.
MIT ★ 8 -
bluefieldgithub.com/danielvhofmann/bluefieldupdated this year
Local first web scraper that turns any URL into clean Markdown or JSON and signs every capture with an offline verifiable Ed25519 provenance manifest called BPM. Git like history and diff for web data, plus an MCP server so AI agents can prove what they read. TypeScript monorepo, AGPL-3.0 engine, Apache-2.0 spec and SDKs.
AGPL-3.0 ★ 1 -
TheCrawlergithub.com/manchittlab/TheCrawlerupdated this year
Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.
AGPL-3.0 ★ 2 -
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
npm Apache-2.0 ★ 274 -
crwgithub.com/fastcrw/crwactive
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
npm AGPL-3.0 ★ 1,259 -
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
Apache-2.0 ★ 110 -
Stealth browser for web scraping and AI agents: undetected Chrome over raw CDP, Cloudflare Turnstile, closed Shadow DOM & cross-origin iframes, HTML to Markdown, MCP server, LLM structured extraction (bring your own model). Puppeteer alternative.
npm MIT -
Drop-in Firecrawl-compatible web data extraction MCP server for Claude Code and Cursor
MIT -
MCP server for scraping LinkedIn, Facebook, Instagram profiles and Google search.
★ 98 -
mcp-server-scrapergithub.com/ofershap/mcp-server-scraperupdated this year
MCP server for web scraping — extract clean markdown, links, metadata from any URL
MIT ★ 6 -
MCP server giving Claude Desktop / Cursor / Cline ad-free web scraping + search via three tools: fetch_page, fetch_pages_batch, search_web.
MIT ★ 2 -
MCP server that gives any LLM agent ad-free Markdown web scraping and search.
pypi MIT -
mcp-server-scrapergithub.com/ofershap/mcp-server-scraperupdated this year
MCP server for web scraping — extract clean markdown, links, and metadata from any URL. Zero auth. Free alternative to Firecrawl.
npm MIT -
29+ Model Context Protocol (MCP) & Apify Cloud B2B Lead Generation, SEC EDGAR, GitHub Recruiter, ClinicalTrials/OpenFDA, Cybersecurity & DeFi Scrapers
-
MCP server for HTML scraping and data extraction using Puppeteer
npm MIT -
Extract validated phone numbers, WhatsApp links, and direct contact emails from local business websites. MCP Server & Python SDK.
MIT -
cn-scraper-mcpgithub.com/goesByhc/cn-scraper-mcpupdated this year
Let AI agents search the Chinese internet via MCP — Taobao, JD, Xiaohongshu, Zhihu, Weibo, Bilibili, ZSXQ, Douban, Dianping, and more.
MIT ★ 80 -
40 read-only public-data tools for MCP and Apify: leads, news, SEO, CVEs, jobs, SEC, procurement, registries, health, and media data.
MIT -
Web search, page reading and browser automation for Python and AI agents. Search Brave, DuckDuckGo, Yahoo, Mojeek, Google and Bing with no API key, read pages as clean Markdown, and give both to agents as OpenAI, Anthropic, LangChain, LlamaIndex or CrewAI tools, or over MCP. Browser TLS impersonation, consensus ranking, honest block detection, caching, Selenium and Playwright.
pypi MIT -
Bilibili Scraper API (哔哩哔哩 / B站爬虫) — Extract Bilibili videos, XML danmaku bullet comments, user comments with IP geolocation, UP主 creator uploads & Top 100 rankings without cookies or login. Ready for Python, JS, n8n & Claude MCP.
★ 1 -
mcp-serp-scrapergithub.com/dppalukuri/mcp-serp-scraperupdated this year
MCP server for Google & Bing SERP extraction — organic results, ads, featured snippets, PAA, keyword research, rank checking. Free, no API keys needed.
-
2Captcha MCP server for AI agents with web search, web scraping, browser automation, captcha solving, and scalable web data collection.
npm MIT -
The OpenRouter for tools. One MCP connection gives any AI agent 254 hosted tools, pay per call.
MIT -
Spicrawl plugin for OpenCode: adds the Spicrawl MCP server so agents can scrape web pages to Markdown or JSON
npm Apache-2.0 -
Teach your agent a web page once, then fetch fresh JSON over plain HTTP. CLI and MCP server for saving reusable scraping recipes.
npm MIT -
cn-scraper-mcpgithub.com/goesbyhc/cn-scraper-mcpupdated this year
MCP server for Chinese web platforms including Taobao, JD, Bilibili, Douban, Dianping, Xiaohongshu, Zhihu, and Weibo.
pypi MIT -
Teach your agent a web page once, then fetch fresh JSON over plain HTTP. CLI + MCP server for reusable scraping recipes.
MIT -
MCP servers for AI agents — Google Maps lead gen, SERP scraper, LinkedIn scraper, CAPTCHA solver, UAE real estate. Free, open-source, no API keys needed.
MIT ★ 5 -
MCP & ETL for biggest czech web job servers - jobs.cz, prace.cz, bazos.cz, jenprace.cz, profesia.cz, volnamista.cz
-
mcp-web-fetchgithub.com/pavex/mcp-web-fetchupdated this year
Token-efficient web reading and HTTP requests for MCP agents.
-
Unofficial MCP server for AKSes KSEI (akses.ksei.co.id) portfolio data
★ 2 -
URL to Markdown for AI agents and LLMs: turn any public web page into clean Markdown (HTML to Markdown, SSRF-safe, robots.txt-aware). MCP server (stdio + remote), zero-dependency library and x402 pay-per-call API ($0.002 USDC on Base).
npm MIT -
MCP server for using ScrAPI to scrape web pages.
npm MIT -
mcp-web-toolsgithub.com/datvietvac-techhub/mcp-web-toolsupdated this year
MCP web tools (advance search, content extractor...) for AI agent
Apache-2.0 ★ 3 -
Hong Kong Labour Department Job Listing Scraper & AI Agent
MIT -
Self-hostable MCP search, public-page fetch and Markdown extraction
npm MIT -
apeirongithub.com/insomnia-me/apeironupdated this year
Local-first web search, fetch, and extraction tools for AI agents
MIT -
Bing-Search-Agentgithub.com/yanay1124/Bing-Search-Agentupdated this year
本地爬蟲並透過llm統整內容的工具
Apache-2.0 ★ 3