MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
—
★ 4 -
mcp-web-scrapergithub.com/Aniruddha1202/mcp-web-scraperupdated this year
testing mcp
-
amazon-q-web-scraper-mcpgithub.com/JMRMEDEV/amazon-q-web-scraper-mcpupdated this year
—
-
github.com/lmorg/mcp-web-scrapergithub.com/lmorg/mcp-web-scraperupdated this year
—
go MIT -
mcp-web-scrapergithub.com/iamseyhmus7/mcp-web-scraperupdated this year
Autonomous Playwright-based web scraper via MCP protocol
pypi MIT -
基于 MCP 的网页爬取服务器,内置 Puppeteer 无头浏览器支持
npm MIT -
Web Scraper MCP Server — Scrape any web page with CSS selectors, AgentPay Pro upsell
npm MIT -
—
-
mcp-web-scraper-servergithub.com/null-create/mcp-web-scraper-serverupdated this year
A simple MCP server that provides basic web scraping functionality for AI Agents and Large Language Models
-
MCP server for scraping images and text from websites with comprehensive web content extraction capabilities
npm MIT -
Customizable web scraper that can be used to build a knowledge base which can be integrated with a RAG system for Search. Supports MCP integration as well for querying
MIT ★ 2 -
Ready-to-use web scrapers (Google Search SERP scraper, YouTube scraper and more) as a scraping API and MCP tools for AI agents.
MIT ★ 1 -
web-scraper-toolkitgithub.com/lazymac2x/web-scraper-toolkitupdated this year
Universal Web Scraper API - extract metadata, links, headlines, images, tables. REST + MCP.
★ 1 -
911-scraper-mcpgithub.com/911-proxy/911-scraper-mcpupdated this year
911Proxy Universal Web Scraper MCP Server - supports HTML extraction and screenshots
npm MIT -
scraper-builder-mcpupdated this year
MCP server for building and running web scrapers with Playwright
npm -
wafle-scrapergithub.com/creandoaldia/wafle-scraperupdated this year
Wafle-Scraper — universal MCP server for safe web scraping with browser automation. Incognito, isolated, audited.
pypi MIT -
SnapAPI-AI-Ready-Scrapergithub.com/Mulliner11/SnapAPI-AI-Ready-Scraperupdated this year
AI-Ready Web Scraper & Data Pipeline: Turns any URL into clean Markdown/JSON for LLMs & RAG. Built-in MCP server.
-
scraper-api-mcpgithub.com/bitterdev/scraper-api-mcpupdated this year
MCP server for scraper-api.com — one tool per endpoint. Pull public web data (social platforms, business directories, real estate) as JSON from your agent.
MIT -
@pinkpixel/prysm-mcpstale
MCP server for the Prysm web scraper - enabling AI assistants to scrape web content
npm MIT -
MCP Server for Incredibly High Performant web scraper (seconds for what takes others lots of minutes) - battle tested on millions of websites.
MIT ★ 1 -
harvestgithub.com/zad111ak-ai/harvestupdated this year
Open-source AI web scraper with Cloudflare bypass, LLM extraction, and MCP server. Free alternative to Firecrawl & Crawl4AI.
pypi MIT ★ 2 -
snarf: a fast Rust web scraper that turns pages into clean Markdown for LLMs. CLI, HTTP API, MCP server and desktop app. MIT/Apache-2.0.
Apache-2.0 ★ 1 -
Local bridge exposing the Gemini web session as an OpenAI-compatible API, a Google-native API, and MCP tools, with a guarded web scraper and cited research.
NOASSERTION ★ 2 -
magpiegithub.com/MBemera/magpieupdated this year
🪶 A polite, suspicious web scraper for AI agents. Collects the shiny things, leaves the junk, trusts nothing. CLI + library + MCP server.
MIT ★ 1 -
⚡ Production-grade, HTTP-first web scrapers and AI MCP tools for Apify. Zero cookies, sub-5s speed, and Pay-Per-Event pricing.
-
nascoder-terminal-browser-mcpgithub.com/freelancernasimofficial/nascoder-terminal-browser-mcpstale
🌐 Ultimate Standalone Terminal Browser & Web Scraper MCP - Browse any website, extract content & links directly in terminal with zero file pollution. 100% standalone with smart fallbacks. Enhanced by optional terminal browsers (lynx/w3m). Perfect for doc
npm MIT -
A self-learning web scraper that uses LLMs to generate CSS extraction schemas once per page template, then caches and auto-generalizes URL patterns. Zero manual selectors. Zero maintenance. FastAPI + MCP server included.
MIT -
mtn project web scraper and mcp
-
Modular web scraper with Clean Architecture — wreq TLS fingerprinting, RAG export, MCP server, TUI, AI semantic cleaning. 1,337 tests, Miri verified.
MIT -
purifygithub.com/Easonliuliang/purifyupdated this year
Single-binary web scraper for AI agents. Headless Chrome + Readability → clean Markdown. Up to 99% token savings. Zero dependencies. Built-in MCP server.
Apache-2.0 ★ 3 -
HTML to Markdown Converter MCP Server 2026 - Web Scraper & Clean Markdown Generator
★ 1 -
web-scrapper-stdiogithub.com/JustAzul/web-scrapper-stdioupdated this year
MCP web scraper with persistent browser pool, Cloudflare bypass (Patchright + Turnstile solving), and dual transport (stdio + HTTP). Extracts Markdown/text/HTML from web pages for AI integration.
MIT -
Valkyriegithub.com/tejaskembalkar-ship-it/Valkyrieupdated this year
Adaptive signal-research engine: self-healing web scrapers that surface buying signals, with anti-bot resilience and an MCP server for on-demand research.
BSD-3-Clause -
Valkyriegithub.com/ishanbhosale08/Valkyrieupdated this year
Adaptive signal-research engine: self-healing web scrapers that surface buying signals, with anti-bot resilience and an MCP server for on-demand research.
BSD-3-Clause -
Self-hosted web scraper for AI agents. Turn any URL into clean Markdown, crawl and map sites, search the web, extract JSON. Python, FastAPI, Playwright, MCP server and CLI.
MIT -
Pagecraft Tools for AI agents: 32 web data tools (site audits, scrapers, OCR, PDF text) via the Apify MCP server. Pay per result.
-
scprgithub.com/AstraBert/scprupdated this year
Web scraper CLI and MCP built for human and coding agents
npm MIT ★ 11 -
EveryInfra organization profile: scraper APIs, web search, CAPTCHA solving and AI for developers and AI agents — remote MCP server plus Claude Code, Codex and Cursor plugins.
-
liciumgithub.com/Licium-ai/liciumupdated this year
Clean rows from public web pages that break ordinary scrapers. CLI, SDK, and MCP server, plus a public bounty board where agents earn money. Mirror of the npm package.
MIT -
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
go Apache-2.0 ★ 21,418 -
mcp-serversgithub.com/bhupendra05/mcp-serversupdated this year
Production-ready MCP servers for Claude — GitHub Issues, PostgreSQL, Web Scraper, Filesystem
MIT -
A simple MCP server that integrates eGet web scraper with Claude for Desktop. This connector allows Claude to scrape web content through your local eGet API, enabling search, summarization, and analysis of websites directly in conversations.
★ 4 -
one-search-mcpgithub.com/yokingma/one-search-mcpupdated this year
🚀 OneSearch MCP Server: Web Search & Scraper & Extract, Support agent-browser, SearXNG, Tavily, DuckDuckGo, Bing, etc.
npm MIT ★ 148 -
A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to easily generate web scrapers for various types of websites.
MIT ★ 7 -
ai-researcher-agentgithub.com/evanyfyip/ai-researcher-agentupdated this year
AI Researcher Agent: a LangChain-based MCP tool that aggregates web, ArXiv, and custom scraper results, summarizes them with an LLM, and produces styled HTML/Markdown reports (with banners, collapsible source cards, and JSON artifacts) for pulse and targeted research.
-
Self-hosted, Firecrawl-compatible CRW web scraper with stealth Chrome and Camoufox tiers built from upstream source, plus an MCP server for Claude, Codex and Antigravity
AGPL-3.0 -
Give your AI agent the web as an API. MCP server + skill for Claude Code, Codex & Cursor: self-healing scrapers for Google Maps, Amazon, Instagram, X, LinkedIn & more. Firecrawl- and Apify-compatible.
MIT ★ 8 -
Stealth Multimodal Web Scraper & 0-Day Phishing Shield for AI Agents. Alternative to Firecrawl & Crawl4AI with zero-CSS vision extraction, 200 free trial credits, and native LangChain / ElizaOS / MCP support.
npm MIT ★ 3 -
TheCrawlergithub.com/manchittlab/TheCrawlerupdated this year
Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.
npm AGPL-3.0 ★ 2 -
bluefieldgithub.com/danielvhofmann/bluefieldupdated this year
Local first web scraper that turns any URL into clean Markdown or JSON and signs every capture with an offline verifiable Ed25519 provenance manifest called BPM. Git like history and diff for web data, plus an MCP server so AI agents can prove what they read. TypeScript monorepo, AGPL-3.0 engine, Apache-2.0 spec and SDKs.
AGPL-3.0 ★ 1 -
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
cargo Apache-2.0 ★ 274 -
Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.
pypi MIT ★ 265 -
crwgithub.com/fastcrw/crwactive
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
cargo AGPL-3.0 ★ 1,260 -
@123pzy/web-scraperupdated this year
网页爬取MCP服务器 - 获取和解析网页内容
npm MIT -
A comprehensive web scraping API with MCP server integration, SDK, and Docker support. Features crawling capabilities, queue management, and TypeScript implementation.
-
A free, local MCP server that gives Claude web scraping powers. 24 tools, four escalating fetch tiers, no API key.
MIT ★ 1 -
simple-web-crawler-scraper-extensiongithub.com/surypratapsingh/simple-web-crawler-scraper-extensionactive
Browser extension + local MCP server giving Claude and other AI agents cheap, read-only eyes on your real browser tabs: read, extract, crawl and export pages locally.
MIT -
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
go Apache-2.0 ★ 110 -
safe-scrapergithub.com/belowthestack/safe-scraperupdated this year
A web scraper with built-in credibility-risk detection for blackhat signal manipulation
-
Drop-in Firecrawl-compatible web data extraction MCP server for Claude Code and Cursor
MIT