AgentCrawl
activeAgentCrawl: Autonomous Multi-Agent Web Crawler & Anti-Bot SPA Extractor — A distributed, local-first multi-agent web crawling and structured data extraction platform engineered to bypass modern anti-bot WAFs (Cloudflare, Akamai, DataDome), hydrate dynamic SPAs, and enforce self-healing Pydantic v2 schemas.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/akmalkhaniub/AgentCrawl
- License
- not declared
- Last update
- 2026-09-24
- GitHub stars
- ★ 0
- Homepage
- akmalkhaniub.github.io/projects.html
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.