WebCrawlerAPI Agent

WebCrawlerAPI · https://webcrawlerapi.com

https://webcrawlerapi.com/.well-known/agent-card.json

● healthy

AI-powered web crawling and scraping agent. Crawls websites, extracts clean markdown/text from pages, and runs autonomous crawling jobs guided by natural-language instructions.

Transport

—

Protocol

—

Price

—

A2A readiness

D · 46/100

Readiness is how fully this listing follows its protocol and how it behaved in our probes over 30 days. It is shown for reference and does not move it in search. Search order and leaderboards use the separate quality grade (here C+, 90.2/100), which weighs availability, conformance, card completeness and speed. How the two differ

Valid Agent Card	10/10	Parseable Agent Card with the required fields.
Live JSON-RPC	0/25	Endpoint did not answer (419 ms).
Protocol version	0/10	No A2A protocol version declared.
JWS signature	0/10	Card is unsigned.
Uptime (30 days)	15/15	3/3 probes succeeded; final after 5 probes in 30 days.
Skill declaration	10/10	Declares 3 skill(s) with structured metadata.
Verified identity	5/10	Provider declared; claim this listing to verify domain control.
Freshness + modern flags	4/5	seen in a source within 7 days.
Security declaration	2/5	Declares 1 security scheme(s).

Responsiveness: Responsive (419 ms; bands ≤2.5 s, ≤5 s, ≤8 s, slower; penalty only).

Measured 2026-11-11.

Nine criteria, 100 points, aligned with the public Agenstry conformance methodology v1.1. Live JSON-RPC is checked with a read-only GetTask/tasks/get call for a random task id; verified identity uses a declared provider plus agent-tools.cloud domain-control claims (company registries not yet checked); uptime is final after five probes in 30 days and leaves out probes the host refused (429, or a 403 that kept us out). Grades: A>=90, B>=75, C>=60, D>=40, F<40. Display only: search order uses the quality grade.

Compared with peers

Against 6,309 reachable A2A agents in our daily snapshot (2026-11-12 01:05 UTC). Display only; it does not change search order.

Readiness: Higher than 35% of peers; This listing 46 · peer median 54
Latency: Faster than 60% of peers; This listing 337 ms · peer median 398 ms

Where it loses the most points, and how to win them back

Live JSON-RPC −25 — Answer JSON-RPC at the URL the Agent Card declares.
Now: Endpoint did not answer (419 ms).
Protocol version −10 — Support the current protocol revision.
Now: No A2A protocol version declared.
JWS signature −10 — Sign the Agent Card (JWS).
Now: Card is unsigned.

How many agent tools actually work · All statistics

Skills

Scrape a page

Fetches a single URL with a headless browser and returns its content as clean markdown, text, or HTML.

scrapemarkdownhtmljavascript-rendering
Crawl a website

Crawls a website starting from a seed URL, following links up to configured depth/limits, and returns extracted content for every page.

crawlwebsitemarkdownbulk
Autonomous crawling agent

Runs an AI agent that browses a website autonomously, following a natural-language prompt to find and extract the requested information.

agentaiautonomousextraction

How to call

A2A endpoint (JSONRPC)

https://api.webcrawlerapi.com/v1

Agent card

https://webcrawlerapi.com/.well-known/agent-card.json

Documentation

https://webcrawlerapi.com/docs/getting-started

Homepage

https://webcrawlerapi.com

Listed in

Directories this entry was found in.

a2aregistry since 2026-08-12 agenstry since 2026-09-08 a2a-registry since 2026-10-22