readfetch.com

Web reading for AI agents: readable text and site maps without a browser, browser rendering when JavaScript is required, and raw HTTP for everything else. Read-only web access for agents: twelve x402-paid endpoints on Base mainnet. Calls are plain HTTP+JSON POSTs to the URLs in `skills`; A2A task operations (message:send, tasks) are not implemented.

Skills

• text
  Fetch a public URL and return its main readable content as Markdown or plain text, plus title, author, published date and site name. Strips navigation, ads and boilerplate. No JavaScript rendering, so it costs a fraction of a browser scrape; use /v1/scrape when the content only appears after JavaScript runs.
  readabilityarticle extractionhtml to texthtml to markdownweb readercontent extractionmetadataopen graphno javascript
• map
  Discover a site's crawlable surface without crawling it: parse robots.txt allow/disallow rules, collect URLs from sitemap.xml and sitemap indexes, find RSS, Atom and JSON feeds, and count internal and external links on the homepage. Use the returned URLs to plan a /v1/scrape or /v1/crawl.
  sitemaprobots.txtrssatomfeed discoveryurl discoverysite mapcrawl planninglink inventory
• scrape
  JavaScript rendering and web scraping for agents: load a public URL in a real browser session, optionally scroll, wait for selectors, run JS, set headers, cookies or auth, and return Markdown, text or HTML with the page's links.
  scrapejavascript renderingbrowser renderingmarkdownhtmlspaweb scraping
• residential
  Identical request and response to /v1/scrape, but the render leaves through a residential address instead of the datacentre. For targets that block by IP reputation (DataDome, PerimeterX, Cloudflare, AWS WAF). One attempt, no retries: residential bandwidth is the cost, and four times the scrape price is what it takes to cover it honestly.
  residential proxyprotected sitesanti-botscrapebrowser rendering
• fetch
  Send an arbitrary HTTP request (GET, POST, PUT, PATCH, DELETE, HEAD) and return the response with status, headers and body, as text or base64. Intended for APIs, GraphQL, PDFs, byte ranges and large payloads where a browser is not needed.
  http clientraw httpapi callsgraphqlproxy
• batch
  Up to 50 URLs in one call and one payment. Results in input order; an undelivered page is not billed and is credited.
  batchbulkmultiple urlsconcurrentmarkdown
• pdf
  Documents, not pages: page text plus one Markdown body, priced per document.
  pdfdocument textpage textmarkdownmetadata
• section
  One heading or one selector instead of the whole page. A heading that is not found returns 200, an empty body and the list of headings that do exist.
  sectionheadingselectortokensdocs
• diff
  Stateless change detection: send the hash you hold, get changed/unchanged and a bounded diff. A no-change answer is billable.
  diffchange detectionhashmonitoringstateless
• screenshot
  PNG or JPEG of a rendered page: viewport, full page, or one element.
  screenshotpngjpegfull pageelement
• search
  Web search without a search subscription, returning titles, URLs and snippets.
  searchweb searchserpresultssnippets
• crawl
  Bounded async crawl with a job id, a page cap quoted up front, and per-page Markdown.
  crawlsiteasyncjobmarkdown
• probe
  Metadata before spending: status, content type, size, title, language and whether a bot wall is waiting. No page body, no browser, always free.
  probemetadatapreflightcontent typebot detection

How to call

https://readfetch.com

Listed in

Directories this entry was found in.