Back to code-only MCP servers

llm-crawler-audit

active

Model Context Protocol (MCP) server for AI & LLM crawler readiness via NPX. Audits robots.txt for AI bots, validates /llms.txt, and verifies markdown mirror content negotiation.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository
github.com/surendranb/llm-crawler-audit
Package
npm: llm-crawler-audit
Run (stdio)
npx -y llm-crawler-audit
The usual command for this package registry; check the repository README for required settings.
License
MIT
Last update
2026-10-17

Adoption signals

Public signals from outside this directory, shown for context. They do not change search order or grades.

npm
1,053 downloads / 30 days
llm-crawler-audit

Listed in

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.