AI Crawler Readiness MCP server
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Little public usage data yet
Reviews
Write oneNobody has reviewed AI Crawler Readiness yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
AI Crawler Readiness tools (4)
write = sends, deletes, buys or postsdomain_readinessFreeCan AI assistants actually read this domain? Returns the measured readiness score, the per-crawler verdict (served / blocked in robots.txt / refused by the edge despite robots.txt allowing it), and which edge vendor answers for the host. Measured live with real HTTP requests, not guessed from robots.txt alone.
edge_blockingFreeWho is actually doing the blocking: for each CDN/WAF vendor, the share of (domain x crawler) pairs that robots.txt ALLOWS and the server refuses anyway — i.e. how much of the blocking is an infrastructure default rather than a decision the site owner made.
measure_domainFreeMeasure a domain RIGHT NOW instead of reading the archive: six real HTTP requests, one from a browser user-agent and one per AI crawler user-agent, plus robots.txt / llms.txt / sitemap. Use it for any site the index has not reached yet, or when the caller wants a fresh verdict after changing robots.txt or a WAF rule.
web_opennessFreeHow much of the most-visited web is readable by AI assistants right now: the share of measured domains that block at least one AI crawler, and the served / robots-blocked / edge-blocked breakdown per crawler.
Public scan report
scanner v0.1.7 · 2026-09-19 · same rubric, same numbers if you re-run it
- –Code scanremote-only server, no package to scann/a
- Live reliabilityremote reachable in 1618ms20/20
- Tool poisoning4 tool descriptions checked15/15
- Auth qualityopen endpoint, read-only tools10/15
- Maintenanceno repository listed3/15
- Maintainer identityverified namespace with website, no repo4/10
Findings (1)
- lowNo source repository listed
maint.no-repo
Install directly
claude mcp add --transport http ai-crawler-readiness https://shop.lumnika.com/ai-readiness/mcp
AI Crawler Readiness: common questions
- Is AI Crawler Readiness MCP server safe?
- With care: it is graded C, so read the findings first (69/100). Read the AI Crawler Readiness safety report
- How do I install AI Crawler Readiness?
- It runs remotely at shop.lumnika.com. Add it to Claude Code, Claude Desktop or Cursor with the snippets above, or call it through the mcp.market gateway without installing anything.
- Does AI Crawler Readiness need an API key?
- Not as far as the registry entry and our scan can tell: no credentials are declared or required.
- Is AI Crawler Readiness maintained?
- The latest release is v1.0.0.
- Is AI Crawler Readiness up?
- 100% of our last 5 checks got an answer. We check remote servers about four times a day.