CrawlEyes MCP Server

by waiky-github·io.github.waiky-github/CrawlEyes·v0.2.0

Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.

B83/100grade B

What users say

No reviews yet

Safety scan

B83/100

Adoption

Growing

2 stars30 downloads/wk

Reviews

Nobody has reviewed CrawlEyes MCP Server yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

write = sends, deletes, buys or posts

Read from the package source without running it. The installed server may list more.

deep_research
深度调研：把主题拆成子问题→搜索→抓取→合成带引用的报告。 Uses SearXNG → Tavily keyless (no API key). Optional LLM synthesis via CRAWLEYES_LLM_* env vars; without them returns an evidence-aggregate report. Returns JSON with report (Markdown) + sources.
extract
抓取网页正文为 Markdown。自动去噪（过滤导航/广告），失败自动重试。返回前会剥离隐藏文字 + 标记可疑注入，防止 prompt-injection 劫持 Agent。 respect_robots=True 时先检查目标站 robots.txt (RFC 9309)，被 Disallow 则拒绝。 format: markdown(默认) | fit | raw | markdown_with_citations。 Returns JSON with title/markdown/length.
search
搜索网页。SearXNG 优先，失败自动 fallback Tavily keyless（无需 API key）。带统一限流 + 指数退避重试（最多 3 次）。 limit 会被 clamp 到 [1, 20]，防止传超大值打爆下游。 Returns JSON with title/url/description for each result.
sitemap
发现站点 URL 地图。解析 {origin}/sitemap.xml（支持 index/gzip），缺失时回退 robots.txt 的 Sitemap 声明。返回去重后的 URL 列表 JSON。用于整站抓取 / deep_research 扩 URL 源。带统一限流。

scanner v0.1.9 · 2026-09-20 · same rubric, same numbers if you re-run it

no findings

Code scan12 source files scanned25/25
–Live reliabilityno gateway calls yet and no remote to proben/a
–Tool poisoningtools not inspected (local package is not executed); not countedn/a
Auth qualitystatic API keys via environment variables6/15
Maintenancelast push 11 days ago15/15
Maintainer identityregistry namespace matches repository owner; GitHub account older than a year8/10

Overall 83/100. Components that don't apply are left out of the denominator. Any critical finding is an F.Rubric Appeal a finding JSON

claude mcp add CrawlEyes -- uvx crawleyes

Is CrawlEyes MCP Server safe?: Mostly: it is graded B (83/100). Read the CrawlEyes MCP Server safety report
How do I install CrawlEyes MCP Server?: It runs on your machine. Copy the Claude Code, Claude Desktop or Cursor config from the install section.
Does CrawlEyes MCP Server need an API key?: Yes. The registry entry asks for TAVILY_API_KEY.
Is CrawlEyes MCP Server maintained?: The last commit was 11 days ago (2026-09-09). The latest release is v0.2.0.
What can I use instead of CrawlEyes MCP Server?: Servers from other publishers that do the same job: SeleniumBase MCP server, Brightdata MCP server and Scrapeless MCP server. Compare all CrawlEyes MCP Server alternatives.

Same job from other publishers: the closest match first, then the best rated.

SeleniumBase MCP
Stealthy browser automation, testing, and web-scraping via CDP Mode.
not reviewed
Widely used
A
Brightdata
Bright Data's Web MCP server enabling AI agents to search, extract & navigate the web
not reviewed
Established
B
Scrapeless
Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
not reviewed
Established
A
PyreCrawl
Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
not reviewed
Growing
A
Video Extract
Download any video from a URL, or get its transcript and key frames. All local, no API keys.
not reviewed
Growing
A

Local package. It runs on your machine, not through the gateway.

SEARXNG_URLOptional. Base URL of a SearXNG instance (e.g. http://localhost:8080). If unset, falls back to Tavily keyless.
TAVILY_API_KEYsecretOptional. Tavily API key for higher-rate search fallback. If unset, uses Tavily keyless (rate-limited).

Claim it to keep the listing current and reply to reviews. Claiming never changes the grade or hides a review.

Shows the safety grade and links back to this page. It updates itself after every scan and review.

[![mcp.market](https://mcp.market/badge/waiky-github-crawleyes.svg)](https://mcp.market/server/waiky-github-crawleyes)