Commoncrawl MCP server
Use this MCP server to Common Crawl index discovery for historical web captures. Tools include...
0 stars
Reviews
Write oneNobody has reviewed Commoncrawl yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
Commoncrawl tools (3)
write = sends, deletes, buys or postsRead from the package source without running it. The installed server may list more.
latest_indexReturn the identifier of the newest Common Crawl index collection.
list_indexesList available Common Crawl web crawl index collections, newest first.
search_capturesFind historical Common Crawl captures matching a URL or wildcard pattern. This returns index metadata, not page contents.
Public scan report
scanner v0.1.9 · 2026-09-21 · same rubric, same numbers if you re-run it
- Code scan8 source files scanned25/25
- –Live reliabilityno gateway calls yet and no remote to proben/a
- –Tool poisoningtools not inspected (local package is not executed); not countedn/a
- Auth qualitylocal package, no credentials required12/15
- Maintenancelast push 44 days ago12/15
- Maintainer identityregistry namespace matches repository owner6/10
Install directly
Runs npx -y commoncrawl-mcp on your machine. Read the scan report first; the gateway never runs local packages.
claude mcp add commoncrawl-mcp -- npx -y commoncrawl-mcp
Commoncrawl: common questions
- Is Commoncrawl MCP server safe?
- Yes, by our scan: it is graded A (85/100). Read the Commoncrawl safety report
- How do I install Commoncrawl?
- It runs on your machine. Copy the Claude Code, Claude Desktop or Cursor config from the install section.
- Does Commoncrawl need an API key?
- Not as far as the registry entry and our scan can tell: no credentials are declared or required.
- Is Commoncrawl maintained?
- The last commit was 45 days ago (2026-08-08). The latest release is v1.0.1.
- What can I use instead of Commoncrawl?
- Servers from other publishers that do the same job: CRW Web Scraper MCP server, PyreCrawl MCP server and ReplyNodes MCP server. Compare all Commoncrawl alternatives.
Alternatives to Commoncrawl
Same job from other publishers: the closest match first, then the best rated.
CRW Web ScraperOpen-source web scraper for AI agents with scrape, crawl, and map toolsnot reviewedEstablishedA- PyreCrawlWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.not reviewedGrowingA
- ReplyNodesWeb MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.not reviewedGrowingA
Web ScrapingWeb scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.not reviewedGrowingA- SeleniumBase MCPStealthy browser automation, testing, and web-scraping via CDP Mode.not reviewedWidely usedA