Mmcp.market

Head to head

Observatory vs Agent Eval

Same numbers we show everywhere else, lined up. Ratings come from users, the grade comes from our scanner, adoption comes from public registries.

Observatoryio.github.KryptosAI/mcp-observatory
B
No reviews yet

MCP security scanner. CI-native testing, attack simulation, health scoring, and SARIF.

Full listing
Agent Evalio.github.RudrenduPaul/agent-eval
A
No reviews yet

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

Full listing

The short version

Neither has been reviewed yet, so the comparison rests on the scan and the public usage numbers. The safety scan favours Agent Eval (85/100 against 77). Observatory has noticeably more public adoption.

 ObservatoryAgent Eval
User ratingNo reviews yetNo reviews yet
Safety gradeB77/100A85/100
AdoptionEstablishedGrowing
GitHub stars1390
Downloads / week38359
Runs whereYour machine (local)Your machine (local)
Gateway-readyNoNo
Tools—1
Write actions—1
Price per callFreeFree
LicenceMITApache-2.0
Last release2026-09-222026-09-18
CategoryDeveloper toolsDeveloper tools

Other comparisons

Observatory vs GitObservatory vs ContentrainObservatory vs WeavatrixObservatory vs GntObservatory vs BorealHostAll Developer tools servers