evalmcp
updated this yearEvaluation for AI agents — judge-based scoring and native RAG metrics (faithfulness, relevancy, context precision/recall). Python lib · CLI · MCP server · FastAPI.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/gashel01/evalmcp
- License
- Apache-2.0
- Last update
- 2026-06-22
- GitHub stars
- ★ 1
- Homepage
- mcpaisuite.com/libraries/evalmcp
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.