Back to code-only MCP servers

eval-integrity

updated this year

Dependency-free statistical checks for AI eval claims (multiple-comparisons, judge-bias, resolution, fragility) — as a CLI and an MCP server an agent calls before trusting a benchmark number.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository
github.com/ipezygj/evalgate
Package
pypi: eval-integrity
Run (stdio)
uvx eval-integrity
The usual command for this package registry; check the repository README for required settings.
License
MIT
Last update
2026-07-23
Homepage
ipezygj.github.io/eval-audit-site/

Listed in

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.