eval-integrity
updated this yearDependency-free statistical checks for AI eval claims (multiple-comparisons, judge-bias, resolution, fragility) — as a CLI and an MCP server an agent calls before trusting a benchmark number.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/ipezygj/evalgate
- Package
- pypi: eval-integrity
- Run (stdio)
uvx eval-integrityThe usual command for this package registry; check the repository README for required settings.- License
- MIT
- Last update
- 2026-07-23
- Homepage
- ipezygj.github.io/eval-audit-site/
Listed in
- pypi · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.