evalpair
activeRun LLM eval suites, cache every call, and compare two runs item by item against a noise floor. CLI and MCP server.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/Srikarmk/evalpair
- Package
- pypi: evalpair
- Run (stdio)
uvx evalpairThe usual command for this package registry; check the repository README for required settings.- License
- MIT
- Last update
- 2026-11-08
- GitHub stars
- ★ 0
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.