Back to code-only MCP servers

evalpair

active

Run LLM eval suites, cache every call, and compare two runs item by item against a noise floor. CLI and MCP server.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository
github.com/Srikarmk/evalpair
Package
pypi: evalpair
Run (stdio)
uvx evalpair
The usual command for this package registry; check the repository README for required settings.
License
MIT
Last update
2026-11-08
GitHub stars
★ 0

Listed in

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.