Back to code-only MCP servers

eval-judge-mcp

active

Judges agent/RAG outputs (relevance, hallucination, accuracy, routing, prompt injection) using Laya instead of LLM-as-judge -- usable as an MCP server or as a plain Python library.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository
github.com/ayanshefeek/eval_laya_mcp
Package
pypi: eval-judge-mcp
Run (stdio)
uvx eval-judge-mcp
The usual command for this package registry; check the repository README for required settings.
License
MIT
Last update
2026-09-28
Homepage
github.com/Ayanshefeek/eval_laya_mcp

Listed in

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.