llm-evaluation-system
activeMCP server for agentic LLM evaluation: jury scoring, agent tracing via OpenTelemetry, document-grounded QA generation, PDF reports.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/awslabs/llm-evaluation-system
- Package
- pypi: llm-evaluation-system
- Run (stdio)
uvx llm-evaluation-systemThe usual command for this package registry; check the repository README for required settings.- License
- Apache-2.0
- Last update
- 2026-08-20
Listed in
- pypi · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.