humanloopbench
activeHuman-in-the-loop LLM Failure Detection & Benchmark Toolkit — Auto-flag LLM failures (hallucination, refusal, factual error) with LLM-as-Judge explanations. Confirm them in a review UI or via MCP agent — then export a citable benchmark validated against expert labels. Compatible with Ollama and Amazon Bedrock models.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/stevenincode/humanloopbench
- License
- not declared
- Last update
- 2026-11-06
- GitHub stars
- ★ 0
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.