digline

active

Regression testing for LLM applications in CI. Sample your reference and a score drop is read against how much that score moves on its own. A flip from pass to fail is always a regression. Python CLI, pytest plugin, MCP server.

Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.

Get it

Repository: github.com/digline/digline
Package: pypi: digline-openai
Run (stdio): uvx digline-openai
The usual command for this package registry; check the repository README for required settings.
License: Apache-2.0
Last update: 2026-11-14
GitHub stars: ★ 10
Homepage: digline.dev

baseline ci evals github-actions llm llm-evaluation llmops mcp mcp-server prompt-engineering pytest pytest-plugin

Listed in

github · source

Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.