saybench
activeBenchmark the full voice-AI pipeline on your own audio — STT (batch + streaming), LLM TTFT, speech-to-speech, and TTS. WER by failure mode, keyterm recall, real-time-paced latency, cost columns, a CI regression gate, and an MCP server for coding agents.
Code-only MCP server: no hosted endpoint, so you install and run it yourself. It is not probed, graded or counted in our reachability statistics.
Get it
- Repository
- github.com/renan-martini/saybench
- License
- MIT
- Last update
- 2026-09-09
- GitHub stars
- ★ 1
Listed in
- github · source
Run this server as a hosted endpoint? Submit the endpoint and it moves to the remote directory, where it is probed and graded.