MCP servers that ship as code — a repository or a package you install and run locally (usually over stdio). They have no hosted endpoint, so we cannot probe or grade them: instead each one shows its repository, install command, license, stars and when it was last updated.
Collected from GitHub repositories and npm, PyPI, Cargo, Go, Maven, NuGet and RubyGems packages tagged as MCP servers, the official MCP Registry, Docker's MCP catalog, ModelScope, Baidu MCP World, Cline and other public directories; one entry per repository. A server that also offers a hosted endpoint is listed under Remote instead. These entries are not counted in our reachability, verification or readiness statistics.
-
CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
Apache-2.0 ★ 16 -
AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices
Apache-2.0 ★ 19 -
Agentic toolkit for building and optimizing high-performance inference engines tailored to your GPU and desired LLM.
pypi Apache-2.0 ★ 48 -
OpenAI-compatible inference for open-weight models, set up by your coding agent. Prepaid, pay per token, no subscription. US live; Canada coming soon.
npm MIT -
⚡ Ultra-fast O(1) Active Inference & Bayesian Cognitive Governor for AI Agents (Antigravity, Claude, Cursor) & Embedded Systems. Zero-alloc C11 core (<36KB) + FastMCP server.
MIT ★ 5 -
diffusion-llm-mcpgithub.com/sandraschi/diffusion-llm-mcpupdated this year
FastMCP fleet MCP server for diffusion LMs (dLLM). DiffusionGemma on Goliath RTX 4090 — batch inference, HLE-shaped reasoning, ~200–400 tok/s. Doc phase; llama-diffusion-cli sidecar next. Complements local-llm-mcp.
MIT ★ 2 -
Exposes the PyMDP active-inference library to AI agents and applications over the Model Context Protocol and a plain REST API: build generative models, infer states and policies, and simulate agents in environments
MIT ★ 3 -
InferFundgithub.com/theabbie/InferFundupdated this year
Donate AI inference to advance open mathematical problems.
-
omni-nligithub.com/CogitatorTech/omni-nliupdated this year
A multi-interface (REST and MCP) server for natural language inference
MIT ★ 3 -
TypeScript type inference inspection tool for AI coding assistants
npm MIT ★ 1 -
mcpgithub.com/cheapestinference/mcpupdated this year
Remote MCP server for CheapestInference — discover unlimited LLM inference pools, subscribe with USDC on Base, get connected from any MCP client
-
genie-lockergithub.com/nhantour/genie-lockerupdated this year
Read-only MCP connector and public API for quality-gated, ephemeral private AI inference.
MIT -
bridgenode-mcpgithub.com/applefanaimail-blip/bridgenode-mcpupdated this year
BridgeNode — AI inference without API keys. Pay per request with Solana USDC via x402 (alias for the bridgenode toolkit).
pypi MIT-0 -
Agent Skills and an MCP server for GPU performance profiling, benchmarking, optimization, and reporting, with an inference focus.
MIT ★ 4 -
Claude Code and Codex plugin for deeplit: manage GPU inference instances, volumes, models and billing from your coding agent, authorized by a scoped API key.
Apache-2.0 ★ 2 -
⚡ Ultra-Reliable AI Inference Gateway & Verifiable Agent Control Plane. Dual-Dispatch, Zero-Token JSON Auto-Healer, VaaS On-Chain Attestation, FastMCP & Vercel AI SDK.
Apache-2.0 ★ 89 -
TypeScript inferred types, completions and type errors for AI coding agents and type tests: an MCP server, a CLI, and snapshot-test helpers
npm MIT -
Benchmark local LLM inference speed (tokens/sec) on your own hardware — llama.cpp native + cloud APIs, 124-model catalog, optimal-quant picker, and an MCP serve mode.
MIT ★ 2 -
Tenchi-MCPgithub.com/DovahkiinYuzuko/Tenchi-MCPupdated this year
[ENG] A hybrid cloud/local LLM inference orchestrator via Model Context Protocol (MCP) and Ollama / [JPN] Model Context Protocol (MCP) と Ollama を活用したクラウド・ローカル LLM ハイブリッド推論オーケストレーター
MIT -
Privacy-first visual grounding fallback with local inference and DOM-visual hybrid routing for MCP browser agents.
AGPL-3.0 -
Autonomous Biophysical Causal Inference and Farquhar-Governed Invariant Framework for Multi-Stress Crop Decoupling over Model Context Protocol (MCP v2025-11-25)
MIT -
GSTD Network MCP server — decentralized inference for Claude Code. Run Llama 3, Mistral, CodeLlama, Qwen, DeepSeek and 50+ open-source models for free, no API key.
npm Apache-2.0 -
🌍 MCP server giving Claude live environmental data: air quality, wildfires, and weather, plus statistical anomaly detection and causal inference (DoWhy) to explain why pollution spikes happen.
MIT -
MCP server for Gate402: pay-per-call agent APIs over x402. Open-model LLM inference, Base trading data, SEC filings and web scraping. 20 tools, free tier, no signup.
npm MIT ★ 1 -
AI model router for agents. Checks whether a local model can handle the task before calling cloud inference. LOCAL/CLOUD verdict saves cost on every call.
npm MIT -
hermes-botcoingithub.com/botcoinmoney/hermes-botcoinupdated this year
Native BOTCOIN proof-of-inference mining for Hermes Agent. Plugin + CLI + MCP server + autonomous cron miner. Multi-provider solver (Venice default), EIP-1559 on Base, ERC-8004 reputation.
MIT -
A self-hosted AI platform: inference, tool use, browser automation, image generation, speech synthesis, transcription, object storage, agentic code execution, and more, behind a single OpenAI-compatible endpoint. One docker-compose up.
WTFPL ★ 18 -
Multi-backend GGUF vision-language inference engine (moondream3.1 · VideoChat3 · Qwen2.5-VL · MOSS-VL · VideoMAE/ViViT · SmolVLM) with a unified CLI, Web UI and an MCP server for agents.
NOASSERTION ★ 4 -
mult-hands-eyes-mcpgithub.com/microherox/mult-hands-eyes-mcpupdated this year
MCP server that gives online LLMs local hands and eyes: OpenAI-compatible local inference (KoboldCpp / Unsloth / llama.cpp / LM Studio / Ollama) for cheap text work and vision work (OCR / image analysis / comparison).
npm MIT -
Reproducible scientific modeling engine and agent skill pack: versioned Model IR with explicit units, dimensional and numerical validation, calibration, sensitivity and uncertainty analysis, causal/Bayesian inference, and portable export via CLI, REST and MCP
pypi MIT -
A production-grade Model Context Protocol (MCP) server that augments local LLM inference (via vLLM or Ollama) with real-time external data (e.g., weather, finance, news) to make responses dynamic, accurate, and context-aware. This system is designed for modularity, scalability, and performance in local or hybrid LLM deployments with support for co
-
The all-in-one, airgapped Local AI. Ypipe bundles a high-performance inference engine, specialized models, and pre-configured MCP servers into a single, self-contained Java executable. Zero-dependency orchestration for autonomous agent workflows with 100% data sovereignty. No cloud, no Python hell - just industrial-grade local intelligence.
★ 14 -
token-scoutgithub.com/jackccrawford/token-scoutupdated this year
For OpenClaw, Hermes and more. Find free and low-cost inference (LLM models). Use them directly. Provides both a CLI and MCP server that knows which free-tier LLM APIs exist, which ones you have keys for, and which one fits your task. Returns endpoints so can you call models directly. No proxy, no middleware, no latency tax.
MIT ★ 9 -
directionmdgithub.com/Dragoon0x/directionmdupdated this year
Infer creative direction from any live URL. 16 extraction passes, 22 inference modules, decision trees, design tokens, competitive positioning, drift monitoring. One crawl → DIRECTION.md
NOASSERTION ★ 1 -
Badgr — GPU Compute, AI Model Deployment & Agent Executionno update data
**Run GPU workloads, deploy AI models, access inference APIs, and execute AI agents using Badgr's MCP server.** Badgr is an AI compute and workload execution platform for developers, coding agents, and AI assistants. Run workloads on cloud GPUs or compatible customer-owned GPUs (BYO GPU), with cost controls, execution logs, and verified results. **What can Badgr do?** - **GPU Compute / AI Workloads:** Run Python scripts, machine learning jobs, batch inference, and supported ComfyUI workflows. - **AI Model Deployment:** Deploy and serve LLMs using compatible runtimes such as vLLM and SGLang. Get a verified, OpenAI-compatible inference endpoint. - **AI API / LLM Inference:** Make AI API requests with response validation, supported fallback routing, and bounded execution. - **AI Agent Execution:** Launch coding and testing agents, run tasks, check acceptance criteria, and retrieve execution receipts. **Key features:** Cloud GPU execution, BYO GPU support, model serving, AI agent jobs, workload verification, execution logs, cost limits, and deployment management. Connect Badgr to your MCP-compatible AI assistant to execute real workloads instead of just generating instructions. Get started: https://aibadgr.com **Requires a Badgr API key. GPU workloads and other paid execution may incur usage charges.**
smithery -
MyAino update data
Decentralized AI inference on Base: OpenAI-compatible chat via community GPUs, paid in MYAI
smithery -
Local multimodal inference service
MIT ★ 5 -
irontology-mcpgithub.com/PromptExecution/irontology-mcpupdated this year
irontology - a memory safe rust Inference Runtime Ontology
-
Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU kernels, and inference stacks.
pypi MIT -
Benchmark AI model inference speed — like speedtest.net but for LLMs. MCP server with zero telemetry.
MIT -
ruleforgegithub.com/orkhanshirin/ruleforgeupdated this year
CLI & local MCP tool that infers stack, layout, and style signals to generate modular Cursor rules (.mdc).
-
MCP server forcing evidence-gated, honestly-tiered (FACT/INFERENCE/SPECULATION) claim reporting. Deterministic, no-LLM, MIT.
-
context-sherpagithub.com/hackafterdark/context-sherpaupdated this year
Context Sherpa MCP server provides code mapping, deterministic feedback loops, and tiered inference for AI coding agents to increase accuracy and optimize token usage.
MIT ★ 26 -
MCP server for local LLM inference on Ryzen AI Max+ 395 with queueing, deadlines and telemetry; benchmark findings
MIT -
MCP server for analogical reasoning: structured pattern mapping, domain-to-domain structure alignment, and explainable inference
npm MIT -
JEV and local LAYA for MCP. Typed decisions, bounded inference and durable decision records.
Apache-2.0 ★ 1 -
causal-panopticon-mcpgithub.com/apifyforge/causal-panopticon-mcpupdated this year
Causal Panopticon is a cross-domain causal discovery and inference engine for AI agents, exposed via the Model Context Protocol.
MIT ★ 1 -
astermind-elm-mcpgithub.com/angrysky56/astermind-elm-mcpupdated this year
A local Model Context Protocol server for training small text classifiers with Extreme Learning Machines (ELMs). It supports in-memory inference and optional SurrealDB persistence, prediction monitoring, and vector storage.
★ 6 -
Cloud-hosted MCP server for Alibaba's Qwen models - specializing in Chinese language, coding, and cost-effective AI inference on Apify platform
-
MCP server for RVC WebUI — voice training, inference, model management, vocal separation via Gradio API (12 tools)
MIT ★ 1 -
Semantic search for your vault and code, through the CLI or MCP. Inference runs on your GPU.
MIT ★ 2 -
Persistent memory for AI coding sessions — captures what agents can't infer from code alone. Works with Copilot, Cursor, Claude, and Windsurf
npm MIT ★ 8 -
Fleet control plane: probe, boot and recover multi-node AI subsystems with proof. Docker and self-hosted inference fleet management.
MIT -
Reverse Engineer any USB gadget: capture vendor-app traffic, infer the protocol with evidence, generate an open Python/libusb driver. CLI + MCP server.
pypi MIT ★ 17 -
aero-refgithub.com/georgejinu-labs/aero-refupdated this year
Multi-server MCP agent: AeroAPI live flight data + BigQuery catalog, orchestrated with LangGraph and Ollama local inference. FastMCP · mcp-use · qwen2.5
★ 1 -
Local-first MCP server: 17 AI tools + 5 system endpoints for Claude & Cursor, powered by Ollama — all inference on-device, no API key, no data egress.
MIT -
Search code and feature records by meaning through the command line or Model Context Protocol (MCP). Inference runs on your GPU.
pypi MIT License -
Local MCP context server for AI agents: persistent memory, sourced knowledge graphs, full-text search, and rule-based inference with SQLite and clingo.
-
MCP server for LightningProx: pay for AI inference with Bitcoin Lightning. No API keys. Pay per request in sats. 24 models across 5 providers.
npm MIT -
k402-mcpgithub.com/kali123411/k402-mcpupdated this year
MCP server for the k402 agent-payable API catalog on Kaspa — text tools, chain data, GPU inference, covenants, and zk attestation, paid per call in KAS with no account or API key
pypi MIT