Armory
Source
Browse
MCPs

mlserve

Self-hosted ML inference MCP server providing embeddings and summarization tools using sentence-transformers and Ollama, with low-latency preloaded models and API-key authentication.

Score
Unranked
Evidence
No signals yet
Last commit
as last read from GitHub; most reads are from 2 Sep 2026 or later
Listed

Install

No one-command install. Set it up from its source.

Alternatives · MCPs

  1. rahilp-second-brain737 stars · 102 forks97.314
  2. cloudflare-workers646 stars · 67 forks96.966
  3. nighttrek-ollama74 stars · 17 forks89.698

What it is

Self-hosted ML inference MCP server providing embeddings and summarization tools using sentence-transformers and Ollama, with low-latency preloaded models and API-key authentication.

When to use it

Self-hosted ML inference MCP server providing embeddings and summarization tools using sentence-transformers and Ollama, with low-latency preloaded models and API-key authentication.

How to install / invoke

See Glama for the install config.

Notes

Listed from the Glama MCP registry.