Armory
Source
Browse
MCPs

agentops-evalbench-mcp

Enables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.

Score
22.5571 signal
Evidence
1 star
Last commit
as last read from GitHub; most reads are from 2 Sep 2026 or later
Listed

Install

No one-command install. Set it up from its source.

Alternatives · MCPs

  1. iris-eval7 stars · 2 forks60.262
  2. noema-ai-mcp-server3 stars38.412
  3. adr-mcp-setup3 stars38.412

What it is

Enables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.

When to use it

Enables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.

How to install / invoke

See Glama for the install config.

Notes

Listed from the Glama MCP registry.