Armory
Source

Leaderboard

Scored on public signals; components with none are listed as Unranked · Formula

RankScoreComponentDescriptionEvidenceLast commitInstall
170198.783trulenseval · back-endEvaluation and tracking for LLM and RAG applications with a feedback-function API and experiment dashboard.3,530 stars · 335 forks · 1 mentionNo one-command install · Source
170298.937caviraoss-openmemorymemory · ai-agentsContributed by SentinelLocal persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.4,478 stars · 504 forksNo one-command install · Source
170398.969byterover-ciphermcp · databaseMemory-powered agent framework that provides persistent memory capabilities across conversations and sessions using vector databases and embeddings…4,966 stars · 454 forksNo one-command install · Source
170498.991agentaeval · ai-agentsOpen-source LLM developer platform with prompt playground, evaluation pipelines, and A/B testing for iterating on LLM apps.4,670 stars · 661 forksNo one-command install · Source
170599.046grafana-tempoobservability · observabilityGrafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM…5,461 stars · 746 forksNo one-command install · Source
170699.082alexzhang13-rlmcli · devopsContributed by SentinelGeneral plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.5,644 stars · 905 forks · 3 mentionsNo one-command install · Source
170799.089heliconeobservability · observabilityOpen-source LLM observability platform: proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs.6,123 stars · 662 forksNo one-command install · Source
170899.103swe-bencheval · ai-agentsSWE-bench: benchmark for evaluating LLMs on real-world GitHub issue resolution across 12 popular Python repositories.5,762 stars · 957 forks · 9 mentionsNo one-command install · Source
170999.194openllmetryobservability · ai-agentsOpenTelemetry-based observability for LLM applications. It auto-instruments OpenAI, Anthropic, LangChain, and 20+ providers with zero code changes.7,452 stars · 1,099 forksNo one-command install · Source
171099.233artidoro-qloracli · ai-agentsContributed by SentinelQLoRA: Efficient Finetuning of Quantized LLMs11,021 stars · 876 forks · 4 mentions · failed install testStaleNo one-command install · Source
171199.273phoenixeval · ai-agentsArize Phoenix: open-source LLM observability with built-in evals, span tracing, and dataset curation for RAG and agents.11,286 stars · 1,086 forks · 2 mentionsNo one-command install · Source
171299.274pocketflowworkflow · ai-agentsPocket Flow: 100-line LLM framework that lets agents build agents11,139 stars · 1,217 forksNo one-command install · Source
171399.277zilliz-claude-contextmcp · databaseProvides semantic code search and indexing using vector embeddings and AST-based code splitting, enabling natural language queries across codebases…12,463 stars · 917 forksNo one-command install · Source
171499.334portkey-ai-gatewayobservability · observabilityOpen-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load…12,873 stars · 1,280 forksNo one-command install · Source
171599.378langchain-ai-openwikicli · ai-agentsContributed by SentinelOpenWiki is a CLI that writes and maintains agent documentation for your codebase.15,979 stars · 1,159 forks · 4 mentionsNo one-command install · Source
171699.397skill-seekers-skill-seekersmcp · databaseTransform 17 source types (docs, GitHub repos, PDFs, videos, Jupyter, Confluence, Notion, Slack/Discord) into AI-ready skills and RAG knowledge. 35…14,879 stars · 1,516 forksNo one-command install · Source
171799.429microsoft-skilloptcli · ai-agentsContributed by SentinelSkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits…16,613 stars · 1,561 forks · 5 mentionsNo one-command install · Source
171899.455deepevaleval · observabilityOpen-source LLM evaluation framework with 14+ metrics (hallucination, faithfulness, answer relevancy) and CI support.18,041 stars · 1,890 forksNo one-command install · Source
171999.472opentelemetry-genaiobservability · observabilityOpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group.4,897 stars · 3,851 forksNo one-command install · Source
172099.473browser-use-webuiinfra · ai-agentsGradio web UI on top of the browser-use framework. It lets users run AI browser agents interactively, configure LLM providers, watch live recordings…16,310 stars · 2,721 forksNo one-command install · Source
172199.474dzhng-deep-researchcli · searchContributed by SentinelAn AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language…19,626 stars · 1,995 forks · 7 mentionsNo one-command install · Source
172299.490comet-opikobservability · observabilityOpik by Comet is an open-source LLM evaluation and tracing platform: log traces, run automated evals, create datasets, and track prompt improvements…22,249 stars · 1,827 forks · 1 mentionNo one-command install · Source
172399.494gibsonai-memorimemory · ai-agentsContributed by SentinelMemori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent state for…16,313 stars · 3,283 forksNo one-command install · Source
172499.512openai-evalseval · ai-agentsOpenAI's official framework for evaluating LLMs and LLM-powered systems, with a registry of community eval sets.19,509 stars · 3,093 forksNo one-command install · Source
172599.513skyverninfra · browserOpen-source agent platform that automates browser-based workflows using LLMs and computer vision. It identifies interactive elements via screenshots…22,907 stars · 2,152 forksNo one-command install · Source
172699.536promptfooeval · ai-agentsCLI and library for testing, comparing, and red-teaming LLM prompts and agents with assertions and CI integration.24,737 stars · 2,255 forksNo one-command install · Source
172799.538humanlayer-12-factor-agentsrules · ai-agentsContributed by SentinelWhat are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?25,642 stars · 1,951 forks · 4 mentionsNo one-command install · Source
172899.558tencentcloud-tencentdb-agent-memorymemory · ai-agentsContributed by SentinelTencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets (Chat Memory…25,635 stars · 2,398 forks · 3 mentionsNo one-command install · Source
172999.606rocketride-org-rocketride-servermcp · ai-agentsMCP server that exposes RocketRide AI pipelines as tools for Claude, Cursor, and Windsurf. Self-hosted, open-source pipeline tool with multi-LLM…12,739 stars · 5,046 forksNo one-command install · Source
173099.649langchain-ai-deepagentscli · ai-agentsContributed by SentinelThe batteries-included agent harness.28,831 stars · 4,050 forks · 6 mentionsNo one-command install · Source
173199.677langfuseobservability · observabilityOpen-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications.34,067 stars · 3,678 forks · 10 mentionsNo one-command install · Source
173299.684mlflow-tracingobservability · ai-agentsMLflow's LLM tracing module instruments model calls, agent steps, and tool invocations, storing them alongside experiment runs for reproducibility.27,768 stars · 6,246 forksNo one-command install · Source
173399.686microsoft-graphragmemory · searchContributed by SentinelA modular graph-based Retrieval-Augmented Generation (RAG) system35,783 stars · 3,754 forks · 3 mentionsNo one-command install · Source
173499.743sentry-llm-monitoringobservability · observabilitySentry's error and performance monitoring extended to LLM applications. It captures exceptions, latency, and AI token usage with OpenTelemetry…44,709 stars · 4,832 forks · 15 mentionsNo one-command install · Source
173599.749answerdotai-llms-txtcli · ai-agentsContributed by SentinelThe /llms.txt file, helping language models use your website2,633 stars · 166 forks · 2 mentions · passed install testNo one-command install · Source
173699.784aaif-goose-goosecli · ai-agentsContributed by Sentinelan open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM54,675 stars · 6,318 forks · 5 mentionsNo one-command install · Source
173799.787sgl-project-sglanginfra · otherContributed by SentinelSGLang is a high-performance serving framework for large language models and multimodal models.33,202 stars · 8,472 forks · 4 mentionsNo one-command install · Source
173899.859berriai-litellmcli · ai-agentsContributed by SentinelThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load…59,664 stars · 11,800 forks · 6 mentionsNo one-command install · Source
173999.869crawl4aicli · browserOpen-source async web crawling library optimised for LLM data extraction: Playwright-backed, outputs clean Markdown, supports CSS/XPath selectors and…84,297 stars · 8,717 forksNo one-command install · Source
174099.947vllm-project-vllminfra · ai-agentsContributed by SentinelA high-throughput and memory-efficient inference and serving engine for LLMs90,743 stars · 21,577 forks · 15 mentionsNo one-command install · Source
174199.950langchain-ai-langgraphworkflow · ai-agentsContributed by SentinelBuild resilient agents.40,899 stars · 6,899 forks · 25 mentions · passed install testNo one-command install · Source
174299.960ggml-org-llama-cppinfra · ai-agentsContributed by SentinelLLM inference in C/C++126,728 stars · 22,647 forks · 5 mentionsNo one-command install · Source
174399.987browser-useinfra · browserPython library that makes web browsers accessible to AI agents; built on Playwright and LangChain. Supports multi-tab, vision + accessibility-tree…111,989 stars · 12,312 forks · 11 mentions · passed install testNo one-command install · Source
1744Unrankedprism-mcpmcp · back-endMCP server providing full HTTP parity with the Prism API, enabling agents to chat, generate images/video/music/TTS, manage RAG documents and projects…No signals yetNo one-command install · Source
1745Unrankedcode-indexing-mcpmcp · searchA local-only codebase indexer that extracts syntax-aware chunks, creates embeddings locally, and enables semantic code search and symbol lookup via…No signals yetNo one-command install · Source
1746Unrankeddynatrace-saas-mcp-servermcp · observabilityEnables LLM agents to query Dynatrace SaaS for observability data (logs, metrics, traces, entities, problems, vulnerabilities) and manage…No signals yetNo one-command install · Source
1747Unrankedaa-mcp-servermcp · ai-agentsAn MCP server that gives Claude (or any MCP-compatible LLM) read-only access to your American Airlines AAdvantage account — mile balance, Loyalty…No signals yetNo one-command install · Source
1748Unrankedreleaseguard-mcp-servermcp · back-endProvides MCP tools for scanning, redacting, and packaging dataset/model directories for public release, leveraging Presidio for PII detection and…No signals yetNo one-command install · Source
1749Unrankedlinkedin-humblebragmcp · otherGenerates humorous LinkedIn posts from user achievements using a self-deprecating, vulnerable tone.No signals yetNo one-command install · Source
1750Unrankedinfino-mcp-servermcp · back-endEnables AI agents to perform keyword, semantic, hybrid, and SQL retrieval over data stored on object storage or local paths, using a local embedding…No signals yetNo one-command install · Source
1751Unrankedcodesteer-atlasmcp · searchLocal MCP server for semantic code search using Tree-sitter AST parsing, local embeddings, and hybrid search; enables indexing and querying codebases…No signals yetNo one-command install · Source
1752Unrankedseven-dpt-mcpmcp · back-endFeynman's twelve-problems method as an MCP server — a persistent set of long-running problems plus an evoke loop that tests each new trick against all…No signals yetNo one-command install · Source
1753Unrankedcfast-mcpmcp · ai-agentsEnables LLMs to build, inspect, run, and analyze CFAST fire models step by step via tools for compartments, materials, vents, fires, devices, and…No signals yetNo one-command install · Source
1754Unrankeddarwin-memomcp · ai-agentsProvides an MCP server that gives LLM agents an evolutionary memory: entries pay upkeep and survive only if they earn their keep through measured…No signals yetNo one-command install · Source
1755Unrankedllm-chat-mcpmcp · ai-agentsWraps Tool and ToolPackage instances from the llm-chat ecosystem behind the Model Context Protocol, enabling stdio and Streamable HTTP transports for…No signals yetNo one-command install · Source
1756Unrankedfirst-ch-tools-mcpmcp · ai-agentsMCP server exposing First CH Tools' free web-tool logic for WCAG contrast, JP character counting, WebP conversion, JSON-LD, and llms.txt generation to…No signals yetNo one-command install · Source
1757Unrankedai-guardianmcp · ai-agentsEnables observability and governance for local LLMs via Ollama, including auditing model usage, scanning prompts for secrets/PII, and enforcing…No signals yetNo one-command install · Source
1758Unrankedyads-mcpmcp · ai-agentsEnables MCP-capable LLM agents to control YADS queues, manage tags, and trigger scans through YADS's API-authenticated /api/v1 interface without…No signals yetNo one-command install · Source
1759Unrankedbizidashboard-mcpmcp · ai-agentsMCP server that exposes BiziDashboard's historical and analytical data for the Zaragoza Bizi bike-share system as tools for LLM clients, enabling…No signals yetNo one-command install · Source
1760Unrankedbookshelf-mcpmcp · back-endMCP server that exposes the Bookshelf (Readarr fork) v1 REST API as tools, allowing an LLM to read and manage authors, books, book files, editions…No signals yetNo one-command install · Source
1761Unrankedmcp-memory-hnswmcp · searchProvides persistent semantic memory for Claude Code and Claude Desktop with fully offline local embeddings and HNSW indexing, enabling memory storage…No signals yetNo one-command install · Source
1762Unrankedcrewai-mcp-orchestratormcp · ai-agentsTransforms any compatible LLM or AI Assistant into a master orchestrator of CrewAI, providing tools to dynamically generate, edit, test, and execute…No signals yetNo one-command install · Source
1763Unrankedmcp4openapimcp · back-endTurn any OpenAPI specification into a smaller, LLM-friendly MCP server. Enables interaction with REST APIs through MCP tools using profiles to reduce…No signals yetNo one-command install · Source
1764Unrankedscribbleslmmcp · searchA self-hosted, notebook-scoped RAG pipeline with contextual retrieval, delivered as an MCP server. Enables ingestion of documents into named notebooks…No signals yetNo one-command install · Source
1765Unrankednexus-browser-mcpmcp · browserA browser-automation MCP server built on Playwright that provides deterministic snapshots via MutationObserver/requestAnimationFrame, HITL governance…No signals yetNo one-command install · Source
1766Unrankedintelliverse-router-mcp-servermcp · back-endEnables agents to manage the Intelliverse platform: create apps, API keys, knowledge bases, send email, generate media, and chat without specifying an…No signals yetNo one-command install · Source
1767Unrankedhai-mcpmcp · ai-agentsProvides a human-agent interface control plane for managing agent state, focus, and next steps across any MCP-compatible client, without calling an…No signals yetNo one-command install · Source
1768Unrankedprivate-journal-mcpmcp · databaseStores journal entries locally with semantic search using multilingual embeddings, and optionally syncs to a Git remote.No signals yetNo one-command install · Source
1769Unrankedaibrief-mcpmcp · ai-agentsRead-only MCP server that serves curated daily Korean AI briefings (papers, releases, community, video, deepdive) via 7 tools, with no LLM calls per…No signals yetNo one-command install · Source
1770Unrankedagent-accessibility-auditor-mcp-servermcp · back-endAudits a domain to determine if AI agents and crawlers can access and read it, returning a flat row of 42 fields covering llms.txt, robots.txt AI…No signals yetNo one-command install · Source
1771Unrankedmcp-for-kibanamcp · ai-agentsEnables LLMs to interact with Kibana through composable toolboxes for building dashboards, managing data, and handling alerts, among other operations.No signals yetNo one-command install · Source
1772Unrankedotc-pricing-mcp-servermcp · back-endAn open-source Model Context Protocol (MCP) server for the Open Telekom Cloud (OTC) Price Calculator API. Expose OTC pricing data to Claude and other…No signals yetNo one-command install · Source
1773Unrankedmcp-toolsets-runtimemcp · front-endA shared runtime that discovers LangChain tools from a toolset package and serves them as an MCP server, with optional UI views and a CLI for managing…No signals yetNo one-command install · Source
1774Unrankedmcp-rpcs1mcp · ai-agentsprevents llm from overload, freeze and oscillationNo signals yetNo one-command install · Source
1775Unrankedrpcs1-agent-tunermcp · ai-agentsprevents llm from overload, freeze and oscillationNo signals yetNo one-command install · Source
1776Unrankedvibedonatemcp · otherEnables peer-to-peer AI inference donation by exposing MCP tools to check node status and request capacity, with local-first compute sharing, consent…No signals yetNo one-command install · Source
1777Unrankednm-hard-toolsmcp · devopsProvides deployable, stateless MCP services for rigorous inference evaluation and benchmarking, including a profiled lm-evaluation-harness…No signals yetNo one-command install · Source
1778Unrankedrepo-explorer-mcpmcp · ai-agentsEnables LLM-driven repository exploration by exposing an explore_repository tool over stdio, using codebase memory and ripgrep/rtk search to navigate…No signals yetNo one-command install · Source
1779Unrankedai-dememorymcp · databasePersonal multi-LLM memory repository using Markdown as source of truth, SQLite FTS5 for retrieval, and MCP tools for search, context, and write…No signals yetNo one-command install · Source
1780Unrankedciv6-mcpmcp · ai-agentsAn MCP server that lets LLM agents play full games of Civilization VI.No signals yetNo one-command install · Source
1781Unrankedcompendiummcp · ai-agentsMCP server that minimizes LLM token usage by compressing, summarizing, filtering, chunk-referencing, and pruning large context before it reaches the…No signals yetNo one-command install · Source
1782Unrankedtempreonmcp · ai-agentsMCP server that provides a portable personal knowledge layer for AI tools, enabling cross-LLM continuity and personalized context across clients like…No signals yetNo one-command install · Source
1783Unrankedclaude-worksmcp · ai-agentsAn MCP server that exposes a perpetual, honest job-application pipeline as typed tools an LLM agent can call, with fit scoring, verified resume…No signals yetNo one-command install · Source
1784Unrankedsimliverse-mcpmcp · ai-agentsProvides a unified MCP server for the SimLiverse Physical AI Platform, enabling LLM copilots to access Isaac Sim knowledge via NVIDIA NIM and…No signals yetNo one-command install · Source
1785Unrankedgeolocation-mcpmcp · databaseEnables LLMs to query IP addresses against free MaxMind GeoLite2 geolocation databases.No signals yetNo one-command install · Source
1786Unrankedmcp-teste-llm2mcp · databaseMCP server that allows natural language queries in Portuguese to a PostgreSQL database using Ollama, ensuring read-only access with parameterized SQL…No signals yetNo one-command install · Source
1787Unrankeddocfill-agent-mcp-servermcp · ai-agentsAn MCP server that enables LLM agents to read, understand, and fill DOCX templates while preserving formatting like bold labels and fonts. It exposes…No signals yetNo one-command install · Source
1788Unrankedbase-tx-explainmcp · ai-agentsExplains any Base mainnet transaction hash by returning a structured JSON with action type, assets moved, risk flags, and cost details, using…No signals yetNo one-command install · Source
1789Unrankedmundigitalmcp · ai-agentsExposes a public, read-only professional profile with tools to search resume evidence, fetch curated links, and generate career briefs for LLM agents.No signals yetNo one-command install · Source
1790Unrankedwikipediamcp · ai-agentsEnables LLM agents to search Wikipedia and retrieve page content via Model Context Protocol tools, supporting natural language research.No signals yetNo one-command install · Source
1791Unrankedneverrankedmcp · ai-agentsAEO scoring, llms.txt auditing, and agent-readiness checks for websites.No signals yetNo one-command install · Source
1792Unrankedpeer-review-mcp-servermcp · back-endEnables querying multiple LLM providers in a weighted quorum to obtain a consensus answer with a certainty score. Supports cost tiers, visible…No signals yetNo one-command install · Source
1793Unrankedui-design-mcp-servermcp · front-endProvides comprehensive UI design assistance tools for LLMs, generating color palettes, typography, spacing systems, shadows, design tokens, and more…No signals yetNo one-command install · Source
1794Unrankedinferwatch-mcpmcp · ai-agentsEnables agents to query real-time and historical metrics for locally served Ollama and vLLM instances, including request rates, latency, token counts…No signals yetNo one-command install · Source
1795Unrankedvideo-to-llmmcp · ai-agentsEnables LLM agents to process local videos into timestamped, citable text documents and then query them through tools for listing videos, retrieving…No signals yetNo one-command install · Source
1796Unrankedweb-data-mcpmcp · back-endAn MCP server that runs Apify scraping actors with quality-gated validation, scoring, and retries, returning embedding-ready chunks for AI agents.No signals yetNo one-command install · Source
1797Unrankedlibrary-mcpmcp · databaseProvides a 'library keeper' sub-agent that ingests PDF/EPUB books and answers questions grounded in them via local embedding search, with…No signals yetNo one-command install · Source
1798Unrankedlocal-corporate-kbmcp · searchLocal RAG knowledge base for Qwen Code, enabling document indexing and semantic search via MCP tools. Supports metadata filtering and document…No signals yetNo one-command install · Source
1799Unrankeda4imcp · back-endMCP server for the Cisco ACI REST API, enabling LLM clients to query and modify fabric configurations via tools like get, post, diff, and merge using…No signals yetNo one-command install · Source
1800Unrankedgroundcheck-mcpmcp · ai-agentsMCP server for grounding verification (exact quotes, citations, code output, repo patterns, arithmetic) using no LLM in the verification path.No signals yetNo one-command install · Source

Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.

Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.

Leaderboard · Armory