Armory
Source

Leaderboard

Scored on public signals; components with none are listed as Unranked · Formula

RankScoreComponentDescriptionEvidenceLast commitInstall
199.9876browser-useinfra · browserPython library that makes web browsers accessible to AI agents; built on Playwright and LangChain. Supports multi-tab, vision + accessibility-tree…111,989 stars · 12,312 forks · 11 mentions · passed install testNo one-command install · Source
299.9607ggml-org-llama-cppinfra · ai-agentsContributed by SentinelLLM inference in C/C++126,728 stars · 22,647 forks · 5 mentionsNo one-command install · Source
399.9503langchain-ai-langgraphworkflow · ai-agentsContributed by SentinelBuild resilient agents.40,899 stars · 6,899 forks · 25 mentions · passed install testNo one-command install · Source
499.9472vllm-project-vllminfra · ai-agentsContributed by SentinelA high-throughput and memory-efficient inference and serving engine for LLMs90,743 stars · 21,577 forks · 15 mentionsNo one-command install · Source
599.8693crawl4aicli · browserOpen-source async web crawling library optimised for LLM data extraction — Playwright-backed, outputs clean Markdown, supports CSS/XPath selectors and…84,297 stars · 8,717 forksNo one-command install · Source
699.8594berriai-litellmcli · ai-agentsContributed by SentinelThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load…59,664 stars · 11,800 forks · 6 mentionsNo one-command install · Source
799.7870sgl-project-sglanginfra · otherContributed by SentinelSGLang is a high-performance serving framework for large language models and multimodal models.33,202 stars · 8,472 forks · 4 mentionsNo one-command install · Source
899.7847aaif-goose-goosecli · ai-agentsContributed by Sentinelan open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM54,675 stars · 6,318 forks · 5 mentionsNo one-command install · Source
999.7490answerdotai-llms-txtcli · ai-agentsContributed by SentinelThe /llms.txt file, helping language models use your website2,633 stars · 166 forks · 2 mentions · passed install testNo one-command install · Source
1099.7436sentry-llm-monitoringobservability · observabilitySentry's error and performance monitoring extended to LLM applications — captures exceptions, latency, and AI token usage with OpenTelemetry…44,709 stars · 4,832 forks · 15 mentionsNo one-command install · Source
1199.6863microsoft-graphragmemory · searchContributed by SentinelA modular graph-based Retrieval-Augmented Generation (RAG) system35,783 stars · 3,754 forks · 3 mentionsNo one-command install · Source
1299.6847mlflow-tracingobservability · ai-agentsMLflow's LLM tracing module instruments model calls, agent steps, and tool invocations, storing them alongside experiment runs for reproducibility.27,768 stars · 6,246 forksNo one-command install · Source
1399.6776langfuseobservability · observabilityOpen-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications.34,067 stars · 3,678 forks · 10 mentionsNo one-command install · Source
1499.6496langchain-ai-deepagentscli · ai-agentsContributed by SentinelThe batteries-included agent harness.28,831 stars · 4,050 forks · 6 mentionsNo one-command install · Source
1599.6066rocketride-org-rocketride-servermcp · ai-agentsMCP server that exposes RocketRide AI pipelines as tools for Claude, Cursor, and Windsurf. Self-hosted, open-source pipeline tool with multi-LLM…12,739 stars · 5,046 forksNo one-command install · Source
1699.5581tencentcloud-tencentdb-agent-memorymemory · ai-agentsContributed by SentinelTencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets (Chat Memory…25,635 stars · 2,398 forks · 3 mentionsNo one-command install · Source
1799.5387humanlayer-12-factor-agentsrules · ai-agentsContributed by SentinelWhat are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?25,642 stars · 1,951 forks · 4 mentionsNo one-command install · Source
1899.5363promptfooeval · ai-agentsCLI and library for testing, comparing, and red-teaming LLM prompts and agents with assertions and CI integration.24,737 stars · 2,255 forksNo one-command install · Source
1999.5139skyverninfra · browserOpen-source agent platform that automates browser-based workflows using LLMs and computer vision — identifies interactive elements via screenshots…22,907 stars · 2,152 forksNo one-command install · Source
2099.5128openai-evalseval · ai-agentsOpenAI's official framework for evaluating LLMs and LLM-powered systems, with a registry of community eval sets.19,509 stars · 3,093 forksNo one-command install · Source
2199.4948gibsonai-memorimemory · ai-agentsContributed by SentinelMemori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent state for…16,313 stars · 3,283 forksNo one-command install · Source
2299.4902comet-opikobservability · observabilityOpik by Comet is an open-source LLM evaluation and tracing platform — log traces, run automated evals, create datasets, and track prompt improvements…22,249 stars · 1,827 forks · 1 mentionNo one-command install · Source
2399.4741dzhng-deep-researchcli · searchContributed by SentinelAn AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language…19,626 stars · 1,995 forks · 7 mentionsNo one-command install · Source
2499.4730browser-use-webuiinfra · ai-agentsGradio web UI on top of the browser-use framework — lets users run AI browser agents interactively, configure LLM providers, watch live recordings…16,310 stars · 2,721 forksNo one-command install · Source
2599.4726opentelemetry-genaiobservability · observabilityOpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group.4,897 stars · 3,851 forksNo one-command install · Source
2699.4554deepevaleval · observabilityOpen-source LLM evaluation framework with 14+ metrics (hallucination, faithfulness, answer relevancy) and CI support.18,041 stars · 1,890 forksNo one-command install · Source
2799.4293microsoft-skilloptcli · ai-agentsContributed by SentinelSkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits…16,613 stars · 1,561 forks · 5 mentionsNo one-command install · Source
2899.3975skill-seekers-skill-seekersmcp · databaseTransform 17 source types (docs, GitHub repos, PDFs, videos, Jupyter, Confluence, Notion, Slack/Discord) into AI-ready skills and RAG knowledge. 35…14,879 stars · 1,516 forksNo one-command install · Source
2999.3781langchain-ai-openwikicli · ai-agentsContributed by SentinelOpenWiki is a CLI that writes and maintains agent documentation for your codebase.15,979 stars · 1,159 forks · 4 mentionsNo one-command install · Source
3099.3347portkey-ai-gatewayobservability · observabilityOpen-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load…12,873 stars · 1,280 forksNo one-command install · Source
3199.2773zilliz-claude-contextmcp · databaseProvides semantic code search and indexing using vector embeddings and AST-based code splitting, enabling natural language queries across codebases…12,463 stars · 917 forksNo one-command install · Source
3299.2749pocketflowworkflow · ai-agentsPocket Flow: 100-line LLM framework that lets agents build agents11,139 stars · 1,217 forksNo one-command install · Source
3399.2737phoenixeval · ai-agentsArize Phoenix: open-source LLM observability with built-in evals, span tracing, and dataset curation for RAG and agents.11,286 stars · 1,086 forks · 2 mentionsNo one-command install · Source
3499.2338artidoro-qloracli · ai-agentsContributed by SentinelQLoRA: Efficient Finetuning of Quantized LLMs11,021 stars · 876 forks · 4 mentions · failed install testStaleNo one-command install · Source
3599.1941openllmetryobservability · ai-agentsOpenTelemetry-based observability for LLM applications — auto-instruments OpenAI, Anthropic, LangChain, and 20+ providers with zero code changes.7,452 stars · 1,099 forksNo one-command install · Source
3699.1039swe-bencheval · ai-agentsSWE-bench: benchmark for evaluating LLMs on real-world GitHub issue resolution across 12 popular Python repositories.5,762 stars · 957 forks · 9 mentionsNo one-command install · Source
3799.0894heliconeobservability · observabilityOpen-source LLM observability platform — proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs.6,123 stars · 662 forksNo one-command install · Source
3899.0821alexzhang13-rlmcli · devopsContributed by SentinelGeneral plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.5,644 stars · 905 forks · 3 mentionsNo one-command install · Source
3999.0465grafana-tempoobservability · observabilityGrafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM…5,461 stars · 746 forksNo one-command install · Source
4098.9918agentaeval · ai-agentsOpen-source LLM developer platform with prompt playground, evaluation pipelines, and A/B testing for iterating on LLM apps.4,670 stars · 661 forksNo one-command install · Source
4198.9699byterover-ciphermcp · databaseMemory-powered agent framework that provides persistent memory capabilities across conversations and sessions using vector databases and embeddings…4,966 stars · 454 forksNo one-command install · Source
4298.9370caviraoss-openmemorymemory · ai-agentsContributed by SentinelLocal persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.4,478 stars · 504 forksNo one-command install · Source
4398.7831trulenseval · back-endEvaluation and tracking for LLM and RAG applications with a feedback-function API and experiment dashboard.3,530 stars · 335 forks · 1 mentionNo one-command install · Source
4498.6883lightevaleval · ai-agentsHugging Face lightweight evaluation library for LLMs across academic benchmarks, with fast local and remote inference support.2,533 stars · 553 forksNo one-command install · Source
4598.6676openlitobservability · observabilityOpenLIT is an OpenTelemetry-native LLM observability toolkit with GPU monitoring, cost tracking, and a prompt hub — one-line setup for 20+ providers.2,736 stars · 367 forksNo one-command install · Source
4698.6529coleam00-crawl4ai-ragmcp · searchIntegrates web crawling with RAG functionality to enable website content retrieval, storage in vector databases, and semantic searching over crawled…2,246 stars · 579 forksNo one-command install · Source
4798.6249laminarobservability · ai-agentsLaminar is an open-source platform for tracing, evaluating, and labeling LLM and agent pipelines with a TypeScript/Python SDK and a self-hostable…3,218 stars · 229 forks · 1 mentionNo one-command install · Source
4898.5705llmsresearch-paperbananamcp · ai-agentsGenerates publication-quality methodology diagrams and statistical plots from text descriptions using a multi-agent pipeline with specialized agents…2,294 stars · 334 forksNo one-command install · Source
4998.5486yctimlin-excalidrawmcp · back-endEnables LLMs to create and manipulate Excalidraw diagrams through a Node.js API that provides tools for element creation, modification, querying, and…2,476 stars · 277 forksNo one-command install · Source
5098.5443butterbasemcp · back-endAI-native open-source backend-as-a-service. Manage Postgres with RLS, auth, file storage, serverless TypeScript functions, durable objects, realtime…3,353 stars · 163 forksarmory install butterbase --cli claude
5198.4931webclawmcp · ai-agentsWeb extraction engine for LLMs with TLS fingerprinting to bypass bot detection, delivering clean markdown output.2,360 stars · 233 forksNo one-command install · Source
5298.4797mixelpixx-kicad-pcb-designermcp · front-endEnables LLMs to directly interact with KiCAD for printed circuit board design.1,995 stars · 308 forksNo one-command install · Source
5398.3747claude-real-videomcp · ai-agentsLets any LLM agent actually watch videos: a watch_video tool takes a URL or local file and returns scene-aware keyframes fused with a timestamped…2,104 stars · 186 forksNo one-command install · Source
5498.3330notteinfra · ai-agentsNotte open-source web agent environment — converts browser sessions into a Markov Decision Process with structured observation/action spaces, making…2,003 stars · 181 forksNo one-command install · Source
5598.2498langchain-ai-langmemmemory · ai-agentsContributed by SentinelLong-term memory for agents: tools that extract what matters from conversations, refine prompts from feedback and keep memory across sessions, with…1,684 stars · 192 forksNo one-command install · Source
5698.1416nickclyde-duckduckgo-searchmcp · searchIntegrates with DuckDuckGo to provide web search capabilities, content fetching, and parsing, with results formatted for large language model…1,446 stars · 186 forksNo one-command install · Source
5798.1215openinferenceobservability · observabilityOpenInference is an open standard and Python/JS instrumentation library for capturing LLM and agent traces in OpenTelemetry format, built by Arize AI.1,192 stars · 302 forksNo one-command install · Source
5898.0629modular-rag-mcp-servermcp · back-endA pluggable, observable modular RAG framework exposing tools via MCP protocol for AI assistants like Copilot/Claude to query knowledge bases, list…1,162 stars · 266 forksNo one-command install · Source
5998.0328agent-einfra · ai-agentsEmergence AI agent-E browser agent — hierarchical LLM-based web automation that uses DOM distillation and action abstraction layers to achieve…1,249 stars · 190 forksNo one-command install · Source
6098.0052langsmithobservability · back-endLangChain's platform for tracing, evaluating, and monitoring LLM applications — deep integration with LangChain/LangGraph plus a REST API for any…1,043 stars · 288 forksNo one-command install · Source
6197.9933apecloud-aperagmcp · searchProduction-ready RAG platform combining Graph RAG, vector search, and full-text search. Best choice for building your own Knowledge Graph and for…1,318 stars · 147 forksNo one-command install · Source
6297.9238wandb-weave-evalseval · ai-agentsWeights & Biases Weave evaluation framework for tracking LLM experiments, scoring model outputs, and comparing runs.1,130 stars · 170 forks · 3 mentionsNo one-command install · Source
6397.8806langtraceeval · observabilityOpen-source observability tool for LLMs with OpenTelemetry-based tracing, automated evals, and annotation workflows.1,228 stars · 127 forksNo one-command install · Source
6497.8171agiresearch-a-memmemory · ai-agentsContributed by SentinelA-MEM: Agentic Memory for LLM Agents1,164 stars · 121 forksNo one-command install · Source
6597.7556langchain-mcpdocmcp · authProvides AI systems with access to documentation from llms.txt files by fetching and parsing content from specified URLs, enabling seamless…1,032 stars · 129 forksNo one-command install · Source
6697.6329coleam00-mem0mcp · searchProvides persistent long-term memory capabilities through semantic indexing, retrieval, and search functions with support for multiple LLM providers…681 stars · 237 forksNo one-command install · Source
6797.4398disler-just-promptmcp · ai-agentsUnified interface for interacting with multiple LLM providers including OpenAI, Anthropic, Google Gemini, Groq, DeepSeek, and Ollama with parallel…738 stars · 132 forksNo one-command install · Source
6897.3144rahilp-second-brainmcp · databaseSelf-hosted semantic memory MCP server on Cloudflare Workers with vector embeddings for intelligent recall and 4 tools for personal knowledge…737 stars · 102 forksNo one-command install · Source
6997.2188context-portalmcp · databaseDatabase-backed project memory management system that stores decisions, progress tracking, and system patterns in a queryable knowledge graph with…765 stars · 78 forksNo one-command install · Source
7097.1920dataeval-dingomcp · ai-agentsMCP server for the Dingo: a comprehensive data quality evaluation tool. Server Enables interaction with Dingo's rule-based and LLM-based evaluation…752 stars · 77 forksNo one-command install · Source
7197.1580chromamcp · databaseIntegrates with Chroma vector database to enable collection management, document operations, and vector search capabilities for knowledge bases and…588 stars · 118 forksNo one-command install · Source
7297.0916modal-labs-modal-clientinfra · devopsContributed by SentinelModal — serverless GPU/CPU containers for running agents, sandboxes and model inference from Python (this is the client SDK).518 stars · 132 forks · 11 mentionsNo one-command install · Source
7396.6747mx-iris-ida-promcp · databaseEnables programmatic reading and searching of IDA Pro databases via large language models, providing tools for reverse engineering and binary analysis…547 stars · 59 forksNo one-command install · Source
7496.4093ggozad-haiku-ragmcp · searchAgentic RAG system powered by LanceDB, Pydantic AI, and Docling587 stars · 41 forksNo one-command install · Source
7596.3901gannonh-memento-mcpmcp · ai-agentsContributed by SentinelMemento MCP: A Knowledge Graph Memory System for LLMs424 stars · 63 forksNo one-command install · Source
7696.3858azure-ai-foundrymcp · devopsIntegrates with Microsoft Azure AI Foundry to enable model deployment, experiment tracking, dataset management, and access to Azure's cognitive…259 stars · 120 forksNo one-command install · Source
7796.3213ai-kline-mcp-servermcp · ai-agentsMCP server for A-share stock technical analysis and AI prediction, enabling LLM-based interaction to analyze stocks.344 stars · 95 forksNo one-command install · Source
7896.3059pyghidra-mcpmcp · ai-agentsExposes Ghidra reverse engineering capabilities via MCP, enabling LLMs and agents to analyze binaries, decompile, search, and edit programs headlessly…421 stars · 57 forksNo one-command install · Source
7996.2940shinpr-local-ragmcp · searchLocal RAG for semantic document search without external API calls.378 stars · 69 forksNo one-command install · Source
8096.2075continuous-evaleval · ai-agentsRelari's modular evaluation library for LLM pipelines with deterministic + LLM-based metrics for RAG and agent workflows.517 stars · 38 forksNo one-command install · Source
8196.1909evalstate-mcp-hfspacemcp · back-endMCP server that seamlessly integrates Hugging Face Spaces with AI assistants, enabling easy access to diverse AI models and tools without manual…387 stars · 57 forksNo one-command install · Source
8296.1770hugging-face-mcp-servermcp · back-endConnects LLMs to the Hugging Face Hub and thousands of Gradio AI applications, enabling model interaction and search.299 stars · 104 forksNo one-command install · Source
8396.0219telememmcp · ai-agentsLong-term and multimodal memory for AI agents. Store facts and conversations with add_memory, recall them with search_memories — 8 tools over…486 stars · 35 forksNo one-command install · Source
8496.0099okf-knowledge-agent-mcp-servermcp · ai-agentsAn LLM-managed knowledge base following the Open Knowledge Format (OKF) v0.1 spec. Provides MCP tools: kb_query, kb_add, kb_update, kb_status over…306 stars · 71 forksNo one-command install · Source
8596.0032pageindexmcp · searchReasoning-based RAG system for analyzing long PDF documents383 stars · 47 forksNo one-command install · Source
8695.8204mcp-server-for-revit-pythonmcp · back-endEnables Large Language Models to access and manipulate Autodesk Revit models through a pyRevit-based bridge and the Model Context Protocol.175 stars · 102 forksNo one-command install · Source
8795.8033hotricenoodles-crosslinkmcp · ai-agentsOpen-source LLM proxy gateway with integrated MCP gateway, supporting multi-provider routing, load balancing, rate limiting, caching, and HTTP/SSE…453 stars · 32 forksNo one-command install · Source
8895.7450netbox-mcp-servermcp · ai-agentsRead-only MCP server for NetBox that enables LLMs to query NetBox objects (devices, IPAM, etc.) and change logs through natural language, with field…221 stars · 93 forksNo one-command install · Source
8995.6701mcp-server-playwrightmcp · browserA Model Context Protocol server that provides browser automation capabilities using Playwright, enabling LLMs to interact with web pages, take…299 stars · 51 forksNo one-command install · Source
9095.5382aliargun-geminimcp · ai-agentsIntegrates Google's Gemini AI models enabling real-time response streaming and LLM processing capabilities.258 stars · 62 forksNo one-command install · Source
9195.5268zilliz-milvusmcp · databaseIntegrates with Milvus vector database to enable vector search, full-text search, and hybrid queries for semantic search and knowledge retrieval…243 stars · 70 forksNo one-command install · Source
9295.4593contextweavermcp · searchA semantic code retrieval engine for AI agents that enables hybrid search, graph expansion, and token-aware context packing, integrating with MCP to…296 stars · 42 forksNo one-command install · Source
9395.4499ghost-in-the-droidmcp · ai-agentsGive any LLM agent a real Android or iPhone. 62 MCP tools: tap, swipe, type, screenshot, screen-tree reading, app launch, camera, TTS, crash reports…334 stars · 35 forksNo one-command install · Source
9495.4433veritasgraphmcp · back-endZero-trust, air-gapped Enterprise GraphRAG MCP server. Build knowledge graphs from local documents and run multi-hop, citation-grounded queries…313 stars · 37 forksNo one-command install · Source
9595.3439ozamatash-open-deep-researchmcp · searchPerforms iterative, deep research on any topic by combining search engines, web scraping, and large language models to generate comprehensive markdown…323 stars · 33 forksNo one-command install · Source
9695.3034cdp-bridgemcp · authConnects MCP clients to real browser sessions via a Chromium plugin, enabling LLMs to read, scan, automate, and navigate web pages using the user's…296 stars · 37 forksNo one-command install · Source
9795.1085glommer-codemoggermcp · searchCode indexing library with tree-sitter parsing and semantic search via embedding-based similarity.340 stars · 27 forksNo one-command install · Source
9894.9847open-street-mapmcp · ai-agentsEnhances LLM capabilities with location-based services and geospatial data from OpenStreetMap.222 stars · 48 forksNo one-command install · Source
9994.9349disler-nano-agentmcp · ai-agentsBridges OpenAI's Agent SDK with natural language task execution, enabling autonomous agent workflows with file system operations, multi-provider LLM…205 stars · 57 forksNo one-command install · Source
10094.9346alpha-vantage-mcp-servermcp · ai-agentsEnables LLMs and agentic workflows to access real-time and historical stock market data through the Model Context Protocol.210 stars · 53 forksNo one-command install · Source

Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.

Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.

Leaderboard · Armory