Leaderboard

Scored on public signals; components with none are listed as Unranked · Formula

Component

All mcp 61,707 skill 1,132 subagent 724 rules 461 hook 134 workflow 62 cli 57 identity 38

4 More

eval 37 memory 36 observability 34 infra 26

Domain

All back-end 23,922 ai-agents 13,106 other 9,354 search 4,535 database 2,789 front-end 2,201 observability 1,987 auth 1,508

5 More

devops 1,377 browser 1,330 comms 1,112 payments 1,089 github-vcs 929

Vertical

All finance 4,779 ai-infra 3,606 security 3,313 productivity 2,190 marketing 1,395 data-analytics 1,204 legal 1,129 devtools 1,006

4 More

education 574 healthcare 489 e-commerce 468 gaming 396

Sort

Score Usage Tested Mentions Stars Name

Highest FirstRows50 100 250ExportHarness

Needs the armory CLI · not on npm yet, build it from cli/ in the repository

17 results · 65,239 in the catalog

Rank	Score	Component	Description	Evidence	Last commit	Install
1	99.743	sentry-llm-monitoringobservability · observability	Sentry's error and performance monitoring extended to LLM applications. It captures exceptions, latency, and AI token usage with OpenTelemetry…	44,709 stars · 4,832 forks · 15 mentions	2 Sep 2026	No one-command install · Source
2	99.677	langfuseobservability · observability	Open-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications.	34,067 stars · 3,678 forks · 10 mentions	1 Sep 2026	No one-command install · Source
3	99.490	comet-opikobservability · observability	Opik by Comet is an open-source LLM evaluation and tracing platform: log traces, run automated evals, create datasets, and track prompt improvements…	22,249 stars · 1,827 forks · 1 mention	26 Sep 2026	No one-command install · Source
4	99.472	opentelemetry-genaiobservability · observability	OpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group.	4,897 stars · 3,851 forks	2 Sep 2026	No one-command install · Source
5	99.334	portkey-ai-gatewayobservability · observability	Open-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load…	12,873 stars · 1,280 forks	25 May 2026	No one-command install · Source
6	99.089	heliconeobservability · observability	Open-source LLM observability platform: proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs.	6,123 stars · 662 forks	31 Aug 2026	No one-command install · Source
7	99.046	grafana-tempoobservability · observability	Grafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM…	5,461 stars · 746 forks	2 Sep 2026	No one-command install · Source
8	98.667	openlitobservability · observability	OpenLIT is an OpenTelemetry-native LLM observability toolkit with GPU monitoring, cost tracking, and a prompt hub (one-line setup for 20+ providers).	2,736 stars · 367 forks	1 Sep 2026	No one-command install · Source
9	98.121	openinferenceobservability · observability	OpenInference is an open standard and Python/JS instrumentation library for capturing LLM and agent traces in OpenTelemetry format, built by Arize AI.	1,192 stars · 302 forks	1 Sep 2026	No one-command install · Source
10	94.644	athina-aiobservability · observability	Athina AI provides developer-focused LLM monitoring and eval framework: real-time inference logging, automated evals, and regression detection in CI.	301 stars · 23 forks	6 Jun 2025	No one-command install · Source
11	75.153	honeycombobservability · observability	Honeycomb's OpenTelemetry-native observability platform: a high-cardinality event store ideal for tracing LLM pipelines and debugging slow agent…	16 stars · 6 forks	13 Aug 2025	No one-command install · Source
12	74.422	baserunobservability · observability	Baserun captures LLM traces via a lightweight decorator-based SDK and provides a dashboard for debugging prompt chains, testing variants, and…	16 stars · 5 forks	26 Jun 2024Stale	No one-command install · Source
13	Unranked	datadog-llm-observabilityobservability · observability	Datadog's managed LLM Observability product. It traces LLM calls, monitors prompt/completion quality, detects anomalies, and integrates with existing…	No signals yet	No commit datelisted 27 May 2026	No one-command install · Source
14	Unranked	fiddler-aiobservability · observability	Fiddler AI Observability platform monitors LLM applications for hallucinations, toxicity, bias, and drift, with explainability and alerting for…	No signals yet	No commit datelisted 27 May 2026	No one-command install · Source
15	Unranked	langtraceobservability · observability	Open-source, OpenTelemetry-compliant LLM observability tool by Scale3Labs. It traces calls to all major LLM providers and frameworks with a…	No signals yet	No commit datelisted 27 May 2026	No one-command install · Source
16	Unranked	lunaryobservability · observability	Open-source LLM observability and prompt management platform. It tracks conversations, errors, costs, and user feedback for production AI…	No signals yet	No commit datelisted 27 May 2026	No one-command install · Source
17	Unranked	new-relic-ai-monitoringobservability · observability	New Relic AI Monitoring instruments LLM calls end-to-end. It traces model invocations, measures token costs, and surfaces anomalies via the New Relic…	No signals yet	No commit datelisted 27 May 2026	No one-command install · Source

Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.

Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, 2 Sep 2026 or later. A repository may have changed since.