Leaderboard
Scored on public signals; components with none are listed as Unranked · Formula
Component
Domain
Vertical
| Rank | Score | Component | Description | Evidence | Last commit | Install |
|---|---|---|---|---|---|---|
| 1 | 99.743 | sentry-llm-monitoringobservability · observability | Sentry's error and performance monitoring extended to LLM applications — captures exceptions, latency, and AI token usage with OpenTelemetry… | 44,709 stars · 4,832 forks · 15 mentions | No one-command install · Source | |
| 2 | 99.677 | langfuseobservability · observability | Open-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications. | 34,067 stars · 3,678 forks · 10 mentions | No one-command install · Source | |
| 3 | 99.490 | comet-opikobservability · observability | Opik by Comet is an open-source LLM evaluation and tracing platform — log traces, run automated evals, create datasets, and track prompt improvements… | 22,249 stars · 1,827 forks · 1 mention | No one-command install · Source | |
| 4 | 99.472 | opentelemetry-genaiobservability · observability | OpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group. | 4,897 stars · 3,851 forks | No one-command install · Source | |
| 5 | 99.334 | portkey-ai-gatewayobservability · observability | Open-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load… | 12,873 stars · 1,280 forks | No one-command install · Source | |
| 6 | 99.249 | ccstatuslineobservability · observability | A highly customizable status line formatter for Claude Code CLI that displays model info, git branch, token usage, and other metrics in your terminal. | 13,035 stars · 579 forks | No one-command install · Source | |
| 7 | 99.089 | heliconeobservability · observability | Open-source LLM observability platform — proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs. | 6,123 stars · 662 forks | No one-command install · Source | |
| 8 | 99.046 | grafana-tempoobservability · observability | Grafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM… | 5,461 stars · 746 forks | No one-command install · Source | |
| 9 | 98.822 | pydantic-logfireobservability · observability | Logfire by Pydantic — OpenTelemetry-based structured logging and tracing for Python applications with built-in support for FastAPI, SQLAlchemy, and… | 4,450 stars · 283 forks | No one-command install · Source | |
| 10 | 98.792 | langwatchobservability · observability | LangWatch provides real-time LLM analytics, guardrails, and evaluation pipelines with a visual studio for monitoring multi-step agent conversations. | 3,522 stars · 362 forks | No one-command install · Source | |
| 11 | 98.667 | openlitobservability · observability | OpenLIT is an OpenTelemetry-native LLM observability toolkit with GPU monitoring, cost tracking, and a prompt hub — one-line setup for 20+ providers. | 2,736 stars · 367 forks | No one-command install · Source | |
| 12 | 98.121 | openinferenceobservability · observability | OpenInference is an open standard and Python/JS instrumentation library for capturing LLM and agent traces in OpenTelemetry format, built by Arize AI. | 1,192 stars · 302 forks | No one-command install · Source | |
| 13 | 95.990 | claude-code-statuslineobservability · observability | Enhanced 4-line statusline for Claude Code with themes, cost tracking, and MCP server monitoring | 476 stars · 35 forks | No one-command install · Source | |
| 14 | 95.863 | phosphoobservability · observability | Phospho is a text analytics and evaluation platform for LLM apps — logs sessions, runs clustering, detects failures, and surfaces actionable insights. | 439 stars · 35 forks | No one-command install · Source | |
| 15 | 94.644 | athina-aiobservability · observability | Athina AI provides developer-focused LLM monitoring and eval framework — real-time inference logging, automated evals, and regression detection in CI. | 301 stars · 23 forks | No one-command install · Source | |
| 16 | 75.153 | honeycombobservability · observability | Honeycomb's OpenTelemetry-native observability platform — high-cardinality event store ideal for tracing LLM pipelines and debugging slow agent… | 16 stars · 6 forks | No one-command install · Source | |
| 17 | 74.422 | baserunobservability · observability | Baserun captures LLM traces via a lightweight decorator-based SDK and provides a dashboard for debugging prompt chains, testing variants, and… | 16 stars · 5 forks | Stale | No one-command install · Source |
| 18 | Unranked | datadog-llm-observabilityobservability · observability | Datadog's managed LLM Observability product — traces LLM calls, monitors prompt/completion quality, detects anomalies, and integrates with existing… | No signals yet | No commit datelisted | No one-command install · Source |
| 19 | Unranked | fiddler-aiobservability · observability | Fiddler AI Observability platform monitors LLM applications for hallucinations, toxicity, bias, and drift, with explainability and alerting for… | No signals yet | No commit datelisted | No one-command install · Source |
| 20 | Unranked | honeyhiveobservability · observability | HoneyHive is an AI evaluation and observability platform for tracing agent pipelines, running evaluations, and debugging regressions in production. | No signals yet | No commit datelisted | No one-command install · Source |
| 21 | Unranked | langtraceobservability · observability | Open-source, OpenTelemetry-compliant LLM observability tool by Scale3Labs — traces calls to all major LLM providers and frameworks with a… | No signals yet | No commit datelisted | No one-command install · Source |
| 22 | Unranked | literal-aiobservability · observability | Literal AI is an observability and evaluation platform for conversational AI — captures multi-step threads, scores responses, and integrates with… | No signals yet | No commit datelisted | No one-command install · Source |
| 23 | Unranked | lunaryobservability · observability | Open-source LLM observability and prompt management platform — tracks conversations, errors, costs, and user feedback for production AI applications. | No signals yet | No commit datelisted | No one-command install · Source |
| 24 | Unranked | maxim-aiobservability · observability | Maxim AI is an evaluation and observability platform for AI agents — supports multi-step trace analysis, prompt testing, and production quality… | No signals yet | No commit datelisted | No one-command install · Source |
| 25 | Unranked | new-relic-ai-monitoringobservability · observability | New Relic AI Monitoring instruments LLM calls end-to-end — traces model invocations, measures token costs, and surfaces anomalies via the New Relic… | No signals yet | No commit datelisted | No one-command install · Source |
Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.
Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.