Leaderboard
Scored on public signals; components with none are listed as Unranked · Formula
Component
Domain
Vertical
| Rank | Score | Component | Description | Evidence | Last commit | Install |
|---|---|---|---|---|---|---|
| 1 | 74.422 | baserunobservability · observability | Baserun captures LLM traces via a lightweight decorator-based SDK and provides a dashboard for debugging prompt chains, testing variants, and… | 16 stars · 5 forks | Stale | No one-command install · Source |
| 2 | 75.153 | honeycombobservability · observability | Honeycomb's OpenTelemetry-native observability platform: a high-cardinality event store ideal for tracing LLM pipelines and debugging slow agent… | 16 stars · 6 forks | No one-command install · Source | |
| 3 | 94.644 | athina-aiobservability · observability | Athina AI provides developer-focused LLM monitoring and eval framework: real-time inference logging, automated evals, and regression detection in CI. | 301 stars · 23 forks | No one-command install · Source | |
| 4 | 98.005 | langsmithobservability · back-end | LangChain's platform for tracing, evaluating, and monitoring LLM applications: deep integration with LangChain/LangGraph plus a REST API for any… | 1,043 stars · 288 forks | No one-command install · Source | |
| 5 | 98.121 | openinferenceobservability · observability | OpenInference is an open standard and Python/JS instrumentation library for capturing LLM and agent traces in OpenTelemetry format, built by Arize AI. | 1,192 stars · 302 forks | No one-command install · Source | |
| 6 | 98.624 | laminarobservability · ai-agents | Laminar is an open-source platform for tracing, evaluating, and labeling LLM and agent pipelines with a TypeScript/Python SDK and a self-hostable… | 3,218 stars · 229 forks · 1 mention | No one-command install · Source | |
| 7 | 98.667 | openlitobservability · observability | OpenLIT is an OpenTelemetry-native LLM observability toolkit with GPU monitoring, cost tracking, and a prompt hub (one-line setup for 20+ providers). | 2,736 stars · 367 forks | No one-command install · Source | |
| 8 | 99.046 | grafana-tempoobservability · observability | Grafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM… | 5,461 stars · 746 forks | No one-command install · Source | |
| 9 | 99.089 | heliconeobservability · observability | Open-source LLM observability platform: proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs. | 6,123 stars · 662 forks | No one-command install · Source | |
| 10 | 99.194 | openllmetryobservability · ai-agents | OpenTelemetry-based observability for LLM applications. It auto-instruments OpenAI, Anthropic, LangChain, and 20+ providers with zero code changes. | 7,452 stars · 1,099 forks | No one-command install · Source | |
| 11 | 99.334 | portkey-ai-gatewayobservability · observability | Open-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load… | 12,873 stars · 1,280 forks | No one-command install · Source | |
| 12 | 99.472 | opentelemetry-genaiobservability · observability | OpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group. | 4,897 stars · 3,851 forks | No one-command install · Source | |
| 13 | 99.490 | comet-opikobservability · observability | Opik by Comet is an open-source LLM evaluation and tracing platform: log traces, run automated evals, create datasets, and track prompt improvements… | 22,249 stars · 1,827 forks · 1 mention | No one-command install · Source | |
| 14 | 99.677 | langfuseobservability · observability | Open-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications. | 34,067 stars · 3,678 forks · 10 mentions | No one-command install · Source | |
| 15 | 99.684 | mlflow-tracingobservability · ai-agents | MLflow's LLM tracing module instruments model calls, agent steps, and tool invocations, storing them alongside experiment runs for reproducibility. | 27,768 stars · 6,246 forks | No one-command install · Source | |
| 16 | 99.743 | sentry-llm-monitoringobservability · observability | Sentry's error and performance monitoring extended to LLM applications. It captures exceptions, latency, and AI token usage with OpenTelemetry… | 44,709 stars · 4,832 forks · 15 mentions | No one-command install · Source | |
| 17 | Unranked | datadog-llm-observabilityobservability · observability | Datadog's managed LLM Observability product. It traces LLM calls, monitors prompt/completion quality, detects anomalies, and integrates with existing… | No signals yet | No commit datelisted | No one-command install · Source |
| 18 | Unranked | fiddler-aiobservability · observability | Fiddler AI Observability platform monitors LLM applications for hallucinations, toxicity, bias, and drift, with explainability and alerting for… | No signals yet | No commit datelisted | No one-command install · Source |
| 19 | Unranked | langtraceobservability · observability | Open-source, OpenTelemetry-compliant LLM observability tool by Scale3Labs. It traces calls to all major LLM providers and frameworks with a… | No signals yet | No commit datelisted | No one-command install · Source |
| 20 | Unranked | lunaryobservability · observability | Open-source LLM observability and prompt management platform. It tracks conversations, errors, costs, and user feedback for production AI… | No signals yet | No commit datelisted | No one-command install · Source |
| 21 | Unranked | new-relic-ai-monitoringobservability · observability | New Relic AI Monitoring instruments LLM calls end-to-end. It traces model invocations, measures token costs, and surfaces anomalies via the New Relic… | No signals yet | No commit datelisted | No one-command install · Source |
Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.
Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.