Observability
Traces, cost and errors from each run
- Listed
- 34
- Ranked
- 76.5%
- Top Score
- 99.7
Pick
The pick and its runners-up, in score order
- langfuse99.63 signals
The pick · #3 on this shelf
Traces, prompt management, datasets and evals in one self-hostable platform
The two rows above it are tracing add-ons to Sentry and MLflow; this is a whole platform on its own.
34,067 stars · 3,678 forks · 10 mentionsNo one-command install · Source - comet-opik99.43 signals
Runner-up · #5 on this shelf
Open-source tracing and evaluation: log traces, run evals, track prompt changes
Built like the pick; above it are two tracing add-ons, the pick and a Claude Code status line.
22,249 stars · 1,827 forks · 1 mentionNo one-command install · Source
Top Ranked
Needs the armory CLI · not on npm yet, build it from cli/ in the repository
| Rank | Score | Component | Description | Evidence | Last commit | Install |
|---|---|---|---|---|---|---|
| 1 | 99.743 | sentry-llm-monitoringobservability · observability | Sentry's error and performance monitoring extended to LLM applications — captures exceptions, latency, and AI token usage with OpenTelemetry… | 44,709 stars · 4,832 forks · 15 mentions | No one-command install · Source | |
| 2 | 99.684 | mlflow-tracingobservability · ai-agents | MLflow's LLM tracing module instruments model calls, agent steps, and tool invocations, storing them alongside experiment runs for reproducibility. | 27,768 stars · 6,246 forks | No one-command install · Source | |
| 3 | 99.677 | langfuseobservability · observability | Open-source LLM engineering platform with traces, evals, prompt management, and datasets for debugging and improving LLM applications. | 34,067 stars · 3,678 forks · 10 mentions | No one-command install · Source | |
| 4 | 99.526 | claude-hudobservability · ai-agents | A status line for Claude Code that shows context usage, tools, agents, to-dos and more. Highly configurable, and maintained when it was listed. | 27,778 stars · 1,286 forks | No one-command install · Source | |
| 5 | 99.490 | comet-opikobservability · observability | Opik by Comet is an open-source LLM evaluation and tracing platform — log traces, run automated evals, create datasets, and track prompt improvements… | 22,249 stars · 1,827 forks · 1 mention | No one-command install · Source | |
| 6 | 99.472 | opentelemetry-genaiobservability · observability | OpenTelemetry semantic conventions and instrumentation for GenAI/LLM spans, traces, and metrics via the GenAI semconv working group. | 4,897 stars · 3,851 forks | No one-command install · Source | |
| 7 | 99.334 | portkey-ai-gatewayobservability · observability | Open-source AI gateway providing a unified API across 100+ LLM providers with built-in observability, request logging, fallbacks, caching, and load… | 12,873 stars · 1,280 forks | No one-command install · Source | |
| 8 | 99.249 | ccstatuslineobservability · observability | A highly customizable status line formatter for Claude Code CLI that displays model info, git branch, token usage, and other metrics in your terminal. | 13,035 stars · 579 forks | No one-command install · Source | |
| 9 | 99.194 | openllmetryobservability · ai-agents | OpenTelemetry-based observability for LLM applications — auto-instruments OpenAI, Anthropic, LangChain, and 20+ providers with zero code changes. | 7,452 stars · 1,099 forks | No one-command install · Source | |
| 10 | 99.089 | heliconeobservability · observability | Open-source LLM observability platform — proxy-based logging, cost tracking, caching, and rate limiting for OpenAI-compatible APIs. | 6,123 stars · 662 forks | No one-command install · Source | |
| 11 | 99.046 | grafana-tempoobservability · observability | Grafana Tempo is a cost-efficient distributed tracing backend (OpenTelemetry-native) that pairs with Loki for logs and Prometheus for metrics in LLM… | 5,461 stars · 746 forks | No one-command install · Source | |
| 12 | 98.822 | pydantic-logfireobservability · observability | Logfire by Pydantic — OpenTelemetry-based structured logging and tracing for Python applications with built-in support for FastAPI, SQLAlchemy, and… | 4,450 stars · 283 forks | No one-command install · Source | |
| 13 | 98.792 | langwatchobservability · observability | LangWatch provides real-time LLM analytics, guardrails, and evaluation pipelines with a visual studio for monitoring multi-step agent conversations. | 3,522 stars · 362 forks | No one-command install · Source | |
| 14 | 98.669 | ccometixline-claude-code-statuslineobservability · ai-agents | A high-performance Claude Code statusline tool written in Rust with Git integration, usage tracking, interactive TUI configuration, and Claude Code… | 3,456 stars · 215 forks | No one-command install · Source | |
| 15 | 98.667 | openlitobservability · observability | OpenLIT is an OpenTelemetry-native LLM observability toolkit with GPU monitoring, cost tracking, and a prompt hub — one-line setup for 20+ providers. | 2,736 stars · 367 forks | No one-command install · Source | |
| 16 | 98.624 | laminarobservability · ai-agents | Laminar is an open-source platform for tracing, evaluating, and labeling LLM and agent pipelines with a TypeScript/Python SDK and a self-hostable… | 3,218 stars · 229 forks · 1 mention | No one-command install · Source | |
| 17 | 98.121 | openinferenceobservability · observability | OpenInference is an open standard and Python/JS instrumentation library for capturing LLM and agent traces in OpenTelemetry format, built by Arize AI. | 1,192 stars · 302 forks | No one-command install · Source | |
| 18 | 98.005 | langsmithobservability · back-end | LangChain's platform for tracing, evaluating, and monitoring LLM applications — deep integration with LangChain/LangGraph plus a REST API for any… | 1,043 stars · 288 forks | No one-command install · Source | |
| 19 | 97.619 | claude-powerlineobservability · ai-agents | A vim-style powerline statusline for Claude Code with real-time usage tracking, git integration, custom themes, and more | 1,163 stars · 82 forks | No one-command install · Source | |
| 20 | 95.990 | claude-code-statuslineobservability · observability | Enhanced 4-line statusline for Claude Code with themes, cost tracking, and MCP server monitoring | 476 stars · 35 forks | No one-command install · Source |
Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.
Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.
Leaderboard ranks all 26 scored rows. Formula shows the calculation.