vellum-evals
Vellum evaluation SDK for running LLM test suites with custom metrics, dataset pinning, and CI workflow integration.
- Score
- 90.5542 signals
- Evidence
- 82 stars · 20 forks
- Last commit
- as last read from GitHub; most reads are from 2 Sep 2026 or later
- Listed
Install
No one-command install. Set it up from its source.
Alternatives · Evals
- continuous-eval517 stars · 38 forks96.207
What it is
Vellum evaluation SDK for running LLM test suites with custom metrics, dataset pinning, and CI workflow integration.
When to use it
Vellum evaluation SDK for running LLM test suites with custom metrics, dataset pinning, and CI workflow integration.
Notes
Curated evals entry. Verified 2026-05-27.