Browse

phoenix

Arize Phoenix: open-source LLM observability with built-in evals, span tracing, and dataset curation for RAG and agents.

humanlayer-humanlayer

The best way to get AI coding agents to solve hard problems in complex codebases.

Contributed by Sentinel

twilio

Unleash the power of Twilio from your command prompt

artidoro-qlora

QLoRA: Efficient Finetuning of Quantized LLMs

Contributed by Sentinel

harbor-framework-harbor

Framework for evaluating and improving agents

Contributed by Sentinel

claude-squad

Claude Squad is a terminal app that manages multiple Claude Code, Codex (and other local agents including Aider) in separate workspaces, allowing you to work on multiple tasks simultaneously.

plastic-labs-honcho

Memory library for building stateful agents

Contributed by Sentinel

claude-code-usage-monitor

A real-time terminal-based tool for monitoring Claude Code token usage. It shows live token consumption, burn rate, and predictions for token depletion. Features include visual progress bars, session-aware analytics, and support for multiple subscription plans.

swe-bench

SWE-bench: benchmark for evaluating LLMs on real-world GitHub issue resolution across 12 popular Python repositories.

alexzhang13-rlm

General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.

Contributed by Sentinel

clawd-on-desk

A desktop pet that reacts to your Claude Code sessions in real time: thinking, typing, juggling, sleeping and more.

gepa-ai-gepa

Optimize prompts, code, and more with AI-powered Reflective Optimization

Contributed by Sentinel

giskard

Open-source LLM testing framework for detecting vulnerabilities (prompt injection, hallucinations, bias) via automated scan.

getzep-zep

Examples, framework integrations and tools for Zep Cloud, Zep's hosted agent memory service; the repository says it is not the product itself. The open-source knowledge-graph engine behind Zep is Graphiti (getzep-graphiti).

Contributed by Sentinel

agenta

Open-source LLM developer platform with prompt playground, evaluation pipelines, and A/B testing for iterating on LLM apps.

openai-simple-evals

OpenAI's lightweight benchmark suite (MMLU, HumanEval, MATH, GPQA, MGSM) for fast model capability comparisons.

caviraoss-openmemory

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

Contributed by Sentinel

claudable

Claudable is an open-source web builder that leverages local CLI agents, such as Claude Code and Cursor Agent, to build and deploy products effortlessly.

big-bench

Google's Beyond the Imitation Game benchmark: 200+ diverse tasks designed to probe capabilities beyond standard NLP benchmarks.

flowelement-m-flow

Use when recall should follow associations between memories rather than nearest-neighbour similarity alone.

trulens

Evaluation and tracking for LLM and RAG applications with a feedback-function API and experiment dashboard.

claude-devtools

A desktop app that shows your Claude Code sessions by reading their logs: context use per turn across categories, compaction, sub-agent execution trees and custom notification triggers.

xlang-ai-osworld

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Contributed by Sentinel

inspect-ai

UK AISI's framework for safety evaluations of large language models, with task-based scaffolding and solver pipelines.