Armory
Source

Leaderboard

Scored on public signals; components with none are listed as Unranked · Formula

RankScoreComponentDescriptionEvidenceLast commitInstall
1Unrankedagent-architecture-auditskill · ai-agentsFull-stack diagnostic for agent and LLM applications. Audits the 12-layer agent stack for wrapper regression, memory pollution, tool discipline…No signals yetNo commit datelisted armory install agent-architecture-audit --cli claude
2Unrankedagent-evaluationskill · observabilityTesting and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top…No signals yetNo commit datelisted armory install agent-evaluation --cli claude
3Unrankedagent-memory-systemsskill · databaseMemory is the cornerstone of intelligent agents. Without it, every interaction starts from zero. This skill covers the architecture of agent memory…No signals yetNo commit datelisted armory install agent-memory-systems --cli claude
4Unrankedagent-tool-builderskill · ai-agentsTools are how AI agents interact with the world. A well-designed tool is the difference between an agent that works and one that hallucinates, fails…No signals yetNo commit datelisted armory install agent-tool-builder --cli claude
5Unrankedai-productskill · ai-agentsEvery product will be AI-powered. The question is whether you'll build it right or ship a demo that falls apart in production. This skill covers LLM…No signals yetNo commit datelisted armory install ai-product --cli claude
6Unrankedai-wrapper-productskill · ai-agentsExpert in building products that wrap AI APIs (OpenAI, Anthropic, etc.) into focused tools people will pay for. Not just 'ChatGPT but different'…No signals yetNo commit datelisted armory install ai-wrapper-product --cli claude
7Unrankedawq-quantizationskill · ai-agentsActivation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on…No signals yetNo commit datelisted armory install awq-quantization --cli claude
8Unrankedaxolotlskill · ai-agentsExpert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal supportNo signals yetNo commit datelisted armory install axolotl --cli claude
9Unrankedblip-2-vision-languageskill · commsVision-language pre-training framework bridging frozen image encoders and LLMs. Use when you need image captioning, visual question answering…No signals yetNo commit datelisted armory install blip-2-vision-language --cli claude
10Unrankedbullmq-specialistskill · back-endBullMQ expert for Redis-backed job queues, background processing, and reliable async execution in Node.js/TypeScript applications. Use when: bullmq…No signals yetNo commit datelisted armory install bullmq-specialist --cli claude
11Unrankedchromaskill · databaseOpen-source embedding database for AI applications. Store embeddings and metadata, perform vector and full-text search, filter by metadata. Simple…No signals yetNo commit datelisted armory install chroma --cli claude
12Unrankedclipskill · searchOpenAI's model connecting vision and language. Enables zero-shot image classification, image-text matching, and cross-modal retrieval. Trained on 400M…No signals yetNo commit datelisted armory install clip --cli claude
13Unrankedcocoindexskill · databaseComprehensive toolkit for developing with the CocoIndex library. Use when users need to create data transformation pipelines (flows), write custom…No signals yetNo commit datelisted armory install cocoindex --cli claude
14Unrankedcontext-window-managementskill · ai-agentsStrategies for managing LLM context windows including summarization, trimming, routing, and avoiding context rot Use when: context window, token…No signals yetNo commit datelisted armory install context-window-management --cli claude
15Unrankedconversation-memoryskill · ai-agentsPersistent memory systems for LLM conversations including short-term, long-term, and entity-based memory Use when: conversation memory, remember…No signals yetNo commit datelisted armory install conversation-memory --cli claude
16Unrankedcost-aware-llm-pipelineskill · ai-agentsCost optimization patterns for LLM API usage — model routing by task complexity, budget tracking, retry logic, and prompt caching.No signals yetNo commit datelisted armory install cost-aware-llm-pipeline --cli claude
17Unrankedcrewai-multi-agentskill · ai-agentsMulti-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agents working together on complex tasks…No signals yetNo commit datelisted armory install crewai-multi-agent --cli claude
18Unrankeddistributed-llm-pretraining-torchtitanskill · ai-agentsProvides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek…No signals yetNo commit datelisted armory install distributed-llm-pretraining-torchtitan --cli claude
19Unrankeddspyskill · ai-agentsBuild complex AI systems with declarative programming, optimize prompts automatically, create modular RAG systems and agents with DSPy - Stanford…No signals yetNo commit datelisted armory install dspy --cli claude
20Unrankedesmskill · front-endComprehensive toolkit for protein language models including ESM3 (generative multimodal protein design across sequence, structure, and function) and…No signals yetNo commit datelisted armory install esm --cli claude
21Unrankedevaluating-llms-harnessskill · back-endEvaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models…No signals yetNo commit datelisted armory install evaluating-llms-harness --cli claude
22Unrankedfine-tuning-with-trlskill · ai-agentsFine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and…No signals yetNo commit datelisted armory install fine-tuning-with-trl --cli claude
23Unrankedfoundation-models-on-deviceskill · ai-agentsApple FoundationModels framework for on-device LLM — text generation, guided generation with @Generable, tool calling, and snapshot streaming in iOS…No signals yetNo commit datelisted armory install foundation-models-on-device --cli claude
24Unrankedgenimlskill · databaseThis skill should be used when working with genomic interval data (BED files) for machine learning tasks. Use for training region embeddings…No signals yetNo commit datelisted armory install geniml --cli claude
25Unrankedgepettoskill · ai-agentsCreates detailed, sectionized implementation plans through research, stakeholder interviews, and multi-LLM review. Use when planning features that…No signals yetNo commit datelisted armory install gepetto --cli claude
26Unrankedgguf-quantizationskill · devopsGGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing…No signals yetNo commit datelisted armory install gguf-quantization --cli claude
27Unrankedgptqskill · ai-agentsPost-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4×…No signals yetNo commit datelisted armory install gptq --cli claude
28Unrankedgrpo-rl-trainingskill · otherExpert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model trainingNo signals yetNo commit datelisted armory install grpo-rl-training --cli claude
29Unrankedguidanceskill · ai-agentsControl LLM output with regex and grammars, guarantee valid JSON/XML/code generation, enforce structured formats, and build multi-step workflows with…No signals yetNo commit datelisted armory install guidance --cli claude
30Unrankedhqq-quantizationskill · devopsHalf-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets…No signals yetNo commit datelisted armory install hqq-quantization --cli claude
31Unrankedhypogenicskill · otherAutomated hypothesis generation and testing using large language models. Use this skill when generating scientific hypotheses from datasets, combining…No signals yetNo commit datelisted armory install hypogenic --cli claude
32Unrankedimplementing-llms-litgptskill · ai-agentsImplements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model…No signals yetNo commit datelisted armory install implementing-llms-litgpt --cli claude
33Unrankedinstructorskill · ai-agentsExtract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and…No signals yetNo commit datelisted armory install instructor --cli claude
34Unrankedknowledge-distillationskill · ai-agentsCompress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained…No signals yetNo commit datelisted armory install knowledge-distillation --cli claude
35Unrankedlambda-labs-gpu-cloudskill · devopsReserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent…No signals yetNo commit datelisted armory install lambda-labs-gpu-cloud --cli claude
36Unrankedlangchainskill · ai-agentsFramework for building LLM-powered applications with agents, chains, and RAG. Supports multiple providers (OpenAI, Anthropic, Google), 500+…No signals yetNo commit datelisted armory install langchain --cli claude
37Unrankedlangfuseskill · ai-agentsExpert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with…No signals yetNo commit datelisted armory install langfuse --cli claude
38Unrankedlanggraphskill · front-endExpert in LangGraph - the production-grade framework for building stateful, multi-actor AI applications. Covers graph construction, state management…No signals yetNo commit datelisted armory install langgraph --cli claude
39Unrankedlangsmith-observabilityskill · observabilityLLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets…No signals yetNo commit datelisted armory install langsmith-observability --cli claude
40Unrankedllama-cppskill · ai-agentsRuns LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when…No signals yetNo commit datelisted armory install llama-cpp --cli claude
41Unrankedllama-factoryskill · ai-agentsExpert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal supportNo signals yetNo commit datelisted armory install llama-factory --cli claude
42Unrankedllamaguardskill · devopsMeta's 7-8B specialized moderation model for LLM input/output filtering. 6 safety categories - violence/hate, sexual content, weapons, substances…No signals yetNo commit datelisted armory install llamaguard --cli claude
43Unrankedllamaindexskill · searchData framework for building LLM applications with RAG. Specializes in document ingestion (300+ connectors), indexing, and querying. Features vector…No signals yetNo commit datelisted armory install llamaindex --cli claude
44Unrankedllm-app-patternsskill · ai-agentsProduction-ready patterns for building LLM applications. Covers RAG pipelines, agent architectures, prompt IDEs, and LLMOps monitoring. Use when…No signals yetNo commit datelisted armory install llm-app-patterns --cli claude
45Unrankedllm-evaluationskill · observabilityMaster comprehensive evaluation strategies for LLM applications, from automated metrics to human evaluation and A/B testing.No signals yetNo commit datelisted armory install llm-evaluation --cli claude
46Unrankedllm-opsskill · databaseLLM Operations -- RAG, embeddings, vector databases, fine-tuning, prompt engineering avancado, custos de LLM, evals de qualidade e arquiteturas de IA…No signals yetNo commit datelisted armory install llm-ops --cli claude
47Unrankedlong-contextskill · databaseExtend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents…No signals yetNo commit datelisted armory install long-context --cli claude
48Unrankedmamba-architectureskill · front-endState-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with…No signals yetNo commit datelisted armory install mamba-architecture --cli claude
49Unrankedmcp-builderskill · back-endGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools…No signals yetNo commit datelisted armory install mcp-builder --cli claude
50Unrankedmiles-rl-trainingskill · otherProvides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4…No signals yetNo commit datelisted armory install miles-rl-training --cli claude
51Unrankedml-engineer-2skill · observabilityBuild production ML systems with PyTorch 2.x, TensorFlow, and modern ML frameworks. Implements model serving, feature engineering, A/B testing, and…No signals yetNo commit datelisted armory install ml-engineer-2 --cli claude
52Unrankedmodel-pruningskill · ai-agentsReduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving…No signals yetNo commit datelisted armory install model-pruning --cli claude
53Unrankedmoe-trainingskill · otherTrain Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs…No signals yetNo commit datelisted armory install moe-training --cli claude
54Unrankedmotion-advancedskill · front-endAdvanced motion patterns for React / Next.js — drag & drop, gestures, text animations, SVG path drawing, custom hooks, imperative sequences…No signals yetNo commit datelisted armory install motion-advanced --cli claude
55Unrankednemo-curatorskill · ai-agentsGPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+…No signals yetNo commit datelisted armory install nemo-curator --cli claude
56Unrankednemo-evaluator-sdkskill · back-endEvaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable…No signals yetNo commit datelisted armory install nemo-evaluator-sdk --cli claude
57Unrankednemo-guardrailsskill · ai-agentsNVIDIA's runtime safety framework for LLM applications. Features jailbreak detection, input/output validation, fact-checking, hallucination detection…No signals yetNo commit datelisted armory install nemo-guardrails --cli claude
58Unrankednowait-reasoning-optimizerskill · ai-agentsImplements the NOWAIT technique for efficient reasoning in R1-style LLMs. Use when optimizing inference of reasoning models (QwQ, DeepSeek-R1…No signals yetNo commit datelisted armory install nowait-reasoning-optimizer --cli claude
59Unrankedopenrlhf-trainingskill · otherHigh-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM…No signals yetNo commit datelisted armory install openrlhf-training --cli claude
60Unrankedoptimizing-attention-flashskill · ai-agentsOptimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long…No signals yetNo commit datelisted armory install optimizing-attention-flash --cli claude
61Unrankedoutlinesskill · ai-agentsGuarantee valid JSON/XML/code structure during generation, use Pydantic models for type-safe outputs, support local models (Transformers, vLLM), and…No signals yetNo commit datelisted armory install outlines --cli claude
62Unrankedpeft-fine-tuningskill · ai-agentsParameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when…No signals yetNo commit datelisted armory install peft-fine-tuning --cli claude
63Unrankedperplexity-searchskill · searchPerform AI-powered web searches with real-time information using Perplexity models via LiteLLM and OpenRouter. This skill should be used when…No signals yetNo commit datelisted armory install perplexity-search --cli claude
64Unrankedphoenix-observabilityskill · observabilityOpen-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running…No signals yetNo commit datelisted armory install phoenix-observability --cli claude
65Unrankedpineconeskill · databaseManaged vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and…No signals yetNo commit datelisted armory install pinecone --cli claude
66Unrankedprompt-cachingskill · ai-agentsCaching strategies for LLM prompts including Anthropic prompt caching, response caching, and CAG (Cache Augmented Generation) Use when: prompt…No signals yetNo commit datelisted armory install prompt-caching --cli claude
67Unrankedprompt-engineer-3skill · ai-agentsExpert in designing effective prompts for LLM-powered applications. Masters prompt structure, context management, output formatting, and prompt…No signals yetNo commit datelisted armory install prompt-engineer-3 --cli claude
68Unrankedprompt-engineeringskill · ai-agentsExpert guide on prompt engineering patterns, best practices, and optimization techniques. Use when user wants to improve prompts, learn prompting…No signals yetNo commit datelisted armory install prompt-engineering --cli claude
69Unrankedprompt-engineering-patternsskill · ai-agentsMaster advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability.No signals yetNo commit datelisted armory install prompt-engineering-patterns --cli claude
70Unrankedpymc-bayesian-modelingskill · otherBayesian modeling with PyMC. Build hierarchical models, MCMC (NUTS), variational inference, LOO/WAIC comparison, posterior checks, for probabilistic…No signals yetNo commit datelisted armory install pymc-bayesian-modeling --cli claude
71Unrankedqdrant-vector-searchskill · searchHigh-performance vector similarity search engine for RAG and semantic search. Use when building production RAG systems requiring fast nearest neighbor…No signals yetNo commit datelisted armory install qdrant-vector-search --cli claude
72Unrankedquantizing-models-bitsandbytesskill · ai-agentsQuantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or…No signals yetNo commit datelisted armory install quantizing-models-bitsandbytes --cli claude
73Unrankedrag-engineerskill · databaseExpert in building Retrieval-Augmented Generation systems. Masters embedding models, vector databases, chunking strategies, and retrieval optimization…No signals yetNo commit datelisted armory install rag-engineer --cli claude
74Unrankedrag-implementationskill · searchRetrieval-Augmented Generation patterns including chunking, embeddings, vector stores, and retrieval optimization Use when: rag, retrieval augmented…No signals yetNo commit datelisted armory install rag-implementation --cli claude
75Unrankedregex-vs-llm-structured-textskill · ai-agentsDecision framework for choosing between regex and LLM when parsing structured text — start with regex, add LLM only for low-confidence edge cases.No signals yetNo commit datelisted armory install regex-vs-llm-structured-text --cli claude
76Unrankedrwkv-architectureskill · ai-agentsRNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux…No signals yetNo commit datelisted armory install rwkv-architecture --cli claude
77Unrankedsenior-computer-visionskill · devopsWorld-class computer vision skill for image/video processing, object detection, segmentation, and visual AI systems. Expertise in PyTorch, OpenCV…No signals yetNo commit datelisted armory install senior-computer-vision --cli claude
78Unrankedsenior-ml-engineerskill · devopsWorld-class ML engineering skill for productionizing ML models, MLOps, and building scalable ML systems. Expertise in PyTorch, TensorFlow, model…No signals yetNo commit datelisted armory install senior-ml-engineer --cli claude
79Unrankedsenior-prompt-engineerskill · ai-agentsWorld-class prompt engineering skill for LLM optimization, prompt patterns, structured outputs, and AI product development. Expertise in Claude…No signals yetNo commit datelisted armory install senior-prompt-engineer --cli claude
80Unrankedsentence-transformersskill · searchFramework for state-of-the-art sentence, text, and image embeddings. Provides 5000+ pre-trained models for semantic similarity, clustering, and…No signals yetNo commit datelisted armory install sentence-transformers --cli claude
81Unrankedserving-llms-vllmskill · ai-agentsServes LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference…No signals yetNo commit datelisted armory install serving-llms-vllm --cli claude
82Unrankedsglangskill · ai-agentsFast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic…No signals yetNo commit datelisted armory install sglang --cli claude
83Unrankedsimpo-trainingskill · ai-agentsSimple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No…No signals yetNo commit datelisted armory install simpo-training --cli claude
84Unrankedslime-rl-trainingskill · ai-agentsProvides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data…No signals yetNo commit datelisted armory install slime-rl-training --cli claude
85Unrankedspeculative-decodingskill · devopsAccelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed…No signals yetNo commit datelisted armory install speculative-decoding --cli claude
86Unrankedstatsmodelsskill · observabilityStatistical modeling toolkit. OLS, GLM, logistic, ARIMA, time series, hypothesis tests, diagnostics, AIC/BIC, for rigorous statistical inference and…No signals yetNo commit datelisted armory install statsmodels --cli claude
87Unrankedtensorrt-llmskill · devopsOptimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when…No signals yetNo commit datelisted armory install tensorrt-llm --cli claude
88Unrankedtraining-llms-megatronskill · ai-agentsTrains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B…No signals yetNo commit datelisted armory install training-llms-megatron --cli claude
89Unrankedtransformersskill · otherThis skill should be used when working with pre-trained transformer models for natural language processing, computer vision, audio, or multimodal…No signals yetNo commit datelisted armory install transformers --cli claude
90Unrankedunslothskill · ai-agentsExpert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimizationNo signals yetNo commit datelisted armory install unsloth --cli claude
91Unrankedverl-rl-trainingskill · back-endProvides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL…No signals yetNo commit datelisted armory install verl-rl-training --cli claude
92Unrankedvoice-agentsskill · ai-agentsVoice agents represent the frontier of AI interaction - humans speaking naturally with AI systems. The challenge isn't just speech recognition and…No signals yetNo commit datelisted armory install voice-agents --cli claude
93Unrankedzod-validation-expertskill · front-endExpert in Zod — TypeScript-first schema validation. Covers parsing, custom errors, refinements, type inference, and integration with React Hook Form…No signals yetNo commit datelisted armory install zod-validation-expert --cli claude

Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.

Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.

Leaderboard · Armory