Armory
Source

Leaderboard

Scored on public signals; components with none are listed as Unranked · Formula

RankScoreComponentDescriptionEvidenceLast commitInstall
1Unrankedagent-architecture-auditskill · ai-agentsFull-stack diagnostic for agent and LLM applications. Audits the 12-layer agent stack for wrapper regression, memory pollution, tool discipline…No signals yetNo commit datelisted armory install agent-architecture-audit --cli claude
2Unrankedagent-tool-builderskill · ai-agentsTools are how AI agents interact with the world. A well-designed tool is the difference between an agent that works and one that hallucinates, fails…No signals yetNo commit datelisted armory install agent-tool-builder --cli claude
3Unrankedai-productskill · ai-agentsEvery product will be AI-powered. The question is whether you'll build it right or ship a demo that falls apart in production. This skill covers LLM…No signals yetNo commit datelisted armory install ai-product --cli claude
4Unrankedai-wrapper-productskill · ai-agentsExpert in building products that wrap AI APIs (OpenAI, Anthropic, etc.) into focused tools people will pay for. Not just 'ChatGPT but different'…No signals yetNo commit datelisted armory install ai-wrapper-product --cli claude
5Unrankedawq-quantizationskill · ai-agentsActivation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on…No signals yetNo commit datelisted armory install awq-quantization --cli claude
6Unrankedaxolotlskill · ai-agentsExpert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal supportNo signals yetNo commit datelisted armory install axolotl --cli claude
7Unrankedcontext-window-managementskill · ai-agentsStrategies for managing LLM context windows including summarization, trimming, routing, and avoiding context rot Use when: context window, token…No signals yetNo commit datelisted armory install context-window-management --cli claude
8Unrankedconversation-memoryskill · ai-agentsPersistent memory systems for LLM conversations including short-term, long-term, and entity-based memory Use when: conversation memory, remember…No signals yetNo commit datelisted armory install conversation-memory --cli claude
9Unrankedcost-aware-llm-pipelineskill · ai-agentsCost optimization patterns for LLM API usage — model routing by task complexity, budget tracking, retry logic, and prompt caching.No signals yetNo commit datelisted armory install cost-aware-llm-pipeline --cli claude
10Unrankedcrewai-multi-agentskill · ai-agentsMulti-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agents working together on complex tasks…No signals yetNo commit datelisted armory install crewai-multi-agent --cli claude
11Unrankeddistributed-llm-pretraining-torchtitanskill · ai-agentsProvides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek…No signals yetNo commit datelisted armory install distributed-llm-pretraining-torchtitan --cli claude
12Unrankeddspyskill · ai-agentsBuild complex AI systems with declarative programming, optimize prompts automatically, create modular RAG systems and agents with DSPy - Stanford…No signals yetNo commit datelisted armory install dspy --cli claude
13Unrankedfine-tuning-with-trlskill · ai-agentsFine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and…No signals yetNo commit datelisted armory install fine-tuning-with-trl --cli claude
14Unrankedfoundation-models-on-deviceskill · ai-agentsApple FoundationModels framework for on-device LLM — text generation, guided generation with @Generable, tool calling, and snapshot streaming in iOS…No signals yetNo commit datelisted armory install foundation-models-on-device --cli claude
15Unrankedgepettoskill · ai-agentsCreates detailed, sectionized implementation plans through research, stakeholder interviews, and multi-LLM review. Use when planning features that…No signals yetNo commit datelisted armory install gepetto --cli claude
16Unrankedgptqskill · ai-agentsPost-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4×…No signals yetNo commit datelisted armory install gptq --cli claude
17Unrankedguidanceskill · ai-agentsControl LLM output with regex and grammars, guarantee valid JSON/XML/code generation, enforce structured formats, and build multi-step workflows with…No signals yetNo commit datelisted armory install guidance --cli claude
18Unrankedimplementing-llms-litgptskill · ai-agentsImplements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model…No signals yetNo commit datelisted armory install implementing-llms-litgpt --cli claude
19Unrankedinstructorskill · ai-agentsExtract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and…No signals yetNo commit datelisted armory install instructor --cli claude
20Unrankedknowledge-distillationskill · ai-agentsCompress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained…No signals yetNo commit datelisted armory install knowledge-distillation --cli claude
21Unrankedlangchainskill · ai-agentsFramework for building LLM-powered applications with agents, chains, and RAG. Supports multiple providers (OpenAI, Anthropic, Google), 500+…No signals yetNo commit datelisted armory install langchain --cli claude
22Unrankedlangfuseskill · ai-agentsExpert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with…No signals yetNo commit datelisted armory install langfuse --cli claude
23Unrankedllama-cppskill · ai-agentsRuns LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when…No signals yetNo commit datelisted armory install llama-cpp --cli claude
24Unrankedllama-factoryskill · ai-agentsExpert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal supportNo signals yetNo commit datelisted armory install llama-factory --cli claude
25Unrankedllm-app-patternsskill · ai-agentsProduction-ready patterns for building LLM applications. Covers RAG pipelines, agent architectures, prompt IDEs, and LLMOps monitoring. Use when…No signals yetNo commit datelisted armory install llm-app-patterns --cli claude
26Unrankedmodel-pruningskill · ai-agentsReduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving…No signals yetNo commit datelisted armory install model-pruning --cli claude
27Unrankednemo-curatorskill · ai-agentsGPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+…No signals yetNo commit datelisted armory install nemo-curator --cli claude
28Unrankednemo-guardrailsskill · ai-agentsNVIDIA's runtime safety framework for LLM applications. Features jailbreak detection, input/output validation, fact-checking, hallucination detection…No signals yetNo commit datelisted armory install nemo-guardrails --cli claude
29Unrankednowait-reasoning-optimizerskill · ai-agentsImplements the NOWAIT technique for efficient reasoning in R1-style LLMs. Use when optimizing inference of reasoning models (QwQ, DeepSeek-R1…No signals yetNo commit datelisted armory install nowait-reasoning-optimizer --cli claude
30Unrankedoptimizing-attention-flashskill · ai-agentsOptimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long…No signals yetNo commit datelisted armory install optimizing-attention-flash --cli claude
31Unrankedoutlinesskill · ai-agentsGuarantee valid JSON/XML/code structure during generation, use Pydantic models for type-safe outputs, support local models (Transformers, vLLM), and…No signals yetNo commit datelisted armory install outlines --cli claude
32Unrankedpeft-fine-tuningskill · ai-agentsParameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when…No signals yetNo commit datelisted armory install peft-fine-tuning --cli claude
33Unrankedprompt-cachingskill · ai-agentsCaching strategies for LLM prompts including Anthropic prompt caching, response caching, and CAG (Cache Augmented Generation) Use when: prompt…No signals yetNo commit datelisted armory install prompt-caching --cli claude
34Unrankedprompt-engineer-3skill · ai-agentsExpert in designing effective prompts for LLM-powered applications. Masters prompt structure, context management, output formatting, and prompt…No signals yetNo commit datelisted armory install prompt-engineer-3 --cli claude
35Unrankedprompt-engineeringskill · ai-agentsExpert guide on prompt engineering patterns, best practices, and optimization techniques. Use when user wants to improve prompts, learn prompting…No signals yetNo commit datelisted armory install prompt-engineering --cli claude
36Unrankedprompt-engineering-patternsskill · ai-agentsMaster advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability.No signals yetNo commit datelisted armory install prompt-engineering-patterns --cli claude
37Unrankedquantizing-models-bitsandbytesskill · ai-agentsQuantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or…No signals yetNo commit datelisted armory install quantizing-models-bitsandbytes --cli claude
38Unrankedregex-vs-llm-structured-textskill · ai-agentsDecision framework for choosing between regex and LLM when parsing structured text — start with regex, add LLM only for low-confidence edge cases.No signals yetNo commit datelisted armory install regex-vs-llm-structured-text --cli claude
39Unrankedrwkv-architectureskill · ai-agentsRNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux…No signals yetNo commit datelisted armory install rwkv-architecture --cli claude
40Unrankedsenior-prompt-engineerskill · ai-agentsWorld-class prompt engineering skill for LLM optimization, prompt patterns, structured outputs, and AI product development. Expertise in Claude…No signals yetNo commit datelisted armory install senior-prompt-engineer --cli claude
41Unrankedserving-llms-vllmskill · ai-agentsServes LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference…No signals yetNo commit datelisted armory install serving-llms-vllm --cli claude
42Unrankedsglangskill · ai-agentsFast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic…No signals yetNo commit datelisted armory install sglang --cli claude
43Unrankedsimpo-trainingskill · ai-agentsSimple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No…No signals yetNo commit datelisted armory install simpo-training --cli claude
44Unrankedslime-rl-trainingskill · ai-agentsProvides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data…No signals yetNo commit datelisted armory install slime-rl-training --cli claude
45Unrankedtraining-llms-megatronskill · ai-agentsTrains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B…No signals yetNo commit datelisted armory install training-llms-megatron --cli claude
46Unrankedunslothskill · ai-agentsExpert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimizationNo signals yetNo commit datelisted armory install unsloth --cli claude
47Unrankedvoice-agentsskill · ai-agentsVoice agents represent the frontier of AI interaction - humans speaking naturally with AI systems. The challenge isn't just speech recognition and…No signals yetNo commit datelisted armory install voice-agents --cli claude

Score colour shows how many signals stand behind it, never how good it is: amber, three or more; dimmer amber, two; grey, one. The Evidence column names them.

Stars, forks and last commit are as GitHub reported them when Armory last read each repository: for most, or later. A repository may have changed since.

Leaderboard · Armory