Armory
Source
Browse
Evals

evalplus

Rigorous code generation evaluation framework built on top of HumanEval and MBPP with 80x more test cases.

Score
98.3242 signals
Evidence
1,819 stars · 208 forks
Last commit
as last read from GitHub; most reads are from 2 Sep 2026 or later
Listed

Install

No one-command install. Set it up from its source.

What it is

Rigorous code generation evaluation framework built on top of HumanEval and MBPP with 80x more test cases.

When to use it

Rigorous code generation evaluation framework built on top of HumanEval and MBPP with 80x more test cases.

Notes

Curated evals entry. Verified 2026-05-27.