Agent-Eval

Agent-Eval

Product Hunt

Statistical regression testing for LLM agents

GitHub & Open Source
Open Source
GitHub
Developer Tools
Listed Aug 5, 2026

Statistical regression testing for LLM agents. Run versions A and B 50 times to get a p-value, Cohen's d, and a 95% CI proving whether behavior actually shifted. While DeepEval, Braintrust, and Promptfoo test single responses against a threshold, none measure distribution drift. It is completely self-hostable under an Apache 2.0 license and requires no SaaS subscriptions. Works natively with LangGraph, OpenAI Agents SDK, CrewAI, and LangChain LCEL. Start testing: `pip install agent-regress-cli`.

GitHub & Open Source
Growing
Few apps + High potential
8

of 59

Total Apps

470

This Week

470

2%

Topics

2

Competition
23
Opportunity
42

Daily launches (14d)

Market positioning

Growing · vs 58 other categories

Explore GitHub & Open Source

Similar Apps