Aequitas
Aequitas: A free, open-source fairness evaluator with Python, CLI and web workflows. Ranked #27 of 39 in AI Model Evaluation Software by our editors (6.4/10); pricing: Free plan; best for auditing group fairness with web and CLI tools.
At a glance
- Editor score6.4 / 10
- PricingFree plan
- Best forAuditing group fairness with web and CLI tools
- Free planYes
- Paid fromFree
- Safety & bias checksYes
- Founded2018
- Facts checked19 Nov 2026
Where it wins
- Audits bias, disparity and group-level metrics across population groups
- Offers Python API, CLI and web interfaces for different workflows
- Exports PDF, CSV and DataFrame reports with visualizations
Where it doesn't
- Focuses on fairness and bias evaluation rather than broad model testing
- Requires user-supplied scores and demographic or other group attributes
- Support is centered on documentation and community channels
Our verdict on Aequitas
Aequitas is an open-source toolkit for machine-learning developers, analysts and policymakers who need to examine fairness across population groups. It evaluates model predictions with fairness, disparity and group-level metrics, then presents results through a web application, command-line interface, Python package and generated reports. The toolkit supports cloud and self-hosted deployment, with web, Linux and API access paths.
Its standout capability is configurable group fairness analysis. Users can set reference groups, test score thresholds and percentiles, and inspect statistical, impact, false-positive, false-negative and false-omission parity measures. Metric and disparity visualizations help compare groups, while PDF, CSV and DataFrame outputs support reporting and downstream analysis. Inputs can come from CSV files, databases or Python workflows, giving teams several ways to connect existing evaluation data.
Aequitas is free and open source, so there is no paid tier structure to compare. Getting useful results still depends on supplying prediction scores, optional labels and demographic or other attributes, then configuring the relevant groups, thresholds and fairness measures. Documentation and community channels are the listed support paths. Choose Aequitas when the primary requirement is auditing group fairness with web, CLI or Python tools; teams seeking a wider model-evaluation suite beyond bias, disparity and group metrics should consider a broader alternative.
Your product? Our editors can test Aequitas in depth and publish a review, labelled as paid · from $149/mo →
Aequitas pricing
Aequitas fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Free |
| Evaluation types | bias audits, fairness metrics, disparity analysis, group metrics |
| Safety & bias checks | Yes |
| Regression benchmarks | Not verified |
| Human review workflows | Not verified |
| Included evaluation runs | Not verified |
| Deployment option | Hybrid |
| Model providers | Not verified |
| Deployment | Cloud, Self-hosted |
| Platforms | Web, Linux |
| Support | Docs, Community |
| Built for | Solo, Small business, Mid-market, Enterprise (editorial estimate) |
| Integrations | 3 integrations: CSV, databases, Python |
| Pricing | Free plan |
| Website | aequitas.dssg.io |
| Facts checked | 19 Nov 2026 |
Aequitas integrations
Aequitas lists 3 integrations on its own site.
- CSV
- databases
- Python
Alternatives to Aequitas
- LangSmithA broad LangSmith toolkit for tracing, evaluating, and improving LLM applications.9.4
- RagasA flexible, self-hosted toolkit for metric-driven LLM evaluation.9.1
- BraintrustGoverned evaluation, tracing, and regression controls for teams operating AI applications.8.9
See all Aequitas alternatives →
Used Aequitas? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used Aequitas for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
Aequitas is listed in our AI Model Evaluation Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/aequitas-ai-model-evaluation-tool/"><img src="https://www.itechguides.com/best/badge/aequitas-ai-model-evaluation-tool.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Nov 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update


