Aequitas review
A free, open-source fairness evaluator with Python, CLI and web workflows.
Reviewed by iTechGuides Editors · Editorial team · Updated Nov 2026
Aequitas is an open-source toolkit for machine-learning developers, analysts and policymakers who need to examine fairness across population groups. It evaluates model predictions with fairness, disparity and group-level metrics, then presents results through a web application, command-line interface, Python package and generated reports. The toolkit supports cloud and self-hosted deployment, with web, Linux and API access paths.
Its standout capability is configurable group fairness analysis. Users can set reference groups, test score thresholds and percentiles, and inspect statistical, impact, false-positive, false-negative and false-omission parity measures. Metric and disparity visualizations help compare groups, while PDF, CSV and DataFrame outputs support reporting and downstream analysis. Inputs can come from CSV files, databases or Python workflows, giving teams several ways to connect existing evaluation data.
Aequitas is free and open source, so there is no paid tier structure to compare. Getting useful results still depends on supplying prediction scores, optional labels and demographic or other attributes, then configuring the relevant groups, thresholds and fairness measures. Documentation and community channels are the listed support paths. Choose Aequitas when the primary requirement is auditing group fairness with web, CLI or Python tools; teams seeking a wider model-evaluation suite beyond bias, disparity and group metrics should consider a broader alternative.
Aequitas pros and cons
- Where it wins
- Audits bias, disparity and group-level metrics across population groups
- Offers Python API, CLI and web interfaces for different workflows
- Exports PDF, CSV and DataFrame reports with visualizations
- Where it doesn't
- Focuses on fairness and bias evaluation rather than broad model testing
- Requires user-supplied scores and demographic or other group attributes
- Support is centered on documentation and community channels
Aequitas fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update