A

autorank

Free#62 of 106 in Statistical Analysis Software

autorank: A focused Python package for choosing and reporting tests across paired populations. Ranked #62 of 106 in Statistical Analysis Software by our editors (3.2/10); pricing: Free plan; best for automated test selection in Python.

3.2/10★★☆☆☆Editor score

Visit autorank

At a glance

• Editor score
  3.2 / 10
• Pricing
  Free plan
• Best for
  Automated test selection in Python
• Free plan
  Yes
• Paid from
  Free
• Deployment
  Desktop
• Founded
  2020
• Facts checked
  23 Sep 2026

• Where it wins

  • Selects frequentist tests using normality, homogeneity, and population count
  • Supports Bayesian signed-rank analysis with configurable ROPE
  • Generates rankings, plots, tables, and LaTeX reports

• Where it doesn't

  • Focused on comparing multiple paired populations, not broad statistical analysis
  • Does not provide regression models
  • Requires data in a pandas DataFrame and Python scripting

Our verdict on autorank

autorank is an open-source Python package for comparing multiple paired populations, including classifier results. It suits analysts who work in Python and want help selecting statistical tests and presenting comparisons without choosing each frequentist test manually. The analysis starts from a pandas DataFrame and can produce rankings, confidence intervals, effect sizes, test results, plots, tables, and LaTeX reports. It is locally installed software available for Linux, Windows, and macOS, rather than a conventional desktop statistics application.

Its central strength is the test-selection workflow: autorank checks normality and homogeneity, then selects a frequentist test based on those assumptions and the number of populations. Normality testing uses Shapiro-Wilk, while homogeneity checks use Bartlett's or Levene's test. Users can instead run Bayesian signed-rank analysis and configure the region of practical equivalence (ROPE). Effect sizes and confidence intervals add context to the test results, and plots plus generated tables and reports support communicating comparisons. Integration with pandas, SciPy, statsmodels, and baycomp fits an existing Python analysis workflow.

The open-source package has a free plan, and its support channel is community-based. Its scope is deliberately narrower than general statistical software: it focuses on paired-population comparison and ranking, with no regression models or broad modeling capability. That makes autorank a fit for Python users comparing classifier or other paired results who value automated test choice and reporting. Analysts looking for regression, wider modeling, or a conventional point-and-click statistics application should choose a broader alternative.

Your product? Our editors can test autorank in depth and publish a review, labelled as paid · from $149/mo →

autorank pricing

autorank fact sheet

autorank integrations

autorank lists 4 integrations on its own site.

• pandas
• SciPy
• statsmodels
• baycomp

Alternatives to autorank

• RA free, programmable environment for statistical analysis, modeling, visualization, and data import.9.4
• SStataA broad, scriptable desktop environment for professional and reproducible applied analysis.9.3
• IBM SPSS StatisticsA broad desktop statistics suite with testing, modeling, forecasting, reporting, and R/Python integration.9.2

See all autorank alternatives →

Used autorank? Be the first to review it

The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used autorank for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.

Write a reviewTwo minutes · verified accounts only · read by an editor before it appears

Website

Reviews come only from verified accounts. Sign in or create an account first — your e-mail is never shown.

Your rating

5 stars★4 stars★3 stars★2 stars★1 star★

Title

Your review

0 characters · at least 80, up to 3,000

Pros (optional · one per line)

Cons (optional · one per line)

Your name (shown with your review)

Role (optional)

Company (optional)

How long have you used it?Prefer not to sayLess than a month1–6 months6–12 months1–2 years2+ years

I've used autorank myself and this is my honest opinion — nobody paid or asked me to write it.

Send my reviewPosted from your verified account. Reviews appear after an editor reads them, usually within two working days.

Featured on iTechGuides

Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026

Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.

Last updated 7 Oct 2026 · How we research and update