FlaPy review
A research-oriented tool for rerunning tests and localizing flaky faults.
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
FlaPy is an open-source research tool for developers and researchers investigating flaky tests across specified projects. It accepts project details and test selections through CSV input, then reruns suites to identify inconsistent behavior. Its focus is fault localization through repeated execution and analysis, rather than serving as a hosted CI analysis service. Researchers who can run and interpret this workflow may find its coverage and call-tracing features useful; teams seeking automated remediation or a managed CI workflow should look elsewhere.
FlaPy supports local execution in Docker containers and jobs on a SLURM cluster. It aggregates and parses results across repeated project runs, and analyzes those runs to detect infrastructure flakiness. During test execution, it can trace function and method calls, collect line coverage, and calculate suspiciousness scores for flaky fault localization. This makes it a better fit for research and investigation workflows that need evidence about likely faulty code than for teams looking primarily for test quarantine or suggested fixes.
The software is distributed as source code under the GNU Lesser General Public License, and its pricing model is open source with a free plan. It is self-hosted and supports Linux. FlaPy’s scope is deliberately centered on analyzing reruns: it does not offer AI features, fix suggestions, or test quarantine. Choose it when you want to study flaky behavior with local or cluster-based runs and can manage the execution yourself. For a hosted service or a workflow centered on integrations and automation, FlaPy is not the right choice.
FlaPy pros and cons
- Where it wins
- Reruns test suites and analyzes repeated runs for infrastructure flakiness
- Traces calls and uses line coverage to calculate suspiciousness scores
- Runs locally in Docker or on a SLURM cluster
- Where it doesn't
- Requires users to provide project and test selections through CSV input
- Is self-run rather than a hosted CI analysis service
- Does not provide fix suggestions or test quarantine
FlaPy fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update