Flaky Test Detective

At a glance

• Editor score
  7.8 / 10
• Pricing
  Open source
• Best for
  Open-source Playwright and JUnit projects
• Paid from
  Free
• Quarantine workflow
  Yes
• Facts checked
  22 Sep 2026

• Where it wins

  • Scores flakiness across historical test runs
  • Detects timing, network, and ordering failure patterns
  • Reports through console, JSON, HTML, and GitHub pull requests

• Where it doesn't

  • Supports only Playwright and JUnit result formats
  • Requires CLI-based integration with existing test workflows
  • Does not document formal issue-tracker linking

Our verdict on Flaky Test Detective

Flaky Test Detective is an open-source TypeScript command-line tool for QA and development teams that need to identify and manage unreliable automated tests. It analyzes results across multiple runs, calculates flakiness scores, detects timing, network, and ordering patterns, and supports threshold-based quarantine tagging. The tool is aimed at projects using Playwright or JUnit, rather than teams seeking broad framework coverage or a hosted testing service.

Its strongest fit is a focused, repository-based workflow. The published feature set includes Playwright JSON and JUnit XML result parsing with automatic format detection, while GitHub Actions is listed as an integration. Results can be presented through console, JSON, HTML, or GitHub pull-request reporters, giving teams several ways to surface findings in development and CI processes. Trend tracking uses SQLite-backed storage, with JSON fallback storage available for simpler setups. Teams should expect to connect the CLI to their existing test-result pipeline rather than adopt a separate hosted workspace.

The standout workflow is quarantine management: configurable thresholds can automatically tag tests, and the quarantine command produces patterns that can be used to exclude identified tests from Playwright runs. That makes the tool suitable for teams that want a measurable way to separate recurring flakes from ordinary failures without abandoning their current test frameworks. Its narrower framework support and CLI focus make it less suitable for organizations running other test ecosystems, seeking hosted deployment, or requiring formal issue-tracker linking. Choose Flaky Test Detective for open-source Playwright and JUnit projects that value historical scoring, pattern detection, and repository-centered reporting.

Your product? Our editors can test Flaky Test Detective in depth and publish a review, labelled as paid · from $149/mo →

Flaky Test Detective pricing

Flaky Test Detective fact sheet

Flaky Test Detective integrations

Flaky Test Detective lists 1 integrations on its own site.

• GitHub Actions

Alternatives to Flaky Test Detective

• Flakiness.ioA broad flake analytics suite with AI workflows, self-hosting, and a free plan.9.4
• Trunk Flaky TestsA broad flakiness-management option for large, multi-framework CI estates.9.3
• TesteryA broad test execution platform with practical flake detection and quarantine workflows.9.1

See all Flaky Test Detective alternatives →

Featured on iTechGuides

Flaky Test Detective is listed in our Test Flakiness Management Software directory. Add the badge to your site — it links back to this page.

<a href="https://www.itechguides.com/products/flaky-test-detective/"><img src="https://www.itechguides.com/best/badge/flaky-test-detective.svg" alt="Featured on iTechGuides" width="230" height="46"></a>

Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026

Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.

Last updated 7 Oct 2026 · How we research and update