FlakyTest.dev
FlakyTest.dev: A focused pytest monitor with ownership, muting, history and a free eligibility-based plan. Ranked #12 of 31 in Test Flakiness Management Software by our editors (7.9/10); pricing: Free plan · 60-day trial; best for pytest teams wanting lightweight hosted monitoring.
At a glance
- Editor score7.9 / 10
- PricingFree plan · 60-day trial
- Best forPytest teams wanting lightweight hosted monitoring
- Free planYes
- Quarantine workflowYes
- Facts checked22 Sep 2026
Where it wins
- Pytest plugin sends results from local runs or CI environments
- Mute flaky tests without code changes while continuing to record errors
- Ownership, run history, output inspection and failure statistics in one web service
Where it doesn't
- Framework support is limited to pytest
- The product is available through the web only
- Business pricing applies after the 60-day trial
Our verdict on FlakyTest.dev
FlakyTest.dev is a web-based service for Python teams managing test-suite performance and flaky tests. Its pytest plugin sends results from local runs or CI environments, giving teams a central view of individual test runs, failures and runtimes. The product fits teams that want lightweight hosted monitoring around pytest rather than a broader testing platform. It also supports test ownership, one-click muting and email reports for skipped-test thresholds.
Pricing is structured around an eligibility-based OSS plan and a Business plan. OSS is free for personal projects, nonprofits and open-source projects. Business includes a free 60-day trial, with pricing handled after the trial. The published plans make FlakyTest.dev approachable for qualifying projects and allow teams to evaluate the service before committing to the paid tier. The product connects to CI through an environment secret, keeping the core workflow centered on result ingestion rather than a large integration ecosystem.
Its standout workflow is muting: teams can stop a flaky test from failing the CI build without changing source code, while the test continues running and recording errors. That pairs with individual run history, standard output and standard error inspection, runtime statistics, failure statistics and ownership assignment. Teams using pytest should find the feature set closely aligned with day-to-day flake management. Organizations supporting other test frameworks, requiring a web-only alternative to fit a broader platform strategy, or seeking a wider integration catalog should choose another product.
Your product? Our editors can test FlakyTest.dev in depth and publish a review, labelled as paid · from $149/mo →
FlakyTest.dev pricing
All 2 FlakyTest.dev plans and prices →
FlakyTest.dev fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Not verified |
| Flake detection | Yes |
| Quarantine workflow | Yes |
| Failure clustering | Not verified |
| Rerun policies | Not verified |
| Supported frameworks | pytest |
| Issue tracker links | Not verified |
| Free trial | 60 days |
| Deployment | Cloud |
| Platforms | Web |
| Support | Email, Docs |
| Built for | Solo, Small business, Mid-market (editorial estimate) |
| Pricing | Free plan · 60-day trial (source) |
| Website | flakytest.dev |
| Facts checked | 22 Sep 2026 |
Alternatives to FlakyTest.dev
- Flakiness.ioA broad flake analytics suite with AI workflows, self-hosting, and a free plan.9.4
- Trunk Flaky TestsA broad flakiness-management option for large, multi-framework CI estates.9.3
- TesteryA broad test execution platform with practical flake detection and quarantine workflows.9.1
See all FlakyTest.dev alternatives →
Used FlakyTest.dev? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used FlakyTest.dev for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
FlakyTest.dev is listed in our Test Flakiness Management Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/flakytest-dev/"><img src="https://www.itechguides.com/best/badge/flakytest-dev.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update