FlakyWatch review
A focused GitHub Actions flake triage tool with useful cost and issue tracking.
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
FlakyWatch is a web-based SaaS platform for teams monitoring test results in GitHub Actions. It ingests JUnit XML artifacts, builds test history, and classifies tests as stable, flaky, broken, or newly unstable. The product is aimed at small teams that want a focused way to triage unreliable tests, assign ownership, and understand how test failures affect CI and developer time. It supports pytest, Jest, JUnit, RSpec, and other JUnit-compatible runners.
Its freemium pricing gives teams a permanent Free plan with classification and cost tracking, GitHub issue creation, and a weekly digest. Starter costs $29 per month and adds automatic issue creation and lifecycle management, owner suggestions, and email support. Team costs $79 per month and adds quarantine rules, priority support, and cost tracking, classification, and GitHub issues. A 14-day free trial is also available. Monthly subscriptions are non-refundable.
FlakyWatch’s strongest fit is a GitHub-centered workflow. It connects with GitHub Actions and GitHub Issues, allowing teams to review test history, instability trends, blocked-run and failure impact metrics, and issue status from a web dashboard. Confidence scores and per-test CI and developer-time estimates add useful context beyond a simple failure list. Teams that need quarantine workflows must choose Team, while teams working across other CI platforms should look elsewhere. PR comments, Slack integration, and CSV export are described as forthcoming, so FlakyWatch is better suited to buyers seeking focused GitHub Actions triage than a broad testing operations ecosystem.
FlakyWatch pros and cons
- Where it wins
- Confidence-scored classification identifies flaky and unstable tests
- Tracks CI and developer-time costs per test
- Creates and manages GitHub issues for flaky tests
- Where it doesn't
- Supports GitHub Actions rather than multiple CI platforms
- Quarantine rules are limited to the Team plan
- Broader workflow integrations are still forthcoming
FlakyWatch fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update