Suggestions appear as you type. Use the up and down arrows to choose one and Enter to open it.

This page's audience our own tag's counts — open to see them
–Visits
–Page views
–Clicks to vendors
–Time on page
–Reading now
Clicks to vendors, by tool
  • –
Top countries
  • –
Devices
  • –

– · visits, page views and clicks counted by our own tag, which counts more than our checked analytics; every figure rounded down · how we count

Flakiness.io review

Freemium#8 of 30 in Test Analytics SoftwareTest Flakiness Management SoftwareCI Failure Analysis And Flaky Test Tools

Deep flake investigation with artifacts, telemetry, trend views, and AI-agent workflows.

8.7/10Editor score
Visit Flakiness.io
Flakiness.io8.7 Visit Flakiness.io

Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026

Flakiness.io is a test analytics service for engineering teams working with GitHub or GitLab. It connects test results to commits and environments, helping teams distinguish regressions from flaky failures. Historical reports, execution trends, failure grouping, pull-request checks, and artifact viewers support teams that need more context than a pass-or-fail CI result. The product is particularly suited to teams investigating recurring failures across automated test suites.

Its strongest area is failure investigation. Flakiness.io combines error analysis with execution waterfalls, system telemetry, and viewers for logs, screenshots, videos, traces, and HTML artifacts. Duration-based shard balancing can help organize parallel test execution, while Flakiness Query Language, APIs, and AI-agent investigation workflows provide additional ways to inspect results. Retention is 180 days, giving teams a meaningful history for comparing test behavior over time. Slack notifications and pull-request integrations connect findings to existing development workflows.

The pricing structure starts with a Free plan at $0 per month and includes core test analytics, unlimited test runs, unlimited users, public projects, private projects, and Slack notifications. Startup is $49 per month, and Growth is $199 per month; the listed highlights for both plans contain the same features. An Enterprise plan is also available. Flakiness.io supports web, API, and self-hosted deployments, with integrations for GitHub, GitLab, GitHub Actions, GitLab CI/CD, Slack, and the listed test frameworks. Choose it for deep flake analysis and artifact-rich debugging; consider an alternative if you need broader framework or CI coverage.

Flakiness.io pros and cons

  • Where it wins
    • Classifies regressions and flaky failures by commit and environment
    • Combines logs, screenshots, videos, traces, and HTML artifacts
    • Supports shard balancing, failure analysis, APIs, and AI-agent workflows
  • Where it doesn't
    • Framework coverage centers on Playwright, Pytest, Vitest, Jest, and listed runners
    • CI integrations focus on GitHub Actions and GitLab CI/CD
    • Advanced plan differences are not clearly reflected in the listed highlights

Flakiness.io fact sheet, pricing and score →

Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.

Last updated · How we research and update