test-reliability

Scantrix analyzes automation repositories to uncover framework inefficiencies, flaky tests, and reliability risks.

Verification Trust Engine: Your tests are lying to you. We prove it.

Flaky test detection: statistical analysis, flakiness scoring, quarantine recommendations, root cause patterns.

Flaky test detection and analytics platform — statistical analysis, root cause classification, quarantine management, suite health metrics. TypeScript/Node.js + PostgreSQL + Redis + Docker + GitHub Actions CI.

Find the tests that pass sometimes and fail others, and work out why. Reads JUnit XML, so it works with any test framework. Zero dependencies.

Detect unreliable tests by running them multiple times - Part of Tuulbelt

Rerun a pytest suite N times to find flaky tests, score their stability, and diagnose the likely cause.

Find flaky tests by running your suite repeatedly and diffing the results — language-agnostic via JUnit XML.

Can you trust your tests? An agent skill that finds flaky, hollow and slow tests and proves every finding with runnable evidence. Mutation-checked, language-agnostic, audit-only: it never touches your code. For Claude Code, Codex and any Agent Skills compatible agent.

An adaptive testing engine: item response theory, maximum-information item selection, live ability estimation, and differential item functioning.

Randomize test execution order to detect hidden dependencies and flaky tests

Observability for .NET test suites. Track test reliability, detect flaky tests, and gain confidence in your testing with minimal setup. Supports NUnit, xUnit, and MSTest.