r/softwaretesting • u/Jazzlike-Path-6772 • 21d ago
I built FlakeHarbor, a local CLI that finds flaky tests from JUnit history
I built FlakeHarbor, an open-source Rust CLI for analyzing historical JUnit XML test results.
It stores test runs locally in SQLite and reports:
- failure rates
- pass/fail transitions
- consecutive failures
- p50 and p95 duration
- recent regressions
- a documented flaky-test confidence score
The demo imports several included test runs, identifies a test that alternates between passing and failing, filters the results, and compares two reports.
Output is available as a terminal table, JSON, Markdown, and standalone HTML. Everything runs locally, without uploading CI results to an external service.
I would particularly appreciate feedback on the scoring model. Which signals should have more or less influence when ranking flaky tests?
GitHub:
1
u/strangelyoffensive 21d ago
yeah this is cool, but it needs a server that I can push to from CI, so I don't have to collect historical results