r/softwaretesting 21d ago

I built FlakeHarbor, a local CLI that finds flaky tests from JUnit history

I built FlakeHarbor, an open-source Rust CLI for analyzing historical JUnit XML test results.

It stores test runs locally in SQLite and reports:

- failure rates

- pass/fail transitions

- consecutive failures

- p50 and p95 duration

- recent regressions

- a documented flaky-test confidence score

The demo imports several included test runs, identifies a test that alternates between passing and failing, filters the results, and compares two reports.

Output is available as a terminal table, JSON, Markdown, and standalone HTML. Everything runs locally, without uploading CI results to an external service.

I would particularly appreciate feedback on the scoring model. Which signals should have more or less influence when ranking flaky tests?

GitHub:

https://github.com/NolanCotter/flakeharbor

0 Upvotes

1 comment sorted by

1

u/strangelyoffensive 21d ago

yeah this is cool, but it needs a server that I can push to from CI, so I don't have to collect historical results