CI failure triage

Implementation

Ingests JUnit XML under explicit build, job and attempt identities. Artifact bytes and normalized cases commit in one transaction; exact repeats are idempotent and conflicting identities are rejected.

Full attempts replace job membership. Partial retries overlay only supplied tests. A single read transaction produces a consistent report while another process imports results.

Classifies retry passes, new and repeated failures, recoveries, skips and unreported tests. A missing test is never treated as a pass, and a retry pass is not presented as a root-cause diagnosis.

Exports a self-contained HTML report with build selection, search, classification filters, attempt details, original XML downloads and filtered CSV. No application server or network request is required.

Executed regression and operating checks include malformed input, resource limits, script/formula escaping, concurrent imports, abrupt process exit before commit, deterministic export and a 10,000-case workload.

Inputs and assumptions

• One SQLite database represents one repository and comparison stream. Caller-supplied positive sequence numbers define build order.
• Test identity is the exact job/file/classname/name tuple. Renaming or moving a test creates a new identity. Framework-specific inline retry extensions must be exported as explicit attempt artifacts.
• The included five-build history and the larger acceptance workload are synthetic. No customer repository or CI provider data is used.

Results

Report figures (1)

Open the full report ↗

Verification

30 behavioral tests and 13 executed operating checks pass. The reference history has 102 observations across 12 job attempts; the latest build has three final failures/errors, one retry pass, one recovery, one skipped test and one unreported identity.

python run_demo.py
python verify.py
python acceptance.py

Project files

The ZIP contains the source, inputs, results, and instructions. These files are also available individually.

• JUnit ingestion, classification and CLItriage.py · 20 KB
• Standalone interactive report rendererreport.py · 14 KB
• Synthetic build and retry inputsexamples/manifest.json · 2 KB
• Executed reference resultsresults/summary.json · 1 KB
• Latest classifications CSVresults/review/latest.csv · 2 KB
• Normalized history and retained XMLresults/review/analysis.json · 151 KB
• Interactive offline triage reportreport.html · 107 KB
• Behavioral test suitetest_triage.py · 11 KB
• Executed regression logresults/test-results.txt · 3 KB
• Reproduce concurrency and recovery checksacceptance.py · 10 KB
• Executed operating-check reportcompletion/report.html · 11 KB
• Acceptance outcomes and source hashescompletion.json · 6 KB
• Measured 10,000-case runresults/acceptance-measurements.json · 1 KB
• Setup, policies and supported XMLREADME.md · 9 KB

Run locally

Python 3.10+ / SQLite via the Python standard library

Extract the ZIP and open a terminal in the ci-failure-triage folder. The README includes setup and usage details.

python run_demo.py
# Open report.html in a browser.
python verify.py
python acceptance.py
python triage.py --help

Limits

• The supplied artifacts are synthetic. The tool works with local files; it has no provider API connector, automatic artifact collection or branch/commit comparison.
• Classifications describe observed outcomes, not defect causes. A renamed test is a new identity; missing and skipped tests remain explicit. The check command gates final failures/errors only, not coverage completeness.
• XML support is a declared JUnit-style subset with bounded UTF-8 inputs. DTD/entities and ambiguous outcomes are rejected. This is not universal support for every framework extension.
• An abrupt subprocess exit exercises transaction recovery, not physical power-loss durability. The 10,000-case timings describe one local runtime rather than guaranteed production capacity.
• Individual export files are atomically replaced; a whole output directory is not an atomic transaction. The HTML report embeds its own data and original artifact bytes.