Skip to content
Gauntlet
SOLARI LIVE
Back to the run

Regression comparison

main @ a1b4c7ePR #82 @ 9f2d13a

Regression detected

Reliability moved -12.5 percentage points, and 1 perturbation got measurably worse. A drop of 5pp or more counts; smaller moves are treated as noise.

BaselineDEMO DATA
88%
14 / 16 runs passed
main @ a1b4c7e · main · 4d ago
Delta
-12.5
percentage points
CurrentDEMO DATA
75%
12 / 16 runs passed
PR #82 @ 9f2d13a · pr-82-refactor-waits · 4d ago

Per perturbation

Sorted with regressions first.

Reliability change per perturbation
PerturbationBaselineCurrentChange
Unexpected modal100%0%-100pp regression
Baseline100%100%0pp unchanged
Cookie popup100%100%0pp unchanged
Expired session0%0%0pp unchanged
Mobile viewport100%100%0pp unchanged
Network delay100%100%0pp unchanged
Renamed CTA100%100%0pp unchanged
Slow API100%100%0pp unchanged