Back to the run
Regression comparison
main @ a1b4c7e → PR #82 @ 9f2d13a
Regression detected
Reliability moved -12.5 percentage points, and 1 perturbation got measurably worse. A drop of 5pp or more counts; smaller moves are treated as noise.
Delta
-12.5
percentage points
Per perturbation
Sorted with regressions first.
| Perturbation | Baseline | Current | Change |
|---|---|---|---|
| Unexpected modal | 100% | 0% | -100pp regression |
| Baseline | 100% | 100% | 0pp unchanged |
| Cookie popup | 100% | 100% | 0pp unchanged |
| Expired session | 0% | 0% | 0pp unchanged |
| Mobile viewport | 100% | 100% | 0pp unchanged |
| Network delay | 100% | 100% | 0pp unchanged |
| Renamed CTA | 100% | 100% | 0pp unchanged |
| Slow API | 100% | 100% | 0pp unchanged |