Resilient Agent · 2026-09-02 15:44
SOLARI LIVEResilient Agent · Complete Demo Checkout · run d95b224 · 3d ago
Reliability
100%11 / 11 runs passed
95% confidence interval 74.1% – 100.0% over 11 scored runs
- Baseline
- 100%
- Perturbed
- 100%
21%–100%
72%–100%
Runs
11
11 scored
Failed
0
no infra errors
p95 duration
28.6s
p50 7.0s
Avg steps
8.18
avg 9.3s
Run-to-run flips
0%
how often identical repetitions disagreed
Reliability by perturbation
Worst first. The whisker is the 95% Wilson interval — small samples are wide on purpose.
Baseline
Baseline
100%1 / 1
Cookie popup
UI
100%1 / 1
Delayed element
UI
100%1 / 1
Expired session
State
100%1 / 1
German locale
Locale
100%1 / 1
Mobile viewport
Viewport
100%1 / 1
Network delay
Network
100%1 / 1
Renamed CTA
UI
100%1 / 1
Reordered layout
UI
100%1 / 1
Slow API
Network
100%1 / 1
Unexpected modal
UI
100%1 / 1
Reliability by category
Baseline
100%1 / 1
UI
100%5 / 5
State
100%1 / 1
Locale
100%1 / 1
Viewport
100%1 / 1
Network
100%2 / 2
Failure distribution
Only scored failures. Infrastructure errors are excluded.
No failures to categorise.
Run matrix
Every cell is one run. Select one to open its evidence.
| Perturbation | Run 1 | Rate |
|---|---|---|
| Baseline | Baseline, run 1: Passed | 100% |
| Cookie popup | Cookie popup, run 1: Passed | 100% |
| Delayed element | Delayed element, run 1: Passed | 100% |
| Expired session | Expired session, run 1: Passed | 100% |
| German locale | German locale, run 1: Passed | 100% |
| Mobile viewport | Mobile viewport, run 1: Passed | 100% |
| Network delay | Network delay, run 1: Passed | 100% |
| Renamed CTA | Renamed CTA, run 1: Passed | 100% |
| Reordered layout | Reordered layout, run 1: Passed | 100% |
| Slow API | Slow API, run 1: Passed | 100% |
| Unexpected modal | Unexpected modal, run 1: Passed | 100% |
Individual failures
Open one to see the assertion that failed and the trace that led there.
No failures in this run.
Every scored run satisfied the task's assertions.