Skip to content
Gauntlet
SOLARI LIVE

external agent expired_session

SOLARI LIVE

Example Repository Agent · Complete Demo Checkout · run f61bd7c · 3d ago

All runs
Reliability
0%0 / 1 runs passed

95% confidence interval 0.0% – 79.3% over 1 scored run

Baseline
—
Perturbed
0%
0%–79%
Runs
1
1 scored
Failed
1
no infra errors
p95 duration
37.9s
p50 37.9s
Avg steps
6
avg 37.9s
Run-to-run flips
0%
how often identical repetitions disagreed

Reliability by perturbation

Worst first. The whisker is the 95% Wilson interval — small samples are wide on purpose.

Expired session
State
0%0 / 1

Reliability by category

State
0%0 / 1

Failure distribution

Only scored failures. Infrastructure errors are excluded.

Auth
1100%

Run matrix

Every cell is one run. Select one to open its evidence.

Outcome of every run, by perturbation and repetition. Select a cell to open that run.
PerturbationRun 1Rate
Expired sessionExpired session, run 1: Failed0%

Failure clusters

Failures grouped by category and cause, so a repeated defect reads as one problem.

  • Auth

    The shopping session expired mid-task and the agent did not re-establish it.

    1 run · 5cc7536

Individual failures

Open one to see the assertion that failed and the trace that led there.