Skip to content
Gauntlet
SOLARI LIVE

external agent baseline

SOLARI LIVE

Example Repository Agent · Complete Demo Checkout · run 4b7480c · 3d ago

All runs
Reliability
0%0 / 1 runs passed

95% confidence interval 0.0% – 79.3% over 1 scored run

Baseline
0%
0%–79%
Perturbed
—
Runs
1
1 scored
Failed
1
no infra errors
p95 duration
39.5s
p50 39.5s
Avg steps
4
avg 39.5s
Run-to-run flips
0%
how often identical repetitions disagreed

Reliability by perturbation

Worst first. The whisker is the 95% Wilson interval — small samples are wide on purpose.

Baseline
Baseline
0%0 / 1

Reliability by category

Baseline
0%0 / 1

Failure distribution

Only scored failures. Infrastructure errors are excluded.

Network
1100%

Run matrix

Every cell is one run. Select one to open its evidence.

Outcome of every run, by perturbation and repetition. Select a cell to open that run.
PerturbationRun 1Rate
BaselineBaseline, run 1: Failed0%

Failure clusters

Failures grouped by category and cause, so a repeated defect reads as one problem.

  • Network

    3 requests failed, including http--agent-gauntlet-web--hjwypxsqnrjv.code.run.

    1 run · 14d33e4

Individual failures

Open one to see the assertion that failed and the trace that led there.