Skip to content
Gauntlet
SOLARI LIVE

external agent baseline

SOLARI LIVE

Example Repository Agent · Complete Demo Checkout · run 49d4027 · 3d ago

This suite did not finish

The benchmark site at https://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture did not respond.

Error code: fixture_unavailable

Reliability
0 / 0 runs passed
Baseline
Perturbed
Runs
1
0 scored
Failed
0
no infra errors
p95 duration
0ms
p50 0ms
Avg steps
avg 0ms
Run-to-run flips
0%
how often identical repetitions disagreed

Reliability by perturbation

Worst first. The whisker is the 95% Wilson interval — small samples are wide on purpose.

No scored runs yet.

Reliability by category

No scored runs yet.

Failure distribution

Only scored failures. Infrastructure errors are excluded.

No failures to categorise.

Run matrix

Every cell is one run. Select one to open its evidence.

Outcome of every run, by perturbation and repetition. Select a cell to open that run.
PerturbationRun 1Rate
BaselineBaseline, run 1: Cancelled

Individual failures

Open one to see the assertion that failed and the trace that led there.

No failures in this run.

Every scored run satisfied the task's assertions.