external agent baseline

SOLARI LIVE

Example Repository Agent · Complete Demo Checkout · run bc9cc65 · 3d ago

Reliability

100%1 / 1 runs passed

95% confidence interval 20.7% – 100.0% over 1 scored run

Runs

1 scored

Failed

no infra errors

p95 duration

8.3s

p50 8.3s

Avg steps

avg 8.3s

Run-to-run flips

how often identical repetitions disagreed

Reliability by perturbation

Worst first. The whisker is the 95% Wilson interval — small samples are wide on purpose.

Baseline

100%1 / 1

Baseline

100%1 / 1

Only scored failures. Infrastructure errors are excluded.

No failures to categorise.

Every cell is one run. Select one to open its evidence.

Outcome of every run, by perturbation and repetition. Select a cell to open that run.
Perturbation	Run 1	Rate
Baseline	Baseline, run 1: Passed	100%

Open one to see the assertion that failed and the trace that led there.

No failures in this run.

Every scored run satisfied the task's assertions.