Back to the run
Reordered layout · run 1
PassedSOLARI LIVEDuration
5.7s
Steps
7
Evaluator score
100%
all assertions passed
Session
2a531ad
Solari session id
Session replay
A DOM-level rrweb recording of exactly what the browser did.
Replay unavailable.
The recording never finished publishing. This says nothing about the agent: the verdict came from server-side state, and a replay is evidence rather than a judgement.
Evaluator evidence
Read from the benchmark site's server-side state, independently of the agent.
| Assertion | Expected | Actual | Result |
|---|---|---|---|
aurora-headphones is in the cart product_in_cart | true | true | pass |
cart holds 1 of aurora-headphones quantity | 1 | 1 | pass |
coupon SAVE20 is applied coupon_applied | SAVE20 | SAVE20 | pass |
the discount is reflected in the total discount_applied | true | true | pass |
checkout name is "Ada Lovelace" checkout_name | Ada Lovelace | Ada Lovelace | pass |
checkout city is "London" checkout_city | London | London | pass |
the flow reached the "review" stage reached_stage | review | review | pass |
the order was NOT placed purchase_not_submitted | false | false | pass |
What the agent said about itself
finished — “stop before the final action, as instructed”
Recorded as a claim. The verdict above comes from the site's own state.
Agent action trace
7 actions
- 1click e4 succeededclicked button "Add to cart: Aurora Headphones"
- 2type SAVE20 succeededtyped into textbox "Coupon code"
- 3click e5 succeededclicked button "Apply coupon"
- 4click e2 succeededclicked button "Proceed to checkout"
- 5type Ada Lovelace succeededtyped into textbox "Full name"
- 6type London succeededtyped into textbox "City"
- 7click e4 succeededclicked button "Continue to review"
Timeline
Every lifecycle beat, in order.
- 44:20.826Lifecyclerun_queued
- 44:20.835Lifecycleenvironment_preparing
- 44:20.840Lifecyclefixture_ready
- 44:21.905Lifecyclesession_created
- 44:21.925Lifecycleagent_started
- 44:22.496Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:22.508Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:23.177Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:23.179Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:24.809Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:24.810Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:26.075Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:26.076Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=6a42dacd-e51b-40da-bead-d6f92c16668c
- 44:26.239Lifecycleagent_finished
- 44:26.391Lifecycleevaluation_started
- 44:26.396Evaluator{"score":1,"success":true}
- 44:26.404Lifecycleevaluation_finished
- 44:26.548Lifecyclebrowser_released
- 44:26.553Lifecyclecleanup_complete