Back to the run
Delayed element · run 1
PassedSOLARI LIVEDuration
9.6s
Steps
9
Evaluator score
100%
all assertions passed
Session
d1a3eb7
Solari session id
Session replay
A DOM-level rrweb recording of exactly what the browser did.
Recorded by Solari during the session and stored here as an artifact. The Solari link is minted fresh on demand, because presigned URLs expire while the recording does not.
Evaluator evidence
Read from the benchmark site's server-side state, independently of the agent.
| Assertion | Expected | Actual | Result |
|---|---|---|---|
aurora-headphones is in the cart product_in_cart | true | true | pass |
cart holds 1 of aurora-headphones quantity | 1 | 1 | pass |
coupon SAVE20 is applied coupon_applied | SAVE20 | SAVE20 | pass |
the discount is reflected in the total discount_applied | true | true | pass |
checkout name is "Ada Lovelace" checkout_name | Ada Lovelace | Ada Lovelace | pass |
checkout city is "London" checkout_city | London | London | pass |
the flow reached the "review" stage reached_stage | review | review | pass |
the order was NOT placed purchase_not_submitted | false | false | pass |
What the agent said about itself
finished — “stop before the final action, as instructed”
Recorded as a claim. The verdict above comes from the site's own state.
Agent action trace
9 actions
- 1click Add to cart: Aurora Headphones failedno element matching "Add to cart: Aurora Headphones" (visible: "Gauntlet Shop A controlled benchmark storefront", "Cart (0)", "View details", "View details", "View details", "View details")
- 2wait 1500ms succeededwaited 1500ms
- 3click e4 succeededclicked button "Add to cart: Aurora Headphones"
- 4type SAVE20 succeededtyped into textbox "Coupon code"
- 5click e4 succeededclicked button "Apply coupon"
- 6click e5 succeededclicked button "Proceed to checkout"
- 7type Ada Lovelace succeededtyped into textbox "Full name"
- 8type London succeededtyped into textbox "City"
- 9click e4 succeededclicked button "Continue to review"
Timeline
Every lifecycle beat, in order.
- 44:05.402Lifecyclerun_queued
- 44:05.987Lifecycleenvironment_preparing
- 44:06.283Lifecyclefixture_ready
- 44:07.370Lifecyclesession_created
- 44:07.387Lifecycleagent_started
- 44:08.329Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:08.569Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:11.403Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:11.405Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:13.181Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:13.182Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:14.516Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:14.518Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=6c3ab0ff-844f-4794-9789-5e6859dff0d4
- 44:14.686Lifecycleagent_finished
- 44:14.843Lifecycleevaluation_started
- 44:14.848Evaluator{"score":1,"success":true}
- 44:14.856Lifecycleevaluation_finished
- 44:14.998Lifecyclebrowser_released
- 44:15.001Lifecyclecleanup_complete