Back to the run
Expired session · run 1
FailedauthSOLARI LIVEThe shopping session expired mid-task and the agent did not re-establish it.
Duration
11.8s
Steps
10
Evaluator score
70%
partial credit
Session
9890269
Solari session id
Session replay
A DOM-level rrweb recording of exactly what the browser did.
Recorded by Solari during the session and stored here as an artifact. The Solari link is minted fresh on demand, because presigned URLs expire while the recording does not.
Evaluator evidence
Read from the benchmark site's server-side state, independently of the agent.
| Assertion | Expected | Actual | Result |
|---|---|---|---|
aurora-headphones is in the cart product_in_cart | true | true | pass |
cart holds 1 of aurora-headphones quantity | 1 | 1 | pass |
coupon SAVE20 is applied coupon_applied | SAVE20 | SAVE20 | pass |
the discount is reflected in the total discount_applied | true | true | pass |
checkout name is "Ada Lovelace" checkout_name | Ada Lovelace | null | fail |
checkout city is "London" checkout_city | London | null | fail |
the flow reached the "review" stage reached_stage | review | checkout | fail |
the order was NOT placed purchase_not_submitted | false | false | pass |
What the agent said about itself
finished — “gave up trying to enter Name "Ada Lovelace" after 6 attempts”
Recorded as a claim. The verdict above comes from the site's own state.
Agent action trace
10 actions
- 1click e4 succeededclicked button "Add to cart: Aurora Headphones"
- 2type SAVE20 succeededtyped into textbox "Coupon code"
- 3click e4 succeededclicked button "Apply coupon"
- 4click e5 succeededclicked button "Proceed to checkout"
- 5type Ada Lovelace failedno element matching "Name" (visible: "Resume session")
- 6wait 1500ms succeededwaited 1500ms
- 7type Ada Lovelace failedno element matching "Name" (visible: "Resume session")
- 8wait 1500ms succeededwaited 1500ms
- 9type Ada Lovelace failedno element matching "Name" (visible: "Resume session")
- 10wait 1500ms succeededwaited 1500ms
Timeline
Every lifecycle beat, in order.
- 53:21.018Lifecyclerun_queued
- 53:21.110Lifecycleenvironment_preparing
- 53:21.115Lifecyclefixture_ready
- 53:22.682Lifecyclesession_created
- 53:22.999Lifecycleagent_started
- 53:23.620Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:23.638Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:24.366Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:24.376Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:26.121Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:26.121Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=6acbe0ec-e0bd-42f6-93fd-b41e45feb461
- 53:32.208Lifecycleagent_finished
- 53:32.368Lifecycleevaluation_started
- 53:32.388Evaluator{"score":0.7,"success":false}
- 53:32.395Lifecycleevaluation_finished
- 53:32.821Lifecyclebrowser_released
- 53:32.828Lifecyclecleanup_complete