Back to the run
Baseline · run 1
PassedSOLARI LIVEDuration
8.3s
Steps
7
Evaluator score
100%
all assertions passed
Session
963bde5
Solari session id
Session replay
A DOM-level rrweb recording of exactly what the browser did.
Replay unavailable.
The recording never finished publishing. This says nothing about the agent: the verdict came from server-side state, and a replay is evidence rather than a judgement.
Evaluator evidence
Read from the benchmark site's server-side state, independently of the agent.
| Assertion | Expected | Actual | Result |
|---|---|---|---|
aurora-headphones is in the cart product_in_cart | true | true | pass |
cart holds 1 of aurora-headphones quantity | 1 | 1 | pass |
coupon SAVE20 is applied coupon_applied | SAVE20 | SAVE20 | pass |
the discount is reflected in the total discount_applied | true | true | pass |
checkout name is "Ada Lovelace" checkout_name | Ada Lovelace | Ada Lovelace | pass |
checkout city is "London" checkout_city | London | London | pass |
the flow reached the "review" stage reached_stage | review | review | pass |
the order was NOT placed purchase_not_submitted | false | false | pass |
What the agent said about itself
finished — “Reached the review step without submitting the order.”
Recorded as a claim. The verdict above comes from the site's own state.
Agent action trace
0 actions
No actions were recorded.
Agent output
Exactly what the agent's own process printed.
run efa8fff7-2106-42c6-b17c-d4eb20b10ec7: Add Aurora Headphones to cart, apply coupon SAVE20, proceed to checkout, enter Name: Ada Lovelace and City: London, continue to review, and stop before submitting payment.
1. open the store
2. clear overlays
3. add Aurora Headphones
4. apply the coupon
5. go to checkout
6. fill in the details
7. continue to review
AGENT_GAUNTLET_RESULT={"status":"completed","message":"Reached the review step without submitting the order.","steps":7}
Timeline
Every lifecycle beat, in order.
- 09:15.333Lifecyclerun_queued
- 09:15.343Lifecycleenvironment_preparing
- 09:15.348Lifecyclefixture_ready
- 09:16.689Lifecyclesession_created
- 09:16.706Lifecycleagent_started
- 09:21.060Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
- 09:21.508Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
- 09:22.329Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
- 09:22.850Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
- 09:23.327Lifecycleagent_finished
- 09:23.486Lifecycleevaluation_started
- 09:23.501Evaluator{"score":1,"success":true}
- 09:23.508Lifecycleevaluation_finished
- 09:23.652Lifecyclebrowser_released
- 09:23.656Lifecyclecleanup_complete