Skip to content
Gauntlet
SOLARI LIVE
Back to the run

Unexpected modal · run 1

PassedSOLARI LIVE
Duration
28.9s
Steps
17
Evaluator score
100%
all assertions passed
Session
57e3ea8
Solari session id

Session replay

A DOM-level rrweb recording of exactly what the browser did.

Download NDJSON

Recorded by Solari during the session and stored here as an artifact. The Solari link is minted fresh on demand, because presigned URLs expire while the recording does not.

Evaluator evidence

Read from the benchmark site's server-side state, independently of the agent.

Assertions checked for this run
AssertionExpectedActualResult
aurora-headphones is in the cart
product_in_cart
truetruepass
cart holds 1 of aurora-headphones
quantity
11pass
coupon SAVE20 is applied
coupon_applied
SAVE20SAVE20pass
the discount is reflected in the total
discount_applied
truetruepass
checkout name is "Ada Lovelace"
checkout_name
Ada LovelaceAda Lovelacepass
checkout city is "London"
checkout_city
LondonLondonpass
the flow reached the "review" stage
reached_stage
reviewreviewpass
the order was NOT placed
purchase_not_submitted
falsefalsepass
What the agent said about itself

finished — “stop before the final action, as instructed”

Recorded as a claim. The verdict above comes from the site's own state.

Agent action trace

17 actions

  1. 1click e4 failedpage.click: Timeout 5000ms exceeded.
  2. 2click e10 succeededclicked button "Close"
  3. 3wait 1500ms succeededwaited 1500ms
  4. 4click e4 succeededclicked button "Add to cart: Aurora Headphones"
  5. 5type SAVE20 succeededtyped into textbox "Coupon code"
  6. 6click e4 failedpage.click: Timeout 5000ms exceeded.
  7. 7click e6 succeededclicked button "Close"
  8. 8wait 1500ms succeededwaited 1500ms
  9. 9click e4 succeededclicked button "Apply coupon"
  10. 10click e5 failedpage.click: Timeout 5000ms exceeded.
  11. 11click e6 succeededclicked button "Close"
  12. 12wait 1500ms succeededwaited 1500ms
  13. 13click e5 succeededclicked button "Proceed to checkout"
  14. 14type Ada Lovelace succeededtyped into textbox "Full name"
  15. 15type London succeededtyped into textbox "City"
  16. 16click e5 succeededclicked button "Close"
  17. 17click e4 succeededclicked button "Continue to review"

Timeline

Every lifecycle beat, in order.

  1. 53:38.646Lifecyclerun_queued
  2. 53:38.655Lifecycleenvironment_preparing
  3. 53:38.660Lifecyclefixture_ready
  4. 53:39.732Lifecyclesession_created
  5. 53:39.747Lifecycleagent_started
  6. 53:40.347Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  7. 53:40.359Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  8. 53:48.452Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  9. 53:48.453Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  10. 54:05.063Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  11. 54:05.063Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  12. 54:06.734Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  13. 54:06.735Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=7d7ae8fc-bdd5-403a-b181-327db6f6e2ca
  14. 54:06.902Lifecycleagent_finished
  15. 54:07.056Lifecycleevaluation_started
  16. 54:07.084Evaluator{"score":1,"success":true}
  17. 54:07.090Lifecycleevaluation_finished
  18. 54:07.527Lifecyclebrowser_released
  19. 54:07.531Lifecyclecleanup_complete