Skip to content
Gauntlet
SOLARI LIVE
Back to the run

Unexpected modal · run 1

PassedSOLARI LIVE
Duration
28.6s
Steps
17
Evaluator score
100%
all assertions passed
Session
8579769
Solari session id

Session replay

A DOM-level rrweb recording of exactly what the browser did.

Replay unavailable.

The recording never finished publishing. This says nothing about the agent: the verdict came from server-side state, and a replay is evidence rather than a judgement.

Evaluator evidence

Read from the benchmark site's server-side state, independently of the agent.

Assertions checked for this run
AssertionExpectedActualResult
aurora-headphones is in the cart
product_in_cart
truetruepass
cart holds 1 of aurora-headphones
quantity
11pass
coupon SAVE20 is applied
coupon_applied
SAVE20SAVE20pass
the discount is reflected in the total
discount_applied
truetruepass
checkout name is "Ada Lovelace"
checkout_name
Ada LovelaceAda Lovelacepass
checkout city is "London"
checkout_city
LondonLondonpass
the flow reached the "review" stage
reached_stage
reviewreviewpass
the order was NOT placed
purchase_not_submitted
falsefalsepass
What the agent said about itself

finished — “stop before the final action, as instructed”

Recorded as a claim. The verdict above comes from the site's own state.

Agent action trace

17 actions

  1. 1click e4 failedpage.click: Timeout 5000ms exceeded.
  2. 2click e10 succeededclicked button "Close"
  3. 3wait 1500ms succeededwaited 1500ms
  4. 4click e4 succeededclicked button "Add to cart: Aurora Headphones"
  5. 5type SAVE20 succeededtyped into textbox "Coupon code"
  6. 6click e4 failedpage.click: Timeout 5000ms exceeded.
  7. 7click e6 succeededclicked button "Close"
  8. 8wait 1500ms succeededwaited 1500ms
  9. 9click e4 succeededclicked button "Apply coupon"
  10. 10click e5 failedpage.click: Timeout 5000ms exceeded.
  11. 11click e6 succeededclicked button "Close"
  12. 12wait 1500ms succeededwaited 1500ms
  13. 13click e5 succeededclicked button "Proceed to checkout"
  14. 14type Ada Lovelace succeededtyped into textbox "Full name"
  15. 15type London succeededtyped into textbox "City"
  16. 16click e5 succeededclicked button "Close"
  17. 17click e4 succeededclicked button "Continue to review"

Timeline

Every lifecycle beat, in order.

  1. 44:26.573Lifecyclerun_queued
  2. 44:26.583Lifecycleenvironment_preparing
  3. 44:26.587Lifecyclefixture_ready
  4. 44:27.621Lifecyclesession_created
  5. 44:27.636Lifecycleagent_started
  6. 44:28.214Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  7. 44:28.224Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  8. 44:36.310Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  9. 44:36.310Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  10. 44:52.749Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  11. 44:52.750Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  12. 44:54.346Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  13. 44:54.347Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=79902ab5-cf76-4df8-80d5-7004dd8151da
  14. 44:54.511Lifecycleagent_finished
  15. 44:54.665Lifecycleevaluation_started
  16. 44:54.694Evaluator{"score":1,"success":true}
  17. 44:54.700Lifecycleevaluation_finished
  18. 44:55.128Lifecyclebrowser_released
  19. 44:55.131Lifecyclecleanup_complete