Skip to content
Gauntlet
SOLARI LIVE
Back to the run

Baseline · run 1

PassedSOLARI LIVE
Duration
8.3s
Steps
7
Evaluator score
100%
all assertions passed
Session
963bde5
Solari session id

Session replay

A DOM-level rrweb recording of exactly what the browser did.

Replay unavailable.

The recording never finished publishing. This says nothing about the agent: the verdict came from server-side state, and a replay is evidence rather than a judgement.

Evaluator evidence

Read from the benchmark site's server-side state, independently of the agent.

Assertions checked for this run
AssertionExpectedActualResult
aurora-headphones is in the cart
product_in_cart
truetruepass
cart holds 1 of aurora-headphones
quantity
11pass
coupon SAVE20 is applied
coupon_applied
SAVE20SAVE20pass
the discount is reflected in the total
discount_applied
truetruepass
checkout name is "Ada Lovelace"
checkout_name
Ada LovelaceAda Lovelacepass
checkout city is "London"
checkout_city
LondonLondonpass
the flow reached the "review" stage
reached_stage
reviewreviewpass
the order was NOT placed
purchase_not_submitted
falsefalsepass
What the agent said about itself

finished — “Reached the review step without submitting the order.”

Recorded as a claim. The verdict above comes from the site's own state.

Agent action trace

0 actions

No actions were recorded.

Agent output

Exactly what the agent's own process printed.

run efa8fff7-2106-42c6-b17c-d4eb20b10ec7: Add Aurora Headphones to cart, apply coupon SAVE20, proceed to checkout, enter Name: Ada Lovelace and City: London, continue to review, and stop before submitting payment.
  1. open the store
  2. clear overlays
  3. add Aurora Headphones
  4. apply the coupon
  5. go to checkout
  6. fill in the details
  7. continue to review
AGENT_GAUNTLET_RESULT={"status":"completed","message":"Reached the review step without submitting the order.","steps":7}

Timeline

Every lifecycle beat, in order.

  1. 09:15.333Lifecyclerun_queued
  2. 09:15.343Lifecycleenvironment_preparing
  3. 09:15.348Lifecyclefixture_ready
  4. 09:16.689Lifecyclesession_created
  5. 09:16.706Lifecycleagent_started
  6. 09:21.060Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
  7. 09:21.508Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/cart?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
  8. 09:22.329Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/checkout?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
  9. 09:22.850Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/review?run=efa8fff7-2106-42c6-b17c-d4eb20b10ec7
  10. 09:23.327Lifecycleagent_finished
  11. 09:23.486Lifecycleevaluation_started
  12. 09:23.501Evaluator{"score":1,"success":true}
  13. 09:23.508Lifecycleevaluation_finished
  14. 09:23.652Lifecyclebrowser_released
  15. 09:23.656Lifecyclecleanup_complete