Skip to content
Gauntlet
SOLARI LIVE
Back to the run

Baseline · run 1

FailednetworkSOLARI LIVE

3 requests failed, including http--agent-gauntlet-web--hjwypxsqnrjv.code.run.

Duration
39.5s
Steps
4
Evaluator score
50%
partial credit
Session
ac26302
Solari session id

Session replay

A DOM-level rrweb recording of exactly what the browser did.

Download NDJSON

Recorded by Solari during the session and stored here as an artifact. The Solari link is minted fresh on demand, because presigned URLs expire while the recording does not.

Evaluator evidence

Read from the benchmark site's server-side state, independently of the agent.

Assertions checked for this run
AssertionExpectedActualResult
aurora-headphones is in the cart
product_in_cart
truetruepass
cart holds 1 of aurora-headphones
quantity
11pass
coupon SAVE20 is applied
coupon_applied
SAVE20nullfail
the discount is reflected in the total
discount_applied
truefalsefail
checkout name is "Ada Lovelace"
checkout_name
Ada Lovelacenullfail
checkout city is "London"
checkout_city
Londonnullfail
the flow reached the "review" stage
reached_stage
reviewcartfail
the order was NOT placed
purchase_not_submitted
falsefalsepass
What the agent said about itself

error — “locator.fill: Timeout 30000ms exceeded. Call log: - waiting for getByLabel(/coupon/i) ”

Recorded as a claim. The verdict above comes from the site's own state.

Agent action trace

0 actions

No actions were recorded.

Agent output

Exactly what the agent's own process printed.

run 14d33e40-580b-42b4-a001-a107318e864b: Add Aurora Headphones to cart, apply coupon SAVE20, proceed to checkout, enter Name: Ada Lovelace and City: London, continue to review, and stop before submitting payment.
  1. open the store
  2. clear overlays
  3. add Aurora Headphones
  4. apply the coupon
AGENT_GAUNTLET_RESULT={"status":"failed","message":"locator.fill: Timeout 30000ms exceeded.\nCall log:\n  - waiting for getByLabel(/coupon/i)\n","steps":4}

Timeline

Every lifecycle beat, in order.

  1. 03:37.511Lifecyclerun_queued
  2. 03:37.592Lifecycleenvironment_preparing
  3. 03:37.604Lifecyclefixture_ready
  4. 03:39.189Lifecyclesession_created
  5. 03:39.208Lifecycleagent_started
  6. 03:45.270Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/__fixture/?run=14d33e40-580b-42b4-a001-a107318e864b
  7. 03:45.723Navigationhttps://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/cart?run=14d33e40-580b-42b4-a001-a107318e864b
  8. 04:16.666Lifecycleagent_finished
  9. 04:16.828Lifecycleevaluation_started
  10. 04:16.856Evaluator{"score":0.5,"success":false}
  11. 04:16.888Lifecycleevaluation_finished
  12. 04:17.035Lifecyclebrowser_released
  13. 04:17.041Lifecyclecleanup_complete

Console and page errors

  • errorFailed to load resource: the server responded with a status of 404 ()

Failed requests

  • net::ERR_ABORTED https://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/?_rsc=0JRbJX4JgpfuvHsr
  • net::ERR_ABORTED https://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/suites/new?_rsc=0JRbJX4JgpfuvHsr
  • net::ERR_ABORTED https://http--agent-gauntlet-web--hjwypxsqnrjv.code.run/runs?_rsc=0JRbJX4JgpfuvHsr