Baseline · run 1
Failedagent_errorSOLARI LIVEbrowserType.connectOverCDP: WebSocket error: connect ECONNREFUSED 127.0.0.1:44045 Call log: - <ws connecting> [redacted-session-endpoint] - <ws error> [redacted-session-endpoint] error connect ECONNREFUSED 127.0.0.1:44045 - <ws connect error> [redacted-session-endpoint] connect ECONNREFUSED 127.0.0.1:44045 - <ws disconnected> [redacted-session-endpoint] code=1006 reason=
Session replay
A DOM-level rrweb recording of exactly what the browser did.
Recorded by Solari during the session and stored here as an artifact. The Solari link is minted fresh on demand, because presigned URLs expire while the recording does not.
Evaluator evidence
Read from the benchmark site's server-side state, independently of the agent.
| Assertion | Expected | Actual | Result |
|---|---|---|---|
aurora-headphones is in the cart product_in_cart | true | false | fail |
cart holds 1 of aurora-headphones quantity | 1 | 0 | fail |
coupon SAVE20 is applied coupon_applied | SAVE20 | null | fail |
the discount is reflected in the total discount_applied | true | false | fail |
checkout name is "Ada Lovelace" checkout_name | Ada Lovelace | null | fail |
checkout city is "London" checkout_city | London | null | fail |
the flow reached the "review" stage reached_stage | review | browse | fail |
the order was NOT placed purchase_not_submitted | false | false | pass |
error — “browserType.connectOverCDP: WebSocket error: connect ECONNREFUSED 127.0.0.1:44045 Call log: - <ws connecting> ws://127.0.0.1:44045/cdp/ip-10-0-10-96%3Ae6220cda-6d86-467f-956a-cf35b42799c6%3Acmtiqnxkf028lo101geau1qce%3A1788349933653._y9SS1xu7W62AJ7S6XnMTw - <ws error> ws://127.0.0.1:44045/cdp/ip-10-0-10-96%3Ae6220cda-6d86-467f-956a-cf35b42799c6%3Acmtiqnxkf028lo101geau1qce%3A1788349933653._y9SS1xu7W62AJ7S6XnMTw error connect ECONNREFUSED 127.0.0.1:44045 - <ws connect error> ws://127.0.0.1:44045/cdp/ip-10-0-10-96%3Ae6220cda-6d86-467f-956a-cf35b42799c6%3Acmtiqnxkf028lo101geau1qce%3A1788349933653._y9SS1xu7W62AJ7S6XnMTw connect ECONNREFUSED 127.0.0.1:44045 - <ws disconnected> ws://127.0.0.1:44045/cdp/ip-10-0-10-96%3Ae6220cda-6d86-467f-956a-cf35b42799c6%3Acmtiqnxkf028lo101geau1qce%3A1788349933653._y9SS1xu7W62AJ7S6XnMTw code=1006 reason= ”
Recorded as a claim. The verdict above comes from the site's own state.
Agent action trace
0 actions
No actions were recorded.
Agent output
Exactly what the agent's own process printed.
run 59aca6b5-c4d5-49d2-a198-680ab62e495e: Add Aurora Headphones to cart, apply coupon SAVE20, proceed to checkout, enter Name: Ada Lovelace and City: London, continue to review, and stop before submitting payment.
AGENT_GAUNTLET_RESULT={"status":"failed","message":"browserType.connectOverCDP: WebSocket error: connect ECONNREFUSED 127.0.0.1:44045\nCall log:\n - <ws connecting> [redacted-session-endpoint] - <ws error> [redacted-session-endpoint] error connect ECONNREFUSED 127.0.0.1:44045\n - <ws connect error> [redacted-session-endpoint] connect ECONNREFUSED 127.0.0.1:44045\n - <ws disconnected> [redacted-session-endpoint] code=1006 reason=\n","steps":0}
Timeline
Every lifecycle beat, in order.
- 52:13.221Lifecyclerun_queued
- 52:13.271Lifecycleenvironment_preparing
- 52:13.282Lifecyclefixture_ready
- 52:14.625Lifecyclesession_created
- 52:14.643Lifecycleagent_started
- 52:18.334Lifecycleagent_finished
- 52:18.492Lifecycleevaluation_started
- 52:18.530Evaluator{"score":0.3,"success":false}
- 52:18.536Lifecycleevaluation_finished
- 52:18.874Lifecyclebrowser_released
- 52:18.879Lifecyclecleanup_complete