Benchmark report
Task verified
6m 38s elapsed
The saved attempt met the documented success criterion.
100/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- SDocs
- SCurrent
A minute of doc hunting after the plan's browser-use.com/auth.md and /cloud-browser were blocked by the sandbox proxy (403), recovered via docs.browser-use.com llms.txt.
Where the time went
6:39 agent time- Research0:29
- Attempt4:11
- Verify1:59
Judge reason
Saved code (code/cookie_persistence.py) and evidence show a real, unmocked run on 2026-11-09 08:24Z: POST /api/v4/profiles -> 201 profile 088cf645 (cookieDomains null), POST /api/v4/browsers {profileId} -> 201 session A 8cbace9b with cdpUrl https://8cbace9b-....cdp.browser-use.com, Playwright connect_over_cdp to browser.contexts[0] loading httpbin.org/cookies/set?tpc=benchmark and printing {"cookies":{"tpc":"benchmark"}} (playwright_sessionA.json, context cookie domain httpbin.org). A was stopped via PATCH /browsers/{id} {"action":"stop"} -> 200 status=stopped and polled to stopped (03/04 evidence) before B existed; GET /profiles then showed cookieDomains ["httpbin.org"] (05). Session B 5fae6e78 (distinct, 06 -> 201) connected over its own CDP URL and httpbin.org/cookies returned {"cookies":{"tpc":"benchmark"}} (playwright_sessionB.json, run_console.log). finally block: PATCH stop A and B -> 200 status=stopped, DELETE /profiles -> 204, GET -> 404 Profile not found. All endpoints match the saved docs (profiles create/get/delete, PATCH action stop, connect_over_cdp with contexts[0]); key sent only in X-Browser-Use-API-Key header, CDP URLs carry no query string, liveUrl query and headers redacted, and the agent's grep for the key over all artifacts found no match. Console output matches the saved JSON responses exactly.
Attempt record
- 1:46Answered from saved key: Browser Use Cloud API key (BROWSER_USE_API_KEY)no wait
- —First success verified
Attempt artifacts saved.