Benchmark report

Task verified

8m 2s elapsed

The saved attempt met the documented success criterion.

Experience score

91/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs S, Current ASInstallAAuthSExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
The undocumented org_id requirement on POST /projects and the ~75s asynchronous compute teardown after a 200 delete, which needed a polling script.

Where the time went

8:03 agent time
  • Research0:19
  • Attempt6:01
  • Verify1:42
8m 2sTotal elapsed
2:10Time to first success
0:00Waited on the owner

Judge reason

Verified against saved code and responses. work/03-http-sql.mjs uses only neon() from @neondatabase/serverless 1.2.0 (no Pool/Client, WebSocket constructor replaced by a throwing stub); evidence/03-http-sql-transcript.txt shows 4 live 'HTTP POST https://api.c-16.us-east-1.aws.neon.tech/sql -> 200' calls doing CREATE TABLE items, INSERT 2 rows RETURNING ({id:1,widget,7},{id:2,gadget,42}), SELECT returning the same two rows, plus a server-side count=2 on PostgreSQL 17.11; those rows match evidence/03-http-sql-results.json exactly. evidence/04-transport-proof.json records every socket: one tls.connect to api.c-16.us-east-1.aws.neon.tech:443 (TLS evidence) plus the sandbox's mandatory CONNECT proxy hop, zero 5432/5433 sockets, zero WebSockets. Project tpcbench-66396a86fc4a (spring-fire-84224412) was created via POST https://console.neon.tech/api/v2/projects (HTTP 201) and deleted via DELETE .../projects/spring-fire-84224412 -> HTTP 200 with body saved, confirmed gone by GET -> HTTP 404 'project not found', by absence from the org project list (0 of 46 matching), and by the HTTP SQL path itself failing with NeonDbError 'The requested endpoint could not be found' at 08:26:21Z after an honestly recorded ~75s of continued serving. No API key or DB password appears in any saved file; the only saved connection URI is '...neondb_owner:[REDACTED]@...'. Nothing is mocked or hard-coded.

Attempt record

  1. 0:53Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.