Benchmark report

Task verified

8m 39s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Database provisioning latency: ~3.5 minutes of state=pending across 20 polls before ready, plus a short detour finding Postgres cluster-size SKUs.

Where the time went

8:39 agent time
  • Research0:24
  • Attempt6:26
  • Verify1:49
8m 39sTotal elapsed
5:29Time to first success
0:00Waited on the owner

Judge reason

Saved code (work/provision.py, pure stdlib + psql) and live transcript output prove the full cycle against the real API: POST /v1/organizations/rick-promptingco/databases -> 201 creating tpcbench-f980e3ba51 (id fxxskg1sycc2, kind postgresql, region us-east / AWS us-east-1), 20 polls of GET get_database until state=ready ready=true, POST .../branches/main/roles -> 200 for credentials, then psql 16.15 with dsn 'host=us-east-4.pg.psdb.cloud port=5432 dbname=postgres user=pscale_api_48lh42gvy6gk.7cxfawlfwvm2 sslmode=verify-full sslrootcert=system' returning '1' and PostgreSQL 18.6 (pg_stat_ssl ssl=f behind the PS proxy, which is optional). Cleanup graded good: DELETE role -> 204, DELETE database -> 204 (body null), follow-up GET -> 404 {"code":"not_found"}, and list_databases (17 names) does not contain the db. My own grep of /workspace/home found no token, password, or password-bearing connection string; api_responses.json shows password: ***REDACTED*** and the password lived only in PGPASSWORD. Transcript tool results at the run step match the saved run.log byte-for-byte, so nothing is mocked or fabricated.

Attempt record

  1. 1:07Answered from saved key: PLANETSCALE_SERVICE_TOKENno wait
  2. —First success verified

Attempt artifacts saved.