Benchmark report

Task verified

5m 30s elapsed

The saved attempt met the documented success criterion.

Experience score

86/ 100

Agent-Ready
  • SInstall
  • SAuth
  • AExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute A, Docs A, Current SSInstallSAuthAExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Resend's misleading 422 'This domain has been registered already.' for example.com and every reserved TLD forced ~6 probe calls and a substitute parent domain.

Where the time went

5:30 agent time
  • Research0:15
  • Attempt3:11
  • Verify2:04
5m 30sTotal elapsed
2:09Time to first success
0:00Waited on the owner

Judge reason

Saved code (resend-domain-task/verify_domain.js) makes real HTTPS calls to api.resend.com with Bearer auth and no mocks; per-call evidence JSONs plus run-console.log show the full documented lifecycle: POST /domains -> HTTP 201 id 4aac6c1c-d10e-4381-bbe5-10a6ebdf64b4 (status not_started), GET /domains/{id} -> 200 returning the four required DNS records (DKIM TXT resend._domainkey..., SPF MX send... priority 10, SPF TXT v=spf1 include:amazonses.com ~all, SPF CNAME rsend... -> send.forge.rmta.net), all listed in REPORT.md with type/name/value; POST /domains/{id}/verify -> 200 {object:domain,id:...} (report correctly states verification is not automatic); three GET polls return status 'pending' and the report explicitly does not claim verified; DELETE /domains/{id} -> 200 {deleted:true} with GET -> 404 'Domain not found' and a final account list showing no leftover tpc-bench domain. No dashboard or SMTP used; credential obtained via benchmark-request. The one deviation is the parent domain: POST with tpc-bench-ed2cd483.example.com returned HTTP 422 'This domain has been registered already.' (evidence/00-blocker-example.com-rejected.json), and transcript probes show .example.net, .example, .test, .invalid and .example.com.invalid all 422 while a control name returned 201 and was deleted - a genuine Resend-side restriction on reserved names, not a bad request. The agent kept the required tpc-bench-ed2cd483 label under an account-owned base, published no DNS, and ended at pending as the task expects, so every success criterion is met with transparent documentation of the substitution.

Attempt record

  1. 0:33Answered from saved key: RESEND_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.