Benchmark report

Task verified

5m 36s elapsed

The saved attempt met the documented success criterion.

Experience score

88/ 100

Agent-Ready
  • AInstall
  • SAuth
  • AExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute A, Docs S, Current SAInstallSAuthAExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Resend rejects every *.example.com with a misleading 422 'This domain has been registered already', forcing diagnosis and a base-domain fallback; plus a Cloudflare 1010 block on urllib's default User-Agent.

Where the time went

5:37 agent time
  • Research0:18
  • Attempt3:24
  • Verify1:54
5m 36sTotal elapsed
2:28Time to first success
0:00Waited on the owner

Judge reason

Saved code (code/resend_domain_flow.py, stdlib urllib, Bearer key read from a private file) and the captured run (evidence/run-output.txt, evidence/flow.json) show the full live lifecycle against https://api.resend.com: POST /domains -> HTTP 201 id 51b644d7-cd0f-40ce-88be-55c23e38589f; GET /domains/{id} -> HTTP 200 returning 4 DNS records, all printed with type/name/value (DKIM TXT resend._domainkey.tpc-bench-d1920795 p=MIGf...; SPF MX send.tpc-bench-d1920795 feedback-smtp.us-east-1.amazonses.com prio 10; SPF TXT v=spf1 include:amazonses.com ~all; SPF CNAME rsend.tpc-bench-d1920795 send.forge.rmta.net); POST /domains/{id}/verify -> HTTP 200; GET /domains/{id} -> status "pending"; DELETE /domains/{id} -> {"deleted":true}. No verified claim, no dashboard, no mocks. One documented deviation: the mandated base example.com is rejected by Resend itself with HTTP 422 "This domain has been registered already" - reproduced in-script and via curl with three independent hex labels, while GET /domains showed the account owns no tpc-bench domain and a control create on a registrable base succeeded - so the agent kept the exact tpc-bench-d1920795 label and used .thefounderportfolio.com, recording the 422 attempt as step 1 in the evidence. Same operation, same expected not-yet-verified outcome.

Attempt record

  1. 0:39Answered from saved key: RESEND_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.