Benchmark report
Task verified
3m 38s elapsed
The saved attempt met the documented success criterion.
100/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- SDocs
- SCurrent
Nothing material — docs read, key request and the full live lifecycle completed in ~77s with no retries or errors.
Where the time went
3:38 agent time- Starting0:01
- Research0:15
- Attempt2:06
- Verify1:17
Judge reason
Saved stdlib-Python script run_domain_flow.py makes real HTTPS calls to https://api.agentmail.to/v0 with a bearer key read from a private file (never printed). Evidence files show the full live lifecycle for tpc-bench-11d8e0e7.example.com: 01_create.json POST /v0/domains -> HTTP 200 with domain_id 'tpc-bench-11d8e0e7.example.com', status NOT_STARTED and 5 DNS records (DKIM TXT, MX inbound-smtp.us-east-1.amazonaws.com pri 10, MX feedback-smtp.us-east-1.amazonses.com pri 10, SPF TXT, DMARC TXT) all listed in REPORT.md with type/name/value; 02_get.json GET -> 200 records MISSING; 03_verify.json POST /{id}/verify -> HTTP 204; 04_get_status.json GET -> 200 status PENDING, reason dns_records_missing; 05_delete.json DELETE -> 204; 06_get_after_delete.json GET -> 404 NotFoundError 'Domain not found' confirming deletion. Report states PENDING and never claims verified. No dashboard or SMTP steps; nothing mocked or hard-coded.
Attempt record
- 0:54Answered from saved key: AGENTMAIL_API_KEYno wait
- —First success verified
Attempt artifacts saved.