Benchmark report
Task verified
5m 3s elapsed
The saved attempt met the documented success criterion.
96/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- ADocs
- SCurrent
Sender-signature discovery: the provided server token got 401 ErrorCode 10 on account-level /senders and /domains, forcing a fallback to /messages/outbound.
Where the time went
5:04 agent time- Research0:18
- Attempt3:01
- Verify1:43
Judge reason
send_email.py POSTs to the documented https://api.postmarkapp.com/email with the X-Postmark-Server-Token header; evidence/request.json matches the code byte-for-byte (From 'Rick chen <rick@promptingco.com>', To test@blackhole.postmarkapp.com -- Postmark's documented blackhole test recipient, Subject 'Postmark transactional send test 2026-11-09', plain-text TextBody, MessageStream outbound). Transcript line 51-52 shows the live run printing 'HTTP status: 200' and MessageID 69ab779f-127a-4a2d-ac44-b6dfce5b85a6, identical to evidence/send_response.json (ErrorCode 0, Message 'OK', SubmittedAt 2026-11-09T19:35:34.8904953Z) and to send_stdout.txt, with live Postmark response headers (X-Postmark-Server 19755949, Ratelimit-Remaining 4999). The sender was discovered through the API before the send: transcript line 43-44 shows GET /messages/outbound returning 200 with prior Status 'Sent' messages From "Rick chen" <rick@promptingco.com> (GET /senders and /domains returned 401 ErrorCode 10, needing an account-level token). An independent read-back, GET /messages/outbound/{id}/details, returned 200 with Status 'Sent', Recipients [test@blackhole.postmarkapp.com] and the matching MIME body. No SDK was needed (single REST call via Python stdlib); no inbox was created, so no deletion applies; nothing mocked or hard-coded.
Attempt record
- 1:00Answered from saved key: Postmark Server API Tokenno wait
- —First success verified
Attempt artifacts saved.