Benchmark report

Task verified

4m 26s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
GET /senders and /domains returned 401 (Account token required), so the sender had to be inferred from outbound history; then ~15s of HTTP 422 polling while Postmark indexed the message.

Where the time went

4:26 agent time
  • Research0:18
  • Attempt2:48
  • Verify1:20
4m 26sTotal elapsed
1:50Time to first success
0:00Waited on the owner

Judge reason

Saved code (postmark-task/send_and_read.py) makes real HTTPS calls with urllib to api.postmarkapp.com: POST /email returned HTTP 200 ErrorCode 0 MessageID c1501aea-89c2-4f3a-8ea7-f002f30dbc3c SubmittedAt 2026-11-02T06:24:45.9392786Z (evidence/01_send_POST_email.json). The pull-style read GET /messages/outbound/c1501aea-.../details polled 3x HTTP 422 then HTTP 200, returning Status 'Sent', ReceivedAt '2026-11-02T01:24:46.0000000-05:00' and MessageEvents[0] Type 'Delivered' with Details.DeliveryMessage 'smtp;250 2.0.0 OK (sandbox blackhole)' (evidence/02). A filter-derived read GET /messages/outbound?recipient=...&fromemail=... matched the same MessageID, and GET /bounces?emailFilter=... returned TotalCount 0. Transcript entry 45 shows the live stdout of the single run, byte-matching the saved evidence and result.json/README; no webhook, dashboard, SMTP, mock or hard-coded response. Exactly one recipient, Postmark's documented black-hole test address test@blackhole.postmarkapp.com; sender rick@promptingco.com discovered through the API (GET /messages/outbound history) after GET /senders and /domains returned 401 ErrorCode 10 requiring an Account token. Token was obtained via benchmark-request and verified absent from all artifacts.

Attempt record

  1. 0:41Answered from saved key: Postmark Server API tokenno wait
  2. —First success verified

Attempt artifacts saved.