Benchmark report

Task verified

4m 13s elapsed

The saved attempt met the documented success criterion.

Experience score

90/ 100

Agent-Ready
  • AInstall
  • AAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth A, Execute S, Docs S, Current SAInstallAAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Sender discovery: /senders and /domains rejected the server token (401 ErrorCode 10), so the agent had to infer a permitted From from outbound message history.

Where the time went

4:14 agent time
  • Research0:20
  • Attempt2:03
  • Verify1:50
4m 13sTotal elapsed
1:20Time to first success
0:00Waited on the owner

Judge reason

Saved code (02_send.py, 03_read_events.py over common.py's urllib client to https://api.postmarkapp.com with X-Postmark-Server-Token) performed a real round trip. POST /email returned HTTP 200 with MessageID e937ef33-0cc1-4889-ace4-ffe5e3520da8 and SubmittedAt 2026-11-09T18:58:17.6353966Z (evidence/02_send_response.json, mirrored in transcript idx 35). Recipient was Postmark's documented test recipient test@blackhole.postmarkapp.com, shown in the saved request body; no inbox was created, so no deletion was required. The pull read GET /messages/outbound/{id}/details returned HTTP 200 with Status 'Sent', ReceivedAt 2026-11-09T13:58:17.0000000-05:00 and MessageEvents[0] Type 'Delivered' with DeliveryMessage 'smtp;250 2.0.0 OK (sandbox blackhole)' (evidence/03_read_events.json; identical stdout at transcript idx 41). Two filter-derived corroborating reads (GET /messages/outbound?recipient=... returning the same MessageID with Status 'Sent', and GET /bounces?emailFilter=... TotalCount 0) are also saved. No webhook or dashboard was used. Responses are server-generated, not mocked: the details body carries the full raw MIME with X-PM-Message-Id, Feedback-ID s19755949, X-Job 534394_19755949 and the account's unrelated prior messages. Sender was discovered through the API: /senders and /domains returned 401 ErrorCode 10 ('Server token is not allowed, please use a valid Account token.'), so the From rick@promptingco.com was taken from GET /messages/outbound (evidence/01_discovery.json). result.json matches the saved responses field for field.

Attempt record

  1. 0:34Answered from saved key: Postmark Server API Tokenno wait
  2. —First success verified

Attempt artifacts saved.