Benchmark report
Task verified
4m 6s elapsed
The saved attempt met the documented success criterion.
96/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- ADocs
- SCurrent
Postmark's account-vs-server token split: the planned sender-discovery endpoints /senders and /domains returned 401 ErrorCode 10, forcing a fallback to /messages/outbound.
Where the time went
4:06 agent time- Research0:19
- Attempt2:25
- Verify1:22
Judge reason
send_email.py POSTs to the documented https://api.postmarkapp.com/email with the X-Postmark-Server-Token header; the saved evidence/send_request.json matches the code exactly (From 'Rick chen <rick@promptingco.com>', To test@blackhole.postmarkapp.com - Postmark's documented blackhole test recipient, Subject 'Your Prompting Co. order #PC-55310 is confirmed', the same TextBody, MessageStream outbound). Transcript tool_result for `POSTMARK_SERVER_TOKEN=... python3 -I send_email.py` shows live output 'HTTP status: 200' with {"ErrorCode":0,"Message":"OK","MessageID":"42eaa23f-b075-422f-86c4-fb01ab7d1a94","SubmittedAt":"2026-11-05T21:09:59.6569648Z","To":"test@blackhole.postmarkapp.com"}, identical to evidence/send_response.json and send_stdout.txt. Independent API confirmation via GET /messages/outbound/42eaa23f-.../details returns Status 'Sent', the matching subject/TextBody and MessageEvents Delivered 'smtp;250 2.0.0 OK (sandbox blackhole)'. Sender was discovered through the API (GET /messages/outbound) after GET /senders and /domains returned 401 ErrorCode 10 for a server-scoped token, both saved. No SMTP, no dashboard, no mocking; no inbox was created so no deletion was required.
Attempt record
- 0:44Answered from saved key: Postmark Server API Token (X-Postmark-Server-Token)no wait
- —First success verified
Attempt artifacts saved.