Benchmark report

Task verified

3m 39s elapsed

The saved attempt met the documented success criterion.

Experience score

90/ 100

Agent-Ready
  • AInstall
  • AAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth A, Execute S, Docs S, Current SAInstallAAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Resend's Cloudflare edge rejected the default Python-urllib User-Agent with HTTP 403 'error code: 1010', costing one failed run and a curl-based diagnosis.

Where the time went

3:39 agent time
  • Research0:15
  • Attempt2:10
  • Verify1:14
3m 39sTotal elapsed
1:25Time to first success
0:00Waited on the owner

Judge reason

Saved code (resend-task/send_and_read.py) calls the real Resend REST API via urllib. Transcript run output and evidence agree: GET /domains -> 200 discovered verified domain resend-bench.thefounderportfolio.com (sender Benchmark Test <benchmark@resend-bench.thefounderportfolio.com>); POST /emails -> 200 returned id 01a19b04-e828-763f-b2e7-a6ba940dc4af to the documented test recipient delivered@resend.dev with subject 'Resend pull-status benchmark probe' and a plain-text body (evidence/02_post_emails.json, email_id.txt). The pull-style read endpoint GET /emails/{id} was then polled by that exact id: attempt 1 at 06:49:12Z returned last_event='queued' (03_get_email_first.json), attempt 2 at 06:49:18Z returned last_event='delivered' with created_at '2026-11-02 06:49:12.633000+00' and message_id <010001a19b04e943-...@email.amazonses.com> (04/05 evidence). A secondary read GET /emails?limit=20 filtered to the same id shows the same delivered state (06_get_emails_list_match.json). No webhook, no dashboard, no SMTP, no mocking: the only earlier failure was a Cloudflare 403 'error code: 1010' against the default urllib User-Agent, which sent no mail, so exactly one email was sent. The report in result.json matches the saved responses field-for-field (only cosmetic drift: it lists attempt_1 at 06:49:13Z vs 06:49:12Z in the evidence).

Attempt record

  1. 0:43Answered from saved key: Resend API keyno wait
  2. —First success verified

Attempt artifacts saved.