Benchmark report

Task verified

3m 53s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Only minor friction: the create response returns just {object,id}, so an extra GET /inboxes/{id} was needed to obtain the deliverable address.

Where the time went

3:54 agent time
  • Research0:31
  • Attempt2:02
  • Verify1:20
3m 53sTotal elapsed
1:23Time to first success
0:00Waited on the owner

Judge reason

Saved runnable code (resend-inbox-task/inbox-task.mjs) calls live api.resend.com with fetch and a bearer key read from a private file - no mocks or hard-coded bodies. Saved run output and the full transcript (evidence-inbox-create-delete.txt, evidence/00-run-output.txt, 02-api-transcript.json) show real Cloudflare-served responses: POST /inboxes -> 201 {"object":"inbox","id":"645e9d08-93bb-45ca-bd30-86dde10e2c51"}, GET /inboxes/{id} -> 200 showing deliverable address bench-1794246773037@resend-bench.thefounderportfolio.com plus receiving_address 156cedcd@deliizeimr.resend.app on a domain confirmed verified with receiving enabled (01-list-domains.json), DELETE /inboxes/{id} -> 200 {"deleted":true}, and a post-delete GET -> 404 {"name":"not_found"} on attempt 1, well inside the 60s bounded poll the code implements. Both the identifier and the deliverable address were printed (the documented create response returns only object+id, so the address was read back via the documented GET and this is stated explicitly, not invented). Transcript entry 40 shows this output produced by an actual node run, matching the saved artifacts byte for byte.

Attempt record

  1. 1:06Answered from saved key: RESEND_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.