Benchmark report

Task verified

6m 54s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs A, Current SSInstallAAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The undocumented-in-context org_id requirement: POST /projects 400 and later GET /projects 400 each forced a lookup/retry cycle (steps 00 and 04).

Where the time went

6:54 agent time
  • Research0:16
  • Attempt4:40
  • Verify1:58
6m 54sTotal elapsed
2:45Time to first success
0:00Waited on the owner

Judge reason

Live end-to-end run verified from saved code + outputs. Project created via documented management API: POST /projects -> HTTP 201, name tpcbench-cbb3982e53, id dark-base-06334807 (01-create-project.log; first POST 400 'org_id is required', retried with org_id from GET /users/me/organizations). SQL ran only through neon() from @neondatabase/serverless v1.2.0 (package-lock pinned): 02-http-sql.log shows DROP/CREATE TABLE items/INSERT 2 rows RETURNING/SELECT, with rows [{id:1,widget,7},{id:2,gadget,42}] matching 02-rows-read-back.json and 02-sql-responses.json byte-identical to evidence/http-sql-success.json. In-process instrumentation of net.Socket.connect/tls.connect/fetch/WebSocket recorded 4 POSTs to https://api.c-8.us-east-2.aws.neon.tech/sql, zero connects to 5432/5433, websocket_constructed false, neonConfig.webSocketConstructor undefined, and the only sockets were the sandbox HTTPS CONNECT proxy at :8080 plus TLS :443. Connection string carried sslmode=verify-full&sslrootcert=system. Cleanup graded: DELETE /projects/dark-base-06334807 -> HTTP 200 with full body, follow-up GET -> HTTP 404 'project not found' (request_id 1fe1ee96), and GET /projects?org_id=... -> 200 listing 13 pre-existing projects with the deleted one absent and no leftover tpcbench-* (04-verify-list.log, superseding the 400 list call recorded in 03). Secret scan across /workspace/home found no password or password-bearing URI: connection_uri/password fields are [REDACTED] in 01-create-project-response.json; the API key was read from a file via NEON_API_KEY_FILE and never printed. No mocked or fabricated responses.

Attempt record

  1. 0:35Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.