Benchmark report

Task verified

7m 11s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs A, Current SSInstallAAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
A self-imposed guard that blocked the TCP the HTTPS proxy needs caused one failed run, plus a ~60s lag before the /sql endpoint reflected the project delete.

Where the time went

7:11 agent time
  • Research0:20
  • Attempt5:20
  • Verify1:31
7m 11sTotal elapsed
2:34Time to first success
0:00Waited on the owner

Judge reason

Saved code and runtime output prove the full task. work/code/run_http_sql.js uses neon() from @neondatabase/serverless (tagged template, HTTP fetch mode; no Pool/Client), and evidence/02+03 show CREATE TABLE items, INSERT 2 rows RETURNING, and SELECT returning [{id:1,'alpha widget',7},{id:2,'beta gadget',42}] matching the printed console.table output, plus server info PostgreSQL 17.11/neondb/item_count 2. Transport proof is instrumented, not asserted: 4 HTTPS POSTs to https://api.c-15.us-east-1.aws.neon.tech/sql all status 200 (TLS evidence), sockets observed only port 8080 (egress proxy CONNECT) and 443 (tls.connect to the Neon /sql host), no 5432, and globalThis.WebSocket was replaced with a throwing stub that never fired (violations []). Project tpcbench-66a9a44279ba was created via POST https://console.neon.tech/api/v2/projects with Bearer NEON_API_KEY (HTTP 201, id fragrant-forest-51870546). Cleanup is complete: DELETE -> HTTP 200 with the project body saved, follow-up GET -> HTTP 404 {"message":"project not found"}, list of 46 org projects shows zero tpcbench-* matches, and a repeat HTTP /sql read after ~60s propagation errors with NeonDbError 'requested endpoint could not be found'. No password or password-bearing connection string appears anywhere: connection_uri and roles[].password are [REDACTED] in saved responses, and grep over all saved files and the transcript found none. Nothing mocked or hard-coded.

Attempt record

  1. 0:48Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.