The default platform for cloud infrastructure benchmarks.
ComputeSDK Benchmarks publishes reproducible, provider-neutral performance measurements for the infrastructure that AI agents and developer platforms run on: sandboxes, object storage, headless browsers, and AI gateways. Every test is automated, every result is committed as JSON, and the methodology is public.
Live leaderboards and full methodology: https://www.computesdk.com/benchmarks
For LLMs and agents: see llms.txt for a machine-readable index of this repo, and results/schema.json for the JSON Schema of every benchmark result file.
Our partners support our independent benchmarks.
★ SILVER
+ BRONZE
BENCHMARKS POWERED BY
We benchmark the infrastructure that AI agents and developer platforms rely on:
- Sandboxes — cold-start and concurrent Time to Interactive (TTI): API request to first successful command inside a fresh sandbox.
- Object storage — upload/download latency and throughput across providers and file sizes.
- Headless browsers — session creation, navigation, and step throughput.
- AI gateways — cold/warm connection latency and time to first token.
Every benchmark uses the same open code against every provider, with fixed workloads and a fixed scoring ceiling. Tests run automatically on GitHub Actions, and every result is committed as JSON to this repo. Each metric includes min, max, median, P95, and P99; a composite score rewards both speed and reliability.
For full details on each suite, see:
- 📖 Open source — All benchmark code is public
- 📊 Raw data — Every result committed to repo as JSON
- 🔁 Reproducible — Anyone can run the same tests
- ⚙️ Automated — Daily at 5pm Pacific (00:00 UTC) via GitHub Actions on Namespace runners
- 🛡️ Independent — Sponsors cannot influence results
- computesdk.com/benchmarks
- Add P95 & P99
- TTI n=100 test
- TTI n=100 concurrency test (staggered + burst)
- 100,000 concurrent sandbox stress test
- Cold start vs warm start metrics
- Multi-region testing
- Cost-per-sandbox-minute
Powered by ComputeSDK — We use ComputeSDK, a multi-provider SDK, to test all sandbox providers with the same code. One API, multiple providers, fair comparison.
MIT License