Skip to content

chore(deps): bump @computesdk/beam to ^0.3.1 - #259

Merged
kisernl merged 1 commit into
masterfrom
devin/1785434006-beam-bump
Jul 30, 2026
Merged

chore(deps): bump @computesdk/beam to ^0.3.1#259
kisernl merged 1 commit into
masterfrom
devin/1785434006-beam-bump

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Summary

Bumps the beam sandbox provider dep to the latest published version: @computesdk/beam ^0.3.0^0.3.1 (picks up @beamcloud/beam-js 1.0.13 → 1.0.17, which swaps archiver for yazl).

No code changes needed — benchmarks/sandbox/providers.ts keeps using beam({ token, workspaceId }) with sandboxOptions: { name, runtime: 'node' }. pnpm typecheck passes.

Link to Devin session: https://app.devin.ai/sessions/9fea0cb02baf4174be0884383cdaa1c1


Open in Devin Review

Co-Authored-By: Noah Kiser <noah@computesdk.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@open-cla

open-cla Bot commented Jul 30, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@kisernl
kisernl merged commit 1e297d2 into master Jul 30, 2026
7 checks passed
@github-actions

Copy link
Copy Markdown
Contributor

Storage Benchmark Results

1MB Files

# Provider Score Download Throughput Upload Status
1 Azure Blob Storage 96.7 0.02s 371.9 Mbps 0.08s 10/10
2 Vercel Blob 95.0 0.07s 127.8 Mbps 0.26s 10/10
3 Tensorlake 94.8 0.05s 156.3 Mbps 0.58s 10/10
4 AWS S3 94.5 0.12s 71.6 Mbps 0.22s 10/10
5 Tigris 94.5 0.06s 139.1 Mbps 0.73s 10/10
6 Cloudflare R2 94.1 0.15s 55.2 Mbps 0.54s 10/10
7 Google Cloud Storage 0.0 0.00s 0.0 Mbps 0.00s 0/10

View full run · SVGs available as build artifacts

@github-actions

Copy link
Copy Markdown
Contributor

Snapshot/Fork Benchmark Results

small dataset

# Provider Score Snapshot create Fork (snapshot) Fork (live) First read Status
1 Tensorlake 99.7 0.02s 0.25s 0.31s 0.15s 1/1
2 Tigris 99.4 0.21s 0.48s 0.41s 0.48s 1/1
3 Azure-blob 98.4 1.01s 0.82s 1.64s 0.02s 1/1
4 Cloudflare R2 94.3 3.89s 2.99s 5.52s 0.10s 1/1
5 AWS S3 0.0 0.00s 0.00s 0.00s 0.00s 0/1

View full run

@github-actions

Copy link
Copy Markdown
Contributor

Browser Benchmark Results

# Provider Score Create Connect Navigate Release Total Status
1 Kernel 97.6 0.01s 0.09s 0.11s 0.04s 0.27s 10/10
2 Tilion 97.4 0.02s 0.04s 0.11s 0.01s 0.22s 10/10
3 Browseruse 95.1 0.20s 0.18s 0.07s 0.05s 0.51s 10/10
4 Browserbase 93.6 0.21s 0.11s 0.09s 0.13s 0.54s 10/10
5 Steel 85.8 0.60s 0.55s 0.12s 0.32s 1.68s 10/10
6 Notte 85.5 0.29s 0.82s 0.29s 0.18s 1.82s 10/10
7 Hyperbrowser 62.8 0.32s 0.54s 0.34s 0.10s 1.55s 10/10

View full run · SVG available as build artifact

@github-actions

Copy link
Copy Markdown
Contributor

Browser Throughput Benchmark Results

# Provider Score APS (med) Task (med) Task (p95) Screenshot Status
1 Kernel 78.4 5.45/s 1.83s 2.62s 324ms 3/3
2 Tilion 70.1 3.87/s 2.58s 4.58s 305ms 3/3
3 Browseruse 69.2 3.58/s 2.80s 4.01s 275ms 3/3
4 Browserbase 68.4 3.42/s 2.92s 4.09s 305ms 3/3
5 Steel 55.7 1.60/s 6.27s 7.74s 612ms 3/3
6 Hyperbrowser 53.0 1.39/s 7.17s 9.14s 942ms 3/3
7 Notte 47.0 0.96/s 10.46s 11.13s 1456ms 3/3

View full run · SVG available as build artifact

@github-actions

Copy link
Copy Markdown
Contributor

Sandbox Dax Benchmark Results

Provider Phases Total Prepare Clone Install Typecheck Status
archil 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
beam 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
blaxel 7/7 53.82s 2.08s 2.17s 11.02s 32.25s 1/1 OK
cloud-run 2/7 0.94s 0.18s 0.00s 0.00s 0.00s 0/1 OK
cloudflare 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
codesandbox 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
createos 7/7 46.88s 2.09s 2.53s 12.25s 24.69s 1/1 OK
daytona 7/7 73.96s 2.92s 2.40s 15.38s 38.74s 1/1 OK
declaw 7/7 229.05s 57446.84s 6.85s 32.23s 164.75s 1/1 OK
e2b 7/7 74.74s 9.09s 3.96s 10.65s 41.84s 1/1 OK
hopx -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
isorun -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
lightning 7/7 47.08s 5.33s 2.66s 12.97s 15.86s 1/1 OK
modal 6/7 26.08s 3.98s 2.60s 13.78s 0.00s 0/1 OK
namespace 7/7 44.82s 3.60s 1.57s 9.55s 23.98s 1/1 OK
northflank -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
opencomputer 6/7 26.17s 3.09s 1.87s 17.97s 0.00s 0/1 OK
runloop 2/7 123.76s 0.00s 0.00s 24.45s 50.57s 1/1 OK
sandbox0 7/7 235.97s 3.95s 6.96s 82.98s 106.41s 1/1 OK
superserve 7/7 96.99s 5.78s 4.49s 25.22s 57.42s 1/1 OK
tenki 7/7 53.18s 3.91s 4.00s 13.05s 25.60s 1/1 OK
tensorlake 7/7 56.02s 12.23s 1.45s 10.79s 27.22s 1/1 OK
upstash 7/7 50.05s 3.67s 2.11s 9.62s 24.03s 1/1 OK
vercel 7/7 108.77s 23.51s 2.42s 16.63s 57.00s 1/1 OK

View full run

@github-actions

Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Sequential

# Provider Score Median TTI P95 P99 Status
1 declaw 99.2 0.05s 0.14s 0.14s 10/10
2 createos 98.9 0.08s 0.15s 0.15s 10/10
3 northflank 98.6 0.10s 0.20s 0.20s 10/10
4 archil 97.9 0.14s 0.32s 0.32s 10/10
5 blaxel 97.6 0.23s 0.27s 0.27s 10/10
6 lightning 97.5 0.17s 0.38s 0.38s 10/10
7 tensorlake 96.6 0.33s 0.36s 0.36s 10/10
8 superserve 96.3 0.34s 0.42s 0.42s 10/10
9 cloud-run 94.7 0.52s 0.56s 0.56s 10/10
10 runloop 93.3 0.59s 0.79s 0.79s 10/10
11 beam 93.0 0.10s 1.61s 1.61s 10/10
12 vercel 92.6 0.40s 1.26s 1.26s 10/10
13 e2b 90.8 0.86s 1.02s 1.02s 10/10
14 modal 89.8 0.67s 1.55s 1.55s 10/10
15 tenki 88.3 0.82s 1.69s 1.69s 10/10
16 opencomputer 82.4 1.58s 2.02s 2.02s 10/10
17 sandbox0 80.4 1.33s 2.92s 2.92s 10/10
18 upstash 77.0 0.35s 0.41s 0.41s 8/10
19 cloudflare 76.0 1.81s 3.28s 3.28s 10/10
20 daytona 60.7 1.61s 7.40s 7.40s 10/10
21 isorun 59.9 0.02s 16.83s 16.83s 10/10
22 codesandbox 48.4 2.42s 9.27s 9.27s 10/10
23 hopx 0.0 0.00s 0.00s 0.00s 0/10

Staggered

# Provider Score Median TTI P95 P99 Status
1 isorun 99.7 0.02s 0.04s 0.04s 10/10
2 createos 99.1 0.07s 0.12s 0.12s 10/10
3 declaw 98.9 0.05s 0.20s 0.20s 10/10
4 northflank 98.6 0.11s 0.18s 0.18s 10/10
5 archil 98.3 0.15s 0.19s 0.19s 10/10
6 beam 97.8 0.19s 0.26s 0.26s 10/10
7 blaxel 97.6 0.22s 0.27s 0.27s 10/10
8 superserve 97.1 0.28s 0.30s 0.30s 10/10
9 lightning 97.0 0.20s 0.45s 0.45s 10/10
10 tensorlake 96.6 0.31s 0.40s 0.40s 10/10
11 upstash 96.2 0.36s 0.41s 0.41s 10/10
12 vercel 94.7 0.44s 0.66s 0.66s 10/10
13 runloop 94.0 0.58s 0.63s 0.63s 10/10
14 modal 92.4 0.55s 1.06s 1.06s 10/10
15 e2b 89.7 0.84s 1.32s 1.32s 10/10
16 tenki 89.2 0.84s 1.46s 1.46s 10/10
17 cloud-run 81.9 0.87s 3.22s 3.22s 10/10
18 opencomputer 81.4 1.75s 2.02s 2.02s 10/10
19 sandbox0 80.7 1.71s 2.26s 2.26s 10/10
20 cloudflare 79.1 1.73s 2.62s 2.62s 10/10
21 codesandbox 74.9 2.23s 2.92s 2.92s 10/10
22 daytona 23.7 6.05s 31.28s 31.28s 10/10
23 hopx 0.0 0.00s 0.00s 0.00s 0/10

Burst

# Provider Score Median TTI P95 P99 Status
1 isorun 99.5 0.04s 0.05s 0.05s 10/10
2 declaw 98.6 0.14s 0.15s 0.15s 10/10
3 createos 98.5 0.14s 0.15s 0.15s 10/10
4 archil 98.4 0.15s 0.18s 0.18s 10/10
5 northflank 98.2 0.16s 0.22s 0.22s 10/10
6 lightning 97.9 0.20s 0.21s 0.21s 10/10
7 beam 97.9 0.14s 0.31s 0.31s 10/10
8 tensorlake 97.0 0.30s 0.31s 0.31s 10/10
9 blaxel 96.5 0.34s 0.36s 0.36s 10/10
10 superserve 95.3 0.44s 0.51s 0.51s 10/10
11 vercel 95.2 0.45s 0.52s 0.52s 10/10
12 upstash 94.5 0.51s 0.60s 0.60s 10/10
13 runloop 93.4 0.64s 0.69s 0.69s 10/10
14 modal 93.1 0.63s 0.78s 0.78s 10/10
15 e2b 87.5 0.80s 1.94s 1.94s 10/10
16 tenki 85.4 1.40s 1.54s 1.54s 10/10
17 opencomputer 80.3 1.91s 2.05s 2.05s 10/10
18 cloud-run 72.7 1.78s 4.16s 4.16s 10/10
19 daytona 69.3 1.93s 2.84s 2.84s 9/10
20 codesandbox 69.0 2.92s 3.36s 3.36s 10/10
21 sandbox0 65.6 3.34s 3.58s 3.58s 10/10
22 cloudflare 63.4 3.37s 4.10s 4.10s 10/10
23 hopx 0.0 0.00s 0.00s 0.00s 0/10

View full run · SVGs available as build artifacts

@github-actions

Copy link
Copy Markdown
Contributor

AI Gateway Benchmark Results

# Gateway Score Cold E2E Warm TTFT Tok/sec Status
1 Vercel AI Gateway 89.8 1025ms 683ms 91.0 20/20
2 OpenRouter 89.7 769ms 756ms 88.2 20/20
3 Anthropic (direct) 89.7 781ms 750ms 88.3 20/20
4 Pydantic AI Gateway 88.9 771ms 620ms 90.5 20/20
5 Cloudflare AI Gateway 87.2 767ms 651ms 87.2 20/20
6 LLM Gateway 86.7 779ms 687ms 88.8 20/20
7 Concentrate AI 83.6 1259ms 833ms 0.0 20/20

View full run · SVG available as a build artifact

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant