Skip to content

fix: standardize dax benchmark resources to 8 vCPU / 16 GiB #196

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
HeyGarrison merged 17 commits into from
Jul 20, 2026
Merged

fix: standardize dax benchmark resources to 8 vCPU / 16 GiB #196

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
ad8d3b0
fix: standardize dax benchmark resources to 8 vCPU / 16 GiB
HeyGarrison Jul 17, 2026
27f9ee4
fix: remove E2B from resource options - CPU/mem set at template build…
HeyGarrison Jul 17, 2026
bca8ec7
fix: standardize dax resource specs for all providers to 8 vCPU / 16 GiB
HeyGarrison Jul 18, 2026
19740f5
feat: local benchmark script with apt/dnf and arch detection
HeyGarrison Jul 18, 2026
5f71355
rename: provider-benchmark.sh to dax-benchmark.sh
HeyGarrison Jul 18, 2026
d6497ad
feat: add namespace provider to dax benchmark (16 vCPU / 32 GiB)
HeyGarrison Jul 18, 2026
f0efe46
dax: standardize declaw resources via node-large template (#197)
shivam-declaw Jul 18, 2026
c7f4c47
fix: bun zip path, northflank API fallback, daytona snapshot, namespa…
HeyGarrison Jul 18, 2026
58b9d5e
fix: northflank smallest plan selection + E2B command timeout workaround
HeyGarrison Jul 18, 2026
67813b6
fix: daytona use image-based creation to enable resource configuration
HeyGarrison Jul 18, 2026
19c21a1
remove: drop cloud-run from dax benchmark (code interpreter model, no…
HeyGarrison Jul 20, 2026
23161e2
add: re-add cloud-run to dax benchmark matrix
HeyGarrison Jul 20, 2026
7305e29
fix: bump @computesdk/* to latest versions with timeout forwarding
HeyGarrison Jul 20, 2026
a5caa5d
fix: correctly size upstash and superserve boxes
HeyGarrison Jul 20, 2026
9417d4d
fix: use namespace builtin:base image instead of node:22
HeyGarrison Jul 20, 2026
66ed047
fix: increase E2B sandbox lifespan to 10 minutes
HeyGarrison Jul 20, 2026
69956ec
fix: use templateId instead of template for E2B sandbox creation
HeyGarrison Jul 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions .github/workflows/sandbox-dax-benchmarks.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,7 @@ jobs:
- isorun
- lightning
- modal
- namespace
- northflank
- runloop
- superserve
Expand All @@ -76,6 +77,16 @@ jobs:
else
npm ci
fi
- name: Build E2B template with 8 vCPU / 16 GiB
if: matrix.provider == 'e2b'
env:
E2B_API_KEY: ${{ secrets.E2B_API_KEY }}
run: npx tsx scripts/build-e2b-template.ts
- name: Find Northflank plan for 8 vCPU / 16 GiB
if: matrix.provider == 'northflank'
env:
NORTHFLANK_TOKEN: ${{ secrets.NORTHFLANK_TOKEN }}
run: npx tsx scripts/find-northflank-plan.ts
- name: Clear stale results from checkout
run: rm -rf results/
- name: Run dax benchmark
Expand Down Expand Up @@ -103,6 +114,7 @@ jobs:
MODAL_TOKEN_ID: ${{ secrets.MODAL_TOKEN_ID }}
MODAL_TOKEN_SECRET: ${{ secrets.MODAL_TOKEN_SECRET }}
NORTHFLANK_TOKEN: ${{ secrets.NORTHFLANK_TOKEN }}
NSC_TOKEN: ${{ secrets.NSC_TOKEN }}
NORTHFLANK_PROJECT_ID: ${{ secrets.NORTHFLANK_PROJECT_ID }}
RUNLOOP_API_KEY: ${{ secrets.RUNLOOP_API_KEY }}
SUPERSERVE_API_KEY: ${{ secrets.SUPERSERVE_API_KEY }}
Expand Down
Loading
Loading