Skip to content

duckdb: Parallelise on Partition, not ArrayRef - #9193

Closed
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-split-model
Closed

duckdb: Parallelise on Partition, not ArrayRef#9193
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-split-model

Conversation

@myrrc

@myrrc myrrc commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

TODO

@codspeed-hq

codspeed-hq Bot commented Aug 5, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 21.42%

⚡ 3 improved benchmarks
✅ 1839 untouched benchmarks
⏩ 44 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress[u64, (10000, 1024)] 175 µs 118.4 µs +47.73%
Simulation chunked_canonicalize_into[(1000, 50, 8, 4)] 17.5 ms 15.9 ms +10.1%
Simulation chunked_canonicalize_into[(1000, 50, 8, 16)] 18.7 ms 17 ms +10.05%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-split-model (36c96f7) with develop (406d6a1)2

Open in CodSpeed

Footnotes

  1. 44 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (e0d5f28) during the generation of this report, so 406d6a1 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 36c96f7 vortex-queries 1 Explore Profiling Data
🟢 Done 36c96f7 appian-nvme 1 Explore Profiling Data
🟢 Done 36c96f7 fineweb 1 Explore Profiling Data
🟢 Done 36c96f7 fineweb-s3 1 Explore Profiling Data
🟢 Done 36c96f7 tpch-s3-10 1 Explore Profiling Data
🟢 Done 36c96f7 tpch-s3 1 Explore Profiling Data
🟢 Done 36c96f7 tpch-nvme 1 Explore Profiling Data
🟢 Done 36c96f7 statpopgen 1 Explore Profiling Data
🟢 Done 36c96f7 tpcds-nvme 1 Explore Profiling Data
🟢 Done 36c96f7 clickbench-nvme 1 Explore Profiling Data
🟢 Done 36c96f7 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 36c96f7 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 36c96f7 polarsignals 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +123.9%
Engines: DataFusion No clear signal (+5.1%, low confidence) · DuckDB Likely regression (+376.8%, high confidence)
Vortex (geomean): 2.245x ❌
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.048x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6942601 6525921 1.06
fineweb_q01/datafusion:vortex-file-compressed 31524367 31452833 1.00
fineweb_q02/datafusion:vortex-file-compressed 38170090 35174342 1.09
fineweb_q03/datafusion:vortex-file-compressed 45167592 44801171 1.01
fineweb_q04/datafusion:vortex-file-compressed 209669559 204472957 1.03
fineweb_q05/datafusion:vortex-file-compressed 158477077 157838135 1.00
fineweb_q06/datafusion:vortex-file-compressed 42082816 39399427 1.07
fineweb_q07/datafusion:vortex-file-compressed 43121021 42702728 1.01
fineweb_q08/datafusion:vortex-file-compressed 🚨 19829701 16820434 1.18
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 8706619 8525276 1.02
fineweb_q01/datafusion:parquet 197561526 198298093 1.00
fineweb_q02/datafusion:parquet 201269327 198224645 1.02
fineweb_q03/datafusion:parquet 189065486 192427422 0.98
fineweb_q04/datafusion:parquet 206986353 208779858 0.99
fineweb_q05/datafusion:parquet 206039430 206263417 1.00
fineweb_q06/datafusion:parquet 200300286 202171184 0.99
fineweb_q07/datafusion:parquet 191790865 197257803 0.97
fineweb_q08/datafusion:parquet 190913086 189642641 1.01
duckdb / vortex-file-compressed / ns (4.809x ❌, 0↑ 9↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 6396730 3767647 1.70
fineweb_q01/duckdb:vortex-file-compressed 🚨 171231015 42852867 4.00
fineweb_q02/duckdb:vortex-file-compressed 🚨 237542427 46978476 5.06
fineweb_q03/duckdb:vortex-file-compressed 🚨 449859727 69211499 6.50
fineweb_q04/duckdb:vortex-file-compressed 🚨 2319167647 309092870 7.50
fineweb_q05/duckdb:vortex-file-compressed 🚨 1868388850 221902061 8.42
fineweb_q06/duckdb:vortex-file-compressed 🚨 355000439 68202009 5.21
fineweb_q07/duckdb:vortex-file-compressed 🚨 604249158 75904824 7.96
fineweb_q08/duckdb:vortex-file-compressed 🚨 73367059 31100197 2.36
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36125282 36342537 0.99
fineweb_q01/duckdb:parquet 77599317 76764114 1.01
fineweb_q02/duckdb:parquet 80033060 76772238 1.04
fineweb_q03/duckdb:parquet 207467724 206433055 1.01
fineweb_q04/duckdb:parquet 233646520 232916002 1.00
fineweb_q05/duckdb:parquet 203909000 203418563 1.00
fineweb_q06/duckdb:parquet 143340818 143099531 1.00
fineweb_q07/duckdb:parquet 145587200 143158910 1.02
fineweb_q08/duckdb:parquet 39012030 38932498 1.00

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.054x ➖


datafusion / vortex-file-compressed / ns (1.054x ➖, 0↑ 2↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123483512 133528041 0.92
polarsignals_q01/datafusion:vortex-file-compressed 164763503 163266929 1.01
polarsignals_q02/datafusion:vortex-file-compressed 23150801 21606678 1.07
polarsignals_q03/datafusion:vortex-file-compressed 168301710 162955608 1.03
polarsignals_q04/datafusion:vortex-file-compressed 12427554 11931483 1.04
polarsignals_q05/datafusion:vortex-file-compressed 15568761 14173832 1.10
polarsignals_q06/datafusion:vortex-file-compressed 🚨 23470895 21243769 1.10
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14917484 12831842 1.16
polarsignals_q08/datafusion:vortex-file-compressed 280742262 273350347 1.03
polarsignals_q09/datafusion:vortex-file-compressed 11954325 10987224 1.09

No file size changes detected.

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +82.0%
Engines: DataFusion No clear signal (+3.2%, environment too noisy confidence) · DuckDB Likely regression (+220.7%, high confidence)
Vortex (geomean): 1.826x ❌
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.038x ➖, 0↑ 2↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 47879220 46987907 1.02
tpch_q02/datafusion:vortex-file-compressed 22854341 21408057 1.07
tpch_q03/datafusion:vortex-file-compressed 33706187 32544475 1.04
tpch_q04/datafusion:vortex-file-compressed 20711353 19139728 1.08
tpch_q05/datafusion:vortex-file-compressed 51297859 51144964 1.00
tpch_q06/datafusion:vortex-file-compressed 11135422 10706123 1.04
tpch_q07/datafusion:vortex-file-compressed 59192463 58275977 1.02
tpch_q08/datafusion:vortex-file-compressed 50805595 48959574 1.04
tpch_q09/datafusion:vortex-file-compressed 56195636 54539906 1.03
tpch_q10/datafusion:vortex-file-compressed 33375905 31615855 1.06
tpch_q11/datafusion:vortex-file-compressed 🚨 18191091 16295251 1.12
tpch_q12/datafusion:vortex-file-compressed 30150705 29358846 1.03
tpch_q13/datafusion:vortex-file-compressed 25607811 24868552 1.03
tpch_q14/datafusion:vortex-file-compressed 18642971 17905492 1.04
tpch_q15/datafusion:vortex-file-compressed 27180911 26340728 1.03
tpch_q16/datafusion:vortex-file-compressed 22976492 22098371 1.04
tpch_q17/datafusion:vortex-file-compressed 60209101 61518571 0.98
tpch_q18/datafusion:vortex-file-compressed 71221254 71485928 1.00
tpch_q19/datafusion:vortex-file-compressed 🚨 23903828 21360689 1.12
tpch_q20/datafusion:vortex-file-compressed 33370850 32075732 1.04
tpch_q21/datafusion:vortex-file-compressed 72152215 69716274 1.03
tpch_q22/datafusion:vortex-file-compressed 12798518 12676794 1.01
datafusion / parquet / ns (1.006x ➖, 1↑ 2↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 110566879 112353493 0.98
tpch_q02/datafusion:parquet 71528910 70114567 1.02
tpch_q03/datafusion:parquet 105583937 99917863 1.06
tpch_q04/datafusion:parquet 49337026 50724581 0.97
tpch_q05/datafusion:parquet 128143015 128616815 1.00
tpch_q06/datafusion:parquet 🚨 47676220 39838542 1.20
tpch_q07/datafusion:parquet 🚨 136635304 123621325 1.11
tpch_q08/datafusion:parquet 128621978 131624191 0.98
tpch_q09/datafusion:parquet 163731644 154696283 1.06
tpch_q10/datafusion:parquet 126213348 117568587 1.07
tpch_q11/datafusion:parquet 49457209 50755630 0.97
tpch_q12/datafusion:parquet 93615383 103386999 0.91
tpch_q13/datafusion:parquet 227943726 225444579 1.01
tpch_q14/datafusion:parquet 🚀 48288870 53992254 0.89
tpch_q15/datafusion:parquet 69686639 69656422 1.00
tpch_q16/datafusion:parquet 49465818 50203407 0.99
tpch_q17/datafusion:parquet 150099541 158076690 0.95
tpch_q18/datafusion:parquet 182159230 176816739 1.03
tpch_q19/datafusion:parquet 81669696 89082919 0.92
tpch_q20/datafusion:parquet 91978211 88050847 1.04
tpch_q21/datafusion:parquet 171201170 172563601 0.99
tpch_q22/datafusion:parquet 56801515 55475909 1.02
duckdb / vortex-file-compressed / ns (3.210x ❌, 0↑ 22↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 243346543 24100709 10.10
tpch_q02/duckdb:vortex-file-compressed 🚨 48276753 38517527 1.25
tpch_q03/duckdb:vortex-file-compressed 🚨 127122077 41399942 3.07
tpch_q04/duckdb:vortex-file-compressed 🚨 153898822 34325602 4.48
tpch_q05/duckdb:vortex-file-compressed 🚨 159590329 45726746 3.49
tpch_q06/duckdb:vortex-file-compressed 🚨 36884685 12706913 2.90
tpch_q07/duckdb:vortex-file-compressed 🚨 136138292 45864735 2.97
tpch_q08/duckdb:vortex-file-compressed 🚨 129515397 54641272 2.37
tpch_q09/duckdb:vortex-file-compressed 🚨 398413940 64177119 6.21
tpch_q10/duckdb:vortex-file-compressed 🚨 199072382 54281984 3.67
tpch_q11/duckdb:vortex-file-compressed 🚨 30130880 20586813 1.46
tpch_q12/duckdb:vortex-file-compressed 🚨 99249102 30341927 3.27
tpch_q13/duckdb:vortex-file-compressed 🚨 341510397 47273426 7.22
tpch_q14/duckdb:vortex-file-compressed 🚨 49472162 23903459 2.07
tpch_q15/duckdb:vortex-file-compressed 🚨 92642544 20855925 4.44
tpch_q16/duckdb:vortex-file-compressed 🚨 62160085 32192709 1.93
tpch_q17/duckdb:vortex-file-compressed 🚨 97128714 34432591 2.82
tpch_q18/duckdb:vortex-file-compressed 🚨 315728475 56132075 5.62
tpch_q19/duckdb:vortex-file-compressed 🚨 69797591 37915287 1.84
tpch_q20/duckdb:vortex-file-compressed 🚨 164947872 41240051 4.00
tpch_q21/duckdb:vortex-file-compressed 🚨 443643614 126104589 3.52
tpch_q22/duckdb:vortex-file-compressed 🚨 43030576 22078974 1.95
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81483856 81692058 1.00
tpch_q02/duckdb:parquet 46619302 45904568 1.02
tpch_q03/duckdb:parquet 80332290 80643209 1.00
tpch_q04/duckdb:parquet 57792180 57774408 1.00
tpch_q05/duckdb:parquet 78383618 78695487 1.00
tpch_q06/duckdb:parquet 25066697 24865399 1.01
tpch_q07/duckdb:parquet 80527909 79921794 1.01
tpch_q08/duckdb:parquet 95838340 96074114 1.00
tpch_q09/duckdb:parquet 148414598 148063679 1.00
tpch_q10/duckdb:parquet 141518753 142559083 0.99
tpch_q11/duckdb:parquet 25445237 25390321 1.00
tpch_q12/duckdb:parquet 52901655 53345486 0.99
tpch_q13/duckdb:parquet 284794695 288714851 0.99
tpch_q14/duckdb:parquet 56172431 55960201 1.00
tpch_q15/duckdb:parquet 30663373 30563311 1.00
tpch_q16/duckdb:parquet 67415438 66265805 1.02
tpch_q17/duckdb:parquet 57963590 57924429 1.00
tpch_q18/duckdb:parquet 127813549 127266773 1.00
tpch_q19/duckdb:parquet 77706306 77399682 1.00
tpch_q20/duckdb:parquet 77248736 77123409 1.00
tpch_q21/duckdb:parquet 187819022 190251093 0.99
tpch_q22/duckdb:parquet 64244394 64055328 1.00

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.06 KB 0 B 6.06 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.68 KB 0 B 496.68 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +198.8%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB Likely regression (+783.3%, high confidence)
Vortex (geomean): 3.004x ❌
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 359253369 360926041 1.00
tpch_q02/datafusion:vortex-file-compressed 106602315 104468431 1.02
tpch_q03/datafusion:vortex-file-compressed 187123800 183984504 1.02
tpch_q04/datafusion:vortex-file-compressed 100161704 99334930 1.01
tpch_q05/datafusion:vortex-file-compressed 298139994 305618080 0.98
tpch_q06/datafusion:vortex-file-compressed 50994879 50620645 1.01
tpch_q07/datafusion:vortex-file-compressed 397075638 393877044 1.01
tpch_q08/datafusion:vortex-file-compressed 322418430 321854806 1.00
tpch_q09/datafusion:vortex-file-compressed 515490064 502570657 1.03
tpch_q10/datafusion:vortex-file-compressed 215222709 212198544 1.01
tpch_q11/datafusion:vortex-file-compressed 80065761 77483281 1.03
tpch_q12/datafusion:vortex-file-compressed 119794403 124194037 0.96
tpch_q13/datafusion:vortex-file-compressed 125870696 125859196 1.00
tpch_q14/datafusion:vortex-file-compressed 66929072 64581259 1.04
tpch_q15/datafusion:vortex-file-compressed 119975322 123433755 0.97
tpch_q16/datafusion:vortex-file-compressed 75825741 72039938 1.05
tpch_q17/datafusion:vortex-file-compressed 474932069 481245632 0.99
tpch_q18/datafusion:vortex-file-compressed 673140374 683840230 0.98
tpch_q19/datafusion:vortex-file-compressed 98045779 90400207 1.08
tpch_q20/datafusion:vortex-file-compressed 157465304 159443481 0.99
tpch_q21/datafusion:vortex-file-compressed 548416280 543102147 1.01
tpch_q22/datafusion:vortex-file-compressed 49719563 48732924 1.02
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 324707363 323980073 1.00
tpch_q02/datafusion:parquet 215560671 223304226 0.97
tpch_q03/datafusion:parquet 233086781 230803378 1.01
tpch_q04/datafusion:parquet 101570115 99874130 1.02
tpch_q05/datafusion:parquet 361021279 358427563 1.01
tpch_q06/datafusion:parquet 77352593 75716573 1.02
tpch_q07/datafusion:parquet 507417657 513315318 0.99
tpch_q08/datafusion:parquet 402929822 408418851 0.99
tpch_q09/datafusion:parquet 671226576 678457289 0.99
tpch_q10/datafusion:parquet 548515898 547410612 1.00
tpch_q11/datafusion:parquet 151704637 156022744 0.97
tpch_q12/datafusion:parquet 150288440 152257422 0.99
tpch_q13/datafusion:parquet 355659463 354494851 1.00
tpch_q14/datafusion:parquet 118610760 117734613 1.01
tpch_q15/datafusion:parquet 194370547 189513050 1.03
tpch_q16/datafusion:parquet 139923527 140945942 0.99
tpch_q17/datafusion:parquet 502942842 506156947 0.99
tpch_q18/datafusion:parquet 691892865 700166222 0.99
tpch_q19/datafusion:parquet 201437331 195722924 1.03
tpch_q20/datafusion:parquet 305623952 309906666 0.99
tpch_q21/datafusion:parquet 549376320 551489207 1.00
tpch_q22/datafusion:parquet 259338116 260940606 0.99
duckdb / vortex-file-compressed / ns (8.943x ❌, 0↑ 22↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 2288072004 90984508 25.15
tpch_q02/duckdb:vortex-file-compressed 🚨 283471928 75022956 3.78
tpch_q03/duckdb:vortex-file-compressed 🚨 1361842722 140568431 9.69
tpch_q04/duckdb:vortex-file-compressed 🚨 1409705976 170096128 8.29
tpch_q05/duckdb:vortex-file-compressed 🚨 1515295715 152544346 9.93
tpch_q06/duckdb:vortex-file-compressed 🚨 348719627 40546183 8.60
tpch_q07/duckdb:vortex-file-compressed 🚨 1432644244 141303328 10.14
tpch_q08/duckdb:vortex-file-compressed 🚨 1663064390 186659128 8.91
tpch_q09/duckdb:vortex-file-compressed 🚨 5381560142 317501858 16.95
tpch_q10/duckdb:vortex-file-compressed 🚨 1740824089 227420931 7.65
tpch_q11/duckdb:vortex-file-compressed 🚨 144510200 41995414 3.44
tpch_q12/duckdb:vortex-file-compressed 🚨 921805987 118452972 7.78
tpch_q13/duckdb:vortex-file-compressed 🚨 3673231296 166110668 22.11
tpch_q14/duckdb:vortex-file-compressed 🚨 392140136 62394353 6.28
tpch_q15/duckdb:vortex-file-compressed 🚨 952505266 92759600 10.27
tpch_q16/duckdb:vortex-file-compressed 🚨 491011200 87327800 5.62
tpch_q17/duckdb:vortex-file-compressed 🚨 1100759234 113512351 9.70
tpch_q18/duckdb:vortex-file-compressed 🚨 2686612277 263957027 10.18
tpch_q19/duckdb:vortex-file-compressed 🚨 603701035 87902428 6.87
tpch_q20/duckdb:vortex-file-compressed 🚨 1551372961 152552090 10.17
tpch_q21/duckdb:vortex-file-compressed 🚨 4727001672 491229502 9.62
tpch_q22/duckdb:vortex-file-compressed 🚨 606781973 77236664 7.86
duckdb / parquet / ns (1.012x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 129708982 111114325 1.17
tpch_q02/duckdb:parquet 99389886 100324533 0.99
tpch_q03/duckdb:parquet 172281343 166097513 1.04
tpch_q04/duckdb:parquet 117534020 119390377 0.98
tpch_q05/duckdb:parquet 190518410 185869114 1.03
tpch_q06/duckdb:parquet 57947573 57839749 1.00
tpch_q07/duckdb:parquet 148421098 151508094 0.98
tpch_q08/duckdb:parquet 219013182 218561562 1.00
tpch_q09/duckdb:parquet 347315422 348163454 1.00
tpch_q10/duckdb:parquet 654845464 652791241 1.00
tpch_q11/duckdb:parquet 41472775 41027932 1.01
tpch_q12/duckdb:parquet 121533464 119820900 1.01
tpch_q13/duckdb:parquet 399060593 400453463 1.00
tpch_q14/duckdb:parquet 152208813 152795556 1.00
tpch_q15/duckdb:parquet 78772051 77997588 1.01
tpch_q16/duckdb:parquet 154907096 153902040 1.01
tpch_q17/duckdb:parquet 126490045 116160289 1.09
tpch_q18/duckdb:parquet 283879196 279157000 1.02
tpch_q19/duckdb:parquet 222952507 228656667 0.98
tpch_q20/duckdb:parquet 196286084 197783337 0.99
tpch_q21/duckdb:parquet 436773243 437673442 1.00
tpch_q22/duckdb:parquet 335082455 336879475 0.99

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.06 KB 0 B 6.06 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +19.1%
Engines: DataFusion No clear signal (+15.0%, environment too noisy confidence) · DuckDB No clear signal (+23.4%, high confidence)
Vortex (geomean): 1.177x ❌
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.127x ❌, 0↑ 1↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚨 754588919 243294460 3.10
clickbench-sorted_q24/datafusion:vortex-file-compressed 21918356 22366014 0.98
clickbench-sorted_q26/datafusion:vortex-file-compressed 21701576 23689875 0.92
clickbench-sorted_q36/datafusion:vortex-file-compressed 48763830 48243633 1.01
clickbench-sorted_q37/datafusion:vortex-file-compressed 36900087 35591612 1.04
clickbench-sorted_q38/datafusion:vortex-file-compressed 35474386 35357187 1.00
clickbench-sorted_q39/datafusion:vortex-file-compressed 94056527 88869253 1.06
clickbench-sorted_q40/datafusion:vortex-file-compressed 19366594 18913178 1.02
clickbench-sorted_q41/datafusion:vortex-file-compressed 19107044 18900706 1.01
clickbench-sorted_q42/datafusion:vortex-file-compressed 15498679 15085641 1.03
datafusion / parquet / ns (0.980x ➖, 1↑ 1↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2945063366 2936405293 1.00
clickbench-sorted_q24/datafusion:parquet 🚨 47807701 33080749 1.45
clickbench-sorted_q26/datafusion:parquet 🚀 33061002 61976280 0.53
clickbench-sorted_q36/datafusion:parquet 181778074 166552596 1.09
clickbench-sorted_q37/datafusion:parquet 111582681 105230684 1.06
clickbench-sorted_q38/datafusion:parquet 165541980 169260922 0.98
clickbench-sorted_q39/datafusion:parquet 299083910 315969965 0.95
clickbench-sorted_q40/datafusion:parquet 64666307 66569079 0.97
clickbench-sorted_q41/datafusion:parquet 62038769 62609372 0.99
clickbench-sorted_q42/datafusion:parquet 36024324 35317863 1.02
duckdb / vortex-file-compressed / ns (1.230x ❌, 2↑ 7↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚀 208299220 236503347 0.88
clickbench-sorted_q24/duckdb:vortex-file-compressed 34494524 37715021 0.91
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚀 43653071 66862358 0.65
clickbench-sorted_q36/duckdb:vortex-file-compressed 🚨 126459088 65545481 1.93
clickbench-sorted_q37/duckdb:vortex-file-compressed 🚨 89343437 53962873 1.66
clickbench-sorted_q38/duckdb:vortex-file-compressed 🚨 92533660 61304775 1.51
clickbench-sorted_q39/duckdb:vortex-file-compressed 🚨 195218895 110321185 1.77
clickbench-sorted_q40/duckdb:vortex-file-compressed 🚨 46327703 38727235 1.20
clickbench-sorted_q41/duckdb:vortex-file-compressed 🚨 46647922 37342540 1.25
clickbench-sorted_q42/duckdb:vortex-file-compressed 🚨 36208674 30712782 1.18
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 229785655 230232587 1.00
clickbench-sorted_q24/duckdb:parquet 31388753 30037414 1.04
clickbench-sorted_q26/duckdb:parquet 23958262 23413127 1.02
clickbench-sorted_q36/duckdb:parquet 67974685 67955057 1.00
clickbench-sorted_q37/duckdb:parquet 55179389 59100741 0.93
clickbench-sorted_q38/duckdb:parquet 61292273 61262337 1.00
clickbench-sorted_q39/duckdb:parquet 107766089 107585036 1.00
clickbench-sorted_q40/duckdb:parquet 28784336 29883906 0.96
clickbench-sorted_q41/duckdb:parquet 28476079 29151899 0.98
clickbench-sorted_q42/duckdb:parquet 20839245 20278228 1.03

File Size Changes (201 files changed, -42.8% overall, 50↑ 151↓)
File Scale Format Base HEAD Change %
hits_064.vortex 1.0 vortex-file-compressed 190.98 MB 194.17 MB +3.20 MB +1.7%
hits_038.vortex 1.0 vortex-file-compressed 190.08 MB 192.21 MB +2.13 MB +1.1%
hits_050.vortex 1.0 vortex-file-compressed 160.17 MB 161.13 MB +984.45 KB +0.6%
hits_070.vortex 1.0 vortex-file-compressed 198.92 MB 200.01 MB +1.08 MB +0.5%
hits_024.vortex 1.0 vortex-file-compressed 160.56 MB 161.20 MB +650.31 KB +0.4%
hits_092.vortex 1.0 vortex-file-compressed 199.49 MB 200.12 MB +637.47 KB +0.3%
hits_020.vortex 1.0 vortex-file-compressed 160.17 MB 160.64 MB +479.48 KB +0.3%
hits_042.vortex 1.0 vortex-file-compressed 201.56 MB 202.09 MB +542.91 KB +0.3%
hits_048.vortex 1.0 vortex-file-compressed 199.56 MB 200.07 MB +523.67 KB +0.3%
hits_068.vortex 1.0 vortex-file-compressed 160.90 MB 161.29 MB +394.90 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.44 MB 180.84 MB +411.48 KB +0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.80 MB 191.22 MB +432.33 KB +0.2%
hits_083.vortex 1.0 vortex-file-compressed 157.14 MB 157.44 MB +299.87 KB +0.2%
hits_062.vortex 1.0 vortex-file-compressed 170.59 MB 170.90 MB +318.39 KB +0.2%
hits_027.vortex 1.0 vortex-file-compressed 190.00 MB 190.33 MB +339.70 KB +0.2%
hits_015.vortex 1.0 vortex-file-compressed 131.05 MB 131.25 MB +203.42 KB +0.2%
hits_090.vortex 1.0 vortex-file-compressed 194.60 MB 194.87 MB +269.62 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.50 MB 131.66 MB +166.42 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.29 MB 172.49 MB +206.48 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.94 MB 131.07 MB +137.80 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.82 MB 171.99 MB +174.80 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.93 MB 169.08 MB +158.99 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.13 MB 172.28 MB +157.42 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.09 MB 161.23 MB +144.34 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.16 MB 195.33 MB +168.47 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.05 MB 161.18 MB +131.57 KB +0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.92 MB 190.07 MB +154.31 KB +0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.32 MB 199.47 MB +159.55 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.46 MB 167.58 MB +125.80 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.60 MB 172.70 MB +104.41 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.47 MB 154.55 MB +88.41 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.21 MB 101.26 MB +57.23 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.54 MB 155.62 MB +85.86 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.79 MB 131.85 MB +66.51 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 199.10 MB 199.20 MB +95.63 KB +0.0%
hits_008.vortex 1.0 vortex-file-compressed 140.11 MB 140.17 MB +59.02 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 199.41 MB 199.48 MB +67.36 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 198.98 MB 199.05 MB +65.91 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.86 MB 160.91 MB +49.93 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.35 MB 161.40 MB +49.64 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 199.99 MB 200.04 MB +58.22 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.62 MB 131.65 MB +30.24 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.82 MB 146.85 MB +32.17 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 200.13 MB 200.16 MB +37.41 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.75 MB 131.76 MB +19.45 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.11 MB 160.12 MB +19.02 KB +0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.62 MB 172.63 MB +13.98 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.98 MB 188.99 MB +12.82 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.63 MB 154.64 MB +9.78 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.90 MB 130.90 MB +312 B +0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.46 MB 131.45 MB 4.12 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.41 MB 126.39 MB 14.56 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 199.64 MB 199.62 MB 26.28 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.97 MB 131.96 MB 18.59 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.69 MB 131.67 MB 26.78 KB -0.0%
hits_059.vortex 1.0 vortex-file-compressed 199.05 MB 199.00 MB 48.86 KB -0.0%
hits_044.vortex 1.0 vortex-file-compressed 200.10 MB 200.03 MB 69.75 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.56 MB 101.53 MB 37.59 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.70 MB 135.65 MB 50.80 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.84 MB 199.76 MB 77.52 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 199.76 MB 199.68 MB 78.36 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.15 MB 161.07 MB 76.49 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.93 MB 192.84 MB 94.23 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 192.19 MB 192.10 MB 95.38 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.38 MB 142.31 MB 74.60 KB -0.1%
hits_091.vortex 1.0 vortex-file-compressed 147.06 MB 146.98 MB 78.27 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.62 MB 154.53 MB 90.09 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.92 MB 131.83 MB 83.78 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.24 MB 177.12 MB 115.12 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 160.05 MB 159.94 MB 110.41 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.79 MB 143.68 MB 112.91 KB -0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.97 MB 126.86 MB 106.88 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.19 MB 193.02 MB 169.10 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.50 MB 154.36 MB 141.84 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 172.20 MB 172.03 MB 173.04 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.16 MB 171.99 MB 181.78 KB -0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.68 MB 126.55 MB 134.43 KB -0.1%
hits_082.vortex 1.0 vortex-file-compressed 140.08 MB 139.90 MB 179.19 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.54 MB 154.34 MB 205.63 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.90 MB 131.72 MB 187.05 KB -0.1%
hits_057.vortex 1.0 vortex-file-compressed 160.17 MB 159.94 MB 236.62 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.84 MB 189.51 MB 335.15 KB -0.2%
hits_074.vortex 1.0 vortex-file-compressed 199.66 MB 199.26 MB 408.20 KB -0.2%
hits_079.vortex 1.0 vortex-file-compressed 181.48 MB 181.06 MB 426.31 KB -0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.79 MB 158.41 MB 381.76 KB -0.2%
hits_085.vortex 1.0 vortex-file-compressed 199.61 MB 199.09 MB 531.91 KB -0.3%
hits_072.vortex 1.0 vortex-file-compressed 102.60 MB 102.31 MB 299.87 KB -0.3%
hits_019.vortex 1.0 vortex-file-compressed 141.30 MB 140.86 MB 451.14 KB -0.3%
hits_098.vortex 1.0 vortex-file-compressed 138.22 MB 137.77 MB 452.88 KB -0.3%
hits_028.vortex 1.0 vortex-file-compressed 152.62 MB 152.07 MB 568.95 KB -0.4%
hits_036.vortex 1.0 vortex-file-compressed 172.10 MB 171.46 MB 659.96 KB -0.4%
hits_035.vortex 1.0 vortex-file-compressed 102.88 MB 102.43 MB 455.66 KB -0.4%
hits_076.vortex 1.0 vortex-file-compressed 160.94 MB 160.22 MB 732.81 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 140.80 MB 140.11 MB 710.13 KB -0.5%
hits_003.vortex 1.0 vortex-file-compressed 137.28 MB 136.54 MB 755.66 KB -0.5%
hits_071.vortex 1.0 vortex-file-compressed 141.35 MB 140.42 MB 954.55 KB -0.7%
hits_066.vortex 1.0 vortex-file-compressed 164.54 MB 163.04 MB 1.50 MB -0.9%
hits_049.vortex 1.0 vortex-file-compressed 193.61 MB 191.52 MB 2.09 MB -1.1%
hits_034.vortex 1.0 vortex-file-compressed 183.98 MB 182.00 MB 1.99 MB -1.1%
hits_054.vortex 1.0 vortex-file-compressed 149.78 MB 147.91 MB 1.87 MB -1.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.60 MB 0 B 98.60 MB -100.0%
hits_001.vortex 1.0 vortex-compact 137.73 MB 0 B 137.73 MB -100.0%
hits_002.vortex 1.0 vortex-compact 125.11 MB 0 B 125.11 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.43 MB 0 B 104.43 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.66 MB 0 B 98.66 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.87 MB 0 B 115.87 MB -100.0%
hits_006.vortex 1.0 vortex-compact 96.22 MB 0 B 96.22 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.77 MB 0 B 105.77 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 0 B 75.23 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.35 MB 0 B 123.35 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.80 MB 0 B 152.80 MB -100.0%
hits_012.vortex 1.0 vortex-compact 139.97 MB 0 B 139.97 MB -100.0%
hits_013.vortex 1.0 vortex-compact 125.75 MB 0 B 125.75 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.91 MB 0 B 133.91 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.18 MB 0 B 97.18 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.55 MB 0 B 127.55 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.74 MB 0 B 111.74 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.85 MB 0 B 152.85 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.12 MB 0 B 106.12 MB -100.0%
hits_020.vortex 1.0 vortex-compact 112.21 MB 0 B 112.21 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.64 MB 0 B 110.64 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.22 MB 0 B 153.22 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.69 MB 0 B 142.69 MB -100.0%
hits_024.vortex 1.0 vortex-compact 123.74 MB 0 B 123.74 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.76 MB 0 B 133.76 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.29 MB 0 B 98.29 MB -100.0%
hits_027.vortex 1.0 vortex-compact 137.96 MB 0 B 137.96 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.81 MB 0 B 115.81 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.38 MB 0 B 153.38 MB -100.0%
hits_030.vortex 1.0 vortex-compact 97.97 MB 0 B 97.97 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.74 MB 0 B 111.74 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.35 MB 0 B 153.35 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.39 MB 0 B 133.39 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.96 MB 0 B 75.96 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.40 MB 0 B 133.40 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.83 MB 0 B 132.83 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.54 MB 0 B 139.54 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.21 MB 0 B 124.21 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.44 MB 0 B 110.44 MB -100.0%
hits_041.vortex 1.0 vortex-compact 97.88 MB 0 B 97.88 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.24 MB 0 B 136.24 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.34 MB 0 B 94.34 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.64 MB 0 B 153.64 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.09 MB 0 B 106.09 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.96 MB 0 B 74.96 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.84 MB 0 B 110.84 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.44 MB 0 B 153.44 MB -100.0%
hits_049.vortex 1.0 vortex-compact 140.48 MB 0 B 140.48 MB -100.0%
hits_050.vortex 1.0 vortex-compact 126.17 MB 0 B 126.17 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.00 MB 0 B 134.00 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.04 MB 0 B 98.04 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.58 MB 0 B 138.58 MB -100.0%
hits_054.vortex 1.0 vortex-compact 111.66 MB 0 B 111.66 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.46 MB 0 B 153.46 MB -100.0%
hits_056.vortex 1.0 vortex-compact 100.87 MB 0 B 100.87 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.95 MB 0 B 111.95 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.07 MB 0 B 111.07 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.31 MB 0 B 152.31 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.18 MB 0 B 141.18 MB -100.0%
hits_061.vortex 1.0 vortex-compact 123.88 MB 0 B 123.88 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.86 MB 0 B 132.86 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.19 MB 0 B 98.19 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.04 MB 0 B 140.04 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.54 MB 0 B 125.54 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.53 MB 0 B 117.53 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.26 MB 0 B 98.26 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.43 MB 0 B 112.43 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.83 MB 0 B 99.83 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.63 MB 0 B 153.63 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.18 MB 0 B 106.18 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.62 MB 0 B 75.62 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.19 MB 0 B 134.19 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.18 MB 0 B 153.18 MB -100.0%
hits_075.vortex 1.0 vortex-compact 139.12 MB 0 B 139.12 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.65 MB 0 B 125.65 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.17 MB 0 B 134.17 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.54 MB 0 B 97.54 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.18 MB 0 B 128.18 MB -100.0%
hits_080.vortex 1.0 vortex-compact 94.66 MB 0 B 94.66 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_082.vortex 1.0 vortex-compact 105.78 MB 0 B 105.78 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.16 MB 0 B 110.16 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.68 MB 0 B 110.68 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.50 MB 0 B 153.50 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.86 MB 0 B 140.86 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.56 MB 0 B 125.56 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.12 MB 0 B 134.12 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.76 MB 0 B 98.76 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.27 MB 0 B 141.27 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.32 MB 0 B 112.32 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.45 MB 0 B 153.45 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.60 MB 0 B 98.60 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.77 MB 0 B 110.77 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.65 MB 0 B 110.65 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.35 MB 0 B 153.35 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.26 MB 0 B 140.26 MB -100.0%
hits_098.vortex 1.0 vortex-compact 104.21 MB 0 B 104.21 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.41 MB 0 B 133.41 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (-0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.6%
Engines: DataFusion No clear signal (-4.3%, environment too noisy confidence) · DuckDB No clear signal (+25.4%, environment too noisy confidence)
Vortex (geomean): 1.123x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 254176226 257983672 0.99
tpch_q02/datafusion:vortex-file-compressed 440695527 439966272 1.00
tpch_q03/datafusion:vortex-file-compressed 365888304 354769280 1.03
tpch_q04/datafusion:vortex-file-compressed 187521590 182294617 1.03
tpch_q05/datafusion:vortex-file-compressed 328087773 335410388 0.98
tpch_q06/datafusion:vortex-file-compressed 278063872 249364645 1.12
tpch_q07/datafusion:vortex-file-compressed 371531593 391969037 0.95
tpch_q08/datafusion:vortex-file-compressed 525794044 530233008 0.99
tpch_q09/datafusion:vortex-file-compressed 309492868 333955272 0.93
tpch_q10/datafusion:vortex-file-compressed 360814004 394495235 0.91
tpch_q11/datafusion:vortex-file-compressed 279818569 335962957 0.83
tpch_q12/datafusion:vortex-file-compressed 365988215 344908964 1.06
tpch_q13/datafusion:vortex-file-compressed 107857223 121347496 0.89
tpch_q14/datafusion:vortex-file-compressed 196953920 210914123 0.93
tpch_q15/datafusion:vortex-file-compressed 322033733 326908951 0.99
tpch_q16/datafusion:vortex-file-compressed 237346237 217564704 1.09
tpch_q17/datafusion:vortex-file-compressed 340728993 349960804 0.97
tpch_q18/datafusion:vortex-file-compressed 297788076 297610378 1.00
tpch_q19/datafusion:vortex-file-compressed 453351617 353556212 1.28
tpch_q20/datafusion:vortex-file-compressed 435018580 387608000 1.12
tpch_q21/datafusion:vortex-file-compressed 514399396 467898053 1.10
tpch_q22/datafusion:vortex-file-compressed 137731779 150036520 0.92
datafusion / vortex-compact / ns (0.993x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 254495872 251767304 1.01
tpch_q02/datafusion:vortex-compact 411076828 494892544 0.83
tpch_q03/datafusion:vortex-compact 387966473 365358304 1.06
tpch_q04/datafusion:vortex-compact 169040617 168231071 1.00
tpch_q05/datafusion:vortex-compact 366607358 362446917 1.01
tpch_q06/datafusion:vortex-compact 270638716 337508189 0.80
tpch_q07/datafusion:vortex-compact 436942535 441811645 0.99
tpch_q08/datafusion:vortex-compact 527841921 482088751 1.09
tpch_q09/datafusion:vortex-compact 318033123 327460355 0.97
tpch_q10/datafusion:vortex-compact 392321966 357065736 1.10
tpch_q11/datafusion:vortex-compact 331276144 308081925 1.08
tpch_q12/datafusion:vortex-compact 319072577 409162425 0.78
tpch_q13/datafusion:vortex-compact 120194299 122583747 0.98
tpch_q14/datafusion:vortex-compact 184326314 186208868 0.99
tpch_q15/datafusion:vortex-compact 325909837 299099908 1.09
tpch_q16/datafusion:vortex-compact 187273106 186036437 1.01
tpch_q17/datafusion:vortex-compact 318954733 357485547 0.89
tpch_q18/datafusion:vortex-compact 248312597 276782289 0.90
tpch_q19/datafusion:vortex-compact 401109055 500163191 0.80
tpch_q20/datafusion:vortex-compact 318870391 356387440 0.89
tpch_q21/datafusion:vortex-compact 🚨 824222339 455290978 1.81
tpch_q22/datafusion:vortex-compact 146388329 132378250 1.11
datafusion / parquet / ns (1.041x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 247172837 223517616 1.11
tpch_q02/datafusion:parquet 272467046 307800592 0.89
tpch_q03/datafusion:parquet 295052442 317677094 0.93
tpch_q04/datafusion:parquet 162061687 166733817 0.97
tpch_q05/datafusion:parquet 386646432 376450771 1.03
tpch_q06/datafusion:parquet 149619357 144626261 1.03
tpch_q07/datafusion:parquet 375939454 375588693 1.00
tpch_q08/datafusion:parquet 437370318 441435504 0.99
tpch_q09/datafusion:parquet 465024506 473850185 0.98
tpch_q10/datafusion:parquet 410830696 414644250 0.99
tpch_q11/datafusion:parquet 278829883 278456217 1.00
tpch_q12/datafusion:parquet 238862036 220412440 1.08
tpch_q13/datafusion:parquet 463007875 456664244 1.01
tpch_q14/datafusion:parquet 208425453 168368294 1.24
tpch_q15/datafusion:parquet 366474819 298294051 1.23
tpch_q16/datafusion:parquet 167786199 134921211 1.24
tpch_q17/datafusion:parquet 🚨 405249503 311703632 1.30
tpch_q18/datafusion:parquet 442977898 455534863 0.97
tpch_q19/datafusion:parquet 185021814 183723810 1.01
tpch_q20/datafusion:parquet 271592831 266885228 1.02
tpch_q21/datafusion:parquet 415844900 411124935 1.01
tpch_q22/datafusion:parquet 173187347 175401851 0.99
duckdb / vortex-file-compressed / ns (1.163x ➖, 0↑ 6↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 512836475 261582157 1.96
tpch_q02/duckdb:vortex-file-compressed 627932617 667320192 0.94
tpch_q03/duckdb:vortex-file-compressed 593929502 468955199 1.27
tpch_q04/duckdb:vortex-file-compressed 396856297 314681270 1.26
tpch_q05/duckdb:vortex-file-compressed 572564046 594515838 0.96
tpch_q06/duckdb:vortex-file-compressed 332799886 279904701 1.19
tpch_q07/duckdb:vortex-file-compressed 602428986 589651892 1.02
tpch_q08/duckdb:vortex-file-compressed 748806227 762351119 0.98
tpch_q09/duckdb:vortex-file-compressed 🚨 851392100 600940529 1.42
tpch_q10/duckdb:vortex-file-compressed 610466122 479127771 1.27
tpch_q11/duckdb:vortex-file-compressed 262395369 281092655 0.93
tpch_q12/duckdb:vortex-file-compressed 597974840 526314098 1.14
tpch_q13/duckdb:vortex-file-compressed 🚨 553924084 383867682 1.44
tpch_q14/duckdb:vortex-file-compressed 281210723 278943559 1.01
tpch_q15/duckdb:vortex-file-compressed 🚨 254523812 189887780 1.34
tpch_q16/duckdb:vortex-file-compressed 263618190 255045950 1.03
tpch_q17/duckdb:vortex-file-compressed 450233647 512107128 0.88
tpch_q18/duckdb:vortex-file-compressed 🚨 610835290 422672349 1.45
tpch_q19/duckdb:vortex-file-compressed 401983149 405559530 0.99
tpch_q20/duckdb:vortex-file-compressed 534774459 565645250 0.95
tpch_q21/duckdb:vortex-file-compressed 🚨 1089312850 790369520 1.38
tpch_q22/duckdb:vortex-file-compressed 210628346 163950650 1.28
duckdb / vortex-compact / ns (1.377x ❌, 0↑ 10↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 649844487 240615742 2.70
tpch_q02/duckdb:vortex-compact 563744361 631466938 0.89
tpch_q03/duckdb:vortex-compact 🚨 646869188 468327568 1.38
tpch_q04/duckdb:vortex-compact 🚨 510917541 309239021 1.65
tpch_q05/duckdb:vortex-compact 648567674 642605556 1.01
tpch_q06/duckdb:vortex-compact 356068637 276159151 1.29
tpch_q07/duckdb:vortex-compact 706914628 583991674 1.21
tpch_q08/duckdb:vortex-compact 839515568 699378697 1.20
tpch_q09/duckdb:vortex-compact 🚨 998552854 589973703 1.69
tpch_q10/duckdb:vortex-compact 🚨 699545235 518063208 1.35
tpch_q11/duckdb:vortex-compact 287187258 283062618 1.01
tpch_q12/duckdb:vortex-compact 694015073 559161103 1.24
tpch_q13/duckdb:vortex-compact 🚨 643423891 314812054 2.04
tpch_q14/duckdb:vortex-compact 332978728 267135687 1.25
tpch_q15/duckdb:vortex-compact 🚨 307341211 187437101 1.64
tpch_q16/duckdb:vortex-compact 259893240 226963299 1.15
tpch_q17/duckdb:vortex-compact 546013042 448497099 1.22
tpch_q18/duckdb:vortex-compact 🚨 747596940 343062233 2.18
tpch_q19/duckdb:vortex-compact 487236446 381113197 1.28
tpch_q20/duckdb:vortex-compact 🚨 650378520 487535223 1.33
tpch_q21/duckdb:vortex-compact 🚨 1334626204 793359994 1.68
tpch_q22/duckdb:vortex-compact 190882276 181518159 1.05
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 325342354 348741317 0.93
tpch_q02/duckdb:parquet 698280360 712210776 0.98
tpch_q03/duckdb:parquet 928507928 846286522 1.10
tpch_q04/duckdb:parquet 493141293 510790948 0.97
tpch_q05/duckdb:parquet 995166773 959167330 1.04
tpch_q06/duckdb:parquet 306250109 309010990 0.99
tpch_q07/duckdb:parquet 930663414 1015313834 0.92
tpch_q08/duckdb:parquet 1226995594 1184300317 1.04
tpch_q09/duckdb:parquet 1214639745 1142042198 1.06
tpch_q10/duckdb:parquet 1056434875 1023592275 1.03
tpch_q11/duckdb:parquet 474269881 427398774 1.11
tpch_q12/duckdb:parquet 572396784 555876633 1.03
tpch_q13/duckdb:parquet 852246657 852036422 1.00
tpch_q14/duckdb:parquet 568513914 529857238 1.07
tpch_q15/duckdb:parquet 425280053 523004435 0.81
tpch_q16/duckdb:parquet 518513589 546377557 0.95
tpch_q17/duckdb:parquet 523859564 508509211 1.03
tpch_q18/duckdb:parquet 686406657 633755511 1.08
tpch_q19/duckdb:parquet 658947201 592915552 1.11
tpch_q20/duckdb:parquet 896427827 870769981 1.03
tpch_q21/duckdb:parquet 793407843 815685108 0.97
tpch_q22/duckdb:parquet 470659653 470952344 1.00

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +54.1%
Engines: DataFusion No clear signal (+2.6%, low confidence) · DuckDB Likely regression (+131.3%, environment too noisy confidence)
Vortex (geomean): 1.543x ❌
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.022x ➖, 0↑ 3↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28449522 28946117 0.98
tpcds_q02/datafusion:vortex-file-compressed 49671901 49369723 1.01
tpcds_q03/datafusion:vortex-file-compressed 15315277 14540578 1.05
tpcds_q04/datafusion:vortex-file-compressed 230593473 217755742 1.06
tpcds_q05/datafusion:vortex-file-compressed 65290300 64424380 1.01
tpcds_q06/datafusion:vortex-file-compressed 27450384 28197673 0.97
tpcds_q07/datafusion:vortex-file-compressed 43632604 42883370 1.02
tpcds_q08/datafusion:vortex-file-compressed 34693114 33993125 1.02
tpcds_q09/datafusion:vortex-file-compressed 31639841 29632557 1.07
tpcds_q10/datafusion:vortex-file-compressed 37480889 38048998 0.99
tpcds_q11/datafusion:vortex-file-compressed 119529293 117418336 1.02
tpcds_q12/datafusion:vortex-file-compressed 20864751 20586095 1.01
tpcds_q13/datafusion:vortex-file-compressed 50410712 47409638 1.06
tpcds_q14/datafusion:vortex-file-compressed 211712145 203461821 1.04
tpcds_q15/datafusion:vortex-file-compressed 30058305 29881690 1.01
tpcds_q16/datafusion:vortex-file-compressed 26091417 25518811 1.02
tpcds_q17/datafusion:vortex-file-compressed 72888940 71935104 1.01
tpcds_q18/datafusion:vortex-file-compressed 88424128 91309784 0.97
tpcds_q19/datafusion:vortex-file-compressed 22514370 22040717 1.02
tpcds_q20/datafusion:vortex-file-compressed 🚨 24970360 22589781 1.11
tpcds_q21/datafusion:vortex-file-compressed 35037281 33825788 1.04
tpcds_q22/datafusion:vortex-file-compressed 108632305 120103305 0.90
tpcds_q23/datafusion:vortex-file-compressed 134945425 129886655 1.04
tpcds_q24/datafusion:vortex-file-compressed 96488856 95706840 1.01
tpcds_q25/datafusion:vortex-file-compressed 73949280 73302340 1.01
tpcds_q26/datafusion:vortex-file-compressed 38123506 36812997 1.04
tpcds_q27/datafusion:vortex-file-compressed 94750635 93420298 1.01
tpcds_q28/datafusion:vortex-file-compressed 🚨 35274774 31512740 1.12
tpcds_q29/datafusion:vortex-file-compressed 70209760 69910252 1.00
tpcds_q30/datafusion:vortex-file-compressed 29222591 28513517 1.02
tpcds_q31/datafusion:vortex-file-compressed 81736281 81063132 1.01
tpcds_q32/datafusion:vortex-file-compressed 19979980 20240330 0.99
tpcds_q33/datafusion:vortex-file-compressed 34122981 32926228 1.04
tpcds_q34/datafusion:vortex-file-compressed 27299128 27460654 0.99
tpcds_q35/datafusion:vortex-file-compressed 47232646 46873832 1.01
tpcds_q36/datafusion:vortex-file-compressed 65780683 65380695 1.01
tpcds_q37/datafusion:vortex-file-compressed 20005414 19897937 1.01
tpcds_q38/datafusion:vortex-file-compressed 42574955 42443258 1.00
tpcds_q39/datafusion:vortex-file-compressed 101176593 101272244 1.00
tpcds_q40/datafusion:vortex-file-compressed 32865823 33522635 0.98
tpcds_q41/datafusion:vortex-file-compressed 24797606 24668530 1.01
tpcds_q42/datafusion:vortex-file-compressed 15023987 14608191 1.03
tpcds_q43/datafusion:vortex-file-compressed 19335636 18961491 1.02
tpcds_q44/datafusion:vortex-file-compressed 36139689 36071074 1.00
tpcds_q45/datafusion:vortex-file-compressed 33841896 33389367 1.01
tpcds_q46/datafusion:vortex-file-compressed 36491163 36205907 1.01
tpcds_q47/datafusion:vortex-file-compressed 130518445 131408912 0.99
tpcds_q48/datafusion:vortex-file-compressed 41374755 38873789 1.06
tpcds_q49/datafusion:vortex-file-compressed 74284563 73010257 1.02
tpcds_q50/datafusion:vortex-file-compressed 46309796 46458152 1.00
tpcds_q51/datafusion:vortex-file-compressed 77990341 77071916 1.01
tpcds_q52/datafusion:vortex-file-compressed 15322829 15157487 1.01
tpcds_q53/datafusion:vortex-file-compressed 25272570 24804770 1.02
tpcds_q54/datafusion:vortex-file-compressed 39928187 38872200 1.03
tpcds_q55/datafusion:vortex-file-compressed 14697102 14710475 1.00
tpcds_q56/datafusion:vortex-file-compressed 36152207 34069900 1.06
tpcds_q57/datafusion:vortex-file-compressed 104517149 106677332 0.98
tpcds_q58/datafusion:vortex-file-compressed 63939108 63672254 1.00
tpcds_q59/datafusion:vortex-file-compressed 54992313 52689353 1.04
tpcds_q60/datafusion:vortex-file-compressed 34241183 33420344 1.02
tpcds_q61/datafusion:vortex-file-compressed 39687271 36312180 1.09
tpcds_q62/datafusion:vortex-file-compressed 24984042 24820714 1.01
tpcds_q63/datafusion:vortex-file-compressed 25744645 25180741 1.02
tpcds_q64/datafusion:vortex-file-compressed 496217714 473316189 1.05
tpcds_q65/datafusion:vortex-file-compressed 72475678 71508430 1.01
tpcds_q66/datafusion:vortex-file-compressed 78415307 79903552 0.98
tpcds_q67/datafusion:vortex-file-compressed 122094331 114136716 1.07
tpcds_q68/datafusion:vortex-file-compressed 36883119 34354587 1.07
tpcds_q69/datafusion:vortex-file-compressed 36060562 35986585 1.00
tpcds_q70/datafusion:vortex-file-compressed 117416265 110863534 1.06
tpcds_q71/datafusion:vortex-file-compressed 25258468 23954935 1.05
tpcds_q72/datafusion:vortex-file-compressed 1496100875 1473647082 1.02
tpcds_q73/datafusion:vortex-file-compressed 26003070 24953111 1.04
tpcds_q74/datafusion:vortex-file-compressed 78658323 75693428 1.04
tpcds_q75/datafusion:vortex-file-compressed 🚨 161250965 140882262 1.14
tpcds_q76/datafusion:vortex-file-compressed 43908403 42420372 1.04
tpcds_q77/datafusion:vortex-file-compressed 45287233 44759498 1.01
tpcds_q78/datafusion:vortex-file-compressed 111467149 109247609 1.02
tpcds_q79/datafusion:vortex-file-compressed 29621150 29655195 1.00
tpcds_q80/datafusion:vortex-file-compressed 104919562 101830681 1.03
tpcds_q81/datafusion:vortex-file-compressed 31706270 29430243 1.08
tpcds_q82/datafusion:vortex-file-compressed 21306249 20718608 1.03
tpcds_q83/datafusion:vortex-file-compressed 44005134 43096424 1.02
tpcds_q84/datafusion:vortex-file-compressed 13430907 12724270 1.06
tpcds_q85/datafusion:vortex-file-compressed 115510856 111086973 1.04
tpcds_q86/datafusion:vortex-file-compressed 20175313 19051217 1.06
tpcds_q87/datafusion:vortex-file-compressed 44814802 44583821 1.01
tpcds_q88/datafusion:vortex-file-compressed 56390638 55203644 1.02
tpcds_q89/datafusion:vortex-file-compressed 29170403 28270423 1.03
tpcds_q90/datafusion:vortex-file-compressed 14318964 14362766 1.00
tpcds_q91/datafusion:vortex-file-compressed 21140519 20374945 1.04
tpcds_q92/datafusion:vortex-file-compressed 17693884 17664603 1.00
tpcds_q93/datafusion:vortex-file-compressed 34489247 32998549 1.05
tpcds_q94/datafusion:vortex-file-compressed 24382676 24197053 1.01
tpcds_q95/datafusion:vortex-file-compressed 62902990 65553221 0.96
tpcds_q96/datafusion:vortex-file-compressed 12294156 12350167 1.00
tpcds_q97/datafusion:vortex-file-compressed 29755840 30140447 0.99
tpcds_q98/datafusion:vortex-file-compressed 25956685 25456497 1.02
tpcds_q99/datafusion:vortex-file-compressed 30034097 28127659 1.07
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29134745 31094160 0.94
tpcds_q02/datafusion:parquet 52900063 52645081 1.00
tpcds_q03/datafusion:parquet 17606897 17287919 1.02
tpcds_q04/datafusion:parquet 340034727 342675550 0.99
tpcds_q05/datafusion:parquet 79497538 79537441 1.00
tpcds_q06/datafusion:parquet 31733983 29997032 1.06
tpcds_q07/datafusion:parquet 98388750 97755482 1.01
tpcds_q08/datafusion:parquet 37442448 38095772 0.98
tpcds_q09/datafusion:parquet 36136969 36295084 1.00
tpcds_q10/datafusion:parquet 89361864 89110140 1.00
tpcds_q11/datafusion:parquet 172472761 160910052 1.07
tpcds_q12/datafusion:parquet 22928484 22827374 1.00
tpcds_q13/datafusion:parquet 98221625 97447575 1.01
tpcds_q14/datafusion:parquet 274412343 284847088 0.96
tpcds_q15/datafusion:parquet 37669855 38301270 0.98
tpcds_q16/datafusion:parquet 46931773 49396008 0.95
tpcds_q17/datafusion:parquet 109731305 108143295 1.01
tpcds_q18/datafusion:parquet 131262557 133914004 0.98
tpcds_q19/datafusion:parquet 28335250 28923125 0.98
tpcds_q20/datafusion:parquet 24564488 23486751 1.05
tpcds_q21/datafusion:parquet 22345434 23163721 0.96
tpcds_q22/datafusion:parquet 140501936 140196598 1.00
tpcds_q23/datafusion:parquet 174353856 169500463 1.03
tpcds_q24/datafusion:parquet 136205735 142479365 0.96
tpcds_q25/datafusion:parquet 109835432 106245141 1.03
tpcds_q26/datafusion:parquet 87222556 86312571 1.01
tpcds_q27/datafusion:parquet 155786533 162307863 0.96
tpcds_q28/datafusion:parquet 40988320 41571152 0.99
tpcds_q29/datafusion:parquet 109484243 108025640 1.01
tpcds_q30/datafusion:parquet 42857851 42559035 1.01
tpcds_q31/datafusion:parquet 95290274 93139054 1.02
tpcds_q32/datafusion:parquet 24886834 24317631 1.02
tpcds_q33/datafusion:parquet 36884573 38569007 0.96
tpcds_q34/datafusion:parquet 29588965 30851723 0.96
tpcds_q35/datafusion:parquet 92757029 88778963 1.04
tpcds_q36/datafusion:parquet 67577785 72484746 0.93
tpcds_q37/datafusion:parquet 23308260 25103894 0.93
tpcds_q38/datafusion:parquet 57667396 57426899 1.00
tpcds_q39/datafusion:parquet 83550795 83985923 0.99
tpcds_q40/datafusion:parquet 33505700 33615573 1.00
tpcds_q41/datafusion:parquet 19064870 19010545 1.00
tpcds_q42/datafusion:parquet 16336288 16417718 1.00
tpcds_q43/datafusion:parquet 23424405 22636930 1.03
tpcds_q44/datafusion:parquet 40307626 40032013 1.01
tpcds_q45/datafusion:parquet 45788008 45760276 1.00
tpcds_q46/datafusion:parquet 41764916 41065758 1.02
tpcds_q47/datafusion:parquet 148710990 153606822 0.97
tpcds_q48/datafusion:parquet 89139066 87681494 1.02
tpcds_q49/datafusion:parquet 77535374 80566338 0.96
tpcds_q50/datafusion:parquet 70592814 70494146 1.00
tpcds_q51/datafusion:parquet 82987636 81450676 1.02
tpcds_q52/datafusion:parquet 16719208 17224642 0.97
tpcds_q53/datafusion:parquet 24805781 26718243 0.93
tpcds_q54/datafusion:parquet 45460629 46743526 0.97
tpcds_q55/datafusion:parquet 16053877 16117805 1.00
tpcds_q56/datafusion:parquet 37241652 36343734 1.02
tpcds_q57/datafusion:parquet 122194055 123597597 0.99
tpcds_q58/datafusion:parquet 82948597 83976244 0.99
tpcds_q59/datafusion:parquet 75363112 75959961 0.99
tpcds_q60/datafusion:parquet 36309233 36763088 0.99
tpcds_q61/datafusion:parquet 46122496 47759587 0.97
tpcds_q62/datafusion:parquet 27664710 28345912 0.98
tpcds_q63/datafusion:parquet 25117355 24714764 1.02
tpcds_q64/datafusion:parquet 368209380 366301161 1.01
tpcds_q65/datafusion:parquet 48385385 48819090 0.99
tpcds_q66/datafusion:parquet 87759669 83670563 1.05
tpcds_q67/datafusion:parquet 144369240 150537538 0.96
tpcds_q68/datafusion:parquet 41014723 40080164 1.02
tpcds_q69/datafusion:parquet 84733900 81724280 1.04
tpcds_q70/datafusion:parquet 43594113 44965907 0.97
tpcds_q71/datafusion:parquet 26505762 27249858 0.97
tpcds_q72/datafusion:parquet 447521777 456108568 0.98
tpcds_q73/datafusion:parquet 29970434 27923164 1.07
tpcds_q74/datafusion:parquet 99632711 107922778 0.92
tpcds_q75/datafusion:parquet 176329994 179558465 0.98
tpcds_q76/datafusion:parquet 61506577 62975224 0.98
tpcds_q77/datafusion:parquet 56435949 55459664 1.02
tpcds_q78/datafusion:parquet 129217853 124237512 1.04
tpcds_q79/datafusion:parquet 33870938 35315770 0.96
tpcds_q80/datafusion:parquet 97488097 95701684 1.02
tpcds_q81/datafusion:parquet 38543079 38622258 1.00
tpcds_q82/datafusion:parquet 23703273 23844965 0.99
tpcds_q83/datafusion:parquet 57799499 55800186 1.04
tpcds_q84/datafusion:parquet 48373486 47885513 1.01
tpcds_q85/datafusion:parquet 195339927 196527256 0.99
tpcds_q86/datafusion:parquet 20809046 20799307 1.00
tpcds_q87/datafusion:parquet 61135519 61430307 1.00
tpcds_q88/datafusion:parquet 58997909 63048213 0.94
tpcds_q89/datafusion:parquet 30565798 30418937 1.00
tpcds_q90/datafusion:parquet 18371241 18810559 0.98
tpcds_q91/datafusion:parquet 65917316 65596777 1.00
tpcds_q92/datafusion:parquet 25909666 25269462 1.03
tpcds_q93/datafusion:parquet 35759033 36501125 0.98
tpcds_q94/datafusion:parquet 30407172 30321602 1.00
tpcds_q95/datafusion:parquet 89286203 89363971 1.00
tpcds_q96/datafusion:parquet 17140904 17981979 0.95
tpcds_q97/datafusion:parquet 40283925 38806370 1.04
tpcds_q98/datafusion:parquet 27136003 26670224 1.02
tpcds_q99/datafusion:parquet 35137471 33744197 1.04
duckdb / vortex-file-compressed / ns (2.331x ❌, 1↑ 93↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 37034785 28140907 1.32
tpcds_q02/duckdb:vortex-file-compressed 🚨 82663844 30126567 2.74
tpcds_q03/duckdb:vortex-file-compressed 🚨 75171029 25037383 3.00
tpcds_q04/duckdb:vortex-file-compressed 🚨 315810916 98504765 3.21
tpcds_q05/duckdb:vortex-file-compressed 🚨 54444980 41972358 1.30
tpcds_q06/duckdb:vortex-file-compressed 🚨 82857915 50888205 1.63
tpcds_q07/duckdb:vortex-file-compressed 🚨 104190325 34745753 3.00
tpcds_q08/duckdb:vortex-file-compressed 🚨 74921372 34358253 2.18
tpcds_q09/duckdb:vortex-file-compressed 🚨 30905026 22808767 1.35
tpcds_q10/duckdb:vortex-file-compressed 🚨 135361424 54745849 2.47
tpcds_q11/duckdb:vortex-file-compressed 🚨 259854360 75214793 3.45
tpcds_q12/duckdb:vortex-file-compressed 🚨 24012886 19265097 1.25
tpcds_q13/duckdb:vortex-file-compressed 🚨 199309120 41988961 4.75
tpcds_q14/duckdb:vortex-file-compressed 🚨 322640358 112647598 2.86
tpcds_q15/duckdb:vortex-file-compressed 35561291 35189776 1.01
tpcds_q16/duckdb:vortex-file-compressed 🚨 41361532 34378154 1.20
tpcds_q17/duckdb:vortex-file-compressed 🚨 197290687 51968105 3.80
tpcds_q18/duckdb:vortex-file-compressed 🚨 69276539 50078482 1.38
tpcds_q19/duckdb:vortex-file-compressed 🚨 110632105 41181044 2.69
tpcds_q20/duckdb:vortex-file-compressed 🚨 20180823 17838114 1.13
tpcds_q21/duckdb:vortex-file-compressed 🚨 29666972 21442702 1.38
tpcds_q22/duckdb:vortex-file-compressed 🚨 367176896 67666369 5.43
tpcds_q23/duckdb:vortex-file-compressed 🚨 604510090 75768823 7.98
tpcds_q24/duckdb:vortex-file-compressed 🚨 191244919 52339266 3.65
tpcds_q25/duckdb:vortex-file-compressed 🚨 104712644 51683646 2.03
tpcds_q26/duckdb:vortex-file-compressed 🚨 37753386 23017441 1.64
tpcds_q27/duckdb:vortex-file-compressed 🚨 112556236 32788127 3.43
tpcds_q28/duckdb:vortex-file-compressed 🚨 30801323 14937271 2.06
tpcds_q29/duckdb:vortex-file-compressed 🚨 216569215 57440048 3.77
tpcds_q30/duckdb:vortex-file-compressed 🚨 43833074 35291733 1.24
tpcds_q31/duckdb:vortex-file-compressed 🚨 91001919 36539022 2.49
tpcds_q32/duckdb:vortex-file-compressed 19822301 18755901 1.06
tpcds_q33/duckdb:vortex-file-compressed 🚨 66562324 35256872 1.89
tpcds_q34/duckdb:vortex-file-compressed 🚨 120377852 34082912 3.53
tpcds_q35/duckdb:vortex-file-compressed 🚨 205021176 88371520 2.32
tpcds_q36/duckdb:vortex-file-compressed 🚨 108290840 30568758 3.54
tpcds_q37/duckdb:vortex-file-compressed 🚨 32683981 25813480 1.27
tpcds_q38/duckdb:vortex-file-compressed 🚨 105717256 41866916 2.53
tpcds_q39/duckdb:vortex-file-compressed 🚨 99185274 35282789 2.81
tpcds_q40/duckdb:vortex-file-compressed 25554454 24120508 1.06
tpcds_q41/duckdb:vortex-file-compressed 🚀 14446584 20026837 0.72
tpcds_q42/duckdb:vortex-file-compressed 🚨 43895249 20055570 2.19
tpcds_q43/duckdb:vortex-file-compressed 🚨 106496602 22091269 4.82
tpcds_q44/duckdb:vortex-file-compressed 🚨 51258794 25787650 1.99
tpcds_q45/duckdb:vortex-file-compressed 🚨 47890169 38191398 1.25
tpcds_q46/duckdb:vortex-file-compressed 🚨 190637447 41418388 4.60
tpcds_q47/duckdb:vortex-file-compressed 🚨 234952830 60079029 3.91
tpcds_q48/duckdb:vortex-file-compressed 🚨 175247255 37534294 4.67
tpcds_q49/duckdb:vortex-file-compressed 🚨 100481994 44090825 2.28
tpcds_q50/duckdb:vortex-file-compressed 🚨 178903118 37616972 4.76
tpcds_q51/duckdb:vortex-file-compressed 🚨 168879636 112391377 1.50
tpcds_q52/duckdb:vortex-file-compressed 🚨 42631178 18383565 2.32
tpcds_q53/duckdb:vortex-file-compressed 🚨 82912862 29441202 2.82
tpcds_q54/duckdb:vortex-file-compressed 🚨 72955761 47397493 1.54
tpcds_q55/duckdb:vortex-file-compressed 🚨 44271029 18484936 2.39
tpcds_q56/duckdb:vortex-file-compressed 🚨 68495262 34636295 1.98
tpcds_q57/duckdb:vortex-file-compressed 🚨 72402968 44705992 1.62
tpcds_q58/duckdb:vortex-file-compressed 🚨 54314996 41944835 1.29
tpcds_q59/duckdb:vortex-file-compressed 🚨 263243637 40524534 6.50
tpcds_q60/duckdb:vortex-file-compressed 🚨 81412674 37819603 2.15
tpcds_q61/duckdb:vortex-file-compressed 🚨 114148885 39785682 2.87
tpcds_q62/duckdb:vortex-file-compressed 🚨 40245722 20526746 1.96
tpcds_q63/duckdb:vortex-file-compressed 🚨 79727732 28620972 2.79
tpcds_q64/duckdb:vortex-file-compressed 🚨 404442946 116730002 3.46
tpcds_q65/duckdb:vortex-file-compressed 🚨 110254897 27286472 4.04
tpcds_q66/duckdb:vortex-file-compressed 🚨 55804464 40932555 1.36
tpcds_q67/duckdb:vortex-file-compressed 🚨 814987795 136350280 5.98
tpcds_q68/duckdb:vortex-file-compressed 🚨 193258783 37529449 5.15
tpcds_q69/duckdb:vortex-file-compressed 🚨 138703891 60490641 2.29
tpcds_q70/duckdb:vortex-file-compressed 🚨 177637248 45177201 3.93
tpcds_q71/duckdb:vortex-file-compressed 🚨 61839932 26151288 2.36
tpcds_q72/duckdb:vortex-file-compressed 🚨 1342964073 149436264 8.99
tpcds_q73/duckdb:vortex-file-compressed 🚨 118051477 32218077 3.66
tpcds_q74/duckdb:vortex-file-compressed 🚨 175448089 55512699 3.16
tpcds_q75/duckdb:vortex-file-compressed 🚨 146919263 57967768 2.53
tpcds_q76/duckdb:vortex-file-compressed 🚨 58874796 26942856 2.19
tpcds_q77/duckdb:vortex-file-compressed 🚨 63087890 31578067 2.00
tpcds_q78/duckdb:vortex-file-compressed 🚨 229863565 79845913 2.88
tpcds_q79/duckdb:vortex-file-compressed 🚨 170307549 34170904 4.98
tpcds_q80/duckdb:vortex-file-compressed 🚨 123257994 60665052 2.03
tpcds_q81/duckdb:vortex-file-compressed 44270919 43338943 1.02
tpcds_q82/duckdb:vortex-file-compressed 🚨 106646347 54194260 1.97
tpcds_q83/duckdb:vortex-file-compressed 38489253 41522220 0.93
tpcds_q84/duckdb:vortex-file-compressed 🚨 38184103 28651042 1.33
tpcds_q85/duckdb:vortex-file-compressed 🚨 92781003 57377387 1.62
tpcds_q86/duckdb:vortex-file-compressed 🚨 33127544 18870945 1.76
tpcds_q87/duckdb:vortex-file-compressed 🚨 121763464 51724155 2.35
tpcds_q88/duckdb:vortex-file-compressed 🚨 129962105 64986499 2.00
tpcds_q89/duckdb:vortex-file-compressed 🚨 87600222 27211825 3.22
tpcds_q90/duckdb:vortex-file-compressed 🚨 22974905 18712150 1.23
tpcds_q91/duckdb:vortex-file-compressed 🚨 47002289 35769812 1.31
tpcds_q92/duckdb:vortex-file-compressed 🚨 35270917 24484986 1.44
tpcds_q93/duckdb:vortex-file-compressed 🚨 132384705 30459133 4.35
tpcds_q94/duckdb:vortex-file-compressed 🚨 52297408 35962519 1.45
tpcds_q95/duckdb:vortex-file-compressed 🚨 460451162 153087829 3.01
tpcds_q96/duckdb:vortex-file-compressed 🚨 77053929 18838491 4.09
tpcds_q97/duckdb:vortex-file-compressed 🚨 89558487 47092417 1.90
tpcds_q98/duckdb:vortex-file-compressed 🚨 50968012 23218094 2.20
tpcds_q99/duckdb:vortex-file-compressed 🚨 53906324 25796300 2.09
duckdb / parquet / ns (1.008x ➖, 5↑ 4↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 32374583 33758265 0.96
tpcds_q02/duckdb:parquet 21366479 21540262 0.99
tpcds_q03/duckdb:parquet 12412857 12364224 1.00
tpcds_q04/duckdb:parquet 193155014 195017520 0.99
tpcds_q05/duckdb:parquet 32443864 31863727 1.02
tpcds_q06/duckdb:parquet 37482050 36070499 1.04
tpcds_q07/duckdb:parquet 23085488 21880304 1.06
tpcds_q08/duckdb:parquet 32908672 32596865 1.01
tpcds_q09/duckdb:parquet 30133004 30700565 0.98
tpcds_q10/duckdb:parquet 40664473 42185846 0.96
tpcds_q11/duckdb:parquet 105347258 101219222 1.04
tpcds_q12/duckdb:parquet 17290047 17933808 0.96
tpcds_q13/duckdb:parquet 🚀 33812759 40144502 0.84
tpcds_q14/duckdb:parquet 105350729 105967082 0.99
tpcds_q15/duckdb:parquet 35279401 34941304 1.01
tpcds_q16/duckdb:parquet 27371584 28296995 0.97
tpcds_q17/duckdb:parquet 45516212 44572557 1.02
tpcds_q18/duckdb:parquet 55972255 57381266 0.98
tpcds_q19/duckdb:parquet 33978550 32800333 1.04
tpcds_q20/duckdb:parquet 19342503 19122806 1.01
tpcds_q21/duckdb:parquet 13877456 13972338 0.99
tpcds_q22/duckdb:parquet 🚀 52287158 60641174 0.86
tpcds_q23/duckdb:parquet 71844122 71052543 1.01
tpcds_q24/duckdb:parquet 49003025 47640914 1.03
tpcds_q25/duckdb:parquet 41763849 41322346 1.01
tpcds_q26/duckdb:parquet 43640754 43401866 1.01
tpcds_q27/duckdb:parquet 57468408 54388822 1.06
tpcds_q28/duckdb:parquet 29361979 29527212 0.99
tpcds_q29/duckdb:parquet 44496735 42855986 1.04
tpcds_q30/duckdb:parquet 44048957 44017289 1.00
tpcds_q31/duckdb:parquet 29324466 29376485 1.00
tpcds_q32/duckdb:parquet 15112447 14878328 1.02
tpcds_q33/duckdb:parquet 24936284 24373364 1.02
tpcds_q34/duckdb:parquet 24945823 25115353 0.99
tpcds_q35/duckdb:parquet 68029238 66799695 1.02
tpcds_q36/duckdb:parquet 25092100 24735528 1.01
tpcds_q37/duckdb:parquet 18512087 17477582 1.06
tpcds_q38/duckdb:parquet 40743241 41079991 0.99
tpcds_q39/duckdb:parquet 37695862 37274762 1.01
tpcds_q40/duckdb:parquet 22876630 22554449 1.01
tpcds_q41/duckdb:parquet 10528582 10368116 1.02
tpcds_q42/duckdb:parquet 13018204 12944028 1.01
tpcds_q43/duckdb:parquet 🚀 16436023 19320741 0.85
tpcds_q44/duckdb:parquet 24485276 24682169 0.99
tpcds_q45/duckdb:parquet 32072666 32787162 0.98
tpcds_q46/duckdb:parquet 54719831 51192836 1.07
tpcds_q47/duckdb:parquet 🚨 52934643 48032038 1.10
tpcds_q48/duckdb:parquet 🚀 30224160 35365534 0.85
tpcds_q49/duckdb:parquet 29708105 27927321 1.06
tpcds_q50/duckdb:parquet 🚀 24845806 29010862 0.86
tpcds_q51/duckdb:parquet 96700909 100605726 0.96
tpcds_q52/duckdb:parquet 13385902 13449201 1.00
tpcds_q53/duckdb:parquet 17877436 17723339 1.01
tpcds_q54/duckdb:parquet 31438254 30370280 1.04
tpcds_q55/duckdb:parquet 11658872 11727204 0.99
tpcds_q56/duckdb:parquet 25302018 25538745 0.99
tpcds_q57/duckdb:parquet 43959278 44600677 0.99
tpcds_q58/duckdb:parquet 27473676 27676613 0.99
tpcds_q59/duckdb:parquet 29701566 29872236 0.99
tpcds_q60/duckdb:parquet 25099771 24808252 1.01
tpcds_q61/duckdb:parquet 34257887 32589603 1.05
tpcds_q62/duckdb:parquet 14499001 14651058 0.99
tpcds_q63/duckdb:parquet 17508343 17419381 1.01
tpcds_q64/duckdb:parquet 84053412 81978848 1.03
tpcds_q65/duckdb:parquet 🚨 25226400 21299080 1.18
tpcds_q66/duckdb:parquet 34490185 34578637 1.00
tpcds_q67/duckdb:parquet 125620185 124245472 1.01
tpcds_q68/duckdb:parquet 39157884 39329560 1.00
tpcds_q69/duckdb:parquet 42990513 42448397 1.01
tpcds_q70/duckdb:parquet 29039339 27584945 1.05
tpcds_q71/duckdb:parquet 21787170 21571254 1.01
tpcds_q72/duckdb:parquet 🚨 189617165 122380045 1.55
tpcds_q73/duckdb:parquet 18809802 19053228 0.99
tpcds_q74/duckdb:parquet 148239605 144652298 1.02
tpcds_q75/duckdb:parquet 60328799 60672833 0.99
tpcds_q76/duckdb:parquet 19912258 19316302 1.03
tpcds_q77/duckdb:parquet 26098695 23874490 1.09
tpcds_q78/duckdb:parquet 78954884 78042451 1.01
tpcds_q79/duckdb:parquet 27644033 27911080 0.99
tpcds_q80/duckdb:parquet 49399820 47541293 1.04
tpcds_q81/duckdb:parquet 40850279 41111992 0.99
tpcds_q82/duckdb:parquet 19007868 19352812 0.98
tpcds_q83/duckdb:parquet 22889669 22288010 1.03
tpcds_q84/duckdb:parquet 23706897 23817689 1.00
tpcds_q85/duckdb:parquet 47822528 47551596 1.01
tpcds_q86/duckdb:parquet 14815048 15171164 0.98
tpcds_q87/duckdb:parquet 43636737 44077885 0.99
tpcds_q88/duckdb:parquet 43742496 42524584 1.03
tpcds_q89/duckdb:parquet 17941430 18271423 0.98
tpcds_q90/duckdb:parquet 9684921 9556512 1.01
tpcds_q91/duckdb:parquet 27817851 26801454 1.04
tpcds_q92/duckdb:parquet 15228796 15025765 1.01
tpcds_q93/duckdb:parquet 31881553 31571909 1.01
tpcds_q94/duckdb:parquet 21970391 21836745 1.01
tpcds_q95/duckdb:parquet 136961510 135779009 1.01
tpcds_q96/duckdb:parquet 🚨 11131571 9939926 1.12
tpcds_q97/duckdb:parquet 39488465 39741281 0.99
tpcds_q98/duckdb:parquet 21187272 22019031 0.96
tpcds_q99/duckdb:parquet 23647912 23396159 1.01

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.65 KB 0 B 47.65 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.66 KB 0 B 362.66 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.04 KB 0 B 639.04 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.38 KB 0 B 424.38 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.48 KB 0 B 140.48 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.49 KB 0 B 10.49 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.77 KB 0 B 5.77 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.54 KB 0 B 1000.54 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.52 KB 0 B 50.52 KB -100.0%
reason.vortex 1.0 vortex-compact 6.17 KB 0 B 6.17 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.93 KB 0 B 10.93 KB -100.0%
store.vortex 1.0 vortex-compact 43.44 KB 0 B 43.44 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.80 KB 0 B 96.80 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.35 KB 0 B 22.35 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.21 KB 0 B 25.21 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.39 KB 0 B 42.39 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (+13.9%, medium confidence)
Vortex (geomean): 1.080x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.018x ➖, 1↑ 2↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2007643 1988872 1.01
clickbench_q01/datafusion:vortex-file-compressed 21604479 23088741 0.94
clickbench_q02/datafusion:vortex-file-compressed 31806562 30838239 1.03
clickbench_q03/datafusion:vortex-file-compressed 33584218 33105335 1.01
clickbench_q04/datafusion:vortex-file-compressed 166882835 166784344 1.00
clickbench_q05/datafusion:vortex-file-compressed 220395742 222663646 0.99
clickbench_q06/datafusion:vortex-file-compressed 1962136 1976417 0.99
clickbench_q07/datafusion:vortex-file-compressed 27570752 26459392 1.04
clickbench_q08/datafusion:vortex-file-compressed 226112270 223382913 1.01
clickbench_q09/datafusion:vortex-file-compressed 354222880 348618017 1.02
clickbench_q10/datafusion:vortex-file-compressed 59651356 60343318 0.99
clickbench_q11/datafusion:vortex-file-compressed 68244201 67281514 1.01
clickbench_q12/datafusion:vortex-file-compressed 204701442 210293352 0.97
clickbench_q13/datafusion:vortex-file-compressed 349317820 343566295 1.02
clickbench_q14/datafusion:vortex-file-compressed 209038561 214955561 0.97
clickbench_q15/datafusion:vortex-file-compressed 197063094 197467604 1.00
clickbench_q16/datafusion:vortex-file-compressed 475558340 482714110 0.99
clickbench_q17/datafusion:vortex-file-compressed 480726876 473738081 1.01
clickbench_q18/datafusion:vortex-file-compressed 921957446 928092029 0.99
clickbench_q19/datafusion:vortex-file-compressed 🚨 32416643 28313857 1.14
clickbench_q20/datafusion:vortex-file-compressed 216049716 202145588 1.07
clickbench_q21/datafusion:vortex-file-compressed 280277429 270226381 1.04
clickbench_q22/datafusion:vortex-file-compressed 342342253 341230242 1.00
clickbench_q23/datafusion:vortex-file-compressed 🚨 692210282 413425347 1.67
clickbench_q24/datafusion:vortex-file-compressed 42008438 38705015 1.09
clickbench_q25/datafusion:vortex-file-compressed 🚀 57644387 65348819 0.88
clickbench_q26/datafusion:vortex-file-compressed 37657341 37508615 1.00
clickbench_q27/datafusion:vortex-file-compressed 288734577 287758059 1.00
clickbench_q28/datafusion:vortex-file-compressed 1488563563 1452163068 1.03
clickbench_q29/datafusion:vortex-file-compressed 63614386 66403216 0.96
clickbench_q30/datafusion:vortex-file-compressed 175976638 170070054 1.03
clickbench_q31/datafusion:vortex-file-compressed 211680561 203269646 1.04
clickbench_q32/datafusion:vortex-file-compressed 812288434 843192742 0.96
clickbench_q33/datafusion:vortex-file-compressed 1005346828 998313598 1.01
clickbench_q34/datafusion:vortex-file-compressed 1009391910 991637062 1.02
clickbench_q35/datafusion:vortex-file-compressed 182021712 193952519 0.94
clickbench_q36/datafusion:vortex-file-compressed 59793896 58536999 1.02
clickbench_q37/datafusion:vortex-file-compressed 28580934 29164921 0.98
clickbench_q38/datafusion:vortex-file-compressed 17299086 17143953 1.01
clickbench_q39/datafusion:vortex-file-compressed 131847249 131186257 1.01
clickbench_q40/datafusion:vortex-file-compressed 15273034 14587766 1.05
clickbench_q41/datafusion:vortex-file-compressed 14431576 14091274 1.02
clickbench_q42/datafusion:vortex-file-compressed 13968375 13895344 1.01
datafusion / parquet / ns (1.001x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1954118 1975543 0.99
clickbench_q01/datafusion:parquet 18690166 18348101 1.02
clickbench_q02/datafusion:parquet 32982343 33139743 1.00
clickbench_q03/datafusion:parquet 27666282 25799981 1.07
clickbench_q04/datafusion:parquet 173594874 171310698 1.01
clickbench_q05/datafusion:parquet 226174130 236746142 0.96
clickbench_q06/datafusion:parquet 2134977 2156641 0.99
clickbench_q07/datafusion:parquet 17941055 17771859 1.01
clickbench_q08/datafusion:parquet 230454530 231697332 0.99
clickbench_q09/datafusion:parquet 374074848 375183167 1.00
clickbench_q10/datafusion:parquet 71400096 72897815 0.98
clickbench_q11/datafusion:parquet 90822528 92704194 0.98
clickbench_q12/datafusion:parquet 236580516 243659251 0.97
clickbench_q13/datafusion:parquet 391678725 404179293 0.97
clickbench_q14/datafusion:parquet 254515478 253607461 1.00
clickbench_q15/datafusion:parquet 194027516 193736798 1.00
clickbench_q16/datafusion:parquet 480062236 473031654 1.01
clickbench_q17/datafusion:parquet 474249006 483477501 0.98
clickbench_q18/datafusion:parquet 926501275 969865300 0.96
clickbench_q19/datafusion:parquet 24265108 23860707 1.02
clickbench_q20/datafusion:parquet 462951272 459472770 1.01
clickbench_q21/datafusion:parquet 494365467 496172480 1.00
clickbench_q22/datafusion:parquet 662519338 650460454 1.02
clickbench_q23/datafusion:parquet 2859987579 2861085165 1.00
clickbench_q24/datafusion:parquet 50597270 51111506 0.99
clickbench_q25/datafusion:parquet 97546045 95826239 1.02
clickbench_q26/datafusion:parquet 46905079 49239744 0.95
clickbench_q27/datafusion:parquet 536252913 543327124 0.99
clickbench_q28/datafusion:parquet 1533466364 1530155869 1.00
clickbench_q29/datafusion:parquet 44293586 40772848 1.09
clickbench_q30/datafusion:parquet 244360640 240357107 1.02
clickbench_q31/datafusion:parquet 279506504 275578799 1.01
clickbench_q32/datafusion:parquet 837475729 859191673 0.97
clickbench_q33/datafusion:parquet 1093163202 1086133398 1.01
clickbench_q34/datafusion:parquet 1101354158 1098780201 1.00
clickbench_q35/datafusion:parquet 🚨 189788431 165879645 1.14
clickbench_q36/datafusion:parquet 118860525 118953380 1.00
clickbench_q37/datafusion:parquet 48039759 49337285 0.97
clickbench_q38/datafusion:parquet 67300725 69637537 0.97
clickbench_q39/datafusion:parquet 228599719 233162330 0.98
clickbench_q40/datafusion:parquet 25806843 25345796 1.02
clickbench_q41/datafusion:parquet 24473044 24005584 1.02
clickbench_q42/datafusion:parquet 26372074 26325204 1.00
duckdb / vortex-file-compressed / ns (1.146x ❌, 6↑ 23↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 8522434 11642721 0.73
clickbench_q01/duckdb:vortex-file-compressed 🚀 17834193 19950069 0.89
clickbench_q02/duckdb:vortex-file-compressed 20783296 20664904 1.01
clickbench_q03/duckdb:vortex-file-compressed 30292296 30808744 0.98
clickbench_q04/duckdb:vortex-file-compressed 🚨 157242455 135279051 1.16
clickbench_q05/duckdb:vortex-file-compressed 🚨 236122183 162933475 1.45
clickbench_q06/duckdb:vortex-file-compressed 🚀 17308873 20070078 0.86
clickbench_q07/duckdb:vortex-file-compressed 23837424 22201365 1.07
clickbench_q08/duckdb:vortex-file-compressed 🚨 191719236 167943002 1.14
clickbench_q09/duckdb:vortex-file-compressed 🚨 255980278 203905627 1.26
clickbench_q10/duckdb:vortex-file-compressed 70266180 70440101 1.00
clickbench_q11/duckdb:vortex-file-compressed 75607402 70069520 1.08
clickbench_q12/duckdb:vortex-file-compressed 🚨 211187319 189036190 1.12
clickbench_q13/duckdb:vortex-file-compressed 🚨 398146471 348567956 1.14
clickbench_q14/duckdb:vortex-file-compressed 🚨 260422816 217955442 1.19
clickbench_q15/duckdb:vortex-file-compressed 🚨 218141897 182800506 1.19
clickbench_q16/duckdb:vortex-file-compressed 🚨 456786054 393936084 1.16
clickbench_q17/duckdb:vortex-file-compressed 🚨 480483012 376188870 1.28
clickbench_q18/duckdb:vortex-file-compressed 778658663 735816758 1.06
clickbench_q19/duckdb:vortex-file-compressed 28590977 27626409 1.03
clickbench_q20/duckdb:vortex-file-compressed 257254225 245504026 1.05
clickbench_q21/duckdb:vortex-file-compressed 363542740 352362002 1.03
clickbench_q22/duckdb:vortex-file-compressed 552870878 523715208 1.06
clickbench_q23/duckdb:vortex-file-compressed 224464549 225743478 0.99
clickbench_q24/duckdb:vortex-file-compressed 🚀 44496425 56627159 0.79
clickbench_q25/duckdb:vortex-file-compressed 🚀 67938045 79677877 0.85
clickbench_q26/duckdb:vortex-file-compressed 🚀 40373508 76846233 0.53
clickbench_q27/duckdb:vortex-file-compressed 🚨 229665929 182065097 1.26
clickbench_q28/duckdb:vortex-file-compressed 🚨 2597191242 1636220939 1.59
clickbench_q29/duckdb:vortex-file-compressed 28059742 27869085 1.01
clickbench_q30/duckdb:vortex-file-compressed 🚨 195421094 166882543 1.17
clickbench_q31/duckdb:vortex-file-compressed 🚨 385622563 311141965 1.24
clickbench_q32/duckdb:vortex-file-compressed 950210509 928822734 1.02
clickbench_q33/duckdb:vortex-file-compressed 🚨 1259533011 1130143263 1.11
clickbench_q34/duckdb:vortex-file-compressed 1265611167 1157070358 1.09
clickbench_q35/duckdb:vortex-file-compressed 🚨 251174344 209541174 1.20
clickbench_q36/duckdb:vortex-file-compressed 🚨 86116724 38455827 2.24
clickbench_q37/duckdb:vortex-file-compressed 🚨 40058175 26422740 1.52
clickbench_q38/duckdb:vortex-file-compressed 🚨 53325366 32157193 1.66
clickbench_q39/duckdb:vortex-file-compressed 🚨 183551085 51394091 3.57
clickbench_q40/duckdb:vortex-file-compressed 🚨 31964201 28800730 1.11
clickbench_q41/duckdb:vortex-file-compressed 🚨 32996925 27550135 1.20
clickbench_q42/duckdb:vortex-file-compressed 🚨 43453245 26674816 1.63
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base e0d5f28 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 17313434 15939468 1.09
clickbench_q01/duckdb:parquet 16679271 18432639 0.90
clickbench_q02/duckdb:parquet 24925103 24303012 1.03
clickbench_q03/duckdb:parquet 28006571 26811283 1.04
clickbench_q04/duckdb:parquet 132296193 131212960 1.01
clickbench_q05/duckdb:parquet 193826347 179455046 1.08
clickbench_q06/duckdb:parquet 22303850 23301559 0.96
clickbench_q07/duckdb:parquet 19289452 18757574 1.03
clickbench_q08/duckdb:parquet 162817450 163501208 1.00
clickbench_q09/duckdb:parquet 234027020 229609800 1.02
clickbench_q10/duckdb:parquet 57108005 56447445 1.01
clickbench_q11/duckdb:parquet 66429393 67199185 0.99
clickbench_q12/duckdb:parquet 176650492 175144643 1.01
clickbench_q13/duckdb:parquet 306033278 306527246 1.00
clickbench_q14/duckdb:parquet 187027530 187722876 1.00
clickbench_q15/duckdb:parquet 183416654 186019845 0.99
clickbench_q16/duckdb:parquet 359498679 357964173 1.00
clickbench_q17/duckdb:parquet 366584717 363648522 1.01
clickbench_q18/duckdb:parquet 690974689 679723981 1.02
clickbench_q19/duckdb:parquet 21575676 20657000 1.04
clickbench_q20/duckdb:parquet 266160140 259020346 1.03
clickbench_q21/duckdb:parquet 321618103 325967908 0.99
clickbench_q22/duckdb:parquet 468950260 469508375 1.00
clickbench_q23/duckdb:parquet 258602905 242486171 1.07
clickbench_q24/duckdb:parquet 68609095 67826044 1.01
clickbench_q25/duckdb:parquet 70910005 72620933 0.98
clickbench_q26/duckdb:parquet 51258081 48831648 1.05
clickbench_q27/duckdb:parquet 280069628 274808897 1.02
clickbench_q28/duckdb:parquet 1728969109 1707246984 1.01
clickbench_q29/duckdb:parquet 27884452 27736232 1.01
clickbench_q30/duckdb:parquet 178482369 174569622 1.02
clickbench_q31/duckdb:parquet 310190980 305499887 1.02
clickbench_q32/duckdb:parquet 904936277 914547737 0.99
clickbench_q33/duckdb:parquet 781269847 787310046 0.99
clickbench_q34/duckdb:parquet 795423110 794393350 1.00
clickbench_q35/duckdb:parquet 210092727 207633448 1.01
clickbench_q36/duckdb:parquet 49271622 50459752 0.98
clickbench_q37/duckdb:parquet 36670315 36657816 1.00
clickbench_q38/duckdb:parquet 37721249 39350423 0.96
clickbench_q39/duckdb:parquet 87354183 87961074 0.99
clickbench_q40/duckdb:parquet 19747867 20262195 0.97
clickbench_q41/duckdb:parquet 19884398 19271985 1.03
clickbench_q42/duckdb:parquet 22448672 23692885 0.95

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: Likely regression (high confidence)
Attributed Vortex impact: +294.7%
Engines: DuckDB Likely regression (+294.7%, high confidence)
Vortex (geomean): 3.975x ❌
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +190.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (3.975x ❌, 1↑ 9↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13124221 14074140 0.93
statpopgen_q01/duckdb:vortex-file-compressed 🚀 13183302 14927821 0.88
statpopgen_q02/duckdb:vortex-file-compressed 🚨 3982688205 611530370 6.51
statpopgen_q03/duckdb:vortex-file-compressed 🚨 11661670500 1370935024 8.51
statpopgen_q04/duckdb:vortex-file-compressed 🚨 11717527924 1284251683 9.12
statpopgen_q05/duckdb:vortex-file-compressed 🚨 4389840306 519816919 8.44
statpopgen_q06/duckdb:vortex-file-compressed 🚨 15639196587 1856592275 8.42
statpopgen_q07/duckdb:vortex-file-compressed 🚨 309799754 269108639 1.15
statpopgen_q08/duckdb:vortex-file-compressed 🚨 359707573 280662473 1.28
statpopgen_q09/duckdb:vortex-file-compressed 🚨 8554435913 947971671 9.02
statpopgen_q10/duckdb:vortex-file-compressed 🚨 28515185181 2874807325 9.92
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 406d6a1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 376178403 376651242 1.00
statpopgen_q01/duckdb:parquet 467530559 467773243 1.00
statpopgen_q02/duckdb:parquet 776617903 778192373 1.00
statpopgen_q03/duckdb:parquet 1062034697 1047608266 1.01
statpopgen_q04/duckdb:parquet 1067025544 1050901099 1.02
statpopgen_q05/duckdb:parquet 767922643 763747125 1.01
statpopgen_q06/duckdb:parquet 1025953689 1021144398 1.00
statpopgen_q07/duckdb:parquet 950165177 941844695 1.01
statpopgen_q08/duckdb:parquet 972519510 965789918 1.01
statpopgen_q09/duckdb:parquet 1003883375 987608343 1.02
statpopgen_q10/duckdb:parquet 1661685349 1644975184 1.01

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +29.1%
Engines: DataFusion No clear signal (-1.9%, environment too noisy confidence) · DuckDB No clear signal (+69.8%, environment too noisy confidence)
Vortex (geomean): 1.494x ❌
Parquet (geomean): 1.157x ➖
Shifts: Parquet (control) +15.7% · Median polish +6.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.941x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 40284470 40124027 1.00
fineweb_q01/datafusion:vortex-file-compressed 574178172 487059765 1.18
fineweb_q02/datafusion:vortex-file-compressed 538510502 535730063 1.01
fineweb_q03/datafusion:vortex-file-compressed 495116011 498046549 0.99
fineweb_q04/datafusion:vortex-file-compressed 430817185 455220455 0.95
fineweb_q05/datafusion:vortex-file-compressed 391979760 426121254 0.92
fineweb_q06/datafusion:vortex-file-compressed 681258848 712863875 0.96
fineweb_q07/datafusion:vortex-file-compressed 502347469 608493066 0.83
fineweb_q08/datafusion:vortex-file-compressed 213853064 301241777 0.71
datafusion / vortex-compact / ns (1.137x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 56942711 44229440 1.29
fineweb_q01/datafusion:vortex-compact 🚨 661003705 462194940 1.43
fineweb_q02/datafusion:vortex-compact 561639940 564056271 1.00
fineweb_q03/datafusion:vortex-compact 813941232 755133729 1.08
fineweb_q04/datafusion:vortex-compact 772380741 765697586 1.01
fineweb_q05/datafusion:vortex-compact 725799988 654099474 1.11
fineweb_q06/datafusion:vortex-compact 769433140 733414235 1.05
fineweb_q07/datafusion:vortex-compact 659795178 579240155 1.14
fineweb_q08/datafusion:vortex-compact 219633177 183461212 1.20
datafusion / parquet / ns (1.054x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 753263284 508390616 1.48
fineweb_q01/datafusion:parquet 1052428113 972605023 1.08
fineweb_q02/datafusion:parquet 997205757 940936243 1.06
fineweb_q03/datafusion:parquet 1057975318 998842326 1.06
fineweb_q04/datafusion:parquet 972289538 1034619319 0.94
fineweb_q05/datafusion:parquet 893833299 915589939 0.98
fineweb_q06/datafusion:parquet 948181539 932847818 1.02
fineweb_q07/datafusion:parquet 961075714 970056294 0.99
fineweb_q08/datafusion:parquet 1018778761 1058661838 0.96
duckdb / vortex-file-compressed / ns (1.249x ➖, 0↑ 3↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 55827011 54916933 1.02
fineweb_q01/duckdb:vortex-file-compressed 704896906 547775386 1.29
fineweb_q02/duckdb:vortex-file-compressed 🚨 763909125 505352904 1.51
fineweb_q03/duckdb:vortex-file-compressed 1692598498 1563028475 1.08
fineweb_q04/duckdb:vortex-file-compressed 🚨 3508989147 1795156900 1.95
fineweb_q05/duckdb:vortex-file-compressed 🚨 2896035967 1681203888 1.72
fineweb_q06/duckdb:vortex-file-compressed 1820187406 1748219458 1.04
fineweb_q07/duckdb:vortex-file-compressed 1803478672 1523591892 1.18
fineweb_q08/duckdb:vortex-file-compressed 638361640 769060960 0.83
duckdb / vortex-compact / ns (3.731x ❌, 0↑ 7↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 53404104 56518695 0.94
fineweb_q01/duckdb:vortex-compact 🚨 1674462168 580664490 2.88
fineweb_q02/duckdb:vortex-compact 🚨 1763424339 611711056 2.88
fineweb_q03/duckdb:vortex-compact 🚨 14425453149 1547470091 9.32
fineweb_q04/duckdb:vortex-compact 🚨 15275398413 1717710497 8.89
fineweb_q05/duckdb:vortex-compact 🚨 13640476047 1625342373 8.39
fineweb_q06/duckdb:vortex-compact 🚨 8060206802 1656902019 4.86
fineweb_q07/duckdb:vortex-compact 🚨 8329210112 1503710585 5.54
fineweb_q08/duckdb:vortex-compact 578294918 607734766 0.95
duckdb / parquet / ns (1.271x ➖, 0↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5279006256 5257416160 1.00
fineweb_q01/duckdb:parquet 5321698104 5328125620 1.00
fineweb_q02/duckdb:parquet 🚨 5272640620 596706966 8.84
fineweb_q03/duckdb:parquet 5356572347 5355296048 1.00
fineweb_q04/duckdb:parquet 5256164839 5298973422 0.99
fineweb_q05/duckdb:parquet 5281873375 5311692037 0.99
fineweb_q06/duckdb:parquet 5368680142 5424580921 0.99
fineweb_q07/duckdb:parquet 5350524115 5333158634 1.00
fineweb_q08/duckdb:parquet 5258103463 5268412496 1.00

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: Likely regression (low confidence)
Attributed Vortex impact: +85.0%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB Likely regression (+151.0%, medium confidence)
Vortex (geomean): 2.515x ❌
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.012x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 103095787 100813299 1.02
appian_q02/datafusion:vortex-file-compressed 479884844 482084775 1.00
appian_q03/datafusion:vortex-file-compressed 291126411 278019825 1.05
appian_q04/datafusion:vortex-file-compressed 13518407562 13610198780 0.99
appian_q05/datafusion:vortex-file-compressed 225663422 223956253 1.01
appian_q06/datafusion:vortex-file-compressed 281909922 276966007 1.02
appian_q07/datafusion:vortex-file-compressed 362717896 359827511 1.01
appian_q08/datafusion:vortex-file-compressed 1399921815 1395556227 1.00
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 136394664 134189314 1.02
appian_q02/datafusion:parquet 589865597 594119681 0.99
appian_q03/datafusion:parquet 316251002 320209073 0.99
appian_q04/datafusion:parquet 13663536844 13712105963 1.00
appian_q05/datafusion:parquet 310718922 308237287 1.01
appian_q06/datafusion:parquet 309945198 308610441 1.00
appian_q07/datafusion:parquet 444688219 441026099 1.01
appian_q08/datafusion:parquet 1539955579 1511390477 1.02
duckdb / vortex-file-compressed / ns (6.250x ❌, 0↑ 8↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 🚨 1672073825 153588172 10.89
appian_q02/duckdb:vortex-file-compressed 🚨 2586303183 415837332 6.22
appian_q03/duckdb:vortex-file-compressed 🚨 1953820922 263515732 7.41
appian_q04/duckdb:vortex-file-compressed 🚨 11273697824 1592273672 7.08
appian_q05/duckdb:vortex-file-compressed 🚨 1980673934 253843434 7.80
appian_q06/duckdb:vortex-file-compressed 🚨 2387720995 1027945672 2.32
appian_q07/duckdb:vortex-file-compressed 🚨 2643882289 292982143 9.02
appian_q08/duckdb:vortex-file-compressed 🚨 3676258768 918117686 4.00
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 158950295 156325092 1.02
appian_q02/duckdb:parquet 359843858 359350763 1.00
appian_q03/duckdb:parquet 219810957 222589886 0.99
appian_q04/duckdb:parquet 1486323564 1484129201 1.00
appian_q05/duckdb:parquet 241056055 240643129 1.00
appian_q06/duckdb:parquet 982846859 992449437 0.99
appian_q07/duckdb:parquet 270744611 267401936 1.01
appian_q08/duckdb:parquet 778054031 792242962 0.98
duckdb / duckdb / ns (1.006x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 135393953 135291550 1.00
appian_q02/duckdb:duckdb 317811147 317538311 1.00
appian_q03/duckdb:duckdb 337441004 341290506 0.99
appian_q04/duckdb:duckdb 1481388928 1495090863 0.99
appian_q05/duckdb:duckdb 216779520 210057847 1.03
appian_q06/duckdb:duckdb 975011595 953138991 1.02
appian_q07/duckdb:duckdb 236060552 232346821 1.02
appian_q08/duckdb:duckdb 737993984 739357915 1.00

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.65 MB (-0.1%)
  • vortex-file-compressed: 479.69 MB → 479.69 MB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: Likely regression (environment too noisy confidence)
Attributed Vortex impact: +61.2%
Engines: DataFusion No clear signal (+0.1%, environment too noisy confidence) · DuckDB Likely regression (+159.7%, environment too noisy confidence)
Vortex (geomean): 1.590x ❌
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish +2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.078x ➖, 1↑ 4↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 553486833 553131786 1.00
tpch_q02/datafusion:vortex-file-compressed 585338443 580794030 1.01
tpch_q03/datafusion:vortex-file-compressed 511367280 548082186 0.93
tpch_q04/datafusion:vortex-file-compressed 🚨 486084736 282280815 1.72
tpch_q05/datafusion:vortex-file-compressed 719961576 699818835 1.03
tpch_q06/datafusion:vortex-file-compressed 🚨 456787427 345506736 1.32
tpch_q07/datafusion:vortex-file-compressed 897690177 725119424 1.24
tpch_q08/datafusion:vortex-file-compressed 1125505352 1044062607 1.08
tpch_q09/datafusion:vortex-file-compressed 911918651 884610117 1.03
tpch_q10/datafusion:vortex-file-compressed 864096528 718353896 1.20
tpch_q11/datafusion:vortex-file-compressed 433353838 396929163 1.09
tpch_q12/datafusion:vortex-file-compressed 569185076 637304654 0.89
tpch_q13/datafusion:vortex-file-compressed 254921904 295925693 0.86
tpch_q14/datafusion:vortex-file-compressed 337488182 342314019 0.99
tpch_q15/datafusion:vortex-file-compressed 672416754 740602281 0.91
tpch_q16/datafusion:vortex-file-compressed 🚀 334360985 485783327 0.69
tpch_q17/datafusion:vortex-file-compressed 840575354 817719860 1.03
tpch_q18/datafusion:vortex-file-compressed 1019625416 879647480 1.16
tpch_q19/datafusion:vortex-file-compressed 🚨 823727859 581345695 1.42
tpch_q20/datafusion:vortex-file-compressed 🚨 1019941644 643174126 1.59
tpch_q21/datafusion:vortex-file-compressed 1032604744 1048383299 0.98
tpch_q22/datafusion:vortex-file-compressed 354649018 340480380 1.04
datafusion / vortex-compact / ns (0.955x ➖, 1↑ 1↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 649753331 676102237 0.96
tpch_q02/datafusion:vortex-compact 🚀 597575149 878737162 0.68
tpch_q03/datafusion:vortex-compact 562589475 639729123 0.88
tpch_q04/datafusion:vortex-compact 285897037 398989234 0.72
tpch_q05/datafusion:vortex-compact 701535462 804035997 0.87
tpch_q06/datafusion:vortex-compact 341489836 411070559 0.83
tpch_q07/datafusion:vortex-compact 734063461 739837427 0.99
tpch_q08/datafusion:vortex-compact 851082826 878040340 0.97
tpch_q09/datafusion:vortex-compact 887281539 867284261 1.02
tpch_q10/datafusion:vortex-compact 656772960 753880786 0.87
tpch_q11/datafusion:vortex-compact 369299943 380018600 0.97
tpch_q12/datafusion:vortex-compact 683770815 541394866 1.26
tpch_q13/datafusion:vortex-compact 🚨 382913323 264935755 1.45
tpch_q14/datafusion:vortex-compact 496599584 404867962 1.23
tpch_q15/datafusion:vortex-compact 726108876 616013705 1.18
tpch_q16/datafusion:vortex-compact 369569782 325065086 1.14
tpch_q17/datafusion:vortex-compact 775839755 859114789 0.90
tpch_q18/datafusion:vortex-compact 875663076 916167653 0.96
tpch_q19/datafusion:vortex-compact 592061594 611700190 0.97
tpch_q20/datafusion:vortex-compact 586147607 805473830 0.73
tpch_q21/datafusion:vortex-compact 954848699 1063602177 0.90
tpch_q22/datafusion:vortex-compact 336328958 375771982 0.90
datafusion / parquet / ns (1.014x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 418880494 416026224 1.01
tpch_q02/datafusion:parquet 691235484 627422766 1.10
tpch_q03/datafusion:parquet 676157175 649567813 1.04
tpch_q04/datafusion:parquet 414075866 419803464 0.99
tpch_q05/datafusion:parquet 765536307 807341886 0.95
tpch_q06/datafusion:parquet 366113425 338308163 1.08
tpch_q07/datafusion:parquet 879322830 944442538 0.93
tpch_q08/datafusion:parquet 1188358238 1041294852 1.14
tpch_q09/datafusion:parquet 1276997259 1558091928 0.82
tpch_q10/datafusion:parquet 1765054699 1852267647 0.95
tpch_q11/datafusion:parquet 442806029 512443854 0.86
tpch_q12/datafusion:parquet 541873232 465845949 1.16
tpch_q13/datafusion:parquet 632006416 609148564 1.04
tpch_q14/datafusion:parquet 483533414 437418716 1.11
tpch_q15/datafusion:parquet 860309333 699388971 1.23
tpch_q16/datafusion:parquet 360565882 284580245 1.27
tpch_q17/datafusion:parquet 832431794 827794159 1.01
tpch_q18/datafusion:parquet 1293286468 1194084527 1.08
tpch_q19/datafusion:parquet 496909627 528355009 0.94
tpch_q20/datafusion:parquet 1138994600 1128592076 1.01
tpch_q21/datafusion:parquet 1234770935 1415862420 0.87
tpch_q22/datafusion:parquet 705471733 819832809 0.86
duckdb / vortex-file-compressed / ns (2.034x ❌, 0↑ 18↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 2718712847 666740888 4.08
tpch_q02/duckdb:vortex-file-compressed 873668858 871820020 1.00
tpch_q03/duckdb:vortex-file-compressed 🚨 1877259698 893415055 2.10
tpch_q04/duckdb:vortex-file-compressed 🚨 1749374766 776572101 2.25
tpch_q05/duckdb:vortex-file-compressed 🚨 2103739051 940973977 2.24
tpch_q06/duckdb:vortex-file-compressed 874127237 717563949 1.22
tpch_q07/duckdb:vortex-file-compressed 🚨 2156380591 1048644988 2.06
tpch_q08/duckdb:vortex-file-compressed 🚨 2538888383 1351597075 1.88
tpch_q09/duckdb:vortex-file-compressed 🚨 5400487115 1537262177 3.51
tpch_q10/duckdb:vortex-file-compressed 🚨 2650935498 1325828788 2.00
tpch_q11/duckdb:vortex-file-compressed 486425376 445594339 1.09
tpch_q12/duckdb:vortex-file-compressed 🚨 1928245024 1465358688 1.32
tpch_q13/duckdb:vortex-file-compressed 🚨 3972959607 863539028 4.60
tpch_q14/duckdb:vortex-file-compressed 859999672 711714182 1.21
tpch_q15/duckdb:vortex-file-compressed 🚨 1337548212 630421810 2.12
tpch_q16/duckdb:vortex-file-compressed 🚨 743955588 358405686 2.08
tpch_q17/duckdb:vortex-file-compressed 🚨 1916116401 1068065898 1.79
tpch_q18/duckdb:vortex-file-compressed 🚨 3046546455 786911132 3.87
tpch_q19/duckdb:vortex-file-compressed 🚨 1188663133 886530147 1.34
tpch_q20/duckdb:vortex-file-compressed 🚨 2303364713 1193288475 1.93
tpch_q21/duckdb:vortex-file-compressed 🚨 5939405437 2328855485 2.55
tpch_q22/duckdb:vortex-file-compressed 🚨 798794322 303898896 2.63
duckdb / vortex-compact / ns (3.055x ❌, 0↑ 20↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 4345660750 624543284 6.96
tpch_q02/duckdb:vortex-compact 963207197 874050071 1.10
tpch_q03/duckdb:vortex-compact 🚨 2804810953 833001837 3.37
tpch_q04/duckdb:vortex-compact 🚨 3142255009 590547012 5.32
tpch_q05/duckdb:vortex-compact 🚨 3138056511 946593090 3.32
tpch_q06/duckdb:vortex-compact 🚨 1373443808 693439956 1.98
tpch_q07/duckdb:vortex-compact 🚨 3652160061 1120669569 3.26
tpch_q08/duckdb:vortex-compact 🚨 3570040351 1339998849 2.66
tpch_q09/duckdb:vortex-compact 🚨 7191047698 1367482016 5.26
tpch_q10/duckdb:vortex-compact 🚨 3500571691 1180045422 2.97
tpch_q11/duckdb:vortex-compact 576367280 443472233 1.30
tpch_q12/duckdb:vortex-compact 🚨 3498715912 1117705339 3.13
tpch_q13/duckdb:vortex-compact 🚨 5019239147 665053581 7.55
tpch_q14/duckdb:vortex-compact 🚨 1289411113 596498449 2.16
tpch_q15/duckdb:vortex-compact 🚨 1973340675 571551100 3.45
tpch_q16/duckdb:vortex-compact 🚨 764608205 342360810 2.23
tpch_q17/duckdb:vortex-compact 🚨 2166630682 986754002 2.20
tpch_q18/duckdb:vortex-compact 🚨 4240669483 826672136 5.13
tpch_q19/duckdb:vortex-compact 🚨 1516211170 944269042 1.61
tpch_q20/duckdb:vortex-compact 🚨 3129423746 1221721021 2.56
tpch_q21/duckdb:vortex-compact 🚨 9173076850 1789058744 5.13
tpch_q22/duckdb:vortex-compact 🚨 944227006 299264338 3.16
duckdb / parquet / ns (0.960x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 431936024 466364234 0.93
tpch_q02/duckdb:parquet 908992232 856139143 1.06
tpch_q03/duckdb:parquet 1177590375 1156894353 1.02
tpch_q04/duckdb:parquet 727923959 760896737 0.96
tpch_q05/duckdb:parquet 1167319794 1354645291 0.86
tpch_q06/duckdb:parquet 399376291 421321130 0.95
tpch_q07/duckdb:parquet 1034770726 1159869166 0.89
tpch_q08/duckdb:parquet 1463773419 1544719339 0.95
tpch_q09/duckdb:parquet 1379911722 1424389938 0.97
tpch_q10/duckdb:parquet 2658635079 2498274532 1.06
tpch_q11/duckdb:parquet 538768747 520087920 1.04
tpch_q12/duckdb:parquet 764977772 695173518 1.10
tpch_q13/duckdb:parquet 1006466526 1031163155 0.98
tpch_q14/duckdb:parquet 751879089 978818170 0.77
tpch_q15/duckdb:parquet 463424774 508756270 0.91
tpch_q16/duckdb:parquet 699000883 716566373 0.98
tpch_q17/duckdb:parquet 685343695 657781248 1.04
tpch_q18/duckdb:parquet 910049682 927282249 0.98
tpch_q19/duckdb:parquet 854361516 849365179 1.01
tpch_q20/duckdb:parquet 1208422573 1310092254 0.92
tpch_q21/duckdb:parquet 1074156264 1212785321 0.89
tpch_q22/duckdb:parquet 932429858 998031441 0.93

@myrrc myrrc closed this Aug 5, 2026
@myrrc
myrrc deleted the myrrc/duckdb-split-model branch August 5, 2026 16:04
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +133.5%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB Likely regression (+439.3%, high confidence)
Vortex (geomean): 2.325x ❌
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 338350963 336632088 1.01
vortex_q01/datafusion:vortex-file-compressed 358541226 356519654 1.01
vortex_q02/datafusion:vortex-file-compressed 354719495 352290891 1.01
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 513054134 515870122 0.99
vortex_q01/datafusion:parquet 149447744 150977274 0.99
vortex_q02/datafusion:parquet 763907789 764334595 1.00
duckdb / vortex-file-compressed / ns (5.372x ❌, 0↑ 3↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 🚨 2720960112 442366076 6.15
vortex_q01/duckdb:vortex-file-compressed 🚨 987048178 232617253 4.24
vortex_q02/duckdb:vortex-file-compressed 🚨 1949352908 328201463 5.94
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name PR 36c96f7 (ns) base 3884b98 (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 574702043 576875623 1.00
vortex_q01/duckdb:parquet 354396688 358726570 0.99
vortex_q02/duckdb:parquet 629573290 626866837 1.00

No file size changes detected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant