Skip to content

Opt-in direct I/O reads, and what segment alignment is actually worth - #9838

Draft
joseph-isaacs wants to merge 5 commits into
developfrom
claude/direct-io-reads-perf-3b5kk2
Draft

Opt-in direct I/O reads, and what segment alignment is actually worth#9838
joseph-isaacs wants to merge 5 commits into
developfrom
claude/direct-io-reads-perf-3b5kk2

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds opt-in O_DIRECT reads for local files, plus three segment padding policies for the writer, and measures what each is worth. Two findings drive the shape of this PR:

Direct I/O does not need aligned files. O_DIRECT constrains the pread — offset, length, and buffer address — not the file. The reader rounds the offset down to a block boundary, rounds the length up, reads into an over-aligned buffer, and slices the requested window back out. So every file Vortex has ever written can be read this way, with no format change and no migration. Widening is the code path, not a fallback, so it is exercised by every direct read rather than rotting.

4 KiB write alignment costs more than it saves. It grows files by ~1.9% and makes a direct-I/O reader transfer more bytes, not fewer, because reads are coalesced long before they reach the filesystem. The writer option is here because it is the only way to demonstrate that, and because Grouped is a strictly better version of it — not because it should be switched on.

Cold-cache reads are where direct I/O pays: −36.3% on a TPC-H lineitem scan, −34.0% on ClickBench, and a tail that collapses from a 6.3× spread to 1.08×.

Changes

vortex-io — lifts the direct-I/O primitives out of vortex-cuda, which already had a working O_DIRECT + statx(STATX_DIOALIGN) implementation for its pinned-buffer reader, into std_file, and wires them into FileReadAt. Both readers now share one implementation instead of two. Linux only; opt in with FileReadAtOptions::with_direct_io() or VORTEX_DIRECT_IO=1, and it falls back to buffered reads where the filesystem cannot serve O_DIRECT.

vortex-file — a SegmentPadding write option, defaulting to today's contiguous packing:

what it does
None pack contiguously, padding only to each segment's own alignment
Always start every segment on a block boundary
Grouped keep every sub-block segment inside one block, packing runs of them together; leave anything a block or larger where it is
Proportional align a segment when its padding is within 1/ratio of its length

VORTEX_SEGMENT_PADDING (none, always, grouped, proportional[:ratio]) selects one without recompiling, mirroring VORTEX_DIRECT_IO.

vortex-bench — a direct-io binary. convert writes under each policy and reports sizes; analyze replays every policy over an already-written file's segment map, pricing storage growth and the bytes a direct reader would transfer, both per-segment and after the reader's own coalescing window; scan times full scans with buffered and direct reads. The replay reproduces the measured file sizes exactly, which is what makes its read estimates trustworthy rather than hand-waved.

What the padding costs

Replayed over the segment maps of ClickBench ×10 and TPC-H SF1. The read columns are the bytes a direct reader transfers, relative to the packed baseline — negative is better.

policy ClickBench growth 1 seg/io coalesced TPC-H growth 1 seg/io coalesced
none
Always +2.035% −1.02% +1.93% +1.868% −0.86% +1.76%
Grouped +1.005% −1.02% +0.90% +1.753% −0.86% +1.65%
Proportional 1/64 +0.493% −0.54% +0.40% +0.561% −0.62% +0.50%

Aligning saves ~1% when each segment is read on its own, but Vortex coalesces at 1 MiB/4 MiB — a 4 KiB gap never splits a run, so the padding is read along with the data. The coalesced column is the one that matches how the reader behaves, and there alignment is a straight loss.

The cost is structural: growth ≈ 2.7 kB × segment_count, within 1% on both datasets despite very different segment profiles. TPC-H SF1 lands at +1.868% against +1.800% measured on SF10, so scale factor barely moves it. The lever is segment count, not segment size.

Grouped is the one policy worth keeping. The rule is asymmetric on purpose. A segment smaller than a block that straddles a boundary touches two blocks instead of one — a 100% penalty — so it is worth moving, and grouping keeps runs of them packed into shared blocks rather than giving each its own. A segment a block or larger already spans ceil(len / block) blocks and a straddle adds at most one to that (1/3 for an 8 KiB segment, 1/256 for a megabyte), so it is left where it is; paying up to a block of padding to avoid that is a bad trade, and it is the trade that dominates real files because the large segments hold the bytes.

Getting that restriction wrong is expensive. On the synthetic wide tables from compress-bench — 100 list<i64> columns × 1000 rows, which write exactly two segments per column, a 156-byte offsets segment and an 8372-byte elements segment:

policy file size growth
none 878 968 B
Grouped without the size restriction 1 270 704 B +44.57%
Grouped as implemented 879 408 B +0.05%
Always 1 663 920 B +89.30%

Pushing the 8372-byte segments to a block boundary burns 3.9 kB apiece and buys nothing — 8372 bytes spans three blocks whether it starts at offset 0 or offset 156. Restricting the rule to sub-block segments leaves those packed while still keeping every 156-byte segment inside a single block.

On real data the saving tracks how much of the file is small segments: ClickBench halves its padding (38.8% of its segments are under 4 KiB, holding 0.2% of the bytes), TPC-H gains 6%. There is no workload where Always is the better choice.

One pathology worth flagging: TPC-H region goes 5.00 kB → 27.74 kB under Always, a 5.5× blowup. Any many-small-files workload pays that repeatedly.

What direct I/O is worth

Full scans through ScanBuilder, page cache dropped between iterations:

buffered direct
TPC-H lineitem 1.867 s 1.189 s −36.3%
ClickBench −34.0%

Warm-cache it loses ~15% on I/O and breaks even end to end, which is the correct result — a page-cache read is a memcpy. The larger prize is the tail: under page-cache reclaim, buffered cold reads ranged over 6.3× (0.77–4.88 s) while direct ranged over 1.08×.

Measured direct reads over aligned files were never faster than over packed ones, across three paired rounds.

Testing

vortex-io 210 passed, vortex-file 191 passed, cargo clippy --all-targets --all-features clean on vortex-io, vortex-file and vortex-bench, cargo +nightly fmt --all applied. New tests cover block widening over unaligned files, the alignment-survives-slicing invariant, each padding policy's per-segment output, the whole-file bound on the proportional budget, and the single-block property of sub-block segments under Grouped.

Caveat on the timings: they come from a 4-vCPU VM on virtio, where drop_caches clears only the guest cache. Treat deltas under ~10% as noise. The last commit runs the CI benchmark suite with both switches on so these numbers can be re-taken on the bench hardware.

API Changes

Two additive, opt-in options, both defaulting to current behavior: FileReadAtOptions::with_direct_io() and VortexWriteOptions::with_segment_padding(). Nothing existing changes, and no file format change — alignment is a property of the read call, not the file.


⚠️ The commit bench: run CI benchmarks with direct I/O and 4 KiB segment alignment sets VORTEX_DIRECT_IO=1 and VORTEX_SEGMENT_PADDING=always on the benchmark jobs. It is an experiment to get numbers on the bench hardware, not a proposed default — revert it before merging.

🤖 Generated with Claude Code

https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU


Generated by Claude Code

joseph-isaacs and others added 4 commits September 10, 2026 23:00
Direct I/O bypasses the page cache, which avoids a copy out of the cache
and stops a large scan evicting everything else, but Linux requires the
file offset, transfer length, and buffer address of every O_DIRECT read
to be block aligned. Vortex segments are aligned to their element width,
not to a block, so reads are widened to the enclosing blocks and sliced
back to the requested range. That keeps direct reads working on files
written by any Vortex version: no format change is required to enable it.

vortex-cuda already had this machinery for its pinned-buffer reader, so
lift it into vortex-io::std_file and have both readers share it. Enable
it per-reader with FileReadAtOptions, or with VORTEX_DIRECT_IO=1 to A/B
a deployment without recompiling. Filesystems that cannot serve O_DIRECT
reject the open, so fall back to buffered reads rather than failing.

Widening costs at most one block of over-read per physical read, so the
writer gains an opt-in SegmentPadding policy to remove it: Always pads
every segment to a 4KiB boundary, and Proportional pads a segment only
when the padding is within 1/64 of its length, which bounds the padding
added across a file to 1/64 of the segment bytes written. The default is
unchanged contiguous packing.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
Adds a `direct-io` benchmark binary with three modes. `convert` writes
Parquet to Vortex under each SegmentPadding policy and reports sizes.
`analyze` replays every policy over an already-written file's segment map,
pricing storage growth and the bytes a direct-I/O reader would transfer,
both per-segment and after applying the reader's own coalescing window --
so a policy can be costed without rewriting terabytes. `scan` times full
scans through ScanBuilder with buffered and direct reads, optionally
dropping the page cache between iterations, and can resolve every segment
without decoding to isolate I/O from decompression.

The replay reproduces the measured file sizes exactly, which is what makes
its read-amplification estimates trustworthy.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
`SegmentPadding::Always` costs half a block per segment whether the segment
is a megabyte or forty bytes, and the small ones are numerous: 38.8% of
ClickBench segments are under 4 KiB while holding 0.2% of the bytes.

`Grouped` pads a segment only when it would otherwise straddle a block
boundary, so a run of small consecutive segments shares one block instead of
each burning a whole one. Every segment still occupies exactly the blocks it
would under `Always` -- one apiece up to a block, `len / block` rounded up
above that -- which a test asserts over ten thousand segments. It therefore
reads identically while padding strictly less, and there is no workload where
`Always` is the better choice.

Replayed over the segment maps:

               ClickBench x10            TPC-H SF1
               growth  1 seg/io   coalesced   growth  1 seg/io   coalesced
  always       2.035%    -1.02%      +1.93%   1.868%    -0.86%      +1.76%
  grouped      1.005%    -1.02%      +0.90%   1.753%    -0.86%      +1.65%

The saving tracks how much of the file is small segments, so ClickBench halves
its padding while TPC-H, which is nearly all large segments, gains 6%.

Also adds `VORTEX_SEGMENT_PADDING` (`none`, `always`, `grouped`,
`proportional[:ratio]`) so a deployment or benchmark can pick a policy without
recompiling, mirroring `VORTEX_DIRECT_IO`. Unset or empty keeps the packed
default.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
Sets `VORTEX_DIRECT_IO=1` and `VORTEX_SEGMENT_PADDING=always` on the jobs that
both generate the benchmark data and query it, so the PR run measures aligned
writes read back through `O_DIRECT` against develop's buffered, packed
baseline.

This is an experiment, not a proposed default: revert this commit before
merging.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Sep 11, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 11, 2026
@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 95c4954 random-access-bench 1 Explore Profiling Data
🟢 Done 95c4954 statpopgen 1 Explore Profiling Data
🟢 Done 95c4954 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 95c4954 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 95c4954 tpch-s3-10 1 Explore Profiling Data
🟢 Done 95c4954 fineweb-s3 1 Explore Profiling Data
🟢 Done 95c4954 fineweb 1 Explore Profiling Data
🟢 Done 95c4954 polarsignals 1 Explore Profiling Data
🟢 Done 95c4954 tpcds-nvme 1 Explore Profiling Data
🟢 Done 95c4954 clickbench-nvme 1 Explore Profiling Data
🟢 Done 95c4954 tpch-s3 1 Explore Profiling Data
🟢 Done 95c4954 appian-nvme 1 Explore Profiling Data
🟢 Done 95c4954 tpch-nvme 1 Explore Profiling Data
🟢 Done 95c4954 string-bench 1 Explore Profiling Data
🟢 Done 95c4954 compress-bench 1 Explore Profiling Data
Previous Runs (18)
Status Commit Job Attempt Link
🟢 Done 0a5e328 compress-bench 3 Explore Profiling Data
🟢 Done 0a5e328 tpch-s3-10 2 Explore Profiling Data
🟢 Done 0a5e328 appian-nvme 2 Explore Profiling Data
🟢 Done 0a5e328 random-access-bench 1 Explore Profiling Data
🟢 Done 0a5e328 statpopgen 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0a5e328 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 fineweb 1 Explore Profiling Data
🟢 Done 0a5e328 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 fineweb-s3 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-s3 1 Explore Profiling Data
🟢 Done 0a5e328 polarsignals 1 Explore Profiling Data
🟢 Done 0a5e328 string-bench 1 Explore Profiling Data
🟢 Done 0a5e328 compress-bench 2 Explore Profiling Data
🟢 Done 0a5e328 appian-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 95c4954a vs base c93f5a9a
Vortex (geomean): hot 1.007x ➖ · cold 1.070x ➖


datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45542066 / 44853450 / +1.5% 95411673 / 91732179 / +4.0% 0.48 / 0.49 / -2.4%
polarsignals_q01/datafusion:vortex-file-compressed 51100124 / 51016473 / +0.2% 118896728 / 116699723 / +1.9% 0.43 / 0.44 / -1.7%
polarsignals_q02/datafusion:vortex-file-compressed 35562620 / 37078624 / -4.1% 83874377 / 77691804 / +8.0% 0.42 / 0.48 / -11.2%
polarsignals_q03/datafusion:vortex-file-compressed 53567876 / 53969870 / -0.7% 121308924 / 115498170 / +5.0% 0.44 / 0.47 / -5.5%
polarsignals_q04/datafusion:vortex-file-compressed 9845906 / 9517406 / +3.5% 53387144 / 48559031 / +9.9% 0.18 / 0.20 / -5.9%
polarsignals_q05/datafusion:vortex-file-compressed 12005477 / 11789586 / +1.8% 57490867 / 50887010 / +13.0% 🔴 0.21 / 0.23 / -9.9%
polarsignals_q06/datafusion:vortex-file-compressed 21140136 / 20780908 / +1.7% 67040055 / 62226849 / +7.7% 0.32 / 0.33 / -5.6%
polarsignals_q07/datafusion:vortex-file-compressed 11334800 / 11361316 / -0.2% 58171790 / 54962080 / +5.8% 0.19 / 0.21 / -5.7%
polarsignals_q08/datafusion:vortex-file-compressed 100775295 / 100565162 / +0.2% 166429871 / 161783535 / +2.9% 0.61 / 0.62 / -2.6%
polarsignals_q09/datafusion:vortex-file-compressed 10612139 / 10282563 / +3.2% 51908651 / 46263497 / +12.2% 🔴 0.20 / 0.22 / -8.0%

File Size Changes (1 files changed, +0.2% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.88 MB 687.11 MB +1.23 MB +0.2%

Totals:

  • vortex-file-compressed: 685.88 MB → 687.11 MB (+0.2%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+2.3%, environment too noisy confidence) · DuckDB No clear signal (-3.2%, environment too noisy confidence)
Vortex (geomean): hot 0.889x ➖ · cold 0.833x ➖
Parquet (geomean): hot 0.894x ➖ · cold 0.848x ➖
Shifts: Parquet (control) -10.6% · Median polish -8.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.893x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 340942487 / 355835124 / -4.2% 1109836814 / 1208932289 / -8.2% 0.31 / 0.29 / +4.4%
tpch_q02/datafusion:vortex-compact 492424116 / 524771142 / -6.2% 1003051238 / 1231670840 / -18.6% 0.49 / 0.43 / +15.2%
tpch_q03/datafusion:vortex-compact 422105083 / 582798673 / -27.6% 1119539473 / 1523353210 / -26.5% 0.38 / 0.38 / -1.4%
tpch_q04/datafusion:vortex-compact 266396856 / 246422200 / +8.1% 625790772 / 773678441 / -19.1% 0.43 / 0.32 / +33.7%
tpch_q05/datafusion:vortex-compact 563278234 / 633318233 / -11.1% 842450624 / 825383598 / +2.1% 0.67 / 0.77 / -12.9%
tpch_q06/datafusion:vortex-compact 278936399 / 481780167 / -42.1% 🟢 506234310 / 670576215 / -24.5% 0.55 / 0.72 / -23.3%
tpch_q07/datafusion:vortex-compact 498995718 / 583414953 / -14.5% 816412173 / 676026984 / +20.8% 0.61 / 0.86 / -29.2%
tpch_q08/datafusion:vortex-compact 844348048 / 941895923 / -10.4% 955537694 / 1097555874 / -12.9% 0.88 / 0.86 / +3.0%
tpch_q09/datafusion:vortex-compact 912599112 / 699852491 / +30.4% 🔴 966842103 / 966159529 / +0.1% 0.94 / 0.72 / +30.3%
tpch_q10/datafusion:vortex-compact 634072088 / 896457257 / -29.3% 901263560 / 957984669 / -5.9% 0.70 / 0.94 / -24.8%
tpch_q11/datafusion:vortex-compact 320941088 / 719713007 / -55.4% 🟢 520674429 / 1025249013 / -49.2% 🟢 0.62 / 0.70 / -12.2%
tpch_q12/datafusion:vortex-compact 586790953 / 610005248 / -3.8% 940895347 / 906732264 / +3.8% 0.62 / 0.67 / -7.3%
tpch_q13/datafusion:vortex-compact 205652757 / 298454574 / -31.1% 🟢 492476639 / 618852531 / -20.4% 0.42 / 0.48 / -13.4%
tpch_q14/datafusion:vortex-compact 383024469 / 349305153 / +9.7% 555298750 / 521636461 / +6.5% 0.69 / 0.67 / +3.0%
tpch_q15/datafusion:vortex-compact 588028405 / 595138039 / -1.2% 917846613 / 932799864 / -1.6% 0.64 / 0.64 / +0.4%
tpch_q16/datafusion:vortex-compact 267526956 / 261902473 / +2.1% 437780641 / 474783107 / -7.8% 0.61 / 0.55 / +10.8%
tpch_q17/datafusion:vortex-compact 716011573 / 733061788 / -2.3% 912484666 / 861613384 / +5.9% 0.78 / 0.85 / -7.8%
tpch_q18/datafusion:vortex-compact 914686077 / 612681942 / +49.3% 🔴 597643162 / 681723500 / -12.3% 1.53 / 0.90 / +70.3%
tpch_q19/datafusion:vortex-compact 591683380 / 523331524 / +13.1% 617781510 / 674156508 / -8.4% 0.96 / 0.78 / +23.4%
tpch_q20/datafusion:vortex-compact 622467399 / 624883275 / -0.4% 668448802 / 669876962 / -0.2% 0.93 / 0.93 / -0.2%
tpch_q21/datafusion:vortex-compact 674567414 / 737084153 / -8.5% 1154756118 / 964194572 / +19.8% 0.58 / 0.76 / -23.6%
tpch_q22/datafusion:vortex-compact 302975229 / 465852490 / -35.0% 🟢 537405069 / 677629971 / -20.7% 0.56 / 0.69 / -18.0%
datafusion / parquet / ns (0.872x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 297657896 / 400516236 / -25.7% 1005359349 / 736404112 / +36.5% 🔴 0.30 / 0.54 / -45.6%
tpch_q02/datafusion:parquet 481810039 / 599637222 / -19.6% 1032472510 / 1384627913 / -25.4% 0.47 / 0.43 / +7.8%
tpch_q03/datafusion:parquet 516508140 / 583826908 / -11.5% 1257987811 / 1236520169 / +1.7% 0.41 / 0.47 / -13.0%
tpch_q04/datafusion:parquet 405316368 / 413806718 / -2.1% 923147146 / 604562524 / +52.7% 🔴 0.44 / 0.68 / -35.9%
tpch_q05/datafusion:parquet 701477430 / 1028079828 / -31.8% 🟢 812209684 / 1219182501 / -33.4% 🟢 0.86 / 0.84 / +2.4%
tpch_q06/datafusion:parquet 268450668 / 347883002 / -22.8% 450179918 / 458428074 / -1.8% 0.60 / 0.76 / -21.4%
tpch_q07/datafusion:parquet 689122467 / 989209197 / -30.3% 🟢 1114543614 / 1107933707 / +0.6% 0.62 / 0.89 / -30.7%
tpch_q08/datafusion:parquet 848664266 / 1048749688 / -19.1% 1055604067 / 1233108947 / -14.4% 0.80 / 0.85 / -5.5%
tpch_q09/datafusion:parquet 1305873438 / 1067022954 / +22.4% 1269905183 / 1409568744 / -9.9% 1.03 / 0.76 / +35.8%
tpch_q10/datafusion:parquet 1825156690 / 1988850598 / -8.2% 3929141345 / 3264599066 / +20.4% 0.46 / 0.61 / -23.8%
tpch_q11/datafusion:parquet 375729621 / 415908224 / -9.7% 560278517 / 708917124 / -21.0% 0.67 / 0.59 / +14.3%
tpch_q12/datafusion:parquet 450265815 / 431505989 / +4.3% 596017267 / 1436769846 / -58.5% 🟢 0.76 / 0.30 / +151.5%
tpch_q13/datafusion:parquet 452369468 / 460342829 / -1.7% 895708593 / 982743916 / -8.9% 0.51 / 0.47 / +7.8%
tpch_q14/datafusion:parquet 482373246 / 531716910 / -9.3% 654677383 / 723245561 / -9.5% 0.74 / 0.74 / +0.2%
tpch_q15/datafusion:parquet 868708393 / 734810434 / +18.2% 961102472 / 954117203 / +0.7% 0.90 / 0.77 / +17.4%
tpch_q16/datafusion:parquet 228337495 / 309184184 / -26.1% 501996291 / 516916634 / -2.9% 0.45 / 0.60 / -24.0%
tpch_q17/datafusion:parquet 833435688 / 865648106 / -3.7% 938687821 / 1021760230 / -8.1% 0.89 / 0.85 / +4.8%
tpch_q18/datafusion:parquet 863470714 / 1293824123 / -33.3% 🟢 1088544059 / 1460805758 / -25.5% 0.79 / 0.89 / -10.4%
tpch_q19/datafusion:parquet 450876761 / 562221458 / -19.8% 641675900 / 694453169 / -7.6% 0.70 / 0.81 / -13.2%
tpch_q20/datafusion:parquet 778753632 / 818683445 / -4.9% 901577181 / 1048917288 / -14.0% 0.86 / 0.78 / +10.7%
tpch_q21/datafusion:parquet 974123915 / 1034663078 / -5.9% 1075738384 / 1366263008 / -21.3% 0.91 / 0.76 / +19.6%
tpch_q22/datafusion:parquet 593553208 / 697465440 / -14.9% 801847317 / 1214064842 / -34.0% 🟢 0.74 / 0.57 / +28.9%
duckdb / vortex-compact / ns (0.886x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 883594352 / 937064829 / -5.7% 1055860227 / 2380819972 / -55.7% 🟢 0.84 / 0.39 / +112.6%
tpch_q02/duckdb:vortex-compact 462451878 / 543953425 / -15.0% 561873100 / 857588185 / -34.5% 🟢 0.82 / 0.63 / +29.8%
tpch_q03/duckdb:vortex-compact 1075160102 / 1249805153 / -14.0% 1091630606 / 1964349349 / -44.4% 🟢 0.98 / 0.64 / +54.8%
tpch_q04/duckdb:vortex-compact 672983259 / 954784929 / -29.5% 713762930 / 1825582934 / -60.9% 🟢 0.94 / 0.52 / +80.3%
tpch_q05/duckdb:vortex-compact 1085769686 / 1139286227 / -4.7% 1276854758 / 1794766161 / -28.9% 0.85 / 0.63 / +34.0%
tpch_q06/duckdb:vortex-compact 1054411953 / 1130006698 / -6.7% 1083281899 / 1131227413 / -4.2% 0.97 / 1.00 / -2.6%
tpch_q07/duckdb:vortex-compact 1364387019 / 1473073773 / -7.4% 1342070847 / 1590584812 / -15.6% 1.02 / 0.93 / +9.8%
tpch_q08/duckdb:vortex-compact 1332880581 / 1539651639 / -13.4% 1397208913 / 1727576937 / -19.1% 0.95 / 0.89 / +7.0%
tpch_q09/duckdb:vortex-compact 1710668231 / 1649945884 / +3.7% 1885713776 / 1897373840 / -0.6% 0.91 / 0.87 / +4.3%
tpch_q10/duckdb:vortex-compact 1308429558 / 1414440396 / -7.5% 1366580333 / 1824180269 / -25.1% 0.96 / 0.78 / +23.5%
tpch_q11/duckdb:vortex-compact 429218125 / 435297563 / -1.4% 484344058 / 658550263 / -26.5% 0.89 / 0.66 / +34.1%
tpch_q12/duckdb:vortex-compact 1936515906 / 2114276661 / -8.4% 2080621841 / 2363106610 / -12.0% 0.93 / 0.89 / +4.0%
tpch_q13/duckdb:vortex-compact 1035496952 / 1303139024 / -20.5% 1490493219 / 1786238581 / -16.6% 0.69 / 0.73 / -4.8%
tpch_q14/duckdb:vortex-compact 779871855 / 849344381 / -8.2% 867047886 / 942099820 / -8.0% 0.90 / 0.90 / -0.2%
tpch_q15/duckdb:vortex-compact 886320858 / 1091019406 / -18.8% 923820515 / 1156974258 / -20.2% 0.96 / 0.94 / +1.7%
tpch_q16/duckdb:vortex-compact 238232599 / 249636269 / -4.6% 266260317 / 250430716 / +6.3% 0.89 / 1.00 / -10.2%
tpch_q17/duckdb:vortex-compact 1292018355 / 1394880087 / -7.4% 1411160116 / 1383019806 / +2.0% 0.92 / 1.01 / -9.2%
tpch_q18/duckdb:vortex-compact 1005604698 / 1145259361 / -12.2% 1075218834 / 1202062270 / -10.6% 0.94 / 0.95 / -1.8%
tpch_q19/duckdb:vortex-compact 1021505940 / 1032741524 / -1.1% 1289802466 / 1231143496 / +4.8% 0.79 / 0.84 / -5.6%
tpch_q20/duckdb:vortex-compact 1523442151 / 2787898183 / -45.4% 🟢 1685254086 / 3433717703 / -50.9% 🟢 0.90 / 0.81 / +11.3%
tpch_q21/duckdb:vortex-compact 2204808364 / 2278229947 / -3.2% 2198201509 / 2425102486 / -9.4% 1.00 / 0.94 / +6.8%
tpch_q22/duckdb:vortex-compact 285603498 / 298697620 / -4.4% 381964249 / 501701065 / -23.9% 0.75 / 0.60 / +25.6%
duckdb / parquet / ns (0.915x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 351005851 / 520874436 / -32.6% 🟢 395856612 / 780474859 / -49.3% 🟢 0.89 / 0.67 / +32.9%
tpch_q02/duckdb:parquet 737142325 / 857698231 / -14.1% 1291687278 / 1571606758 / -17.8% 0.57 / 0.55 / +4.6%
tpch_q03/duckdb:parquet 895397663 / 1111999273 / -19.5% 1149095717 / 2256809483 / -49.1% 🟢 0.78 / 0.49 / +58.1%
tpch_q04/duckdb:parquet 725669701 / 687790214 / +5.5% 593261309 / 945900614 / -37.3% 🟢 1.22 / 0.73 / +68.2%
tpch_q05/duckdb:parquet 1120441590 / 1370682471 / -18.3% 1214215602 / 1539621173 / -21.1% 0.92 / 0.89 / +3.7%
tpch_q06/duckdb:parquet 588412658 / 408050784 / +44.2% 🔴 391778926 / 465978539 / -15.9% 1.50 / 0.88 / +71.5%
tpch_q07/duckdb:parquet 999003793 / 1283781887 / -22.2% 1182059129 / 1049682679 / +12.6% 0.85 / 1.22 / -30.9%
tpch_q08/duckdb:parquet 1361162368 / 1338811641 / +1.7% 1259664133 / 2181157411 / -42.2% 🟢 1.08 / 0.61 / +76.0%
tpch_q09/duckdb:parquet 1199743085 / 1324725826 / -9.4% 1294468704 / 1709793532 / -24.3% 0.93 / 0.77 / +19.6%
tpch_q10/duckdb:parquet 2198423959 / 2294789278 / -4.2% 2215454729 / 3074141637 / -27.9% 0.99 / 0.75 / +32.9%
tpch_q11/duckdb:parquet 489816920 / 498120019 / -1.7% 498265658 / 501748576 / -0.7% 0.98 / 0.99 / -1.0%
tpch_q12/duckdb:parquet 765261806 / 637228529 / +20.1% 761619535 / 1131326992 / -32.7% 🟢 1.00 / 0.56 / +78.4%
tpch_q13/duckdb:parquet 874266440 / 910661679 / -4.0% 1658323795 / 1623966896 / +2.1% 0.53 / 0.56 / -6.0%
tpch_q14/duckdb:parquet 695157644 / 718427522 / -3.2% 751196595 / 835268272 / -10.1% 0.93 / 0.86 / +7.6%
tpch_q15/duckdb:parquet 427009844 / 569271162 / -25.0% 565303656 / 592863752 / -4.6% 0.76 / 0.96 / -21.3%
tpch_q16/duckdb:parquet 636707410 / 661595841 / -3.8% 718479667 / 828724705 / -13.3% 0.89 / 0.80 / +11.0%
tpch_q17/duckdb:parquet 615186190 / 735021747 / -16.3% 669289662 / 666268807 / +0.5% 0.92 / 1.10 / -16.7%
tpch_q18/duckdb:parquet 814024586 / 860064002 / -5.4% 917934151 / 1033722714 / -11.2% 0.89 / 0.83 / +6.6%
tpch_q19/duckdb:parquet 723723186 / 985106080 / -26.5% 871637567 / 888271715 / -1.9% 0.83 / 1.11 / -25.1%
tpch_q20/duckdb:parquet 1151237388 / 1239479628 / -7.1% 1285180777 / 1544574110 / -16.8% 0.90 / 0.80 / +11.6%
tpch_q21/duckdb:parquet 881731436 / 951738574 / -7.4% 929253220 / 864851244 / +7.4% 0.95 / 1.10 / -13.8%
tpch_q22/duckdb:parquet 755425422 / 835622931 / -9.6% 882414415 / 1129249581 / -21.9% 0.86 / 0.74 / +15.7%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): hot 1.014x ➖ · cold 0.985x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 53340050 / 52800138 / +1.0% 73966482 / 75567713 / -2.1% 0.72 / 0.70 / +3.2%
appian_q02/datafusion:vortex-compact 236019118 / 233939330 / +0.9% 264715121 / 266887623 / -0.8% 0.89 / 0.88 / +1.7%
appian_q03/datafusion:vortex-compact 148694688 / 150222271 / -1.0% 184526268 / 183689346 / +0.5% 0.81 / 0.82 / -1.5%
appian_q04/datafusion:vortex-compact 9857227531 / 9901820002 / -0.5% 9766431266 / 9814931855 / -0.5% 1.01 / 1.01 / +0.0%
appian_q05/datafusion:vortex-compact 137082042 / 137415159 / -0.2% 161184419 / 161576114 / -0.2% 0.85 / 0.85 / +0.0%
appian_q06/datafusion:vortex-compact 142763894 / 142652111 / +0.1% 166649784 / 163741833 / +1.8% 0.86 / 0.87 / -1.7%
appian_q07/datafusion:vortex-compact 164098626 / 164019016 / +0.0% 189909131 / 199421547 / -4.8% 0.86 / 0.82 / +5.1%
appian_q08/datafusion:vortex-compact 565224064 / 559046983 / +1.1% 582331514 / 586827600 / -0.8% 0.97 / 0.95 / +1.9%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72272292 / 72440940 / -0.2% 96980869 / 88547995 / +9.5% 0.75 / 0.82 / -8.9%
appian_q02/datafusion:parquet 303005392 / 302774199 / +0.1% 330718407 / 328014643 / +0.8% 0.92 / 0.92 / -0.7%
appian_q03/datafusion:parquet 186931323 / 185207947 / +0.9% 228549371 / 221644424 / +3.1% 0.82 / 0.84 / -2.1%
appian_q04/datafusion:parquet 9948165303 / 9906143563 / +0.4% 9804670538 / 9804537702 / +0.0% 1.01 / 1.01 / +0.4%
appian_q05/datafusion:parquet 191341005 / 191542619 / -0.1% 219501513 / 219250120 / +0.1% 0.87 / 0.87 / -0.2%
appian_q06/datafusion:parquet 167047776 / 166454608 / +0.4% 191807502 / 190147899 / +0.9% 0.87 / 0.88 / -0.5%
appian_q07/datafusion:parquet 205170084 / 205605565 / -0.2% 241184872 / 240402897 / +0.3% 0.85 / 0.86 / -0.5%
appian_q08/datafusion:parquet 671177358 / 665856344 / +0.8% 679075098 / 676434077 / +0.4% 0.99 / 0.98 / +0.4%
duckdb / vortex-compact / ns (1.025x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 93897793 / 90877406 / +3.3% 98262133 / 106264126 / -7.5% 0.96 / 0.86 / +11.7%
appian_q02/duckdb:vortex-compact 220082115 / 213154327 / +3.3% 223096335 / 220615338 / +1.1% 0.99 / 0.97 / +2.1%
appian_q03/duckdb:vortex-compact 123551066 / 122287288 / +1.0% 134842491 / 144459105 / -6.7% 0.92 / 0.85 / +8.2%
appian_q04/duckdb:vortex-compact 543154463 / 527431363 / +3.0% 555349325 / 568630030 / -2.3% 0.98 / 0.93 / +5.4%
appian_q05/duckdb:vortex-compact 136114788 / 134325921 / +1.3% 147752974 / 152651777 / -3.2% 0.92 / 0.88 / +4.7%
appian_q06/duckdb:vortex-compact 403790603 / 400382696 / +0.9% 381219974 / 386098098 / -1.3% 1.06 / 1.04 / +2.1%
appian_q07/duckdb:vortex-compact 142215692 / 136670012 / +4.1% 154782449 / 154070551 / +0.5% 0.92 / 0.89 / +3.6%
appian_q08/duckdb:vortex-compact 457060095 / 441089304 / +3.6% 468165920 / 454966456 / +2.9% 0.98 / 0.97 / +0.7%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 100111408 / 99044510 / +1.1% 122617001 / 121600799 / +0.8% 0.82 / 0.81 / +0.2%
appian_q02/duckdb:parquet 201180173 / 198473636 / +1.4% 203824355 / 209704742 / -2.8% 0.99 / 0.95 / +4.3%
appian_q03/duckdb:parquet 125432427 / 126339262 / -0.7% 141952333 / 143510492 / -1.1% 0.88 / 0.88 / +0.4%
appian_q04/duckdb:parquet 443097217 / 427967665 / +3.5% 423123886 / 440679410 / -4.0% 1.05 / 0.97 / +7.8%
appian_q05/duckdb:parquet 144103974 / 142904875 / +0.8% 169297318 / 157065409 / +7.8% 0.85 / 0.91 / -6.4%
appian_q06/duckdb:parquet 263787944 / 259942832 / +1.5% 266773147 / 278666487 / -4.3% 0.99 / 0.93 / +6.0%
appian_q07/duckdb:parquet 154669487 / 154801954 / -0.1% 168927592 / 167116666 / +1.1% 0.92 / 0.93 / -1.2%
appian_q08/duckdb:parquet 383620823 / 379038132 / +1.2% 376499918 / 393402603 / -4.3% 1.02 / 0.96 / +5.8%

File Size Changes (8 files changed, +1.5% overall, 8↑ 0↓)
File Scale Format Base HEAD Change %
categoryview.vortex 1.0 vortex-compact 17.41 KB 103.65 KB +86.23 KB +495.2%
productview.vortex 1.0 vortex-compact 16.61 KB 94.62 KB +78.01 KB +469.7%
orderview.vortex 1.0 vortex-compact 31.01 MB 31.76 MB +762.62 KB +2.4%
customerview.vortex 1.0 vortex-compact 10.58 MB 10.80 MB +226.79 KB +2.1%
creditcardview.vortex 1.0 vortex-compact 32.19 MB 32.70 MB +528.32 KB +1.6%
addressview.vortex 1.0 vortex-compact 24.50 MB 24.81 MB +313.94 KB +1.3%
orderitemview.vortex 1.0 vortex-compact 155.96 MB 157.81 MB +1.85 MB +1.2%
taxrecordview.vortex 1.0 vortex-compact 17.32 MB 17.50 MB +181.65 KB +1.0%

Totals:

  • vortex-compact: 271.86 MB → 275.84 MB (+1.5%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 95c4954a vs base c93f5a9a


vortex / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 865447622 / 887453354 / -2.5%
compress time/Bimbo 3894489993 / 3954480678 / -1.5%
compress time/CMSprovider 2890676829 / 3047335369 / -5.1%
compress time/Euro2016 309164864 / 319000175 / -3.1%
compress time/Food 308264639 / 315302037 / -2.2%
compress time/HashTags 556741394 / 570624905 / -2.4%
compress time/TPC-H l_comment canonical 775904642 / 788118432 / -1.5%
compress time/TPC-H l_comment chunked 778646626 / 786588743 / -1.0%
compress time/taxi 426255429 / 436098344 / -2.3%
compress time/wide table cols=100 chunks=1 rows=1000 7601456 / 7211104 / +5.4%
compress time/wide table cols=100 chunks=50 rows=1000 7452153 / 7182317 / +3.8%
compress time/wide table cols=1000 chunks=1 rows=1000 73782696 / 70306957 / +4.9%
compress time/wide table cols=1000 chunks=50 rows=1000 73273935 / 69498235 / +5.4%
compress time/wide table cols=10000 chunks=1 rows=1000 788288790 / 779953023 / +1.1%
compress time/wide table cols=10000 chunks=50 rows=1000 791308637 / 796592066 / -0.7%
decompress time/Arade 9263111 / 9449197 / -2.0%
decompress time/Bimbo 63404526 / 62859933 / +0.9%
decompress time/CMSprovider 26491443 / 27630725 / -4.1%
decompress time/Euro2016 7259772 / 7366804 / -1.5%
decompress time/Food 2872573 / 2909296 / -1.3%
decompress time/HashTags 58632040 / 59662589 / -1.7%
decompress time/TPC-H l_comment canonical 21040243 / 22090229 / -4.8%
decompress time/TPC-H l_comment chunked 21192575 / 21781105 / -2.7%
decompress time/taxi 8426864 / 8546323 / -1.4%
decompress time/wide table cols=100 chunks=1 rows=1000 2050244 / 2035509 / +0.7%
decompress time/wide table cols=100 chunks=50 rows=1000 2035844 / 2067873 / -1.5%
decompress time/wide table cols=1000 chunks=1 rows=1000 19779726 / 19830510 / -0.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 19638491 / 19620058 / +0.1%
decompress time/wide table cols=10000 chunks=1 rows=1000 226924142 / 232546380 / -2.4%
decompress time/wide table cols=10000 chunks=50 rows=1000 228060262 / 229734892 / -0.7%
vortex / vortex-file-compressed / bytes (1.286x ❌, 0↑ 6↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 144601188 / 142210524 / +1.7%
vortex-file-compressed size/Bimbo 464267396 / 458475220 / +1.3%
vortex-file-compressed size/CMSprovider 423113500 / 420650636 / +0.6%
vortex-file-compressed size/Euro2016 164682756 / 164038260 / +0.4%
vortex-file-compressed size/Food 39147968 / 38946488 / +0.5%
vortex-file-compressed size/HashTags 192210036 / 190336420 / +1.0%
vortex-file-compressed size/TPC-H l_comment canonical 183397000 / 179845160 / +2.0%
vortex-file-compressed size/TPC-H l_comment chunked 183397000 / 179845160 / +2.0%
vortex-file-compressed size/taxi 51022516 / 50116916 / +1.8%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 1717432 / 932480 / +84.2% 🔴
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 1717432 / 932480 / +84.2% 🔴
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 17157832 / 9309680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 17157832 / 9309680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 171597832 / 93117680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 171597832 / 93117680 / +84.3% 🔴
vortex / vortex-file-compressed / ratio (1.082x ➖, 0↑ 6↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.384298979 / 0.394672077 / -2.6%
vortex:parquet-zstd ratio compress time/Bimbo 0.329888639 / 0.334187991 / -1.3%
vortex:parquet-zstd ratio compress time/CMSprovider 0.452772922 / 0.476565425 / -5.0%
vortex:parquet-zstd ratio compress time/Euro2016 0.286665147 / 0.294911996 / -2.8%
vortex:parquet-zstd ratio compress time/Food 0.416021491 / 0.425858844 / -2.3%
vortex:parquet-zstd ratio compress time/HashTags 0.304443421 / 0.311719011 / -2.3%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.295297031 / 0.299566965 / -1.4%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.294889108 / 0.298660757 / -1.3%
vortex:parquet-zstd ratio compress time/taxi 0.390530675 / 0.399524099 / -2.3%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.89671803 / 1.80704967 / +5.0%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.86995193 / 1.8130736 / +3.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.65049435 / 1.57159348 / +5.0%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.6134213 / 1.55977213 / +3.4%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.7083817 / 1.69562819 / +0.8%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.70315118 / 1.71617903 / -0.8%
vortex:parquet-zstd ratio decompress time/Arade 0.016648222 / 0.016924974 / -1.6%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0396214003 / 0.0391855889 / +1.1%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.01950392 / 0.0202346046 / -3.6%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0218516968 / 0.0221119232 / -1.2%
vortex:parquet-zstd ratio decompress time/Food 0.0169673802 / 0.017085331 / -0.7%
vortex:parquet-zstd ratio decompress time/HashTags 0.113688524 / 0.115654067 / -1.7%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0424180888 / 0.0443266004 / -4.3%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.042665833 / 0.0437252309 / -2.4%
vortex:parquet-zstd ratio decompress time/taxi 0.0388897847 / 0.0392803296 / -1.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.99154674 / 0.976966163 / +1.5%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.990834082 / 1.0012434 / -1.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.846880077 / 0.835195206 / +1.4%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.815166034 / 0.837090188 / -2.6%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.929393634 / 0.946305482 / -1.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.92041825 / 0.925315424 / -0.5%
vortex:parquet-zstd size/Arade 0.560438697 / 0.55117307 / +1.7%
vortex:parquet-zstd size/Bimbo 1.20740317 / 1.19233967 / +1.3%
vortex:parquet-zstd size/CMSprovider 1.12265076 / 1.11611602 / +0.6%
vortex:parquet-zstd size/Euro2016 1.33911229 / 1.33387159 / +0.4%
vortex:parquet-zstd size/Food 1.0965971 / 1.09095332 / +0.5%
vortex:parquet-zstd size/HashTags 1.43980154 / 1.42576671 / +1.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.15811468 / 1.13568553 / +2.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.15811468 / 1.13568553 / +2.0%
vortex:parquet-zstd size/taxi 0.922922597 / 0.906541619 / +1.8%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.84193976 / 1.00008151 / +84.2% 🔴
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.84193976 / 1.00008151 / +84.2% 🔴
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.84017853 / 0.99846375 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.84017853 / 0.99846375 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.84038851 / 0.998688074 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.84038851 / 0.998688074 / +84.3% 🔴
vortex / parquet / ns (1.000x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2252016446 / 2248584094 / +0.2%
parquet_rs-zstd compress time/Bimbo 11805468673 / 11833102291 / -0.2%
parquet_rs-zstd compress time/CMSprovider 6384385392 / 6394369402 / -0.2%
parquet_rs-zstd compress time/Euro2016 1078487801 / 1081679210 / -0.3%
parquet_rs-zstd compress time/Food 740982486 / 740390957 / +0.1%
parquet_rs-zstd compress time/HashTags 1828718758 / 1830574604 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2627539598 / 2630858951 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2640472653 / 2633719778 / +0.3%
parquet_rs-zstd compress time/taxi 1091477460 / 1091544528 / -0.0%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 4007689 / 3990540 / +0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3985211 / 3961404 / +0.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44703392 / 44736096 / -0.1%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 45415252 / 44556659 / +1.9%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 461424277 / 459978803 / +0.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 464614443 / 464166063 / +0.1%
parquet_rs-zstd decompress time/Arade 556402418 / 558299056 / -0.3%
parquet_rs-zstd decompress time/Bimbo 1600259597 / 1604159455 / -0.2%
parquet_rs-zstd decompress time/CMSprovider 1358262496 / 1365518406 / -0.5%
parquet_rs-zstd decompress time/Euro2016 332229211 / 333159804 / -0.3%
parquet_rs-zstd decompress time/Food 169299737 / 170280342 / -0.6%
parquet_rs-zstd decompress time/HashTags 515725230 / 515871086 / -0.0%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 496020533 / 498351527 / -0.5%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 496710682 / 498135849 / -0.3%
parquet_rs-zstd decompress time/taxi 216685797 / 217572589 / -0.4%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2067723 / 2083500 / -0.8%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2054677 / 2065305 / -0.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23355994 / 23743563 / -1.6%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 24091400 / 23438404 / +2.8%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 244163650 / 245741343 / -0.6%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 247778944 / 248277383 / -0.2%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.996x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 100293276 / 99475687 / +0.8%
arrow-ipc compress time/Bimbo 623531255 / 623956525 / -0.1%
arrow-ipc compress time/CMSprovider 382898232 / 386188776 / -0.9%
arrow-ipc compress time/Euro2016 38464969 / 38741766 / -0.7%
arrow-ipc compress time/Food 34000600 / 34106616 / -0.3%
arrow-ipc compress time/HashTags 78588874 / 79327299 / -0.9%
arrow-ipc compress time/TPC-H l_comment canonical 495581010 / 499564273 / -0.8%
arrow-ipc compress time/TPC-H l_comment chunked 501258385 / 504337956 / -0.6%
arrow-ipc compress time/taxi 75099016 / 75356659 / -0.3%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 206565 / 205724 / +0.4%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 202990 / 205997 / -1.5%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2251506 / 2259631 / -0.4%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2210455 / 2256817 / -2.1%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25358943 / 25706180 / -1.4%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25521248 / 25897949 / -1.5%
arrow-ipc decompress time/Arade 181057878 / 181207329 / -0.1%
arrow-ipc decompress time/Bimbo 405855144 / 425273564 / -4.6%
arrow-ipc decompress time/CMSprovider 581740671 / 581684438 / +0.0%
arrow-ipc decompress time/Euro2016 75037634 / 74670549 / +0.5%
arrow-ipc decompress time/Food 58465400 / 58395550 / +0.1%
arrow-ipc decompress time/HashTags 143171482 / 142757625 / +0.3%
arrow-ipc decompress time/TPC-H l_comment canonical 531455571 / 534155650 / -0.5%
arrow-ipc decompress time/TPC-H l_comment chunked 532044239 / 534147498 / -0.4%
arrow-ipc decompress time/taxi 48527689 / 48883106 / -0.7%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 321858 / 323013 / -0.4%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 319756 / 321779 / -0.6%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3461579 / 3477704 / -0.5%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3481172 / 3410494 / +2.1%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35442682 / 35230919 / +0.6%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35329964 / 34880692 / +1.3%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 95c4954a vs base c93f5a9a


vortex / vortex-file-compressed / ms (1.006x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.241101 / 32.166356 / +0.2%
read/clickbench/URL/shard-0/onpair-12 19.904581 / 20.072693 / -0.8%
read/tpch/l_comment/fsst 56.474634 / 53.549542 / +5.5%
read/tpch/l_comment/onpair-12 49.265824 / 49.364394 / -0.2%
write/clickbench/URL/shard-0/fsst 590.96634 / 594.297572 / -0.6%
write/clickbench/URL/shard-0/onpair-12 986.31286 / 986.236212 / +0.0%
write/tpch/l_comment/fsst 1991.23627 / 1994.48671 / -0.2%
write/tpch/l_comment/onpair-12 2215.31449 / 2200.02709 / +0.7%
vortex / vortex-file-compressed / % (1.017x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.638347 / 47.3999586 / +0.5%
size/clickbench/URL/shard-0/onpair-12 30.4612008 / 30.225605 / +0.8%
size/tpch/l_comment/fsst 31.298062 / 30.5819725 / +2.3%
size/tpch/l_comment/onpair-12 26.6875683 / 25.8644092 / +3.2%

Copy link
Copy Markdown
Contributor Author

The three BENCHMARK FAILED comments above are EC2 spot interruptions, not a failure of this PR.

Each failed job ends with the same runner-provider error rather than any Vortex output:

##[error]AWS interrupted the EC2 Spot instance running this job.
RunsOn can retry it after the workflow run finishes.
  • all-compression-bench / bench / bench — instance i-083aa1e5bdb727232, us-east-1b, died at 2.89 min
  • all-sql-bench / sql / bench (tpch-s3-10) — instance i-0193df05ee1ec85f5, us-east-1a, died at 2.74 min
  • all-sql-bench / sql / bench (appian-nvme) — same window

All three died within six seconds of each other on different instances in two availability zones, which is a fleet-wide c8gd.metal-24xl spot reclamation, not anything in the diff. The polarsignals job survived on its own instance and produced clean results over the same code.

I'll re-run the failed jobs once the run finishes, as RunsOn's message instructs — they can't be retried while it is still in progress.

For context on what these runs are measuring: the last commit deliberately sets VORTEX_DIRECT_IO=1 and VORTEX_SEGMENT_PADDING=always on the benchmark jobs, so this run compares aligned writes read back through O_DIRECT against develop's buffered, packed baseline. That commit is an experiment and should be reverted before merging.


Generated by Claude Code

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +14.6%
Engines: DataFusion No clear signal (+4.6%, low confidence) · DuckDB Likely regression (+25.5%, low confidence)
Vortex (geomean): hot 1.145x ❌ · cold 0.844x ✅
Parquet (geomean): hot 0.999x ➖ · cold 1.034x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6943692 / 6726260 / +3.2% 20986873 / 20730642 / +1.2% 0.33 / 0.32 / +2.0%
fineweb_q01/datafusion:vortex-file-compressed 12486801 / 12477362 / +0.1% 44289254 / 49344110 / -10.2% 🟢 0.28 / 0.25 / +11.5%
fineweb_q02/datafusion:vortex-file-compressed 13285676 / 13335722 / -0.4% 48585616 / 52814813 / -8.0% 0.27 / 0.25 / +8.3%
fineweb_q03/datafusion:vortex-file-compressed 20071543 / 20163072 / -0.5% 105149591 / 99732774 / +5.4% 0.19 / 0.20 / -5.6%
fineweb_q04/datafusion:vortex-file-compressed 75507586 / 76535666 / -1.3% 156223496 / 150023268 / +4.1% 0.48 / 0.51 / -5.3%
fineweb_q05/datafusion:vortex-file-compressed 60380034 / 60735904 / -0.6% 134012950 / 140193857 / -4.4% 0.45 / 0.43 / +4.0%
fineweb_q06/datafusion:vortex-file-compressed 19884960 / 19660684 / +1.1% 105791802 / 102322651 / +3.4% 0.19 / 0.19 / -2.2%
fineweb_q07/datafusion:vortex-file-compressed 17604440 / 16065176 / +9.6% 102794541 / 97418508 / +5.5% 0.17 / 0.16 / +3.9%
fineweb_q08/datafusion:vortex-file-compressed 9749239 / 10690661 / -8.8% 41358208 / 44116003 / -6.3% 0.24 / 0.24 / -2.7%
datafusion / vortex-compact / ns (1.068x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6968609 / 7032346 / -0.9% 20256515 / 19027861 / +6.5% 0.34 / 0.37 / -6.9%
fineweb_q01/datafusion:vortex-compact 60984136 / 44456314 / +37.2% 🔴 77206162 / 77815085 / -0.8% 0.79 / 0.57 / +38.3%
fineweb_q02/datafusion:vortex-compact 59954899 / 45018740 / +33.2% 🔴 77845707 / 80975552 / -3.9% 0.77 / 0.56 / +38.5%
fineweb_q03/datafusion:vortex-compact 160728768 / 169313186 / -5.1% 225170532 / 293109172 / -23.2% 🟢 0.71 / 0.58 / +23.6%
fineweb_q04/datafusion:vortex-compact 178296438 / 178237198 / +0.0% 239865198 / 264989296 / -9.5% 0.74 / 0.67 / +10.5%
fineweb_q05/datafusion:vortex-compact 156864506 / 154412434 / +1.6% 235747942 / 228756129 / +3.1% 0.67 / 0.68 / -1.4%
fineweb_q06/datafusion:vortex-compact 87464782 / 88319857 / -1.0% 178019930 / 161574433 / +10.2% 🔴 0.49 / 0.55 / -10.1%
fineweb_q07/datafusion:vortex-compact 89941590 / 89030688 / +1.0% 157172477 / 156669113 / +0.3% 0.57 / 0.57 / +0.7%
fineweb_q08/datafusion:vortex-compact 9766236 / 9426087 / +3.6% 33769760 / 37519399 / -10.0% 0.29 / 0.25 / +15.1%
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9287028 / 9544301 / -2.7% 31979809 / 33442194 / -4.4% 0.29 / 0.29 / +1.8%
fineweb_q01/datafusion:parquet 75590936 / 75351553 / +0.3% 156642388 / 144869117 / +8.1% 0.48 / 0.52 / -7.2%
fineweb_q02/datafusion:parquet 73995259 / 76058232 / -2.7% 156707785 / 146598420 / +6.9% 0.47 / 0.52 / -9.0%
fineweb_q03/datafusion:parquet 73617466 / 73425153 / +0.3% 156048802 / 146861281 / +6.3% 0.47 / 0.50 / -5.6%
fineweb_q04/datafusion:parquet 82022318 / 83516917 / -1.8% 152129817 / 140507993 / +8.3% 0.54 / 0.59 / -9.3%
fineweb_q05/datafusion:parquet 81249222 / 82116467 / -1.1% 157065078 / 140777121 / +11.6% 🔴 0.52 / 0.58 / -11.3%
fineweb_q06/datafusion:parquet 75460899 / 76359124 / -1.2% 154982881 / 144635238 / +7.2% 0.49 / 0.53 / -7.8%
fineweb_q07/datafusion:parquet 73902432 / 73761139 / +0.2% 155264298 / 141449472 / +9.8% 0.48 / 0.52 / -8.7%
fineweb_q08/datafusion:parquet 72982180 / 73609070 / -0.9% 161971703 / 146703264 / +10.4% 🔴 0.45 / 0.50 / -10.2%
duckdb / vortex-file-compressed / ns (1.550x ❌, 0↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2067324 / 1843530 / +12.1% 🔴 4955819 / 4713904 / +5.1% 0.42 / 0.39 / +6.7%
fineweb_q01/duckdb:vortex-file-compressed 25493450 / 24512481 / +4.0% 28291981 / 61694358 / -54.1% 🟢 0.90 / 0.40 / +126.8%
fineweb_q02/duckdb:vortex-file-compressed 24672771 / 21542216 / +14.5% 🔴 30395319 / 61543521 / -50.6% 🟢 0.81 / 0.35 / +131.9%
fineweb_q03/duckdb:vortex-file-compressed 86460325 / 29427934 / +193.8% 🔴 88482790 / 163121258 / -45.8% 🟢 0.98 / 0.18 / +441.6%
fineweb_q04/duckdb:vortex-file-compressed 107094856 / 76647157 / +39.7% 🔴 105607442 / 132955796 / -20.6% 🟢 1.01 / 0.58 / +75.9%
fineweb_q05/duckdb:vortex-file-compressed 102815166 / 59822845 / +71.9% 🔴 103868758 / 111951832 / -7.2% 0.99 / 0.53 / +85.2%
fineweb_q06/duckdb:vortex-file-compressed 87625932 / 51238184 / +71.0% 🔴 92108863 / 152664729 / -39.7% 🟢 0.95 / 0.34 / +183.4%
fineweb_q07/duckdb:vortex-file-compressed 83704918 / 29891385 / +180.0% 🔴 88044791 / 109712675 / -19.7% 🟢 0.95 / 0.27 / +248.9%
fineweb_q08/duckdb:vortex-file-compressed 7516596 / 6567940 / +14.4% 🔴 11378655 / 16320538 / -30.3% 🟢 0.66 / 0.40 / +64.1%
duckdb / vortex-compact / ns (1.035x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2306409 / 3034978 / -24.0% 🟢 5095980 / 8108161 / -37.1% 🟢 0.45 / 0.37 / +20.9%
fineweb_q01/duckdb:vortex-compact 54482098 / 45503742 / +19.7% 🔴 69536599 / 66057652 / +5.3% 0.78 / 0.69 / +13.7%
fineweb_q02/duckdb:vortex-compact 56283377 / 55654264 / +1.1% 75879023 / 100971662 / -24.9% 🟢 0.74 / 0.55 / +34.6%
fineweb_q03/duckdb:vortex-compact 194611179 / 188797640 / +3.1% 197255598 / 294231188 / -33.0% 🟢 0.99 / 0.64 / +53.8%
fineweb_q04/duckdb:vortex-compact 224062110 / 187538448 / +19.5% 🔴 236149589 / 242190267 / -2.5% 0.95 / 0.77 / +22.5%
fineweb_q05/duckdb:vortex-compact 191725562 / 183263616 / +4.6% 211566996 / 254335338 / -16.8% 🟢 0.91 / 0.72 / +25.8%
fineweb_q06/duckdb:vortex-compact 118182120 / 109272839 / +8.2% 126130501 / 199577668 / -36.8% 🟢 0.94 / 0.55 / +71.1%
fineweb_q07/duckdb:vortex-compact 123781361 / 114002595 / +8.6% 131770488 / 175705996 / -25.0% 🟢 0.94 / 0.65 / +44.8%
fineweb_q08/duckdb:vortex-compact 5850935 / 5988716 / -2.3% 11539170 / 13834458 / -16.6% 🟢 0.51 / 0.43 / +17.1%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22973115 / 21234978 / +8.2% 25970005 / 23299074 / +11.5% 🔴 0.88 / 0.91 / -2.9%
fineweb_q01/duckdb:parquet 44455048 / 44856516 / -0.9% 53255619 / 57631272 / -7.6% 0.83 / 0.78 / +7.2%
fineweb_q02/duckdb:parquet 43889738 / 43801900 / +0.2% 55977470 / 53089555 / +5.4% 0.78 / 0.83 / -5.0%
fineweb_q03/duckdb:parquet 94982522 / 94509843 / +0.5% 188410248 / 182842218 / +3.0% 0.50 / 0.52 / -2.5%
fineweb_q04/duckdb:parquet 153570618 / 151467950 / +1.4% 196166308 / 218822966 / -10.4% 🟢 0.78 / 0.69 / +13.1%
fineweb_q05/duckdb:parquet 143067164 / 142199992 / +0.6% 202536602 / 199949344 / +1.3% 0.71 / 0.71 / -0.7%
fineweb_q06/duckdb:parquet 70903636 / 71163871 / -0.4% 126373690 / 116652236 / +8.3% 0.56 / 0.61 / -8.0%
fineweb_q07/duckdb:parquet 71743646 / 71699721 / +0.1% 144050766 / 150191399 / -4.1% 0.50 / 0.48 / +4.3%
fineweb_q08/duckdb:parquet 23402801 / 23752949 / -1.5% 23797294 / 25331543 / -6.1% 0.98 / 0.94 / +4.9%

File Size Changes (2 files changed, +0.1% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +795.93 KB +0.1%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +838.02 KB +0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.1%)
  • vortex-file-compressed: 1.43 GB → 1.44 GB (+0.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (+3.9%, low confidence) · DuckDB Likely regression (+11.4%, medium confidence)
Vortex (geomean): hot 1.053x ➖ · cold 0.946x ➖
Parquet (geomean): hot 0.979x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -2.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16833980 / 16841850 / -0.0% 49753187 / 47252405 / +5.3% 0.34 / 0.36 / -5.1%
tpch_q02/datafusion:vortex-file-compressed 17543377 / 17328078 / +1.2% 40778489 / 37791472 / +7.9% 0.43 / 0.46 / -6.2%
tpch_q03/datafusion:vortex-file-compressed 19467546 / 19085706 / +2.0% 53371059 / 53884209 / -1.0% 0.36 / 0.35 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 9946408 / 10168212 / -2.2% 39664153 / 36113265 / +9.8% 0.25 / 0.28 / -10.9%
tpch_q05/datafusion:vortex-file-compressed 37108127 / 37053535 / +0.1% 70349594 / 67954784 / +3.5% 0.53 / 0.55 / -3.3%
tpch_q06/datafusion:vortex-file-compressed 6406865 / 6241549 / +2.6% 34037524 / 32949761 / +3.3% 0.19 / 0.19 / -0.6%
tpch_q07/datafusion:vortex-file-compressed 52354188 / 51841763 / +1.0% 85533941 / 86938492 / -1.6% 0.61 / 0.60 / +2.6%
tpch_q08/datafusion:vortex-file-compressed 51769688 / 51941492 / -0.3% 85868247 / 78674715 / +9.1% 0.60 / 0.66 / -8.7%
tpch_q09/datafusion:vortex-file-compressed 50976211 / 50442551 / +1.1% 82176797 / 80460431 / +2.1% 0.62 / 0.63 / -1.1%
tpch_q10/datafusion:vortex-file-compressed 17011109 / 17207510 / -1.1% 52770572 / 52354132 / +0.8% 0.32 / 0.33 / -1.9%
tpch_q11/datafusion:vortex-file-compressed 15195987 / 15107721 / +0.6% 38248812 / 34876545 / +9.7% 0.40 / 0.43 / -8.3%
tpch_q12/datafusion:vortex-file-compressed 22650347 / 22962389 / -1.4% 56878099 / 47747084 / +19.1% 🔴 0.40 / 0.48 / -17.2%
tpch_q13/datafusion:vortex-file-compressed 20167435 / 20102638 / +0.3% 47103145 / 44420634 / +6.0% 0.43 / 0.45 / -5.4%
tpch_q14/datafusion:vortex-file-compressed 15230727 / 15123941 / +0.7% 44915659 / 41738161 / +7.6% 0.34 / 0.36 / -6.4%
tpch_q15/datafusion:vortex-file-compressed 18774011 / 18997882 / -1.2% 51424571 / 47135376 / +9.1% 0.37 / 0.40 / -9.4%
tpch_q16/datafusion:vortex-file-compressed 18753156 / 18794504 / -0.2% 41528681 / 39562358 / +5.0% 0.45 / 0.48 / -4.9%
tpch_q17/datafusion:vortex-file-compressed 28423423 / 27992951 / +1.5% 63487802 / 59644834 / +6.4% 0.45 / 0.47 / -4.6%
tpch_q18/datafusion:vortex-file-compressed 37123737 / 36978363 / +0.4% 62306988 / 60945195 / +2.2% 0.60 / 0.61 / -1.8%
tpch_q19/datafusion:vortex-file-compressed 14152849 / 14168406 / -0.1% 45293318 / 41088187 / +10.2% 🔴 0.31 / 0.34 / -9.4%
tpch_q20/datafusion:vortex-file-compressed 20933912 / 21025182 / -0.4% 49025025 / 47297329 / +3.7% 0.43 / 0.44 / -3.9%
tpch_q21/datafusion:vortex-file-compressed 39952820 / 39108149 / +2.2% 71275112 / 69315508 / +2.8% 0.56 / 0.56 / -0.6%
tpch_q22/datafusion:vortex-file-compressed 11567801 / 11198895 / +3.3% 36090998 / 34800546 / +3.7% 0.32 / 0.32 / -0.4%
datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18428907 / 18423433 / +0.0% 44585554 / 45218762 / -1.4% 0.41 / 0.41 / +1.5%
tpch_q02/datafusion:vortex-compact 19684539 / 19629800 / +0.3% 39195913 / 39484399 / -0.7% 0.50 / 0.50 / +1.0%
tpch_q03/datafusion:vortex-compact 20103039 / 20209567 / -0.5% 51215557 / 48488227 / +5.6% 0.39 / 0.42 / -5.8%
tpch_q04/datafusion:vortex-compact 11640819 / 11073055 / +5.1% 35934921 / 33303383 / +7.9% 0.32 / 0.33 / -2.6%
tpch_q05/datafusion:vortex-compact 38373031 / 38135824 / +0.6% 67790228 / 68196354 / -0.6% 0.57 / 0.56 / +1.2%
tpch_q06/datafusion:vortex-compact 6744948 / 6720728 / +0.4% 33077041 / 30269099 / +9.3% 0.20 / 0.22 / -8.2%
tpch_q07/datafusion:vortex-compact 52096983 / 52894918 / -1.5% 83589826 / 75737805 / +10.4% 🔴 0.62 / 0.70 / -10.8%
tpch_q08/datafusion:vortex-compact 52013807 / 52648741 / -1.2% 85991846 / 82894459 / +3.7% 0.60 / 0.64 / -4.8%
tpch_q09/datafusion:vortex-compact 51018698 / 50250571 / +1.5% 81806307 / 80010448 / +2.2% 0.62 / 0.63 / -0.7%
tpch_q10/datafusion:vortex-compact 19456055 / 19129225 / +1.7% 51955513 / 49844964 / +4.2% 0.37 / 0.38 / -2.4%
tpch_q11/datafusion:vortex-compact 15854511 / 16051756 / -1.2% 36557288 / 34351998 / +6.4% 0.43 / 0.47 / -7.2%
tpch_q12/datafusion:vortex-compact 24113722 / 24158464 / -0.2% 50076400 / 47220059 / +6.0% 0.48 / 0.51 / -5.9%
tpch_q13/datafusion:vortex-compact 20979107 / 21145410 / -0.8% 40616823 / 39500374 / +2.8% 0.52 / 0.54 / -3.5%
tpch_q14/datafusion:vortex-compact 16486472 / 16424033 / +0.4% 43951696 / 42489501 / +3.4% 0.38 / 0.39 / -3.0%
tpch_q15/datafusion:vortex-compact 20037249 / 19901155 / +0.7% 46807976 / 45390241 / +3.1% 0.43 / 0.44 / -2.4%
tpch_q16/datafusion:vortex-compact 18985081 / 18456257 / +2.9% 38684006 / 38727371 / -0.1% 0.49 / 0.48 / +3.0%
tpch_q17/datafusion:vortex-compact 29234447 / 29080440 / +0.5% 59128398 / 57917311 / +2.1% 0.49 / 0.50 / -1.5%
tpch_q18/datafusion:vortex-compact 38466476 / 38176385 / +0.8% 59214130 / 59331811 / -0.2% 0.65 / 0.64 / +1.0%
tpch_q19/datafusion:vortex-compact 18997028 / 18739971 / +1.4% 45660923 / 46793810 / -2.4% 0.42 / 0.40 / +3.9%
tpch_q20/datafusion:vortex-compact 22189072 / 22027246 / +0.7% 47132189 / 45496543 / +3.6% 0.47 / 0.48 / -2.8%
tpch_q21/datafusion:vortex-compact 42611947 / 42571507 / +0.1% 70864490 / 69425168 / +2.1% 0.60 / 0.61 / -1.9%
tpch_q22/datafusion:vortex-compact 11723492 / 11768009 / -0.4% 32944130 / 32012885 / +2.9% 0.36 / 0.37 / -3.2%
datafusion / parquet / ns (0.967x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 61627153 / 67273283 / -8.4% 81918658 / 87687149 / -6.6% 0.75 / 0.77 / -1.9%
tpch_q02/datafusion:parquet 48660814 / 52855327 / -7.9% 68494235 / 75695520 / -9.5% 0.71 / 0.70 / +1.7%
tpch_q03/datafusion:parquet 67556962 / 72087763 / -6.3% 91894908 / 98657229 / -6.9% 0.74 / 0.73 / +0.6%
tpch_q04/datafusion:parquet 36619732 / 39886960 / -8.2% 56689434 / 62771870 / -9.7% 0.65 / 0.64 / +1.7%
tpch_q05/datafusion:parquet 80568328 / 87730361 / -8.2% 112461717 / 118148543 / -4.8% 0.72 / 0.74 / -3.5%
tpch_q06/datafusion:parquet 25812298 / 28121644 / -8.2% 46019404 / 50470712 / -8.8% 0.56 / 0.56 / +0.7%
tpch_q07/datafusion:parquet 86318036 / 94099283 / -8.3% 116558195 / 129233587 / -9.8% 0.74 / 0.73 / +1.7%
tpch_q08/datafusion:parquet 89766828 / 95836873 / -6.3% 119919845 / 126724510 / -5.4% 0.75 / 0.76 / -1.0%
tpch_q09/datafusion:parquet 105335960 / 114785812 / -8.2% 136639025 / 149035501 / -8.3% 0.77 / 0.77 / +0.1%
tpch_q10/datafusion:parquet 80032546 / 79867174 / +0.2% 116788511 / 114666339 / +1.9% 0.69 / 0.70 / -1.6%
tpch_q11/datafusion:parquet 38536495 / 39879865 / -3.4% 66616391 / 65340184 / +2.0% 0.58 / 0.61 / -5.2%
tpch_q12/datafusion:parquet 62176534 / 61896749 / +0.5% 93373163 / 91754425 / +1.8% 0.67 / 0.67 / -1.3%
tpch_q13/datafusion:parquet 160055220 / 159656590 / +0.2% 188142005 / 187131231 / +0.5% 0.85 / 0.85 / -0.3%
tpch_q14/datafusion:parquet 39965304 / 39770349 / +0.5% 71389875 / 68235685 / +4.6% 0.56 / 0.58 / -3.9%
tpch_q15/datafusion:parquet 46738028 / 46782957 / -0.1% 73900131 / 72955990 / +1.3% 0.63 / 0.64 / -1.4%
tpch_q16/datafusion:parquet 38501161 / 38660210 / -0.4% 59024603 / 60583614 / -2.6% 0.65 / 0.64 / +2.2%
tpch_q17/datafusion:parquet 116756687 / 116433638 / +0.3% 146191254 / 143728905 / +1.7% 0.80 / 0.81 / -1.4%
tpch_q18/datafusion:parquet 115656306 / 115819736 / -0.1% 144504089 / 142343727 / +1.5% 0.80 / 0.81 / -1.6%
tpch_q19/datafusion:parquet 50758053 / 49887562 / +1.7% 82258529 / 80538243 / +2.1% 0.62 / 0.62 / -0.4%
tpch_q20/datafusion:parquet 58151378 / 58344580 / -0.3% 88069635 / 89332677 / -1.4% 0.66 / 0.65 / +1.1%
tpch_q21/datafusion:parquet 99515995 / 99727762 / -0.2% 126889810 / 127385237 / -0.4% 0.78 / 0.78 / +0.2%
tpch_q22/datafusion:parquet 42181905 / 42098723 / +0.2% 63557744 / 62071003 / +2.4% 0.66 / 0.68 / -2.1%
duckdb / vortex-file-compressed / ns (1.105x ❌, 0↑ 12↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 12623775 / 11573337 / +9.1% 15833908 / 23524769 / -32.7% 🟢 0.80 / 0.49 / +62.1%
tpch_q02/duckdb:vortex-file-compressed 19057214 / 17731492 / +7.5% 25183112 / 28586514 / -11.9% 🟢 0.76 / 0.62 / +22.0%
tpch_q03/duckdb:vortex-file-compressed 20717936 / 18615732 / +11.3% 🔴 28375023 / 39532612 / -28.2% 🟢 0.73 / 0.47 / +55.1%
tpch_q04/duckdb:vortex-file-compressed 17886056 / 17648331 / +1.3% 25798694 / 31268806 / -17.5% 🟢 0.69 / 0.56 / +22.8%
tpch_q05/duckdb:vortex-file-compressed 24280053 / 22823748 / +6.4% 34142204 / 36846688 / -7.3% 0.71 / 0.62 / +14.8%
tpch_q06/duckdb:vortex-file-compressed 7448132 / 5721653 / +30.2% 🔴 10809178 / 14362119 / -24.7% 🟢 0.69 / 0.40 / +73.0%
tpch_q07/duckdb:vortex-file-compressed 23603830 / 21361920 / +10.5% 🔴 33509312 / 37568738 / -10.8% 🟢 0.70 / 0.57 / +23.9%
tpch_q08/duckdb:vortex-file-compressed 26536227 / 23801721 / +11.5% 🔴 33056916 / 43023990 / -23.2% 🟢 0.80 / 0.55 / +45.1%
tpch_q09/duckdb:vortex-file-compressed 33670032 / 29808259 / +13.0% 🔴 42016457 / 48248948 / -12.9% 🟢 0.80 / 0.62 / +29.7%
tpch_q10/duckdb:vortex-file-compressed 31626922 / 28602470 / +10.6% 🔴 38476957 / 46421819 / -17.1% 🟢 0.82 / 0.62 / +33.4%
tpch_q11/duckdb:vortex-file-compressed 8864209 / 8070549 / +9.8% 16650423 / 15161481 / +9.8% 0.53 / 0.53 / +0.0%
tpch_q12/duckdb:vortex-file-compressed 19450689 / 16479710 / +18.0% 🔴 25068309 / 32070174 / -21.8% 🟢 0.78 / 0.51 / +51.0%
tpch_q13/duckdb:vortex-file-compressed 23209279 / 22536280 / +3.0% 33254871 / 39229230 / -15.2% 🟢 0.70 / 0.57 / +21.5%
tpch_q14/duckdb:vortex-file-compressed 14913095 / 13247587 / +12.6% 🔴 20492860 / 25245757 / -18.8% 🟢 0.73 / 0.52 / +38.7%
tpch_q15/duckdb:vortex-file-compressed 10505000 / 9654349 / +8.8% 16424276 / 21940075 / -25.1% 🟢 0.64 / 0.44 / +45.4%
tpch_q16/duckdb:vortex-file-compressed 19150584 / 18524517 / +3.4% 24019960 / 24609896 / -2.4% 0.80 / 0.75 / +5.9%
tpch_q17/duckdb:vortex-file-compressed 17546776 / 14784392 / +18.7% 🔴 26853514 / 36085173 / -25.6% 🟢 0.65 / 0.41 / +59.5%
tpch_q18/duckdb:vortex-file-compressed 28927386 / 24948415 / +15.9% 🔴 33049787 / 37449344 / -11.7% 🟢 0.88 / 0.67 / +31.4%
tpch_q19/duckdb:vortex-file-compressed 25894599 / 23123625 / +12.0% 🔴 32414994 / 36506740 / -11.2% 🟢 0.80 / 0.63 / +26.1%
tpch_q20/duckdb:vortex-file-compressed 20328550 / 17574543 / +15.7% 🔴 29612398 / 34988695 / -15.4% 🟢 0.69 / 0.50 / +36.7%
tpch_q21/duckdb:vortex-file-compressed 69376865 / 66021399 / +5.1% 82683537 / 81080063 / +2.0% 0.84 / 0.81 / +3.0%
tpch_q22/duckdb:vortex-file-compressed 12571163 / 12588773 / -0.1% 22665700 / 22874248 / -0.9% 0.55 / 0.55 / +0.8%
duckdb / vortex-compact / ns (1.104x ❌, 1↑ 12↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 11952061 / 14667341 / -18.5% 🟢 19405230 / 23093313 / -16.0% 🟢 0.62 / 0.64 / -3.0%
tpch_q02/duckdb:vortex-compact 21346821 / 20158306 / +5.9% 28871604 / 30433534 / -5.1% 0.74 / 0.66 / +11.6%
tpch_q03/duckdb:vortex-compact 21347113 / 18995005 / +12.4% 🔴 30973862 / 38213070 / -18.9% 🟢 0.69 / 0.50 / +38.6%
tpch_q04/duckdb:vortex-compact 19580871 / 18350162 / +6.7% 27249831 / 30798001 / -11.5% 🟢 0.72 / 0.60 / +20.6%
tpch_q05/duckdb:vortex-compact 26154893 / 22430186 / +16.6% 🔴 33024882 / 38602737 / -14.4% 🟢 0.79 / 0.58 / +36.3%
tpch_q06/duckdb:vortex-compact 9452415 / 6301096 / +50.0% 🔴 12246920 / 16383171 / -25.2% 🟢 0.77 / 0.38 / +100.7%
tpch_q07/duckdb:vortex-compact 24300673 / 21743063 / +11.8% 🔴 32763419 / 40160075 / -18.4% 🟢 0.74 / 0.54 / +37.0%
tpch_q08/duckdb:vortex-compact 28787339 / 25890738 / +11.2% 🔴 35238886 / 42617172 / -17.3% 🟢 0.82 / 0.61 / +34.5%
tpch_q09/duckdb:vortex-compact 34616412 / 30614142 / +13.1% 🔴 43799844 / 44727732 / -2.1% 0.79 / 0.68 / +15.5%
tpch_q10/duckdb:vortex-compact 32269338 / 31242068 / +3.3% 38973021 / 50523901 / -22.9% 🟢 0.83 / 0.62 / +33.9%
tpch_q11/duckdb:vortex-compact 11424424 / 9393232 / +21.6% 🔴 15852296 / 17468025 / -9.2% 0.72 / 0.54 / +34.0%
tpch_q12/duckdb:vortex-compact 21554897 / 18662579 / +15.5% 🔴 28040295 / 31947651 / -12.2% 🟢 0.77 / 0.58 / +31.6%
tpch_q13/duckdb:vortex-compact 25038041 / 22748269 / +10.1% 🔴 41172089 / 47977915 / -14.2% 🟢 0.61 / 0.47 / +28.3%
tpch_q14/duckdb:vortex-compact 16008169 / 15025789 / +6.5% 21722665 / 26979843 / -19.5% 🟢 0.74 / 0.56 / +32.3%
tpch_q15/duckdb:vortex-compact 11918321 / 9865524 / +20.8% 🔴 20939929 / 22377310 / -6.4% 0.57 / 0.44 / +29.1%
tpch_q16/duckdb:vortex-compact 20650042 / 20454980 / +1.0% 24831347 / 27072902 / -8.3% 0.83 / 0.76 / +10.1%
tpch_q17/duckdb:vortex-compact 19014486 / 16535131 / +15.0% 🔴 28624659 / 32222958 / -11.2% 🟢 0.66 / 0.51 / +29.4%
tpch_q18/duckdb:vortex-compact 28465954 / 26848418 / +6.0% 34389159 / 41829069 / -17.8% 🟢 0.83 / 0.64 / +29.0%
tpch_q19/duckdb:vortex-compact 26485407 / 24628367 / +7.5% 33843739 / 35964077 / -5.9% 0.78 / 0.68 / +14.3%
tpch_q20/duckdb:vortex-compact 22285836 / 19124358 / +16.5% 🔴 32831294 / 37071327 / -11.4% 🟢 0.68 / 0.52 / +31.6%
tpch_q21/duckdb:vortex-compact 71496846 / 69106962 / +3.5% 81981649 / 86728344 / -5.5% 0.87 / 0.80 / +9.4%
tpch_q22/duckdb:vortex-compact 13639426 / 12864733 / +6.0% 22018180 / 25298390 / -13.0% 🟢 0.62 / 0.51 / +21.8%
duckdb / parquet / ns (0.992x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60047690 / 60357845 / -0.5% 76356872 / 66718108 / +14.4% 🔴 0.79 / 0.90 / -13.1%
tpch_q02/duckdb:parquet 34730742 / 35530048 / -2.2% 42925508 / 43216727 / -0.7% 0.81 / 0.82 / -1.6%
tpch_q03/duckdb:parquet 61971184 / 62579421 / -1.0% 74427799 / 74093185 / +0.5% 0.83 / 0.84 / -1.4%
tpch_q04/duckdb:parquet 42987818 / 45748894 / -6.0% 53184861 / 53137188 / +0.1% 0.81 / 0.86 / -6.1%
tpch_q05/duckdb:parquet 60826224 / 61081593 / -0.4% 72871629 / 73721538 / -1.2% 0.83 / 0.83 / +0.7%
tpch_q06/duckdb:parquet 20012545 / 20298984 / -1.4% 24568733 / 24700480 / -0.5% 0.81 / 0.82 / -0.9%
tpch_q07/duckdb:parquet 60857402 / 61394501 / -0.9% 72545626 / 72481550 / +0.1% 0.84 / 0.85 / -1.0%
tpch_q08/duckdb:parquet 72896061 / 73836951 / -1.3% 87266619 / 87738454 / -0.5% 0.84 / 0.84 / -0.7%
tpch_q09/duckdb:parquet 113626716 / 115073006 / -1.3% 131000150 / 130308202 / +0.5% 0.87 / 0.88 / -1.8%
tpch_q10/duckdb:parquet 108366948 / 109092836 / -0.7% 122737379 / 125015639 / -1.8% 0.88 / 0.87 / +1.2%
tpch_q11/duckdb:parquet 20082443 / 20253054 / -0.8% 23823249 / 24355852 / -2.2% 0.84 / 0.83 / +1.4%
tpch_q12/duckdb:parquet 41211908 / 41623713 / -1.0% 48919927 / 49514412 / -1.2% 0.84 / 0.84 / +0.2%
tpch_q13/duckdb:parquet 238697635 / 239305747 / -0.3% 250361548 / 249047976 / +0.5% 0.95 / 0.96 / -0.8%
tpch_q14/duckdb:parquet 43403892 / 43976951 / -1.3% 52323778 / 52781165 / -0.9% 0.83 / 0.83 / -0.4%
tpch_q15/duckdb:parquet 27687023 / 25084238 / +10.4% 🔴 31793120 / 31691726 / +0.3% 0.87 / 0.79 / +10.0%
tpch_q16/duckdb:parquet 49644700 / 51562535 / -3.7% 56534128 / 58278660 / -3.0% 0.88 / 0.88 / -0.7%
tpch_q17/duckdb:parquet 44368489 / 44660314 / -0.7% 54484614 / 55063817 / -1.1% 0.81 / 0.81 / +0.4%
tpch_q18/duckdb:parquet 89467041 / 90738571 / -1.4% 100855891 / 101576475 / -0.7% 0.89 / 0.89 / -0.7%
tpch_q19/duckdb:parquet 61256441 / 61487376 / -0.4% 72094897 / 71753672 / +0.5% 0.85 / 0.86 / -0.8%
tpch_q20/duckdb:parquet 58630945 / 59136460 / -0.9% 70365551 / 71135126 / -1.1% 0.83 / 0.83 / +0.2%
tpch_q21/duckdb:parquet 136249520 / 137493886 / -0.9% 147734665 / 148648697 / -0.6% 0.92 / 0.92 / -0.3%
tpch_q22/duckdb:parquet 50294832 / 50787925 / -1.0% 58101785 / 61391221 / -5.4% 0.87 / 0.83 / +4.6%

File Size Changes (16 files changed, +1.9% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 1.0 vortex-compact 5.70 KB 28.42 KB +22.73 KB +399.0%
nation.vortex 1.0 vortex-compact 7.51 KB 37.17 KB +29.66 KB +394.8%
region.vortex 1.0 vortex-file-compressed 6.52 KB 28.72 KB +22.20 KB +340.8%
nation.vortex 1.0 vortex-file-compressed 10.54 KB 41.99 KB +31.45 KB +298.3%
supplier.vortex 1.0 vortex-compact 495.60 KB 548.97 KB +53.38 KB +10.8%
supplier.vortex 1.0 vortex-file-compressed 624.71 KB 672.37 KB +47.66 KB +7.6%
part.vortex 1.0 vortex-compact 3.55 MB 3.69 MB +139.17 KB +3.8%
part.vortex 1.0 vortex-file-compressed 5.39 MB 5.55 MB +159.95 KB +2.9%
customer.vortex 1.0 vortex-compact 7.41 MB 7.61 MB +209.99 KB +2.8%
customer.vortex 1.0 vortex-file-compressed 9.17 MB 9.39 MB +224.86 KB +2.4%
orders.vortex 1.0 vortex-compact 31.72 MB 32.38 MB +673.05 KB +2.1%
lineitem.vortex 1.0 vortex-file-compressed 171.51 MB 174.90 MB +3.39 MB +2.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 128.15 MB +2.14 MB +1.7%
orders.vortex 1.0 vortex-file-compressed 42.78 MB 43.38 MB +612.95 KB +1.4%
partsupp.vortex 1.0 vortex-compact 20.30 MB 20.56 MB +268.55 KB +1.3%
partsupp.vortex 1.0 vortex-file-compressed 24.95 MB 25.24 MB +296.98 KB +1.2%

Totals:

  • vortex-compact: 189.75 MB → 193.25 MB (+1.8%)
  • vortex-file-compressed: 254.70 MB → 259.45 MB (+1.9%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +13.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB Likely regression (+28.5%, environment too noisy confidence)
Vortex (geomean): hot 1.138x ❌ · cold 1.044x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.070x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 194282297 / 203958554 / -4.7% 718199471 / 554859386 / +29.4% 🔴 0.27 / 0.37 / -26.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10712016 / 10147694 / +5.6% 50107332 / 46221672 / +8.4% 0.21 / 0.22 / -2.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11378236 / 11226318 / +1.4% 49553908 / 45622714 / +8.6% 0.23 / 0.25 / -6.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23324662 / 22664480 / +2.9% 73990473 / 65164433 / +13.5% 🔴 0.32 / 0.35 / -9.4%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18119216 / 17980650 / +0.8% 62957752 / 54844461 / +14.8% 🔴 0.29 / 0.33 / -12.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 18188688 / 17900656 / +1.6% 64582357 / 55903347 / +15.5% 🔴 0.28 / 0.32 / -12.0%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40374452 / 40709808 / -0.8% 93943284 / 89086386 / +5.5% 0.43 / 0.46 / -6.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed 13431531 / 13203188 / +1.7% 47575555 / 42315040 / +12.4% 🔴 0.28 / 0.31 / -9.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11807068 / 12772200 / -7.6% 46633862 / 39529482 / +18.0% 🔴 0.25 / 0.32 / -21.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9935476 / 9952523 / -0.2% 36944345 / 34271295 / +7.8% 0.27 / 0.29 / -7.4%
datafusion / vortex-compact / ns (1.003x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 190952318 / 216074156 / -11.6% 🟢 481725219 / 429430708 / +12.2% 🔴 0.40 / 0.50 / -21.2%
clickbench-sorted_q24/datafusion:vortex-compact 23363026 / 23163317 / +0.9% 53558391 / 50917792 / +5.2% 0.44 / 0.45 / -4.1%
clickbench-sorted_q26/datafusion:vortex-compact 23155532 / 23427008 / -1.2% 55065189 / 49079527 / +12.2% 🔴 0.42 / 0.48 / -11.9%
clickbench-sorted_q36/datafusion:vortex-compact 27071743 / 24768156 / +9.3% 71220950 / 66909300 / +6.4% 0.38 / 0.37 / +2.7%
clickbench-sorted_q37/datafusion:vortex-compact 22077489 / 21445435 / +2.9% 71650786 / 65440405 / +9.5% 0.31 / 0.33 / -6.0%
clickbench-sorted_q38/datafusion:vortex-compact 21486580 / 20822332 / +3.2% 66639198 / 61433464 / +8.5% 0.32 / 0.34 / -4.9%
clickbench-sorted_q39/datafusion:vortex-compact 45070625 / 44742779 / +0.7% 93253153 / 82943710 / +12.4% 🔴 0.48 / 0.54 / -10.4%
clickbench-sorted_q40/datafusion:vortex-compact 14780852 / 15093750 / -2.1% 47383006 / 42882250 / +10.5% 🔴 0.31 / 0.35 / -11.4%
clickbench-sorted_q41/datafusion:vortex-compact 13748829 / 14467203 / -5.0% 49787576 / 43893742 / +13.4% 🔴 0.28 / 0.33 / -16.2%
clickbench-sorted_q42/datafusion:vortex-compact 11993494 / 11124072 / +7.8% 38280715 / 33782727 / +13.3% 🔴 0.31 / 0.33 / -4.9%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 755704096 / 754211802 / +0.2% 949519848 / 952663856 / -0.3% 0.80 / 0.79 / +0.5%
clickbench-sorted_q24/datafusion:parquet 8598380 / 8766182 / -1.9% 74662587 / 74567385 / +0.1% 0.12 / 0.12 / -2.0%
clickbench-sorted_q26/datafusion:parquet 9270166 / 9143628 / +1.4% 73707413 / 71331011 / +3.3% 0.13 / 0.13 / -1.9%
clickbench-sorted_q36/datafusion:parquet 94020321 / 93308853 / +0.8% 173212529 / 167252122 / +3.6% 0.54 / 0.56 / -2.7%
clickbench-sorted_q37/datafusion:parquet 64399598 / 64380406 / +0.0% 134510344 / 131474705 / +2.3% 0.48 / 0.49 / -2.2%
clickbench-sorted_q38/datafusion:parquet 87835640 / 86865668 / +1.1% 163199482 / 158637356 / +2.9% 0.54 / 0.55 / -1.7%
clickbench-sorted_q39/datafusion:parquet 159379182 / 159971916 / -0.4% 237731065 / 231745071 / +2.6% 0.67 / 0.69 / -2.9%
clickbench-sorted_q40/datafusion:parquet 44397415 / 44248474 / +0.3% 117765288 / 109678710 / +7.4% 0.38 / 0.40 / -6.6%
clickbench-sorted_q41/datafusion:parquet 42484395 / 41722788 / +1.8% 110337043 / 106879259 / +3.2% 0.39 / 0.39 / -1.4%
clickbench-sorted_q42/datafusion:parquet 26134349 / 25938578 / +0.8% 89044549 / 86425443 / +3.0% 0.29 / 0.30 / -2.2%
duckdb / vortex-file-compressed / ns (1.301x ❌, 1↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 63698588 / 56678177 / +12.4% 🔴 89317637 / 88136408 / +1.3% 0.71 / 0.64 / +10.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 24747810 / 22203234 / +11.5% 🔴 30751444 / 28579992 / +7.6% 0.80 / 0.78 / +3.6%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14415514 / 16327810 / -11.7% 🟢 29081229 / 25009332 / +16.3% 🔴 0.50 / 0.65 / -24.1%
clickbench-sorted_q36/duckdb:vortex-file-compressed 48285418 / 29935670 / +61.3% 🔴 59050098 / 59853994 / -1.3% 0.82 / 0.50 / +63.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed 36413334 / 23555410 / +54.6% 🔴 47308885 / 53310453 / -11.3% 🟢 0.77 / 0.44 / +74.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 40106549 / 26417602 / +51.8% 🔴 50715592 / 57435907 / -11.7% 🟢 0.79 / 0.46 / +71.9%
clickbench-sorted_q39/duckdb:vortex-file-compressed 70415100 / 48175516 / +46.2% 🔴 87951056 / 92820980 / -5.2% 0.80 / 0.52 / +54.3%
clickbench-sorted_q40/duckdb:vortex-file-compressed 22752202 / 15710556 / +44.8% 🔴 36305091 / 35554250 / +2.1% 0.63 / 0.44 / +41.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21335701 / 15856792 / +34.6% 🔴 36258863 / 38156276 / -5.0% 0.59 / 0.42 / +41.6%
clickbench-sorted_q42/duckdb:vortex-file-compressed 16379256 / 14102984 / +16.1% 🔴 34178064 / 31205734 / +9.5% 0.48 / 0.45 / +6.0%
duckdb / vortex-compact / ns (1.287x ❌, 0↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 71517456 / 65614158 / +9.0% 92677533 / 92489108 / +0.2% 0.77 / 0.71 / +8.8%
clickbench-sorted_q24/duckdb:vortex-compact 23794526 / 22659856 / +5.0% 36740277 / 32579825 / +12.8% 🔴 0.65 / 0.70 / -6.9%
clickbench-sorted_q26/duckdb:vortex-compact 20004826 / 15409460 / +29.8% 🔴 29496911 / 32988210 / -10.6% 🟢 0.68 / 0.47 / +45.2%
clickbench-sorted_q36/duckdb:vortex-compact 54235973 / 35997109 / +50.7% 🔴 70473904 / 71951366 / -2.1% 0.77 / 0.50 / +53.8%
clickbench-sorted_q37/duckdb:vortex-compact 46131690 / 30703165 / +50.3% 🔴 57093649 / 69267609 / -17.6% 🟢 0.81 / 0.44 / +82.3%
clickbench-sorted_q38/duckdb:vortex-compact 48106126 / 32757278 / +46.9% 🔴 60491220 / 66530096 / -9.1% 0.80 / 0.49 / +61.5%
clickbench-sorted_q39/duckdb:vortex-compact 80849232 / 61336080 / +31.8% 🔴 96587545 / 96696895 / -0.1% 0.84 / 0.63 / +32.0%
clickbench-sorted_q40/duckdb:vortex-compact 23181896 / 17948590 / +29.2% 🔴 38120973 / 39854716 / -4.4% 0.61 / 0.45 / +35.0%
clickbench-sorted_q41/duckdb:vortex-compact 24439321 / 19285862 / +26.7% 🔴 41195704 / 43087655 / -4.4% 0.59 / 0.45 / +32.5%
clickbench-sorted_q42/duckdb:vortex-compact 17605625 / 15040000 / +17.1% 🔴 32376835 / 35728320 / -9.4% 0.54 / 0.42 / +29.2%
duckdb / parquet / ns (1.007x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 127310748 / 123574631 / +3.0% 147442482 / 152980403 / -3.6% 0.86 / 0.81 / +6.9%
clickbench-sorted_q24/duckdb:parquet 17460002 / 17170432 / +1.7% 30027003 / 31553056 / -4.8% 0.58 / 0.54 / +6.9%
clickbench-sorted_q26/duckdb:parquet 13011744 / 14940070 / -12.9% 🟢 21496395 / 23618781 / -9.0% 0.61 / 0.63 / -4.3%
clickbench-sorted_q36/duckdb:parquet 45492520 / 42032726 / +8.2% 73819513 / 60107224 / +22.8% 🔴 0.62 / 0.70 / -11.9%
clickbench-sorted_q37/duckdb:parquet 31016485 / 31008083 / +0.0% 58852883 / 45614583 / +29.0% 🔴 0.53 / 0.68 / -22.5%
clickbench-sorted_q38/duckdb:parquet 37457456 / 40603616 / -7.7% 65502077 / 55031645 / +19.0% 🔴 0.57 / 0.74 / -22.5%
clickbench-sorted_q39/duckdb:parquet 82070308 / 73674813 / +11.4% 🔴 93586446 / 86274078 / +8.5% 0.88 / 0.85 / +2.7%
clickbench-sorted_q40/duckdb:parquet 16827882 / 18467324 / -8.9% 46201854 / 38898370 / +18.8% 🔴 0.36 / 0.47 / -23.3%
clickbench-sorted_q41/duckdb:parquet 17234528 / 15837202 / +8.8% 46996100 / 35684318 / +31.7% 🔴 0.37 / 0.44 / -17.4%
clickbench-sorted_q42/duckdb:parquet 11492002 / 10838226 / +6.0% 24621090 / 22476682 / +9.5% 0.47 / 0.48 / -3.2%

File Size Changes (200 files changed, +1.5% overall, 200↑ 0↓)
File Scale Format Base HEAD Change %
hits_080.vortex 1.0 vortex-compact 94.66 MB 98.65 MB +3.98 MB +4.2%
hits_001.vortex 1.0 vortex-file-compressed 188.75 MB 196.05 MB +7.30 MB +3.9%
hits_000.vortex 1.0 vortex-compact 97.88 MB 101.10 MB +3.22 MB +3.3%
hits_052.vortex 1.0 vortex-compact 98.06 MB 101.12 MB +3.06 MB +3.1%
hits_089.vortex 1.0 vortex-compact 97.67 MB 100.65 MB +2.98 MB +3.1%
hits_061.vortex 1.0 vortex-compact 123.42 MB 126.89 MB +3.47 MB +2.8%
hits_041.vortex 1.0 vortex-compact 97.13 MB 99.78 MB +2.66 MB +2.7%
hits_039.vortex 1.0 vortex-compact 123.81 MB 126.84 MB +3.02 MB +2.4%
hits_075.vortex 1.0 vortex-compact 137.85 MB 141.19 MB +3.34 MB +2.4%
hits_026.vortex 1.0 vortex-compact 97.28 MB 99.61 MB +2.33 MB +2.4%
hits_064.vortex 1.0 vortex-compact 138.86 MB 142.18 MB +3.32 MB +2.4%
hits_086.vortex 1.0 vortex-compact 139.68 MB 142.95 MB +3.27 MB +2.3%
hits_046.vortex 1.0 vortex-compact 74.85 MB 76.54 MB +1.69 MB +2.3%
hits_069.vortex 1.0 vortex-compact 99.57 MB 101.80 MB +2.23 MB +2.2%
hits_009.vortex 1.0 vortex-compact 75.16 MB 76.84 MB +1.68 MB +2.2%
hits_083.vortex 1.0 vortex-compact 109.96 MB 112.40 MB +2.44 MB +2.2%
hits_031.vortex 1.0 vortex-compact 111.14 MB 113.58 MB +2.43 MB +2.2%
hits_057.vortex 1.0 vortex-compact 111.41 MB 113.85 MB +2.44 MB +2.2%
hits_068.vortex 1.0 vortex-compact 111.94 MB 114.37 MB +2.44 MB +2.2%
hits_043.vortex 1.0 vortex-compact 94.45 MB 96.49 MB +2.04 MB +2.2%
hits_020.vortex 1.0 vortex-compact 111.64 MB 114.04 MB +2.41 MB +2.2%
hits_035.vortex 1.0 vortex-compact 75.98 MB 77.60 MB +1.62 MB +2.1%
hits_015.vortex 1.0 vortex-compact 97.34 MB 99.41 MB +2.08 MB +2.1%
hits_072.vortex 1.0 vortex-compact 75.64 MB 77.25 MB +1.61 MB +2.1%
hits_001.vortex 1.0 vortex-compact 138.76 MB 141.71 MB +2.96 MB +2.1%
hits_094.vortex 1.0 vortex-compact 110.71 MB 113.06 MB +2.35 MB +2.1%
hits_021.vortex 1.0 vortex-compact 110.38 MB 112.70 MB +2.32 MB +2.1%
hits_037.vortex 1.0 vortex-compact 132.18 MB 134.92 MB +2.74 MB +2.1%
hits_028.vortex 1.0 vortex-compact 115.19 MB 117.57 MB +2.37 MB +2.1%
hits_005.vortex 1.0 vortex-compact 115.84 MB 118.22 MB +2.38 MB +2.1%
hits_056.vortex 1.0 vortex-compact 100.72 MB 102.73 MB +2.01 MB +2.0%
hits_058.vortex 1.0 vortex-compact 111.06 MB 113.27 MB +2.21 MB +2.0%
hits_019.vortex 1.0 vortex-compact 106.08 MB 108.16 MB +2.08 MB +2.0%
hits_082.vortex 1.0 vortex-compact 105.64 MB 107.71 MB +2.07 MB +2.0%
hits_017.vortex 1.0 vortex-compact 111.72 MB 113.86 MB +2.14 MB +1.9%
hits_084.vortex 1.0 vortex-compact 110.56 MB 112.68 MB +2.12 MB +1.9%
hits_070.vortex 1.0 vortex-file-compressed 199.61 MB 203.41 MB +3.81 MB +1.9%
hits_008.vortex 1.0 vortex-compact 105.70 MB 107.70 MB +2.00 MB +1.9%
hits_071.vortex 1.0 vortex-compact 105.57 MB 107.56 MB +1.99 MB +1.9%
hits_065.vortex 1.0 vortex-compact 123.95 MB 126.25 MB +2.30 MB +1.9%
hits_027.vortex 1.0 vortex-compact 137.94 MB 140.49 MB +2.55 MB +1.8%
hits_054.vortex 1.0 vortex-compact 111.64 MB 113.70 MB +2.06 MB +1.8%
hits_040.vortex 1.0 vortex-compact 109.98 MB 112.00 MB +2.02 MB +1.8%
hits_071.vortex 1.0 vortex-file-compressed 139.39 MB 141.94 MB +2.55 MB +1.8%
hits_079.vortex 1.0 vortex-compact 127.92 MB 130.26 MB +2.34 MB +1.8%
hits_042.vortex 1.0 vortex-file-compressed 201.28 MB 204.96 MB +3.68 MB +1.8%
hits_003.vortex 1.0 vortex-compact 104.58 MB 106.50 MB +1.91 MB +1.8%
hits_047.vortex 1.0 vortex-compact 110.46 MB 112.47 MB +2.02 MB +1.8%
hits_034.vortex 1.0 vortex-compact 133.15 MB 135.57 MB +2.42 MB +1.8%
hits_012.vortex 1.0 vortex-compact 138.70 MB 141.22 MB +2.52 MB +1.8%
hits_092.vortex 1.0 vortex-file-compressed 199.30 MB 202.92 MB +3.62 MB +1.8%
hits_053.vortex 1.0 vortex-compact 138.24 MB 140.75 MB +2.51 MB +1.8%
hits_095.vortex 1.0 vortex-compact 110.63 MB 112.63 MB +1.99 MB +1.8%
hits_043.vortex 1.0 vortex-file-compressed 126.68 MB 128.96 MB +2.28 MB +1.8%
hits_013.vortex 1.0 vortex-compact 125.26 MB 127.51 MB +2.25 MB +1.8%
hits_091.vortex 1.0 vortex-compact 111.92 MB 113.93 MB +2.01 MB +1.8%
hits_006.vortex 1.0 vortex-file-compressed 126.55 MB 128.82 MB +2.27 MB +1.8%
hits_045.vortex 1.0 vortex-compact 105.71 MB 107.61 MB +1.89 MB +1.8%
hits_042.vortex 1.0 vortex-compact 136.24 MB 138.66 MB +2.42 MB +1.8%
hits_032.vortex 1.0 vortex-compact 110.61 MB 112.57 MB +1.96 MB +1.8%
hits_016.vortex 1.0 vortex-compact 127.31 MB 129.57 MB +2.26 MB +1.8%
hits_052.vortex 1.0 vortex-file-compressed 129.97 MB 132.25 MB +2.28 MB +1.8%
hits_080.vortex 1.0 vortex-file-compressed 127.07 MB 129.30 MB +2.22 MB +1.7%
hits_072.vortex 1.0 vortex-file-compressed 101.86 MB 103.63 MB +1.77 MB +1.7%
hits_003.vortex 1.0 vortex-file-compressed 136.61 MB 138.97 MB +2.36 MB +1.7%
hits_010.vortex 1.0 vortex-compact 123.40 MB 125.52 MB +2.12 MB +1.7%
hits_049.vortex 1.0 vortex-compact 139.39 MB 141.78 MB +2.38 MB +1.7%
hits_007.vortex 1.0 vortex-compact 153.54 MB 156.14 MB +2.60 MB +1.7%
hits_073.vortex 1.0 vortex-compact 134.17 MB 136.43 MB +2.26 MB +1.7%
hits_023.vortex 1.0 vortex-compact 142.50 MB 144.89 MB +2.39 MB +1.7%
hits_085.vortex 1.0 vortex-compact 153.30 MB 155.85 MB +2.55 MB +1.7%
hits_062.vortex 1.0 vortex-compact 132.57 MB 134.78 MB +2.20 MB +1.7%
hits_041.vortex 1.0 vortex-file-compressed 130.20 MB 132.36 MB +2.15 MB +1.7%
hits_019.vortex 1.0 vortex-file-compressed 139.98 MB 142.29 MB +2.31 MB +1.6%
hits_070.vortex 1.0 vortex-compact 153.49 MB 155.98 MB +2.49 MB +1.6%
hits_087.vortex 1.0 vortex-compact 125.12 MB 127.13 MB +2.01 MB +1.6%
hits_026.vortex 1.0 vortex-file-compressed 130.42 MB 132.52 MB +2.09 MB +1.6%
hits_056.vortex 1.0 vortex-file-compressed 134.95 MB 137.11 MB +2.16 MB +1.6%
hits_004.vortex 1.0 vortex-file-compressed 130.59 MB 132.67 MB +2.08 MB +1.6%
hits_074.vortex 1.0 vortex-compact 153.00 MB 155.41 MB +2.40 MB +1.6%
hits_096.vortex 1.0 vortex-compact 153.21 MB 155.60 MB +2.38 MB +1.6%
hits_060.vortex 1.0 vortex-file-compressed 192.73 MB 195.73 MB +3.00 MB +1.6%
hits_098.vortex 1.0 vortex-file-compressed 137.74 MB 139.88 MB +2.14 MB +1.6%
hits_092.vortex 1.0 vortex-compact 153.31 MB 155.68 MB +2.37 MB +1.5%
hits_090.vortex 1.0 vortex-compact 141.29 MB 143.48 MB +2.19 MB +1.5%
hits_077.vortex 1.0 vortex-compact 134.41 MB 136.48 MB +2.07 MB +1.5%
hits_059.vortex 1.0 vortex-compact 152.65 MB 155.00 MB +2.35 MB +1.5%
hits_089.vortex 1.0 vortex-file-compressed 130.58 MB 132.59 MB +2.01 MB +1.5%
hits_000.vortex 1.0 vortex-file-compressed 130.63 MB 132.63 MB +2.00 MB +1.5%
hits_051.vortex 1.0 vortex-compact 133.92 MB 135.97 MB +2.05 MB +1.5%
hits_009.vortex 1.0 vortex-file-compressed 101.18 MB 102.73 MB +1.55 MB +1.5%
hits_046.vortex 1.0 vortex-file-compressed 100.77 MB 102.31 MB +1.54 MB +1.5%
hits_035.vortex 1.0 vortex-file-compressed 102.29 MB 103.86 MB +1.56 MB +1.5%
hits_088.vortex 1.0 vortex-compact 134.09 MB 136.13 MB +2.04 MB +1.5%
hits_038.vortex 1.0 vortex-file-compressed 189.58 MB 192.46 MB +2.88 MB +1.5%
hits_078.vortex 1.0 vortex-file-compressed 130.27 MB 132.25 MB +1.98 MB +1.5%
hits_050.vortex 1.0 vortex-compact 125.04 MB 126.93 MB +1.90 MB +1.5%
hits_057.vortex 1.0 vortex-file-compressed 159.74 MB 162.15 MB +2.41 MB +1.5%
hits_082.vortex 1.0 vortex-file-compressed 139.30 MB 141.41 MB +2.10 MB +1.5%
hits_030.vortex 1.0 vortex-file-compressed 131.09 MB 133.06 MB +1.97 MB +1.5%
hits_076.vortex 1.0 vortex-compact 124.95 MB 126.83 MB +1.88 MB +1.5%
hits_036.vortex 1.0 vortex-compact 133.23 MB 135.23 MB +2.00 MB +1.5%
hits_002.vortex 1.0 vortex-compact 124.90 MB 126.77 MB +1.87 MB +1.5%
hits_013.vortex 1.0 vortex-file-compressed 161.75 MB 164.17 MB +2.42 MB +1.5%
hits_067.vortex 1.0 vortex-file-compressed 130.72 MB 132.66 MB +1.95 MB +1.5%
hits_016.vortex 1.0 vortex-file-compressed 179.65 MB 182.32 MB +2.67 MB +1.5%
hits_099.vortex 1.0 vortex-compact 132.99 MB 134.97 MB +1.97 MB +1.5%
hits_068.vortex 1.0 vortex-file-compressed 160.26 MB 162.63 MB +2.37 MB +1.5%
hits_014.vortex 1.0 vortex-compact 133.73 MB 135.70 MB +1.97 MB +1.5%
hits_069.vortex 1.0 vortex-file-compressed 143.07 MB 145.17 MB +2.11 MB +1.5%
hits_029.vortex 1.0 vortex-compact 153.49 MB 155.74 MB +2.25 MB +1.5%
hits_063.vortex 1.0 vortex-file-compressed 130.77 MB 132.69 MB +1.92 MB +1.5%
hits_004.vortex 1.0 vortex-compact 97.31 MB 98.73 MB +1.42 MB +1.5%
hits_015.vortex 1.0 vortex-file-compressed 130.28 MB 132.18 MB +1.90 MB +1.5%
hits_025.vortex 1.0 vortex-compact 133.44 MB 135.38 MB +1.94 MB +1.5%
hits_018.vortex 1.0 vortex-compact 153.76 MB 156.00 MB +2.24 MB +1.5%
hits_050.vortex 1.0 vortex-file-compressed 161.68 MB 164.03 MB +2.34 MB +1.4%
hits_063.vortex 1.0 vortex-compact 98.15 MB 99.57 MB +1.41 MB +1.4%
hits_044.vortex 1.0 vortex-compact 153.75 MB 155.95 MB +2.21 MB +1.4%
hits_005.vortex 1.0 vortex-file-compressed 167.08 MB 169.48 MB +2.39 MB +1.4%
hits_093.vortex 1.0 vortex-file-compressed 130.90 MB 132.77 MB +1.87 MB +1.4%
hits_064.vortex 1.0 vortex-file-compressed 190.61 MB 193.33 MB +2.72 MB +1.4%
hits_087.vortex 1.0 vortex-file-compressed 161.53 MB 163.84 MB +2.31 MB +1.4%
hits_055.vortex 1.0 vortex-compact 153.37 MB 155.56 MB +2.19 MB +1.4%
hits_075.vortex 1.0 vortex-file-compressed 189.10 MB 191.75 MB +2.65 MB +1.4%
hits_079.vortex 1.0 vortex-file-compressed 181.01 MB 183.53 MB +2.51 MB +1.4%
hits_017.vortex 1.0 vortex-file-compressed 147.19 MB 149.23 MB +2.04 MB +1.4%
hits_073.vortex 1.0 vortex-file-compressed 173.05 MB 175.45 MB +2.39 MB +1.4%
hits_049.vortex 1.0 vortex-file-compressed 191.01 MB 193.62 MB +2.61 MB +1.4%
hits_012.vortex 1.0 vortex-file-compressed 190.39 MB 192.99 MB +2.60 MB +1.4%
hits_053.vortex 1.0 vortex-file-compressed 189.47 MB 192.06 MB +2.59 MB +1.4%
hits_048.vortex 1.0 vortex-compact 153.30 MB 155.40 MB +2.09 MB +1.4%
hits_091.vortex 1.0 vortex-file-compressed 147.34 MB 149.34 MB +2.01 MB +1.4%
hits_084.vortex 1.0 vortex-file-compressed 153.95 MB 156.04 MB +2.09 MB +1.4%
hits_024.vortex 1.0 vortex-file-compressed 161.05 MB 163.23 MB +2.18 MB +1.4%
hits_027.vortex 1.0 vortex-file-compressed 189.55 MB 192.11 MB +2.57 MB +1.4%
hits_023.vortex 1.0 vortex-file-compressed 194.82 MB 197.43 MB +2.62 MB +1.3%
hits_066.vortex 1.0 vortex-file-compressed 162.95 MB 165.13 MB +2.18 MB +1.3%
hits_037.vortex 1.0 vortex-file-compressed 178.08 MB 180.46 MB +2.38 MB +1.3%
hits_081.vortex 1.0 vortex-compact 153.69 MB 155.74 MB +2.05 MB +1.3%
hits_028.vortex 1.0 vortex-file-compressed 152.14 MB 154.15 MB +2.02 MB +1.3%
hits_033.vortex 1.0 vortex-compact 152.85 MB 154.88 MB +2.03 MB +1.3%
hits_011.vortex 1.0 vortex-compact 152.97 MB 154.99 MB +2.02 MB +1.3%
hits_065.vortex 1.0 vortex-file-compressed 161.87 MB 164.00 MB +2.13 MB +1.3%
hits_054.vortex 1.0 vortex-file-compressed 147.27 MB 149.21 MB +1.94 MB +1.3%
hits_058.vortex 1.0 vortex-file-compressed 154.49 MB 156.52 MB +2.03 MB +1.3%
hits_039.vortex 1.0 vortex-file-compressed 161.76 MB 163.88 MB +2.12 MB +1.3%
hits_066.vortex 1.0 vortex-compact 117.64 MB 119.18 MB +1.54 MB +1.3%
hits_047.vortex 1.0 vortex-file-compressed 153.83 MB 155.84 MB +2.02 MB +1.3%
hits_060.vortex 1.0 vortex-compact 140.92 MB 142.76 MB +1.84 MB +1.3%
hits_076.vortex 1.0 vortex-file-compressed 161.66 MB 163.76 MB +2.10 MB +1.3%
hits_020.vortex 1.0 vortex-file-compressed 159.92 MB 161.98 MB +2.07 MB +1.3%
hits_083.vortex 1.0 vortex-file-compressed 156.32 MB 158.31 MB +1.99 MB +1.3%
hits_090.vortex 1.0 vortex-file-compressed 192.35 MB 194.80 MB +2.45 MB +1.3%
hits_062.vortex 1.0 vortex-file-compressed 171.23 MB 173.41 MB +2.18 MB +1.3%
hits_095.vortex 1.0 vortex-file-compressed 153.90 MB 155.85 MB +1.95 MB +1.3%
hits_086.vortex 1.0 vortex-file-compressed 191.77 MB 194.20 MB +2.43 MB +1.3%
hits_010.vortex 1.0 vortex-file-compressed 168.91 MB 171.04 MB +2.14 MB +1.3%
hits_011.vortex 1.0 vortex-file-compressed 200.06 MB 202.54 MB +2.48 MB +1.2%
hits_034.vortex 1.0 vortex-file-compressed 182.01 MB 184.25 MB +2.23 MB +1.2%
hits_096.vortex 1.0 vortex-file-compressed 200.22 MB 202.66 MB +2.45 MB +1.2%
hits_061.vortex 1.0 vortex-file-compressed 161.58 MB 163.54 MB +1.96 MB +1.2%
hits_059.vortex 1.0 vortex-file-compressed 200.09 MB 202.50 MB +2.41 MB +1.2%
hits_032.vortex 1.0 vortex-file-compressed 154.15 MB 156.00 MB +1.85 MB +1.2%
hits_088.vortex 1.0 vortex-file-compressed 172.65 MB 174.71 MB +2.06 MB +1.2%
hits_094.vortex 1.0 vortex-file-compressed 158.73 MB 160.62 MB +1.90 MB +1.2%
hits_055.vortex 1.0 vortex-file-compressed 200.71 MB 203.08 MB +2.37 MB +1.2%
hits_085.vortex 1.0 vortex-file-compressed 200.84 MB 203.19 MB +2.35 MB +1.2%
hits_025.vortex 1.0 vortex-file-compressed 172.39 MB 174.39 MB +2.00 MB +1.2%
hits_007.vortex 1.0 vortex-file-compressed 201.32 MB 203.60 MB +2.28 MB +1.1%
hits_014.vortex 1.0 vortex-file-compressed 172.71 MB 174.67 MB +1.95 MB +1.1%
hits_040.vortex 1.0 vortex-file-compressed 144.56 MB 146.19 MB +1.63 MB +1.1%
hits_097.vortex 1.0 vortex-file-compressed 193.03 MB 195.20 MB +2.17 MB +1.1%
hits_033.vortex 1.0 vortex-file-compressed 201.09 MB 203.34 MB +2.25 MB +1.1%
hits_081.vortex 1.0 vortex-file-compressed 201.11 MB 203.36 MB +2.25 MB +1.1%
hits_074.vortex 1.0 vortex-file-compressed 200.24 MB 202.49 MB +2.24 MB +1.1%
hits_030.vortex 1.0 vortex-compact 98.70 MB 99.79 MB +1.09 MB +1.1%
hits_021.vortex 1.0 vortex-file-compressed 154.03 MB 155.73 MB +1.71 MB +1.1%
hits_022.vortex 1.0 vortex-file-compressed 200.26 MB 202.48 MB +2.22 MB +1.1%
hits_099.vortex 1.0 vortex-file-compressed 171.77 MB 173.67 MB +1.90 MB +1.1%
hits_097.vortex 1.0 vortex-compact 141.03 MB 142.59 MB +1.56 MB +1.1%
hits_002.vortex 1.0 vortex-file-compressed 161.61 MB 163.39 MB +1.78 MB +1.1%
hits_077.vortex 1.0 vortex-file-compressed 172.91 MB 174.81 MB +1.90 MB +1.1%
hits_045.vortex 1.0 vortex-file-compressed 139.88 MB 141.39 MB +1.50 MB +1.1%
hits_051.vortex 1.0 vortex-file-compressed 172.87 MB 174.69 MB +1.82 MB +1.1%
hits_038.vortex 1.0 vortex-compact 139.28 MB 140.70 MB +1.42 MB +1.0%
hits_022.vortex 1.0 vortex-compact 153.00 MB 154.53 MB +1.54 MB +1.0%
hits_031.vortex 1.0 vortex-file-compressed 159.66 MB 161.24 MB +1.58 MB +1.0%
hits_093.vortex 1.0 vortex-compact 98.92 MB 99.87 MB +970.39 KB +1.0%
hits_008.vortex 1.0 vortex-file-compressed 140.30 MB 141.55 MB +1.25 MB +0.9%
hits_067.vortex 1.0 vortex-compact 99.30 MB 100.13 MB +850.30 KB +0.8%
hits_024.vortex 1.0 vortex-compact 124.60 MB 125.58 MB +1010.30 KB +0.8%
hits_078.vortex 1.0 vortex-compact 98.00 MB 98.69 MB +699.02 KB +0.7%
hits_036.vortex 1.0 vortex-file-compressed 172.53 MB 173.73 MB +1.20 MB +0.7%
hits_018.vortex 1.0 vortex-file-compressed 200.79 MB 201.85 MB +1.07 MB +0.5%
hits_098.vortex 1.0 vortex-compact 103.82 MB 104.26 MB +446.92 KB +0.4%
hits_029.vortex 1.0 vortex-file-compressed 200.96 MB 201.67 MB +729.22 KB +0.4%
hits_044.vortex 1.0 vortex-file-compressed 201.40 MB 201.97 MB +587.83 KB +0.3%
hits_048.vortex 1.0 vortex-file-compressed 200.55 MB 201.03 MB +499.02 KB +0.2%
hits_006.vortex 1.0 vortex-compact 96.34 MB 96.37 MB +28.57 KB +0.0%

Totals:

  • vortex-compact: 11.91 GB → 12.12 GB (+1.8%)
  • vortex-file-compressed: 15.96 GB → 16.17 GB (+1.3%)

@codspeed-hq

codspeed-hq Bot commented Sep 11, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 13.68%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 4 regressed benchmarks
✅ 2234 untouched benchmarks
⏩ 176 skipped benchmarks1
🗄️ 1 archived benchmark run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 12.4 µs 20.4 µs -39.16%
Simulation random_i16[0.95] 79.4 µs 97.4 µs -18.45%
Simulation decompress[u64, (4000, 1024)] 71.4 µs 86.8 µs -17.7%
WallTime words_gather_scalar_avx2[65536] 8.2 µs 9.4 µs -11.86%
Simulation random_i8[0.5] 93.7 µs 70.4 µs +33.18%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/direct-io-reads-perf-3b5kk2 (95c4954) with develop (d82de0e)

Open in CodSpeed

Footnotes

  1. 176 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. 1 benchmark was run, but is now archived. If it was deleted in another branch, consider rebasing to remove it from the report. Instead if it was added back, click here to restore it.

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.8%
Engines: DataFusion No clear signal (+7.4%, environment too noisy confidence) · DuckDB No clear signal (+14.2%, environment too noisy confidence)
Vortex (geomean): hot 0.937x ➖ · cold 0.872x ➖
Parquet (geomean): hot 0.846x ➖ · cold 0.839x ➖
Shifts: Parquet (control) -15.4% · Median polish -7.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.037x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 54740232 / 38914313 / +40.7% 🔴 140915309 / 152403481 / -7.5% 0.39 / 0.26 / +52.1%
fineweb_q01/datafusion:vortex-file-compressed 423751870 / 459094487 / -7.7% 643981152 / 798450003 / -19.3% 0.66 / 0.57 / +14.4%
fineweb_q02/datafusion:vortex-file-compressed 393912282 / 426358332 / -7.6% 530933048 / 703905879 / -24.6% 0.74 / 0.61 / +22.5%
fineweb_q03/datafusion:vortex-file-compressed 489520128 / 589472863 / -17.0% 588083704 / 1114579491 / -47.2% 🟢 0.83 / 0.53 / +57.4%
fineweb_q04/datafusion:vortex-file-compressed 387184592 / 440066464 / -12.0% 428798533 / 485247749 / -11.6% 0.90 / 0.91 / -0.4%
fineweb_q05/datafusion:vortex-file-compressed 393588798 / 422920108 / -6.9% 451171137 / 571255162 / -21.0% 0.87 / 0.74 / +17.8%
fineweb_q06/datafusion:vortex-file-compressed 672224594 / 782061036 / -14.0% 702504638 / 703963456 / -0.2% 0.96 / 1.11 / -13.9%
fineweb_q07/datafusion:vortex-file-compressed 481660149 / 441507766 / +9.1% 420100655 / 450552343 / -6.8% 1.15 / 0.98 / +17.0%
fineweb_q08/datafusion:vortex-file-compressed 314664062 / 174052698 / +80.8% 🔴 390650444 / 173185809 / +125.6% 🔴 0.81 / 1.01 / -19.9%
datafusion / vortex-compact / ns (0.858x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 44159181 / 64592282 / -31.6% 🟢 124800644 / 125592844 / -0.6% 0.35 / 0.51 / -31.2%
fineweb_q01/datafusion:vortex-compact 346485718 / 408861030 / -15.3% 660741960 / 1247744211 / -47.0% 🟢 0.52 / 0.33 / +60.0%
fineweb_q02/datafusion:vortex-compact 353142054 / 391183342 / -9.7% 462496739 / 514267035 / -10.1% 0.76 / 0.76 / +0.4%
fineweb_q03/datafusion:vortex-compact 567479507 / 578706144 / -1.9% 743843844 / 1864891277 / -60.1% 🟢 0.76 / 0.31 / +145.8%
fineweb_q04/datafusion:vortex-compact 475912900 / 775467346 / -38.6% 🟢 477373051 / 626195360 / -23.8% 1.00 / 1.24 / -19.5%
fineweb_q05/datafusion:vortex-compact 431986288 / 456737370 / -5.4% 481409708 / 530722941 / -9.3% 0.90 / 0.86 / +4.3%
fineweb_q06/datafusion:vortex-compact 709224322 / 687740232 / +3.1% 711809479 / 652057471 / +9.2% 1.00 / 1.05 / -5.5%
fineweb_q07/datafusion:vortex-compact 498019999 / 516078708 / -3.5% 466932144 / 505619308 / -7.7% 1.07 / 1.02 / +4.5%
fineweb_q08/datafusion:vortex-compact 161784659 / 189262741 / -14.5% 178071476 / 358294202 / -50.3% 🟢 0.91 / 0.53 / +72.0%
datafusion / parquet / ns (0.878x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 640268290 / 529981865 / +20.8% 775322864 / 817110277 / -5.1% 0.83 / 0.65 / +27.3%
fineweb_q01/datafusion:parquet 711531226 / 913711911 / -22.1% 612412973 / 982843522 / -37.7% 🟢 1.16 / 0.93 / +25.0%
fineweb_q02/datafusion:parquet 704603490 / 728136556 / -3.2% 588243855 / 676084464 / -13.0% 1.20 / 1.08 / +11.2%
fineweb_q03/datafusion:parquet 696592671 / 696965431 / -0.1% 669012228 / 769078982 / -13.0% 1.04 / 0.91 / +14.9%
fineweb_q04/datafusion:parquet 745280986 / 871757850 / -14.5% 814507315 / 977175943 / -16.6% 0.92 / 0.89 / +2.6%
fineweb_q05/datafusion:parquet 690347048 / 801929898 / -13.9% 609654711 / 1080908085 / -43.6% 🟢 1.13 / 0.74 / +52.6%
fineweb_q06/datafusion:parquet 819467664 / 908834815 / -9.8% 797157327 / 925763581 / -13.9% 1.03 / 0.98 / +4.7%
fineweb_q07/datafusion:parquet 748967094 / 782261684 / -4.3% 887851255 / 720282244 / +23.3% 0.84 / 1.09 / -22.3%
fineweb_q08/datafusion:parquet 711615084 / 1320745330 / -46.1% 🟢 751953465 / 1136774029 / -33.9% 🟢 0.95 / 1.16 / -18.5%
duckdb / vortex-file-compressed / ns (0.911x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 50170690 / 66944936 / -25.1% 44201091 / 49895204 / -11.4% 1.14 / 1.34 / -15.4%
fineweb_q01/duckdb:vortex-file-compressed 418743732 / 541803921 / -22.7% 435562059 / 510048743 / -14.6% 0.96 / 1.06 / -9.5%
fineweb_q02/duckdb:vortex-file-compressed 554789062 / 581749338 / -4.6% 577686274 / 603252039 / -4.2% 0.96 / 0.96 / -0.4%
fineweb_q03/duckdb:vortex-file-compressed 1029850110 / 1011700680 / +1.8% 1082125175 / 1277659540 / -15.3% 0.95 / 0.79 / +20.2%
fineweb_q04/duckdb:vortex-file-compressed 1001136832 / 1009015396 / -0.8% 1015229720 / 1049413497 / -3.3% 0.99 / 0.96 / +2.6%
fineweb_q05/duckdb:vortex-file-compressed 880067519 / 966120876 / -8.9% 961607118 / 1051437764 / -8.5% 0.92 / 0.92 / -0.4%
fineweb_q06/duckdb:vortex-file-compressed 1213546208 / 1224723750 / -0.9% 1233291625 / 1319876834 / -6.6% 0.98 / 0.93 / +6.0%
fineweb_q07/duckdb:vortex-file-compressed 967396685 / 960234368 / +0.7% 1002037676 / 1073092903 / -6.6% 0.97 / 0.89 / +7.9%
fineweb_q08/duckdb:vortex-file-compressed 390248340 / 458647687 / -14.9% 461994940 / 488998339 / -5.5% 0.84 / 0.94 / -9.9%
duckdb / vortex-compact / ns (0.951x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 65863911 / 67765461 / -2.8% 71595967 / 70797508 / +1.1% 0.92 / 0.96 / -3.9%
fineweb_q01/duckdb:vortex-compact 425822218 / 454471877 / -6.3% 468678035 / 564164885 / -16.9% 0.91 / 0.81 / +12.8%
fineweb_q02/duckdb:vortex-compact 547497872 / 592117845 / -7.5% 569358793 / 607379218 / -6.3% 0.96 / 0.97 / -1.4%
fineweb_q03/duckdb:vortex-compact 1062426206 / 1172211820 / -9.4% 1259078975 / 1344717891 / -6.4% 0.84 / 0.87 / -3.2%
fineweb_q04/duckdb:vortex-compact 1044684787 / 1103208730 / -5.3% 1082299505 / 967765736 / +11.8% 0.97 / 1.14 / -15.3%
fineweb_q05/duckdb:vortex-compact 925012360 / 918497998 / +0.7% 1159069429 / 1259957351 / -8.0% 0.80 / 0.73 / +9.5%
fineweb_q06/duckdb:vortex-compact 1081020806 / 1071944462 / +0.8% 1134984780 / 1125878564 / +0.8% 0.95 / 0.95 / +0.0%
fineweb_q07/duckdb:vortex-compact 955007988 / 946040122 / +0.9% 979979557 / 984192378 / -0.4% 0.97 / 0.96 / +1.4%
fineweb_q08/duckdb:vortex-compact 343612641 / 398824289 / -13.8% 404524986 / 549022030 / -26.3% 0.85 / 0.73 / +16.9%
duckdb / parquet / ns (0.815x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 531150966 / 576099376 / -7.8% 544143359 / 608468113 / -10.6% 0.98 / 0.95 / +3.1%
fineweb_q01/duckdb:parquet 594488244 / 750902218 / -20.8% 641030890 / 556962300 / +15.1% 0.93 / 1.35 / -31.2%
fineweb_q02/duckdb:parquet 585121269 / 800351004 / -26.9% 639102677 / 808663761 / -21.0% 0.92 / 0.99 / -7.5%
fineweb_q03/duckdb:parquet 1283378022 / 1796044053 / -28.5% 1352519720 / 2736761639 / -50.6% 🟢 0.95 / 0.66 / +44.6%
fineweb_q04/duckdb:parquet 835570390 / 906622280 / -7.8% 990774917 / 838284831 / +18.2% 0.84 / 1.08 / -22.0%
fineweb_q05/duckdb:parquet 866622306 / 1044954971 / -17.1% 910223054 / 965805490 / -5.8% 0.95 / 1.08 / -12.0%
fineweb_q06/duckdb:parquet 1622614492 / 1895843542 / -14.4% 1545040020 / 1903220002 / -18.8% 1.05 / 1.00 / +5.4%
fineweb_q07/duckdb:parquet 941860666 / 1297573868 / -27.4% 1168124627 / 1318274423 / -11.4% 0.81 / 0.98 / -18.1%
fineweb_q08/duckdb:parquet 459186670 / 525283968 / -12.6% 518890367 / 576259175 / -10.0% 0.88 / 0.91 / -2.9%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.967x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -1.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 8991202 / 9012477 / -0.2% 9517887 / 9549241 / -0.3% 0.94 / 0.94 / +0.1%
statpopgen_q01/duckdb:vortex-file-compressed 10645328 / 10464460 / +1.7% 13012775 / 14184123 / -8.3% 0.82 / 0.74 / +10.9%
statpopgen_q02/duckdb:vortex-file-compressed 303597006 / 302343554 / +0.4% 321259931 / 324605630 / -1.0% 0.95 / 0.93 / +1.5%
statpopgen_q03/duckdb:vortex-file-compressed 805924888 / 803926859 / +0.2% 809191440 / 811488352 / -0.3% 1.00 / 0.99 / +0.5%
statpopgen_q04/duckdb:vortex-file-compressed 806892866 / 815771302 / -1.1% 817815422 / 822327907 / -0.5% 0.99 / 0.99 / -0.5%
statpopgen_q05/duckdb:vortex-file-compressed 322139502 / 316331324 / +1.8% 331233896 / 353941531 / -6.4% 0.97 / 0.89 / +8.8%
statpopgen_q06/duckdb:vortex-file-compressed 1134463973 / 1140266942 / -0.5% 1134282336 / 1138324130 / -0.4% 1.00 / 1.00 / -0.2%
statpopgen_q07/duckdb:vortex-file-compressed 131037370 / 130443968 / +0.5% 154141342 / 149497675 / +3.1% 0.85 / 0.87 / -2.6%
statpopgen_q08/duckdb:vortex-file-compressed 143971090 / 145748242 / -1.2% 159263146 / 207781627 / -23.4% 🟢 0.90 / 0.70 / +28.9%
statpopgen_q09/duckdb:vortex-file-compressed 617127392 / 610605088 / +1.1% 628393586 / 621901233 / +1.0% 0.98 / 0.98 / +0.0%
statpopgen_q10/duckdb:vortex-file-compressed 1935053175 / 1927296567 / +0.4% 1886257417 / 1906473108 / -1.1% 1.03 / 1.01 / +1.5%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8998146 / 9044018 / -0.5% 9439415 / 9554749 / -1.2% 0.95 / 0.95 / +0.7%
statpopgen_q01/duckdb:vortex-compact 10292468 / 10281126 / +0.1% 12906933 / 14279111 / -9.6% 0.80 / 0.72 / +10.8%
statpopgen_q02/duckdb:vortex-compact 388333092 / 392708380 / -1.1% 398562567 / 413893853 / -3.7% 0.97 / 0.95 / +2.7%
statpopgen_q03/duckdb:vortex-compact 908963444 / 907105456 / +0.2% 907849157 / 922198363 / -1.6% 1.00 / 0.98 / +1.8%
statpopgen_q04/duckdb:vortex-compact 904517334 / 905945164 / -0.2% 908634358 / 926695322 / -1.9% 1.00 / 0.98 / +1.8%
statpopgen_q05/duckdb:vortex-compact 440881936 / 436246416 / +1.1% 444577816 / 448255842 / -0.8% 0.99 / 0.97 / +1.9%
statpopgen_q06/duckdb:vortex-compact 1186374286 / 1180092459 / +0.5% 1174464651 / 1184310323 / -0.8% 1.01 / 1.00 / +1.4%
statpopgen_q07/duckdb:vortex-compact 332556418 / 331522118 / +0.3% 329633713 / 350757352 / -6.0% 1.01 / 0.95 / +6.7%
statpopgen_q08/duckdb:vortex-compact 348685120 / 351585740 / -0.8% 353452087 / 371316185 / -4.8% 0.99 / 0.95 / +4.2%
statpopgen_q09/duckdb:vortex-compact 726793413 / 721881442 / +0.7% 725974622 / 728312776 / -0.3% 1.00 / 0.99 / +1.0%
statpopgen_q10/duckdb:vortex-compact 2010092976 / 2039931518 / -1.5% 1986617701 / 2014521364 / -1.4% 1.01 / 1.01 / -0.1%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245662210 / 247147169 / -0.6% 244632486 / 247774976 / -1.3% 1.00 / 1.00 / +0.7%
statpopgen_q01/duckdb:parquet 300731920 / 305886086 / -1.7% 304202959 / 307534833 / -1.1% 0.99 / 0.99 / -0.6%
statpopgen_q02/duckdb:parquet 550227804 / 562821850 / -2.2% 582752136 / 587763925 / -0.9% 0.94 / 0.96 / -1.4%
statpopgen_q03/duckdb:parquet 857630192 / 867536667 / -1.1% 881473946 / 850826871 / +3.6% 0.97 / 1.02 / -4.6%
statpopgen_q04/duckdb:parquet 842973544 / 896348225 / -6.0% 849268245 / 883953996 / -3.9% 0.99 / 1.01 / -2.1%
statpopgen_q05/duckdb:parquet 583742374 / 565923325 / +3.1% 584106042 / 556930036 / +4.9% 1.00 / 1.02 / -1.7%
statpopgen_q06/duckdb:parquet 711870297 / 723393928 / -1.6% 690253454 / 762538601 / -9.5% 1.03 / 0.95 / +8.7%
statpopgen_q07/duckdb:parquet 605055096 / 617188774 / -2.0% 698813167 / 712014640 / -1.9% 0.87 / 0.87 / -0.1%
statpopgen_q08/duckdb:parquet 613125198 / 620562042 / -1.2% 728975126 / 715393665 / +1.9% 0.84 / 0.87 / -3.0%
statpopgen_q09/duckdb:parquet 794766464 / 785833538 / +1.1% 826106819 / 811310746 / +1.8% 0.96 / 0.97 / -0.7%
statpopgen_q10/duckdb:parquet 1418726996 / 1462335237 / -3.0% 1387927195 / 1313137120 / +5.7% 1.02 / 1.11 / -8.2%

File Size Changes (2 files changed, +0.7% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.58 MB 969.54 MB +8.96 MB +0.9%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.80 GB 1.81 GB +9.49 MB +0.5%

Totals:

  • vortex-compact: 960.84 MB → 969.80 MB (+0.9%)
  • vortex-file-compressed: 1.80 GB → 1.81 GB (+0.5%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.6%
Engines: DataFusion No clear signal (+2.0%, low confidence) · DuckDB No clear signal (+9.4%, environment too noisy confidence)
Vortex (geomean): hot 1.042x ➖ · cold 0.943x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -1.4% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1247146 / 1205786 / +3.4% 20877144 / 20883544 / -0.0% 0.06 / 0.06 / +3.5%
clickbench_q01/datafusion:vortex-file-compressed 5909394 / 5842518 / +1.1% 33112448 / 34356884 / -3.6% 0.18 / 0.17 / +4.9%
clickbench_q02/datafusion:vortex-file-compressed 10280380 / 10057895 / +2.2% 40363374 / 40500980 / -0.3% 0.25 / 0.25 / +2.6%
clickbench_q03/datafusion:vortex-file-compressed 11906592 / 12277718 / -3.0% 54372516 / 54367362 / +0.0% 0.22 / 0.23 / -3.0%
clickbench_q04/datafusion:vortex-file-compressed 56334654 / 54914094 / +2.6% 92418842 / 91520904 / +1.0% 0.61 / 0.60 / +1.6%
clickbench_q05/datafusion:vortex-file-compressed 73188314 / 74070010 / -1.2% 111811539 / 114776753 / -2.6% 0.65 / 0.65 / +1.4%
clickbench_q06/datafusion:vortex-file-compressed 1256884 / 1240946 / +1.3% 21824056 / 21268139 / +2.6% 0.06 / 0.06 / -1.3%
clickbench_q07/datafusion:vortex-file-compressed 9800839 / 9872777 / -0.7% 37010017 / 34058418 / +8.7% 0.26 / 0.29 / -8.6%
clickbench_q08/datafusion:vortex-file-compressed 78338548 / 77042766 / +1.7% 115777095 / 118714513 / -2.5% 0.68 / 0.65 / +4.3%
clickbench_q09/datafusion:vortex-file-compressed 169950184 / 170639886 / -0.4% 207473523 / 211844607 / -2.1% 0.82 / 0.81 / +1.7%
clickbench_q10/datafusion:vortex-file-compressed 23886678 / 23658820 / +1.0% 68065861 / 70229666 / -3.1% 0.35 / 0.34 / +4.2%
clickbench_q11/datafusion:vortex-file-compressed 26610918 / 27240367 / -2.3% 69910401 / 71503062 / -2.2% 0.38 / 0.38 / -0.1%
clickbench_q12/datafusion:vortex-file-compressed 71115100 / 71100051 / +0.0% 116705839 / 117298486 / -0.5% 0.61 / 0.61 / +0.5%
clickbench_q13/datafusion:vortex-file-compressed 117502644 / 116959460 / +0.5% 173586394 / 177942492 / -2.4% 0.68 / 0.66 / +3.0%
clickbench_q14/datafusion:vortex-file-compressed 77005052 / 76078914 / +1.2% 121089295 / 121993543 / -0.7% 0.64 / 0.62 / +2.0%
clickbench_q15/datafusion:vortex-file-compressed 60983700 / 61979438 / -1.6% 96666510 / 97068748 / -0.4% 0.63 / 0.64 / -1.2%
clickbench_q16/datafusion:vortex-file-compressed 150589295 / 148601215 / +1.3% 200342098 / 207003213 / -3.2% 0.75 / 0.72 / +4.7%
clickbench_q17/datafusion:vortex-file-compressed 147313684 / 149744412 / -1.6% 203723603 / 212164108 / -4.0% 0.72 / 0.71 / +2.5%
clickbench_q18/datafusion:vortex-file-compressed 310990663 / 295804232 / +5.1% 362192137 / 377704273 / -4.1% 0.86 / 0.78 / +9.6%
clickbench_q19/datafusion:vortex-file-compressed 7622686 / 7857701 / -3.0% 51124561 / 49499902 / +3.3% 0.15 / 0.16 / -6.1%
clickbench_q20/datafusion:vortex-file-compressed 61812343 / 61684815 / +0.2% 228188296 / 229367445 / -0.5% 0.27 / 0.27 / +0.7%
clickbench_q21/datafusion:vortex-file-compressed 89793592 / 88146335 / +1.9% 273530577 / 270901992 / +1.0% 0.33 / 0.33 / +0.9%
clickbench_q22/datafusion:vortex-file-compressed 105792601 / 102205630 / +3.5% 347098905 / 347277514 / -0.1% 0.30 / 0.29 / +3.6%
clickbench_q23/datafusion:vortex-file-compressed 197471178 / 211021468 / -6.4% 525110973 / 508084248 / +3.4% 0.38 / 0.42 / -9.5%
clickbench_q24/datafusion:vortex-file-compressed 16711394 / 16067936 / +4.0% 65830316 / 67527760 / -2.5% 0.25 / 0.24 / +6.7%
clickbench_q25/datafusion:vortex-file-compressed 18177158 / 17528214 / +3.7% 61268082 / 56856538 / +7.8% 0.30 / 0.31 / -3.8%
clickbench_q26/datafusion:vortex-file-compressed 16586254 / 17279652 / -4.0% 62900193 / 65693393 / -4.3% 0.26 / 0.26 / +0.2%
clickbench_q27/datafusion:vortex-file-compressed 98105010 / 96990851 / +1.1% 243240753 / 242840828 / +0.2% 0.40 / 0.40 / +1.0%
clickbench_q28/datafusion:vortex-file-compressed 563432998 / 571705001 / -1.4% 615338631 / 613310872 / +0.3% 0.92 / 0.93 / -1.8%
clickbench_q29/datafusion:vortex-file-compressed 22765324 / 22510956 / +1.1% 49387045 / 50397494 / -2.0% 0.46 / 0.45 / +3.2%
clickbench_q30/datafusion:vortex-file-compressed 59306570 / 63168538 / -6.1% 107171944 / 105416564 / +1.7% 0.55 / 0.60 / -7.7%
clickbench_q31/datafusion:vortex-file-compressed 71283786 / 71259405 / +0.0% 154554386 / 154984479 / -0.3% 0.46 / 0.46 / +0.3%
clickbench_q32/datafusion:vortex-file-compressed 290016874 / 307167956 / -5.6% 373271640 / 383713194 / -2.7% 0.78 / 0.80 / -2.9%
clickbench_q33/datafusion:vortex-file-compressed 327267896 / 325330120 / +0.6% 415569690 / 429637869 / -3.3% 0.79 / 0.76 / +4.0%
clickbench_q34/datafusion:vortex-file-compressed 327899539 / 329050201 / -0.3% 424081689 / 434299372 / -2.4% 0.77 / 0.76 / +2.1%
clickbench_q35/datafusion:vortex-file-compressed 56556888 / 55751219 / +1.4% 84108875 / 91573128 / -8.2% 0.67 / 0.61 / +10.4%
clickbench_q36/datafusion:vortex-file-compressed 37228253 / 37537554 / -0.8% 65621052 / 68735827 / -4.5% 0.57 / 0.55 / +3.9%
clickbench_q37/datafusion:vortex-file-compressed 21857628 / 21707569 / +0.7% 46985112 / 48522739 / -3.2% 0.47 / 0.45 / +4.0%
clickbench_q38/datafusion:vortex-file-compressed 11845636 / 11842752 / +0.0% 40788535 / 40462250 / +0.8% 0.29 / 0.29 / -0.8%
clickbench_q39/datafusion:vortex-file-compressed 77376508 / 77970286 / -0.8% 108116318 / 111893693 / -3.4% 0.72 / 0.70 / +2.7%
clickbench_q40/datafusion:vortex-file-compressed 11134376 / 10870766 / +2.4% 37657897 / 39525926 / -4.7% 0.30 / 0.28 / +7.5%
clickbench_q41/datafusion:vortex-file-compressed 10679201 / 10968894 / -2.6% 36342785 / 38911125 / -6.6% 0.29 / 0.28 / +4.2%
clickbench_q42/datafusion:vortex-file-compressed 11165153 / 11090516 / +0.7% 35955942 / 36463167 / -1.4% 0.31 / 0.30 / +2.1%
datafusion / vortex-compact / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1234954 / 1218520 / +1.3% 20914615 / 20514158 / +2.0% 0.06 / 0.06 / -0.6%
clickbench_q01/datafusion:vortex-compact 6941150 / 7165106 / -3.1% 34203223 / 33721537 / +1.4% 0.20 / 0.21 / -4.5%
clickbench_q02/datafusion:vortex-compact 19732789 / 20331238 / -2.9% 44729404 / 46167168 / -3.1% 0.44 / 0.44 / +0.2%
clickbench_q03/datafusion:vortex-compact 14295194 / 13749716 / +4.0% 41532808 / 40006177 / +3.8% 0.34 / 0.34 / +0.1%
clickbench_q04/datafusion:vortex-compact 58979397 / 58271328 / +1.2% 88636422 / 90474686 / -2.0% 0.67 / 0.64 / +3.3%
clickbench_q05/datafusion:vortex-compact 85967624 / 88179400 / -2.5% 116590706 / 120380879 / -3.1% 0.74 / 0.73 / +0.7%
clickbench_q06/datafusion:vortex-compact 1239196 / 1243699 / -0.4% 20284694 / 20308876 / -0.1% 0.06 / 0.06 / -0.2%
clickbench_q07/datafusion:vortex-compact 12075084 / 12345266 / -2.2% 35998365 / 35047069 / +2.7% 0.34 / 0.35 / -4.8%
clickbench_q08/datafusion:vortex-compact 87027324 / 86809626 / +0.3% 118935171 / 115175431 / +3.3% 0.73 / 0.75 / -2.9%
clickbench_q09/datafusion:vortex-compact 188366006 / 189147963 / -0.4% 219731551 / 219031848 / +0.3% 0.86 / 0.86 / -0.7%
clickbench_q10/datafusion:vortex-compact 43330334 / 43740248 / -0.9% 72419471 / 70755791 / +2.4% 0.60 / 0.62 / -3.2%
clickbench_q11/datafusion:vortex-compact 55978444 / 55451336 / +1.0% 80702851 / 81688167 / -1.2% 0.69 / 0.68 / +2.2%
clickbench_q12/datafusion:vortex-compact 87477718 / 84591020 / +3.4% 117853463 / 125685309 / -6.2% 0.74 / 0.67 / +10.3%
clickbench_q13/datafusion:vortex-compact 140003552 / 137679052 / +1.7% 178906533 / 185515865 / -3.6% 0.78 / 0.74 / +5.4%
clickbench_q14/datafusion:vortex-compact 93285612 / 89503722 / +4.2% 128975145 / 127810711 / +0.9% 0.72 / 0.70 / +3.3%
clickbench_q15/datafusion:vortex-compact 62072002 / 63106820 / -1.6% 97532802 / 93296663 / +4.5% 0.64 / 0.68 / -5.9%
clickbench_q16/datafusion:vortex-compact 169294610 / 166935431 / +1.4% 210201895 / 207537712 / +1.3% 0.81 / 0.80 / +0.1%
clickbench_q17/datafusion:vortex-compact 162204768 / 165218004 / -1.8% 211857277 / 218277652 / -2.9% 0.77 / 0.76 / +1.2%
clickbench_q18/datafusion:vortex-compact 304872546 / 311983194 / -2.3% 356009248 / 376529261 / -5.4% 0.86 / 0.83 / +3.4%
clickbench_q19/datafusion:vortex-compact 9846064 / 10240091 / -3.8% 38519730 / 40765474 / -5.5% 0.26 / 0.25 / +1.8%
clickbench_q20/datafusion:vortex-compact 74054190 / 73849008 / +0.3% 193723215 / 195570840 / -0.9% 0.38 / 0.38 / +1.2%
clickbench_q21/datafusion:vortex-compact 118597835 / 119338953 / -0.6% 234520690 / 228175561 / +2.8% 0.51 / 0.52 / -3.3%
clickbench_q22/datafusion:vortex-compact 185073100 / 187745750 / -1.4% 281876209 / 272009463 / +3.6% 0.66 / 0.69 / -4.9%
clickbench_q23/datafusion:vortex-compact 529507674 / 603419602 / -12.2% 🟢 631787892 / 690187990 / -8.5% 0.84 / 0.87 / -4.1%
clickbench_q24/datafusion:vortex-compact 29280712 / 27739246 / +5.6% 60347480 / 62375122 / -3.3% 0.49 / 0.44 / +9.1%
clickbench_q25/datafusion:vortex-compact 36658507 / 36633690 / +0.1% 65322992 / 68142215 / -4.1% 0.56 / 0.54 / +4.4%
clickbench_q26/datafusion:vortex-compact 30334723 / 29477586 / +2.9% 60039505 / 62423690 / -3.8% 0.51 / 0.47 / +7.0%
clickbench_q27/datafusion:vortex-compact 104981666 / 102538024 / +2.4% 210877128 / 206536341 / +2.1% 0.50 / 0.50 / +0.3%
clickbench_q28/datafusion:vortex-compact 581973252 / 581891513 / +0.0% 606473038 / 640639327 / -5.3% 0.96 / 0.91 / +5.6%
clickbench_q29/datafusion:vortex-compact 30890438 / 30584710 / +1.0% 54002667 / 55592113 / -2.9% 0.57 / 0.55 / +4.0%
clickbench_q30/datafusion:vortex-compact 93235071 / 93517934 / -0.3% 129532605 / 133565056 / -3.0% 0.72 / 0.70 / +2.8%
clickbench_q31/datafusion:vortex-compact 99249436 / 100198448 / -0.9% 152537955 / 157371175 / -3.1% 0.65 / 0.64 / +2.2%
clickbench_q32/datafusion:vortex-compact 298702492 / 306776931 / -2.6% 368420381 / 381824134 / -3.5% 0.81 / 0.80 / +0.9%
clickbench_q33/datafusion:vortex-compact 338897950 / 339447450 / -0.2% 414044007 / 438305512 / -5.5% 0.82 / 0.77 / +5.7%
clickbench_q34/datafusion:vortex-compact 346661016 / 344275490 / +0.7% 418985684 / 422494708 / -0.8% 0.83 / 0.81 / +1.5%
clickbench_q35/datafusion:vortex-compact 63388230 / 64051915 / -1.0% 90802301 / 90187011 / +0.7% 0.70 / 0.71 / -1.7%
clickbench_q36/datafusion:vortex-compact 37825598 / 38223459 / -1.0% 65985790 / 67349861 / -2.0% 0.57 / 0.57 / +1.0%
clickbench_q37/datafusion:vortex-compact 22428389 / 22667656 / -1.1% 47264902 / 48127682 / -1.8% 0.47 / 0.47 / +0.8%
clickbench_q38/datafusion:vortex-compact 12719860 / 12755558 / -0.3% 40240946 / 41833543 / -3.8% 0.32 / 0.30 / +3.7%
clickbench_q39/datafusion:vortex-compact 78847564 / 79181504 / -0.4% 108628413 / 112035141 / -3.0% 0.73 / 0.71 / +2.7%
clickbench_q40/datafusion:vortex-compact 12507862 / 12329351 / +1.4% 37115545 / 38186503 / -2.8% 0.34 / 0.32 / +4.4%
clickbench_q41/datafusion:vortex-compact 12934064 / 12682689 / +2.0% 36852293 / 37980252 / -3.0% 0.35 / 0.33 / +5.1%
clickbench_q42/datafusion:vortex-compact 11145936 / 11075602 / +0.6% 34523325 / 37052657 / -6.8% 0.32 / 0.30 / +8.0%
datafusion / parquet / ns (0.979x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1262208 / 1248666 / +1.1% 50965217 / 50674550 / +0.6% 0.02 / 0.02 / +0.5%
clickbench_q01/datafusion:parquet 15852801 / 16261794 / -2.5% 68952995 / 71148607 / -3.1% 0.23 / 0.23 / +0.6%
clickbench_q02/datafusion:parquet 18868394 / 18762621 / +0.6% 85270127 / 83030696 / +2.7% 0.22 / 0.23 / -2.1%
clickbench_q03/datafusion:parquet 17237440 / 17195102 / +0.2% 84994307 / 81411249 / +4.4% 0.20 / 0.21 / -4.0%
clickbench_q04/datafusion:parquet 62047702 / 63354337 / -2.1% 125260789 / 129119589 / -3.0% 0.50 / 0.49 / +1.0%
clickbench_q05/datafusion:parquet 87187584 / 88844260 / -1.9% 159254763 / 160327899 / -0.7% 0.55 / 0.55 / -1.2%
clickbench_q06/datafusion:parquet 1287853 / 1240214 / +3.8% 51367086 / 49710136 / +3.3% 0.03 / 0.02 / +0.5%
clickbench_q07/datafusion:parquet 16584550 / 16890980 / -1.8% 68609393 / 67962034 / +1.0% 0.24 / 0.25 / -2.7%
clickbench_q08/datafusion:parquet 84961435 / 85061250 / -0.1% 163943970 / 163012411 / +0.6% 0.52 / 0.52 / -0.7%
clickbench_q09/datafusion:parquet 187298988 / 189203609 / -1.0% 272068874 / 270632685 / +0.5% 0.69 / 0.70 / -1.5%
clickbench_q10/datafusion:parquet 35142540 / 36601414 / -4.0% 101987620 / 102731359 / -0.7% 0.34 / 0.36 / -3.3%
clickbench_q11/datafusion:parquet 44858389 / 42820304 / +4.8% 113400126 / 112329735 / +1.0% 0.40 / 0.38 / +3.8%
clickbench_q12/datafusion:parquet 95190378 / 95946685 / -0.8% 163168982 / 164878211 / -1.0% 0.58 / 0.58 / +0.3%
clickbench_q13/datafusion:parquet 145403694 / 147449550 / -1.4% 225258127 / 232667652 / -3.2% 0.65 / 0.63 / +1.9%
clickbench_q14/datafusion:parquet 99540655 / 101570327 / -2.0% 174541204 / 176212981 / -0.9% 0.57 / 0.58 / -1.1%
clickbench_q15/datafusion:parquet 71114242 / 71215126 / -0.1% 131280251 / 132957062 / -1.3% 0.54 / 0.54 / +1.1%
clickbench_q16/datafusion:parquet 153910594 / 155956499 / -1.3% 231571846 / 241651347 / -4.2% 0.66 / 0.65 / +3.0%
clickbench_q17/datafusion:parquet 153452330 / 156850529 / -2.2% 232252065 / 241796412 / -3.9% 0.66 / 0.65 / +1.9%
clickbench_q18/datafusion:parquet 312612516 / 316711610 / -1.3% 412432133 / 421464415 / -2.1% 0.76 / 0.75 / +0.9%
clickbench_q19/datafusion:parquet 19414584 / 18651205 / +4.1% 77908837 / 77599466 / +0.4% 0.25 / 0.24 / +3.7%
clickbench_q20/datafusion:parquet 169491870 / 181282567 / -6.5% 294882503 / 296948476 / -0.7% 0.57 / 0.61 / -5.8%
clickbench_q21/datafusion:parquet 164000906 / 174007663 / -5.8% 310480341 / 316344166 / -1.9% 0.53 / 0.55 / -4.0%
clickbench_q22/datafusion:parquet 245924362 / 259863082 / -5.4% 452412367 / 458777006 / -1.4% 0.54 / 0.57 / -4.0%
clickbench_q23/datafusion:parquet 955386798 / 1121270496 / -14.8% 🟢 1198477325 / 1271960961 / -5.8% 0.80 / 0.88 / -9.6%
clickbench_q24/datafusion:parquet 29687470 / 29908004 / -0.7% 92049325 / 90973777 / +1.2% 0.32 / 0.33 / -1.9%
clickbench_q25/datafusion:parquet 35385516 / 37356178 / -5.3% 103204235 / 104951637 / -1.7% 0.34 / 0.36 / -3.7%
clickbench_q26/datafusion:parquet 30521946 / 30298266 / +0.7% 93217577 / 94990767 / -1.9% 0.33 / 0.32 / +2.7%
clickbench_q27/datafusion:parquet 181256310 / 194471708 / -6.8% 304940095 / 303642736 / +0.4% 0.59 / 0.64 / -7.2%
clickbench_q28/datafusion:parquet 619058374 / 626889826 / -1.2% 707209193 / 714969361 / -1.1% 0.88 / 0.88 / -0.2%
clickbench_q29/datafusion:parquet 28901556 / 28855514 / +0.2% 91229418 / 92735185 / -1.6% 0.32 / 0.31 / +1.8%
clickbench_q30/datafusion:parquet 88425334 / 91374237 / -3.2% 172668223 / 175352107 / -1.5% 0.51 / 0.52 / -1.7%
clickbench_q31/datafusion:parquet 98737380 / 103920149 / -5.0% 194404152 / 201411255 / -3.5% 0.51 / 0.52 / -1.6%
clickbench_q32/datafusion:parquet 313971930 / 333823982 / -5.9% 412348859 / 433890883 / -5.0% 0.76 / 0.77 / -1.0%
clickbench_q33/datafusion:parquet 368932638 / 384234452 / -4.0% 453490309 / 481163445 / -5.8% 0.81 / 0.80 / +1.9%
clickbench_q34/datafusion:parquet 370205916 / 383579387 / -3.5% 459599559 / 479141684 / -4.1% 0.81 / 0.80 / +0.6%
clickbench_q35/datafusion:parquet 63049676 / 64999929 / -3.0% 127061640 / 124009260 / +2.5% 0.50 / 0.52 / -5.3%
clickbench_q36/datafusion:parquet 73006034 / 73238122 / -0.3% 134694291 / 139145527 / -3.2% 0.54 / 0.53 / +3.0%
clickbench_q37/datafusion:parquet 35118516 / 35337692 / -0.6% 91367319 / 92525371 / -1.3% 0.38 / 0.38 / +0.6%
clickbench_q38/datafusion:parquet 46510482 / 47774183 / -2.6% 105827641 / 110068026 / -3.9% 0.44 / 0.43 / +1.3%
clickbench_q39/datafusion:parquet 142752135 / 143495754 / -0.5% 210650247 / 213701963 / -1.4% 0.68 / 0.67 / +0.9%
clickbench_q40/datafusion:parquet 19670934 / 20319687 / -3.2% 76888887 / 78728787 / -2.3% 0.26 / 0.26 / -0.9%
clickbench_q41/datafusion:parquet 18659908 / 18592491 / +0.4% 76453300 / 76860792 / -0.5% 0.24 / 0.24 / +0.9%
clickbench_q42/datafusion:parquet 19158939 / 19336308 / -0.9% 75495467 / 74945510 / +0.7% 0.25 / 0.26 / -1.6%
duckdb / vortex-file-compressed / ns (1.086x ➖, 2↑ 16↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1577282 / 1555660 / +1.4% 25137496 / 26610999 / -5.5% 0.06 / 0.06 / +7.3%
clickbench_q01/duckdb:vortex-file-compressed 12507916 / 11781086 / +6.2% 31313004 / 28832902 / +8.6% 0.40 / 0.41 / -2.2%
clickbench_q02/duckdb:vortex-file-compressed 14522954 / 13836074 / +5.0% 32849328 / 36131089 / -9.1% 0.44 / 0.38 / +15.5%
clickbench_q03/duckdb:vortex-file-compressed 24738540 / 17140524 / +44.3% 🔴 37643784 / 53468402 / -29.6% 🟢 0.66 / 0.32 / +105.0%
clickbench_q04/duckdb:vortex-file-compressed 76363228 / 77080077 / -0.9% 90771571 / 104764827 / -13.4% 🟢 0.84 / 0.74 / +14.3%
clickbench_q05/duckdb:vortex-file-compressed 68740232 / 69369968 / -0.9% 87734369 / 98497477 / -10.9% 🟢 0.78 / 0.70 / +11.2%
clickbench_q06/duckdb:vortex-file-compressed 1830844 / 2050057 / -10.7% 🟢 29103148 / 28556723 / +1.9% 0.06 / 0.07 / -12.4%
clickbench_q07/duckdb:vortex-file-compressed 17035212 / 14163454 / +20.3% 🔴 31549182 / 32663221 / -3.4% 0.54 / 0.43 / +24.5%
clickbench_q08/duckdb:vortex-file-compressed 94417597 / 83843124 / +12.6% 🔴 105951137 / 133020092 / -20.3% 🟢 0.89 / 0.63 / +41.4%
clickbench_q09/duckdb:vortex-file-compressed 114871662 / 107725871 / +6.6% 134407708 / 150064254 / -10.4% 🟢 0.85 / 0.72 / +19.1%
clickbench_q10/duckdb:vortex-file-compressed 43150752 / 34233652 / +26.0% 🔴 59101841 / 71593935 / -17.4% 🟢 0.73 / 0.48 / +52.7%
clickbench_q11/duckdb:vortex-file-compressed 44736056 / 35341393 / +26.6% 🔴 65543554 / 77723859 / -15.7% 🟢 0.68 / 0.45 / +50.1%
clickbench_q12/duckdb:vortex-file-compressed 74860500 / 74770450 / +0.1% 99922797 / 104373673 / -4.3% 0.75 / 0.72 / +4.6%
clickbench_q13/duckdb:vortex-file-compressed 142341386 / 142453523 / -0.1% 157643943 / 181443736 / -13.1% 🟢 0.90 / 0.79 / +15.0%
clickbench_q14/duckdb:vortex-file-compressed 81767442 / 80848595 / +1.1% 103673765 / 107241481 / -3.3% 0.79 / 0.75 / +4.6%
clickbench_q15/duckdb:vortex-file-compressed 98125068 / 93632290 / +4.8% 118913386 / 130965227 / -9.2% 0.83 / 0.71 / +15.4%
clickbench_q16/duckdb:vortex-file-compressed 165891092 / 165086103 / +0.5% 189545447 / 212027800 / -10.6% 🟢 0.88 / 0.78 / +12.4%
clickbench_q17/duckdb:vortex-file-compressed 169705326 / 168316407 / +0.8% 180798117 / 212915965 / -15.1% 🟢 0.94 / 0.79 / +18.7%
clickbench_q18/duckdb:vortex-file-compressed 323404946 / 321957444 / +0.4% 352659773 / 379013620 / -7.0% 0.92 / 0.85 / +8.0%
clickbench_q19/duckdb:vortex-file-compressed 18756620 / 16469936 / +13.9% 🔴 38491832 / 41085999 / -6.3% 0.49 / 0.40 / +21.6%
clickbench_q20/duckdb:vortex-file-compressed 139644620 / 111091562 / +25.7% 🔴 152933665 / 191326909 / -20.1% 🟢 0.91 / 0.58 / +57.3%
clickbench_q21/duckdb:vortex-file-compressed 211856724 / 161411504 / +31.3% 🔴 227342005 / 306668783 / -25.9% 🟢 0.93 / 0.53 / +77.1%
clickbench_q22/duckdb:vortex-file-compressed 323126522 / 243102506 / +32.9% 🔴 335904153 / 473518056 / -29.1% 🟢 0.96 / 0.51 / +87.4%
clickbench_q23/duckdb:vortex-file-compressed 82201962 / 57912988 / +41.9% 🔴 100203337 / 106188703 / -5.6% 0.82 / 0.55 / +50.4%
clickbench_q24/duckdb:vortex-file-compressed 28344730 / 26464748 / +7.1% 42862824 / 49261544 / -13.0% 🟢 0.66 / 0.54 / +23.1%
clickbench_q25/duckdb:vortex-file-compressed 32042748 / 32604929 / -1.7% 45591780 / 54143239 / -15.8% 🟢 0.70 / 0.60 / +16.7%
clickbench_q26/duckdb:vortex-file-compressed 22886394 / 20767506 / +10.2% 🔴 30247717 / 40737224 / -25.7% 🟢 0.76 / 0.51 / +48.4%
clickbench_q27/duckdb:vortex-file-compressed 181726092 / 145419334 / +25.0% 🔴 192532422 / 252360295 / -23.7% 🟢 0.94 / 0.58 / +63.8%
clickbench_q28/duckdb:vortex-file-compressed 626065896 / 835607383 / -25.1% 🟢 649447438 / 679116000 / -4.4% 0.96 / 1.23 / -21.7%
clickbench_q29/duckdb:vortex-file-compressed 19303336 / 18452732 / +4.6% 36820724 / 40940911 / -10.1% 🟢 0.52 / 0.45 / +16.3%
clickbench_q30/duckdb:vortex-file-compressed 77757024 / 66155557 / +17.5% 🔴 95370385 / 116403278 / -18.1% 🟢 0.82 / 0.57 / +43.5%
clickbench_q31/duckdb:vortex-file-compressed 155379352 / 127292754 / +22.1% 🔴 175747752 / 208706847 / -15.8% 🟢 0.88 / 0.61 / +45.0%
clickbench_q32/duckdb:vortex-file-compressed 439406312 / 445166432 / -1.3% 462534511 / 495199203 / -6.6% 0.95 / 0.90 / +5.7%
clickbench_q33/duckdb:vortex-file-compressed 395522440 / 385800970 / +2.5% 421908505 / 499735089 / -15.6% 🟢 0.94 / 0.77 / +21.4%
clickbench_q34/duckdb:vortex-file-compressed 420374274 / 419334437 / +0.2% 438789659 / 551039433 / -20.4% 🟢 0.96 / 0.76 / +25.9%
clickbench_q35/duckdb:vortex-file-compressed 106654314 / 102418915 / +4.1% 128227368 / 145629829 / -11.9% 🟢 0.83 / 0.70 / +18.3%
clickbench_q36/duckdb:vortex-file-compressed 18614251 / 16406492 / +13.5% 🔴 30844503 / 33727523 / -8.5% 0.60 / 0.49 / +24.1%
clickbench_q37/duckdb:vortex-file-compressed 12780019 / 12172136 / +5.0% 31089798 / 28478850 / +9.2% 0.41 / 0.43 / -3.8%
clickbench_q38/duckdb:vortex-file-compressed 14623110 / 13966158 / +4.7% 26964365 / 28868971 / -6.6% 0.54 / 0.48 / +12.1%
clickbench_q39/duckdb:vortex-file-compressed 25013319 / 24545774 / +1.9% 42357687 / 43063175 / -1.6% 0.59 / 0.57 / +3.6%
clickbench_q40/duckdb:vortex-file-compressed 11902830 / 10820871 / +10.0% 26516458 / 27873084 / -4.9% 0.45 / 0.39 / +15.6%
clickbench_q41/duckdb:vortex-file-compressed 12657134 / 12830578 / -1.4% 28005607 / 28261988 / -0.9% 0.45 / 0.45 / -0.4%
clickbench_q42/duckdb:vortex-file-compressed 14029876 / 12307592 / +14.0% 🔴 27484286 / 27507131 / -0.1% 0.51 / 0.45 / +14.1%
duckdb / vortex-compact / ns (1.087x ➖, 0↑ 20↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1596116 / 1624142 / -1.7% 26116159 / 23788879 / +9.8% 0.06 / 0.07 / -10.5%
clickbench_q01/duckdb:vortex-compact 13868133 / 14611340 / -5.1% 28524805 / 28737551 / -0.7% 0.49 / 0.51 / -4.4%
clickbench_q02/duckdb:vortex-compact 24177874 / 20342177 / +18.9% 🔴 37731513 / 42481998 / -11.2% 🟢 0.64 / 0.48 / +33.8%
clickbench_q03/duckdb:vortex-compact 24191290 / 20958997 / +15.4% 🔴 38590327 / 54359716 / -29.0% 🟢 0.63 / 0.39 / +62.6%
clickbench_q04/duckdb:vortex-compact 80410580 / 72302596 / +11.2% 🔴 88277166 / 107210276 / -17.7% 🟢 0.91 / 0.67 / +35.1%
clickbench_q05/duckdb:vortex-compact 84161884 / 75487450 / +11.5% 🔴 95743742 / 98174917 / -2.5% 0.88 / 0.77 / +14.3%
clickbench_q06/duckdb:vortex-compact 1799534 / 1975292 / -8.9% 28669781 / 28414301 / +0.9% 0.06 / 0.07 / -9.7%
clickbench_q07/duckdb:vortex-compact 15764839 / 14724766 / +7.1% 35107354 / 31373286 / +11.9% 🔴 0.45 / 0.47 / -4.3%
clickbench_q08/duckdb:vortex-compact 102258254 / 96022259 / +6.5% 117728555 / 134522619 / -12.5% 🟢 0.87 / 0.71 / +21.7%
clickbench_q09/duckdb:vortex-compact 153113738 / 142531730 / +7.4% 161949311 / 179314897 / -9.7% 0.95 / 0.79 / +18.9%
clickbench_q10/duckdb:vortex-compact 60424749 / 52368664 / +15.4% 🔴 76972733 / 89720452 / -14.2% 🟢 0.79 / 0.58 / +34.5%
clickbench_q11/duckdb:vortex-compact 75868778 / 67319914 / +12.7% 🔴 93218769 / 105745354 / -11.8% 🟢 0.81 / 0.64 / +27.8%
clickbench_q12/duckdb:vortex-compact 96828934 / 91058630 / +6.3% 112429449 / 122276367 / -8.1% 0.86 / 0.74 / +15.7%
clickbench_q13/duckdb:vortex-compact 177374390 / 163663890 / +8.4% 195106992 / 212104600 / -8.0% 0.91 / 0.77 / +17.8%
clickbench_q14/duckdb:vortex-compact 107564204 / 97007480 / +10.9% 🔴 122575880 / 131946165 / -7.1% 0.88 / 0.74 / +19.4%
clickbench_q15/duckdb:vortex-compact 102135966 / 96349476 / +6.0% 132802601 / 135882541 / -2.3% 0.77 / 0.71 / +8.5%
clickbench_q16/duckdb:vortex-compact 200325848 / 180450493 / +11.0% 🔴 207457609 / 221549460 / -6.4% 0.97 / 0.81 / +18.6%
clickbench_q17/duckdb:vortex-compact 191515118 / 182144784 / +5.1% 224809416 / 242501932 / -7.3% 0.85 / 0.75 / +13.4%
clickbench_q18/duckdb:vortex-compact 331357007 / 347221068 / -4.6% 349168032 / 389180143 / -10.3% 🟢 0.95 / 0.89 / +6.4%
clickbench_q19/duckdb:vortex-compact 18092370 / 16629261 / +8.8% 33468739 / 39935291 / -16.2% 🟢 0.54 / 0.42 / +29.8%
clickbench_q20/duckdb:vortex-compact 135203962 / 111637470 / +21.1% 🔴 152225239 / 182133382 / -16.4% 🟢 0.89 / 0.61 / +44.9%
clickbench_q21/duckdb:vortex-compact 238809741 / 180599658 / +32.2% 🔴 250666611 / 327718011 / -23.5% 🟢 0.95 / 0.55 / +72.9%
clickbench_q22/duckdb:vortex-compact 423434516 / 355788996 / +19.0% 🔴 428799560 / 565709205 / -24.2% 🟢 0.99 / 0.63 / +57.0%
clickbench_q23/duckdb:vortex-compact 113314614 / 92353930 / +22.7% 🔴 126755648 / 123748622 / +2.4% 0.89 / 0.75 / +19.8%
clickbench_q24/duckdb:vortex-compact 36166556 / 32261884 / +12.1% 🔴 51026112 / 48347550 / +5.5% 0.71 / 0.67 / +6.2%
clickbench_q25/duckdb:vortex-compact 53865363 / 47447020 / +13.5% 🔴 62643115 / 75521580 / -17.1% 🟢 0.86 / 0.63 / +36.9%
clickbench_q26/duckdb:vortex-compact 26872764 / 23931724 / +12.3% 🔴 33503667 / 40327768 / -16.9% 🟢 0.80 / 0.59 / +35.2%
clickbench_q27/duckdb:vortex-compact 239444101 / 194363813 / +23.2% 🔴 243422979 / 322009569 / -24.4% 🟢 0.98 / 0.60 / +63.0%
clickbench_q28/duckdb:vortex-compact 623174042 / 600215280 / +3.8% 637473067 / 683199128 / -6.7% 0.98 / 0.88 / +11.3%
clickbench_q29/duckdb:vortex-compact 27904328 / 23469530 / +18.9% 🔴 42644634 / 45491424 / -6.3% 0.65 / 0.52 / +26.8%
clickbench_q30/duckdb:vortex-compact 131547816 / 112331456 / +17.1% 🔴 142474236 / 158527705 / -10.1% 🟢 0.92 / 0.71 / +30.3%
clickbench_q31/duckdb:vortex-compact 197699421 / 174169635 / +13.5% 🔴 227037904 / 252709846 / -10.2% 🟢 0.87 / 0.69 / +26.3%
clickbench_q32/duckdb:vortex-compact 450964617 / 479328178 / -5.9% 487350535 / 528017463 / -7.7% 0.93 / 0.91 / +1.9%
clickbench_q33/duckdb:vortex-compact 403129084 / 404644044 / -0.4% 411872613 / 511009693 / -19.4% 🟢 0.98 / 0.79 / +23.6%
clickbench_q34/duckdb:vortex-compact 423459854 / 413275762 / +2.5% 441460703 / 528416266 / -16.5% 🟢 0.96 / 0.78 / +22.6%
clickbench_q35/duckdb:vortex-compact 114154588 / 109895418 / +3.9% 154380434 / 140403090 / +10.0% 0.74 / 0.78 / -5.5%
clickbench_q36/duckdb:vortex-compact 19566932 / 18443364 / +6.1% 41409380 / 32427851 / +27.7% 🔴 0.47 / 0.57 / -16.9%
clickbench_q37/duckdb:vortex-compact 15254077 / 14783627 / +3.2% 28648065 / 31346342 / -8.6% 0.53 / 0.47 / +12.9%
clickbench_q38/duckdb:vortex-compact 15350614 / 13562504 / +13.2% 🔴 28736038 / 28911154 / -0.6% 0.53 / 0.47 / +13.9%
clickbench_q39/duckdb:vortex-compact 27894452 / 26262972 / +6.2% 43313729 / 41778694 / +3.7% 0.64 / 0.63 / +2.4%
clickbench_q40/duckdb:vortex-compact 13748936 / 13103070 / +4.9% 28910306 / 31759007 / -9.0% 0.48 / 0.41 / +15.3%
clickbench_q41/duckdb:vortex-compact 14937746 / 14943380 / -0.0% 30369218 / 30350475 / +0.1% 0.49 / 0.49 / -0.1%
clickbench_q42/duckdb:vortex-compact 12592765 / 12388085 / +1.7% 28291164 / 28867129 / -2.0% 0.45 / 0.43 / +3.7%
duckdb / parquet / ns (0.993x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9917337 / 8188704 / +21.1% 🔴 23840907 / 25978629 / -8.2% 0.42 / 0.32 / +32.0%
clickbench_q01/duckdb:parquet 9625550 / 9901200 / -2.8% 22102422 / 22215098 / -0.5% 0.44 / 0.45 / -2.3%
clickbench_q02/duckdb:parquet 18173788 / 15495019 / +17.3% 🔴 32634276 / 35855076 / -9.0% 0.56 / 0.43 / +28.9%
clickbench_q03/duckdb:parquet 15985078 / 16017134 / -0.2% 52571143 / 55503757 / -5.3% 0.30 / 0.29 / +5.4%
clickbench_q04/duckdb:parquet 67696029 / 72294106 / -6.4% 95103949 / 103405382 / -8.0% 0.71 / 0.70 / +1.8%
clickbench_q05/duckdb:parquet 82396206 / 80965278 / +1.8% 131938512 / 125353809 / +5.3% 0.62 / 0.65 / -3.3%
clickbench_q06/duckdb:parquet 15391617 / 14773186 / +4.2% 25855270 / 23800327 / +8.6% 0.60 / 0.62 / -4.1%
clickbench_q07/duckdb:parquet 11171849 / 13256286 / -15.7% 🟢 25152304 / 25126959 / +0.1% 0.44 / 0.53 / -15.8%
clickbench_q08/duckdb:parquet 81901234 / 85591179 / -4.3% 125841367 / 131058726 / -4.0% 0.65 / 0.65 / -0.3%
clickbench_q09/duckdb:parquet 114934414 / 114570831 / +0.3% 163190741 / 161664641 / +0.9% 0.70 / 0.71 / -0.6%
clickbench_q10/duckdb:parquet 32471066 / 33618728 / -3.4% 70473454 / 70864710 / -0.6% 0.46 / 0.47 / -2.9%
clickbench_q11/duckdb:parquet 36584881 / 36150668 / +1.2% 76369202 / 77841601 / -1.9% 0.48 / 0.46 / +3.2%
clickbench_q12/duckdb:parquet 93282192 / 95129340 / -1.9% 149535862 / 129562608 / +15.4% 🔴 0.62 / 0.73 / -15.0%
clickbench_q13/duckdb:parquet 148143127 / 144599352 / +2.5% 206399092 / 211392462 / -2.4% 0.72 / 0.68 / +4.9%
clickbench_q14/duckdb:parquet 97842896 / 100808935 / -2.9% 146343013 / 144919177 / +1.0% 0.67 / 0.70 / -3.9%
clickbench_q15/duckdb:parquet 91553248 / 92959255 / -1.5% 129150692 / 121633756 / +6.2% 0.71 / 0.76 / -7.2%
clickbench_q16/duckdb:parquet 170381026 / 171936248 / -0.9% 227511864 / 242210282 / -6.1% 0.75 / 0.71 / +5.5%
clickbench_q17/duckdb:parquet 173796314 / 183724055 / -5.4% 226994090 / 232945903 / -2.6% 0.77 / 0.79 / -2.9%
clickbench_q18/duckdb:parquet 327374186 / 315987706 / +3.6% 415870100 / 406534129 / +2.3% 0.79 / 0.78 / +1.3%
clickbench_q19/duckdb:parquet 13441888 / 13225112 / +1.6% 44784228 / 41753034 / +7.3% 0.30 / 0.32 / -5.2%
clickbench_q20/duckdb:parquet 135267156 / 131089836 / +3.2% 244253345 / 250381531 / -2.4% 0.55 / 0.52 / +5.8%
clickbench_q21/duckdb:parquet 176519616 / 182542027 / -3.3% 317638693 / 324653048 / -2.2% 0.56 / 0.56 / -1.2%
clickbench_q22/duckdb:parquet 235679772 / 245135811 / -3.9% 430780927 / 411306695 / +4.7% 0.55 / 0.60 / -8.2%
clickbench_q23/duckdb:parquet 145132800 / 145770542 / -0.4% 173958109 / 166706922 / +4.3% 0.83 / 0.87 / -4.6%
clickbench_q24/duckdb:parquet 42376070 / 43180490 / -1.9% 62707083 / 63327310 / -1.0% 0.68 / 0.68 / -0.9%
clickbench_q25/duckdb:parquet 40173330 / 40270625 / -0.2% 96377999 / 91397272 / +5.4% 0.42 / 0.44 / -5.4%
clickbench_q26/duckdb:parquet 30211816 / 30946298 / -2.4% 50706953 / 47644733 / +6.4% 0.60 / 0.65 / -8.3%
clickbench_q27/duckdb:parquet 143635144 / 148859846 / -3.5% 261376851 / 258566970 / +1.1% 0.55 / 0.58 / -4.5%
clickbench_q28/duckdb:parquet 895960514 / 904229444 / -0.9% 991193628 / 1013536632 / -2.2% 0.90 / 0.89 / +1.3%
clickbench_q29/duckdb:parquet 18560275 / 17283162 / +7.4% 32836782 / 34486894 / -4.8% 0.57 / 0.50 / +12.8%
clickbench_q30/duckdb:parquet 94692116 / 93892706 / +0.9% 171351880 / 172337175 / -0.6% 0.55 / 0.54 / +1.4%
clickbench_q31/duckdb:parquet 143525513 / 148288425 / -3.2% 290923141 / 265553721 / +9.6% 0.49 / 0.56 / -11.7%
clickbench_q32/duckdb:parquet 438039524 / 450951973 / -2.9% 502447006 / 508105948 / -1.1% 0.87 / 0.89 / -1.8%
clickbench_q33/duckdb:parquet 432498908 / 472101960 / -8.4% 470808372 / 478063670 / -1.5% 0.92 / 0.99 / -7.0%
clickbench_q34/duckdb:parquet 446380830 / 450578300 / -0.9% 487078384 / 522061345 / -6.7% 0.92 / 0.86 / +6.2%
clickbench_q35/duckdb:parquet 100257504 / 102129014 / -1.8% 127704744 / 120247467 / +6.2% 0.79 / 0.85 / -7.6%
clickbench_q36/duckdb:parquet 31345468 / 31581072 / -0.7% 41601068 / 40732371 / +2.1% 0.75 / 0.78 / -2.8%
clickbench_q37/duckdb:parquet 22498235 / 23091040 / -2.6% 31771536 / 32936273 / -3.5% 0.71 / 0.70 / +1.0%
clickbench_q38/duckdb:parquet 24466768 / 24368718 / +0.4% 35259097 / 33606655 / +4.9% 0.69 / 0.73 / -4.3%
clickbench_q39/duckdb:parquet 56393785 / 56813448 / -0.7% 67410195 / 68932993 / -2.2% 0.84 / 0.82 / +1.5%
clickbench_q40/duckdb:parquet 12496524 / 13314852 / -6.1% 22212160 / 22181755 / +0.1% 0.56 / 0.60 / -6.3%
clickbench_q41/duckdb:parquet 13197092 / 13047572 / +1.1% 21521108 / 23638357 / -9.0% 0.61 / 0.55 / +11.1%
clickbench_q42/duckdb:parquet 14396731 / 14777680 / -2.6% 23744649 / 24237447 / -2.0% 0.61 / 0.61 / -0.6%

File Size Changes (200 files changed, +2.5% overall, 200↑ 0↓)
File Scale Format Base HEAD Change %
hits_48.vortex 1.0 vortex-compact 17.83 MB 19.94 MB +2.12 MB +11.9%
hits_47.vortex 1.0 vortex-compact 18.19 MB 20.23 MB +2.04 MB +11.2%
hits_48.vortex 1.0 vortex-file-compressed 28.75 MB 30.85 MB +2.11 MB +7.3%
hits_33.vortex 1.0 vortex-compact 35.91 MB 38.03 MB +2.11 MB +5.9%
hits_29.vortex 1.0 vortex-compact 36.66 MB 38.59 MB +1.93 MB +5.3%
hits_32.vortex 1.0 vortex-compact 44.57 MB 46.74 MB +2.17 MB +4.9%
hits_75.vortex 1.0 vortex-compact 45.11 MB 47.30 MB +2.18 MB +4.8%
hits_20.vortex 1.0 vortex-compact 38.33 MB 40.19 MB +1.85 MB +4.8%
hits_47.vortex 1.0 vortex-file-compressed 41.95 MB 43.94 MB +2.00 MB +4.8%
hits_19.vortex 1.0 vortex-compact 49.57 MB 51.87 MB +2.30 MB +4.6%
hits_24.vortex 1.0 vortex-compact 45.03 MB 47.11 MB +2.08 MB +4.6%
hits_49.vortex 1.0 vortex-compact 50.97 MB 53.30 MB +2.32 MB +4.6%
hits_23.vortex 1.0 vortex-compact 46.04 MB 48.13 MB +2.09 MB +4.5%
hits_10.vortex 1.0 vortex-compact 49.46 MB 51.69 MB +2.23 MB +4.5%
hits_36.vortex 1.0 vortex-compact 49.20 MB 51.40 MB +2.20 MB +4.5%
hits_66.vortex 1.0 vortex-compact 53.47 MB 55.86 MB +2.39 MB +4.5%
hits_15.vortex 1.0 vortex-compact 48.37 MB 50.52 MB +2.14 MB +4.4%
hits_22.vortex 1.0 vortex-compact 46.14 MB 48.17 MB +2.03 MB +4.4%
hits_86.vortex 1.0 vortex-compact 49.09 MB 51.25 MB +2.16 MB +4.4%
hits_63.vortex 1.0 vortex-compact 46.10 MB 48.09 MB +1.99 MB +4.3%
hits_16.vortex 1.0 vortex-compact 49.44 MB 51.57 MB +2.13 MB +4.3%
hits_11.vortex 1.0 vortex-compact 55.95 MB 58.30 MB +2.35 MB +4.2%
hits_46.vortex 1.0 vortex-compact 42.24 MB 44.01 MB +1.77 MB +4.2%
hits_83.vortex 1.0 vortex-compact 53.49 MB 55.68 MB +2.19 MB +4.1%
hits_17.vortex 1.0 vortex-compact 58.77 MB 61.16 MB +2.39 MB +4.1%
hits_72.vortex 1.0 vortex-compact 52.64 MB 54.78 MB +2.14 MB +4.1%
hits_31.vortex 1.0 vortex-compact 55.75 MB 57.99 MB +2.24 MB +4.0%
hits_85.vortex 1.0 vortex-compact 52.84 MB 54.95 MB +2.11 MB +4.0%
hits_53.vortex 1.0 vortex-compact 60.02 MB 62.40 MB +2.38 MB +4.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 72.58 MB +2.70 MB +3.9%
hits_95.vortex 1.0 vortex-compact 58.10 MB 60.35 MB +2.24 MB +3.9%
hits_93.vortex 1.0 vortex-compact 59.70 MB 61.96 MB +2.27 MB +3.8%
hits_39.vortex 1.0 vortex-compact 50.02 MB 51.88 MB +1.87 MB +3.7%
hits_61.vortex 1.0 vortex-compact 57.67 MB 59.80 MB +2.13 MB +3.7%
hits_21.vortex 1.0 vortex-compact 51.92 MB 53.84 MB +1.92 MB +3.7%
hits_28.vortex 1.0 vortex-compact 70.84 MB 73.46 MB +2.61 MB +3.7%
hits_26.vortex 1.0 vortex-compact 71.97 MB 74.58 MB +2.61 MB +3.6%
hits_30.vortex 1.0 vortex-compact 58.56 MB 60.68 MB +2.12 MB +3.6%
hits_33.vortex 1.0 vortex-file-compressed 58.81 MB 60.93 MB +2.13 MB +3.6%
hits_8.vortex 1.0 vortex-compact 63.37 MB 65.64 MB +2.27 MB +3.6%
hits_68.vortex 1.0 vortex-compact 76.63 MB 79.36 MB +2.73 MB +3.6%
hits_6.vortex 1.0 vortex-compact 63.55 MB 65.81 MB +2.26 MB +3.6%
hits_34.vortex 1.0 vortex-compact 58.22 MB 60.28 MB +2.05 MB +3.5%
hits_18.vortex 1.0 vortex-compact 64.80 MB 67.09 MB +2.28 MB +3.5%
hits_5.vortex 1.0 vortex-compact 63.30 MB 65.53 MB +2.22 MB +3.5%
hits_37.vortex 1.0 vortex-compact 54.28 MB 56.19 MB +1.91 MB +3.5%
hits_58.vortex 1.0 vortex-compact 61.22 MB 63.36 MB +2.15 MB +3.5%
hits_59.vortex 1.0 vortex-compact 66.63 MB 68.95 MB +2.32 MB +3.5%
hits_4.vortex 1.0 vortex-compact 71.93 MB 74.43 MB +2.50 MB +3.5%
hits_7.vortex 1.0 vortex-compact 64.16 MB 66.39 MB +2.23 MB +3.5%
hits_88.vortex 1.0 vortex-compact 73.50 MB 76.02 MB +2.52 MB +3.4%
hits_98.vortex 1.0 vortex-compact 72.92 MB 75.41 MB +2.49 MB +3.4%
hits_97.vortex 1.0 vortex-compact 69.35 MB 71.72 MB +2.36 MB +3.4%
hits_54.vortex 1.0 vortex-compact 117.47 MB 121.47 MB +4.00 MB +3.4%
hits_35.vortex 1.0 vortex-compact 75.31 MB 77.83 MB +2.53 MB +3.4%
hits_75.vortex 1.0 vortex-file-compressed 64.66 MB 66.82 MB +2.16 MB +3.3%
hits_0.vortex 1.0 vortex-compact 58.86 MB 60.83 MB +1.97 MB +3.3%
hits_79.vortex 1.0 vortex-compact 86.11 MB 88.98 MB +2.87 MB +3.3%
hits_74.vortex 1.0 vortex-compact 71.84 MB 74.24 MB +2.39 MB +3.3%
hits_81.vortex 1.0 vortex-compact 65.93 MB 68.10 MB +2.17 MB +3.3%
hits_38.vortex 1.0 vortex-compact 63.36 MB 65.44 MB +2.08 MB +3.3%
hits_73.vortex 1.0 vortex-compact 70.83 MB 73.14 MB +2.30 MB +3.3%
hits_52.vortex 1.0 vortex-compact 65.05 MB 67.16 MB +2.12 MB +3.3%
hits_64.vortex 1.0 vortex-compact 54.05 MB 55.80 MB +1.74 MB +3.2%
hits_25.vortex 1.0 vortex-compact 73.49 MB 75.85 MB +2.36 MB +3.2%
hits_78.vortex 1.0 vortex-compact 97.77 MB 100.91 MB +3.14 MB +3.2%
hits_76.vortex 1.0 vortex-compact 77.04 MB 79.52 MB +2.47 MB +3.2%
hits_69.vortex 1.0 vortex-compact 80.96 MB 83.55 MB +2.59 MB +3.2%
hits_70.vortex 1.0 vortex-compact 61.82 MB 63.79 MB +1.97 MB +3.2%
hits_40.vortex 1.0 vortex-compact 77.31 MB 79.77 MB +2.45 MB +3.2%
hits_9.vortex 1.0 vortex-compact 66.29 MB 68.39 MB +2.10 MB +3.2%
hits_84.vortex 1.0 vortex-compact 74.15 MB 76.49 MB +2.33 MB +3.1%
hits_10.vortex 1.0 vortex-file-compressed 72.07 MB 74.33 MB +2.25 MB +3.1%
hits_91.vortex 1.0 vortex-compact 61.20 MB 63.11 MB +1.91 MB +3.1%
hits_49.vortex 1.0 vortex-file-compressed 78.38 MB 80.82 MB +2.44 MB +3.1%
hits_32.vortex 1.0 vortex-file-compressed 68.72 MB 70.85 MB +2.13 MB +3.1%
hits_36.vortex 1.0 vortex-file-compressed 70.03 MB 72.19 MB +2.16 MB +3.1%
hits_71.vortex 1.0 vortex-compact 69.87 MB 72.03 MB +2.15 MB +3.1%
hits_99.vortex 1.0 vortex-compact 77.61 MB 80.00 MB +2.39 MB +3.1%
hits_29.vortex 1.0 vortex-file-compressed 61.81 MB 63.71 MB +1.90 MB +3.1%
hits_90.vortex 1.0 vortex-compact 82.09 MB 84.60 MB +2.51 MB +3.1%
hits_45.vortex 1.0 vortex-compact 75.78 MB 78.09 MB +2.31 MB +3.0%
hits_86.vortex 1.0 vortex-file-compressed 71.03 MB 73.19 MB +2.16 MB +3.0%
hits_3.vortex 1.0 vortex-compact 94.83 MB 97.69 MB +2.87 MB +3.0%
hits_56.vortex 1.0 vortex-compact 78.62 MB 81.00 MB +2.37 MB +3.0%
hits_89.vortex 1.0 vortex-compact 114.03 MB 117.44 MB +3.42 MB +3.0%
hits_82.vortex 1.0 vortex-compact 67.33 MB 69.31 MB +1.98 MB +2.9%
hits_67.vortex 1.0 vortex-compact 113.95 MB 117.28 MB +3.33 MB +2.9%
hits_20.vortex 1.0 vortex-file-compressed 64.29 MB 66.16 MB +1.87 MB +2.9%
hits_13.vortex 1.0 vortex-compact 68.69 MB 70.66 MB +1.97 MB +2.9%
hits_24.vortex 1.0 vortex-file-compressed 76.74 MB 78.92 MB +2.18 MB +2.8%
hits_96.vortex 1.0 vortex-compact 91.69 MB 94.29 MB +2.60 MB +2.8%
hits_63.vortex 1.0 vortex-file-compressed 71.20 MB 73.19 MB +1.99 MB +2.8%
hits_23.vortex 1.0 vortex-file-compressed 77.21 MB 79.36 MB +2.15 MB +2.8%
hits_53.vortex 1.0 vortex-file-compressed 88.39 MB 90.84 MB +2.45 MB +2.8%
hits_94.vortex 1.0 vortex-compact 90.58 MB 93.09 MB +2.50 MB +2.8%
hits_19.vortex 1.0 vortex-file-compressed 76.46 MB 78.57 MB +2.11 MB +2.8%
hits_60.vortex 1.0 vortex-compact 64.85 MB 66.63 MB +1.78 MB +2.7%
hits_22.vortex 1.0 vortex-file-compressed 77.65 MB 79.79 MB +2.13 MB +2.7%
hits_16.vortex 1.0 vortex-file-compressed 80.65 MB 82.86 MB +2.21 MB +2.7%
hits_62.vortex 1.0 vortex-compact 74.85 MB 76.90 MB +2.05 MB +2.7%
hits_12.vortex 1.0 vortex-compact 69.49 MB 71.39 MB +1.90 MB +2.7%
hits_80.vortex 1.0 vortex-compact 68.63 MB 70.50 MB +1.87 MB +2.7%
hits_11.vortex 1.0 vortex-file-compressed 83.69 MB 85.96 MB +2.27 MB +2.7%
hits_50.vortex 1.0 vortex-compact 113.70 MB 116.76 MB +3.06 MB +2.7%
hits_1.vortex 1.0 vortex-compact 90.69 MB 93.11 MB +2.41 MB +2.7%
hits_92.vortex 1.0 vortex-compact 94.39 MB 96.89 MB +2.50 MB +2.7%
hits_55.vortex 1.0 vortex-compact 92.52 MB 94.95 MB +2.43 MB +2.6%
hits_51.vortex 1.0 vortex-compact 168.31 MB 172.67 MB +4.37 MB +2.6%
hits_14.vortex 1.0 vortex-compact 74.51 MB 76.44 MB +1.93 MB +2.6%
hits_66.vortex 1.0 vortex-file-compressed 93.24 MB 95.64 MB +2.40 MB +2.6%
hits_77.vortex 1.0 vortex-compact 118.46 MB 121.49 MB +3.03 MB +2.6%
hits_87.vortex 1.0 vortex-compact 118.83 MB 121.83 MB +3.00 MB +2.5%
hits_17.vortex 1.0 vortex-file-compressed 91.91 MB 94.20 MB +2.29 MB +2.5%
hits_46.vortex 1.0 vortex-file-compressed 71.32 MB 73.10 MB +1.78 MB +2.5%
hits_72.vortex 1.0 vortex-file-compressed 88.41 MB 90.55 MB +2.14 MB +2.4%
hits_31.vortex 1.0 vortex-file-compressed 92.30 MB 94.53 MB +2.23 MB +2.4%
hits_93.vortex 1.0 vortex-file-compressed 95.37 MB 97.63 MB +2.27 MB +2.4%
hits_44.vortex 1.0 vortex-compact 132.85 MB 136.01 MB +3.15 MB +2.4%
hits_26.vortex 1.0 vortex-file-compressed 111.64 MB 114.28 MB +2.65 MB +2.4%
hits_15.vortex 1.0 vortex-file-compressed 91.20 MB 93.35 MB +2.15 MB +2.4%
hits_30.vortex 1.0 vortex-file-compressed 90.48 MB 92.59 MB +2.11 MB +2.3%
hits_83.vortex 1.0 vortex-file-compressed 93.53 MB 95.69 MB +2.16 MB +2.3%
hits_88.vortex 1.0 vortex-file-compressed 113.91 MB 116.54 MB +2.63 MB +2.3%
hits_57.vortex 1.0 vortex-compact 83.69 MB 85.60 MB +1.91 MB +2.3%
hits_6.vortex 1.0 vortex-file-compressed 94.80 MB 96.94 MB +2.14 MB +2.3%
hits_2.vortex 1.0 vortex-compact 129.16 MB 132.07 MB +2.92 MB +2.3%
hits_8.vortex 1.0 vortex-file-compressed 94.66 MB 96.79 MB +2.13 MB +2.3%
hits_7.vortex 1.0 vortex-file-compressed 95.45 MB 97.59 MB +2.14 MB +2.2%
hits_5.vortex 1.0 vortex-file-compressed 94.31 MB 96.42 MB +2.11 MB +2.2%
hits_39.vortex 1.0 vortex-file-compressed 81.95 MB 83.76 MB +1.82 MB +2.2%
hits_0.vortex 1.0 vortex-file-compressed 91.02 MB 93.03 MB +2.01 MB +2.2%
hits_4.vortex 1.0 vortex-file-compressed 111.55 MB 114.02 MB +2.47 MB +2.2%
hits_76.vortex 1.0 vortex-file-compressed 117.15 MB 119.74 MB +2.59 MB +2.2%
hits_85.vortex 1.0 vortex-file-compressed 95.04 MB 97.14 MB +2.10 MB +2.2%
hits_95.vortex 1.0 vortex-file-compressed 100.59 MB 102.80 MB +2.21 MB +2.2%
hits_58.vortex 1.0 vortex-file-compressed 92.40 MB 94.43 MB +2.03 MB +2.2%
hits_37.vortex 1.0 vortex-file-compressed 89.21 MB 91.16 MB +1.95 MB +2.2%
hits_59.vortex 1.0 vortex-file-compressed 105.52 MB 107.83 MB +2.31 MB +2.2%
hits_65.vortex 1.0 vortex-compact 129.36 MB 132.19 MB +2.82 MB +2.2%
hits_27.vortex 1.0 vortex-file-compressed 122.41 MB 125.08 MB +2.67 MB +2.2%
hits_35.vortex 1.0 vortex-file-compressed 119.39 MB 121.97 MB +2.58 MB +2.2%
hits_68.vortex 1.0 vortex-file-compressed 127.52 MB 130.27 MB +2.75 MB +2.2%
hits_28.vortex 1.0 vortex-file-compressed 120.47 MB 123.05 MB +2.59 MB +2.1%
hits_42.vortex 1.0 vortex-compact 164.50 MB 168.01 MB +3.51 MB +2.1%
hits_97.vortex 1.0 vortex-file-compressed 111.46 MB 113.83 MB +2.38 MB +2.1%
hits_40.vortex 1.0 vortex-file-compressed 119.93 MB 122.48 MB +2.55 MB +2.1%
hits_41.vortex 1.0 vortex-compact 166.03 MB 169.56 MB +3.53 MB +2.1%
hits_43.vortex 1.0 vortex-compact 169.18 MB 172.78 MB +3.59 MB +2.1%
hits_25.vortex 1.0 vortex-file-compressed 117.26 MB 119.73 MB +2.47 MB +2.1%
hits_79.vortex 1.0 vortex-file-compressed 148.70 MB 151.83 MB +3.13 MB +2.1%
hits_69.vortex 1.0 vortex-file-compressed 125.83 MB 128.47 MB +2.64 MB +2.1%
hits_18.vortex 1.0 vortex-file-compressed 109.80 MB 112.09 MB +2.29 MB +2.1%
hits_73.vortex 1.0 vortex-file-compressed 113.32 MB 115.67 MB +2.36 MB +2.1%
hits_52.vortex 1.0 vortex-file-compressed 107.27 MB 109.46 MB +2.19 MB +2.0%
hits_3.vortex 1.0 vortex-file-compressed 147.09 MB 150.06 MB +2.98 MB +2.0%
hits_64.vortex 1.0 vortex-file-compressed 83.40 MB 85.09 MB +1.69 MB +2.0%
hits_61.vortex 1.0 vortex-file-compressed 103.90 MB 105.99 MB +2.09 MB +2.0%
hits_21.vortex 1.0 vortex-file-compressed 96.10 MB 98.03 MB +1.93 MB +2.0%
hits_84.vortex 1.0 vortex-file-compressed 120.82 MB 123.24 MB +2.41 MB +2.0%
hits_98.vortex 1.0 vortex-file-compressed 121.51 MB 123.93 MB +2.42 MB +2.0%
hits_74.vortex 1.0 vortex-file-compressed 122.65 MB 125.08 MB +2.44 MB +2.0%
hits_9.vortex 1.0 vortex-file-compressed 101.79 MB 103.81 MB +2.02 MB +2.0%
hits_90.vortex 1.0 vortex-file-compressed 145.83 MB 148.72 MB +2.89 MB +2.0%
hits_34.vortex 1.0 vortex-file-compressed 100.90 MB 102.89 MB +1.99 MB +2.0%
hits_81.vortex 1.0 vortex-file-compressed 103.74 MB 105.78 MB +2.04 MB +2.0%
hits_38.vortex 1.0 vortex-file-compressed 102.71 MB 104.74 MB +2.02 MB +2.0%
hits_13.vortex 1.0 vortex-file-compressed 100.73 MB 102.71 MB +1.98 MB +2.0%
hits_70.vortex 1.0 vortex-file-compressed 96.77 MB 98.66 MB +1.89 MB +1.9%
hits_71.vortex 1.0 vortex-file-compressed 106.13 MB 108.20 MB +2.07 MB +1.9%
hits_45.vortex 1.0 vortex-file-compressed 122.90 MB 125.26 MB +2.36 MB +1.9%
hits_54.vortex 1.0 vortex-file-compressed 225.88 MB 230.20 MB +4.32 MB +1.9%
hits_82.vortex 1.0 vortex-file-compressed 102.22 MB 104.17 MB +1.95 MB +1.9%
hits_91.vortex 1.0 vortex-file-compressed 102.21 MB 104.15 MB +1.93 MB +1.9%
hits_78.vortex 1.0 vortex-file-compressed 167.44 MB 170.57 MB +3.13 MB +1.9%
hits_96.vortex 1.0 vortex-file-compressed 142.30 MB 144.93 MB +2.62 MB +1.8%
hits_55.vortex 1.0 vortex-file-compressed 173.90 MB 177.09 MB +3.20 MB +1.8%
hits_99.vortex 1.0 vortex-file-compressed 127.94 MB 130.28 MB +2.34 MB +1.8%
hits_77.vortex 1.0 vortex-file-compressed 172.87 MB 176.03 MB +3.16 MB +1.8%
hits_1.vortex 1.0 vortex-file-compressed 143.29 MB 145.88 MB +2.59 MB +1.8%
hits_12.vortex 1.0 vortex-file-compressed 103.73 MB 105.58 MB +1.86 MB +1.8%
hits_89.vortex 1.0 vortex-file-compressed 188.22 MB 191.57 MB +3.35 MB +1.8%
hits_80.vortex 1.0 vortex-file-compressed 108.37 MB 110.28 MB +1.91 MB +1.8%
hits_56.vortex 1.0 vortex-file-compressed 126.92 MB 129.14 MB +2.22 MB +1.7%
hits_87.vortex 1.0 vortex-file-compressed 176.84 MB 179.93 MB +3.09 MB +1.7%
hits_94.vortex 1.0 vortex-file-compressed 143.98 MB 146.48 MB +2.50 MB +1.7%
hits_44.vortex 1.0 vortex-file-compressed 191.26 MB 194.54 MB +3.28 MB +1.7%
hits_67.vortex 1.0 vortex-file-compressed 188.24 MB 191.41 MB +3.18 MB +1.7%
hits_14.vortex 1.0 vortex-file-compressed 113.62 MB 115.53 MB +1.91 MB +1.7%
hits_43.vortex 1.0 vortex-file-compressed 232.11 MB 235.98 MB +3.86 MB +1.7%
hits_65.vortex 1.0 vortex-file-compressed 185.87 MB 188.96 MB +3.09 MB +1.7%
hits_41.vortex 1.0 vortex-file-compressed 228.73 MB 232.52 MB +3.79 MB +1.7%
hits_62.vortex 1.0 vortex-file-compressed 122.23 MB 124.26 MB +2.03 MB +1.7%
hits_42.vortex 1.0 vortex-file-compressed 227.69 MB 231.45 MB +3.75 MB +1.6%
hits_92.vortex 1.0 vortex-file-compressed 153.24 MB 155.74 MB +2.50 MB +1.6%
hits_2.vortex 1.0 vortex-file-compressed 191.95 MB 195.02 MB +3.07 MB +1.6%
hits_60.vortex 1.0 vortex-file-compressed 108.73 MB 110.47 MB +1.74 MB +1.6%
hits_50.vortex 1.0 vortex-file-compressed 183.47 MB 186.37 MB +2.90 MB +1.6%
hits_51.vortex 1.0 vortex-file-compressed 282.30 MB 286.56 MB +4.25 MB +1.5%
hits_57.vortex 1.0 vortex-file-compressed 131.86 MB 133.84 MB +1.98 MB +1.5%

Totals:

  • vortex-compact: 7.10 GB → 7.33 GB (+3.3%)
  • vortex-file-compressed: 11.31 GB → 11.54 GB (+2.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +9.1%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB Likely regression (+19.3%, high confidence)
Vortex (geomean): hot 1.087x ➖ · cold 0.901x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92031141 / 90718299 / +1.4% 150393839 / 161920161 / -7.1% 0.61 / 0.56 / +9.2%
tpch_q02/datafusion:vortex-file-compressed 65031710 / 65106392 / -0.1% 93545324 / 93735096 / -0.2% 0.70 / 0.69 / +0.1%
tpch_q03/datafusion:vortex-file-compressed 65602074 / 65510838 / +0.1% 121610239 / 122072875 / -0.4% 0.54 / 0.54 / +0.5%
tpch_q04/datafusion:vortex-file-compressed 35036356 / 35419851 / -1.1% 83270353 / 82498686 / +0.9% 0.42 / 0.43 / -2.0%
tpch_q05/datafusion:vortex-file-compressed 119381179 / 120181046 / -0.7% 190940867 / 180443811 / +5.8% 0.63 / 0.67 / -6.1%
tpch_q06/datafusion:vortex-file-compressed 14573584 / 14889095 / -2.1% 73696572 / 71495537 / +3.1% 0.20 / 0.21 / -5.0%
tpch_q07/datafusion:vortex-file-compressed 139113980 / 134914143 / +3.1% 200272191 / 188757102 / +6.1% 0.69 / 0.71 / -2.8%
tpch_q08/datafusion:vortex-file-compressed 148908120 / 143590799 / +3.7% 218587126 / 205655383 / +6.3% 0.68 / 0.70 / -2.4%
tpch_q09/datafusion:vortex-file-compressed 183472168 / 190875316 / -3.9% 271016070 / 263505741 / +2.9% 0.68 / 0.72 / -6.5%
tpch_q10/datafusion:vortex-file-compressed 73841708 / 74236083 / -0.5% 140647258 / 137496474 / +2.3% 0.53 / 0.54 / -2.8%
tpch_q11/datafusion:vortex-file-compressed 43465396 / 43276214 / +0.4% 69558870 / 67129567 / +3.6% 0.62 / 0.64 / -3.1%
tpch_q12/datafusion:vortex-file-compressed 45019618 / 43428903 / +3.7% 96919063 / 98999395 / -2.1% 0.46 / 0.44 / +5.9%
tpch_q13/datafusion:vortex-file-compressed 46693534 / 46959961 / -0.6% 77060614 / 80001769 / -3.7% 0.61 / 0.59 / +3.2%
tpch_q14/datafusion:vortex-file-compressed 24366871 / 25972460 / -6.2% 92836693 / 97595825 / -4.9% 0.26 / 0.27 / -1.4%
tpch_q15/datafusion:vortex-file-compressed 37970774 / 37241288 / +2.0% 101019549 / 101658759 / -0.6% 0.38 / 0.37 / +2.6%
tpch_q16/datafusion:vortex-file-compressed 37592112 / 37262096 / +0.9% 66046262 / 65082240 / +1.5% 0.57 / 0.57 / -0.6%
tpch_q17/datafusion:vortex-file-compressed 175002438 / 178369927 / -1.9% 233135311 / 231964611 / +0.5% 0.75 / 0.77 / -2.4%
tpch_q18/datafusion:vortex-file-compressed 201468348 / 205858784 / -2.1% 263338128 / 259896298 / +1.3% 0.77 / 0.79 / -3.4%
tpch_q19/datafusion:vortex-file-compressed 39260524 / 38939016 / +0.8% 92409220 / 92521024 / -0.1% 0.42 / 0.42 / +0.9%
tpch_q20/datafusion:vortex-file-compressed 63258987 / 63132078 / +0.2% 127910011 / 123321682 / +3.7% 0.49 / 0.51 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 180358054 / 182309751 / -1.1% 238502440 / 232119520 / +2.7% 0.76 / 0.79 / -3.7%
tpch_q22/datafusion:vortex-file-compressed 25870422 / 25899078 / -0.1% 59160268 / 54581185 / +8.4% 0.44 / 0.47 / -7.8%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 96514923 / 97060611 / -0.6% 162544652 / 154909681 / +4.9% 0.59 / 0.63 / -5.2%
tpch_q02/datafusion:vortex-compact 65252744 / 65405144 / -0.2% 96257529 / 93396582 / +3.1% 0.68 / 0.70 / -3.2%
tpch_q03/datafusion:vortex-compact 67248921 / 67066223 / +0.3% 113038424 / 109735955 / +3.0% 0.59 / 0.61 / -2.7%
tpch_q04/datafusion:vortex-compact 42330702 / 41789575 / +1.3% 83889281 / 82522632 / +1.7% 0.50 / 0.51 / -0.4%
tpch_q05/datafusion:vortex-compact 121370447 / 118762005 / +2.2% 167858341 / 181374305 / -7.5% 0.72 / 0.65 / +10.4%
tpch_q06/datafusion:vortex-compact 18252421 / 18378566 / -0.7% 70857508 / 65298690 / +8.5% 0.26 / 0.28 / -8.5%
tpch_q07/datafusion:vortex-compact 143457689 / 142891448 / +0.4% 186959357 / 184683668 / +1.2% 0.77 / 0.77 / -0.8%
tpch_q08/datafusion:vortex-compact 148470484 / 146672213 / +1.2% 205563064 / 202261098 / +1.6% 0.72 / 0.73 / -0.4%
tpch_q09/datafusion:vortex-compact 191898906 / 193389534 / -0.8% 259064326 / 247034529 / +4.9% 0.74 / 0.78 / -5.4%
tpch_q10/datafusion:vortex-compact 79331026 / 78750615 / +0.7% 128990487 / 124545156 / +3.6% 0.62 / 0.63 / -2.7%
tpch_q11/datafusion:vortex-compact 43771502 / 43826937 / -0.1% 66232212 / 64470941 / +2.7% 0.66 / 0.68 / -2.8%
tpch_q12/datafusion:vortex-compact 57754124 / 57993415 / -0.4% 99274049 / 95909282 / +3.5% 0.58 / 0.60 / -3.8%
tpch_q13/datafusion:vortex-compact 54757416 / 55065646 / -0.6% 85844446 / 78648239 / +9.1% 0.64 / 0.70 / -8.9%
tpch_q14/datafusion:vortex-compact 27996324 / 27745169 / +0.9% 97071987 / 99776492 / -2.7% 0.29 / 0.28 / +3.7%
tpch_q15/datafusion:vortex-compact 45345960 / 45456025 / -0.2% 103965885 / 103092070 / +0.8% 0.44 / 0.44 / -1.1%
tpch_q16/datafusion:vortex-compact 40408686 / 40384702 / +0.1% 72816921 / 68466681 / +6.4% 0.55 / 0.59 / -5.9%
tpch_q17/datafusion:vortex-compact 174294296 / 174149976 / +0.1% 218416285 / 214997469 / +1.6% 0.80 / 0.81 / -1.5%
tpch_q18/datafusion:vortex-compact 199192371 / 205743264 / -3.2% 252959976 / 258593281 / -2.2% 0.79 / 0.80 / -1.0%
tpch_q19/datafusion:vortex-compact 62581476 / 62715924 / -0.2% 100899844 / 114848020 / -12.1% 🟢 0.62 / 0.55 / +13.6%
tpch_q20/datafusion:vortex-compact 65629612 / 66101860 / -0.7% 120076446 / 119448629 / +0.5% 0.55 / 0.55 / -1.2%
tpch_q21/datafusion:vortex-compact 191420660 / 189686137 / +0.9% 234756529 / 244988028 / -4.2% 0.82 / 0.77 / +5.3%
tpch_q22/datafusion:vortex-compact 27282801 / 26958000 / +1.2% 56573089 / 54751199 / +3.3% 0.48 / 0.49 / -2.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83338014 / 82985004 / +0.4% 130299151 / 135056995 / -3.5% 0.64 / 0.61 / +4.1%
tpch_q02/datafusion:parquet 136527836 / 134226775 / +1.7% 166035391 / 165287949 / +0.5% 0.82 / 0.81 / +1.3%
tpch_q03/datafusion:parquet 123848966 / 124672909 / -0.7% 190701467 / 199745541 / -4.5% 0.65 / 0.62 / +4.1%
tpch_q04/datafusion:parquet 53749736 / 53154295 / +1.1% 103270152 / 108607013 / -4.9% 0.52 / 0.49 / +6.3%
tpch_q05/datafusion:parquet 163354257 / 164101362 / -0.5% 238816352 / 242393288 / -1.5% 0.68 / 0.68 / +1.0%
tpch_q06/datafusion:parquet 31967719 / 32031872 / -0.2% 76777127 / 87089467 / -11.8% 🟢 0.42 / 0.37 / +13.2%
tpch_q07/datafusion:parquet 213323240 / 216098084 / -1.3% 286850429 / 299942092 / -4.4% 0.74 / 0.72 / +3.2%
tpch_q08/datafusion:parquet 209790510 / 209680280 / +0.1% 290697765 / 298917893 / -2.7% 0.72 / 0.70 / +2.9%
tpch_q09/datafusion:parquet 286633779 / 284343266 / +0.8% 373723822 / 370705911 / +0.8% 0.77 / 0.77 / -0.0%
tpch_q10/datafusion:parquet 300946242 / 306143316 / -1.7% 378831979 / 367040139 / +3.2% 0.79 / 0.83 / -4.8%
tpch_q11/datafusion:parquet 95559653 / 96301472 / -0.8% 121594308 / 121896745 / -0.2% 0.79 / 0.79 / -0.5%
tpch_q12/datafusion:parquet 78855705 / 78260334 / +0.8% 130421689 / 129915649 / +0.4% 0.60 / 0.60 / +0.4%
tpch_q13/datafusion:parquet 194232883 / 194122123 / +0.1% 228606439 / 228269594 / +0.1% 0.85 / 0.85 / -0.1%
tpch_q14/datafusion:parquet 74948576 / 73826800 / +1.5% 172319869 / 177775534 / -3.1% 0.43 / 0.42 / +4.7%
tpch_q15/datafusion:parquet 78420179 / 76428249 / +2.6% 140996217 / 137900768 / +2.2% 0.56 / 0.55 / +0.4%
tpch_q16/datafusion:parquet 84870598 / 83914067 / +1.1% 112355585 / 108592822 / +3.5% 0.76 / 0.77 / -2.2%
tpch_q17/datafusion:parquet 203790308 / 203042405 / +0.4% 262138511 / 265689386 / -1.3% 0.78 / 0.76 / +1.7%
tpch_q18/datafusion:parquet 263170462 / 263878401 / -0.3% 323471719 / 317435077 / +1.9% 0.81 / 0.83 / -2.1%
tpch_q19/datafusion:parquet 97621492 / 97761598 / -0.1% 171410471 / 175242736 / -2.2% 0.57 / 0.56 / +2.1%
tpch_q20/datafusion:parquet 152365849 / 152990226 / -0.4% 220090049 / 216879922 / +1.5% 0.69 / 0.71 / -1.9%
tpch_q21/datafusion:parquet 226635305 / 226277529 / +0.2% 310432622 / 312189724 / -0.6% 0.73 / 0.72 / +0.7%
tpch_q22/datafusion:parquet 160615438 / 161622830 / -0.6% 188632730 / 185133592 / +1.9% 0.85 / 0.87 / -2.5%
duckdb / vortex-file-compressed / ns (1.202x ❌, 0↑ 18↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 67583470 / 55555531 / +21.7% 🔴 77898053 / 110216789 / -29.3% 🟢 0.87 / 0.50 / +72.1%
tpch_q02/duckdb:vortex-file-compressed 35674720 / 32541791 / +9.6% 43434875 / 46441633 / -6.5% 0.82 / 0.70 / +17.2%
tpch_q03/duckdb:vortex-file-compressed 71254041 / 57300905 / +24.4% 🔴 79923105 / 103922372 / -23.1% 🟢 0.89 / 0.55 / +61.7%
tpch_q04/duckdb:vortex-file-compressed 90759622 / 80706043 / +12.5% 🔴 97720808 / 116271519 / -16.0% 🟢 0.93 / 0.69 / +33.8%
tpch_q05/duckdb:vortex-file-compressed 77031964 / 66426992 / +16.0% 🔴 82607821 / 124059387 / -33.4% 🟢 0.93 / 0.54 / +74.2%
tpch_q06/duckdb:vortex-file-compressed 37069714 / 21795436 / +70.1% 🔴 41949192 / 61665915 / -32.0% 🟢 0.88 / 0.35 / +150.0%
tpch_q07/duckdb:vortex-file-compressed 76912352 / 59799599 / +28.6% 🔴 84875302 / 128109764 / -33.7% 🟢 0.91 / 0.47 / +94.1%
tpch_q08/duckdb:vortex-file-compressed 100009716 / 88621589 / +12.9% 🔴 105176772 / 149114244 / -29.5% 🟢 0.95 / 0.59 / +60.0%
tpch_q09/duckdb:vortex-file-compressed 192603958 / 172707325 / +11.5% 🔴 201081992 / 230597946 / -12.8% 🟢 0.96 / 0.75 / +27.9%
tpch_q10/duckdb:vortex-file-compressed 129624506 / 111454986 / +16.3% 🔴 139752783 / 188228145 / -25.8% 🟢 0.93 / 0.59 / +56.6%
tpch_q11/duckdb:vortex-file-compressed 20319315 / 16543436 / +22.8% 🔴 31031586 / 31429871 / -1.3% 0.65 / 0.53 / +24.4%
tpch_q12/duckdb:vortex-file-compressed 83556875 / 58914507 / +41.8% 🔴 87519300 / 109356280 / -20.0% 🟢 0.95 / 0.54 / +77.2%
tpch_q13/duckdb:vortex-file-compressed 103407373 / 89883101 / +15.0% 🔴 120876461 / 142695989 / -15.3% 🟢 0.86 / 0.63 / +35.8%
tpch_q14/duckdb:vortex-file-compressed 44883527 / 31098922 / +44.3% 🔴 54697143 / 78400101 / -30.2% 🟢 0.82 / 0.40 / +106.9%
tpch_q15/duckdb:vortex-file-compressed 49499753 / 38112225 / +29.9% 🔴 56366340 / 82844673 / -32.0% 🟢 0.88 / 0.46 / +90.9%
tpch_q16/duckdb:vortex-file-compressed 43939247 / 41864444 / +5.0% 52668279 / 54253314 / -2.9% 0.83 / 0.77 / +8.1%
tpch_q17/duckdb:vortex-file-compressed 71308954 / 77493508 / -8.0% 81984548 / 157552557 / -48.0% 🟢 0.87 / 0.49 / +76.8%
tpch_q18/duckdb:vortex-file-compressed 150925592 / 127192319 / +18.7% 🔴 137990544 / 153154817 / -9.9% 1.09 / 0.83 / +31.7%
tpch_q19/duckdb:vortex-file-compressed 60916046 / 46838937 / +30.1% 🔴 68419644 / 103959645 / -34.2% 🟢 0.89 / 0.45 / +97.6%
tpch_q20/duckdb:vortex-file-compressed 74278311 / 60650184 / +22.5% 🔴 82526943 / 111249578 / -25.8% 🟢 0.90 / 0.55 / +65.1%
tpch_q21/duckdb:vortex-file-compressed 276300529 / 239591296 / +15.3% 🔴 276408934 / 280748163 / -1.5% 1.00 / 0.85 / +17.1%
tpch_q22/duckdb:vortex-file-compressed 41426391 / 39651137 / +4.5% 51683859 / 58488190 / -11.6% 🟢 0.80 / 0.68 / +18.2%
duckdb / vortex-compact / ns (1.163x ❌, 0↑ 16↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 79450820 / 69763407 / +13.9% 🔴 87833977 / 102078555 / -14.0% 🟢 0.90 / 0.68 / +32.4%
tpch_q02/duckdb:vortex-compact 37053783 / 35467591 / +4.5% 52991855 / 51544532 / +2.8% 0.70 / 0.69 / +1.6%
tpch_q03/duckdb:vortex-compact 74051091 / 62797964 / +17.9% 🔴 83279805 / 101122412 / -17.6% 🟢 0.89 / 0.62 / +43.2%
tpch_q04/duckdb:vortex-compact 100733800 / 88498922 / +13.8% 🔴 110453623 / 116507376 / -5.2% 0.91 / 0.76 / +20.1%
tpch_q05/duckdb:vortex-compact 81429547 / 71039489 / +14.6% 🔴 86561976 / 118753685 / -27.1% 🟢 0.94 / 0.60 / +57.3%
tpch_q06/duckdb:vortex-compact 37269841 / 24889827 / +49.7% 🔴 45621936 / 58210433 / -21.6% 🟢 0.82 / 0.43 / +91.1%
tpch_q07/duckdb:vortex-compact 85975799 / 71600075 / +20.1% 🔴 93531798 / 129062907 / -27.5% 🟢 0.92 / 0.55 / +65.7%
tpch_q08/duckdb:vortex-compact 105909679 / 89663182 / +18.1% 🔴 110526528 / 144157371 / -23.3% 🟢 0.96 / 0.62 / +54.1%
tpch_q09/duckdb:vortex-compact 191152987 / 173205477 / +10.4% 🔴 203814252 / 238226043 / -14.4% 🟢 0.94 / 0.73 / +29.0%
tpch_q10/duckdb:vortex-compact 135752974 / 126411615 / +7.4% 143885724 / 182577166 / -21.2% 🟢 0.94 / 0.69 / +36.3%
tpch_q11/duckdb:vortex-compact 21743543 / 19090258 / +13.9% 🔴 34726911 / 36345490 / -4.5% 0.63 / 0.53 / +19.2%
tpch_q12/duckdb:vortex-compact 96903848 / 70649690 / +37.2% 🔴 103122483 / 104119215 / -1.0% 0.94 / 0.68 / +38.5%
tpch_q13/duckdb:vortex-compact 110757375 / 100597399 / +10.1% 🔴 119345272 / 140218777 / -14.9% 🟢 0.93 / 0.72 / +29.4%
tpch_q14/duckdb:vortex-compact 46047419 / 34283535 / +34.3% 🔴 54561002 / 70368970 / -22.5% 🟢 0.84 / 0.49 / +73.2%
tpch_q15/duckdb:vortex-compact 52790650 / 44990280 / +17.3% 🔴 59567490 / 93558853 / -36.3% 🟢 0.89 / 0.48 / +84.3%
tpch_q16/duckdb:vortex-compact 45599434 / 44150952 / +3.3% 52769611 / 59347307 / -11.1% 🟢 0.86 / 0.74 / +16.2%
tpch_q17/duckdb:vortex-compact 72898062 / 59976812 / +21.5% 🔴 83119917 / 115300443 / -27.9% 🟢 0.88 / 0.52 / +68.6%
tpch_q18/duckdb:vortex-compact 150757757 / 144241447 / +4.5% 146654137 / 160371601 / -8.6% 1.03 / 0.90 / +14.3%
tpch_q19/duckdb:vortex-compact 61486428 / 48908239 / +25.7% 🔴 69102775 / 91444496 / -24.4% 🟢 0.89 / 0.53 / +66.4%
tpch_q20/duckdb:vortex-compact 81841703 / 69234969 / +18.2% 🔴 88244101 / 119750548 / -26.3% 🟢 0.93 / 0.58 / +60.4%
tpch_q21/duckdb:vortex-compact 287935526 / 262933198 / +9.5% 283717040 / 293311934 / -3.3% 1.01 / 0.90 / +13.2%
tpch_q22/duckdb:vortex-compact 43958352 / 42147182 / +4.3% 51714032 / 57055182 / -9.4% 0.85 / 0.74 / +15.1%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70672667 / 70842519 / -0.2% 116437411 / 90442707 / +28.7% 🔴 0.61 / 0.78 / -22.5%
tpch_q02/duckdb:parquet 71085533 / 71805208 / -1.0% 83522674 / 82425569 / +1.3% 0.85 / 0.87 / -2.3%
tpch_q03/duckdb:parquet 114032315 / 117211364 / -2.7% 153058843 / 151144056 / +1.3% 0.75 / 0.78 / -3.9%
tpch_q04/duckdb:parquet 74893429 / 75583302 / -0.9% 105815194 / 98854880 / +7.0% 0.71 / 0.76 / -7.4%
tpch_q05/duckdb:parquet 125466903 / 131258202 / -4.4% 165286192 / 174179281 / -5.1% 0.76 / 0.75 / +0.7%
tpch_q06/duckdb:parquet 34411977 / 34993895 / -1.7% 60053150 / 49773568 / +20.7% 🔴 0.57 / 0.70 / -18.5%
tpch_q07/duckdb:parquet 90210952 / 90463516 / -0.3% 130660453 / 131778689 / -0.8% 0.69 / 0.69 / +0.6%
tpch_q08/duckdb:parquet 144825507 / 144548339 / +0.2% 186275994 / 191928354 / -2.9% 0.78 / 0.75 / +3.2%
tpch_q09/duckdb:parquet 224450845 / 223503870 / +0.4% 267886873 / 269442082 / -0.6% 0.84 / 0.83 / +1.0%
tpch_q10/duckdb:parquet 473798292 / 472703459 / +0.2% 533688936 / 509586595 / +4.7% 0.89 / 0.93 / -4.3%
tpch_q11/duckdb:parquet 30752662 / 30851557 / -0.3% 41590759 / 38068350 / +9.3% 0.74 / 0.81 / -8.8%
tpch_q12/duckdb:parquet 76350150 / 76544310 / -0.3% 93159976 / 92985642 / +0.2% 0.82 / 0.82 / -0.4%
tpch_q13/duckdb:parquet 317457377 / 316481914 / +0.3% 329447397 / 332974494 / -1.1% 0.96 / 0.95 / +1.4%
tpch_q14/duckdb:parquet 106044872 / 104990086 / +1.0% 134352580 / 134425576 / -0.1% 0.79 / 0.78 / +1.1%
tpch_q15/duckdb:parquet 43812049 / 44791188 / -2.2% 66963457 / 85275809 / -21.5% 🟢 0.65 / 0.53 / +24.6%
tpch_q16/duckdb:parquet 114795248 / 115629668 / -0.7% 127506793 / 124365082 / +2.5% 0.90 / 0.93 / -3.2%
tpch_q17/duckdb:parquet 73644102 / 73968208 / -0.4% 104500428 / 104627359 / -0.1% 0.70 / 0.71 / -0.3%
tpch_q18/duckdb:parquet 199105247 / 208416812 / -4.5% 169072077 / 175877923 / -3.9% 1.18 / 1.19 / -0.6%
tpch_q19/duckdb:parquet 162762432 / 163166706 / -0.2% 197113804 / 193530513 / +1.9% 0.83 / 0.84 / -2.1%
tpch_q20/duckdb:parquet 128261639 / 129447889 / -0.9% 163978205 / 173231992 / -5.3% 0.78 / 0.75 / +4.7%
tpch_q21/duckdb:parquet 274094939 / 271829325 / +0.8% 304561280 / 285154253 / +6.8% 0.90 / 0.95 / -5.6%
tpch_q22/duckdb:parquet 260946069 / 262805581 / -0.7% 275474875 / 275519672 / -0.0% 0.95 / 0.95 / -0.7%

File Size Changes (16 files changed, +1.8% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 10.0 vortex-compact 5.70 KB 28.42 KB +22.73 KB +399.0%
nation.vortex 10.0 vortex-compact 7.51 KB 37.17 KB +29.66 KB +394.8%
region.vortex 10.0 vortex-file-compressed 6.52 KB 28.72 KB +22.20 KB +340.8%
nation.vortex 10.0 vortex-file-compressed 10.54 KB 41.99 KB +31.45 KB +298.3%
supplier.vortex 10.0 vortex-compact 4.73 MB 4.88 MB +157.94 KB +3.3%
orders.vortex 10.0 vortex-compact 344.29 MB 354.68 MB +10.39 MB +3.0%
supplier.vortex 10.0 vortex-file-compressed 5.92 MB 6.07 MB +150.41 KB +2.5%
part.vortex 10.0 vortex-compact 35.90 MB 36.74 MB +861.20 KB +2.3%
customer.vortex 10.0 vortex-compact 74.00 MB 75.71 MB +1.71 MB +2.3%
part.vortex 10.0 vortex-file-compressed 53.83 MB 55.00 MB +1.17 MB +2.2%
lineitem.vortex 10.0 vortex-file-compressed 1.71 GB 1.74 GB +33.00 MB +1.9%
customer.vortex 10.0 vortex-file-compressed 91.33 MB 93.00 MB +1.67 MB +1.8%
orders.vortex 10.0 vortex-file-compressed 491.43 MB 500.31 MB +8.88 MB +1.8%
lineitem.vortex 10.0 vortex-compact 1.28 GB 1.30 GB +21.26 MB +1.6%
partsupp.vortex 10.0 vortex-compact 203.65 MB 206.13 MB +2.48 MB +1.2%
partsupp.vortex 10.0 vortex-file-compressed 251.87 MB 254.59 MB +2.72 MB +1.1%

Totals:

  • vortex-compact: 1.92 GB → 1.96 GB (+1.9%)
  • vortex-file-compressed: 2.59 GB → 2.63 GB (+1.8%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+9.0%, low confidence)
Vortex (geomean): hot 1.036x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24654082 / 24209545 / +1.8% 42376703 / 44493131 / -4.8% 0.58 / 0.54 / +6.9%
tpcds_q02/datafusion:vortex-file-compressed 46314702 / 45551338 / +1.7% 64228638 / 63567695 / +1.0% 0.72 / 0.72 / +0.6%
tpcds_q03/datafusion:vortex-file-compressed 11338396 / 11854732 / -4.4% 28334548 / 29298469 / -3.3% 0.40 / 0.40 / -1.1%
tpcds_q04/datafusion:vortex-file-compressed 115715360 / 114245680 / +1.3% 144246149 / 140890938 / +2.4% 0.80 / 0.81 / -1.1%
tpcds_q05/datafusion:vortex-file-compressed 60666406 / 60187488 / +0.8% 80746167 / 82383525 / -2.0% 0.75 / 0.73 / +2.8%
tpcds_q06/datafusion:vortex-file-compressed 24441958 / 23721332 / +3.0% 46520737 / 47656367 / -2.4% 0.53 / 0.50 / +5.6%
tpcds_q07/datafusion:vortex-file-compressed 32967760 / 32430537 / +1.7% 55083934 / 56373994 / -2.3% 0.60 / 0.58 / +4.0%
tpcds_q08/datafusion:vortex-file-compressed 25424328 / 25450420 / -0.1% 43885984 / 46814117 / -6.3% 0.58 / 0.54 / +6.6%
tpcds_q09/datafusion:vortex-file-compressed 16894375 / 19217823 / -12.1% 🟢 35553305 / 34826524 / +2.1% 0.48 / 0.55 / -13.9%
tpcds_q10/datafusion:vortex-file-compressed 27853042 / 29692906 / -6.2% 50360186 / 51723362 / -2.6% 0.55 / 0.57 / -3.7%
tpcds_q11/datafusion:vortex-file-compressed 63328033 / 63186827 / +0.2% 89365391 / 87943666 / +1.6% 0.71 / 0.72 / -1.4%
tpcds_q12/datafusion:vortex-file-compressed 16560708 / 16406628 / +0.9% 31332861 / 32625161 / -4.0% 0.53 / 0.50 / +5.1%
tpcds_q13/datafusion:vortex-file-compressed 36403874 / 35495760 / +2.6% 56982280 / 57011671 / -0.1% 0.64 / 0.62 / +2.6%
tpcds_q14/datafusion:vortex-file-compressed 93682806 / 91388534 / +2.5% 124613743 / 119650544 / +4.1% 0.75 / 0.76 / -1.6%
tpcds_q15/datafusion:vortex-file-compressed 23731320 / 23912982 / -0.8% 44000322 / 45317113 / -2.9% 0.54 / 0.53 / +2.2%
tpcds_q16/datafusion:vortex-file-compressed 20361309 / 20787212 / -2.0% 41399222 / 43498455 / -4.8% 0.49 / 0.48 / +2.9%
tpcds_q17/datafusion:vortex-file-compressed 60052548 / 61329098 / -2.1% 84352716 / 78699433 / +7.2% 0.71 / 0.78 / -8.6%
tpcds_q18/datafusion:vortex-file-compressed 68927153 / 68540143 / +0.6% 92464278 / 94401300 / -2.1% 0.75 / 0.73 / +2.7%
tpcds_q19/datafusion:vortex-file-compressed 18247344 / 18246804 / +0.0% 39530690 / 41306019 / -4.3% 0.46 / 0.44 / +4.5%
tpcds_q20/datafusion:vortex-file-compressed 17539989 / 17511053 / +0.2% 33194863 / 35435793 / -6.3% 0.53 / 0.49 / +6.9%
tpcds_q21/datafusion:vortex-file-compressed 17311554 / 17176112 / +0.8% 39014692 / 40849805 / -4.5% 0.44 / 0.42 / +5.5%
tpcds_q22/datafusion:vortex-file-compressed 49499661 / 49718227 / -0.4% 73099730 / 72443522 / +0.9% 0.68 / 0.69 / -1.3%
tpcds_q23/datafusion:vortex-file-compressed 74823643 / 73297570 / +2.1% 102166028 / 99365227 / +2.8% 0.73 / 0.74 / -0.7%
tpcds_q24/datafusion:vortex-file-compressed 71258360 / 70991760 / +0.4% 98081609 / 95356119 / +2.9% 0.73 / 0.74 / -2.4%
tpcds_q25/datafusion:vortex-file-compressed 49526586 / 52428004 / -5.5% 69433517 / 85672153 / -19.0% 🟢 0.71 / 0.61 / +16.6%
tpcds_q26/datafusion:vortex-file-compressed 29971156 / 30193362 / -0.7% 49418718 / 51478030 / -4.0% 0.61 / 0.59 / +3.4%
tpcds_q27/datafusion:vortex-file-compressed 62703331 / 66013373 / -5.0% 89586594 / 88686756 / +1.0% 0.70 / 0.74 / -6.0%
tpcds_q28/datafusion:vortex-file-compressed 18513782 / 18956134 / -2.3% 38485458 / 36939006 / +4.2% 0.48 / 0.51 / -6.3%
tpcds_q29/datafusion:vortex-file-compressed 51991694 / 53694536 / -3.2% 80940969 / 74675106 / +8.4% 0.64 / 0.72 / -10.7%
tpcds_q30/datafusion:vortex-file-compressed 27659156 / 27305402 / +1.3% 47490795 / 45179172 / +5.1% 0.58 / 0.60 / -3.6%
tpcds_q31/datafusion:vortex-file-compressed 62358320 / 65145012 / -4.3% 86167950 / 94955879 / -9.3% 0.72 / 0.69 / +5.5%
tpcds_q32/datafusion:vortex-file-compressed 14213053 / 13570556 / +4.7% 33261819 / 30433477 / +9.3% 0.43 / 0.45 / -4.2%
tpcds_q33/datafusion:vortex-file-compressed 26326149 / 26739354 / -1.5% 50249502 / 49963685 / +0.6% 0.52 / 0.54 / -2.1%
tpcds_q34/datafusion:vortex-file-compressed 17392288 / 18576946 / -6.4% 37488614 / 38995162 / -3.9% 0.46 / 0.48 / -2.6%
tpcds_q35/datafusion:vortex-file-compressed 34397270 / 35844588 / -4.0% 55286547 / 59565058 / -7.2% 0.62 / 0.60 / +3.4%
tpcds_q36/datafusion:vortex-file-compressed 48513579 / 48371832 / +0.3% 72658398 / 75743852 / -4.1% 0.67 / 0.64 / +4.6%
tpcds_q37/datafusion:vortex-file-compressed 13867252 / 13173512 / +5.3% 35982483 / 38281435 / -6.0% 0.39 / 0.34 / +12.0%
tpcds_q38/datafusion:vortex-file-compressed 28230152 / 30644097 / -7.9% 49114246 / 53748926 / -8.6% 0.57 / 0.57 / +0.8%
tpcds_q39/datafusion:vortex-file-compressed 65655235 / 64887354 / +1.2% 90334942 / 91586869 / -1.4% 0.73 / 0.71 / +2.6%
tpcds_q40/datafusion:vortex-file-compressed 24984688 / 25814617 / -3.2% 47057378 / 45950344 / +2.4% 0.53 / 0.56 / -5.5%
tpcds_q41/datafusion:vortex-file-compressed 16735208 / 16598124 / +0.8% 31185348 / 31129827 / +0.2% 0.54 / 0.53 / +0.6%
tpcds_q42/datafusion:vortex-file-compressed 10826114 / 11374309 / -4.8% 27298243 / 26926960 / +1.4% 0.40 / 0.42 / -6.1%
tpcds_q43/datafusion:vortex-file-compressed 13039830 / 13383700 / -2.6% 29127665 / 34403070 / -15.3% 🟢 0.45 / 0.39 / +15.1%
tpcds_q44/datafusion:vortex-file-compressed 26004040 / 26989066 / -3.6% 51104691 / 50725769 / +0.7% 0.51 / 0.53 / -4.4%
tpcds_q45/datafusion:vortex-file-compressed 27222282 / 27962898 / -2.6% 46326762 / 48784651 / -5.0% 0.59 / 0.57 / +2.5%
tpcds_q46/datafusion:vortex-file-compressed 24195580 / 24775440 / -2.3% 47271462 / 48277343 / -2.1% 0.51 / 0.51 / -0.3%
tpcds_q47/datafusion:vortex-file-compressed 76975198 / 78525543 / -2.0% 103046499 / 107199684 / -3.9% 0.75 / 0.73 / +2.0%
tpcds_q48/datafusion:vortex-file-compressed 31468361 / 31590750 / -0.4% 52729477 / 54264055 / -2.8% 0.60 / 0.58 / +2.5%
tpcds_q49/datafusion:vortex-file-compressed 59802732 / 59714518 / +0.1% 90477792 / 85744971 / +5.5% 0.66 / 0.70 / -5.1%
tpcds_q50/datafusion:vortex-file-compressed 34342194 / 34141712 / +0.6% 55838111 / 55681588 / +0.3% 0.62 / 0.61 / +0.3%
tpcds_q51/datafusion:vortex-file-compressed 60839462 / 60959043 / -0.2% 84130631 / 85430330 / -1.5% 0.72 / 0.71 / +1.3%
tpcds_q52/datafusion:vortex-file-compressed 11351012 / 11723278 / -3.2% 26865296 / 27973863 / -4.0% 0.42 / 0.42 / +0.8%
tpcds_q53/datafusion:vortex-file-compressed 17909414 / 18812716 / -4.8% 38413724 / 38972024 / -1.4% 0.47 / 0.48 / -3.4%
tpcds_q54/datafusion:vortex-file-compressed 33617583 / 34011909 / -1.2% 63460864 / 59861406 / +6.0% 0.53 / 0.57 / -6.8%
tpcds_q55/datafusion:vortex-file-compressed 10889770 / 11413189 / -4.6% 27470010 / 26945480 / +1.9% 0.40 / 0.42 / -6.4%
tpcds_q56/datafusion:vortex-file-compressed 26417436 / 26686058 / -1.0% 49590233 / 50026308 / -0.9% 0.53 / 0.53 / -0.1%
tpcds_q57/datafusion:vortex-file-compressed 72881020 / 73812887 / -1.3% 96383759 / 98848490 / -2.5% 0.76 / 0.75 / +1.3%
tpcds_q58/datafusion:vortex-file-compressed 40491648 / 40609592 / -0.3% 68041086 / 67175031 / +1.3% 0.60 / 0.60 / -1.6%
tpcds_q59/datafusion:vortex-file-compressed 33021062 / 32203426 / +2.5% 53416381 / 52800744 / +1.2% 0.62 / 0.61 / +1.4%
tpcds_q60/datafusion:vortex-file-compressed 26869657 / 26507256 / +1.4% 48164939 / 49928489 / -3.5% 0.56 / 0.53 / +5.1%
tpcds_q61/datafusion:vortex-file-compressed 25013859 / 24195840 / +3.4% 49687773 / 50119451 / -0.9% 0.50 / 0.48 / +4.3%
tpcds_q62/datafusion:vortex-file-compressed 17652906 / 17229598 / +2.5% 34932523 / 36716501 / -4.9% 0.51 / 0.47 / +7.7%
tpcds_q63/datafusion:vortex-file-compressed 18120006 / 18534167 / -2.2% 37374283 / 38245302 / -2.3% 0.48 / 0.48 / +0.0%
tpcds_q64/datafusion:vortex-file-compressed 338937349 / 329339718 / +2.9% 374213612 / 356767521 / +4.9% 0.91 / 0.92 / -1.9%
tpcds_q65/datafusion:vortex-file-compressed 76201724 / 75783855 / +0.6% 96499548 / 97247728 / -0.8% 0.79 / 0.78 / +1.3%
tpcds_q66/datafusion:vortex-file-compressed 52706490 / 52776656 / -0.1% 74582674 / 76379668 / -2.4% 0.71 / 0.69 / +2.3%
tpcds_q67/datafusion:vortex-file-compressed 54978169 / 56506143 / -2.7% 84308332 / 84887185 / -0.7% 0.65 / 0.67 / -2.0%
tpcds_q68/datafusion:vortex-file-compressed 23776298 / 24321702 / -2.2% 47754892 / 48195692 / -0.9% 0.50 / 0.50 / -1.3%
tpcds_q69/datafusion:vortex-file-compressed 27808262 / 28307381 / -1.8% 46856059 / 50842483 / -7.8% 0.59 / 0.56 / +6.6%
tpcds_q70/datafusion:vortex-file-compressed 71945622 / 71914044 / +0.0% 91792113 / 96193633 / -4.6% 0.78 / 0.75 / +4.8%
tpcds_q71/datafusion:vortex-file-compressed 18772897 / 18853803 / -0.4% 40581187 / 41037157 / -1.1% 0.46 / 0.46 / +0.7%
tpcds_q72/datafusion:vortex-file-compressed 465202819 / 463929504 / +0.3% 498627121 / 507997879 / -1.8% 0.93 / 0.91 / +2.2%
tpcds_q73/datafusion:vortex-file-compressed 17164000 / 17497196 / -1.9% 37305157 / 38393239 / -2.8% 0.46 / 0.46 / +1.0%
tpcds_q74/datafusion:vortex-file-compressed 47146448 / 45741640 / +3.1% 70630666 / 70925213 / -0.4% 0.67 / 0.64 / +3.5%
tpcds_q75/datafusion:vortex-file-compressed 130342410 / 131527228 / -0.9% 157314494 / 163844236 / -4.0% 0.83 / 0.80 / +3.2%
tpcds_q76/datafusion:vortex-file-compressed 49508796 / 43257954 / +14.5% 🔴 68915129 / 66453008 / +3.7% 0.72 / 0.65 / +10.4%
tpcds_q77/datafusion:vortex-file-compressed 36918618 / 34360453 / +7.4% 58684232 / 59787018 / -1.8% 0.63 / 0.57 / +9.5%
tpcds_q78/datafusion:vortex-file-compressed 79416392 / 79618750 / -0.3% 108677375 / 110640920 / -1.8% 0.73 / 0.72 / +1.5%
tpcds_q79/datafusion:vortex-file-compressed 20778831 / 22162926 / -6.2% 42436225 / 42678830 / -0.6% 0.49 / 0.52 / -5.7%
tpcds_q80/datafusion:vortex-file-compressed 77301780 / 77767990 / -0.6% 107806515 / 112302035 / -4.0% 0.72 / 0.69 / +3.5%
tpcds_q81/datafusion:vortex-file-compressed 28506912 / 28133097 / +1.3% 45455295 / 45945146 / -1.1% 0.63 / 0.61 / +2.4%
tpcds_q82/datafusion:vortex-file-compressed 14271732 / 13209876 / +8.0% 35451329 / 36385630 / -2.6% 0.40 / 0.36 / +10.9%
tpcds_q83/datafusion:vortex-file-compressed 37581540 / 36369596 / +3.3% 59196394 / 57787929 / +2.4% 0.63 / 0.63 / +0.9%
tpcds_q84/datafusion:vortex-file-compressed 12130181 / 12030092 / +0.8% 28623499 / 29508149 / -3.0% 0.42 / 0.41 / +3.9%
tpcds_q85/datafusion:vortex-file-compressed 59782733 / 60371630 / -1.0% 84782196 / 84495024 / +0.3% 0.71 / 0.71 / -1.3%
tpcds_q86/datafusion:vortex-file-compressed 15927920 / 16422308 / -3.0% 31744782 / 33121460 / -4.2% 0.50 / 0.50 / +1.2%
tpcds_q87/datafusion:vortex-file-compressed 28011721 / 30095466 / -6.9% 48946692 / 53002818 / -7.7% 0.57 / 0.57 / +0.8%
tpcds_q88/datafusion:vortex-file-compressed 34338915 / 34474280 / -0.4% 66418000 / 60817379 / +9.2% 0.52 / 0.57 / -8.8%
tpcds_q89/datafusion:vortex-file-compressed 21164418 / 20846144 / +1.5% 41750378 / 42042067 / -0.7% 0.51 / 0.50 / +2.2%
tpcds_q90/datafusion:vortex-file-compressed 10430140 / 10579896 / -1.4% 26863591 / 27009219 / -0.5% 0.39 / 0.39 / -0.9%
tpcds_q91/datafusion:vortex-file-compressed 17782703 / 16615224 / +7.0% 39812166 / 38358818 / +3.8% 0.45 / 0.43 / +3.1%
tpcds_q92/datafusion:vortex-file-compressed 13819744 / 13948810 / -0.9% 33589884 / 31855868 / +5.4% 0.41 / 0.44 / -6.0%
tpcds_q93/datafusion:vortex-file-compressed 24086272 / 23838968 / +1.0% 45747629 / 46049852 / -0.7% 0.53 / 0.52 / +1.7%
tpcds_q94/datafusion:vortex-file-compressed 19301266 / 20316402 / -5.0% 38509295 / 40550707 / -5.0% 0.50 / 0.50 / +0.0%
tpcds_q95/datafusion:vortex-file-compressed 45983286 / 46654052 / -1.4% 67344271 / 69093550 / -2.5% 0.68 / 0.68 / +1.1%
tpcds_q96/datafusion:vortex-file-compressed 9749143 / 9663888 / +0.9% 26452186 / 25818562 / +2.5% 0.37 / 0.37 / -1.5%
tpcds_q97/datafusion:vortex-file-compressed 21324795 / 21306582 / +0.1% 44436045 / 43759469 / +1.5% 0.48 / 0.49 / -1.4%
tpcds_q98/datafusion:vortex-file-compressed 16779113 / 17106440 / -1.9% 35702346 / 37287051 / -4.3% 0.47 / 0.46 / +2.4%
tpcds_q99/datafusion:vortex-file-compressed 19736032 / 19698649 / +0.2% 36588466 / 38072133 / -3.9% 0.54 / 0.52 / +4.3%
datafusion / vortex-compact / ns (0.998x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 26365224 / 25847061 / +2.0% 44819582 / 45951592 / -2.5% 0.59 / 0.56 / +4.6%
tpcds_q02/datafusion:vortex-compact 48303916 / 48421820 / -0.2% 66117940 / 68168703 / -3.0% 0.73 / 0.71 / +2.9%
tpcds_q03/datafusion:vortex-compact 13357564 / 12806770 / +4.3% 30165244 / 32635054 / -7.6% 0.44 / 0.39 / +12.8%
tpcds_q04/datafusion:vortex-compact 122831029 / 121451010 / +1.1% 149180538 / 158523435 / -5.9% 0.82 / 0.77 / +7.5%
tpcds_q05/datafusion:vortex-compact 62093841 / 62462968 / -0.6% 86715356 / 83574189 / +3.8% 0.72 / 0.75 / -4.2%
tpcds_q06/datafusion:vortex-compact 24945577 / 25739960 / -3.1% 46790338 / 47893348 / -2.3% 0.53 / 0.54 / -0.8%
tpcds_q07/datafusion:vortex-compact 36605920 / 34260386 / +6.8% 63514472 / 58743985 / +8.1% 0.58 / 0.58 / -1.2%
tpcds_q08/datafusion:vortex-compact 30618032 / 29919128 / +2.3% 49499240 / 49328743 / +0.3% 0.62 / 0.61 / +2.0%
tpcds_q09/datafusion:vortex-compact 22694696 / 21957310 / +3.4% 40390372 / 40180516 / +0.5% 0.56 / 0.55 / +2.8%
tpcds_q10/datafusion:vortex-compact 38643377 / 37610208 / +2.7% 60159964 / 60153007 / +0.0% 0.64 / 0.63 / +2.7%
tpcds_q11/datafusion:vortex-compact 69395830 / 68607668 / +1.1% 93053932 / 95659428 / -2.7% 0.75 / 0.72 / +4.0%
tpcds_q12/datafusion:vortex-compact 16910397 / 20864904 / -19.0% 🟢 33541874 / 39704966 / -15.5% 🟢 0.50 / 0.53 / -4.1%
tpcds_q13/datafusion:vortex-compact 60702114 / 60717974 / -0.0% 80533588 / 90912276 / -11.4% 🟢 0.75 / 0.67 / +12.9%
tpcds_q14/datafusion:vortex-compact 97434380 / 95387368 / +2.1% 123288443 / 123315557 / -0.0% 0.79 / 0.77 / +2.2%
tpcds_q15/datafusion:vortex-compact 27390086 / 28136835 / -2.7% 48669775 / 47356163 / +2.8% 0.56 / 0.59 / -5.3%
tpcds_q16/datafusion:vortex-compact 24544267 / 23885446 / +2.8% 45291669 / 45048605 / +0.5% 0.54 / 0.53 / +2.2%
tpcds_q17/datafusion:vortex-compact 66564603 / 60915038 / +9.3% 84390189 / 82370648 / +2.5% 0.79 / 0.74 / +6.7%
tpcds_q18/datafusion:vortex-compact 69956896 / 68886582 / +1.6% 90912180 / 96042052 / -5.3% 0.77 / 0.72 / +7.3%
tpcds_q19/datafusion:vortex-compact 23510760 / 22631540 / +3.9% 42018201 / 41672400 / +0.8% 0.56 / 0.54 / +3.0%
tpcds_q20/datafusion:vortex-compact 18616948 / 22061768 / -15.6% 🟢 35894368 / 41495654 / -13.5% 🟢 0.52 / 0.53 / -2.4%
tpcds_q21/datafusion:vortex-compact 16973933 / 18113812 / -6.3% 39504586 / 43138800 / -8.4% 0.43 / 0.42 / +2.3%
tpcds_q22/datafusion:vortex-compact 49351370 / 49822808 / -0.9% 71151312 / 73790878 / -3.6% 0.69 / 0.68 / +2.7%
tpcds_q23/datafusion:vortex-compact 76770082 / 77601330 / -1.1% 104711804 / 102979822 / +1.7% 0.73 / 0.75 / -2.7%
tpcds_q24/datafusion:vortex-compact 76487492 / 77711650 / -1.6% 101837345 / 102370756 / -0.5% 0.75 / 0.76 / -1.1%
tpcds_q25/datafusion:vortex-compact 53955064 / 55804121 / -3.3% 87138034 / 81635113 / +6.7% 0.62 / 0.68 / -9.4%
tpcds_q26/datafusion:vortex-compact 32331244 / 33394533 / -3.2% 53637754 / 51443620 / +4.3% 0.60 / 0.65 / -7.1%
tpcds_q27/datafusion:vortex-compact 64926892 / 63979262 / +1.5% 97965788 / 93149357 / +5.2% 0.66 / 0.69 / -3.5%
tpcds_q28/datafusion:vortex-compact 27847946 / 27687149 / +0.6% 49124624 / 50221109 / -2.2% 0.57 / 0.55 / +2.8%
tpcds_q29/datafusion:vortex-compact 61774991 / 62926912 / -1.8% 91949520 / 86104283 / +6.8% 0.67 / 0.73 / -8.1%
tpcds_q30/datafusion:vortex-compact 30663534 / 30224040 / +1.5% 50486963 / 49644050 / +1.7% 0.61 / 0.61 / -0.2%
tpcds_q31/datafusion:vortex-compact 76478361 / 79249961 / -3.5% 103645483 / 104171198 / -0.5% 0.74 / 0.76 / -3.0%
tpcds_q32/datafusion:vortex-compact 15970582 / 16204287 / -1.4% 34091956 / 34719519 / -1.8% 0.47 / 0.47 / +0.4%
tpcds_q33/datafusion:vortex-compact 29353842 / 29168044 / +0.6% 51857487 / 49327104 / +5.1% 0.57 / 0.59 / -4.3%
tpcds_q34/datafusion:vortex-compact 22196896 / 23084256 / -3.8% 45502815 / 44410192 / +2.5% 0.49 / 0.52 / -6.2%
tpcds_q35/datafusion:vortex-compact 42830354 / 42277139 / +1.3% 66947611 / 67001072 / -0.1% 0.64 / 0.63 / +1.4%
tpcds_q36/datafusion:vortex-compact 51444088 / 51554938 / -0.2% 74403317 / 77482113 / -4.0% 0.69 / 0.67 / +3.9%
tpcds_q37/datafusion:vortex-compact 15518517 / 16002820 / -3.0% 39210276 / 39192532 / +0.0% 0.40 / 0.41 / -3.1%
tpcds_q38/datafusion:vortex-compact 33998090 / 34071045 / -0.2% 54740683 / 58758240 / -6.8% 0.62 / 0.58 / +7.1%
tpcds_q39/datafusion:vortex-compact 66139773 / 65477464 / +1.0% 92456850 / 88368383 / +4.6% 0.72 / 0.74 / -3.5%
tpcds_q40/datafusion:vortex-compact 26907788 / 27988866 / -3.9% 48631877 / 52180527 / -6.8% 0.55 / 0.54 / +3.2%
tpcds_q41/datafusion:vortex-compact 17540061 / 18914344 / -7.3% 32462483 / 33708858 / -3.7% 0.54 / 0.56 / -3.7%
tpcds_q42/datafusion:vortex-compact 13397388 / 13037724 / +2.8% 30927576 / 32506748 / -4.9% 0.43 / 0.40 / +8.0%
tpcds_q43/datafusion:vortex-compact 15819166 / 16211266 / -2.4% 35981666 / 34729553 / +3.6% 0.44 / 0.47 / -5.8%
tpcds_q44/datafusion:vortex-compact 31693615 / 31102529 / +1.9% 56309494 / 54345355 / +3.6% 0.56 / 0.57 / -1.7%
tpcds_q45/datafusion:vortex-compact 30635864 / 31141502 / -1.6% 50623498 / 50852863 / -0.5% 0.61 / 0.61 / -1.2%
tpcds_q46/datafusion:vortex-compact 28303514 / 27940356 / +1.3% 55649789 / 50644634 / +9.9% 0.51 / 0.55 / -7.8%
tpcds_q47/datafusion:vortex-compact 85862624 / 87527522 / -1.9% 114892364 / 117130924 / -1.9% 0.75 / 0.75 / +0.0%
tpcds_q48/datafusion:vortex-compact 51468042 / 51484601 / -0.0% 70302319 / 69676038 / +0.9% 0.73 / 0.74 / -0.9%
tpcds_q49/datafusion:vortex-compact 69187050 / 67748596 / +2.1% 89644188 / 90226182 / -0.6% 0.77 / 0.75 / +2.8%
tpcds_q50/datafusion:vortex-compact 38612472 / 37062606 / +4.2% 59757514 / 57858592 / +3.3% 0.65 / 0.64 / +0.9%
tpcds_q51/datafusion:vortex-compact 62782106 / 62470158 / +0.5% 85343063 / 84867660 / +0.6% 0.74 / 0.74 / -0.1%
tpcds_q52/datafusion:vortex-compact 13476956 / 12875685 / +4.7% 32020973 / 32163376 / -0.4% 0.42 / 0.40 / +5.1%
tpcds_q53/datafusion:vortex-compact 21781002 / 21809695 / -0.1% 43322515 / 43087061 / +0.5% 0.50 / 0.51 / -0.7%
tpcds_q54/datafusion:vortex-compact 37910204 / 39185623 / -3.3% 65113687 / 64775750 / +0.5% 0.58 / 0.60 / -3.8%
tpcds_q55/datafusion:vortex-compact 13306168 / 12766572 / +4.2% 29976257 / 31359850 / -4.4% 0.44 / 0.41 / +9.0%
tpcds_q56/datafusion:vortex-compact 30687733 / 29168234 / +5.2% 51220126 / 51981430 / -1.5% 0.60 / 0.56 / +6.8%
tpcds_q57/datafusion:vortex-compact 79493293 / 81188812 / -2.1% 106222306 / 106157370 / +0.1% 0.75 / 0.76 / -2.1%
tpcds_q58/datafusion:vortex-compact 43653252 / 47539902 / -8.2% 69212170 / 72339722 / -4.3% 0.63 / 0.66 / -4.0%
tpcds_q59/datafusion:vortex-compact 40219050 / 39191598 / +2.6% 59361162 / 59006718 / +0.6% 0.68 / 0.66 / +2.0%
tpcds_q60/datafusion:vortex-compact 29805719 / 28082206 / +6.1% 51212558 / 52203366 / -1.9% 0.58 / 0.54 / +8.2%
tpcds_q61/datafusion:vortex-compact 28963212 / 27235683 / +6.3% 50397604 / 48994220 / +2.9% 0.57 / 0.56 / +3.4%
tpcds_q62/datafusion:vortex-compact 17849038 / 18142532 / -1.6% 38176351 / 36388396 / +4.9% 0.47 / 0.50 / -6.2%
tpcds_q63/datafusion:vortex-compact 21720371 / 21590052 / +0.6% 41113665 / 42839430 / -4.0% 0.53 / 0.50 / +4.8%
tpcds_q64/datafusion:vortex-compact 446911861 / 451718034 / -1.1% 457000137 / 457109762 / -0.0% 0.98 / 0.99 / -1.0%
tpcds_q65/datafusion:vortex-compact 79554684 / 81278832 / -2.1% 99571069 / 101785805 / -2.2% 0.80 / 0.80 / +0.1%
tpcds_q66/datafusion:vortex-compact 54859134 / 55091460 / -0.4% 79431086 / 78774548 / +0.8% 0.69 / 0.70 / -1.2%
tpcds_q67/datafusion:vortex-compact 60880370 / 59584584 / +2.2% 88688108 / 90455780 / -2.0% 0.69 / 0.66 / +4.2%
tpcds_q68/datafusion:vortex-compact 30422786 / 28593706 / +6.4% 57429573 / 50415641 / +13.9% 🔴 0.53 / 0.57 / -6.6%
tpcds_q69/datafusion:vortex-compact 37974320 / 36735275 / +3.4% 59513817 / 59093815 / +0.7% 0.64 / 0.62 / +2.6%
tpcds_q70/datafusion:vortex-compact 77533207 / 75893215 / +2.2% 98136305 / 97157390 / +1.0% 0.79 / 0.78 / +1.1%
tpcds_q71/datafusion:vortex-compact 20589712 / 20365184 / +1.1% 43673018 / 43849042 / -0.4% 0.47 / 0.46 / +1.5%
tpcds_q72/datafusion:vortex-compact 470103586 / 454555715 / +3.4% 486944005 / 510426472 / -4.6% 0.97 / 0.89 / +8.4%
tpcds_q73/datafusion:vortex-compact 21977445 / 19731228 / +11.4% 🔴 42855349 / 40738140 / +5.2% 0.51 / 0.48 / +5.9%
tpcds_q74/datafusion:vortex-compact 51390418 / 51321584 / +0.1% 75680075 / 73366509 / +3.2% 0.68 / 0.70 / -2.9%
tpcds_q75/datafusion:vortex-compact 133672942 / 137379045 / -2.7% 169108692 / 171366292 / -1.3% 0.79 / 0.80 / -1.4%
tpcds_q76/datafusion:vortex-compact 44110262 / 42837152 / +3.0% 64686667 / 60981994 / +6.1% 0.68 / 0.70 / -2.9%
tpcds_q77/datafusion:vortex-compact 40728106 / 37619168 / +8.3% 62806668 / 64733096 / -3.0% 0.65 / 0.58 / +11.6%
tpcds_q78/datafusion:vortex-compact 86981988 / 86303460 / +0.8% 116354871 / 117020546 / -0.6% 0.75 / 0.74 / +1.4%
tpcds_q79/datafusion:vortex-compact 24827810 / 30013532 / -17.3% 🟢 50918483 / 44998728 / +13.2% 🔴 0.49 / 0.67 / -26.9%
tpcds_q80/datafusion:vortex-compact 80170268 / 79199438 / +1.2% 111723201 / 109584373 / +2.0% 0.72 / 0.72 / -0.7%
tpcds_q81/datafusion:vortex-compact 29604312 / 29885982 / -0.9% 47841319 / 48592274 / -1.5% 0.62 / 0.62 / +0.6%
tpcds_q82/datafusion:vortex-compact 15792136 / 16172809 / -2.4% 39574040 / 39391619 / +0.5% 0.40 / 0.41 / -2.8%
tpcds_q83/datafusion:vortex-compact 38121442 / 37181148 / +2.5% 60758680 / 59748235 / +1.7% 0.63 / 0.62 / +0.8%
tpcds_q84/datafusion:vortex-compact 13451247 / 13756324 / -2.2% 30220850 / 30097194 / +0.4% 0.45 / 0.46 / -2.6%
tpcds_q85/datafusion:vortex-compact 108641387 / 108574433 / +0.1% 132659439 / 134707421 / -1.5% 0.82 / 0.81 / +1.6%
tpcds_q86/datafusion:vortex-compact 16663264 / 17000860 / -2.0% 33984480 / 35659312 / -4.7% 0.49 / 0.48 / +2.8%
tpcds_q87/datafusion:vortex-compact 33142136 / 32307966 / +2.6% 56804670 / 57969364 / -2.0% 0.58 / 0.56 / +4.7%
tpcds_q88/datafusion:vortex-compact 42106441 / 41658815 / +1.1% 68461844 / 70474018 / -2.9% 0.62 / 0.59 / +4.0%
tpcds_q89/datafusion:vortex-compact 24227650 / 25374506 / -4.5% 46058426 / 46846550 / -1.7% 0.53 / 0.54 / -2.9%
tpcds_q90/datafusion:vortex-compact 11491744 / 11826490 / -2.8% 27728357 / 28119874 / -1.4% 0.41 / 0.42 / -1.5%
tpcds_q91/datafusion:vortex-compact 27259838 / 27511352 / -0.9% 48348683 / 47409440 / +2.0% 0.56 / 0.58 / -2.8%
tpcds_q92/datafusion:vortex-compact 15229208 / 15874000 / -4.1% 32117756 / 33948192 / -5.4% 0.47 / 0.47 / +1.4%
tpcds_q93/datafusion:vortex-compact 25248441 / 24753238 / +2.0% 46063001 / 47850496 / -3.7% 0.55 / 0.52 / +6.0%
tpcds_q94/datafusion:vortex-compact 22402950 / 22329019 / +0.3% 41478763 / 42782198 / -3.0% 0.54 / 0.52 / +3.5%
tpcds_q95/datafusion:vortex-compact 50020976 / 50259422 / -0.5% 72034287 / 73707461 / -2.3% 0.69 / 0.68 / +1.8%
tpcds_q96/datafusion:vortex-compact 11891701 / 10206070 / +16.5% 🔴 30090342 / 26399703 / +14.0% 🔴 0.40 / 0.39 / +2.2%
tpcds_q97/datafusion:vortex-compact 24879662 / 24293034 / +2.4% 45151039 / 45845556 / -1.5% 0.55 / 0.53 / +4.0%
tpcds_q98/datafusion:vortex-compact 17956194 / 22074703 / -18.7% 🟢 39435778 / 43047960 / -8.4% 0.46 / 0.51 / -11.2%
tpcds_q99/datafusion:vortex-compact 21060976 / 20892357 / +0.8% 41433322 / 40345069 / +2.7% 0.51 / 0.52 / -1.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29628310 / 29846593 / -0.7% 46426315 / 46020232 / +0.9% 0.64 / 0.65 / -1.6%
tpcds_q02/datafusion:parquet 45063072 / 45625254 / -1.2% 61528295 / 62295826 / -1.2% 0.73 / 0.73 / -0.0%
tpcds_q03/datafusion:parquet 19027784 / 19273647 / -1.3% 33487951 / 32896864 / +1.8% 0.57 / 0.59 / -3.0%
tpcds_q04/datafusion:parquet 194812972 / 196168412 / -0.7% 225604740 / 226993878 / -0.6% 0.86 / 0.86 / -0.1%
tpcds_q05/datafusion:parquet 72758108 / 71586808 / +1.6% 95247141 / 91903016 / +3.6% 0.76 / 0.78 / -1.9%
tpcds_q06/datafusion:parquet 35373274 / 35747908 / -1.0% 52131388 / 56247731 / -7.3% 0.68 / 0.64 / +6.8%
tpcds_q07/datafusion:parquet 46352326 / 46691948 / -0.7% 67067595 / 72983013 / -8.1% 0.69 / 0.64 / +8.0%
tpcds_q08/datafusion:parquet 39411620 / 39770866 / -0.9% 53491099 / 56826924 / -5.9% 0.74 / 0.70 / +5.3%
tpcds_q09/datafusion:parquet 32222472 / 33125552 / -2.7% 43725462 / 42918511 / +1.9% 0.74 / 0.77 / -4.5%
tpcds_q10/datafusion:parquet 50917399 / 50233250 / +1.4% 65421091 / 62691370 / +4.4% 0.78 / 0.80 / -2.9%
tpcds_q11/datafusion:parquet 93942712 / 94782382 / -0.9% 119388191 / 118287865 / +0.9% 0.79 / 0.80 / -1.8%
tpcds_q12/datafusion:parquet 24736886 / 24672304 / +0.3% 37224110 / 38280172 / -2.8% 0.66 / 0.64 / +3.1%
tpcds_q13/datafusion:parquet 44818840 / 45533153 / -1.6% 67212288 / 69616323 / -3.5% 0.67 / 0.65 / +2.0%
tpcds_q14/datafusion:parquet 137621510 / 137902304 / -0.2% 153839296 / 156174025 / -1.5% 0.89 / 0.88 / +1.3%
tpcds_q15/datafusion:parquet 30951354 / 31884794 / -2.9% 50978491 / 50736861 / +0.5% 0.61 / 0.63 / -3.4%
tpcds_q16/datafusion:parquet 37344077 / 36788681 / +1.5% 57334363 / 57420057 / -0.1% 0.65 / 0.64 / +1.7%
tpcds_q17/datafusion:parquet 75749954 / 75639592 / +0.1% 100245568 / 107233952 / -6.5% 0.76 / 0.71 / +7.1%
tpcds_q18/datafusion:parquet 59321794 / 59596884 / -0.5% 83242160 / 79095017 / +5.2% 0.71 / 0.75 / -5.4%
tpcds_q19/datafusion:parquet 32514300 / 32959238 / -1.3% 49695020 / 49188629 / +1.0% 0.65 / 0.67 / -2.4%
tpcds_q20/datafusion:parquet 26104686 / 25324751 / +3.1% 38356360 / 39923016 / -3.9% 0.68 / 0.63 / +7.3%
tpcds_q21/datafusion:parquet 20445628 / 20383787 / +0.3% 35025836 / 35287627 / -0.7% 0.58 / 0.58 / +1.1%
tpcds_q22/datafusion:parquet 76986449 / 77616322 / -0.8% 91856007 / 93142133 / -1.4% 0.84 / 0.83 / +0.6%
tpcds_q23/datafusion:parquet 117301791 / 116990994 / +0.3% 140913615 / 138080407 / +2.1% 0.83 / 0.85 / -1.8%
tpcds_q24/datafusion:parquet 89382606 / 93396004 / -4.3% 116199681 / 120393377 / -3.5% 0.77 / 0.78 / -0.8%
tpcds_q25/datafusion:parquet 74295985 / 75687110 / -1.8% 102346809 / 106267475 / -3.7% 0.73 / 0.71 / +1.9%
tpcds_q26/datafusion:parquet 42870090 / 42770909 / +0.2% 62729147 / 60807504 / +3.2% 0.68 / 0.70 / -2.8%
tpcds_q27/datafusion:parquet 77351408 / 78338060 / -1.3% 105826087 / 108675046 / -2.6% 0.73 / 0.72 / +1.4%
tpcds_q28/datafusion:parquet 27119267 / 26904520 / +0.8% 44418780 / 46882587 / -5.3% 0.61 / 0.57 / +6.4%
tpcds_q29/datafusion:parquet 75140012 / 76745932 / -2.1% 103724090 / 106123849 / -2.3% 0.72 / 0.72 / +0.2%
tpcds_q30/datafusion:parquet 46336642 / 46043924 / +0.6% 65172968 / 68730656 / -5.2% 0.71 / 0.67 / +6.1%
tpcds_q31/datafusion:parquet 89085413 / 89855576 / -0.9% 104343710 / 109673120 / -4.9% 0.85 / 0.82 / +4.2%
tpcds_q32/datafusion:parquet 25530676 / 25888316 / -1.4% 42022815 / 42014572 / +0.0% 0.61 / 0.62 / -1.4%
tpcds_q33/datafusion:parquet 39987597 / 40284584 / -0.7% 57573751 / 57926783 / -0.6% 0.69 / 0.70 / -0.1%
tpcds_q34/datafusion:parquet 24172774 / 23847806 / +1.4% 39114680 / 39526141 / -1.0% 0.62 / 0.60 / +2.4%
tpcds_q35/datafusion:parquet 54737660 / 54618561 / +0.2% 73769075 / 72795686 / +1.3% 0.74 / 0.75 / -1.1%
tpcds_q36/datafusion:parquet 51261524 / 50905620 / +0.7% 78283911 / 74377829 / +5.3% 0.65 / 0.68 / -4.3%
tpcds_q37/datafusion:parquet 25466388 / 26076095 / -2.3% 42721945 / 42414528 / +0.7% 0.60 / 0.61 / -3.0%
tpcds_q38/datafusion:parquet 44315776 / 44779390 / -1.0% 63412039 / 63406614 / +0.0% 0.70 / 0.71 / -1.0%
tpcds_q39/datafusion:parquet 71652598 / 71815856 / -0.2% 92397588 / 93681914 / -1.4% 0.78 / 0.77 / +1.2%
tpcds_q40/datafusion:parquet 27817054 / 29539680 / -5.8% 50883129 / 50962939 / -0.2% 0.55 / 0.58 / -5.7%
tpcds_q41/datafusion:parquet 19917415 / 20009051 / -0.5% 34230732 / 34955364 / -2.1% 0.58 / 0.57 / +1.6%
tpcds_q42/datafusion:parquet 18407726 / 17826889 / +3.3% 30986541 / 31389641 / -1.3% 0.59 / 0.57 / +4.6%
tpcds_q43/datafusion:parquet 19234926 / 19542640 / -1.6% 33840246 / 34531394 / -2.0% 0.57 / 0.57 / +0.4%
tpcds_q44/datafusion:parquet 32437496 / 32412757 / +0.1% 51936794 / 53088869 / -2.2% 0.62 / 0.61 / +2.3%
tpcds_q45/datafusion:parquet 37992743 / 38250872 / -0.7% 55359813 / 56295125 / -1.7% 0.69 / 0.68 / +1.0%
tpcds_q46/datafusion:parquet 30643659 / 29909678 / +2.5% 50147943 / 52441427 / -4.4% 0.61 / 0.57 / +7.1%
tpcds_q47/datafusion:parquet 99610074 / 98790790 / +0.8% 125342162 / 125332012 / +0.0% 0.79 / 0.79 / +0.8%
tpcds_q48/datafusion:parquet 42487315 / 42630614 / -0.3% 61160177 / 62885752 / -2.7% 0.69 / 0.68 / +2.5%
tpcds_q49/datafusion:parquet 72412654 / 73996938 / -2.1% 96631080 / 102416942 / -5.6% 0.75 / 0.72 / +3.7%
tpcds_q50/datafusion:parquet 47354348 / 48052640 / -1.5% 70001112 / 70627300 / -0.9% 0.68 / 0.68 / -0.6%
tpcds_q51/datafusion:parquet 71848940 / 71805103 / +0.1% 93007647 / 92620134 / +0.4% 0.77 / 0.78 / -0.4%
tpcds_q52/datafusion:parquet 18255525 / 18677049 / -2.3% 30983550 / 32114649 / -3.5% 0.59 / 0.58 / +1.3%
tpcds_q53/datafusion:parquet 22676960 / 21732446 / +4.3% 40640207 / 42177049 / -3.6% 0.56 / 0.52 / +8.3%
tpcds_q54/datafusion:parquet 54133744 / 54132809 / +0.0% 74386848 / 78969314 / -5.8% 0.73 / 0.69 / +6.2%
tpcds_q55/datafusion:parquet 17976762 / 18281062 / -1.7% 31595671 / 32048045 / -1.4% 0.57 / 0.57 / -0.3%
tpcds_q56/datafusion:parquet 46113868 / 45759942 / +0.8% 62933632 / 61406418 / +2.5% 0.73 / 0.75 / -1.7%
tpcds_q57/datafusion:parquet 98429424 / 100968331 / -2.5% 120418969 / 120146685 / +0.2% 0.82 / 0.84 / -2.7%
tpcds_q58/datafusion:parquet 64955180 / 64731798 / +0.3% 82523403 / 83586135 / -1.3% 0.79 / 0.77 / +1.6%
tpcds_q59/datafusion:parquet 46477750 / 45525105 / +2.1% 66233781 / 66921330 / -1.0% 0.70 / 0.68 / +3.2%
tpcds_q60/datafusion:parquet 46302256 / 45327546 / +2.2% 62621757 / 62706944 / -0.1% 0.74 / 0.72 / +2.3%
tpcds_q61/datafusion:parquet 37977894 / 37615214 / +1.0% 54876451 / 60012479 / -8.6% 0.69 / 0.63 / +10.4%
tpcds_q62/datafusion:parquet 25296262 / 24930858 / +1.5% 40041157 / 40856289 / -2.0% 0.63 / 0.61 / +3.5%
tpcds_q63/datafusion:parquet 22251127 / 21815516 / +2.0% 41412887 / 41618576 / -0.5% 0.54 / 0.52 / +2.5%
tpcds_q64/datafusion:parquet 207222374 / 205051758 / +1.1% 238199040 / 239594689 / -0.6% 0.87 / 0.86 / +1.7%
tpcds_q65/datafusion:parquet 37478230 / 38669758 / -3.1% 53860261 / 58762198 / -8.3% 0.70 / 0.66 / +5.7%
tpcds_q66/datafusion:parquet 61917746 / 61455426 / +0.8% 81440998 / 81827346 / -0.5% 0.76 / 0.75 / +1.2%
tpcds_q67/datafusion:parquet 69706547 / 71872432 / -3.0% 98548306 / 98651560 / -0.1% 0.71 / 0.73 / -2.9%
tpcds_q68/datafusion:parquet 29099084 / 29658280 / -1.9% 51798137 / 50953882 / +1.7% 0.56 / 0.58 / -3.5%
tpcds_q69/datafusion:parquet 50966209 / 50695970 / +0.5% 64385373 / 64047383 / +0.5% 0.79 / 0.79 / +0.0%
tpcds_q70/datafusion:parquet 36828938 / 36896737 / -0.2% 59374143 / 58303043 / +1.8% 0.62 / 0.63 / -2.0%
tpcds_q71/datafusion:parquet 27667520 / 28275400 / -2.1% 42299179 / 44420173 / -4.8% 0.65 / 0.64 / +2.8%
tpcds_q72/datafusion:parquet 555602116 / 549309171 / +1.1% 589452824 / 586303764 / +0.5% 0.94 / 0.94 / +0.6%
tpcds_q73/datafusion:parquet 22914461 / 23147376 / -1.0% 39611688 / 39144801 / +1.2% 0.58 / 0.59 / -2.2%
tpcds_q74/datafusion:parquet 68581077 / 68898929 / -0.5% 86135624 / 89628751 / -3.9% 0.80 / 0.77 / +3.6%
tpcds_q75/datafusion:parquet 147667572 / 146351637 / +0.9% 173265970 / 176616694 / -1.9% 0.85 / 0.83 / +2.9%
tpcds_q76/datafusion:parquet 53489468 / 53797080 / -0.6% 77831475 / 70853471 / +9.8% 0.69 / 0.76 / -9.5%
tpcds_q77/datafusion:parquet 56644306 / 56408311 / +0.4% 80615420 / 75182013 / +7.2% 0.70 / 0.75 / -6.3%
tpcds_q78/datafusion:parquet 91514928 / 89321760 / +2.5% 128534755 / 123362389 / +4.2% 0.71 / 0.72 / -1.7%
tpcds_q79/datafusion:parquet 26278918 / 25947408 / +1.3% 46899424 / 46598159 / +0.6% 0.56 / 0.56 / +0.6%
tpcds_q80/datafusion:parquet 80795132 / 80167490 / +0.8% 115228594 / 114080679 / +1.0% 0.70 / 0.70 / -0.2%
tpcds_q81/datafusion:parquet 41161455 / 42388637 / -2.9% 61517707 / 61943530 / -0.7% 0.67 / 0.68 / -2.2%
tpcds_q82/datafusion:parquet 27488758 / 26601935 / +3.3% 43127595 / 42302343 / +2.0% 0.64 / 0.63 / +1.4%
tpcds_q83/datafusion:parquet 58089873 / 56841896 / +2.2% 78940671 / 76776455 / +2.8% 0.74 / 0.74 / -0.6%
tpcds_q84/datafusion:parquet 30959186 / 31320690 / -1.2% 45366169 / 46003455 / -1.4% 0.68 / 0.68 / +0.2%
tpcds_q85/datafusion:parquet 83395618 / 82481460 / +1.1% 107957097 / 107615661 / +0.3% 0.77 / 0.77 / +0.8%
tpcds_q86/datafusion:parquet 20402494 / 20517204 / -0.6% 35836277 / 36255234 / -1.2% 0.57 / 0.57 / +0.6%
tpcds_q87/datafusion:parquet 46120402 / 45833168 / +0.6% 64503582 / 67467137 / -4.4% 0.72 / 0.68 / +5.2%
tpcds_q88/datafusion:parquet 45556054 / 48170367 / -5.4% 61786364 / 57365463 / +7.7% 0.74 / 0.84 / -12.2%
tpcds_q89/datafusion:parquet 25780128 / 25890070 / -0.4% 44911192 / 44515327 / +0.9% 0.57 / 0.58 / -1.3%
tpcds_q90/datafusion:parquet 19192446 / 19042084 / +0.8% 33340438 / 33153148 / +0.6% 0.58 / 0.57 / +0.2%
tpcds_q91/datafusion:parquet 37076062 / 37644044 / -1.5% 51662313 / 55662770 / -7.2% 0.72 / 0.68 / +6.1%
tpcds_q92/datafusion:parquet 26270938 / 25735606 / +2.1% 41453253 / 41822047 / -0.9% 0.63 / 0.62 / +3.0%
tpcds_q93/datafusion:parquet 26824690 / 27267882 / -1.6% 49166463 / 49222862 / -0.1% 0.55 / 0.55 / -1.5%
tpcds_q94/datafusion:parquet 34427034 / 34401071 / +0.1% 49435741 / 50811669 / -2.7% 0.70 / 0.68 / +2.9%
tpcds_q95/datafusion:parquet 65086008 / 62559637 / +4.0% 80742530 / 83392885 / -3.2% 0.81 / 0.75 / +7.5%
tpcds_q96/datafusion:parquet 16584450 / 16712070 / -0.8% 29754718 / 31299059 / -4.9% 0.56 / 0.53 / +4.4%
tpcds_q97/datafusion:parquet 35277405 / 35276555 / +0.0% 52204002 / 54050435 / -3.4% 0.68 / 0.65 / +3.5%
tpcds_q98/datafusion:parquet 25216362 / 25130371 / +0.3% 39530224 / 40887914 / -3.3% 0.64 / 0.61 / +3.8%
tpcds_q99/datafusion:parquet 29434953 / 29490492 / -0.2% 44911004 / 43520926 / +3.2% 0.66 / 0.68 / -3.3%
duckdb / vortex-file-compressed / ns (1.087x ➖, 1↑ 40↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16360708 / 15284880 / +7.0% 21579749 / 23627707 / -8.7% 0.76 / 0.65 / +17.2%
tpcds_q02/duckdb:vortex-file-compressed 15085766 / 15190563 / -0.7% 18535966 / 23343220 / -20.6% 🟢 0.81 / 0.65 / +25.1%
tpcds_q03/duckdb:vortex-file-compressed 13156320 / 12513962 / +5.1% 16582543 / 23887840 / -30.6% 🟢 0.79 / 0.52 / +51.4%
tpcds_q04/duckdb:vortex-file-compressed 51205187 / 50246609 / +1.9% 59455914 / 63113110 / -5.8% 0.86 / 0.80 / +8.2%
tpcds_q05/duckdb:vortex-file-compressed 20510292 / 19507920 / +5.1% 24354699 / 28253135 / -13.8% 🟢 0.84 / 0.69 / +22.0%
tpcds_q06/duckdb:vortex-file-compressed 29048528 / 26880026 / +8.1% 37946774 / 43883967 / -13.5% 🟢 0.77 / 0.61 / +25.0%
tpcds_q07/duckdb:vortex-file-compressed 17949214 / 16045900 / +11.9% 🔴 23433803 / 32068742 / -26.9% 🟢 0.77 / 0.50 / +53.1%
tpcds_q08/duckdb:vortex-file-compressed 20412035 / 19461940 / +4.9% 25089651 / 28044803 / -10.5% 🟢 0.81 / 0.69 / +17.2%
tpcds_q09/duckdb:vortex-file-compressed 10889342 / 10356468 / +5.1% 16456582 / 18046047 / -8.8% 0.66 / 0.57 / +15.3%
tpcds_q10/duckdb:vortex-file-compressed 31092584 / 27623936 / +12.6% 🔴 38953405 / 42714860 / -8.8% 0.80 / 0.65 / +23.4%
tpcds_q11/duckdb:vortex-file-compressed 41435466 / 40150728 / +3.2% 49621122 / 54867277 / -9.6% 0.84 / 0.73 / +14.1%
tpcds_q12/duckdb:vortex-file-compressed 11295748 / 10171470 / +11.1% 🔴 14891908 / 21421773 / -30.5% 🟢 0.76 / 0.47 / +59.7%
tpcds_q13/duckdb:vortex-file-compressed 23089582 / 21944388 / +5.2% 28469223 / 36263691 / -21.5% 🟢 0.81 / 0.61 / +34.0%
tpcds_q14/duckdb:vortex-file-compressed 62511920 / 61219424 / +2.1% 71036094 / 70750486 / +0.4% 0.88 / 0.87 / +1.7%
tpcds_q15/duckdb:vortex-file-compressed 22540221 / 20835645 / +8.2% 26942977 / 25308661 / +6.5% 0.84 / 0.82 / +1.6%
tpcds_q16/duckdb:vortex-file-compressed 19512360 / 17760004 / +9.9% 26392243 / 32629332 / -19.1% 🟢 0.74 / 0.54 / +35.8%
tpcds_q17/duckdb:vortex-file-compressed 34034568 / 30328749 / +12.2% 🔴 40245781 / 45764309 / -12.1% 🟢 0.85 / 0.66 / +27.6%
tpcds_q18/duckdb:vortex-file-compressed 30865808 / 28295922 / +9.1% 36219383 / 39217059 / -7.6% 0.85 / 0.72 / +18.1%
tpcds_q19/duckdb:vortex-file-compressed 25816009 / 23866096 / +8.2% 30959130 / 34966562 / -11.5% 🟢 0.83 / 0.68 / +22.2%
tpcds_q20/duckdb:vortex-file-compressed 11938948 / 10703145 / +11.5% 🔴 15038456 / 15399798 / -2.3% 0.79 / 0.70 / +14.2%
tpcds_q21/duckdb:vortex-file-compressed 10889381 / 9876061 / +10.3% 🔴 19455838 / 18098491 / +7.5% 0.56 / 0.55 / +2.6%
tpcds_q22/duckdb:vortex-file-compressed 30431254 / 29833482 / +2.0% 35595010 / 40210972 / -11.5% 🟢 0.85 / 0.74 / +15.2%
tpcds_q23/duckdb:vortex-file-compressed 40145922 / 36601222 / +9.7% 48313396 / 47599047 / +1.5% 0.83 / 0.77 / +8.1%
tpcds_q24/duckdb:vortex-file-compressed 30299760 / 28119339 / +7.8% 36205046 / 40140649 / -9.8% 0.84 / 0.70 / +19.5%
tpcds_q25/duckdb:vortex-file-compressed 28693904 / 25647444 / +11.9% 🔴 34626032 / 41091163 / -15.7% 🟢 0.83 / 0.62 / +32.8%
tpcds_q26/duckdb:vortex-file-compressed 15872873 / 13667576 / +16.1% 🔴 19145761 / 19777649 / -3.2% 0.83 / 0.69 / +20.0%
tpcds_q27/duckdb:vortex-file-compressed 20126998 / 17518005 / +14.9% 🔴 27875343 / 31803045 / -12.4% 🟢 0.72 / 0.55 / +31.1%
tpcds_q28/duckdb:vortex-file-compressed 8648563 / 7776540 / +11.2% 🔴 10742624 / 12975429 / -17.2% 🟢 0.81 / 0.60 / +34.3%
tpcds_q29/duckdb:vortex-file-compressed 32434880 / 28919674 / +12.2% 🔴 38095606 / 45086305 / -15.5% 🟢 0.85 / 0.64 / +32.7%
tpcds_q30/duckdb:vortex-file-compressed 20259688 / 19579508 / +3.5% 29278659 / 28913848 / +1.3% 0.69 / 0.68 / +2.2%
tpcds_q31/duckdb:vortex-file-compressed 20174785 / 19264032 / +4.7% 24883511 / 27101547 / -8.2% 0.81 / 0.71 / +14.1%
tpcds_q32/duckdb:vortex-file-compressed 12793376 / 9959145 / +28.5% 🔴 17887169 / 20169220 / -11.3% 🟢 0.72 / 0.49 / +44.8%
tpcds_q33/duckdb:vortex-file-compressed 18374576 / 17349052 / +5.9% 28797228 / 29177286 / -1.3% 0.64 / 0.59 / +7.3%
tpcds_q34/duckdb:vortex-file-compressed 15965308 / 15377156 / +3.8% 20577252 / 24307496 / -15.3% 🟢 0.78 / 0.63 / +22.6%
tpcds_q35/duckdb:vortex-file-compressed 49376721 / 46014606 / +7.3% 56417510 / 60757011 / -7.1% 0.88 / 0.76 / +15.6%
tpcds_q36/duckdb:vortex-file-compressed 15784106 / 14858093 / +6.2% 24313052 / 29422165 / -17.4% 🟢 0.65 / 0.50 / +28.6%
tpcds_q37/duckdb:vortex-file-compressed 15986762 / 13887972 / +15.1% 🔴 24884100 / 23334512 / +6.6% 0.64 / 0.60 / +7.9%
tpcds_q38/duckdb:vortex-file-compressed 23644878 / 22382348 / +5.6% 28652461 / 30398941 / -5.7% 0.83 / 0.74 / +12.1%
tpcds_q39/duckdb:vortex-file-compressed 19645796 / 18364480 / +7.0% 24751502 / 30665331 / -19.3% 🟢 0.79 / 0.60 / +32.5%
tpcds_q40/duckdb:vortex-file-compressed 15784802 / 13411468 / +17.7% 🔴 19407765 / 19222888 / +1.0% 0.81 / 0.70 / +16.6%
tpcds_q41/duckdb:vortex-file-compressed 6841562 / 6617007 / +3.4% 9380459 / 10131919 / -7.4% 0.73 / 0.65 / +11.7%
tpcds_q42/duckdb:vortex-file-compressed 9550889 / 8469154 / +12.8% 🔴 14335970 / 17958329 / -20.2% 🟢 0.67 / 0.47 / +41.3%
tpcds_q43/duckdb:vortex-file-compressed 11284112 / 10234168 / +10.3% 🔴 15646395 / 18099603 / -13.6% 🟢 0.72 / 0.57 / +27.5%
tpcds_q44/duckdb:vortex-file-compressed 15023439 / 13803986 / +8.8% 21053314 / 23352728 / -9.8% 0.71 / 0.59 / +20.7%
tpcds_q45/duckdb:vortex-file-compressed 24488880 / 22399580 / +9.3% 27409539 / 30071502 / -8.9% 0.89 / 0.74 / +19.9%
tpcds_q46/duckdb:vortex-file-compressed 21151408 / 18521214 / +14.2% 🔴 28321934 / 29415961 / -3.7% 0.75 / 0.63 / +18.6%
tpcds_q47/duckdb:vortex-file-compressed 31693059 / 30983854 / +2.3% 37859533 / 44050042 / -14.1% 🟢 0.84 / 0.70 / +19.0%
tpcds_q48/duckdb:vortex-file-compressed 22103345 / 19674957 / +12.3% 🔴 27989124 / 32609013 / -14.2% 🟢 0.79 / 0.60 / +30.9%
tpcds_q49/duckdb:vortex-file-compressed 19188056 / 16859476 / +13.8% 🔴 25403909 / 29785863 / -14.7% 🟢 0.76 / 0.57 / +33.4%
tpcds_q50/duckdb:vortex-file-compressed 20089090 / 16917463 / +18.7% 🔴 27990735 / 29023573 / -3.6% 0.72 / 0.58 / +23.1%
tpcds_q51/duckdb:vortex-file-compressed 53498198 / 64933288 / -17.6% 🟢 63956559 / 60983319 / +4.9% 0.84 / 1.06 / -21.4%
tpcds_q52/duckdb:vortex-file-compressed 9675848 / 8508166 / +13.7% 🔴 14885043 / 18005207 / -17.3% 🟢 0.65 / 0.47 / +37.6%
tpcds_q53/duckdb:vortex-file-compressed 17251458 / 14531259 / +18.7% 🔴 22818398 / 24984186 / -8.7% 0.76 / 0.58 / +30.0%
tpcds_q54/duckdb:vortex-file-compressed 22137318 / 20243797 / +9.4% 27964916 / 30043273 / -6.9% 0.79 / 0.67 / +17.5%
tpcds_q55/duckdb:vortex-file-compressed 9894544 / 8347115 / +18.5% 🔴 14211746 / 18420923 / -22.8% 🟢 0.70 / 0.45 / +53.6%
tpcds_q56/duckdb:vortex-file-compressed 18382083 / 17177692 / +7.0% 25143862 / 28918705 / -13.1% 🟢 0.73 / 0.59 / +23.1%
tpcds_q57/duckdb:vortex-file-compressed 26075121 / 26744502 / -2.5% 32364060 / 31520074 / +2.7% 0.81 / 0.85 / -5.0%
tpcds_q58/duckdb:vortex-file-compressed 19954596 / 18460114 / +8.1% 24893824 / 30650564 / -18.8% 🟢 0.80 / 0.60 / +33.1%
tpcds_q59/duckdb:vortex-file-compressed 19199192 / 18955488 / +1.3% 24645964 / 25571913 / -3.6% 0.78 / 0.74 / +5.1%
tpcds_q60/duckdb:vortex-file-compressed 19106239 / 17880724 / +6.9% 25600175 / 31146649 / -17.8% 🟢 0.75 / 0.57 / +30.0%
tpcds_q61/duckdb:vortex-file-compressed 21498972 / 19937746 / +7.8% 27434702 / 33563712 / -18.3% 🟢 0.78 / 0.59 / +31.9%
tpcds_q62/duckdb:vortex-file-compressed 12266510 / 11832466 / +3.7% 15360355 / 17755275 / -13.5% 🟢 0.80 / 0.67 / +19.8%
tpcds_q63/duckdb:vortex-file-compressed 15995664 / 13734132 / +16.5% 🔴 20571972 / 24072310 / -14.5% 🟢 0.78 / 0.57 / +36.3%
tpcds_q64/duckdb:vortex-file-compressed 66724026 / 62649974 / +6.5% 76188229 / 78474938 / -2.9% 0.88 / 0.80 / +9.7%
tpcds_q65/duckdb:vortex-file-compressed 15379247 / 13707912 / +12.2% 🔴 20371708 / 22504574 / -9.5% 0.75 / 0.61 / +23.9%
tpcds_q66/duckdb:vortex-file-compressed 23773326 / 21473406 / +10.7% 🔴 26629495 / 32954612 / -19.2% 🟢 0.89 / 0.65 / +37.0%
tpcds_q67/duckdb:vortex-file-compressed 67160197 / 65173367 / +3.0% 81270766 / 81615332 / -0.4% 0.83 / 0.80 / +3.5%
tpcds_q68/duckdb:vortex-file-compressed 20412871 / 18277758 / +11.7% 🔴 26207259 / 28175961 / -7.0% 0.78 / 0.65 / +20.1%
tpcds_q69/duckdb:vortex-file-compressed 32780878 / 28726705 / +14.1% 🔴 43790670 / 42876140 / +2.1% 0.75 / 0.67 / +11.7%
tpcds_q70/duckdb:vortex-file-compressed 21243160 / 18729678 / +13.4% 🔴 26776478 / 31862751 / -16.0% 🟢 0.79 / 0.59 / +35.0%
tpcds_q71/duckdb:vortex-file-compressed 14497582 / 12661834 / +14.5% 🔴 19288053 / 23676377 / -18.5% 🟢 0.75 / 0.53 / +40.5%
tpcds_q72/duckdb:vortex-file-compressed 63515798 / 61679881 / +3.0% 72520011 / 80279126 / -9.7% 0.88 / 0.77 / +14.0%
tpcds_q73/duckdb:vortex-file-compressed 15463734 / 14690200 / +5.3% 20459369 / 20164445 / +1.5% 0.76 / 0.73 / +3.7%
tpcds_q74/duckdb:vortex-file-compressed 28359296 / 27183421 / +4.3% 34977307 / 36403494 / -3.9% 0.81 / 0.75 / +8.6%
tpcds_q75/duckdb:vortex-file-compressed 29812838 / 28643819 / +4.1% 37063780 / 45597335 / -18.7% 🟢 0.80 / 0.63 / +28.0%
tpcds_q76/duckdb:vortex-file-compressed 13692554 / 12824042 / +6.8% 27308836 / 24299101 / +12.4% 🔴 0.50 / 0.53 / -5.0%
tpcds_q77/duckdb:vortex-file-compressed 17373112 / 16016758 / +8.5% 21844819 / 24690151 / -11.5% 🟢 0.80 / 0.65 / +22.6%
tpcds_q78/duckdb:vortex-file-compressed 38223868 / 37586808 / +1.7% 46229680 / 46316024 / -0.2% 0.83 / 0.81 / +1.9%
tpcds_q79/duckdb:vortex-file-compressed 16491774 / 14656468 / +12.5% 🔴 20595740 / 24820597 / -17.0% 🟢 0.80 / 0.59 / +35.6%
tpcds_q80/duckdb:vortex-file-compressed 29941610 / 28036052 / +6.8% 39155305 / 42321480 / -7.5% 0.76 / 0.66 / +15.4%
tpcds_q81/duckdb:vortex-file-compressed 23611592 / 22359486 / +5.6% 28952854 / 30680098 / -5.6% 0.82 / 0.73 / +11.9%
tpcds_q82/duckdb:vortex-file-compressed 33977622 / 32556034 / +4.4% 41592681 / 39752091 / +4.6% 0.82 / 0.82 / -0.3%
tpcds_q83/duckdb:vortex-file-compressed 20299558 / 18742225 / +8.3% 24145132 / 24573727 / -1.7% 0.84 / 0.76 / +10.2%
tpcds_q84/duckdb:vortex-file-compressed 15231655 / 12742933 / +19.5% 🔴 20329973 / 23010314 / -11.6% 🟢 0.75 / 0.55 / +35.3%
tpcds_q85/duckdb:vortex-file-compressed 33660369 / 31505152 / +6.8% 37733154 / 41461509 / -9.0% 0.89 / 0.76 / +17.4%
tpcds_q86/duckdb:vortex-file-compressed 12044476 / 10788680 / +11.6% 🔴 18564728 / 17546160 / +5.8% 0.65 / 0.61 / +5.5%
tpcds_q87/duckdb:vortex-file-compressed 25236796 / 24131230 / +4.6% 29812191 / 30107442 / -1.0% 0.85 / 0.80 / +5.6%
tpcds_q88/duckdb:vortex-file-compressed 37189664 / 32481819 / +14.5% 🔴 46315246 / 45859246 / +1.0% 0.80 / 0.71 / +13.4%
tpcds_q89/duckdb:vortex-file-compressed 15224789 / 14055656 / +8.3% 22489088 / 24721581 / -9.0% 0.68 / 0.57 / +19.1%
tpcds_q90/duckdb:vortex-file-compressed 9305851 / 7659454 / +21.5% 🔴 12592979 / 15479961 / -18.6% 🟢 0.74 / 0.49 / +49.3%
tpcds_q91/duckdb:vortex-file-compressed 17874952 / 15605009 / +14.5% 🔴 20806026 / 24041785 / -13.5% 🟢 0.86 / 0.65 / +32.4%
tpcds_q92/duckdb:vortex-file-compressed 15581431 / 13265162 / +17.5% 🔴 21553471 / 22525279 / -4.3% 0.72 / 0.59 / +22.8%
tpcds_q93/duckdb:vortex-file-compressed 19006128 / 17251864 / +10.2% 🔴 24828365 / 24436782 / +1.6% 0.77 / 0.71 / +8.4%
tpcds_q94/duckdb:vortex-file-compressed 18145022 / 17666823 / +2.7% 24232431 / 28813503 / -15.9% 🟢 0.75 / 0.61 / +22.1%
tpcds_q95/duckdb:vortex-file-compressed 73318466 / 71736714 / +2.2% 77825956 / 85826591 / -9.3% 0.94 / 0.84 / +12.7%
tpcds_q96/duckdb:vortex-file-compressed 9608222 / 7606576 / +26.3% 🔴 12829205 / 17670168 / -27.4% 🟢 0.75 / 0.43 / +74.0%
tpcds_q97/duckdb:vortex-file-compressed 24117969 / 22513732 / +7.1% 28225796 / 29063888 / -2.9% 0.85 / 0.77 / +10.3%
tpcds_q98/duckdb:vortex-file-compressed 14180746 / 14794104 / -4.1% 19080686 / 23341699 / -18.3% 🟢 0.74 / 0.63 / +17.3%
tpcds_q99/duckdb:vortex-file-compressed 15898730 / 13623054 / +16.7% 🔴 19388417 / 19384928 / +0.0% 0.82 / 0.70 / +16.7%
duckdb / vortex-compact / ns (1.070x ➖, 0↑ 20↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17834921 / 16369750 / +9.0% 27128462 / 24815392 / +9.3% 0.66 / 0.66 / -0.3%
tpcds_q02/duckdb:vortex-compact 16731336 / 16580339 / +0.9% 21099031 / 23202141 / -9.1% 0.79 / 0.71 / +11.0%
tpcds_q03/duckdb:vortex-compact 22882866 / 22316301 / +2.5% 26946123 / 30750841 / -12.4% 🟢 0.85 / 0.73 / +17.0%
tpcds_q04/duckdb:vortex-compact 57791768 / 55556578 / +4.0% 64755334 / 67660601 / -4.3% 0.89 / 0.82 / +8.7%
tpcds_q05/duckdb:vortex-compact 26138228 / 22547808 / +15.9% 🔴 29970561 / 32849701 / -8.8% 0.87 / 0.69 / +27.1%
tpcds_q06/duckdb:vortex-compact 35704678 / 32403836 / +10.2% 🔴 42416076 / 44707847 / -5.1% 0.84 / 0.72 / +16.1%
tpcds_q07/duckdb:vortex-compact 30759722 / 28249055 / +8.9% 39605049 / 38548201 / +2.7% 0.78 / 0.73 / +6.0%
tpcds_q08/duckdb:vortex-compact 50740848 / 49503013 / +2.5% 56657953 / 57987317 / -2.3% 0.90 / 0.85 / +4.9%
tpcds_q09/duckdb:vortex-compact 13323252 / 13088366 / +1.8% 19120346 / 20255663 / -5.6% 0.70 / 0.65 / +7.8%
tpcds_q10/duckdb:vortex-compact 49427712 / 45476239 / +8.7% 56981748 / 67120749 / -15.1% 🟢 0.87 / 0.68 / +28.0%
tpcds_q11/duckdb:vortex-compact 46566520 / 45292618 / +2.8% 53030679 / 58297560 / -9.0% 0.88 / 0.78 / +13.0%
tpcds_q12/duckdb:vortex-compact 14109660 / 13561264 / +4.0% 17617974 / 20196629 / -12.8% 🟢 0.80 / 0.67 / +19.3%
tpcds_q13/duckdb:vortex-compact 37732126 / 37617626 / +0.3% 45755734 / 49963680 / -8.4% 0.82 / 0.75 / +9.5%
tpcds_q14/duckdb:vortex-compact 69822668 / 67574868 / +3.3% 83855848 / 83241792 / +0.7% 0.83 / 0.81 / +2.6%
tpcds_q15/duckdb:vortex-compact 27729770 / 26450583 / +4.8% 34636415 / 32480373 / +6.6% 0.80 / 0.81 / -1.7%
tpcds_q16/duckdb:vortex-compact 29421668 / 25229970 / +16.6% 🔴 35570277 / 37077468 / -4.1% 0.83 / 0.68 / +21.6%
tpcds_q17/duckdb:vortex-compact 49384610 / 45116099 / +9.5% 55571874 / 57275102 / -3.0% 0.89 / 0.79 / +12.8%
tpcds_q18/duckdb:vortex-compact 38979716 / 37324354 / +4.4% 45848667 / 45197674 / +1.4% 0.85 / 0.83 / +3.0%
tpcds_q19/duckdb:vortex-compact 38306251 / 35797276 / +7.0% 41060779 / 44035414 / -6.8% 0.93 / 0.81 / +14.8%
tpcds_q20/duckdb:vortex-compact 15317765 / 14059656 / +8.9% 19574476 / 20059475 / -2.4% 0.78 / 0.70 / +11.6%
tpcds_q21/duckdb:vortex-compact 11864950 / 11389792 / +4.2% 20870390 / 18843385 / +10.8% 🔴 0.57 / 0.60 / -5.9%
tpcds_q22/duckdb:vortex-compact 31261212 / 30239667 / +3.4% 38527754 / 43466368 / -11.4% 🟢 0.81 / 0.70 / +16.6%
tpcds_q23/duckdb:vortex-compact 46037802 / 43250880 / +6.4% 52729628 / 55712041 / -5.4% 0.87 / 0.78 / +12.5%
tpcds_q24/duckdb:vortex-compact 41911316 / 40298646 / +4.0% 47553268 / 49623726 / -4.2% 0.88 / 0.81 / +8.5%
tpcds_q25/duckdb:vortex-compact 45523170 / 43503126 / +4.6% 52158135 / 54426117 / -4.2% 0.87 / 0.80 / +9.2%
tpcds_q26/duckdb:vortex-compact 27925740 / 25183713 / +10.9% 🔴 31331339 / 32678147 / -4.1% 0.89 / 0.77 / +15.7%
tpcds_q27/duckdb:vortex-compact 34997997 / 34243806 / +2.2% 45279725 / 48984812 / -7.6% 0.77 / 0.70 / +10.6%
tpcds_q28/duckdb:vortex-compact 13074552 / 12460782 / +4.9% 16416169 / 16885958 / -2.8% 0.80 / 0.74 / +7.9%
tpcds_q29/duckdb:vortex-compact 48213701 / 44367738 / +8.7% 54376180 / 57868180 / -6.0% 0.89 / 0.77 / +15.6%
tpcds_q30/duckdb:vortex-compact 23774852 / 22594562 / +5.2% 29887976 / 30548635 / -2.2% 0.80 / 0.74 / +7.5%
tpcds_q31/duckdb:vortex-compact 24594399 / 23917496 / +2.8% 34962830 / 31492955 / +11.0% 🔴 0.70 / 0.76 / -7.4%
tpcds_q32/duckdb:vortex-compact 17042834 / 15624302 / +9.1% 22611626 / 20809096 / +8.7% 0.75 / 0.75 / +0.4%
tpcds_q33/duckdb:vortex-compact 25149683 / 24119986 / +4.3% 34048502 / 35742487 / -4.7% 0.74 / 0.67 / +9.5%
tpcds_q34/duckdb:vortex-compact 27282668 / 22390500 / +21.8% 🔴 29162309 / 29860866 / -2.3% 0.94 / 0.75 / +24.8%
tpcds_q35/duckdb:vortex-compact 65645848 / 61874526 / +6.1% 72414415 / 75146335 / -3.6% 0.91 / 0.82 / +10.1%
tpcds_q36/duckdb:vortex-compact 22461905 / 22342407 / +0.5% 32587906 / 39535116 / -17.6% 🟢 0.69 / 0.57 / +22.0%
tpcds_q37/duckdb:vortex-compact 17228806 / 15614482 / +10.3% 🔴 23539923 / 24602090 / -4.3% 0.73 / 0.63 / +15.3%
tpcds_q38/duckdb:vortex-compact 27473852 / 26590398 / +3.3% 34019237 / 36094595 / -5.7% 0.81 / 0.74 / +9.6%
tpcds_q39/duckdb:vortex-compact 21248368 / 19436791 / +9.3% 29739871 / 27651708 / +7.6% 0.71 / 0.70 / +1.6%
tpcds_q40/duckdb:vortex-compact 17406955 / 16124118 / +8.0% 26733448 / 22164330 / +20.6% 🔴 0.65 / 0.73 / -10.5%
tpcds_q41/duckdb:vortex-compact 8020213 / 7739064 / +3.6% 11461506 / 11421758 / +0.3% 0.70 / 0.68 / +3.3%
tpcds_q42/duckdb:vortex-compact 12615262 / 11836234 / +6.6% 19359209 / 24871182 / -22.2% 🟢 0.65 / 0.48 / +36.9%
tpcds_q43/duckdb:vortex-compact 17663849 / 16637960 / +6.2% 22835859 / 27175569 / -16.0% 🟢 0.77 / 0.61 / +26.3%
tpcds_q44/duckdb:vortex-compact 22236772 / 20508671 / +8.4% 29070086 / 29262939 / -0.7% 0.76 / 0.70 / +9.1%
tpcds_q45/duckdb:vortex-compact 29317726 / 27636409 / +6.1% 32576039 / 34293406 / -5.0% 0.90 / 0.81 / +11.7%
tpcds_q46/duckdb:vortex-compact 30671600 / 29558072 / +3.8% 36238478 / 39041187 / -7.2% 0.85 / 0.76 / +11.8%
tpcds_q47/duckdb:vortex-compact 37307970 / 36229910 / +3.0% 47540337 / 45266647 / +5.0% 0.78 / 0.80 / -1.9%
tpcds_q48/duckdb:vortex-compact 34306731 / 33521122 / +2.3% 41148231 / 46078073 / -10.7% 🟢 0.83 / 0.73 / +14.6%
tpcds_q49/duckdb:vortex-compact 26804350 / 23316542 / +15.0% 🔴 32004600 / 43875563 / -27.1% 🟢 0.84 / 0.53 / +57.6%
tpcds_q50/duckdb:vortex-compact 29700538 / 27903992 / +6.4% 36828163 / 37036742 / -0.6% 0.81 / 0.75 / +7.0%
tpcds_q51/duckdb:vortex-compact 67474692 / 53139590 / +27.0% 🔴 62238777 / 61294257 / +1.5% 1.08 / 0.87 / +25.0%
tpcds_q52/duckdb:vortex-compact 12974046 / 11909316 / +8.9% 20709417 / 23780933 / -12.9% 🟢 0.63 / 0.50 / +25.1%
tpcds_q53/duckdb:vortex-compact 23755593 / 21508319 / +10.4% 🔴 28837154 / 30297476 / -4.8% 0.82 / 0.71 / +16.0%
tpcds_q54/duckdb:vortex-compact 28774564 / 26493018 / +8.6% 33146077 / 37175867 / -10.8% 🟢 0.87 / 0.71 / +21.8%
tpcds_q55/duckdb:vortex-compact 12714028 / 11783906 / +7.9% 18607391 / 23378549 / -20.4% 🟢 0.68 / 0.50 / +35.6%
tpcds_q56/duckdb:vortex-compact 25867696 / 23659026 / +9.3% 33866175 / 34640840 / -2.2% 0.76 / 0.68 / +11.8%
tpcds_q57/duckdb:vortex-compact 30362600 / 27816474 / +9.2% 33962424 / 36459243 / -6.8% 0.89 / 0.76 / +17.2%
tpcds_q58/duckdb:vortex-compact 23147405 / 22829472 / +1.4% 31454517 / 34956338 / -10.0% 🟢 0.74 / 0.65 / +12.7%
tpcds_q59/duckdb:vortex-compact 24005040 / 23471868 / +2.3% 30927740 / 29752467 / +4.0% 0.78 / 0.79 / -1.6%
tpcds_q60/duckdb:vortex-compact 25924676 / 24496604 / +5.8% 31391012 / 39730033 / -21.0% 🟢 0.83 / 0.62 / +33.9%
tpcds_q61/duckdb:vortex-compact 33336106 / 34299418 / -2.8% 39316404 / 45618565 / -13.8% 🟢 0.85 / 0.75 / +12.8%
tpcds_q62/duckdb:vortex-compact 13792488 / 11762698 / +17.3% 🔴 19609192 / 17889136 / +9.6% 0.70 / 0.66 / +7.0%
tpcds_q63/duckdb:vortex-compact 22511716 / 20871291 / +7.9% 27527161 / 28983248 / -5.0% 0.82 / 0.72 / +13.6%
tpcds_q64/duckdb:vortex-compact 90329914 / 86148949 / +4.9% 97812094 / 100976937 / -3.1% 0.92 / 0.85 / +8.2%
tpcds_q65/duckdb:vortex-compact 19731436 / 18365707 / +7.4% 24305776 / 28071073 / -13.4% 🟢 0.81 / 0.65 / +24.1%
tpcds_q66/duckdb:vortex-compact 27351054 / 25758148 / +6.2% 36958917 / 39120395 / -5.5% 0.74 / 0.66 / +12.4%
tpcds_q67/duckdb:vortex-compact 73279812 / 70728064 / +3.6% 85062187 / 85412969 / -0.4% 0.86 / 0.83 / +4.0%
tpcds_q68/duckdb:vortex-compact 31202089 / 29237142 / +6.7% 36957828 / 40063961 / -7.8% 0.84 / 0.73 / +15.7%
tpcds_q69/duckdb:vortex-compact 50732382 / 47610686 / +6.6% 59161905 / 58301712 / +1.5% 0.86 / 0.82 / +5.0%
tpcds_q70/duckdb:vortex-compact 33329728 / 31298426 / +6.5% 40007423 / 41389069 / -3.3% 0.83 / 0.76 / +10.2%
tpcds_q71/duckdb:vortex-compact 21262357 / 19278324 / +10.3% 🔴 26880478 / 30554483 / -12.0% 🟢 0.79 / 0.63 / +25.4%
tpcds_q72/duckdb:vortex-compact 71251420 / 70066934 / +1.7% 81097209 / 83627441 / -3.0% 0.88 / 0.84 / +4.9%
tpcds_q73/duckdb:vortex-compact 24167174 / 21731503 / +11.2% 🔴 32382017 / 29492244 / +9.8% 0.75 / 0.74 / +1.3%
tpcds_q74/duckdb:vortex-compact 33131724 / 32039862 / +3.4% 39349740 / 41083032 / -4.2% 0.84 / 0.78 / +8.0%
tpcds_q75/duckdb:vortex-compact 35383676 / 33902676 / +4.4% 38806735 / 46096888 / -15.8% 🟢 0.91 / 0.74 / +24.0%
tpcds_q76/duckdb:vortex-compact 17939792 / 16183138 / +10.9% 🔴 23742762 / 30516314 / -22.2% 🟢 0.76 / 0.53 / +42.5%
tpcds_q77/duckdb:vortex-compact 25713848 / 23654162 / +8.7% 32336291 / 31817358 / +1.6% 0.80 / 0.74 / +7.0%
tpcds_q78/duckdb:vortex-compact 42971577 / 42654026 / +0.7% 57242126 / 51182973 / +11.8% 🔴 0.75 / 0.83 / -9.9%
tpcds_q79/duckdb:vortex-compact 39416874 / 37981746 / +3.8% 47113857 / 62575122 / -24.7% 🟢 0.84 / 0.61 / +37.8%
tpcds_q80/duckdb:vortex-compact 37554242 / 36393418 / +3.2% 43743677 / 48444070 / -9.7% 0.86 / 0.75 / +14.3%
tpcds_q81/duckdb:vortex-compact 26220322 / 24390154 / +7.5% 32739729 / 32832428 / -0.3% 0.80 / 0.74 / +7.8%
tpcds_q82/duckdb:vortex-compact 38375508 / 35533818 / +8.0% 44297750 / 42852238 / +3.4% 0.87 / 0.83 / +4.5%
tpcds_q83/duckdb:vortex-compact 32671112 / 28378524 / +15.1% 🔴 35196109 / 32113563 / +9.6% 0.93 / 0.88 / +5.0%
tpcds_q84/duckdb:vortex-compact 16801544 / 15103359 / +11.2% 🔴 23385889 / 23574279 / -0.8% 0.72 / 0.64 / +12.1%
tpcds_q85/duckdb:vortex-compact 44084746 / 42011352 / +4.9% 48968985 / 51510234 / -4.9% 0.90 / 0.82 / +10.4%
tpcds_q86/duckdb:vortex-compact 13598570 / 12492364 / +8.9% 16465456 / 18823586 / -12.5% 🟢 0.83 / 0.66 / +24.4%
tpcds_q87/duckdb:vortex-compact 29357142 / 28749832 / +2.1% 36404310 / 36842375 / -1.2% 0.81 / 0.78 / +3.3%
tpcds_q88/duckdb:vortex-compact 72504220 / 67573438 / +7.3% 84961063 / 78735670 / +7.9% 0.85 / 0.86 / -0.6%
tpcds_q89/duckdb:vortex-compact 23079864 / 20974839 / +10.0% 🔴 33248889 / 31419256 / +5.8% 0.69 / 0.67 / +4.0%
tpcds_q90/duckdb:vortex-compact 13648943 / 11869118 / +15.0% 🔴 18766664 / 16064936 / +16.8% 🔴 0.73 / 0.74 / -1.6%
tpcds_q91/duckdb:vortex-compact 36010836 / 33154032 / +8.6% 40081700 / 40722614 / -1.6% 0.90 / 0.81 / +10.4%
tpcds_q92/duckdb:vortex-compact 22282286 / 20789349 / +7.2% 26283614 / 27592247 / -4.7% 0.85 / 0.75 / +12.5%
tpcds_q93/duckdb:vortex-compact 19311050 / 18575360 / +4.0% 24624018 / 26712494 / -7.8% 0.78 / 0.70 / +12.8%
tpcds_q94/duckdb:vortex-compact 24359484 / 22276236 / +9.4% 30207202 / 32506122 / -7.1% 0.81 / 0.69 / +17.7%
tpcds_q95/duckdb:vortex-compact 79476850 / 78344498 / +1.4% 85799428 / 84877825 / +1.1% 0.93 / 0.92 / +0.4%
tpcds_q96/duckdb:vortex-compact 20390723 / 17211488 / +18.5% 🔴 23522501 / 24101734 / -2.4% 0.87 / 0.71 / +21.4%
tpcds_q97/duckdb:vortex-compact 28785819 / 26003982 / +10.7% 🔴 32521335 / 32773920 / -0.8% 0.89 / 0.79 / +11.6%
tpcds_q98/duckdb:vortex-compact 19612042 / 18378596 / +6.7% 25193746 / 29144067 / -13.6% 🟢 0.78 / 0.63 / +23.4%
tpcds_q99/duckdb:vortex-compact 19122432 / 17002282 / +12.5% 🔴 24966537 / 22061752 / +13.2% 🔴 0.77 / 0.77 / -0.6%
duckdb / parquet / ns (0.989x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23422408 / 24892216 / -5.9% 34521657 / 32003518 / +7.9% 0.68 / 0.78 / -12.8%
tpcds_q02/duckdb:parquet 15517446 / 15399586 / +0.8% 20078298 / 20478454 / -2.0% 0.77 / 0.75 / +2.8%
tpcds_q03/duckdb:parquet 8697498 / 8726826 / -0.3% 15918952 / 15895487 / +0.1% 0.55 / 0.55 / -0.5%
tpcds_q04/duckdb:parquet 127483268 / 127435346 / +0.0% 132618924 / 131795077 / +0.6% 0.96 / 0.97 / -0.6%
tpcds_q05/duckdb:parquet 21769577 / 21380982 / +1.8% 25453697 / 25922677 / -1.8% 0.86 / 0.82 / +3.7%
tpcds_q06/duckdb:parquet 26465183 / 26746958 / -1.1% 39140694 / 37099351 / +5.5% 0.68 / 0.72 / -6.2%
tpcds_q07/duckdb:parquet 15275740 / 15262952 / +0.1% 26528395 / 26055830 / +1.8% 0.58 / 0.59 / -1.7%
tpcds_q08/duckdb:parquet 25311506 / 25668402 / -1.4% 33343744 / 33460274 / -0.3% 0.76 / 0.77 / -1.0%
tpcds_q09/duckdb:parquet 19126561 / 18845854 / +1.5% 23607184 / 21894456 / +7.8% 0.81 / 0.86 / -5.9%
tpcds_q10/duckdb:parquet 27729734 / 27719191 / +0.0% 38686533 / 37759053 / +2.5% 0.72 / 0.73 / -2.4%
tpcds_q11/duckdb:parquet 71681688 / 71181890 / +0.7% 76503278 / 78994763 / -3.2% 0.94 / 0.90 / +4.0%
tpcds_q12/duckdb:parquet 12697854 / 12707596 / -0.1% 18017586 / 17359903 / +3.8% 0.70 / 0.73 / -3.7%
tpcds_q13/duckdb:parquet 23761166 / 23941733 / -0.8% 33059948 / 39333773 / -16.0% 🟢 0.72 / 0.61 / +18.1%
tpcds_q14/duckdb:parquet 60536673 / 60703586 / -0.3% 68084521 / 71191830 / -4.4% 0.89 / 0.85 / +4.3%
tpcds_q15/duckdb:parquet 25102531 / 24957040 / +0.6% 31387570 / 30795553 / +1.9% 0.80 / 0.81 / -1.3%
tpcds_q16/duckdb:parquet 19877500 / 20098979 / -1.1% 28956064 / 27921995 / +3.7% 0.69 / 0.72 / -4.6%
tpcds_q17/duckdb:parquet 32332668 / 32134993 / +0.6% 41381842 / 40574349 / +2.0% 0.78 / 0.79 / -1.3%
tpcds_q18/duckdb:parquet 38926788 / 39615626 / -1.7% 52156892 / 50202551 / +3.9% 0.75 / 0.79 / -5.4%
tpcds_q19/duckdb:parquet 24459780 / 25865102 / -5.4% 31834918 / 35497537 / -10.3% 🟢 0.77 / 0.73 / +5.4%
tpcds_q20/duckdb:parquet 13555160 / 13566776 / -0.1% 18632974 / 17815772 / +4.6% 0.73 / 0.76 / -4.5%
tpcds_q21/duckdb:parquet 9388892 / 9605931 / -2.3% 13072619 / 12908643 / +1.3% 0.72 / 0.74 / -3.5%
tpcds_q22/duckdb:parquet 35037460 / 34915558 / +0.3% 39707850 / 38836985 / +2.2% 0.88 / 0.90 / -1.9%
tpcds_q23/duckdb:parquet 40424952 / 40603944 / -0.4% 48643106 / 47593344 / +2.2% 0.83 / 0.85 / -2.6%
tpcds_q24/duckdb:parquet 33118282 / 33279720 / -0.5% 44114434 / 44350900 / -0.5% 0.75 / 0.75 / +0.0%
tpcds_q25/duckdb:parquet 29947505 / 30070326 / -0.4% 39708660 / 39578300 / +0.3% 0.75 / 0.76 / -0.7%
tpcds_q26/duckdb:parquet 30896162 / 31546068 / -2.1% 39252672 / 40615886 / -3.4% 0.79 / 0.78 / +1.3%
tpcds_q27/duckdb:parquet 31790422 / 32128526 / -1.1% 40846958 / 43726866 / -6.6% 0.78 / 0.73 / +5.9%
tpcds_q28/duckdb:parquet 17284396 / 17040462 / +1.4% 25114137 / 21599707 / +16.3% 🔴 0.69 / 0.79 / -12.8%
tpcds_q29/duckdb:parquet 30689809 / 30751530 / -0.2% 39344941 / 38745407 / +1.5% 0.78 / 0.79 / -1.7%
tpcds_q30/duckdb:parquet 32801033 / 33798509 / -3.0% 42240936 / 45035165 / -6.2% 0.78 / 0.75 / +3.5%
tpcds_q31/duckdb:parquet 20593772 / 21630488 / -4.8% 24601470 / 27668929 / -11.1% 🟢 0.84 / 0.78 / +7.1%
tpcds_q32/duckdb:parquet 11021180 / 11159186 / -1.2% 17598626 / 17475535 / +0.7% 0.63 / 0.64 / -1.9%
tpcds_q33/duckdb:parquet 16277662 / 15919042 / +2.3% 23544414 / 22825372 / +3.2% 0.69 / 0.70 / -0.9%
tpcds_q34/duckdb:parquet 15967286 / 16740047 / -4.6% 25012926 / 22436545 / +11.5% 🔴 0.64 / 0.75 / -14.4%
tpcds_q35/duckdb:parquet 46722696 / 47851832 / -2.4% 57203814 / 55866415 / +2.4% 0.82 / 0.86 / -4.6%
tpcds_q36/duckdb:parquet 15228965 / 15014140 / +1.4% 25447346 / 23150041 / +9.9% 0.60 / 0.65 / -7.7%
tpcds_q37/duckdb:parquet 11590533 / 13482123 / -14.0% 🟢 16791356 / 16508163 / +1.7% 0.69 / 0.82 / -15.5%
tpcds_q38/duckdb:parquet 26423273 / 26522598 / -0.4% 32651888 / 29483436 / +10.7% 🔴 0.81 / 0.90 / -10.0%
tpcds_q39/duckdb:parquet 24402163 / 24707215 / -1.2% 29897624 / 31686852 / -5.6% 0.82 / 0.78 / +4.7%
tpcds_q40/duckdb:parquet 15863174 / 15944883 / -0.5% 20947715 / 21125904 / -0.8% 0.76 / 0.75 / +0.3%
tpcds_q41/duckdb:parquet 7613567 / 10268143 / -25.9% 🟢 13466151 / 15808281 / -14.8% 🟢 0.57 / 0.65 / -13.0%
tpcds_q42/duckdb:parquet 8408654 / 8410119 / -0.0% 15373152 / 14619960 / +5.2% 0.55 / 0.58 / -4.9%
tpcds_q43/duckdb:parquet 10711126 / 10601022 / +1.0% 15929907 / 15355861 / +3.7% 0.67 / 0.69 / -2.6%
tpcds_q44/duckdb:parquet 16286774 / 16245904 / +0.3% 26581377 / 22368359 / +18.8% 🔴 0.61 / 0.73 / -15.6%
tpcds_q45/duckdb:parquet 23214880 / 23304017 / -0.4% 29497190 / 29859992 / -1.2% 0.79 / 0.78 / +0.8%
tpcds_q46/duckdb:parquet 37866854 / 36266682 / +4.4% 47870682 / 45473146 / +5.3% 0.79 / 0.80 / -0.8%
tpcds_q47/duckdb:parquet 32468414 / 32891756 / -1.3% 39708587 / 37248154 / +6.6% 0.82 / 0.88 / -7.4%
tpcds_q48/duckdb:parquet 20835526 / 21310342 / -2.2% 29103070 / 28214310 / +3.2% 0.72 / 0.76 / -5.2%
tpcds_q49/duckdb:parquet 18857842 / 18923718 / -0.3% 27981926 / 28708591 / -2.5% 0.67 / 0.66 / +2.2%
tpcds_q50/duckdb:parquet 17481742 / 18710498 / -6.6% 24945535 / 29925203 / -16.6% 🟢 0.70 / 0.63 / +12.1%
tpcds_q51/duckdb:parquet 53822380 / 53400597 / +0.8% 84203121 / 63254263 / +33.1% 🔴 0.64 / 0.84 / -24.3%
tpcds_q52/duckdb:parquet 8445762 / 8603280 / -1.8% 15535454 / 15217944 / +2.1% 0.54 / 0.57 / -3.8%
tpcds_q53/duckdb:parquet 11554092 / 11388516 / +1.5% 16904442 / 17011084 / -0.6% 0.68 / 0.67 / +2.1%
tpcds_q54/duckdb:parquet 20632248 / 20597508 / +0.2% 30367382 / 30236890 / +0.4% 0.68 / 0.68 / -0.3%
tpcds_q55/duckdb:parquet 8596334 / 8610430 / -0.2% 15208667 / 15119000 / +0.6% 0.57 / 0.57 / -0.8%
tpcds_q56/duckdb:parquet 16828624 / 16249792 / +3.6% 23359626 / 23586322 / -1.0% 0.72 / 0.69 / +4.6%
tpcds_q57/duckdb:parquet 28886166 / 28918634 / -0.1% 34486959 / 34396235 / +0.3% 0.84 / 0.84 / -0.4%
tpcds_q58/duckdb:parquet 18266395 / 18315076 / -0.3% 28377179 / 25929345 / +9.4% 0.64 / 0.71 / -8.9%
tpcds_q59/duckdb:parquet 21567852 / 20016616 / +7.7% 24878440 / 25833903 / -3.7% 0.87 / 0.77 / +11.9%
tpcds_q60/duckdb:parquet 16714790 / 17214026 / -2.9% 28903565 / 24319888 / +18.8% 🔴 0.58 / 0.71 / -18.3%
tpcds_q61/duckdb:parquet 21838242 / 21701258 / +0.6% 28594533 / 29371714 / -2.6% 0.76 / 0.74 / +3.4%
tpcds_q62/duckdb:parquet 10763354 / 10825700 / -0.6% 15130279 / 14610787 / +3.6% 0.71 / 0.74 / -4.0%
tpcds_q63/duckdb:parquet 10981746 / 11036888 / -0.5% 18441385 / 16480242 / +11.9% 🔴 0.60 / 0.67 / -11.1%
tpcds_q64/duckdb:parquet 52486424 / 52858096 / -0.7% 65778279 / 70192901 / -6.3% 0.80 / 0.75 / +6.0%
tpcds_q65/duckdb:parquet 14575996 / 15821623 / -7.9% 21128621 / 21080130 / +0.2% 0.69 / 0.75 / -8.1%
tpcds_q66/duckdb:parquet 24593424 / 24786574 / -0.8% 30494555 / 30940761 / -1.4% 0.81 / 0.80 / +0.7%
tpcds_q67/duckdb:parquet 76979818 / 77742174 / -1.0% 85154293 / 88196782 / -3.4% 0.90 / 0.88 / +2.6%
tpcds_q68/duckdb:parquet 29435252 / 29344296 / +0.3% 41307843 / 42745994 / -3.4% 0.71 / 0.69 / +3.8%
tpcds_q69/duckdb:parquet 28763521 / 28549396 / +0.8% 39514227 / 40482778 / -2.4% 0.73 / 0.71 / +3.2%
tpcds_q70/duckdb:parquet 17014240 / 16284184 / +4.5% 26085245 / 23211368 / +12.4% 🔴 0.65 / 0.70 / -7.0%
tpcds_q71/duckdb:parquet 14756270 / 14835429 / -0.5% 20736411 / 27973316 / -25.9% 🟢 0.71 / 0.53 / +34.2%
tpcds_q72/duckdb:parquet 84388672 / 81713904 / +3.3% 86882392 / 87471517 / -0.7% 0.97 / 0.93 / +4.0%
tpcds_q73/duckdb:parquet 13475653 / 13312422 / +1.2% 19622850 / 19774141 / -0.8% 0.69 / 0.67 / +2.0%
tpcds_q74/duckdb:parquet 98524503 / 99068760 / -0.5% 105976441 / 106359606 / -0.4% 0.93 / 0.93 / -0.2%
tpcds_q75/duckdb:parquet 40025619 / 40559942 / -1.3% 50354651 / 50522731 / -0.3% 0.79 / 0.80 / -1.0%
tpcds_q76/duckdb:parquet 13610419 / 13965362 / -2.5% 22111082 / 20567409 / +7.5% 0.62 / 0.68 / -9.3%
tpcds_q77/duckdb:parquet 16618218 / 16731664 / -0.7% 24602708 / 26026600 / -5.5% 0.68 / 0.64 / +5.1%
tpcds_q78/duckdb:parquet 48415225 / 48303170 / +0.2% 52961022 / 54714371 / -3.2% 0.91 / 0.88 / +3.6%
tpcds_q79/duckdb:parquet 20568544 / 20507531 / +0.3% 28715297 / 29039482 / -1.1% 0.72 / 0.71 / +1.4%
tpcds_q80/duckdb:parquet 31492608 / 31454994 / +0.1% 38903286 / 40217150 / -3.3% 0.81 / 0.78 / +3.5%
tpcds_q81/duckdb:parquet 29904474 / 29910051 / -0.0% 39875435 / 40090064 / -0.5% 0.75 / 0.75 / +0.5%
tpcds_q82/duckdb:parquet 12690859 / 13799418 / -8.0% 20666018 / 19865711 / +4.0% 0.61 / 0.69 / -11.6%
tpcds_q83/duckdb:parquet 16002732 / 15631995 / +2.4% 20087149 / 20563794 / -2.3% 0.80 / 0.76 / +4.8%
tpcds_q84/duckdb:parquet 17531073 / 18406704 / -4.8% 23688476 / 23503714 / +0.8% 0.74 / 0.78 / -5.5%
tpcds_q85/duckdb:parquet 34646058 / 34558891 / +0.3% 45410876 / 45323347 / +0.2% 0.76 / 0.76 / +0.1%
tpcds_q86/duckdb:parquet 10829378 / 13526972 / -19.9% 🟢 19100003 / 17727848 / +7.7% 0.57 / 0.76 / -25.7%
tpcds_q87/duckdb:parquet 28258401 / 28272938 / -0.1% 32715748 / 32032555 / +2.1% 0.86 / 0.88 / -2.1%
tpcds_q88/duckdb:parquet 26743046 / 27691900 / -3.4% 30988983 / 32822185 / -5.6% 0.86 / 0.84 / +2.3%
tpcds_q89/duckdb:parquet 12646700 / 12940780 / -2.3% 19029156 / 18260692 / +4.2% 0.66 / 0.71 / -6.2%
tpcds_q90/duckdb:parquet 7849518 / 6935350 / +13.2% 🔴 14210309 / 11196587 / +26.9% 🔴 0.55 / 0.62 / -10.8%
tpcds_q91/duckdb:parquet 20879676 / 20796389 / +0.4% 30142818 / 29024150 / +3.9% 0.69 / 0.72 / -3.3%
tpcds_q92/duckdb:parquet 11532598 / 11347676 / +1.6% 18962338 / 17684358 / +7.2% 0.61 / 0.64 / -5.2%
tpcds_q93/duckdb:parquet 21275248 / 21386518 / -0.5% 32715026 / 28960152 / +13.0% 🔴 0.65 / 0.74 / -11.9%
tpcds_q94/duckdb:parquet 15729952 / 15928124 / -1.2% 24936781 / 28435358 / -12.3% 🟢 0.63 / 0.56 / +12.6%
tpcds_q95/duckdb:parquet 89455992 / 89788770 / -0.4% 95737933 / 97927599 / -2.2% 0.93 / 0.92 / +1.9%
tpcds_q96/duckdb:parquet 7045109 / 6929343 / +1.7% 11090294 / 10815650 / +2.5% 0.64 / 0.64 / -0.8%
tpcds_q97/duckdb:parquet 25860476 / 25732818 / +0.5% 32100123 / 34130479 / -5.9% 0.81 / 0.75 / +6.9%
tpcds_q98/duckdb:parquet 14959567 / 14984405 / -0.2% 21957709 / 22450049 / -2.2% 0.68 / 0.67 / +2.1%
tpcds_q99/duckdb:parquet 17334428 / 17311944 / +0.1% 21845387 / 21342992 / +2.4% 0.79 / 0.81 / -2.2%

File Size Changes (48 files changed, +2.4% overall, 48↑ 0↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 46.10 KB 304.62 KB +258.52 KB +560.8%
store.vortex 1.0 vortex-compact 41.98 KB 265.84 KB +223.85 KB +533.2%
call_center.vortex 1.0 vortex-file-compressed 52.39 KB 323.46 KB +271.07 KB +517.4%
household_demographics.vortex 1.0 vortex-compact 9.72 KB 58.59 KB +48.87 KB +502.8%
web_site.vortex 1.0 vortex-compact 41.19 KB 248.11 KB +206.91 KB +502.3%
warehouse.vortex 1.0 vortex-compact 21.71 KB 125.89 KB +104.18 KB +479.9%
store.vortex 1.0 vortex-file-compressed 47.99 KB 276.20 KB +228.20 KB +475.5%
web_page.vortex 1.0 vortex-compact 23.91 KB 134.48 KB +110.56 KB +462.3%
ship_mode.vortex 1.0 vortex-compact 10.56 KB 59.11 KB +48.55 KB +459.8%
income_band.vortex 1.0 vortex-compact 5.14 KB 28.21 KB +23.07 KB +449.1%
warehouse.vortex 1.0 vortex-file-compressed 23.66 KB 126.78 KB +103.12 KB +435.8%
income_band.vortex 1.0 vortex-file-compressed 5.35 KB 28.25 KB +22.90 KB +428.2%
web_page.vortex 1.0 vortex-file-compressed 29.44 KB 152.38 KB +122.95 KB +417.6%
web_site.vortex 1.0 vortex-file-compressed 53.72 KB 272.32 KB +218.59 KB +406.9%
reason.vortex 1.0 vortex-compact 5.79 KB 28.32 KB +22.53 KB +388.9%
ship_mode.vortex 1.0 vortex-file-compressed 13.14 KB 64.14 KB +51.00 KB +388.2%
promotion.vortex 1.0 vortex-compact 50.96 KB 220.98 KB +170.02 KB +333.6%
household_demographics.vortex 1.0 vortex-file-compressed 16.20 KB 62.85 KB +46.65 KB +287.9%
reason.vortex 1.0 vortex-file-compressed 7.49 KB 28.77 KB +21.28 KB +284.2%
promotion.vortex 1.0 vortex-file-compressed 59.94 KB 230.20 KB +170.27 KB +284.1%
date_dim.vortex 1.0 vortex-compact 138.67 KB 377.39 KB +238.73 KB +172.2%
customer_demographics.vortex 1.0 vortex-compact 422.17 KB 837.79 KB +415.62 KB +98.4%
time_dim.vortex 1.0 vortex-compact 95.23 KB 185.16 KB +89.94 KB +94.4%
date_dim.vortex 1.0 vortex-file-compressed 910.61 KB 1.11 MB +227.20 KB +24.9%
catalog_page.vortex 1.0 vortex-compact 361.33 KB 436.82 KB +75.49 KB +20.9%
time_dim.vortex 1.0 vortex-file-compressed 441.29 KB 529.19 KB +87.90 KB +19.9%
customer_address.vortex 1.0 vortex-compact 638.19 KB 746.63 KB +108.45 KB +17.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.48 MB 1.73 MB +257.37 KB +17.0%
item.vortex 1.0 vortex-compact 998.46 KB 1.12 MB +152.61 KB +15.3%
catalog_page.vortex 1.0 vortex-file-compressed 585.52 KB 659.41 KB +73.90 KB +12.6%
customer_address.vortex 1.0 vortex-file-compressed 883.09 KB 984.41 KB +101.31 KB +11.5%
item.vortex 1.0 vortex-file-compressed 1.69 MB 1.84 MB +148.97 KB +8.6%
inventory.vortex 1.0 vortex-compact 16.06 MB 16.96 MB +917.80 KB +5.6%
web_returns.vortex 1.0 vortex-compact 2.99 MB 3.13 MB +143.99 KB +4.7%
web_returns.vortex 1.0 vortex-file-compressed 3.48 MB 3.62 MB +148.70 KB +4.2%
customer.vortex 1.0 vortex-compact 3.29 MB 3.42 MB +132.77 KB +3.9%
customer.vortex 1.0 vortex-file-compressed 4.29 MB 4.42 MB +136.72 KB +3.1%
inventory.vortex 1.0 vortex-file-compressed 36.63 MB 37.76 MB +1.13 MB +3.1%
catalog_returns.vortex 1.0 vortex-compact 6.03 MB 6.22 MB +184.88 KB +3.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.30 MB 7.51 MB +208.84 KB +2.8%
store_returns.vortex 1.0 vortex-compact 9.36 MB 9.52 MB +172.01 KB +1.8%
store_returns.vortex 1.0 vortex-file-compressed 11.12 MB 11.31 MB +193.44 KB +1.7%
web_sales.vortex 1.0 vortex-compact 29.43 MB 29.83 MB +412.59 KB +1.4%
web_sales.vortex 1.0 vortex-file-compressed 33.63 MB 34.02 MB +400.55 KB +1.2%
store_sales.vortex 1.0 vortex-compact 78.09 MB 78.94 MB +870.36 KB +1.1%
catalog_sales.vortex 1.0 vortex-file-compressed 69.36 MB 70.10 MB +766.44 KB +1.1%
catalog_sales.vortex 1.0 vortex-compact 59.44 MB 60.06 MB +626.30 KB +1.0%
store_sales.vortex 1.0 vortex-file-compressed 100.64 MB 101.37 MB +750.41 KB +0.7%

Totals:

  • vortex-compact: 207.81 MB → 213.43 MB (+2.7%)
  • vortex-file-compressed: 272.94 MB → 278.72 MB (+2.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.2%
Engines: DataFusion No clear signal (-10.8%, environment too noisy confidence) · DuckDB No clear signal (-7.5%, environment too noisy confidence)
Vortex (geomean): hot 0.879x ➖ · cold 0.916x ➖
Parquet (geomean): hot 0.968x ➖ · cold 0.940x ➖
Shifts: Parquet (control) -3.2% · Median polish -9.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.870x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 213767324 / 212495404 / +0.6% 577755218 / 912126946 / -36.7% 🟢 0.37 / 0.23 / +58.8%
tpch_q02/datafusion:vortex-file-compressed 301027961 / 329761572 / -8.7% 610562371 / 649541700 / -6.0% 0.49 / 0.51 / -2.9%
tpch_q03/datafusion:vortex-file-compressed 348225220 / 381705259 / -8.8% 993962743 / 1088939418 / -8.7% 0.35 / 0.35 / -0.1%
tpch_q04/datafusion:vortex-file-compressed 168417992 / 353322571 / -52.3% 🟢 397672726 / 529286015 / -24.9% 0.42 / 0.67 / -36.6%
tpch_q05/datafusion:vortex-file-compressed 422099563 / 423833929 / -0.4% 634191867 / 800711864 / -20.8% 0.67 / 0.53 / +25.7%
tpch_q06/datafusion:vortex-file-compressed 251091079 / 250258941 / +0.3% 403002322 / 500533749 / -19.5% 0.62 / 0.50 / +24.6%
tpch_q07/datafusion:vortex-file-compressed 417585571 / 376675474 / +10.9% 498590276 / 624919536 / -20.2% 0.84 / 0.60 / +38.9%
tpch_q08/datafusion:vortex-file-compressed 480210401 / 534616340 / -10.2% 562220547 / 608401986 / -7.6% 0.85 / 0.88 / -2.8%
tpch_q09/datafusion:vortex-file-compressed 326631984 / 458808694 / -28.8% 507465371 / 455973798 / +11.3% 0.64 / 1.01 / -36.0%
tpch_q10/datafusion:vortex-file-compressed 359181986 / 392851870 / -8.6% 560503698 / 588125858 / -4.7% 0.64 / 0.67 / -4.1%
tpch_q11/datafusion:vortex-file-compressed 298694081 / 265885417 / +12.3% 885277442 / 395433557 / +123.9% 🔴 0.34 / 0.67 / -49.8%
tpch_q12/datafusion:vortex-file-compressed 315743019 / 528284189 / -40.2% 🟢 433325808 / 716254598 / -39.5% 🟢 0.73 / 0.74 / -1.2%
tpch_q13/datafusion:vortex-file-compressed 148567703 / 158904654 / -6.5% 535984595 / 415349017 / +29.0% 0.28 / 0.38 / -27.5%
tpch_q14/datafusion:vortex-file-compressed 161854878 / 239950497 / -32.5% 🟢 308931574 / 332141698 / -7.0% 0.52 / 0.72 / -27.5%
tpch_q15/datafusion:vortex-file-compressed 277333402 / 313847765 / -11.6% 480959874 / 472455278 / +1.8% 0.58 / 0.66 / -13.2%
tpch_q16/datafusion:vortex-file-compressed 158549404 / 157261978 / +0.8% 340815202 / 293813506 / +16.0% 0.47 / 0.54 / -13.1%
tpch_q17/datafusion:vortex-file-compressed 366264794 / 341197056 / +7.3% 497627753 / 429489552 / +15.9% 0.74 / 0.79 / -7.4%
tpch_q18/datafusion:vortex-file-compressed 232666038 / 270082764 / -13.9% 371311221 / 420898783 / -11.8% 0.63 / 0.64 / -2.3%
tpch_q19/datafusion:vortex-file-compressed 380239308 / 456715140 / -16.7% 473300977 / 492213752 / -3.8% 0.80 / 0.93 / -13.4%
tpch_q20/datafusion:vortex-file-compressed 279654717 / 282574450 / -1.0% 448219722 / 435458262 / +2.9% 0.62 / 0.65 / -3.9%
tpch_q21/datafusion:vortex-file-compressed 472505840 / 571225163 / -17.3% 822544968 / 824560315 / -0.2% 0.57 / 0.69 / -17.1%
tpch_q22/datafusion:vortex-file-compressed 141427713 / 188218990 / -24.9% 362640334 / 321225366 / +12.9% 0.39 / 0.59 / -33.4%
datafusion / vortex-compact / ns (0.880x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 213829564 / 260315962 / -17.9% 663018102 / 810033291 / -18.1% 0.32 / 0.32 / +0.4%
tpch_q02/datafusion:vortex-compact 322194357 / 318957773 / +1.0% 654878160 / 717138638 / -8.7% 0.49 / 0.44 / +10.6%
tpch_q03/datafusion:vortex-compact 313024452 / 402865459 / -22.3% 1467064403 / 921781255 / +59.2% 🔴 0.21 / 0.44 / -51.2%
tpch_q04/datafusion:vortex-compact 166876917 / 217390455 / -23.2% 429594924 / 481104113 / -10.7% 0.39 / 0.45 / -14.0%
tpch_q05/datafusion:vortex-compact 375616737 / 414396696 / -9.4% 635654791 / 547241107 / +16.2% 0.59 / 0.76 / -22.0%
tpch_q06/datafusion:vortex-compact 261783355 / 280286588 / -6.6% 470627248 / 439365995 / +7.1% 0.56 / 0.64 / -12.8%
tpch_q07/datafusion:vortex-compact 392427860 / 406265291 / -3.4% 486683528 / 488238410 / -0.3% 0.81 / 0.83 / -3.1%
tpch_q08/datafusion:vortex-compact 452210968 / 410224929 / +10.2% 732361496 / 629323492 / +16.4% 0.62 / 0.65 / -5.3%
tpch_q09/datafusion:vortex-compact 433131278 / 663957640 / -34.8% 🟢 657092054 / 1268145420 / -48.2% 🟢 0.66 / 0.52 / +25.9%
tpch_q10/datafusion:vortex-compact 319191364 / 414919916 / -23.1% 449791779 / 494058866 / -9.0% 0.71 / 0.84 / -15.5%
tpch_q11/datafusion:vortex-compact 256251231 / 300304065 / -14.7% 403847006 / 422037147 / -4.3% 0.63 / 0.71 / -10.8%
tpch_q12/datafusion:vortex-compact 348028200 / 358540023 / -2.9% 822015989 / 590325445 / +39.2% 🔴 0.42 / 0.61 / -30.3%
tpch_q13/datafusion:vortex-compact 101703393 / 131884301 / -22.9% 321977389 / 418528288 / -23.1% 0.32 / 0.32 / +0.2%
tpch_q14/datafusion:vortex-compact 168016962 / 183302949 / -8.3% 288861911 / 320682078 / -9.9% 0.58 / 0.57 / +1.8%
tpch_q15/datafusion:vortex-compact 302082289 / 351359993 / -14.0% 507593881 / 520532573 / -2.5% 0.60 / 0.68 / -11.8%
tpch_q16/datafusion:vortex-compact 181182615 / 142419505 / +27.2% 253239391 / 280472054 / -9.7% 0.72 / 0.51 / +40.9%
tpch_q17/datafusion:vortex-compact 283704425 / 351218636 / -19.2% 428508974 / 579282050 / -26.0% 0.66 / 0.61 / +9.2%
tpch_q18/datafusion:vortex-compact 234798522 / 249005871 / -5.7% 412509884 / 524158987 / -21.3% 0.57 / 0.48 / +19.8%
tpch_q19/datafusion:vortex-compact 380691670 / 456356805 / -16.6% 495427382 / 566152477 / -12.5% 0.77 / 0.81 / -4.7%
tpch_q20/datafusion:vortex-compact 283027197 / 311032633 / -9.0% 405461232 / 440814737 / -8.0% 0.70 / 0.71 / -1.1%
tpch_q21/datafusion:vortex-compact 399007853 / 476677575 / -16.3% 549580640 / 603230629 / -8.9% 0.73 / 0.79 / -8.1%
tpch_q22/datafusion:vortex-compact 167056313 / 190608234 / -12.4% 365205299 / 388636379 / -6.0% 0.46 / 0.49 / -6.7%
datafusion / parquet / ns (0.981x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164360586 / 165898051 / -0.9% 494175485 / 548305944 / -9.9% 0.33 / 0.30 / +9.9%
tpch_q02/datafusion:parquet 259736350 / 305939681 / -15.1% 544965133 / 522837246 / +4.2% 0.48 / 0.59 / -18.5%
tpch_q03/datafusion:parquet 284796225 / 275962896 / +3.2% 790098097 / 744614676 / +6.1% 0.36 / 0.37 / -2.7%
tpch_q04/datafusion:parquet 132374774 / 164512906 / -19.5% 324690750 / 545844825 / -40.5% 🟢 0.41 / 0.30 / +35.3%
tpch_q05/datafusion:parquet 330151211 / 321614415 / +2.7% 568309222 / 515027020 / +10.3% 0.58 / 0.62 / -7.0%
tpch_q06/datafusion:parquet 136041536 / 132984475 / +2.3% 333973658 / 275628266 / +21.2% 0.41 / 0.48 / -15.6%
tpch_q07/datafusion:parquet 332842144 / 385492998 / -13.7% 449995190 / 543715897 / -17.2% 0.74 / 0.71 / +4.3%
tpch_q08/datafusion:parquet 406468636 / 420067618 / -3.2% 506125456 / 616234116 / -17.9% 0.80 / 0.68 / +17.8%
tpch_q09/datafusion:parquet 431247085 / 449952282 / -4.2% 681536716 / 562390399 / +21.2% 0.63 / 0.80 / -20.9%
tpch_q10/datafusion:parquet 365109634 / 369485600 / -1.2% 525660600 / 498000247 / +5.6% 0.69 / 0.74 / -6.4%
tpch_q11/datafusion:parquet 256942114 / 258472057 / -0.6% 406375382 / 442370111 / -8.1% 0.63 / 0.58 / +8.2%
tpch_q12/datafusion:parquet 171967045 / 189121813 / -9.1% 363928741 / 530961161 / -31.5% 🟢 0.47 / 0.36 / +32.7%
tpch_q13/datafusion:parquet 392990185 / 397936895 / -1.2% 513330129 / 583740302 / -12.1% 0.77 / 0.68 / +12.3%
tpch_q14/datafusion:parquet 156226216 / 160644279 / -2.8% 252834656 / 375994834 / -32.8% 🟢 0.62 / 0.43 / +44.6%
tpch_q15/datafusion:parquet 261611082 / 261740407 / -0.0% 439339271 / 462459131 / -5.0% 0.60 / 0.57 / +5.2%
tpch_q16/datafusion:parquet 104487523 / 108529039 / -3.7% 297867472 / 256471208 / +16.1% 0.35 / 0.42 / -17.1%
tpch_q17/datafusion:parquet 392506542 / 291988228 / +34.4% 🔴 757466208 / 430670965 / +75.9% 🔴 0.52 / 0.68 / -23.6%
tpch_q18/datafusion:parquet 387892715 / 406440887 / -4.6% 498923789 / 563818281 / -11.5% 0.78 / 0.72 / +7.8%
tpch_q19/datafusion:parquet 156411043 / 152184768 / +2.8% 319328854 / 287431304 / +11.1% 0.49 / 0.53 / -7.5%
tpch_q20/datafusion:parquet 280995460 / 279836185 / +0.4% 403356774 / 441966909 / -8.7% 0.70 / 0.63 / +10.0%
tpch_q21/datafusion:parquet 320418943 / 341769157 / -6.2% 450132995 / 654701592 / -31.2% 🟢 0.71 / 0.52 / +36.4%
tpch_q22/datafusion:parquet 167281013 / 154550679 / +8.2% 328122620 / 303312510 / +8.2% 0.51 / 0.51 / +0.1%
duckdb / vortex-file-compressed / ns (0.863x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 196906681 / 232124014 / -15.2% 247177796 / 346937658 / -28.8% 0.80 / 0.67 / +19.1%
tpch_q02/duckdb:vortex-file-compressed 365542621 / 402701759 / -9.2% 409837478 / 404297971 / +1.4% 0.89 / 1.00 / -10.5%
tpch_q03/duckdb:vortex-file-compressed 425923418 / 515177037 / -17.3% 473314952 / 784788858 / -39.7% 🟢 0.90 / 0.66 / +37.1%
tpch_q04/duckdb:vortex-file-compressed 229823706 / 399758894 / -42.5% 🟢 300514870 / 303155511 / -0.9% 0.76 / 1.32 / -42.0%
tpch_q05/duckdb:vortex-file-compressed 452715724 / 856420881 / -47.1% 🟢 472171772 / 617227298 / -23.5% 0.96 / 1.39 / -30.9%
tpch_q06/duckdb:vortex-file-compressed 287478600 / 297513617 / -3.4% 249862986 / 274731682 / -9.1% 1.15 / 1.08 / +6.2%
tpch_q07/duckdb:vortex-file-compressed 484507666 / 492705118 / -1.7% 493173280 / 541883231 / -9.0% 0.98 / 0.91 / +8.0%
tpch_q08/duckdb:vortex-file-compressed 589697469 / 666858296 / -11.6% 688815781 / 749955713 / -8.2% 0.86 / 0.89 / -3.7%
tpch_q09/duckdb:vortex-file-compressed 452022288 / 513928366 / -12.0% 452288977 / 568214713 / -20.4% 1.00 / 0.90 / +10.5%
tpch_q10/duckdb:vortex-file-compressed 483530935 / 496933929 / -2.7% 513686265 / 546767925 / -6.1% 0.94 / 0.91 / +3.6%
tpch_q11/duckdb:vortex-file-compressed 135289974 / 139720710 / -3.2% 150384293 / 207719811 / -27.6% 0.90 / 0.67 / +33.7%
tpch_q12/duckdb:vortex-file-compressed 468357153 / 648345851 / -27.8% 530960777 / 576992356 / -8.0% 0.88 / 1.12 / -21.5%
tpch_q13/duckdb:vortex-file-compressed 448790966 / 438960295 / +2.2% 444202455 / 428422769 / +3.7% 1.01 / 1.02 / -1.4%
tpch_q14/duckdb:vortex-file-compressed 225292374 / 255652658 / -11.9% 269663920 / 272616264 / -1.1% 0.84 / 0.94 / -10.9%
tpch_q15/duckdb:vortex-file-compressed 155556917 / 189090993 / -17.7% 200323575 / 250473164 / -20.0% 0.78 / 0.75 / +2.9%
tpch_q16/duckdb:vortex-file-compressed 188229290 / 174547463 / +7.8% 245675965 / 238114532 / +3.2% 0.77 / 0.73 / +4.5%
tpch_q17/duckdb:vortex-file-compressed 374254963 / 398503772 / -6.1% 470898856 / 429059537 / +9.8% 0.79 / 0.93 / -14.4%
tpch_q18/duckdb:vortex-file-compressed 338820283 / 464086519 / -27.0% 330128666 / 504851020 / -34.6% 🟢 1.03 / 0.92 / +11.6%
tpch_q19/duckdb:vortex-file-compressed 323867372 / 319192745 / +1.5% 374990986 / 348050799 / +7.7% 0.86 / 0.92 / -5.8%
tpch_q20/duckdb:vortex-file-compressed 365164410 / 393306059 / -7.2% 413685093 / 411405952 / +0.6% 0.88 / 0.96 / -7.7%
tpch_q21/duckdb:vortex-file-compressed 598170318 / 716463367 / -16.5% 592282071 / 790013682 / -25.0% 1.01 / 0.91 / +11.4%
tpch_q22/duckdb:vortex-file-compressed 126406539 / 134885337 / -6.3% 176047883 / 130946415 / +34.4% 🔴 0.72 / 1.03 / -30.3%
duckdb / vortex-compact / ns (0.904x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 208771718 / 202071117 / +3.3% 225864083 / 424328020 / -46.8% 🟢 0.92 / 0.48 / +94.1%
tpch_q02/duckdb:vortex-compact 355083111 / 357087082 / -0.6% 385395518 / 567903309 / -32.1% 🟢 0.92 / 0.63 / +46.5%
tpch_q03/duckdb:vortex-compact 400184464 / 413412338 / -3.2% 494125117 / 605113653 / -18.3% 0.81 / 0.68 / +18.5%
tpch_q04/duckdb:vortex-compact 217816067 / 303759372 / -28.3% 247529708 / 513899327 / -51.8% 🟢 0.88 / 0.59 / +48.9%
tpch_q05/duckdb:vortex-compact 354262914 / 465669778 / -23.9% 394289311 / 438676865 / -10.1% 0.90 / 1.06 / -15.4%
tpch_q06/duckdb:vortex-compact 282791165 / 292363566 / -3.3% 303588162 / 282502958 / +7.5% 0.93 / 1.03 / -10.0%
tpch_q07/duckdb:vortex-compact 403246800 / 443900065 / -9.2% 489323691 / 493277835 / -0.8% 0.82 / 0.90 / -8.4%
tpch_q08/duckdb:vortex-compact 497240475 / 561157149 / -11.4% 508989408 / 546543394 / -6.9% 0.98 / 1.03 / -4.9%
tpch_q09/duckdb:vortex-compact 432472196 / 509827363 / -15.2% 497524522 / 526804990 / -5.6% 0.87 / 0.97 / -10.2%
tpch_q10/duckdb:vortex-compact 396632593 / 466466667 / -15.0% 461180791 / 776985053 / -40.6% 🟢 0.86 / 0.60 / +43.3%
tpch_q11/duckdb:vortex-compact 135662131 / 137234465 / -1.1% 154909492 / 153133939 / +1.2% 0.88 / 0.90 / -2.3%
tpch_q12/duckdb:vortex-compact 445611988 / 545693067 / -18.3% 672110218 / 523457593 / +28.4% 0.66 / 1.04 / -36.4%
tpch_q13/duckdb:vortex-compact 224443056 / 230960391 / -2.8% 343218133 / 301046170 / +14.0% 0.65 / 0.77 / -14.8%
tpch_q14/duckdb:vortex-compact 242682577 / 242206407 / +0.2% 265713780 / 308551261 / -13.9% 0.91 / 0.78 / +16.3%
tpch_q15/duckdb:vortex-compact 144960806 / 206479006 / -29.8% 177645082 / 214233056 / -17.1% 0.82 / 0.96 / -15.3%
tpch_q16/duckdb:vortex-compact 176672903 / 174004147 / +1.5% 240323764 / 200006343 / +20.2% 0.74 / 0.87 / -15.5%
tpch_q17/duckdb:vortex-compact 369593529 / 401502520 / -7.9% 377333139 / 466031932 / -19.0% 0.98 / 0.86 / +13.7%
tpch_q18/duckdb:vortex-compact 321718897 / 310436315 / +3.6% 292417163 / 332680882 / -12.1% 1.10 / 0.93 / +17.9%
tpch_q19/duckdb:vortex-compact 391095762 / 437080733 / -10.5% 372431435 / 345789848 / +7.7% 1.05 / 1.26 / -16.9%
tpch_q20/duckdb:vortex-compact 347832007 / 364460304 / -4.6% 372023169 / 423391061 / -12.1% 0.93 / 0.86 / +8.6%
tpch_q21/duckdb:vortex-compact 528270339 / 693487082 / -23.8% 600450029 / 764202628 / -21.4% 0.88 / 0.91 / -3.0%
tpch_q22/duckdb:vortex-compact 110929032 / 108358155 / +2.4% 152902541 / 139191639 / +9.9% 0.73 / 0.78 / -6.8%
duckdb / parquet / ns (0.955x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 300888005 / 344941437 / -12.8% 316418587 / 320265021 / -1.2% 0.95 / 1.08 / -11.7%
tpch_q02/duckdb:parquet 660834831 / 654682727 / +0.9% 758942276 / 733454300 / +3.5% 0.87 / 0.89 / -2.5%
tpch_q03/duckdb:parquet 762915433 / 723972392 / +5.4% 878346924 / 1297299087 / -32.3% 🟢 0.87 / 0.56 / +55.6%
tpch_q04/duckdb:parquet 438447554 / 496175221 / -11.6% 501222263 / 512886329 / -2.3% 0.87 / 0.97 / -9.6%
tpch_q05/duckdb:parquet 908530809 / 1027529072 / -11.6% 986315800 / 1107983499 / -11.0% 0.92 / 0.93 / -0.7%
tpch_q06/duckdb:parquet 294640899 / 306555085 / -3.9% 310097338 / 363582457 / -14.7% 0.95 / 0.84 / +12.7%
tpch_q07/duckdb:parquet 837027099 / 1003962975 / -16.6% 830867945 / 998462609 / -16.8% 1.01 / 1.01 / +0.2%
tpch_q08/duckdb:parquet 1038875828 / 1012923219 / +2.6% 1095958713 / 1102791371 / -0.6% 0.95 / 0.92 / +3.2%
tpch_q09/duckdb:parquet 991361358 / 1091185309 / -9.1% 932225189 / 978344359 / -4.7% 1.06 / 1.12 / -4.7%
tpch_q10/duckdb:parquet 969464687 / 980605105 / -1.1% 930423354 / 1017561510 / -8.6% 1.04 / 0.96 / +8.1%
tpch_q11/duckdb:parquet 446816004 / 424153349 / +5.3% 441455871 / 589605628 / -25.1% 1.01 / 0.72 / +40.7%
tpch_q12/duckdb:parquet 506240330 / 536870845 / -5.7% 816615762 / 666733990 / +22.5% 0.62 / 0.81 / -23.0%
tpch_q13/duckdb:parquet 763505797 / 770696008 / -0.9% 853649726 / 936662022 / -8.9% 0.89 / 0.82 / +8.7%
tpch_q14/duckdb:parquet 488077207 / 546435974 / -10.7% 534241895 / 668121779 / -20.0% 0.91 / 0.82 / +11.7%
tpch_q15/duckdb:parquet 395230974 / 525618307 / -24.8% 359615958 / 331828246 / +8.4% 1.10 / 1.58 / -30.6%
tpch_q16/duckdb:parquet 480563337 / 477624322 / +0.6% 529066993 / 470422882 / +12.5% 0.91 / 1.02 / -10.5%
tpch_q17/duckdb:parquet 490043752 / 452906248 / +8.2% 486678043 / 435268133 / +11.8% 1.01 / 1.04 / -3.2%
tpch_q18/duckdb:parquet 652977782 / 698670045 / -6.5% 648908833 / 599644157 / +8.2% 1.01 / 1.17 / -13.6%
tpch_q19/duckdb:parquet 590474816 / 552354905 / +6.9% 652579584 / 677334843 / -3.7% 0.90 / 0.82 / +11.0%
tpch_q20/duckdb:parquet 795804586 / 860949261 / -7.6% 812736417 / 1167285367 / -30.4% 🟢 0.98 / 0.74 / +32.8%
tpch_q21/duckdb:parquet 700221375 / 715282074 / -2.1% 680703908 / 807227773 / -15.7% 1.03 / 0.89 / +16.1%
tpch_q22/duckdb:parquet 415477956 / 397359298 / +4.6% 413139363 / 422630633 / -2.2% 1.01 / 0.94 / +7.0%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 95c4954a vs base c93f5a9a
Verdict: Likely regression (high confidence)
Attributed Vortex impact: +416.6%
Engines: random-access Likely regression (+416.6%, high confidence)
Vortex (geomean): hot 5.083x ❌
Parquet (geomean): hot 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish +144.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.878x ✅, 7↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 67141 / 74138 / -9.4%
random-access/arrow-tokio-local-disk-footer 160978 / 166792 / -3.5%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1334731 / 2502246 / -46.7% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2073759 / 2097099 / -1.1%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 32816103 / 54090475 / -39.3% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 32924437 / 32201747 / +2.2%
random-access/nested-lists/correlated/arrow-tokio-local-disk 57862 / 62489 / -7.4%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 100847 / 109694 / -8.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1083031 / 1128498 / -4.0%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1135631 / 1241735 / -8.5%
random-access/nested-structs/correlated/arrow-tokio-local-disk 50890 / 56989 / -10.7% 🟢
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 87336 / 98180 / -11.0% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk 859594 / 954305 / -9.9%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 894190 / 1001935 / -10.8% 🟢
random-access/taxi/correlated/arrow-tokio-local-disk 115102 / 123709 / -7.0%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 215769 / 223929 / -3.6%
random-access/taxi/uniform/arrow-tokio-local-disk 2531730 / 2898817 / -12.7% 🟢
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2725223 / 3042527 / -10.4% 🟢
random-access / vortex-file-compressed / ns (5.083x ❌, 0↑ 18↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3747256 / 246051 / +1423.0% 🔴
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1817176 / 1245389 / +45.9% 🔴
random-access/feature-vectors/uniform/vortex-tokio-local-disk 7892454 / 1460723 / +440.3% 🔴
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 8049616 / 2712027 / +196.8% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk 4736065 / 228962 / +1968.5% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 889821 / 390856 / +127.7% 🔴
random-access/nested-lists/uniform/vortex-tokio-local-disk 7060565 / 750444 / +840.9% 🔴
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 7379095 / 982525 / +651.0% 🔴
random-access/nested-structs/correlated/vortex-tokio-local-disk 4678916 / 276552 / +1591.9% 🔴
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 1419711 / 525403 / +170.2% 🔴
random-access/nested-structs/uniform/vortex-tokio-local-disk 6876889 / 633029 / +986.3% 🔴
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 7149609 / 935500 / +664.3% 🔴
random-access/taxi/correlated/vortex-tokio-local-disk 4938362 / 685794 / +620.1% 🔴
random-access/taxi/correlated/vortex-tokio-local-disk-footer 2851886 / 1441517 / +97.8% 🔴
random-access/taxi/uniform/vortex-tokio-local-disk 7098154 / 2626503 / +170.3% 🔴
random-access/taxi/uniform/vortex-tokio-local-disk-footer 8520994 / 3864560 / +120.5% 🔴
random-access/vortex-tokio-local-disk 3652150 / 455963 / +701.0% 🔴
random-access/vortex-tokio-local-disk-footer 1842201 / 1098276 / +67.7% 🔴
random-access / parquet / ns (0.984x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 103612940229 / 103855780644 / -0.2%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 104123640294 / 103864529848 / +0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 103882644308 / 109841839881 / -5.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 104112515071 / 103858934719 / +0.2%
random-access/nested-lists/correlated/parquet-tokio-local-disk 132151903 / 132934703 / -0.6%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 130995097 / 131984566 / -0.7%
random-access/nested-lists/uniform/parquet-tokio-local-disk 131352123 / 133490005 / -1.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 131214705 / 133690341 / -1.9%
random-access/nested-structs/correlated/parquet-tokio-local-disk 7294846 / 7219715 / +1.0%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 7803190 / 8325871 / -6.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk 7619816 / 7451982 / +2.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 7497107 / 7825121 / -4.2%
random-access/parquet-tokio-local-disk 118439535 / 123223410 / -3.9%
random-access/parquet-tokio-local-disk-footer 118336297 / 118945783 / -0.5%
random-access/taxi/correlated/parquet-tokio-local-disk 177515380 / 184368428 / -3.7%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 177508835 / 178420187 / -0.5%
random-access/taxi/uniform/parquet-tokio-local-disk 187465629 / 192123540 / -2.4%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 187351468 / 188053360 / -0.4%
random-access / lance / ns (0.985x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 283161 / 284073 / -0.3%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1234368 / 1268759 / -2.7%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1016025 / 1023262 / -0.7%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2008465 / 2021912 / -0.7%
random-access/lance-tokio-local-disk 512844 / 525814 / -2.5%
random-access/lance-tokio-local-disk-footer 1423049 / 1410340 / +0.9%
random-access/nested-lists/correlated/lance-tokio-local-disk 153652 / 156724 / -2.0%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 692428 / 713436 / -2.9%
random-access/nested-lists/uniform/lance-tokio-local-disk 857351 / 883182 / -2.9%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1397450 / 1408773 / -0.8%
random-access/nested-structs/correlated/lance-tokio-local-disk 271355 / 276261 / -1.8%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 618860 / 637723 / -3.0%
random-access/nested-structs/uniform/lance-tokio-local-disk 2322319 / 2361781 / -1.7%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2700447 / 2817947 / -4.2%
random-access/taxi/correlated/lance-tokio-local-disk 745661 / 737380 / +1.1%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1914121 / 1948907 / -1.8%
random-access/taxi/uniform/lance-tokio-local-disk 8108328 / 8129926 / -0.3%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8959517 / 9006521 / -0.5%

`Grouped` moved any segment that would straddle a block boundary, including
segments larger than a block. That was the wrong rule, and it cost most of
what the policy was supposed to save.

Straddling costs a sub-block segment a whole extra block -- it goes from
touching one to touching two, a 100% penalty -- so moving it is worth up to a
block of padding. A segment already a block or more long touches
`ceil(len / block)` blocks, and a straddle adds at most one to that: 1/3 for
an 8 KiB segment, 1/256 for a megabyte. Paying up to a block of padding to
avoid it is a bad trade, and it is the trade that dominates real files,
because the large segments are where the bytes are.

Measured on the wide-table shape from `compress-bench` (100 list<i64> columns
x 1000 rows, which writes exactly two segments per column: a 156-byte offsets
segment and an 8372-byte elements segment):

  policy          file size    growth
  none              878 968     0.00%
  grouped (was)   1 270 704   +44.57%
  grouped (now)     879 408    +0.05%
  always          1 663 920   +89.30%

The old rule pushed every 8372-byte segment to a block boundary and burned
3.9 KiB doing it, which bought nothing: 8372 bytes spans three blocks whether
it starts at offset 0 or offset 156. The new rule leaves it packed and still
keeps every 156-byte segment inside a single block, turning the wide-table
cost of block alignment from +89.30% into +0.05%.

The `grouped` versus `always` padding ratio on a uniform sub-block
distribution is unchanged at 1/3, since the restriction only affects segments
at least a block long.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU

Copy link
Copy Markdown
Contributor Author

Clearing an accidental disapproval — this is not an approval.

policy-bot: develop is red with "Disapproved by joseph-isaacs". Nobody disapproved this PR. The trigger is a literal substring match: policy.yml treats a hyphen followed by the digit one, appearing anywhere in a comment body, as a disapproval vote. My earlier comment about the EC2 Spot interruptions spelled out AWS availability zone names, which contain exactly that sequence. That comment was the vote.

This comment carries the revoke token, so the status clears.

It cannot count as an approval: approval_defaults.options.allow_author: false excludes the author's own vote. This PR still needs one committer approval, exactly as it did before.

👍


Generated by Claude Code

Copy link
Copy Markdown
Contributor Author

👍

(Revoke token for the comment above, as a literal character this time — the previous one was written as an HTML entity, which policy-bot's raw-body match does not see. Still not an approval: allow_author: false.)


Generated by Claude Code

@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 14, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants