duckdb: use zone maps for min/max/sum aggregations - #9041
Conversation
9258cf6 to
e7c427d
Compare
e7c427d to
21b602d
Compare
Merging this PR will not alter performance
Comparing Footnotes
|
Polar Signals Profiling ResultsLatest Run
Previous Runs (13)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals Profiling 📖Vortex (geomean): 0.966x ➖ How to read Verdict and Engines
datafusion / vortex-file-compressed (0.966x ➖, 2↑ 0↓)
No file size changes detected. |
Benchmarks: TPC-H SF=1 on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
datafusion / parquet (0.976x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
duckdb / parquet (0.982x ➖, 1↑ 0↓)
File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
Totals:
|
21b602d to
e7c427d
Compare
e7c427d to
6cdbd4b
Compare
Benchmarks: FineWeb NVMe 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)
datafusion / parquet (1.029x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
duckdb / parquet (1.020x ➖, 0↑ 0↓)
No file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.994x ➖, 0↑ 0↓)
datafusion / parquet (0.933x ➖, 18↑ 0↓)
duckdb / vortex-file-compressed (0.973x ➖, 9↑ 1↓)
duckdb / vortex-compact (1.009x ➖, 1↑ 1↓)
duckdb / parquet (0.982x ➖, 3↑ 0↓)
duckdb / duckdb (1.021x ➖, 0↑ 2↓)
No file size changes detected. |
Benchmarks: FineWeb S3 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.971x ➖, 0↑ 0↓)
datafusion / parquet (0.955x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.948x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.937x ➖, 0↑ 0↓)
duckdb / parquet (0.982x ➖, 0↑ 0↓)
|
Benchmarks: Statistical and Population Genetics 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
duckdb / vortex-file-compressed (1.071x ➖, 0↑ 4↓)
duckdb / vortex-compact (1.092x ➖, 0↑ 5↓)
duckdb / parquet (1.076x ➖, 0↑ 2↓)
No file size changes detected. |
Benchmarks: Clickbench Sorted on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.951x ➖, 3↑ 1↓)
datafusion / parquet (0.919x ➖, 4↑ 0↓)
duckdb / vortex-file-compressed (0.901x ➖, 4↑ 0↓)
duckdb / parquet (0.929x ➖, 2↑ 0↓)
duckdb / duckdb (0.952x ➖, 0↑ 0↓)
File Size Changes (201 files changed, -0.0% overall, 102↑ 99↓)
Totals:
|
Benchmarks: TPC-H SF=10 on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.075x ➖, 0↑ 6↓)
datafusion / vortex-compact (1.059x ➖, 0↑ 1↓)
datafusion / parquet (1.054x ➖, 0↑ 3↓)
duckdb / vortex-file-compressed (1.059x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.047x ➖, 0↑ 0↓)
duckdb / parquet (1.023x ➖, 0↑ 1↓)
duckdb / duckdb (1.031x ➖, 0↑ 1↓)
No file size changes detected. |
Benchmarks: Clickbench on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.966x ➖, 0↑ 0↓)
datafusion / parquet (0.968x ➖, 3↑ 1↓)
duckdb / vortex-file-compressed (0.972x ➖, 4↑ 2↓)
duckdb / parquet (0.993x ➖, 0↑ 0↓)
duckdb / duckdb (1.004x ➖, 0↑ 0↓)
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: TPC-H SF=1 on S3 📖Verdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
datafusion / parquet (1.043x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
duckdb / parquet (0.990x ➖, 0↑ 0↓)
|
Benchmarks: Appian on NVME 📖Verdict: No clear signal (low confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
datafusion / parquet (0.988x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
duckdb / parquet (1.000x ➖, 0↑ 0↓)
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: TPC-H SF=10 on S3 📖Verdict: No clear signal (environment too noisy confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.071x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
datafusion / parquet (0.996x ➖, 1↑ 1↓)
duckdb / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.988x ➖, 0↑ 0↓)
duckdb / parquet (1.041x ➖, 0↑ 0↓)
|
Benchmarks: Vortex queries 📖Verdict: Likely improvement (medium confidence) How to read Verdict and Engines
datafusion / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
datafusion / parquet (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.176x ✅, 3↑ 0↓)
duckdb / parquet (1.001x ➖, 0↑ 0↓)
No file size changes detected. |
6cdbd4b to
e7c427d
Compare
e7c427d to
f28ca6c
Compare
f28ca6c to
a82ba5a
Compare
a82ba5a to
f28ca6c
Compare
e2cd937 to
344c1ff
Compare
344c1ff to
9309590
Compare
9309590 to
b9c1b7e
Compare
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
b9c1b7e to
922d4f1
Compare
Get info from zone maps for min/max/sum instead of aggregating in table function. If any aggregate can't read zone maps (like mean), use current accumulation route.