Skip to content

run compress bench in parallel#7265

Draft
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/compress-parallel-bench
Draft

run compress bench in parallel#7265
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/compress-parallel-bench

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@joseph-isaacs joseph-isaacs changed the title wip run compress bench in parallel Apr 2, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4ebf4f4 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 4ebf4f4 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

BENCHMARK FAILED

Benchmark Compression (other) failed! Check the workflow run for details.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 2, 2026

Merging this PR will improve performance by 11.62%

⚡ 1 improved benchmark
✅ 1121 untouched benchmarks
⏩ 1530 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(1000, 10)] 72.9 µs 65.3 µs +11.62%

Comparing ji/compress-parallel-bench (6d84c8d) with develop (38ab5af)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.038x ➖


datafusion / vortex-file-compressed (1.038x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129962322 126300187 1.03
polarsignals_q01/datafusion:vortex-file-compressed 384835751 376353843 1.02
polarsignals_q02/datafusion:vortex-file-compressed 23609614 22718881 1.04
polarsignals_q03/datafusion:vortex-file-compressed 395983707 377657148 1.05
polarsignals_q04/datafusion:vortex-file-compressed 11845505 10823840 1.09
polarsignals_q05/datafusion:vortex-file-compressed 16516579 15378771 1.07
polarsignals_q06/datafusion:vortex-file-compressed 19407435 18513625 1.05
polarsignals_q07/datafusion:vortex-file-compressed 13566279 13401606 1.01
polarsignals_q08/datafusion:vortex-file-compressed 477349103 463357706 1.03
polarsignals_q09/datafusion:vortex-file-compressed 10423698 10621527 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.9%
Vortex (geomean): 1.105x ❌
Parquet (geomean): 1.042x ➖
Shifts: Parquet (control) +4.2% · Median polish +7.0%


datafusion / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48235702 50201468 0.96
tpch_q02/datafusion:vortex-file-compressed 34522093 33509251 1.03
tpch_q03/datafusion:vortex-file-compressed 27224443 29329487 0.93
tpch_q04/datafusion:vortex-file-compressed 18527664 19421660 0.95
tpch_q05/datafusion:vortex-file-compressed 55508516 53903049 1.03
tpch_q06/datafusion:vortex-file-compressed 11327128 10333435 1.10
tpch_q07/datafusion:vortex-file-compressed 64010483 61929719 1.03
tpch_q08/datafusion:vortex-file-compressed 47115431 44742470 1.05
tpch_q09/datafusion:vortex-file-compressed 57290478 54364106 1.05
tpch_q10/datafusion:vortex-file-compressed 45139258 45811364 0.99
tpch_q11/datafusion:vortex-file-compressed 18360605 17848255 1.03
tpch_q12/datafusion:vortex-file-compressed 23089601 22702601 1.02
tpch_q13/datafusion:vortex-file-compressed 28245254 28262111 1.00
tpch_q14/datafusion:vortex-file-compressed 16522408 15620124 1.06
tpch_q15/datafusion:vortex-file-compressed 24684223 24656386 1.00
tpch_q16/datafusion:vortex-file-compressed 26215991 24289406 1.08
tpch_q17/datafusion:vortex-file-compressed 66836204 63775027 1.05
tpch_q18/datafusion:vortex-file-compressed 81564831 79828186 1.02
tpch_q19/datafusion:vortex-file-compressed 22735103 22004200 1.03
tpch_q20/datafusion:vortex-file-compressed 33549645 34481512 0.97
tpch_q21/datafusion:vortex-file-compressed 79865535 73686696 1.08
tpch_q22/datafusion:vortex-file-compressed 🚨 18712212 15648108 1.20
datafusion / vortex-compact (1.097x ➖, 0↑ 9↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63898011 59179082 1.08
tpch_q02/datafusion:vortex-compact 38527413 36082583 1.07
tpch_q03/datafusion:vortex-compact 31845590 32335271 0.98
tpch_q04/datafusion:vortex-compact 24133657 23290940 1.04
tpch_q05/datafusion:vortex-compact 58246242 55045867 1.06
tpch_q06/datafusion:vortex-compact 🚨 15130759 13608033 1.11
tpch_q07/datafusion:vortex-compact 71921295 70700175 1.02
tpch_q08/datafusion:vortex-compact 50732200 49087865 1.03
tpch_q09/datafusion:vortex-compact 🚨 70619753 60977255 1.16
tpch_q10/datafusion:vortex-compact 🚨 68893966 53816440 1.28
tpch_q11/datafusion:vortex-compact 21384928 19972236 1.07
tpch_q12/datafusion:vortex-compact 33877614 33142646 1.02
tpch_q13/datafusion:vortex-compact 36922443 37718036 0.98
tpch_q14/datafusion:vortex-compact 22430492 21321089 1.05
tpch_q15/datafusion:vortex-compact 🚨 40237571 33512515 1.20
tpch_q16/datafusion:vortex-compact 32886255 29995975 1.10
tpch_q17/datafusion:vortex-compact 🚨 82790019 70102960 1.18
tpch_q18/datafusion:vortex-compact 🚨 103901025 83447770 1.25
tpch_q19/datafusion:vortex-compact 34985592 33310116 1.05
tpch_q20/datafusion:vortex-compact 🚨 44630477 38606599 1.16
tpch_q21/datafusion:vortex-compact 🚨 105071495 86212511 1.22
tpch_q22/datafusion:vortex-compact 🚨 18939421 17161553 1.10
datafusion / parquet (1.024x ➖, 2↑ 3↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 137190334 137259838 1.00
tpch_q02/datafusion:parquet 72003884 69103424 1.04
tpch_q03/datafusion:parquet 🚨 81722917 69961827 1.17
tpch_q04/datafusion:parquet 47884478 47714756 1.00
tpch_q05/datafusion:parquet 105645726 102920644 1.03
tpch_q06/datafusion:parquet 🚨 42763450 34066464 1.26
tpch_q07/datafusion:parquet 116076845 111615015 1.04
tpch_q08/datafusion:parquet 98395336 98086527 1.00
tpch_q09/datafusion:parquet 132527297 134970415 0.98
tpch_q10/datafusion:parquet 121312774 118652152 1.02
tpch_q11/datafusion:parquet 50640106 47303751 1.07
tpch_q12/datafusion:parquet 🚀 80511641 95120410 0.85
tpch_q13/datafusion:parquet 213354897 203484974 1.05
tpch_q14/datafusion:parquet 🚨 50236907 43886250 1.14
tpch_q15/datafusion:parquet 67316346 66445309 1.01
tpch_q16/datafusion:parquet 50466601 52009979 0.97
tpch_q17/datafusion:parquet 136720166 127841566 1.07
tpch_q18/datafusion:parquet 165498104 175213862 0.94
tpch_q19/datafusion:parquet 🚀 78374043 89076217 0.88
tpch_q20/datafusion:parquet 77343239 76493866 1.01
tpch_q21/datafusion:parquet 142822911 145697670 0.98
tpch_q22/datafusion:parquet 37825275 34815258 1.09
datafusion / arrow (1.014x ➖, 1↑ 2↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 53318608 55132518 0.97
tpch_q02/datafusion:arrow 21850219 22338673 0.98
tpch_q03/datafusion:arrow 34010113 34725027 0.98
tpch_q04/datafusion:arrow 28043495 27557590 1.02
tpch_q05/datafusion:arrow 79018203 83160660 0.95
tpch_q06/datafusion:arrow 20206565 20610521 0.98
tpch_q07/datafusion:arrow 115443391 113589693 1.02
tpch_q08/datafusion:arrow 46845492 45197480 1.04
tpch_q09/datafusion:arrow 74328563 68945176 1.08
tpch_q10/datafusion:arrow 🚨 56219256 50587594 1.11
tpch_q11/datafusion:arrow 11786326 11595950 1.02
tpch_q12/datafusion:arrow 🚨 61358799 54269461 1.13
tpch_q13/datafusion:arrow 51802563 49449039 1.05
tpch_q14/datafusion:arrow 23755304 22974190 1.03
tpch_q15/datafusion:arrow 46411077 44133261 1.05
tpch_q16/datafusion:arrow 21543967 20968514 1.03
tpch_q17/datafusion:arrow 72057774 72621986 0.99
tpch_q18/datafusion:arrow 146677309 142190609 1.03
tpch_q19/datafusion:arrow 🚀 39980954 44672267 0.89
tpch_q20/datafusion:arrow 38914002 39958386 0.97
tpch_q21/datafusion:arrow 158213328 152450079 1.04
tpch_q22/datafusion:arrow 19865275 20348360 0.98
duckdb / vortex-file-compressed (1.172x ❌, 0↑ 21↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 36631928 33025707 1.11
tpch_q02/duckdb:vortex-file-compressed 🚨 31149521 26864391 1.16
tpch_q03/duckdb:vortex-file-compressed 🚨 34440829 28874434 1.19
tpch_q04/duckdb:vortex-file-compressed 🚨 35414061 28903090 1.23
tpch_q05/duckdb:vortex-file-compressed 🚨 37215346 32846451 1.13
tpch_q06/duckdb:vortex-file-compressed 🚨 12129394 10473593 1.16
tpch_q07/duckdb:vortex-file-compressed 🚨 43722791 36915479 1.18
tpch_q08/duckdb:vortex-file-compressed 🚨 46413058 38917966 1.19
tpch_q09/duckdb:vortex-file-compressed 🚨 91656773 79574003 1.15
tpch_q10/duckdb:vortex-file-compressed 🚨 41887710 35408569 1.18
tpch_q11/duckdb:vortex-file-compressed 🚨 18665493 15500975 1.20
tpch_q12/duckdb:vortex-file-compressed 🚨 25479691 22118833 1.15
tpch_q13/duckdb:vortex-file-compressed 🚨 42106363 36479704 1.15
tpch_q14/duckdb:vortex-file-compressed 🚨 26091492 20874987 1.25
tpch_q15/duckdb:vortex-file-compressed 🚨 18935329 16002601 1.18
tpch_q16/duckdb:vortex-file-compressed 33087941 30191146 1.10
tpch_q17/duckdb:vortex-file-compressed 🚨 29089032 24869410 1.17
tpch_q18/duckdb:vortex-file-compressed 🚨 54184295 47263719 1.15
tpch_q19/duckdb:vortex-file-compressed 🚨 38196526 32280091 1.18
tpch_q20/duckdb:vortex-file-compressed 🚨 41440358 34233497 1.21
tpch_q21/duckdb:vortex-file-compressed 🚨 122266152 101931237 1.20
tpch_q22/duckdb:vortex-file-compressed 🚨 20761952 18053677 1.15
duckdb / vortex-compact (1.127x ❌, 0↑ 16↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 43148033 39893204 1.08
tpch_q02/duckdb:vortex-compact 40750111 37551994 1.09
tpch_q03/duckdb:vortex-compact 🚨 36587235 32422200 1.13
tpch_q04/duckdb:vortex-compact 🚨 39115198 35170089 1.11
tpch_q05/duckdb:vortex-compact 41910898 38352133 1.09
tpch_q06/duckdb:vortex-compact 🚨 16552089 14258377 1.16
tpch_q07/duckdb:vortex-compact 🚨 48953060 41994998 1.17
tpch_q08/duckdb:vortex-compact 🚨 51052292 45908894 1.11
tpch_q09/duckdb:vortex-compact 🚨 103187510 86796211 1.19
tpch_q10/duckdb:vortex-compact 🚨 45927626 40893133 1.12
tpch_q11/duckdb:vortex-compact 🚨 23787280 20963469 1.13
tpch_q12/duckdb:vortex-compact 🚨 41561506 36713715 1.13
tpch_q13/duckdb:vortex-compact 🚨 54013807 46525801 1.16
tpch_q14/duckdb:vortex-compact 🚨 33706422 30451624 1.11
tpch_q15/duckdb:vortex-compact 🚨 22180110 19491815 1.14
tpch_q16/duckdb:vortex-compact 39917461 36654274 1.09
tpch_q17/duckdb:vortex-compact 🚨 34770620 30947390 1.12
tpch_q18/duckdb:vortex-compact 56731005 51737284 1.10
tpch_q19/duckdb:vortex-compact 🚨 42934436 36700456 1.17
tpch_q20/duckdb:vortex-compact 🚨 50291888 44345295 1.13
tpch_q21/duckdb:vortex-compact 🚨 130256369 111388610 1.17
tpch_q22/duckdb:vortex-compact 22954854 20919312 1.10
duckdb / parquet (1.059x ➖, 0↑ 4↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 96435911 77404094 1.25
tpch_q02/duckdb:parquet 41904800 39185264 1.07
tpch_q03/duckdb:parquet 73489924 69225304 1.06
tpch_q04/duckdb:parquet 57045840 56048278 1.02
tpch_q05/duckdb:parquet 70844744 65940715 1.07
tpch_q06/duckdb:parquet 21516276 20881093 1.03
tpch_q07/duckdb:parquet 73290166 79538121 0.92
tpch_q08/duckdb:parquet 84628259 79556248 1.06
tpch_q09/duckdb:parquet 🚨 170612574 154462632 1.10
tpch_q10/duckdb:parquet 133768245 124072890 1.08
tpch_q11/duckdb:parquet 23811638 22114273 1.08
tpch_q12/duckdb:parquet 47306269 51333854 0.92
tpch_q13/duckdb:parquet 🚨 295491745 259800113 1.14
tpch_q14/duckdb:parquet 53439787 48783720 1.10
tpch_q15/duckdb:parquet 25902784 23819583 1.09
tpch_q16/duckdb:parquet 59268579 54624419 1.09
tpch_q17/duckdb:parquet 58237988 57620781 1.01
tpch_q18/duckdb:parquet 123897147 115567719 1.07
tpch_q19/duckdb:parquet 76825998 76567227 1.00
tpch_q20/duckdb:parquet 65318557 63124256 1.03
tpch_q21/duckdb:parquet 🚨 200698162 180766727 1.11
tpch_q22/duckdb:parquet 54911292 52330070 1.05
duckdb / duckdb (1.128x ❌, 0↑ 15↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16806162 16049706 1.05
tpch_q02/duckdb:duckdb 🚨 14152705 12449698 1.14
tpch_q03/duckdb:duckdb 🚨 21310841 19138445 1.11
tpch_q04/duckdb:duckdb 20652449 19168671 1.08
tpch_q05/duckdb:duckdb 🚨 21927909 18790734 1.17
tpch_q06/duckdb:duckdb 5859047 5332818 1.10
tpch_q07/duckdb:duckdb 23933315 23164106 1.03
tpch_q08/duckdb:duckdb 🚨 24344258 20793554 1.17
tpch_q09/duckdb:duckdb 🚨 62636785 53274465 1.18
tpch_q10/duckdb:duckdb 🚨 50347409 40313142 1.25
tpch_q11/duckdb:duckdb 🚨 6724827 5589083 1.20
tpch_q12/duckdb:duckdb 🚨 15682159 13566886 1.16
tpch_q13/duckdb:duckdb 🚨 40212175 36020632 1.12
tpch_q14/duckdb:duckdb 🚨 19799638 16393615 1.21
tpch_q15/duckdb:duckdb 🚨 13596498 11751084 1.16
tpch_q16/duckdb:duckdb 🚨 27056428 22884296 1.18
tpch_q17/duckdb:duckdb 14890578 13794595 1.08
tpch_q18/duckdb:duckdb 🚨 42178440 37503633 1.12
tpch_q19/duckdb:duckdb 🚨 30869073 27652318 1.12
tpch_q20/duckdb:duckdb 24162875 22768892 1.06
tpch_q21/duckdb:duckdb 🚨 61949092 55729227 1.11
tpch_q22/duckdb:duckdb 25710313 24152501 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.3% +11.6% -13.3% +31.1% ➖ noise
1 datafusion:vortex-compact +8.0% +11.6% -3.2% +30.7% ➖ noise
1 datafusion:vortex-file-compressed -3.9% +11.6% -13.9% +31.3% ➖ noise
1 duckdb:duckdb +4.7% +11.6% -6.2% +30.0% ➖ noise
1 duckdb:vortex-compact +8.2% +11.6% -3.1% +29.2% ➖ noise
1 duckdb:vortex-file-compressed +10.9% +11.6% -0.6% +30.2% ➖ noise
2 datafusion:arrow -2.2% +5.6% -7.3% +16.1% ➖ noise
2 datafusion:vortex-compact +6.8% +5.6% +1.2% +16.1% ➖ noise
2 datafusion:vortex-file-compressed +3.0% +5.6% -2.4% +16.1% ➖ noise
2 duckdb:duckdb +13.7% +5.6% +7.7% +18.7% ➖ noise
2 duckdb:vortex-compact +8.5% +5.6% +2.8% +16.1% ➖ noise
2 duckdb:vortex-file-compressed +16.0% +5.6% +9.8% +16.1% ➖ noise
3 datafusion:arrow -2.1% +11.4% -12.0% +16.1% ➖ noise
3 datafusion:vortex-compact -1.5% +11.4% -11.6% +16.1% ➖ noise
3 datafusion:vortex-file-compressed -7.2% +11.4% -16.6% +16.1% ✅ faster
3 duckdb:duckdb +11.4% +11.4% -0.0% +16.4% ➖ noise
3 duckdb:vortex-compact +12.8% +11.4% +1.3% +16.1% ➖ noise
3 duckdb:vortex-file-compressed +19.3% +11.4% +7.1% +16.1% ➖ noise
4 datafusion:arrow +1.8% +1.1% +0.7% +16.1% ➖ noise
4 datafusion:vortex-compact +3.6% +1.1% +2.5% +16.1% ➖ noise
4 datafusion:vortex-file-compressed -4.6% +1.1% -5.6% +16.1% ➖ noise
4 duckdb:duckdb +7.7% +1.1% +6.6% +16.1% ➖ noise
4 duckdb:vortex-compact +11.2% +1.1% +10.0% +16.1% ➖ noise
4 duckdb:vortex-file-compressed +22.5% +1.1% +21.2% +16.1% 🚨 regression
5 datafusion:arrow -5.0% +5.0% -9.5% +16.1% ➖ noise
5 datafusion:vortex-compact +5.8% +5.0% +0.8% +16.1% ➖ noise
5 datafusion:vortex-file-compressed +3.0% +5.0% -1.9% +16.1% ➖ noise
5 duckdb:duckdb +16.7% +5.0% +11.1% +17.1% ➖ noise
5 duckdb:vortex-compact +9.3% +5.0% +4.1% +16.1% ➖ noise
5 duckdb:vortex-file-compressed +13.3% +5.0% +7.9% +16.1% ➖ noise
6 datafusion:arrow -2.0% +13.7% -13.8% +18.6% ➖ noise
6 datafusion:vortex-compact +11.2% +13.7% -2.2% +23.5% ➖ noise
6 datafusion:vortex-file-compressed +9.6% +13.7% -3.6% +22.2% ➖ noise
6 duckdb:duckdb +9.9% +13.7% -3.4% +22.6% ➖ noise
6 duckdb:vortex-compact +16.1% +13.7% +2.1% +22.2% ➖ noise
6 duckdb:vortex-file-compressed +15.8% +13.7% +1.8% +23.1% ➖ noise
7 datafusion:arrow +1.6% -2.1% +3.8% +16.1% ➖ noise
7 datafusion:vortex-compact +1.7% -2.1% +3.9% +16.1% ➖ noise
7 datafusion:vortex-file-compressed +3.4% -2.1% +5.6% +16.1% ➖ noise
7 duckdb:duckdb +3.3% -2.1% +5.5% +16.1% ➖ noise
7 duckdb:vortex-compact +16.6% -2.1% +19.1% +16.1% 🚨 regression
7 duckdb:vortex-file-compressed +18.4% -2.1% +21.0% +16.1% 🚨 regression
8 datafusion:arrow +3.6% +3.3% +0.3% +16.1% ➖ noise
8 datafusion:vortex-compact +3.3% +3.3% +0.0% +16.1% ➖ noise
8 datafusion:vortex-file-compressed +5.3% +3.3% +1.9% +16.1% ➖ noise
8 duckdb:duckdb +17.1% +3.3% +13.3% +16.1% ➖ noise
8 duckdb:vortex-compact +11.2% +3.3% +7.7% +16.1% ➖ noise
8 duckdb:vortex-file-compressed +19.3% +3.3% +15.4% +16.1% ➖ noise
9 datafusion:arrow +7.8% +4.1% +3.5% +16.1% ➖ noise
9 datafusion:vortex-compact +15.8% +4.1% +11.2% +16.1% ➖ noise
9 datafusion:vortex-file-compressed +5.4% +4.1% +1.2% +16.1% ➖ noise
9 duckdb:duckdb +17.6% +4.1% +12.9% +16.1% ➖ noise
9 duckdb:vortex-compact +18.9% +4.1% +14.2% +16.1% ➖ noise
9 duckdb:vortex-file-compressed +15.2% +4.1% +10.6% +16.1% ➖ noise
10 datafusion:arrow +11.1% +5.0% +5.8% +16.1% ➖ noise
10 datafusion:vortex-compact +28.0% +5.0% +21.9% +16.1% 🚨 regression
10 datafusion:vortex-file-compressed -1.5% +5.0% -6.2% +16.1% ➖ noise
10 duckdb:duckdb +24.9% +5.0% +19.0% +16.7% 🚨 regression
10 duckdb:vortex-compact +12.3% +5.0% +7.0% +16.1% ➖ noise
10 duckdb:vortex-file-compressed +18.3% +5.0% +12.7% +16.1% ➖ noise
11 datafusion:arrow +1.6% +7.4% -5.3% +16.1% ➖ noise
11 datafusion:vortex-compact +7.1% +7.4% -0.3% +20.5% ➖ noise
11 datafusion:vortex-file-compressed +2.9% +7.4% -4.2% +16.1% ➖ noise
11 duckdb:duckdb +20.3% +7.4% +12.1% +16.1% ➖ noise
11 duckdb:vortex-compact +13.5% +7.4% +5.7% +16.1% ➖ noise
11 duckdb:vortex-file-compressed +20.4% +7.4% +12.2% +16.1% ➖ noise
12 datafusion:arrow +13.1% -11.7% +28.0% +16.1% 🚨 regression
12 datafusion:vortex-compact +2.2% -11.7% +15.7% +16.1% ➖ noise
12 datafusion:vortex-file-compressed +1.7% -11.7% +15.2% +16.1% ➖ noise
12 duckdb:duckdb +15.6% -11.7% +30.9% +16.1% 🚨 regression
12 duckdb:vortex-compact +13.2% -11.7% +28.2% +16.1% 🚨 regression
12 duckdb:vortex-file-compressed +15.2% -11.7% +30.4% +16.1% 🚨 regression
13 datafusion:arrow +4.8% +9.2% -4.1% +16.1% ➖ noise
13 datafusion:vortex-compact -2.1% +9.2% -10.4% +16.1% ➖ noise
13 datafusion:vortex-file-compressed -0.1% +9.2% -8.5% +16.1% ➖ noise
13 duckdb:duckdb +11.6% +9.2% +2.2% +16.1% ➖ noise
13 duckdb:vortex-compact +16.1% +9.2% +6.3% +16.1% ➖ noise
13 duckdb:vortex-file-compressed +15.4% +9.2% +5.7% +16.1% ➖ noise
14 datafusion:arrow +3.4% +12.0% -7.7% +16.1% ➖ noise
14 datafusion:vortex-compact +5.2% +12.0% -6.1% +16.1% ➖ noise
14 datafusion:vortex-file-compressed +5.8% +12.0% -5.5% +16.1% ➖ noise
14 duckdb:duckdb +20.8% +12.0% +7.9% +20.8% ➖ noise
14 duckdb:vortex-compact +10.7% +12.0% -1.2% +16.1% ➖ noise
14 duckdb:vortex-file-compressed +25.0% +12.0% +11.6% +16.2% ➖ noise
15 datafusion:arrow +5.2% +5.0% +0.2% +16.1% ➖ noise
15 datafusion:vortex-compact +20.1% +5.0% +14.4% +16.6% ➖ noise
15 datafusion:vortex-file-compressed +0.1% +5.0% -4.6% +18.0% ➖ noise
15 duckdb:duckdb +15.7% +5.0% +10.2% +19.2% ➖ noise
15 duckdb:vortex-compact +13.8% +5.0% +8.4% +16.2% ➖ noise
15 duckdb:vortex-file-compressed +18.3% +5.0% +12.7% +16.1% ➖ noise
16 datafusion:arrow +2.7% +2.6% +0.1% +16.1% ➖ noise
16 datafusion:vortex-compact +9.6% +2.6% +6.8% +16.1% ➖ noise
16 datafusion:vortex-file-compressed +7.9% +2.6% +5.2% +16.1% ➖ noise
16 duckdb:duckdb +18.2% +2.6% +15.2% +16.1% ➖ noise
16 duckdb:vortex-compact +8.9% +2.6% +6.1% +16.1% ➖ noise
16 duckdb:vortex-file-compressed +9.6% +2.6% +6.8% +16.1% ➖ noise
17 datafusion:arrow -0.8% +4.0% -4.6% +16.1% ➖ noise
17 datafusion:vortex-compact +18.1% +4.0% +13.6% +16.1% ➖ noise
17 datafusion:vortex-file-compressed +4.8% +4.0% +0.8% +16.1% ➖ noise
17 duckdb:duckdb +7.9% +4.0% +3.8% +16.1% ➖ noise
17 duckdb:vortex-compact +12.4% +4.0% +8.1% +16.1% ➖ noise
17 duckdb:vortex-file-compressed +17.0% +4.0% +12.5% +16.1% ➖ noise
18 datafusion:arrow +3.2% +0.6% +2.5% +16.1% ➖ noise
18 datafusion:vortex-compact +24.5% +0.6% +23.7% +16.1% 🚨 regression
18 datafusion:vortex-file-compressed +2.2% +0.6% +1.5% +16.1% ➖ noise
18 duckdb:duckdb +12.5% +0.6% +11.8% +16.1% ➖ noise
18 duckdb:vortex-compact +9.7% +0.6% +9.0% +16.1% ➖ noise
18 duckdb:vortex-file-compressed +14.6% +0.6% +13.9% +16.1% ➖ noise
19 datafusion:arrow -10.5% -6.0% -4.7% +19.6% ➖ noise
19 datafusion:vortex-compact +5.0% -6.0% +11.8% +16.4% ➖ noise
19 datafusion:vortex-file-compressed +3.3% -6.0% +10.0% +16.1% ➖ noise
19 duckdb:duckdb +11.6% -6.0% +18.8% +16.1% 🚨 regression
19 duckdb:vortex-compact +17.0% -6.0% +24.5% +16.4% 🚨 regression
19 duckdb:vortex-file-compressed +18.3% -6.0% +25.9% +16.1% 🚨 regression
20 datafusion:arrow -2.6% +2.3% -4.8% +17.5% ➖ noise
20 datafusion:vortex-compact +15.6% +2.3% +13.0% +16.1% ➖ noise
20 datafusion:vortex-file-compressed -2.7% +2.3% -4.9% +16.1% ➖ noise
20 duckdb:duckdb +6.1% +2.3% +3.8% +16.1% ➖ noise
20 duckdb:vortex-compact +13.4% +2.3% +10.9% +16.1% ➖ noise
20 duckdb:vortex-file-compressed +21.1% +2.3% +18.3% +18.1% 🚨 regression
21 datafusion:arrow +3.8% +4.3% -0.5% +16.1% ➖ noise
21 datafusion:vortex-compact +21.9% +4.3% +16.8% +16.1% 🚨 regression
21 datafusion:vortex-file-compressed +8.4% +4.3% +3.9% +16.1% ➖ noise
21 duckdb:duckdb +11.2% +4.3% +6.6% +16.1% ➖ noise
21 duckdb:vortex-compact +16.9% +4.3% +12.1% +16.1% ➖ noise
21 duckdb:vortex-file-compressed +19.9% +4.3% +15.0% +16.1% ➖ noise
22 datafusion:arrow -2.4% +6.8% -8.6% +16.1% ➖ noise
22 datafusion:vortex-compact +10.4% +6.8% +3.4% +16.1% ➖ noise
22 datafusion:vortex-file-compressed +19.6% +6.8% +12.0% +16.1% ➖ noise
22 duckdb:duckdb +6.4% +6.8% -0.3% +16.1% ➖ noise
22 duckdb:vortex-compact +9.7% +6.8% +2.8% +16.1% ➖ noise
22 duckdb:vortex-file-compressed +15.0% +6.8% +7.7% +16.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -0.9%


datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6253575 6529421 0.96
fineweb_q01/datafusion:vortex-file-compressed 30029967 29079473 1.03
fineweb_q02/datafusion:vortex-file-compressed 31755495 33751265 0.94
fineweb_q03/datafusion:vortex-file-compressed 84512883 93364613 0.91
fineweb_q04/datafusion:vortex-file-compressed 267622457 273644727 0.98
fineweb_q05/datafusion:vortex-file-compressed 234663955 247379992 0.95
fineweb_q06/datafusion:vortex-file-compressed 76241357 73796337 1.03
fineweb_q07/datafusion:vortex-file-compressed 73983167 75333035 0.98
fineweb_q08/datafusion:vortex-file-compressed 31111896 28616089 1.09
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5379753 5162633 1.04
fineweb_q01/datafusion:vortex-compact 168959442 167366677 1.01
fineweb_q02/datafusion:vortex-compact 172238226 170679481 1.01
fineweb_q03/datafusion:vortex-compact 1554290386 1555130943 1.00
fineweb_q04/datafusion:vortex-compact 1684350424 1717694705 0.98
fineweb_q05/datafusion:vortex-compact 1327379280 1339037275 0.99
fineweb_q06/datafusion:vortex-compact 756353680 761663864 0.99
fineweb_q07/datafusion:vortex-compact 771579068 807248555 0.96
fineweb_q08/datafusion:vortex-compact 25403530 24586642 1.03
datafusion / parquet (0.988x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7407854 7292299 1.02
fineweb_q01/datafusion:parquet 292655277 303649146 0.96
fineweb_q02/datafusion:parquet 290089624 309062704 0.94
fineweb_q03/datafusion:parquet 299439352 300651810 1.00
fineweb_q04/datafusion:parquet 315162929 317336182 0.99
fineweb_q05/datafusion:parquet 310839757 310571776 1.00
fineweb_q06/datafusion:parquet 302518327 311175342 0.97
fineweb_q07/datafusion:parquet 295506154 293766428 1.01
fineweb_q08/datafusion:parquet 291092150 288402493 1.01
duckdb / vortex-file-compressed (0.989x ➖, 1↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3835347 3958736 0.97
fineweb_q01/duckdb:vortex-file-compressed 28994331 28728517 1.01
fineweb_q02/duckdb:vortex-file-compressed 29879726 29422490 1.02
fineweb_q03/duckdb:vortex-file-compressed 🚀 136910857 171873157 0.80
fineweb_q04/duckdb:vortex-file-compressed 242730806 236938146 1.02
fineweb_q05/duckdb:vortex-file-compressed 225832117 219674658 1.03
fineweb_q06/duckdb:vortex-file-compressed 🚨 75659797 68615583 1.10
fineweb_q07/duckdb:vortex-file-compressed 72086186 75658441 0.95
fineweb_q08/duckdb:vortex-file-compressed 28625630 27633708 1.04
duckdb / vortex-compact (0.973x ➖, 1↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4554224 4719526 0.96
fineweb_q01/duckdb:vortex-compact 103224438 108454341 0.95
fineweb_q02/duckdb:vortex-compact 116874151 122854040 0.95
fineweb_q03/duckdb:vortex-compact 948685907 935288726 1.01
fineweb_q04/duckdb:vortex-compact 980591431 995361576 0.99
fineweb_q05/duckdb:vortex-compact 870227430 893610849 0.97
fineweb_q06/duckdb:vortex-compact 509081884 500856848 1.02
fineweb_q07/duckdb:vortex-compact 518576355 510962723 1.01
fineweb_q08/duckdb:vortex-compact 🚀 22323068 24968775 0.89
duckdb / parquet (0.978x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38388159 39656486 0.97
fineweb_q01/duckdb:parquet 98205247 103126595 0.95
fineweb_q02/duckdb:parquet 104277527 107562218 0.97
fineweb_q03/duckdb:parquet 326421337 328057639 1.00
fineweb_q04/duckdb:parquet 459707932 456561716 1.01
fineweb_q05/duckdb:parquet 428037873 435018485 0.98
fineweb_q06/duckdb:parquet 207275588 216149482 0.96
fineweb_q07/duckdb:parquet 222726399 225804724 0.99
fineweb_q08/duckdb:parquet 63640838 64511311 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +4.2% -0.8% +5.1% +40.2% ➖ noise
0 datafusion:vortex-file-compressed -4.2% -0.8% -3.4% +52.9% ➖ noise
0 duckdb:vortex-compact -3.5% -0.8% -2.7% +33.4% ➖ noise
0 duckdb:vortex-file-compressed -3.1% -0.8% -2.3% +49.4% ➖ noise
1 datafusion:vortex-compact +1.0% -4.2% +5.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +3.3% -4.2% +7.8% +18.0% ➖ noise
1 duckdb:vortex-compact -4.8% -4.2% -0.7% +14.8% ➖ noise
1 duckdb:vortex-file-compressed +0.9% -4.2% +5.3% +40.0% ➖ noise
2 datafusion:vortex-compact +0.9% -4.6% +5.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.9% -4.6% -1.4% +21.6% ➖ noise
2 duckdb:vortex-compact -4.9% -4.6% -0.3% +10.2% ➖ noise
2 duckdb:vortex-file-compressed +1.6% -4.6% +6.5% +10.0% ➖ noise
3 datafusion:vortex-compact -0.1% -0.5% +0.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -9.5% -0.5% -9.1% +24.1% ➖ noise
3 duckdb:vortex-compact +1.4% -0.5% +1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -20.3% -0.5% -20.0% +28.1% ➖ noise
4 datafusion:vortex-compact -1.9% -0.0% -1.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% -0.0% -2.2% +10.0% ➖ noise
4 duckdb:vortex-compact -1.5% -0.0% -1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% -0.0% +2.4% +10.0% ➖ noise
5 datafusion:vortex-compact -0.9% -0.8% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.1% -0.8% -4.4% +13.0% ➖ noise
5 duckdb:vortex-compact -2.6% -0.8% -1.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.8% -0.8% +3.6% +10.0% ➖ noise
6 datafusion:vortex-compact -0.7% -3.4% +2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.3% -3.4% +7.0% +15.3% ➖ noise
6 duckdb:vortex-compact +1.6% -3.4% +5.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +10.3% -3.4% +14.2% +10.0% 🚨 regression
7 datafusion:vortex-compact -4.4% -0.4% -4.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.8% -0.4% -1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +1.5% -0.4% +1.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.7% -0.4% -4.3% +14.0% ➖ noise
8 datafusion:vortex-compact +3.3% -0.2% +3.5% +15.6% ➖ noise
8 datafusion:vortex-file-compressed +8.7% -0.2% +9.0% +25.8% ➖ noise
8 duckdb:vortex-compact -10.6% -0.2% -10.4% +23.9% ➖ noise
8 duckdb:vortex-file-compressed +3.6% -0.2% +3.8% +11.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -0.4%


datafusion / vortex-file-compressed (0.850x ✅, 95↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 27120132 32327926 0.84
tpcds_q02/datafusion:vortex-file-compressed 🚀 52766402 62244123 0.85
tpcds_q03/datafusion:vortex-file-compressed 🚀 20204820 24826593 0.81
tpcds_q04/datafusion:vortex-file-compressed 🚀 293256159 348992019 0.84
tpcds_q05/datafusion:vortex-file-compressed 🚀 52626111 62811774 0.84
tpcds_q06/datafusion:vortex-file-compressed 🚀 51625284 61677352 0.84
tpcds_q07/datafusion:vortex-file-compressed 🚀 52570704 63383630 0.83
tpcds_q08/datafusion:vortex-file-compressed 🚀 36502837 43785997 0.83
tpcds_q09/datafusion:vortex-file-compressed 🚀 55064524 63564874 0.87
tpcds_q10/datafusion:vortex-file-compressed 🚀 46458798 55219229 0.84
tpcds_q11/datafusion:vortex-file-compressed 🚀 169160224 202743269 0.83
tpcds_q12/datafusion:vortex-file-compressed 🚀 23234596 27660012 0.84
tpcds_q13/datafusion:vortex-file-compressed 🚀 62633852 71082219 0.88
tpcds_q14/datafusion:vortex-file-compressed 🚀 204625451 237811026 0.86
tpcds_q15/datafusion:vortex-file-compressed 🚀 35074962 42511946 0.83
tpcds_q16/datafusion:vortex-file-compressed 🚀 28116575 33491862 0.84
tpcds_q17/datafusion:vortex-file-compressed 🚀 67973670 79318369 0.86
tpcds_q18/datafusion:vortex-file-compressed 🚀 76603623 90323977 0.85
tpcds_q19/datafusion:vortex-file-compressed 🚀 31856272 35915360 0.89
tpcds_q20/datafusion:vortex-file-compressed 🚀 26813641 30007051 0.89
tpcds_q21/datafusion:vortex-file-compressed 🚀 135150336 159242154 0.85
tpcds_q22/datafusion:vortex-file-compressed 🚀 57268441 70999902 0.81
tpcds_q23/datafusion:vortex-file-compressed 🚀 150934530 179010676 0.84
tpcds_q24/datafusion:vortex-file-compressed 🚀 112566154 134078291 0.84
tpcds_q25/datafusion:vortex-file-compressed 🚀 67335497 80201407 0.84
tpcds_q26/datafusion:vortex-file-compressed 🚀 36267310 42561158 0.85
tpcds_q27/datafusion:vortex-file-compressed 🚀 120514700 142370583 0.85
tpcds_q28/datafusion:vortex-file-compressed 🚀 50627607 56389227 0.90
tpcds_q29/datafusion:vortex-file-compressed 🚀 67926361 79756162 0.85
tpcds_q30/datafusion:vortex-file-compressed 31109129 34532846 0.90
tpcds_q31/datafusion:vortex-file-compressed 🚀 99738542 113304993 0.88
tpcds_q32/datafusion:vortex-file-compressed 🚀 21834972 24689224 0.88
tpcds_q33/datafusion:vortex-file-compressed 🚀 39537856 44659682 0.89
tpcds_q34/datafusion:vortex-file-compressed 🚀 34304933 39163925 0.88
tpcds_q35/datafusion:vortex-file-compressed 58116154 63926622 0.91
tpcds_q36/datafusion:vortex-file-compressed 🚀 76459676 88821824 0.86
tpcds_q37/datafusion:vortex-file-compressed 🚀 34096727 42027963 0.81
tpcds_q38/datafusion:vortex-file-compressed 🚀 53485926 61982964 0.86
tpcds_q39/datafusion:vortex-file-compressed 🚀 138187081 176161546 0.78
tpcds_q40/datafusion:vortex-file-compressed 🚀 52669195 61350217 0.86
tpcds_q41/datafusion:vortex-file-compressed 🚀 17397855 22014643 0.79
tpcds_q42/datafusion:vortex-file-compressed 🚀 19593095 22316647 0.88
tpcds_q43/datafusion:vortex-file-compressed 🚀 33097605 39477614 0.84
tpcds_q44/datafusion:vortex-file-compressed 🚀 46304330 54641090 0.85
tpcds_q45/datafusion:vortex-file-compressed 🚀 33934528 38910320 0.87
tpcds_q46/datafusion:vortex-file-compressed 🚀 50497452 58804506 0.86
tpcds_q47/datafusion:vortex-file-compressed 🚀 202727275 250198002 0.81
tpcds_q48/datafusion:vortex-file-compressed 🚀 47884591 56336141 0.85
tpcds_q49/datafusion:vortex-file-compressed 🚀 69412845 81145889 0.86
tpcds_q50/datafusion:vortex-file-compressed 🚀 47359714 58263723 0.81
tpcds_q51/datafusion:vortex-file-compressed 🚀 89644344 106483574 0.84
tpcds_q52/datafusion:vortex-file-compressed 🚀 18925829 22840365 0.83
tpcds_q53/datafusion:vortex-file-compressed 🚀 26368587 30371731 0.87
tpcds_q54/datafusion:vortex-file-compressed 🚀 45183656 52019546 0.87
tpcds_q55/datafusion:vortex-file-compressed 🚀 18519574 20741293 0.89
tpcds_q56/datafusion:vortex-file-compressed 🚀 42073161 46840581 0.90
tpcds_q57/datafusion:vortex-file-compressed 🚀 125674628 149653508 0.84
tpcds_q58/datafusion:vortex-file-compressed 🚀 70386927 83863594 0.84
tpcds_q59/datafusion:vortex-file-compressed 🚀 73603236 87622098 0.84
tpcds_q60/datafusion:vortex-file-compressed 🚀 42562431 47953361 0.89
tpcds_q61/datafusion:vortex-file-compressed 🚀 52257323 60920507 0.86
tpcds_q62/datafusion:vortex-file-compressed 🚀 31469199 38695813 0.81
tpcds_q63/datafusion:vortex-file-compressed 🚀 26408618 31000958 0.85
tpcds_q64/datafusion:vortex-file-compressed 🚀 469464706 544445532 0.86
tpcds_q65/datafusion:vortex-file-compressed 50919374 56471771 0.90
tpcds_q66/datafusion:vortex-file-compressed 🚀 95340336 107253481 0.89
tpcds_q67/datafusion:vortex-file-compressed 🚀 122229104 140281463 0.87
tpcds_q68/datafusion:vortex-file-compressed 🚀 46019357 52754388 0.87
tpcds_q69/datafusion:vortex-file-compressed 🚀 44238946 49339286 0.90
tpcds_q70/datafusion:vortex-file-compressed 🚀 110080327 126834720 0.87
tpcds_q71/datafusion:vortex-file-compressed 🚀 32344592 37743720 0.86
tpcds_q72/datafusion:vortex-file-compressed 🚀 2592576711 3292479629 0.79
tpcds_q73/datafusion:vortex-file-compressed 🚀 36260237 44565243 0.81
tpcds_q74/datafusion:vortex-file-compressed 🚀 117728979 140799797 0.84
tpcds_q75/datafusion:vortex-file-compressed 129372255 143122424 0.90
tpcds_q76/datafusion:vortex-file-compressed 🚀 36425831 40842634 0.89
tpcds_q77/datafusion:vortex-file-compressed 🚀 53519832 60092973 0.89
tpcds_q78/datafusion:vortex-file-compressed 🚀 126841784 154843269 0.82
tpcds_q79/datafusion:vortex-file-compressed 🚀 40154999 48654541 0.83
tpcds_q80/datafusion:vortex-file-compressed 🚀 115230509 137503005 0.84
tpcds_q81/datafusion:vortex-file-compressed 🚀 36420044 44417893 0.82
tpcds_q82/datafusion:vortex-file-compressed 🚀 36621470 45974007 0.80
tpcds_q83/datafusion:vortex-file-compressed 🚀 50481264 58106884 0.87
tpcds_q84/datafusion:vortex-file-compressed 🚀 14732330 18501062 0.80
tpcds_q85/datafusion:vortex-file-compressed 🚀 102075176 114840230 0.89
tpcds_q86/datafusion:vortex-file-compressed 🚀 19949078 22522300 0.89
tpcds_q87/datafusion:vortex-file-compressed 🚀 54885979 65064517 0.84
tpcds_q88/datafusion:vortex-file-compressed 🚀 83960741 98443203 0.85
tpcds_q89/datafusion:vortex-file-compressed 🚀 36271947 43704911 0.83
tpcds_q90/datafusion:vortex-file-compressed 🚀 18239973 21492931 0.85
tpcds_q91/datafusion:vortex-file-compressed 🚀 25916070 30862192 0.84
tpcds_q92/datafusion:vortex-file-compressed 🚀 18827326 22392134 0.84
tpcds_q93/datafusion:vortex-file-compressed 🚀 35234064 43220630 0.82
tpcds_q94/datafusion:vortex-file-compressed 🚀 25918508 29141076 0.89
tpcds_q95/datafusion:vortex-file-compressed 🚀 60153722 70645413 0.85
tpcds_q96/datafusion:vortex-file-compressed 🚀 18026325 21718627 0.83
tpcds_q97/datafusion:vortex-file-compressed 🚀 32793289 38603073 0.85
tpcds_q98/datafusion:vortex-file-compressed 🚀 33030552 39704994 0.83
tpcds_q99/datafusion:vortex-file-compressed 🚀 44997748 57097286 0.79
datafusion / vortex-compact (0.890x ✅, 72↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 37026033 42884114 0.86
tpcds_q02/datafusion:vortex-compact 🚀 57460030 66102682 0.87
tpcds_q03/datafusion:vortex-compact 🚀 26566047 29531173 0.90
tpcds_q04/datafusion:vortex-compact 🚀 327511509 393642309 0.83
tpcds_q05/datafusion:vortex-compact 🚀 65676424 77035625 0.85
tpcds_q06/datafusion:vortex-compact 🚀 56935386 67999688 0.84
tpcds_q07/datafusion:vortex-compact 🚀 67599940 82208093 0.82
tpcds_q08/datafusion:vortex-compact 🚀 44947359 51138232 0.88
tpcds_q09/datafusion:vortex-compact 🚀 101235225 133161493 0.76
tpcds_q10/datafusion:vortex-compact 🚀 63921430 71419684 0.90
tpcds_q11/datafusion:vortex-compact 🚀 189590643 229260834 0.83
tpcds_q12/datafusion:vortex-compact 🚀 25644233 30519028 0.84
tpcds_q13/datafusion:vortex-compact 🚀 129275424 146132243 0.88
tpcds_q14/datafusion:vortex-compact 🚀 254658070 299207640 0.85
tpcds_q15/datafusion:vortex-compact 🚀 40452698 47429453 0.85
tpcds_q16/datafusion:vortex-compact 🚀 39142059 45206402 0.87
tpcds_q17/datafusion:vortex-compact 🚀 92400703 107452143 0.86
tpcds_q18/datafusion:vortex-compact 🚀 93117618 105800260 0.88
tpcds_q19/datafusion:vortex-compact 🚀 42878949 48213931 0.89
tpcds_q20/datafusion:vortex-compact 🚀 30582210 34499336 0.89
tpcds_q21/datafusion:vortex-compact 🚀 141992556 166803942 0.85
tpcds_q22/datafusion:vortex-compact 🚀 64376558 78320332 0.82
tpcds_q23/datafusion:vortex-compact 🚀 181163946 213650315 0.85
tpcds_q24/datafusion:vortex-compact 🚀 138438117 159665139 0.87
tpcds_q25/datafusion:vortex-compact 95762529 105583607 0.91
tpcds_q26/datafusion:vortex-compact 🚀 47297125 52989179 0.89
tpcds_q27/datafusion:vortex-compact 🚀 155800888 180891535 0.86
tpcds_q28/datafusion:vortex-compact 🚀 100137297 115493863 0.87
tpcds_q29/datafusion:vortex-compact 🚀 94524357 108950194 0.87
tpcds_q30/datafusion:vortex-compact 🚀 35683498 41867799 0.85
tpcds_q31/datafusion:vortex-compact 🚀 125928150 145360255 0.87
tpcds_q32/datafusion:vortex-compact 🚀 27123667 30426465 0.89
tpcds_q33/datafusion:vortex-compact 🚀 51072076 56994332 0.90
tpcds_q34/datafusion:vortex-compact 🚀 47663611 53374883 0.89
tpcds_q35/datafusion:vortex-compact 🚀 67289675 76390858 0.88
tpcds_q36/datafusion:vortex-compact 🚀 96592393 111789599 0.86
tpcds_q37/datafusion:vortex-compact 🚀 45471734 55046518 0.83
tpcds_q38/datafusion:vortex-compact 66228440 73526142 0.90
tpcds_q39/datafusion:vortex-compact 🚀 147721784 181197537 0.82
tpcds_q40/datafusion:vortex-compact 🚀 59940946 70014261 0.86
tpcds_q41/datafusion:vortex-compact 🚀 20570003 25208667 0.82
tpcds_q42/datafusion:vortex-compact 🚀 24792453 28030673 0.88
tpcds_q43/datafusion:vortex-compact 🚀 38260156 43885884 0.87
tpcds_q44/datafusion:vortex-compact 🚀 76029697 87533243 0.87
tpcds_q45/datafusion:vortex-compact 🚀 37653367 42806778 0.88
tpcds_q46/datafusion:vortex-compact 69867971 76133162 0.92
tpcds_q47/datafusion:vortex-compact 🚀 225835603 267164726 0.85
tpcds_q48/datafusion:vortex-compact 99403610 104853661 0.95
tpcds_q49/datafusion:vortex-compact 🚀 95523755 113205953 0.84
tpcds_q50/datafusion:vortex-compact 🚀 62703769 70595922 0.89
tpcds_q51/datafusion:vortex-compact 🚀 95076729 107678893 0.88
tpcds_q52/datafusion:vortex-compact 🚀 25003960 29060884 0.86
tpcds_q53/datafusion:vortex-compact 🚀 34530341 38664789 0.89
tpcds_q54/datafusion:vortex-compact 58519501 63709130 0.92
tpcds_q55/datafusion:vortex-compact 🚀 24786500 27905306 0.89
tpcds_q56/datafusion:vortex-compact 53373307 58829668 0.91
tpcds_q57/datafusion:vortex-compact 🚀 137554222 162143230 0.85
tpcds_q58/datafusion:vortex-compact 🚀 75592807 88825372 0.85
tpcds_q59/datafusion:vortex-compact 🚀 85479617 99760921 0.86
tpcds_q60/datafusion:vortex-compact 54662920 60355974 0.91
tpcds_q61/datafusion:vortex-compact 🚀 71823846 80286984 0.89
tpcds_q62/datafusion:vortex-compact 🚀 32788464 38191613 0.86
tpcds_q63/datafusion:vortex-compact 🚀 35083664 40178087 0.87
tpcds_q64/datafusion:vortex-compact 🚀 533578132 613996852 0.87
tpcds_q65/datafusion:vortex-compact 66793435 73380128 0.91
tpcds_q66/datafusion:vortex-compact 🚀 99081243 110251349 0.90
tpcds_q67/datafusion:vortex-compact 🚀 130166147 146267358 0.89
tpcds_q68/datafusion:vortex-compact 🚀 68523102 80011978 0.86
tpcds_q69/datafusion:vortex-compact 🚀 58735382 66096931 0.89
tpcds_q70/datafusion:vortex-compact 🚀 120325118 141923132 0.85
tpcds_q71/datafusion:vortex-compact 🚀 46227744 53030260 0.87
tpcds_q72/datafusion:vortex-compact 🚀 2617693334 3249059773 0.81
tpcds_q73/datafusion:vortex-compact 🚀 49184946 54688807 0.90
tpcds_q74/datafusion:vortex-compact 🚀 132162636 154324118 0.86
tpcds_q75/datafusion:vortex-compact 🚀 167070794 187013531 0.89
tpcds_q76/datafusion:vortex-compact 🚀 50246147 59621436 0.84
tpcds_q77/datafusion:vortex-compact 68677843 75391765 0.91
tpcds_q78/datafusion:vortex-compact 🚀 149840810 177075595 0.85
tpcds_q79/datafusion:vortex-compact 🚀 57496667 66526573 0.86
tpcds_q80/datafusion:vortex-compact 🚀 129822784 153837831 0.84
tpcds_q81/datafusion:vortex-compact 🚀 42115585 48211276 0.87
tpcds_q82/datafusion:vortex-compact 48718493 50447680 0.97
tpcds_q83/datafusion:vortex-compact 59059006 62618610 0.94
tpcds_q84/datafusion:vortex-compact 18182183 18879469 0.96
tpcds_q85/datafusion:vortex-compact 125939236 126710475 0.99
tpcds_q86/datafusion:vortex-compact 20184348 19721319 1.02
tpcds_q87/datafusion:vortex-compact 66081010 65035096 1.02
tpcds_q88/datafusion:vortex-compact 131666147 132760942 0.99
tpcds_q89/datafusion:vortex-compact 44193554 43974874 1.00
tpcds_q90/datafusion:vortex-compact 24271455 24620666 0.99
tpcds_q91/datafusion:vortex-compact 40665297 39883543 1.02
tpcds_q92/datafusion:vortex-compact 20485085 21443704 0.96
tpcds_q93/datafusion:vortex-compact 48382186 46813413 1.03
tpcds_q94/datafusion:vortex-compact 32468181 31036361 1.05
tpcds_q95/datafusion:vortex-compact 72213910 72152285 1.00
tpcds_q96/datafusion:vortex-compact 26634943 26433786 1.01
tpcds_q97/datafusion:vortex-compact 41397745 41334200 1.00
tpcds_q98/datafusion:vortex-compact 38812346 37879648 1.02
tpcds_q99/datafusion:vortex-compact 51280818 50481486 1.02
datafusion / parquet (0.883x ✅, 65↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36993773 40749612 0.91
tpcds_q02/datafusion:parquet 45162772 50074956 0.90
tpcds_q03/datafusion:parquet 🚀 14405832 17183457 0.84
tpcds_q04/datafusion:parquet 🚀 315591248 374586515 0.84
tpcds_q05/datafusion:parquet 🚀 52301411 62571727 0.84
tpcds_q06/datafusion:parquet 64568284 66721658 0.97
tpcds_q07/datafusion:parquet 89867124 99037837 0.91
tpcds_q08/datafusion:parquet 32743757 36257976 0.90
tpcds_q09/datafusion:parquet 59602263 64409288 0.93
tpcds_q10/datafusion:parquet 84155000 89654231 0.94
tpcds_q11/datafusion:parquet 🚀 181816486 211852653 0.86
tpcds_q12/datafusion:parquet 22891304 24766224 0.92
tpcds_q13/datafusion:parquet 87250606 96097719 0.91
tpcds_q14/datafusion:parquet 🚀 194315808 225484630 0.86
tpcds_q15/datafusion:parquet 🚀 25392638 29521155 0.86
tpcds_q16/datafusion:parquet 🚀 27860916 32330285 0.86
tpcds_q17/datafusion:parquet 🚀 70315172 80100305 0.88
tpcds_q18/datafusion:parquet 130965281 143475934 0.91
tpcds_q19/datafusion:parquet 🚀 27193032 30977820 0.88
tpcds_q20/datafusion:parquet 🚀 21297745 23910712 0.89
tpcds_q21/datafusion:parquet 🚀 21870876 24954260 0.88
tpcds_q22/datafusion:parquet 🚀 130937926 160144307 0.82
tpcds_q23/datafusion:parquet 🚀 165983143 197676285 0.84
tpcds_q24/datafusion:parquet 🚀 106089322 124380828 0.85
tpcds_q25/datafusion:parquet 🚀 71614294 84600023 0.85
tpcds_q26/datafusion:parquet 🚀 74474230 84988843 0.88
tpcds_q27/datafusion:parquet 🚀 163787537 190909419 0.86
tpcds_q28/datafusion:parquet 🚀 48973552 57866916 0.85
tpcds_q29/datafusion:parquet 🚀 72998276 86075177 0.85
tpcds_q30/datafusion:parquet 🚀 44618678 49808731 0.90
tpcds_q31/datafusion:parquet 76215058 84659403 0.90
tpcds_q32/datafusion:parquet 🚀 22360164 25190924 0.89
tpcds_q33/datafusion:parquet 35948611 39838999 0.90
tpcds_q34/datafusion:parquet 27111800 29827380 0.91
tpcds_q35/datafusion:parquet 🚀 84467914 98276970 0.86
tpcds_q36/datafusion:parquet 🚀 65297282 74511859 0.88
tpcds_q37/datafusion:parquet 🚀 22877289 26303732 0.87
tpcds_q38/datafusion:parquet 50390474 55659069 0.91
tpcds_q39/datafusion:parquet 🚀 83361086 100804701 0.83
tpcds_q40/datafusion:parquet 28212456 29623259 0.95
tpcds_q41/datafusion:parquet 🚀 16077398 18422024 0.87
tpcds_q42/datafusion:parquet 🚀 13546941 15466739 0.88
tpcds_q43/datafusion:parquet 🚀 18688828 21525593 0.87
tpcds_q44/datafusion:parquet 🚀 41651319 46913714 0.89
tpcds_q45/datafusion:parquet 33259845 36557453 0.91
tpcds_q46/datafusion:parquet 🚀 39044753 44787223 0.87
tpcds_q47/datafusion:parquet 🚀 137752483 159731670 0.86
tpcds_q48/datafusion:parquet 🚀 77854114 91018302 0.86
tpcds_q49/datafusion:parquet 🚀 67142409 75589483 0.89
tpcds_q50/datafusion:parquet 🚀 49204731 56635126 0.87
tpcds_q51/datafusion:parquet 🚀 89849652 100741998 0.89
tpcds_q52/datafusion:parquet 🚀 15486387 17625381 0.88
tpcds_q53/datafusion:parquet 23041626 25306034 0.91
tpcds_q54/datafusion:parquet 42660515 47093997 0.91
tpcds_q55/datafusion:parquet 14884528 15387226 0.97
tpcds_q56/datafusion:parquet 35825543 39737068 0.90
tpcds_q57/datafusion:parquet 114834549 124095970 0.93
tpcds_q58/datafusion:parquet 🚀 56619469 65381790 0.87
tpcds_q59/datafusion:parquet 🚀 58371246 65903183 0.89
tpcds_q60/datafusion:parquet 36251091 39185136 0.93
tpcds_q61/datafusion:parquet 🚀 50329508 59792366 0.84
tpcds_q62/datafusion:parquet 27479107 27712053 0.99
tpcds_q63/datafusion:parquet 🚀 21629854 24177931 0.89
tpcds_q64/datafusion:parquet 🚀 552052993 622341017 0.89
tpcds_q65/datafusion:parquet 46018423 49731410 0.93
tpcds_q66/datafusion:parquet 76936276 81010321 0.95
tpcds_q67/datafusion:parquet 🚀 151383221 180513377 0.84
tpcds_q68/datafusion:parquet 40899454 45280066 0.90
tpcds_q69/datafusion:parquet 78739595 85578268 0.92
tpcds_q70/datafusion:parquet 97082586 107172618 0.91
tpcds_q71/datafusion:parquet 26366775 29090696 0.91
tpcds_q72/datafusion:parquet 🚀 636706550 769325928 0.83
tpcds_q73/datafusion:parquet 28061029 30970347 0.91
tpcds_q74/datafusion:parquet 🚀 106771507 123298354 0.87
tpcds_q75/datafusion:parquet 🚀 118608974 134352470 0.88
tpcds_q76/datafusion:parquet 🚀 35905491 40587437 0.88
tpcds_q77/datafusion:parquet 🚀 48510383 56097777 0.86
tpcds_q78/datafusion:parquet 🚀 123093344 143930955 0.86
tpcds_q79/datafusion:parquet 🚀 31241369 35613956 0.88
tpcds_q80/datafusion:parquet 🚀 89959202 108226533 0.83
tpcds_q81/datafusion:parquet 🚀 41928103 47709850 0.88
tpcds_q82/datafusion:parquet 23390028 25765497 0.91
tpcds_q83/datafusion:parquet 🚀 47536640 54408675 0.87
tpcds_q84/datafusion:parquet 47225646 51994731 0.91
tpcds_q85/datafusion:parquet 174963569 190465758 0.92
tpcds_q86/datafusion:parquet 🚀 17735298 20377768 0.87
tpcds_q87/datafusion:parquet 52284303 56804537 0.92
tpcds_q88/datafusion:parquet 🚀 70333616 79048277 0.89
tpcds_q89/datafusion:parquet 🚀 24757765 27908115 0.89
tpcds_q90/datafusion:parquet 🚀 18140955 22031499 0.82
tpcds_q91/datafusion:parquet 🚀 69017939 78433390 0.88
tpcds_q92/datafusion:parquet 🚀 23021612 25657533 0.90
tpcds_q93/datafusion:parquet 🚀 35367039 42956695 0.82
tpcds_q94/datafusion:parquet 🚀 24229227 28457048 0.85
tpcds_q95/datafusion:parquet 🚀 68816742 77275514 0.89
tpcds_q96/datafusion:parquet 🚀 14071583 16913715 0.83
tpcds_q97/datafusion:parquet 🚀 32629863 39092990 0.83
tpcds_q98/datafusion:parquet 🚀 25498656 29884031 0.85
tpcds_q99/datafusion:parquet 🚀 27875701 32007444 0.87
duckdb / vortex-file-compressed (1.003x ➖, 1↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25525772 26755976 0.95
tpcds_q02/duckdb:vortex-file-compressed 81672074 80089862 1.02
tpcds_q03/duckdb:vortex-file-compressed 23634447 25041430 0.94
tpcds_q04/duckdb:vortex-file-compressed 105057697 105158398 1.00
tpcds_q05/duckdb:vortex-file-compressed 99312851 105315752 0.94
tpcds_q06/duckdb:vortex-file-compressed 36425517 35735151 1.02
tpcds_q07/duckdb:vortex-file-compressed 24360384 24481401 1.00
tpcds_q08/duckdb:vortex-file-compressed 22980804 22845136 1.01
tpcds_q09/duckdb:vortex-file-compressed 38739955 39272852 0.99
tpcds_q10/duckdb:vortex-file-compressed 36046240 37945561 0.95
tpcds_q11/duckdb:vortex-file-compressed 61955713 61344057 1.01
tpcds_q12/duckdb:vortex-file-compressed 15004616 14362726 1.04
tpcds_q13/duckdb:vortex-file-compressed 34453142 32718596 1.05
tpcds_q14/duckdb:vortex-file-compressed 191478440 192317434 1.00
tpcds_q15/duckdb:vortex-file-compressed 40241110 40170419 1.00
tpcds_q16/duckdb:vortex-file-compressed 30937714 30756658 1.01
tpcds_q17/duckdb:vortex-file-compressed 38572261 38805632 0.99
tpcds_q18/duckdb:vortex-file-compressed 44697859 45238603 0.99
tpcds_q19/duckdb:vortex-file-compressed 33364702 32791812 1.02
tpcds_q20/duckdb:vortex-file-compressed 16116860 16674880 0.97
tpcds_q21/duckdb:vortex-file-compressed 20768759 19738543 1.05
tpcds_q22/duckdb:vortex-file-compressed 111517102 107704179 1.04
tpcds_q23/duckdb:vortex-file-compressed 126443937 128672817 0.98
tpcds_q24/duckdb:vortex-file-compressed 56037319 55810734 1.00
tpcds_q25/duckdb:vortex-file-compressed 38206550 36413161 1.05
tpcds_q26/duckdb:vortex-file-compressed 41184950 40329249 1.02
tpcds_q27/duckdb:vortex-file-compressed 87611275 86229966 1.02
tpcds_q28/duckdb:vortex-file-compressed 36300964 35383768 1.03
tpcds_q29/duckdb:vortex-file-compressed 36245626 37144423 0.98
tpcds_q30/duckdb:vortex-file-compressed 28974143 28855842 1.00
tpcds_q31/duckdb:vortex-file-compressed 26586066 26020578 1.02
tpcds_q32/duckdb:vortex-file-compressed 16704024 17224584 0.97
tpcds_q33/duckdb:vortex-file-compressed 69749253 70142443 0.99
tpcds_q34/duckdb:vortex-file-compressed 19758794 19119099 1.03
tpcds_q35/duckdb:vortex-file-compressed 63582688 63616035 1.00
tpcds_q36/duckdb:vortex-file-compressed 27445312 28716741 0.96
tpcds_q37/duckdb:vortex-file-compressed 23011024 21872229 1.05
tpcds_q38/duckdb:vortex-file-compressed 38096290 37248585 1.02
tpcds_q39/duckdb:vortex-file-compressed 45499898 45709141 1.00
tpcds_q40/duckdb:vortex-file-compressed 24240292 24587325 0.99
tpcds_q41/duckdb:vortex-file-compressed 12918238 13071191 0.99
tpcds_q42/duckdb:vortex-file-compressed 11153290 11930769 0.93
tpcds_q43/duckdb:vortex-file-compressed 20288175 20099058 1.01
tpcds_q44/duckdb:vortex-file-compressed 22157731 22812656 0.97
tpcds_q45/duckdb:vortex-file-compressed 27558590 26755354 1.03
tpcds_q46/duckdb:vortex-file-compressed 49265464 48140331 1.02
tpcds_q47/duckdb:vortex-file-compressed 49890419 48252404 1.03
tpcds_q48/duckdb:vortex-file-compressed 32439617 31927980 1.02
tpcds_q49/duckdb:vortex-file-compressed 31035386 32760742 0.95
tpcds_q50/duckdb:vortex-file-compressed 38004787 36985192 1.03
tpcds_q51/duckdb:vortex-file-compressed 102459826 98183415 1.04
tpcds_q52/duckdb:vortex-file-compressed 12639419 12078187 1.05
tpcds_q53/duckdb:vortex-file-compressed 17237040 17264646 1.00
tpcds_q54/duckdb:vortex-file-compressed 51880091 49808900 1.04
tpcds_q55/duckdb:vortex-file-compressed 12206158 11753660 1.04
tpcds_q56/duckdb:vortex-file-compressed 67087320 67289185 1.00
tpcds_q57/duckdb:vortex-file-compressed 43071163 45286031 0.95
tpcds_q58/duckdb:vortex-file-compressed 33326748 31437552 1.06
tpcds_q59/duckdb:vortex-file-compressed 61557831 60492679 1.02
tpcds_q60/duckdb:vortex-file-compressed 71504511 72928666 0.98
tpcds_q61/duckdb:vortex-file-compressed 40115856 38017926 1.06
tpcds_q62/duckdb:vortex-file-compressed 18288018 17915652 1.02
tpcds_q63/duckdb:vortex-file-compressed 17242838 17548818 0.98
tpcds_q64/duckdb:vortex-file-compressed 81263950 80096551 1.01
tpcds_q65/duckdb:vortex-file-compressed 23940915 23725305 1.01
tpcds_q66/duckdb:vortex-file-compressed 🚀 58064934 65626174 0.88
tpcds_q67/duckdb:vortex-file-compressed 152071460 146055118 1.04
tpcds_q68/duckdb:vortex-file-compressed 41659771 40922913 1.02
tpcds_q69/duckdb:vortex-file-compressed 38430801 37994903 1.01
tpcds_q70/duckdb:vortex-file-compressed 25341978 24528289 1.03
tpcds_q71/duckdb:vortex-file-compressed 20901693 20358088 1.03
tpcds_q72/duckdb:vortex-file-compressed 179060933 176136909 1.02
tpcds_q73/duckdb:vortex-file-compressed 19899435 20327051 0.98
tpcds_q74/duckdb:vortex-file-compressed 52345016 53261671 0.98
tpcds_q75/duckdb:vortex-file-compressed 60562163 58442352 1.04
tpcds_q76/duckdb:vortex-file-compressed 66856891 61596759 1.09
tpcds_q77/duckdb:vortex-file-compressed 63589164 63331567 1.00
tpcds_q78/duckdb:vortex-file-compressed 76411163 79946881 0.96
tpcds_q79/duckdb:vortex-file-compressed 42610836 42676230 1.00
tpcds_q80/duckdb:vortex-file-compressed 94060562 95656217 0.98
tpcds_q81/duckdb:vortex-file-compressed 33653978 34102933 0.99
tpcds_q82/duckdb:vortex-file-compressed 22269337 21627756 1.03
tpcds_q83/duckdb:vortex-file-compressed 28276596 29121256 0.97
tpcds_q84/duckdb:vortex-file-compressed 16962841 17040066 1.00
tpcds_q85/duckdb:vortex-file-compressed 46432372 45668738 1.02
tpcds_q86/duckdb:vortex-file-compressed 16418482 17452041 0.94
tpcds_q87/duckdb:vortex-file-compressed 41710245 39367015 1.06
tpcds_q88/duckdb:vortex-file-compressed 35434560 35321509 1.00
tpcds_q89/duckdb:vortex-file-compressed 18523136 19374793 0.96
tpcds_q90/duckdb:vortex-file-compressed 15381228 15648500 0.98
tpcds_q91/duckdb:vortex-file-compressed 27507521 28191143 0.98
tpcds_q92/duckdb:vortex-file-compressed 14218053 14655867 0.97
tpcds_q93/duckdb:vortex-file-compressed 30441637 28879468 1.05
tpcds_q94/duckdb:vortex-file-compressed 22109044 22367701 0.99
tpcds_q95/duckdb:vortex-file-compressed 157339025 163580264 0.96
tpcds_q96/duckdb:vortex-file-compressed 11658192 11822827 0.99
tpcds_q97/duckdb:vortex-file-compressed 40180767 37594524 1.07
tpcds_q98/duckdb:vortex-file-compressed 18009540 17477984 1.03
tpcds_q99/duckdb:vortex-file-compressed 32900067 32221838 1.02
duckdb / vortex-compact (1.009x ➖, 1↑ 2↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33592880 34050786 0.99
tpcds_q02/duckdb:vortex-compact 124833262 125596404 0.99
tpcds_q03/duckdb:vortex-compact 51121803 52454080 0.97
tpcds_q04/duckdb:vortex-compact 126402089 121148398 1.04
tpcds_q05/duckdb:vortex-compact 169575349 162979535 1.04
tpcds_q06/duckdb:vortex-compact 37462280 37587798 1.00
tpcds_q07/duckdb:vortex-compact 37279084 36163298 1.03
tpcds_q08/duckdb:vortex-compact 27907631 27580202 1.01
tpcds_q09/duckdb:vortex-compact 110336363 109628023 1.01
tpcds_q10/duckdb:vortex-compact 45713406 46397786 0.99
tpcds_q11/duckdb:vortex-compact 77472547 73951701 1.05
tpcds_q12/duckdb:vortex-compact 🚨 21181241 18718804 1.13
tpcds_q13/duckdb:vortex-compact 48016133 46657794 1.03
tpcds_q14/duckdb:vortex-compact 278942914 271285772 1.03
tpcds_q15/duckdb:vortex-compact 45359577 44819033 1.01
tpcds_q16/duckdb:vortex-compact 35897690 37461562 0.96
tpcds_q17/duckdb:vortex-compact 48357640 47325600 1.02
tpcds_q18/duckdb:vortex-compact 66345959 68038073 0.98
tpcds_q19/duckdb:vortex-compact 37364437 38370127 0.97
tpcds_q20/duckdb:vortex-compact 19450445 19850288 0.98
tpcds_q21/duckdb:vortex-compact 28742609 27379206 1.05
tpcds_q22/duckdb:vortex-compact 115397044 115532442 1.00
tpcds_q23/duckdb:vortex-compact 151025906 160399223 0.94
tpcds_q24/duckdb:vortex-compact 73105190 67126796 1.09
tpcds_q25/duckdb:vortex-compact 46634849 49125318 0.95
tpcds_q26/duckdb:vortex-compact 49675556 48009812 1.03
tpcds_q27/duckdb:vortex-compact 129005975 129649399 1.00
tpcds_q28/duckdb:vortex-compact 107799540 105564829 1.02
tpcds_q29/duckdb:vortex-compact 47870495 47363744 1.01
tpcds_q30/duckdb:vortex-compact 36540787 37203776 0.98
tpcds_q31/duckdb:vortex-compact 31079967 29219101 1.06
tpcds_q32/duckdb:vortex-compact 22676986 23492597 0.97
tpcds_q33/duckdb:vortex-compact 132255236 134697451 0.98
tpcds_q34/duckdb:vortex-compact 22101292 22499154 0.98
tpcds_q35/duckdb:vortex-compact 64293113 68008421 0.95
tpcds_q36/duckdb:vortex-compact 32657464 33395151 0.98
tpcds_q37/duckdb:vortex-compact 30227371 30477834 0.99
tpcds_q38/duckdb:vortex-compact 38392908 37033093 1.04
tpcds_q39/duckdb:vortex-compact 54196063 54668972 0.99
tpcds_q40/duckdb:vortex-compact 30759320 29821988 1.03
tpcds_q41/duckdb:vortex-compact 16509830 16485647 1.00
tpcds_q42/duckdb:vortex-compact 14838035 14676169 1.01
tpcds_q43/duckdb:vortex-compact 23170619 23783921 0.97
tpcds_q44/duckdb:vortex-compact 29397950 27961092 1.05
tpcds_q45/duckdb:vortex-compact 31015120 30499458 1.02
tpcds_q46/duckdb:vortex-compact 57041894 56564715 1.01
tpcds_q47/duckdb:vortex-compact 55002972 53468478 1.03
tpcds_q48/duckdb:vortex-compact 42979949 41694103 1.03
tpcds_q49/duckdb:vortex-compact 49102302 47080364 1.04
tpcds_q50/duckdb:vortex-compact 36999358 35345866 1.05
tpcds_q51/duckdb:vortex-compact 103611651 101797105 1.02
tpcds_q52/duckdb:vortex-compact 15279105 15226605 1.00
tpcds_q53/duckdb:vortex-compact 21276208 21853473 0.97
tpcds_q54/duckdb:vortex-compact 83872209 82352430 1.02
tpcds_q55/duckdb:vortex-compact 14917608 14168635 1.05
tpcds_q56/duckdb:vortex-compact 130490760 130948497 1.00
tpcds_q57/duckdb:vortex-compact 🚀 47443074 54314245 0.87
tpcds_q58/duckdb:vortex-compact 🚨 45796421 40989283 1.12
tpcds_q59/duckdb:vortex-compact 78141886 75262678 1.04
tpcds_q60/duckdb:vortex-compact 132960522 132939417 1.00
tpcds_q61/duckdb:vortex-compact 46537142 45595265 1.02
tpcds_q62/duckdb:vortex-compact 21769356 22055992 0.99
tpcds_q63/duckdb:vortex-compact 21707051 20409807 1.06
tpcds_q64/duckdb:vortex-compact 101019970 97074931 1.04
tpcds_q65/duckdb:vortex-compact 28586347 26176223 1.09
tpcds_q66/duckdb:vortex-compact 97879409 95540352 1.02
tpcds_q67/duckdb:vortex-compact 150516836 150597427 1.00
tpcds_q68/duckdb:vortex-compact 51003084 50840287 1.00
tpcds_q69/duckdb:vortex-compact 46486054 45680603 1.02
tpcds_q70/duckdb:vortex-compact 26808460 27430682 0.98
tpcds_q71/duckdb:vortex-compact 24531700 24952761 0.98
tpcds_q72/duckdb:vortex-compact 200789043 199123368 1.01
tpcds_q73/duckdb:vortex-compact 21611881 21926273 0.99
tpcds_q74/duckdb:vortex-compact 56557089 54072441 1.05
tpcds_q75/duckdb:vortex-compact 70057841 72934199 0.96
tpcds_q76/duckdb:vortex-compact 125872019 124819449 1.01
tpcds_q77/duckdb:vortex-compact 134398425 127465123 1.05
tpcds_q78/duckdb:vortex-compact 83856662 91179633 0.92
tpcds_q79/duckdb:vortex-compact 69278081 72709279 0.95
tpcds_q80/duckdb:vortex-compact 165776824 162696957 1.02
tpcds_q81/duckdb:vortex-compact 40750590 39629699 1.03
tpcds_q82/duckdb:vortex-compact 31557862 31406462 1.00
tpcds_q83/duckdb:vortex-compact 45841622 45235600 1.01
tpcds_q84/duckdb:vortex-compact 20548127 21455013 0.96
tpcds_q85/duckdb:vortex-compact 64337845 58653993 1.10
tpcds_q86/duckdb:vortex-compact 19366842 20208918 0.96
tpcds_q87/duckdb:vortex-compact 42279622 41967765 1.01
tpcds_q88/duckdb:vortex-compact 34135653 34255504 1.00
tpcds_q89/duckdb:vortex-compact 21953481 21669843 1.01
tpcds_q90/duckdb:vortex-compact 15833336 15769120 1.00
tpcds_q91/duckdb:vortex-compact 46572924 44417815 1.05
tpcds_q92/duckdb:vortex-compact 19474942 19627163 0.99
tpcds_q93/duckdb:vortex-compact 36780897 35583717 1.03
tpcds_q94/duckdb:vortex-compact 27006060 26149663 1.03
tpcds_q95/duckdb:vortex-compact 158346037 147067188 1.08
tpcds_q96/duckdb:vortex-compact 11929952 11355629 1.05
tpcds_q97/duckdb:vortex-compact 39360829 40455298 0.97
tpcds_q98/duckdb:vortex-compact 22507650 22599459 1.00
tpcds_q99/duckdb:vortex-compact 35499882 35783694 0.99
duckdb / parquet (1.006x ➖, 0↑ 3↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44865484 45011645 1.00
tpcds_q02/duckdb:parquet 57804277 63682859 0.91
tpcds_q03/duckdb:parquet 12386235 11870539 1.04
tpcds_q04/duckdb:parquet 125596800 121482368 1.03
tpcds_q05/duckdb:parquet 70918247 71459791 0.99
tpcds_q06/duckdb:parquet 28662794 27686586 1.04
tpcds_q07/duckdb:parquet 23472106 23334348 1.01
tpcds_q08/duckdb:parquet 27189993 28939674 0.94
tpcds_q09/duckdb:parquet 39301631 39470749 1.00
tpcds_q10/duckdb:parquet 34313222 34606922 0.99
tpcds_q11/duckdb:parquet 90062918 88799009 1.01
tpcds_q12/duckdb:parquet 14317848 14168878 1.01
tpcds_q13/duckdb:parquet 33453922 33942551 0.99
tpcds_q14/duckdb:parquet 160228021 160228935 1.00
tpcds_q15/duckdb:parquet 30754812 29123917 1.06
tpcds_q16/duckdb:parquet 20637749 21693777 0.95
tpcds_q17/duckdb:parquet 37064220 36457758 1.02
tpcds_q18/duckdb:parquet 46045221 45887321 1.00
tpcds_q19/duckdb:parquet 29184050 30274644 0.96
tpcds_q20/duckdb:parquet 14950277 15073639 0.99
tpcds_q21/duckdb:parquet 11249203 11070581 1.02
tpcds_q22/duckdb:parquet 69577246 67465636 1.03
tpcds_q23/duckdb:parquet 119188380 112933365 1.06
tpcds_q24/duckdb:parquet 45519808 45730591 1.00
tpcds_q25/duckdb:parquet 33083085 32453025 1.02
tpcds_q26/duckdb:parquet 34499527 36689268 0.94
tpcds_q27/duckdb:parquet 87534285 88498081 0.99
tpcds_q28/duckdb:parquet 37178355 37390795 0.99
tpcds_q29/duckdb:parquet 36673768 36552921 1.00
tpcds_q30/duckdb:parquet 39840282 40142227 0.99
tpcds_q31/duckdb:parquet 21152036 23043254 0.92
tpcds_q32/duckdb:parquet 11660706 11598212 1.01
tpcds_q33/duckdb:parquet 71974592 70357821 1.02
tpcds_q34/duckdb:parquet 20845469 20563991 1.01
tpcds_q35/duckdb:parquet 57521287 57558800 1.00
tpcds_q36/duckdb:parquet 20624803 20270484 1.02
tpcds_q37/duckdb:parquet 13157835 12888070 1.02
tpcds_q38/duckdb:parquet 32779363 33414893 0.98
tpcds_q39/duckdb:parquet 33345219 32544973 1.02
tpcds_q40/duckdb:parquet 17437408 17420600 1.00
tpcds_q41/duckdb:parquet 7315561 7456427 0.98
tpcds_q42/duckdb:parquet 10593133 10311838 1.03
tpcds_q43/duckdb:parquet 15429448 15629357 0.99
tpcds_q44/duckdb:parquet 🚨 24037428 21034771 1.14
tpcds_q45/duckdb:parquet 26288463 26283782 1.00
tpcds_q46/duckdb:parquet 44427950 44855906 0.99
tpcds_q47/duckdb:parquet 45358010 45415824 1.00
tpcds_q48/duckdb:parquet 30822768 30149279 1.02
tpcds_q49/duckdb:parquet 23730302 24080932 0.99
tpcds_q50/duckdb:parquet 24421123 23926286 1.02
tpcds_q51/duckdb:parquet 94086749 95610941 0.98
tpcds_q52/duckdb:parquet 10769034 10725068 1.00
tpcds_q53/duckdb:parquet 15974241 15997542 1.00
tpcds_q54/duckdb:parquet 🚨 41031422 35516584 1.16
tpcds_q55/duckdb:parquet 10938939 10566397 1.04
tpcds_q56/duckdb:parquet 68320478 66571299 1.03
tpcds_q57/duckdb:parquet 34825393 35839942 0.97
tpcds_q58/duckdb:parquet 21360547 20992046 1.02
tpcds_q59/duckdb:parquet 36404698 36558389 1.00
tpcds_q60/duckdb:parquet 71903062 74029606 0.97
tpcds_q61/duckdb:parquet 31776984 30636565 1.04
tpcds_q62/duckdb:parquet 11909444 11548230 1.03
tpcds_q63/duckdb:parquet 14969558 14967536 1.00
tpcds_q64/duckdb:parquet 73259413 77244804 0.95
tpcds_q65/duckdb:parquet 19918477 20251287 0.98
tpcds_q66/duckdb:parquet 55904714 57706719 0.97
tpcds_q67/duckdb:parquet 134721127 135844122 0.99
tpcds_q68/duckdb:parquet 37562800 37103698 1.01
tpcds_q69/duckdb:parquet 36814130 37580696 0.98
tpcds_q70/duckdb:parquet 19442068 19563226 0.99
tpcds_q71/duckdb:parquet 18604535 18792023 0.99
tpcds_q72/duckdb:parquet 164589989 166116365 0.99
tpcds_q73/duckdb:parquet 18542257 18117751 1.02
tpcds_q74/duckdb:parquet 49234829 50182269 0.98
tpcds_q75/duckdb:parquet 53545212 52822158 1.01
tpcds_q76/duckdb:parquet 67180445 67830287 0.99
tpcds_q77/duckdb:parquet 62214778 57648618 1.08
tpcds_q78/duckdb:parquet 74372497 74284985 1.00
tpcds_q79/duckdb:parquet 27981766 27105435 1.03
tpcds_q80/duckdb:parquet 83394308 80362585 1.04
tpcds_q81/duckdb:parquet 47021487 46893999 1.00
tpcds_q82/duckdb:parquet 15349520 15301805 1.00
tpcds_q83/duckdb:parquet 15762721 16028885 0.98
tpcds_q84/duckdb:parquet 20232043 19024282 1.06
tpcds_q85/duckdb:parquet 39698244 38889836 1.02
tpcds_q86/duckdb:parquet 12288817 13077199 0.94
tpcds_q87/duckdb:parquet 36641585 35203753 1.04
tpcds_q88/duckdb:parquet 29038822 28620000 1.01
tpcds_q89/duckdb:parquet 17151908 17073446 1.00
tpcds_q90/duckdb:parquet 7078478 7048244 1.00
tpcds_q91/duckdb:parquet 22889905 23320612 0.98
tpcds_q92/duckdb:parquet 11167159 11349929 0.98
tpcds_q93/duckdb:parquet 29974686 29203995 1.03
tpcds_q94/duckdb:parquet 15776141 16271063 0.97
tpcds_q95/duckdb:parquet 🚨 143323247 119471098 1.20
tpcds_q96/duckdb:parquet 9321415 9148686 1.02
tpcds_q97/duckdb:parquet 34604468 34398586 1.01
tpcds_q98/duckdb:parquet 18333330 17918104 1.02
tpcds_q99/duckdb:parquet 19389820 19325095 1.00
duckdb / duckdb (1.091x ➖, 0↑ 49↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19961946 19278577 1.04
tpcds_q02/duckdb:duckdb 18731976 18542107 1.01
tpcds_q03/duckdb:duckdb 8137591 7996814 1.02
tpcds_q04/duckdb:duckdb 160734109 160777413 1.00
tpcds_q05/duckdb:duckdb 17679646 17133964 1.03
tpcds_q06/duckdb:duckdb 21585777 22263834 0.97
tpcds_q07/duckdb:duckdb 38411988 37529346 1.02
tpcds_q08/duckdb:duckdb 119971195 119720658 1.00
tpcds_q09/duckdb:duckdb 19427526 19449810 1.00
tpcds_q10/duckdb:duckdb 22816341 22863657 1.00
tpcds_q11/duckdb:duckdb 136658038 140302113 0.97
tpcds_q12/duckdb:duckdb 11906559 11193734 1.06
tpcds_q13/duckdb:duckdb 24021503 23808275 1.01
tpcds_q14/duckdb:duckdb 93120537 92686691 1.00
tpcds_q15/duckdb:duckdb 24022225 24503215 0.98
tpcds_q16/duckdb:duckdb 16417706 17795220 0.92
tpcds_q17/duckdb:duckdb 22044627 21500111 1.03
tpcds_q18/duckdb:duckdb 42727262 43147912 0.99
tpcds_q19/duckdb:duckdb 16254331 16083647 1.01
tpcds_q20/duckdb:duckdb 🚨 13260214 11567471 1.15
tpcds_q21/duckdb:duckdb 🚨 7321316 6398826 1.14
tpcds_q22/duckdb:duckdb 🚨 70446788 58047970 1.21
tpcds_q23/duckdb:duckdb 🚨 86526872 74856950 1.16
tpcds_q24/duckdb:duckdb 🚨 25253895 22925152 1.10
tpcds_q25/duckdb:duckdb 17044383 16365280 1.04
tpcds_q26/duckdb:duckdb 🚨 29261686 25215470 1.16
tpcds_q27/duckdb:duckdb 40338494 39071032 1.03
tpcds_q28/duckdb:duckdb 23227871 21485219 1.08
tpcds_q29/duckdb:duckdb 21174514 19611059 1.08
tpcds_q30/duckdb:duckdb 29234779 27686509 1.06
tpcds_q31/duckdb:duckdb 🚨 22328141 19510380 1.14
tpcds_q32/duckdb:duckdb 7313253 6988315 1.05
tpcds_q33/duckdb:duckdb 🚨 13747687 12176768 1.13
tpcds_q34/duckdb:duckdb 15691318 14669373 1.07
tpcds_q35/duckdb:duckdb 🚨 36435228 31461013 1.16
tpcds_q36/duckdb:duckdb 75440491 69186988 1.09
tpcds_q37/duckdb:duckdb 🚨 8050058 7209304 1.12
tpcds_q38/duckdb:duckdb 33263280 30578629 1.09
tpcds_q39/duckdb:duckdb 27468769 28908725 0.95
tpcds_q40/duckdb:duckdb 14269315 13583306 1.05
tpcds_q41/duckdb:duckdb 🚨 8978094 7824018 1.15
tpcds_q42/duckdb:duckdb 6592447 6295688 1.05
tpcds_q43/duckdb:duckdb 🚨 12179967 10877273 1.12
tpcds_q44/duckdb:duckdb 🚨 14863805 13075064 1.14
tpcds_q45/duckdb:duckdb 🚨 18437930 16017466 1.15
tpcds_q46/duckdb:duckdb 🚨 40154050 35655831 1.13
tpcds_q47/duckdb:duckdb 🚨 45948306 40225211 1.14
tpcds_q48/duckdb:duckdb 23629747 21631979 1.09
tpcds_q49/duckdb:duckdb 🚨 19122253 16207342 1.18
tpcds_q50/duckdb:duckdb 🚨 16269151 13444048 1.21
tpcds_q51/duckdb:duckdb 🚨 100187964 90685783 1.10
tpcds_q52/duckdb:duckdb 🚨 7858427 7108951 1.11
tpcds_q53/duckdb:duckdb 12928224 11859899 1.09
tpcds_q54/duckdb:duckdb 17347702 16545345 1.05
tpcds_q55/duckdb:duckdb 🚨 7675971 6878255 1.12
tpcds_q56/duckdb:duckdb 14668739 13695617 1.07
tpcds_q57/duckdb:duckdb 🚨 34896381 31289300 1.12
tpcds_q58/duckdb:duckdb 🚨 13939463 11753900 1.19
tpcds_q59/duckdb:duckdb 🚨 37756616 34003801 1.11
tpcds_q60/duckdb:duckdb 🚨 16244587 14209333 1.14
tpcds_q61/duckdb:duckdb 🚨 16063886 13927410 1.15
tpcds_q62/duckdb:duckdb 🚨 9853087 8883006 1.11
tpcds_q63/duckdb:duckdb 11880753 11592869 1.02
tpcds_q64/duckdb:duckdb 58116950 53147378 1.09
tpcds_q65/duckdb:duckdb 🚨 34841811 30881325 1.13
tpcds_q66/duckdb:duckdb 25186697 24535512 1.03
tpcds_q67/duckdb:duckdb 🚨 148136835 124989959 1.19
tpcds_q68/duckdb:duckdb 🚨 28247196 24718294 1.14
tpcds_q69/duckdb:duckdb 🚨 25893242 23281631 1.11
tpcds_q70/duckdb:duckdb 15161308 13844081 1.10
tpcds_q71/duckdb:duckdb 🚨 14158688 12297621 1.15
tpcds_q72/duckdb:duckdb 44705151 42950860 1.04
tpcds_q73/duckdb:duckdb 🚨 11201889 10070000 1.11
tpcds_q74/duckdb:duckdb 🚨 106101556 95772281 1.11
tpcds_q75/duckdb:duckdb 🚨 46857019 40520966 1.16
tpcds_q76/duckdb:duckdb 🚨 13213920 11750471 1.12
tpcds_q77/duckdb:duckdb 🚨 13257637 11580496 1.14
tpcds_q78/duckdb:duckdb 🚨 69868459 61075564 1.14
tpcds_q79/duckdb:duckdb 🚨 20710877 17360003 1.19
tpcds_q80/duckdb:duckdb 🚨 31829459 26303625 1.21
tpcds_q81/duckdb:duckdb 39363076 37520365 1.05
tpcds_q82/duckdb:duckdb 8910978 8175505 1.09
tpcds_q83/duckdb:duckdb 10047456 9221199 1.09
tpcds_q84/duckdb:duckdb 14849220 13639009 1.09
tpcds_q85/duckdb:duckdb 🚨 26913771 23366502 1.15
tpcds_q86/duckdb:duckdb 🚨 11871086 10230821 1.16
tpcds_q87/duckdb:duckdb 36773750 34006496 1.08
tpcds_q88/duckdb:duckdb 25943973 23833094 1.09
tpcds_q89/duckdb:duckdb 🚨 15025710 12981244 1.16
tpcds_q90/duckdb:duckdb 🚨 6131221 5358250 1.14
tpcds_q91/duckdb:duckdb 🚨 13673226 12263003 1.11
tpcds_q92/duckdb:duckdb 9502285 8676541 1.10
tpcds_q93/duckdb:duckdb 🚨 25568658 21105345 1.21
tpcds_q94/duckdb:duckdb 14520843 13907885 1.04
tpcds_q95/duckdb:duckdb 118913251 125811702 0.95
tpcds_q96/duckdb:duckdb 🚨 5238575 4351249 1.20
tpcds_q97/duckdb:duckdb 🚨 35304789 30480729 1.16
tpcds_q98/duckdb:duckdb 🚨 15539031 12779947 1.22
tpcds_q99/duckdb:duckdb 17634284 16351086 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.7% -4.9% -9.2% +15.0% ➖ noise
1 datafusion:vortex-file-compressed -16.1% -4.9% -11.8% +11.1% ✅ faster
1 duckdb:duckdb +3.5% -4.9% +8.9% +14.1% ➖ noise
1 duckdb:vortex-compact -1.3% -4.9% +3.7% +13.9% ➖ noise
1 duckdb:vortex-file-compressed -4.6% -4.9% +0.3% +14.0% ➖ noise
2 datafusion:vortex-compact -13.1% -9.5% -3.9% +10.2% ➖ noise
2 datafusion:vortex-file-compressed -15.2% -9.5% -6.3% +10.0% ➖ noise
2 duckdb:duckdb +1.0% -9.5% +11.7% +11.2% 🚨 regression
2 duckdb:vortex-compact -0.6% -9.5% +9.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.0% -9.5% +12.7% +11.2% 🚨 regression
3 datafusion:vortex-compact -10.0% -6.5% -3.8% +13.2% ➖ noise
3 datafusion:vortex-file-compressed -18.6% -6.5% -13.0% +12.0% ✅ faster
3 duckdb:duckdb +1.8% -6.5% +8.8% +18.8% ➖ noise
3 duckdb:vortex-compact -2.5% -6.5% +4.2% +10.6% ➖ noise
3 duckdb:vortex-file-compressed -5.6% -6.5% +0.9% +13.5% ➖ noise
4 datafusion:vortex-compact -16.8% -6.7% -10.9% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -16.0% -6.7% -10.0% +10.0% ✅ faster
4 duckdb:duckdb -0.0% -6.7% +7.1% +10.0% ➖ noise
4 duckdb:vortex-compact +4.3% -6.7% +11.8% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed -0.1% -6.7% +7.0% +10.0% ➖ noise
5 datafusion:vortex-compact -14.7% -8.9% -6.4% +10.7% ➖ noise
5 datafusion:vortex-file-compressed -16.2% -8.9% -8.0% +11.0% ➖ noise
5 duckdb:duckdb +3.2% -8.9% +13.3% +18.3% ➖ noise
5 duckdb:vortex-compact +4.0% -8.9% +14.2% +14.4% ➖ noise
5 duckdb:vortex-file-compressed -5.7% -8.9% +3.5% +10.2% ➖ noise
6 datafusion:vortex-compact -16.3% +0.1% -16.3% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -16.3% +0.1% -16.4% +10.0% ✅ faster
6 duckdb:duckdb -3.0% +0.1% -3.1% +13.3% ➖ noise
6 duckdb:vortex-compact -0.3% +0.1% -0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% +0.1% +1.8% +10.0% ➖ noise
7 datafusion:vortex-compact -17.8% -4.5% -13.9% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -17.1% -4.5% -13.2% +10.0% ✅ faster
7 duckdb:duckdb +2.4% -4.5% +7.1% +18.9% ➖ noise
7 duckdb:vortex-compact +3.1% -4.5% +7.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.5% -4.5% +4.2% +10.0% ➖ noise
8 datafusion:vortex-compact -12.1% -7.9% -4.6% +10.3% ➖ noise
8 datafusion:vortex-file-compressed -16.6% -7.9% -9.5% +16.5% ➖ noise
8 duckdb:duckdb +0.2% -7.9% +8.8% +10.1% ➖ noise
8 duckdb:vortex-compact +1.2% -7.9% +9.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.6% -7.9% +9.2% +10.0% ➖ noise
9 datafusion:vortex-compact -24.0% -4.0% -20.8% +10.0% ✅ faster
9 datafusion:vortex-file-compressed -13.4% -4.0% -9.8% +10.0% ✅ faster
9 duckdb:duckdb -0.1% -4.0% +4.1% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -4.0% +4.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% -4.0% +2.8% +10.0% ➖ noise
10 datafusion:vortex-compact -10.5% -3.5% -7.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -15.9% -3.5% -12.8% +10.0% ✅ faster
10 duckdb:duckdb -0.2% -3.5% +3.4% +10.0% ➖ noise
10 duckdb:vortex-compact -1.5% -3.5% +2.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.0% -3.5% -1.5% +10.0% ➖ noise
11 datafusion:vortex-compact -17.3% -6.7% -11.4% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -16.6% -6.7% -10.6% +10.0% ✅ faster
11 duckdb:duckdb -2.6% -6.7% +4.4% +10.0% ➖ noise
11 duckdb:vortex-compact +4.8% -6.7% +12.3% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +1.0% -6.7% +8.3% +10.8% ➖ noise
12 datafusion:vortex-compact -16.0% -3.4% -13.1% +10.7% ✅ faster
12 datafusion:vortex-file-compressed -16.0% -3.4% -13.1% +14.2% ✅ faster
12 duckdb:duckdb +6.4% -3.4% +10.1% +15.4% ➖ noise
12 duckdb:vortex-compact +13.2% -3.4% +17.1% +29.4% ➖ noise
12 duckdb:vortex-file-compressed +4.5% -3.4% +8.1% +14.1% ➖ noise
13 datafusion:vortex-compact -11.5% -5.4% -6.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -11.9% -5.4% -6.9% +10.0% ➖ noise
13 duckdb:duckdb +0.9% -5.4% +6.7% +10.0% ➖ noise
13 duckdb:vortex-compact +2.9% -5.4% +8.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +5.3% -5.4% +11.3% +10.9% 🚨 regression
14 datafusion:vortex-compact -14.9% -7.2% -8.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -14.0% -7.2% -7.3% +10.0% ➖ noise
14 duckdb:duckdb +0.5% -7.2% +8.2% +10.0% ➖ noise
14 duckdb:vortex-compact +2.8% -7.2% +10.8% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed -0.4% -7.2% +7.3% +10.6% ➖ noise
15 datafusion:vortex-compact -14.7% -4.7% -10.5% +10.0% ✅ faster
15 datafusion:vortex-file-compressed -17.5% -4.7% -13.4% +12.2% ✅ faster
15 duckdb:duckdb -2.0% -4.7% +2.9% +15.1% ➖ noise
15 duckdb:vortex-compact +1.2% -4.7% +6.2% +14.1% ➖ noise
15 duckdb:vortex-file-compressed +0.2% -4.7% +5.1% +18.1% ➖ noise
16 datafusion:vortex-compact -13.4% -9.5% -4.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -16.0% -9.5% -7.3% +10.1% ➖ noise
16 duckdb:duckdb -7.7% -9.5% +1.9% +16.4% ➖ noise
16 duckdb:vortex-compact -4.2% -9.5% +5.8% +16.3% ➖ noise
16 duckdb:vortex-file-compressed +0.6% -9.5% +11.1% +10.0% 🚨 regression
17 datafusion:vortex-compact -14.0% -5.5% -9.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -14.3% -5.5% -9.3% +10.0% ✅ faster
17 duckdb:duckdb +2.5% -5.5% +8.5% +10.0% ➖ noise
17 duckdb:vortex-compact +2.2% -5.5% +8.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.6% -5.5% +5.2% +10.0% ➖ noise
18 datafusion:vortex-compact -12.0% -4.3% -8.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -15.2% -4.3% -11.4% +10.0% ✅ faster
18 duckdb:duckdb -1.0% -4.3% +3.5% +12.2% ➖ noise
18 duckdb:vortex-compact -2.5% -4.3% +1.9% +10.2% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -4.3% +3.2% +11.4% ➖ noise
19 datafusion:vortex-compact -11.1% -8.0% -3.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -11.3% -8.0% -3.6% +10.0% ➖ noise
19 duckdb:duckdb +1.1% -8.0% +9.9% +10.1% ➖ noise
19 duckdb:vortex-compact -2.6% -8.0% +5.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.7% -8.0% +10.6% +10.0% 🚨 regression
20 datafusion:vortex-compact -11.4% -6.0% -5.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -10.6% -6.0% -4.9% +10.0% ➖ noise
20 duckdb:duckdb +14.6% -6.0% +22.0% +16.1% 🚨 regression
20 duckdb:vortex-compact -2.0% -6.0% +4.3% +15.7% ➖ noise
20 duckdb:vortex-file-compressed -3.3% -6.0% +2.8% +11.6% ➖ noise
21 datafusion:vortex-compact -14.9% -5.6% -9.8% +10.4% ✅ faster
21 datafusion:vortex-file-compressed -15.1% -5.6% -10.1% +11.0% ✅ faster
21 duckdb:duckdb +14.4% -5.6% +21.2% +24.4% ➖ noise
21 duckdb:vortex-compact +5.0% -5.6% +11.2% +11.7% ➖ noise
21 duckdb:vortex-file-compressed +5.2% -5.6% +11.5% +11.7% ➖ noise
22 datafusion:vortex-compact -17.8% -8.2% -10.5% +13.0% ➖ noise
22 datafusion:vortex-file-compressed -19.3% -8.2% -12.2% +11.9% ✅ faster
22 duckdb:duckdb +21.4% -8.2% +32.2% +11.8% 🚨 regression
22 duckdb:vortex-compact -0.1% -8.2% +8.8% +10.3% ➖ noise
22 duckdb:vortex-file-compressed +3.5% -8.2% +12.8% +10.3% 🚨 regression
23 datafusion:vortex-compact -15.2% -5.9% -9.9% +10.0% ✅ faster
23 datafusion:vortex-file-compressed -15.7% -5.9% -10.4% +10.0% ✅ faster
23 duckdb:duckdb +15.6% -5.9% +22.8% +15.0% 🚨 regression
23 duckdb:vortex-compact -5.8% -5.9% +0.0% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -1.7% -5.9% +4.4% +10.0% ➖ noise
24 datafusion:vortex-compact -13.3% -7.9% -5.9% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -16.0% -7.9% -8.9% +10.0% ➖ noise
24 duckdb:duckdb +10.2% -7.9% +19.6% +10.0% 🚨 regression
24 duckdb:vortex-compact +8.9% -7.9% +18.2% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed +0.4% -7.9% +9.0% +10.0% ➖ noise
25 datafusion:vortex-compact -9.3% -7.1% -2.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -16.0% -7.1% -9.6% +10.0% ✅ faster
25 duckdb:duckdb +4.1% -7.1% +12.1% +10.7% 🚨 regression
25 duckdb:vortex-compact -5.1% -7.1% +2.2% +12.1% ➖ noise
25 duckdb:vortex-file-compressed +4.9% -7.1% +13.0% +10.0% 🚨 regression
26 datafusion:vortex-compact -10.7% -9.2% -1.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -14.8% -9.2% -6.1% +10.0% ➖ noise
26 duckdb:duckdb +16.0% -9.2% +27.8% +13.1% 🚨 regression
26 duckdb:vortex-compact +3.5% -9.2% +14.0% +16.2% ➖ noise
26 duckdb:vortex-file-compressed +2.1% -9.2% +12.5% +10.0% 🚨 regression
27 datafusion:vortex-compact -13.9% -7.9% -6.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -15.4% -7.9% -8.1% +10.0% ➖ noise
27 duckdb:duckdb +3.2% -7.9% +12.1% +14.9% ➖ noise
27 duckdb:vortex-compact -0.5% -7.9% +8.0% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.6% -7.9% +10.3% +10.0% 🚨 regression
28 datafusion:vortex-compact -13.3% -8.3% -5.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -10.2% -8.3% -2.1% +10.0% ➖ noise
28 duckdb:duckdb +8.1% -8.3% +17.9% +10.0% 🚨 regression
28 duckdb:vortex-compact +2.1% -8.3% +11.3% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +2.6% -8.3% +11.8% +10.0% 🚨 regression
29 datafusion:vortex-compact -13.2% -7.8% -5.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -14.8% -7.8% -7.7% +11.3% ➖ noise
29 duckdb:duckdb +8.0% -7.8% +17.1% +10.4% 🚨 regression
29 duckdb:vortex-compact +1.1% -7.8% +9.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.4% -7.8% +5.8% +10.0% ➖ noise
30 datafusion:vortex-compact -14.8% -5.7% -9.6% +10.0% ✅ faster
30 datafusion:vortex-file-compressed -9.9% -5.7% -4.5% +10.0% ➖ noise
30 duckdb:duckdb +5.6% -5.7% +12.0% +10.0% 🚨 regression
30 duckdb:vortex-compact -1.8% -5.7% +4.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.4% -5.7% +6.5% +10.0% ➖ noise
31 datafusion:vortex-compact -13.4% -9.1% -4.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -12.0% -9.1% -3.2% +10.0% ➖ noise
31 duckdb:duckdb +14.4% -9.1% +25.9% +11.8% 🚨 regression
31 duckdb:vortex-compact +6.4% -9.1% +17.0% +10.0% 🚨 regression
31 duckdb:vortex-file-compressed +2.2% -9.1% +12.4% +14.5% ➖ noise
32 datafusion:vortex-compact -10.9% -5.5% -5.6% +17.9% ➖ noise
32 datafusion:vortex-file-compressed -11.6% -5.5% -6.4% +18.3% ➖ noise
32 duckdb:duckdb +4.6% -5.5% +10.8% +19.5% ➖ noise
32 duckdb:vortex-compact -3.5% -5.5% +2.2% +19.5% ➖ noise
32 duckdb:vortex-file-compressed -3.0% -5.5% +2.7% +18.2% ➖ noise
33 datafusion:vortex-compact -10.4% -3.9% -6.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -11.5% -3.9% -7.9% +10.0% ➖ noise
33 duckdb:duckdb +12.9% -3.9% +17.5% +13.2% 🚨 regression
33 duckdb:vortex-compact -1.8% -3.9% +2.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.6% -3.9% +3.5% +10.2% ➖ noise
34 datafusion:vortex-compact -10.7% -4.0% -7.0% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -12.4% -4.0% -8.7% +10.0% ➖ noise
34 duckdb:duckdb +7.0% -4.0% +11.4% +10.0% 🚨 regression
34 duckdb:vortex-compact -1.8% -4.0% +2.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +3.3% -4.0% +7.7% +10.0% ➖ noise
35 datafusion:vortex-compact -11.9% -7.3% -5.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -9.1% -7.3% -1.9% +10.0% ➖ noise
35 duckdb:duckdb +15.8% -7.3% +25.0% +14.4% 🚨 regression
35 duckdb:vortex-compact -5.5% -7.3% +2.0% +11.7% ➖ noise
35 duckdb:vortex-file-compressed -0.1% -7.3% +7.8% +11.1% ➖ noise
36 datafusion:vortex-compact -13.6% -5.6% -8.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -13.9% -5.6% -8.8% +10.0% ➖ noise
36 duckdb:duckdb +9.0% -5.6% +15.5% +10.1% 🚨 regression
36 duckdb:vortex-compact -2.2% -5.6% +3.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -4.4% -5.6% +1.2% +22.5% ➖ noise
37 datafusion:vortex-compact -17.4% -5.8% -12.3% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -18.9% -5.8% -13.9% +11.0% ✅ faster
37 duckdb:duckdb +11.7% -5.8% +18.5% +17.9% 🚨 regression
37 duckdb:vortex-compact -0.8% -5.8% +5.3% +11.7% ➖ noise
37 duckdb:vortex-file-compressed +5.2% -5.8% +11.6% +14.9% ➖ noise
38 datafusion:vortex-compact -9.9% -5.8% -4.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -13.7% -5.8% -8.4% +10.0% ➖ noise
38 duckdb:duckdb +8.8% -5.8% +15.4% +12.7% 🚨 regression
38 duckdb:vortex-compact +3.7% -5.8% +10.0% +15.2% ➖ noise
38 duckdb:vortex-file-compressed +2.3% -5.8% +8.5% +11.3% ➖ noise
39 datafusion:vortex-compact -18.5% -8.0% -11.4% +17.4% ➖ noise
39 datafusion:vortex-file-compressed -21.6% -8.0% -14.8% +12.3% ✅ faster
39 duckdb:duckdb -5.0% -8.0% +3.2% +14.6% ➖ noise
39 duckdb:vortex-compact -0.9% -8.0% +7.7% +12.1% ➖ noise
39 duckdb:vortex-file-compressed -0.5% -8.0% +8.1% +20.9% ➖ noise
40 datafusion:vortex-compact -14.4% -2.4% -12.3% +10.0% ✅ faster
40 datafusion:vortex-file-compressed -14.1% -2.4% -12.1% +10.0% ✅ faster
40 duckdb:duckdb +5.1% -2.4% +7.6% +18.4% ➖ noise
40 duckdb:vortex-compact +3.1% -2.4% +5.6% +12.5% ➖ noise
40 duckdb:vortex-file-compressed -1.4% -2.4% +1.0% +12.7% ➖ noise
41 datafusion:vortex-compact -18.4% -7.5% -11.8% +13.5% ➖ noise
41 datafusion:vortex-file-compressed -21.0% -7.5% -14.6% +10.0% ✅ faster
41 duckdb:duckdb +14.8% -7.5% +24.0% +10.5% 🚨 regression
41 duckdb:vortex-compact +0.1% -7.5% +8.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -1.2% -7.5% +6.8% +10.0% ➖ noise
42 datafusion:vortex-compact -11.6% -5.1% -6.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -12.2% -5.1% -7.4% +10.0% ➖ noise
42 duckdb:duckdb +4.7% -5.1% +10.4% +14.2% ➖ noise
42 duckdb:vortex-compact +1.1% -5.1% +6.6% +10.2% ➖ noise
42 duckdb:vortex-file-compressed -6.5% -5.1% -1.4% +15.7% ➖ noise
43 datafusion:vortex-compact -12.8% -7.4% -5.8% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -16.2% -7.4% -9.4% +10.0% ✅ faster
43 duckdb:duckdb +12.0% -7.4% +21.0% +10.2% 🚨 regression
43 duckdb:vortex-compact -2.6% -7.4% +5.2% +14.3% ➖ noise
43 duckdb:vortex-file-compressed +0.9% -7.4% +9.0% +10.1% ➖ noise
44 datafusion:vortex-compact -13.1% +0.7% -13.8% +10.0% ✅ faster
44 datafusion:vortex-file-compressed -15.3% +0.7% -15.9% +10.3% ✅ faster
44 duckdb:duckdb +13.7% +0.7% +12.9% +10.0% 🚨 regression
44 duckdb:vortex-compact +5.1% +0.7% +4.4% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -2.9% +0.7% -3.6% +13.1% ➖ noise
45 datafusion:vortex-compact -12.0% -4.6% -7.8% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -12.8% -4.6% -8.6% +10.0% ➖ noise
45 duckdb:duckdb +15.1% -4.6% +20.7% +11.8% 🚨 regression
45 duckdb:vortex-compact +1.7% -4.6% +6.6% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +3.0% -4.6% +8.0% +20.0% ➖ noise
46 datafusion:vortex-compact -8.2% -7.1% -1.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -14.1% -7.1% -7.6% +10.0% ➖ noise
46 duckdb:duckdb +12.6% -7.1% +21.2% +10.0% 🚨 regression
46 duckdb:vortex-compact +0.8% -7.1% +8.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.3% -7.1% +10.1% +10.0% 🚨 regression
47 datafusion:vortex-compact -15.5% -7.2% -8.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -19.0% -7.2% -12.7% +10.0% ✅ faster
47 duckdb:duckdb +14.2% -7.2% +23.1% +10.0% 🚨 regression
47 duckdb:vortex-compact +2.9% -7.2% +10.8% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +3.4% -7.2% +11.4% +10.0% 🚨 regression
48 datafusion:vortex-compact -5.2% -6.5% +1.4% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -15.0% -6.5% -9.1% +10.0% ✅ faster
48 duckdb:duckdb +9.2% -6.5% +16.8% +10.0% 🚨 regression
48 duckdb:vortex-compact +3.1% -6.5% +10.2% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +1.6% -6.5% +8.7% +10.0% ➖ noise
49 datafusion:vortex-compact -15.6% -6.4% -9.8% +10.0% ✅ faster
49 datafusion:vortex-file-compressed -14.5% -6.4% -8.6% +13.5% ➖ noise
49 duckdb:duckdb +18.0% -6.4% +26.1% +12.6% 🚨 regression
49 duckdb:vortex-compact +4.3% -6.4% +11.5% +10.8% 🚨 regression
49 duckdb:vortex-file-compressed -5.3% -6.4% +1.3% +12.9% ➖ noise
50 datafusion:vortex-compact -11.2% -5.8% -5.7% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -18.7% -5.8% -13.7% +10.0% ✅ faster
50 duckdb:duckdb +21.0% -5.8% +28.5% +10.0% 🚨 regression
50 duckdb:vortex-compact +4.7% -5.8% +11.2% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +2.8% -5.8% +9.1% +10.0% ➖ noise
51 datafusion:vortex-compact -11.7% -6.3% -5.8% +11.4% ➖ noise
51 datafusion:vortex-file-compressed -15.8% -6.3% -10.1% +10.5% ✅ faster
51 duckdb:duckdb +10.5% -6.3% +17.9% +10.5% 🚨 regression
51 duckdb:vortex-compact +1.8% -6.3% +8.6% +12.0% ➖ noise
51 duckdb:vortex-file-compressed +4.4% -6.3% +11.4% +23.5% ➖ noise
52 datafusion:vortex-compact -14.0% -6.1% -8.4% +14.3% ➖ noise
52 datafusion:vortex-file-compressed -17.1% -6.1% -11.8% +13.5% ➖ noise
52 duckdb:duckdb +10.5% -6.1% +17.7% +18.1% ➖ noise
52 duckdb:vortex-compact +0.3% -6.1% +6.8% +19.0% ➖ noise
52 duckdb:vortex-file-compressed +4.6% -6.1% +11.4% +21.6% ➖ noise
53 datafusion:vortex-compact -10.7% -4.6% -6.3% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -13.2% -4.6% -8.9% +10.0% ➖ noise
53 duckdb:duckdb +9.0% -4.6% +14.3% +11.1% 🚨 regression
53 duckdb:vortex-compact -2.6% -4.6% +2.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -0.2% -4.6% +4.7% +12.8% ➖ noise
54 datafusion:vortex-compact -8.1% +2.3% -10.2% +10.0% ✅ faster
54 datafusion:vortex-file-compressed -13.1% +2.3% -15.1% +10.0% ✅ faster
54 duckdb:duckdb +4.8% +2.3% +2.5% +11.1% ➖ noise
54 duckdb:vortex-compact +1.8% +2.3% -0.4% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.2% +2.3% +1.8% +10.2% ➖ noise
55 datafusion:vortex-compact -11.2% +0.1% -11.2% +11.8% ✅ faster
55 datafusion:vortex-file-compressed -10.7% +0.1% -10.8% +14.2% ➖ noise
55 duckdb:duckdb +11.6% +0.1% +11.5% +15.9% ➖ noise
55 duckdb:vortex-compact +5.3% +0.1% +5.2% +15.4% ➖ noise
55 duckdb:vortex-file-compressed +3.8% +0.1% +3.8% +15.1% ➖ noise
56 datafusion:vortex-compact -9.3% -3.8% -5.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -10.2% -3.8% -6.6% +10.0% ➖ noise
56 duckdb:duckdb +7.1% -3.8% +11.3% +10.8% 🚨 regression
56 duckdb:vortex-compact -0.3% -3.8% +3.6% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -0.3% -3.8% +3.6% +10.0% ➖ noise
57 datafusion:vortex-compact -15.2% -5.2% -10.5% +10.0% ✅ faster
57 datafusion:vortex-file-compressed -16.0% -5.2% -11.4% +10.0% ✅ faster
57 duckdb:duckdb +11.5% -5.2% +17.6% +11.0% 🚨 regression
57 duckdb:vortex-compact -12.7% -5.2% -7.9% +13.7% ➖ noise
57 duckdb:vortex-file-compressed -4.9% -5.2% +0.3% +11.8% ➖ noise
58 datafusion:vortex-compact -14.9% -6.1% -9.3% +10.0% ✅ faster
58 datafusion:vortex-file-compressed -16.1% -6.1% -10.6% +10.0% ✅ faster
58 duckdb:duckdb +18.6% -6.1% +26.3% +10.8% 🚨 regression
58 duckdb:vortex-compact +11.7% -6.1% +19.0% +15.9% 🚨 regression
58 duckdb:vortex-file-compressed +6.0% -6.1% +12.9% +11.4% 🚨 regression
59 datafusion:vortex-compact -14.3% -6.1% -8.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -16.0% -6.1% -10.6% +10.0% ✅ faster
59 duckdb:duckdb +11.0% -6.1% +18.2% +10.0% 🚨 regression
59 duckdb:vortex-compact +3.8% -6.1% +10.6% +10.0% 🚨 regression
59 duckdb:vortex-file-compressed +1.8% -6.1% +8.4% +10.0% ➖ noise
60 datafusion:vortex-compact -9.4% -5.2% -4.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -11.2% -5.2% -6.4% +10.0% ➖ noise
60 duckdb:duckdb +14.3% -5.2% +20.6% +11.8% 🚨 regression
60 duckdb:vortex-compact +0.0% -5.2% +5.5% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -2.0% -5.2% +3.4% +10.0% ➖ noise
61 datafusion:vortex-compact -10.5% -6.6% -4.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -14.2% -6.6% -8.2% +10.0% ➖ noise
61 duckdb:duckdb +15.3% -6.6% +23.4% +10.0% 🚨 regression
61 duckdb:vortex-compact +2.1% -6.6% +9.2% +11.3% ➖ noise
61 duckdb:vortex-file-compressed +5.5% -6.6% +12.9% +12.5% 🚨 regression
62 datafusion:vortex-compact -14.1% +1.1% -15.1% +14.5% ✅ faster
62 datafusion:vortex-file-compressed -18.7% +1.1% -19.6% +13.1% ✅ faster
62 duckdb:duckdb +10.9% +1.1% +9.7% +12.5% ➖ noise
62 duckdb:vortex-compact -1.3% +1.1% -2.4% +24.7% ➖ noise
62 duckdb:vortex-file-compressed +2.1% +1.1% +0.9% +19.8% ➖ noise
63 datafusion:vortex-compact -12.7% -5.4% -7.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -14.8% -5.4% -9.9% +10.6% ✅ faster
63 duckdb:duckdb +2.5% -5.4% +8.3% +10.0% ➖ noise
63 duckdb:vortex-compact +6.4% -5.4% +12.4% +10.0% 🚨 regression
63 duckdb:vortex-file-compressed -1.7% -5.4% +3.9% +14.3% ➖ noise
64 datafusion:vortex-compact -13.1% -8.3% -5.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -13.8% -8.3% -6.0% +10.0% ➖ noise
64 duckdb:duckdb +9.4% -8.3% +19.2% +10.0% 🚨 regression
64 duckdb:vortex-compact +4.1% -8.3% +13.5% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +1.5% -8.3% +10.6% +10.0% 🚨 regression
65 datafusion:vortex-compact -9.0% -4.6% -4.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -9.8% -4.6% -5.5% +11.5% ➖ noise
65 duckdb:duckdb +12.8% -4.6% +18.3% +22.9% ➖ noise
65 duckdb:vortex-compact +9.2% -4.6% +14.5% +11.4% 🚨 regression
65 duckdb:vortex-file-compressed +0.9% -4.6% +5.8% +10.0% ➖ noise
66 datafusion:vortex-compact -10.1% -4.1% -6.3% +10.8% ➖ noise
66 datafusion:vortex-file-compressed -11.1% -4.1% -7.3% +11.3% ➖ noise
66 duckdb:duckdb +2.7% -4.1% +7.0% +16.1% ➖ noise
66 duckdb:vortex-compact +2.4% -4.1% +6.8% +14.1% ➖ noise
66 duckdb:vortex-file-compressed -11.5% -4.1% -7.8% +16.0% ➖ noise
67 datafusion:vortex-compact -11.0% -8.8% -2.4% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -12.9% -8.8% -4.5% +10.0% ➖ noise
67 duckdb:duckdb +18.5% -8.8% +30.0% +10.0% 🚨 regression
67 duckdb:vortex-compact -0.1% -8.8% +9.6% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +4.1% -8.8% +14.2% +10.0% 🚨 regression
68 datafusion:vortex-compact -14.4% -4.4% -10.4% +10.0% ✅ faster
68 datafusion:vortex-file-compressed -12.8% -4.4% -8.8% +10.0% ➖ noise
68 duckdb:duckdb +14.3% -4.4% +19.5% +10.0% 🚨 regression
68 duckdb:vortex-compact +0.3% -4.4% +4.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +1.8% -4.4% +6.5% +10.0% ➖ noise
69 datafusion:vortex-compact -11.1% -5.1% -6.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -10.3% -5.1% -5.6% +10.0% ➖ noise
69 duckdb:duckdb +11.2% -5.1% +17.1% +10.0% 🚨 regression
69 duckdb:vortex-compact +1.8% -5.1% +7.2% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +1.1% -5.1% +6.5% +10.0% ➖ noise
70 datafusion:vortex-compact -15.2% -5.1% -10.6% +10.0% ✅ faster
70 datafusion:vortex-file-compressed -13.2% -5.1% -8.5% +10.0% ➖ noise
70 duckdb:duckdb +9.5% -5.1% +15.4% +13.4% 🚨 regression
70 duckdb:vortex-compact -2.3% -5.1% +3.0% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +3.3% -5.1% +8.9% +10.0% ➖ noise
71 datafusion:vortex-compact -12.8% -5.3% -8.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -14.3% -5.3% -9.5% +10.0% ✅ faster
71 duckdb:duckdb +15.1% -5.3% +21.5% +16.7% 🚨 regression
71 duckdb:vortex-compact -1.7% -5.3% +3.8% +22.8% ➖ noise
71 duckdb:vortex-file-compressed +2.7% -5.3% +8.4% +10.0% ➖ noise
72 datafusion:vortex-compact -19.4% -9.4% -11.0% +10.0% ✅ faster
72 datafusion:vortex-file-compressed -21.3% -9.4% -13.0% +10.0% ✅ faster
72 duckdb:duckdb +4.1% -9.4% +14.9% +10.0% 🚨 regression
72 duckdb:vortex-compact +0.8% -9.4% +11.4% +10.0% 🚨 regression
72 duckdb:vortex-file-compressed +1.7% -9.4% +12.3% +10.0% 🚨 regression
73 datafusion:vortex-compact -10.1% -3.7% -6.6% +17.3% ➖ noise
73 datafusion:vortex-file-compressed -18.6% -3.7% -15.5% +15.6% ✅ faster
73 duckdb:duckdb +11.2% -3.7% +15.5% +13.1% 🚨 regression
73 duckdb:vortex-compact -1.4% -3.7% +2.4% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -2.1% -3.7% +1.7% +10.0% ➖ noise
74 datafusion:vortex-compact -14.4% -7.8% -7.1% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -16.4% -7.8% -9.3% +10.0% ✅ faster
74 duckdb:duckdb +10.8% -7.8% +20.2% +16.9% 🚨 regression
74 duckdb:vortex-compact +4.6% -7.8% +13.5% +10.0% 🚨 regression
74 duckdb:vortex-file-compressed -1.7% -7.8% +6.6% +10.0% ➖ noise
75 datafusion:vortex-compact -10.7% -5.4% -5.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -9.6% -5.4% -4.4% +10.0% ➖ noise
75 duckdb:duckdb +15.6% -5.4% +22.2% +11.3% 🚨 regression
75 duckdb:vortex-compact -3.9% -5.4% +1.5% +11.4% ➖ noise
75 duckdb:vortex-file-compressed +3.6% -5.4% +9.5% +13.5% ➖ noise
76 datafusion:vortex-compact -15.7% -6.4% -10.0% +10.0% ✅ faster
76 datafusion:vortex-file-compressed -10.8% -6.4% -4.7% +10.0% ➖ noise
76 duckdb:duckdb +12.5% -6.4% +20.1% +10.9% 🚨 regression
76 duckdb:vortex-compact +0.8% -6.4% +7.7% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +8.5% -6.4% +16.0% +16.1% ➖ noise
77 datafusion:vortex-compact -8.9% -3.4% -5.7% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -10.9% -3.4% -7.8% +10.0% ➖ noise
77 duckdb:duckdb +14.5% -3.4% +18.5% +14.2% 🚨 regression
77 duckdb:vortex-compact +5.4% -3.4% +9.1% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +0.4% -3.4% +3.9% +10.0% ➖ noise
78 datafusion:vortex-compact -15.4% -7.5% -8.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -18.1% -7.5% -11.5% +10.0% ✅ faster
78 duckdb:duckdb +14.4% -7.5% +23.6% +10.0% 🚨 regression
78 duckdb:vortex-compact -8.0% -7.5% -0.6% +13.8% ➖ noise
78 duckdb:vortex-file-compressed -4.4% -7.5% +3.3% +10.0% ➖ noise
79 datafusion:vortex-compact -13.6% -4.8% -9.2% +10.0% ✅ faster
79 datafusion:vortex-file-compressed -17.5% -4.8% -13.3% +10.0% ✅ faster
79 duckdb:duckdb +19.3% -4.8% +25.4% +12.0% 🚨 regression
79 duckdb:vortex-compact -4.7% -4.8% +0.1% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.2% -4.8% +4.9% +10.1% ➖ noise
80 datafusion:vortex-compact -15.6% -7.1% -9.1% +10.0% ✅ faster
80 datafusion:vortex-file-compressed -16.2% -7.1% -9.8% +10.0% ✅ faster
80 duckdb:duckdb +21.0% -7.1% +30.3% +14.3% 🚨 regression
80 duckdb:vortex-compact +1.9% -7.1% +9.7% +12.9% ➖ noise
80 duckdb:vortex-file-compressed -1.7% -7.1% +5.9% +10.0% ➖ noise
81 datafusion:vortex-compact -12.6% -6.1% -6.9% +14.3% ➖ noise
81 datafusion:vortex-file-compressed -18.0% -6.1% -12.7% +13.8% ✅ faster
81 duckdb:duckdb +4.9% -6.1% +11.8% +11.7% 🚨 regression
81 duckdb:vortex-compact +2.8% -6.1% +9.5% +13.1% ➖ noise
81 duckdb:vortex-file-compressed -1.3% -6.1% +5.1% +12.5% ➖ noise
82 datafusion:vortex-compact -3.4% -4.6% +1.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -20.3% -4.6% -16.5% +10.0% ✅ faster
82 duckdb:duckdb +9.0% -4.6% +14.2% +16.0% ➖ noise
82 duckdb:vortex-compact +0.5% -4.6% +5.3% +10.8% ➖ noise
82 duckdb:vortex-file-compressed +3.0% -4.6% +7.9% +15.1% ➖ noise
83 datafusion:vortex-compact -5.7% -7.3% +1.8% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -13.1% -7.3% -6.3% +10.0% ➖ noise
83 duckdb:duckdb +9.0% -7.3% +17.6% +14.6% 🚨 regression
83 duckdb:vortex-compact +1.3% -7.3% +9.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -2.9% -7.3% +4.8% +12.2% ➖ noise
84 datafusion:vortex-compact -3.7% -1.7% -2.0% +14.4% ➖ noise
84 datafusion:vortex-file-compressed -20.4% -1.7% -19.0% +11.6% ✅ faster
84 duckdb:duckdb +8.9% -1.7% +10.8% +10.8% ➖ noise
84 duckdb:vortex-compact -4.2% -1.7% -2.6% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -0.5% -1.7% +1.3% +10.0% ➖ noise
85 datafusion:vortex-compact -0.6% -3.2% +2.6% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -11.1% -3.2% -8.2% +10.0% ➖ noise
85 duckdb:duckdb +15.2% -3.2% +18.9% +10.0% 🚨 regression
85 duckdb:vortex-compact +9.7% -3.2% +13.3% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +1.7% -3.2% +5.0% +10.0% ➖ noise
86 datafusion:vortex-compact +2.3% -9.6% +13.2% +12.4% 🚨 regression
86 datafusion:vortex-file-compressed -11.4% -9.6% -2.1% +11.8% ➖ noise
86 duckdb:duckdb +16.0% -9.6% +28.3% +12.6% 🚨 regression
86 duckdb:vortex-compact -4.2% -9.6% +6.0% +18.2% ➖ noise
86 duckdb:vortex-file-compressed -5.9% -9.6% +4.0% +14.7% ➖ noise
87 datafusion:vortex-compact +1.6% -2.1% +3.8% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -15.6% -2.1% -13.8% +10.0% ✅ faster
87 duckdb:duckdb +8.1% -2.1% +10.5% +14.5% ➖ noise
87 duckdb:vortex-compact +0.7% -2.1% +2.9% +14.3% ➖ noise
87 duckdb:vortex-file-compressed +6.0% -2.1% +8.2% +10.7% ➖ noise
88 datafusion:vortex-compact -0.8% -5.0% +4.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -14.7% -5.0% -10.2% +10.0% ✅ faster
88 duckdb:duckdb +8.9% -5.0% +14.6% +10.0% 🚨 regression
88 duckdb:vortex-compact -0.3% -5.0% +4.9% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +0.3% -5.0% +5.6% +10.0% ➖ noise
89 datafusion:vortex-compact +0.5% -5.6% +6.5% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -17.0% -5.6% -12.1% +10.0% ✅ faster
89 duckdb:duckdb +15.7% -5.6% +22.6% +11.0% 🚨 regression
89 duckdb:vortex-compact +1.3% -5.6% +7.3% +13.2% ➖ noise
89 duckdb:vortex-file-compressed -4.4% -5.6% +1.3% +13.8% ➖ noise
90 datafusion:vortex-compact -1.4% -9.1% +8.4% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -15.1% -9.1% -6.7% +10.0% ➖ noise
90 duckdb:duckdb +14.4% -9.1% +25.8% +10.0% 🚨 regression
90 duckdb:vortex-compact +0.4% -9.1% +10.4% +11.4% ➖ noise
90 duckdb:vortex-file-compressed -1.7% -9.1% +8.1% +10.0% ➖ noise
91 datafusion:vortex-compact +2.0% -7.1% +9.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -16.0% -7.1% -9.6% +10.0% ✅ faster
91 duckdb:duckdb +11.5% -7.1% +20.0% +15.4% 🚨 regression
91 duckdb:vortex-compact +4.9% -7.1% +12.8% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed -2.4% -7.1% +5.0% +10.0% ➖ noise
92 datafusion:vortex-compact -4.5% -6.0% +1.7% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -15.9% -6.0% -10.5% +10.0% ✅ faster
92 duckdb:duckdb +9.5% -6.0% +16.6% +13.3% 🚨 regression
92 duckdb:vortex-compact -0.8% -6.0% +5.6% +18.9% ➖ noise
92 duckdb:vortex-file-compressed -3.0% -6.0% +3.3% +10.0% ➖ noise
93 datafusion:vortex-compact +3.4% -8.1% +12.4% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed -18.5% -8.1% -11.3% +10.0% ✅ faster
93 duckdb:duckdb +21.1% -8.1% +31.8% +14.7% 🚨 regression
93 duckdb:vortex-compact +3.4% -8.1% +12.4% +10.3% 🚨 regression
93 duckdb:vortex-file-compressed +5.4% -8.1% +14.7% +13.5% 🚨 regression
94 datafusion:vortex-compact +4.6% -9.1% +15.1% +10.0% 🚨 regression
94 datafusion:vortex-file-compressed -11.1% -9.1% -2.1% +10.0% ➖ noise
94 duckdb:duckdb +4.4% -9.1% +14.9% +10.4% 🚨 regression
94 duckdb:vortex-compact +3.3% -9.1% +13.7% +12.8% 🚨 regression
94 duckdb:vortex-file-compressed -1.2% -9.1% +8.8% +10.0% ➖ noise
95 datafusion:vortex-compact +0.1% +3.4% -3.2% +10.4% ➖ noise
95 datafusion:vortex-file-compressed -14.9% +3.4% -17.6% +10.0% ✅ faster
95 duckdb:duckdb -5.5% +3.4% -8.6% +20.6% ➖ noise
95 duckdb:vortex-compact +7.7% +3.4% +4.2% +16.0% ➖ noise
95 duckdb:vortex-file-compressed -3.8% +3.4% -6.9% +18.6% ➖ noise
96 datafusion:vortex-compact +0.8% -7.9% +9.4% +13.7% ➖ noise
96 datafusion:vortex-file-compressed -17.0% -7.9% -9.9% +15.6% ➖ noise
96 duckdb:duckdb +20.4% -7.9% +30.8% +14.8% 🚨 regression
96 duckdb:vortex-compact +5.1% -7.9% +14.1% +13.1% 🚨 regression
96 duckdb:vortex-file-compressed -1.4% -7.9% +7.1% +15.2% ➖ noise
97 datafusion:vortex-compact +0.2% -8.4% +9.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -15.1% -8.4% -7.3% +10.0% ➖ noise
97 duckdb:duckdb +15.8% -8.4% +26.4% +10.0% 🚨 regression
97 duckdb:vortex-compact -2.7% -8.4% +6.2% +10.2% ➖ noise
97 duckdb:vortex-file-compressed +6.9% -8.4% +16.6% +10.0% 🚨 regression
98 datafusion:vortex-compact +2.5% -6.6% +9.7% +10.6% ➖ noise
98 datafusion:vortex-file-compressed -16.8% -6.6% -11.0% +11.0% ✅ faster
98 duckdb:duckdb +21.6% -6.6% +30.1% +12.2% 🚨 regression
98 duckdb:vortex-compact -0.4% -6.6% +6.6% +11.2% ➖ noise
98 duckdb:vortex-file-compressed +3.0% -6.6% +10.3% +12.3% ➖ noise
99 datafusion:vortex-compact +1.6% -6.5% +8.7% +16.4% ➖ noise
99 datafusion:vortex-file-compressed -21.2% -6.5% -15.7% +17.6% ✅ faster
99 duckdb:duckdb +7.8% -6.5% +15.4% +16.3% ➖ noise
99 duckdb:vortex-compact -0.8% -6.5% +6.1% +29.9% ➖ noise
99 duckdb:vortex-file-compressed +2.1% -6.5% +9.2% +15.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.0%


datafusion / vortex-file-compressed (1.003x ➖, 0↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 413496095 412701579 1.00
tpch_q02/datafusion:vortex-file-compressed 116114359 120074259 0.97
tpch_q03/datafusion:vortex-file-compressed 203149922 201635699 1.01
tpch_q04/datafusion:vortex-file-compressed 99134906 102499285 0.97
tpch_q05/datafusion:vortex-file-compressed 382115182 378669490 1.01
tpch_q06/datafusion:vortex-file-compressed 41848935 41257231 1.01
tpch_q07/datafusion:vortex-file-compressed 563733311 561210844 1.00
tpch_q08/datafusion:vortex-file-compressed 378036412 380380521 0.99
tpch_q09/datafusion:vortex-file-compressed 667282826 659730730 1.01
tpch_q10/datafusion:vortex-file-compressed 238945622 234393278 1.02
tpch_q11/datafusion:vortex-file-compressed 86395172 85397920 1.01
tpch_q12/datafusion:vortex-file-compressed 108208301 108336820 1.00
tpch_q13/datafusion:vortex-file-compressed 220934631 223271391 0.99
tpch_q14/datafusion:vortex-file-compressed 57655747 57783438 1.00
tpch_q15/datafusion:vortex-file-compressed 107911321 106785185 1.01
tpch_q16/datafusion:vortex-file-compressed 76187280 77739913 0.98
tpch_q17/datafusion:vortex-file-compressed 🚨 714981853 640740835 1.12
tpch_q18/datafusion:vortex-file-compressed 881303645 878329044 1.00
tpch_q19/datafusion:vortex-file-compressed 98780363 101658674 0.97
tpch_q20/datafusion:vortex-file-compressed 171722206 173369920 0.99
tpch_q21/datafusion:vortex-file-compressed 660496399 659403589 1.00
tpch_q22/datafusion:vortex-file-compressed 60961266 60297749 1.01
datafusion / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 443758199 446967185 0.99
tpch_q02/datafusion:vortex-compact 122642665 120748552 1.02
tpch_q03/datafusion:vortex-compact 216453459 221129942 0.98
tpch_q04/datafusion:vortex-compact 121150995 121152513 1.00
tpch_q05/datafusion:vortex-compact 388484531 393767514 0.99
tpch_q06/datafusion:vortex-compact 63303205 64996338 0.97
tpch_q07/datafusion:vortex-compact 586764942 585958781 1.00
tpch_q08/datafusion:vortex-compact 388178381 390979572 0.99
tpch_q09/datafusion:vortex-compact 679777736 679673916 1.00
tpch_q10/datafusion:vortex-compact 273170818 272545016 1.00
tpch_q11/datafusion:vortex-compact 91419940 91076514 1.00
tpch_q12/datafusion:vortex-compact 169854275 168828458 1.01
tpch_q13/datafusion:vortex-compact 276010788 274575747 1.01
tpch_q14/datafusion:vortex-compact 76115136 75546010 1.01
tpch_q15/datafusion:vortex-compact 169905298 168594663 1.01
tpch_q16/datafusion:vortex-compact 82409113 83340634 0.99
tpch_q17/datafusion:vortex-compact 648112360 652236508 0.99
tpch_q18/datafusion:vortex-compact 891460574 891726576 1.00
tpch_q19/datafusion:vortex-compact 140169157 148012666 0.95
tpch_q20/datafusion:vortex-compact 197882330 198958293 0.99
tpch_q21/datafusion:vortex-compact 700532186 701977771 1.00
tpch_q22/datafusion:vortex-compact 72747289 71680198 1.01
datafusion / parquet (1.001x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 408924650 430172336 0.95
tpch_q02/datafusion:parquet 182891075 190622020 0.96
tpch_q03/datafusion:parquet 291167716 296499631 0.98
tpch_q04/datafusion:parquet 133431685 135189317 0.99
tpch_q05/datafusion:parquet 444486314 439681826 1.01
tpch_q06/datafusion:parquet 121546814 117813261 1.03
tpch_q07/datafusion:parquet 624564879 623292513 1.00
tpch_q08/datafusion:parquet 487343854 479678337 1.02
tpch_q09/datafusion:parquet 766720094 754425540 1.02
tpch_q10/datafusion:parquet 504278483 502188319 1.00
tpch_q11/datafusion:parquet 130644051 129445103 1.01
tpch_q12/datafusion:parquet 218226888 202440781 1.08
tpch_q13/datafusion:parquet 341896265 342492491 1.00
tpch_q14/datafusion:parquet 164496283 165846446 0.99
tpch_q15/datafusion:parquet 253854278 254367782 1.00
tpch_q16/datafusion:parquet 134977567 137343875 0.98
tpch_q17/datafusion:parquet 686277188 684965581 1.00
tpch_q18/datafusion:parquet 871203555 885016533 0.98
tpch_q19/datafusion:parquet 270354319 264018382 1.02
tpch_q20/datafusion:parquet 304563660 304729242 1.00
tpch_q21/datafusion:parquet 738836098 735945036 1.00
tpch_q22/datafusion:parquet 218525769 219727088 0.99
datafusion / arrow (0.991x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 600390202 601890768 1.00
tpch_q02/datafusion:arrow 161432003 165213747 0.98
tpch_q03/datafusion:arrow 456651165 459548304 0.99
tpch_q04/datafusion:arrow 340778392 349044144 0.98
tpch_q05/datafusion:arrow 911239334 917780256 0.99
tpch_q06/datafusion:arrow 274397412 275242289 1.00
tpch_q07/datafusion:arrow 1127324716 1133646304 0.99
tpch_q08/datafusion:arrow 1127901195 1134540628 0.99
tpch_q09/datafusion:arrow 1335616187 1340401534 1.00
tpch_q10/datafusion:arrow 591141117 598290293 0.99
tpch_q11/datafusion:arrow 150158626 149812288 1.00
tpch_q12/datafusion:arrow 654766132 683371069 0.96
tpch_q13/datafusion:arrow 519089558 521699303 0.99
tpch_q14/datafusion:arrow 302771533 314439669 0.96
tpch_q15/datafusion:arrow 654148833 663049426 0.99
tpch_q16/datafusion:arrow 106742896 110037357 0.97
tpch_q17/datafusion:arrow 1305826904 1315936250 0.99
tpch_q18/datafusion:arrow 1815441576 1787753056 1.02
tpch_q19/datafusion:arrow 506644396 502630312 1.01
tpch_q20/datafusion:arrow 491442513 487700505 1.01
tpch_q21/datafusion:arrow 2837236790 2812519933 1.01
tpch_q22/datafusion:arrow 145911723 147181509 0.99
duckdb / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176619261 179268727 0.99
tpch_q02/duckdb:vortex-file-compressed 55164915 51613543 1.07
tpch_q03/duckdb:vortex-file-compressed 125971600 127001185 0.99
tpch_q04/duckdb:vortex-file-compressed 146962432 147751012 0.99
tpch_q05/duckdb:vortex-file-compressed 131031153 132305261 0.99
tpch_q06/duckdb:vortex-file-compressed 54023835 52351785 1.03
tpch_q07/duckdb:vortex-file-compressed 148743862 144865449 1.03
tpch_q08/duckdb:vortex-file-compressed 179124847 174305565 1.03
tpch_q09/duckdb:vortex-file-compressed 335919078 339110221 0.99
tpch_q10/duckdb:vortex-file-compressed 155908785 152943932 1.02
tpch_q11/duckdb:vortex-file-compressed 35490292 35373462 1.00
tpch_q12/duckdb:vortex-file-compressed 90775642 90862391 1.00
tpch_q13/duckdb:vortex-file-compressed 246836613 245416935 1.01
tpch_q14/duckdb:vortex-file-compressed 71535814 65794633 1.09
tpch_q15/duckdb:vortex-file-compressed 98420854 96231959 1.02
tpch_q16/duckdb:vortex-file-compressed 79490580 80165418 0.99
tpch_q17/duckdb:vortex-file-compressed 103991072 101057820 1.03
tpch_q18/duckdb:vortex-file-compressed 281247373 283650717 0.99
tpch_q19/duckdb:vortex-file-compressed 92283862 91417857 1.01
tpch_q20/duckdb:vortex-file-compressed 167854309 166152431 1.01
tpch_q21/duckdb:vortex-file-compressed 561273889 557051328 1.01
tpch_q22/duckdb:vortex-file-compressed 77747360 77990792 1.00
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231081162 230167725 1.00
tpch_q02/duckdb:vortex-compact 59333787 60938092 0.97
tpch_q03/duckdb:vortex-compact 140293823 139057182 1.01
tpch_q04/duckdb:vortex-compact 179107023 173659176 1.03
tpch_q05/duckdb:vortex-compact 146249879 146836405 1.00
tpch_q06/duckdb:vortex-compact 86156108 91973281 0.94
tpch_q07/duckdb:vortex-compact 207413360 202571481 1.02
tpch_q08/duckdb:vortex-compact 191243340 192973974 0.99
tpch_q09/duckdb:vortex-compact 367983242 365292430 1.01
tpch_q10/duckdb:vortex-compact 189502642 185517685 1.02
tpch_q11/duckdb:vortex-compact 41467791 41314608 1.00
tpch_q12/duckdb:vortex-compact 211402428 207848601 1.02
tpch_q13/duckdb:vortex-compact 296291300 294434682 1.01
tpch_q14/duckdb:vortex-compact 103577920 105993435 0.98
tpch_q15/duckdb:vortex-compact 120152077 119801105 1.00
tpch_q16/duckdb:vortex-compact 87277606 85850561 1.02
tpch_q17/duckdb:vortex-compact 116714918 117571992 0.99
tpch_q18/duckdb:vortex-compact 303416052 292063744 1.04
tpch_q19/duckdb:vortex-compact 115812386 117032835 0.99
tpch_q20/duckdb:vortex-compact 207047757 209794673 0.99
tpch_q21/duckdb:vortex-compact 632041859 632967754 1.00
tpch_q22/duckdb:vortex-compact 89373795 91240710 0.98
duckdb / parquet (1.006x ➖, 0↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255922438 265778419 0.96
tpch_q02/duckdb:parquet 104635263 103550217 1.01
tpch_q03/duckdb:parquet 212504202 214282344 0.99
tpch_q04/duckdb:parquet 137450137 134050474 1.03
tpch_q05/duckdb:parquet 218987006 218317853 1.00
tpch_q06/duckdb:parquet 70078324 66773079 1.05
tpch_q07/duckdb:parquet 182616983 179552179 1.02
tpch_q08/duckdb:parquet 255114098 252524090 1.01
tpch_q09/duckdb:parquet 448862610 465472090 0.96
tpch_q10/duckdb:parquet 601518123 609867354 0.99
tpch_q11/duckdb:parquet 🚨 44025124 39265429 1.12
tpch_q12/duckdb:parquet 127272023 125548833 1.01
tpch_q13/duckdb:parquet 442373701 452640073 0.98
tpch_q14/duckdb:parquet 171933905 169940839 1.01
tpch_q15/duckdb:parquet 96472669 96760639 1.00
tpch_q16/duckdb:parquet 157191817 165837528 0.95
tpch_q17/duckdb:parquet 175880960 177432926 0.99
tpch_q18/duckdb:parquet 349688868 347455191 1.01
tpch_q19/duckdb:parquet 283971189 281721421 1.01
tpch_q20/duckdb:parquet 234427643 227083335 1.03
tpch_q21/duckdb:parquet 575795356 567126547 1.02
tpch_q22/duckdb:parquet 293357666 290608528 1.01
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116932319 116833266 1.00
tpch_q02/duckdb:duckdb 45231015 47214287 0.96
tpch_q03/duckdb:duckdb 99021984 97141192 1.02
tpch_q04/duckdb:duckdb 132117521 129388127 1.02
tpch_q05/duckdb:duckdb 108396053 109446703 0.99
tpch_q06/duckdb:duckdb 39129159 39743838 0.98
tpch_q07/duckdb:duckdb 86339679 86247065 1.00
tpch_q08/duckdb:duckdb 111653552 110229080 1.01
tpch_q09/duckdb:duckdb 276048771 279409114 0.99
tpch_q10/duckdb:duckdb 206481433 198249210 1.04
tpch_q11/duckdb:duckdb 15515153 15552133 1.00
tpch_q12/duckdb:duckdb 84599461 85022577 1.00
tpch_q13/duckdb:duckdb 250865754 250891122 1.00
tpch_q14/duckdb:duckdb 70867755 70981389 1.00
tpch_q15/duckdb:duckdb 78466945 77859282 1.01
tpch_q16/duckdb:duckdb 73184899 72970902 1.00
tpch_q17/duckdb:duckdb 84538224 84911860 1.00
tpch_q18/duckdb:duckdb 213071108 212158404 1.00
tpch_q19/duckdb:duckdb 115903043 115800942 1.00
tpch_q20/duckdb:duckdb 111796634 111593745 1.00
tpch_q21/duckdb:duckdb 295106656 303579375 0.97
tpch_q22/duckdb:duckdb 68033200 67545513 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.2% -4.3% +4.3% +10.0% ➖ noise
1 datafusion:vortex-compact -0.7% -4.3% +3.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +0.2% -4.3% +4.7% +10.7% ➖ noise
1 duckdb:duckdb +0.1% -4.3% +4.6% +10.0% ➖ noise
1 duckdb:vortex-compact +0.4% -4.3% +4.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.5% -4.3% +3.0% +10.0% ➖ noise
2 datafusion:arrow -2.3% -1.5% -0.8% +10.0% ➖ noise
2 datafusion:vortex-compact +1.6% -1.5% +3.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -3.3% -1.5% -1.8% +10.0% ➖ noise
2 duckdb:duckdb -4.2% -1.5% -2.7% +10.0% ➖ noise
2 duckdb:vortex-compact -2.6% -1.5% -1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +6.9% -1.5% +8.5% +12.5% ➖ noise
3 datafusion:arrow -0.6% -1.3% +0.7% +10.0% ➖ noise
3 datafusion:vortex-compact -2.1% -1.3% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.8% -1.3% +2.1% +10.0% ➖ noise
3 duckdb:duckdb +1.9% -1.3% +3.3% +10.0% ➖ noise
3 duckdb:vortex-compact +0.9% -1.3% +2.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
4 datafusion:arrow -2.4% +0.6% -3.0% +10.0% ➖ noise
4 datafusion:vortex-compact -0.0% +0.6% -0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.3% +0.6% -3.9% +10.0% ➖ noise
4 duckdb:duckdb +2.1% +0.6% +1.5% +10.0% ➖ noise
4 duckdb:vortex-compact +3.1% +0.6% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.5% +0.6% -1.1% +10.0% ➖ noise
5 datafusion:arrow -0.7% +0.7% -1.4% +10.0% ➖ noise
5 datafusion:vortex-compact -1.3% +0.7% -2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.9% +0.7% +0.2% +10.0% ➖ noise
5 duckdb:duckdb -1.0% +0.7% -1.6% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% +0.7% -1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.0% ➖ noise
6 datafusion:arrow -0.3% +4.1% -4.2% +10.0% ➖ noise
6 datafusion:vortex-compact -2.6% +4.1% -6.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.4% +4.1% -2.5% +10.0% ➖ noise
6 duckdb:duckdb -1.5% +4.1% -5.4% +14.2% ➖ noise
6 duckdb:vortex-compact -6.3% +4.1% -10.0% +10.0% ✅ faster
6 duckdb:vortex-file-compressed +3.2% +4.1% -0.8% +15.7% ➖ noise
7 datafusion:arrow -0.6% +1.0% -1.5% +10.0% ➖ noise
7 datafusion:vortex-compact +0.1% +1.0% -0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.4% +1.0% -0.5% +10.0% ➖ noise
7 duckdb:duckdb +0.1% +1.0% -0.8% +10.0% ➖ noise
7 duckdb:vortex-compact +2.4% +1.0% +1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.7% +1.0% +1.7% +10.0% ➖ noise
8 datafusion:arrow -0.6% +1.3% -1.9% +10.0% ➖ noise
8 datafusion:vortex-compact -0.7% +1.3% -2.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.6% +1.3% -1.9% +10.0% ➖ noise
8 duckdb:duckdb +1.3% +1.3% -0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -0.9% +1.3% -2.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.8% +1.3% +1.4% +10.0% ➖ noise
9 datafusion:arrow -0.4% -1.0% +0.7% +10.0% ➖ noise
9 datafusion:vortex-compact +0.0% -1.0% +1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.1% -1.0% +2.2% +10.0% ➖ noise
9 duckdb:duckdb -1.2% -1.0% -0.2% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% -1.0% +1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -1.0% +0.1% +10.0% ➖ noise
10 datafusion:arrow -1.2% -0.5% -0.7% +10.0% ➖ noise
10 datafusion:vortex-compact +0.2% -0.5% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.9% -0.5% +2.4% +10.0% ➖ noise
10 duckdb:duckdb +4.2% -0.5% +4.7% +10.0% ➖ noise
10 duckdb:vortex-compact +2.1% -0.5% +2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.9% -0.5% +2.4% +10.0% ➖ noise
11 datafusion:arrow +0.2% +6.4% -5.8% +10.8% ➖ noise
11 datafusion:vortex-compact +0.4% +6.4% -5.6% +11.0% ➖ noise
11 datafusion:vortex-file-compressed +1.2% +6.4% -4.9% +10.2% ➖ noise
11 duckdb:duckdb -0.2% +6.4% -6.2% +18.9% ➖ noise
11 duckdb:vortex-compact +0.4% +6.4% -5.6% +14.5% ➖ noise
11 duckdb:vortex-file-compressed +0.3% +6.4% -5.7% +13.7% ➖ noise
12 datafusion:arrow -4.2% +4.5% -8.3% +48.1% ➖ noise
12 datafusion:vortex-compact +0.6% +4.5% -3.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.1% +4.5% -4.5% +10.0% ➖ noise
12 duckdb:duckdb -0.5% +4.5% -4.8% +10.0% ➖ noise
12 duckdb:vortex-compact +1.7% +4.5% -2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.1% +4.5% -4.4% +10.0% ➖ noise
13 datafusion:arrow -0.5% -1.2% +0.7% +11.2% ➖ noise
13 datafusion:vortex-compact +0.5% -1.2% +1.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.0% -1.2% +0.2% +10.0% ➖ noise
13 duckdb:duckdb -0.0% -1.2% +1.2% +10.0% ➖ noise
13 duckdb:vortex-compact +0.6% -1.2% +1.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% -1.2% +1.8% +10.0% ➖ noise
14 datafusion:arrow -3.7% +0.2% -3.9% +10.0% ➖ noise
14 datafusion:vortex-compact +0.8% +0.2% +0.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.2% +0.2% -0.4% +14.5% ➖ noise
14 duckdb:duckdb -0.2% +0.2% -0.3% +10.0% ➖ noise
14 duckdb:vortex-compact -2.3% +0.2% -2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +8.7% +0.2% +8.5% +11.3% ➖ noise
15 datafusion:arrow -1.3% -0.2% -1.1% +10.0% ➖ noise
15 datafusion:vortex-compact +0.8% -0.2% +1.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.1% -0.2% +1.3% +10.0% ➖ noise
15 duckdb:duckdb +0.8% -0.2% +1.0% +10.0% ➖ noise
15 duckdb:vortex-compact +0.3% -0.2% +0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
16 datafusion:arrow -3.0% -3.5% +0.5% +10.0% ➖ noise
16 datafusion:vortex-compact -1.1% -3.5% +2.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.0% -3.5% +1.5% +10.3% ➖ noise
16 duckdb:duckdb +0.3% -3.5% +3.9% +10.0% ➖ noise
16 duckdb:vortex-compact +1.7% -3.5% +5.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.8% -3.5% +2.7% +10.0% ➖ noise
17 datafusion:arrow -0.8% -0.3% -0.4% +10.0% ➖ noise
17 datafusion:vortex-compact -0.6% -0.3% -0.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +11.6% -0.3% +12.0% +10.0% 🚨 regression
17 duckdb:duckdb -0.4% -0.3% -0.1% +10.0% ➖ noise
17 duckdb:vortex-compact -0.7% -0.3% -0.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.9% -0.3% +3.3% +10.0% ➖ noise
18 datafusion:arrow +1.5% -0.5% +2.0% +10.0% ➖ noise
18 datafusion:vortex-compact -0.0% -0.5% +0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
18 duckdb:duckdb +0.4% -0.5% +0.9% +10.0% ➖ noise
18 duckdb:vortex-compact +3.9% -0.5% +4.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.8% -0.5% -0.4% +10.0% ➖ noise
19 datafusion:arrow +0.8% +1.6% -0.8% +10.0% ➖ noise
19 datafusion:vortex-compact -5.3% +1.6% -6.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.8% +1.6% -4.4% +10.0% ➖ noise
19 duckdb:duckdb +0.1% +1.6% -1.5% +10.0% ➖ noise
19 duckdb:vortex-compact -1.0% +1.6% -2.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.9% +1.6% -0.6% +10.0% ➖ noise
20 datafusion:arrow +0.8% +1.6% -0.8% +10.0% ➖ noise
20 datafusion:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.0% +1.6% -2.5% +10.0% ➖ noise
20 duckdb:duckdb +0.2% +1.6% -1.4% +10.0% ➖ noise
20 duckdb:vortex-compact -1.3% +1.6% -2.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.0% +1.6% -0.5% +10.0% ➖ noise
21 datafusion:arrow +0.9% +1.0% -0.1% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% +1.0% -1.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.2% +1.0% -0.8% +10.0% ➖ noise
21 duckdb:duckdb -2.8% +1.0% -3.7% +10.0% ➖ noise
21 duckdb:vortex-compact -0.1% +1.0% -1.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.8% +1.0% -0.2% +10.0% ➖ noise
22 datafusion:arrow -0.9% +0.2% -1.1% +10.0% ➖ noise
22 datafusion:vortex-compact +1.5% +0.2% +1.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.1% +0.2% +0.9% +10.0% ➖ noise
22 duckdb:duckdb +0.7% +0.2% +0.5% +10.0% ➖ noise
22 duckdb:vortex-compact -2.0% +0.2% -2.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.3% +0.2% -0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.0%
Vortex (geomean): 1.060x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish +2.4%


datafusion / vortex-file-compressed (1.060x ➖, 3↑ 7↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 207778383 361646531 0.57
tpch_q02/datafusion:vortex-file-compressed 544204435 722922449 0.75
tpch_q03/datafusion:vortex-file-compressed 🚀 397232846 590716465 0.67
tpch_q04/datafusion:vortex-file-compressed 🚀 215218567 322147815 0.67
tpch_q05/datafusion:vortex-file-compressed 565925965 570508608 0.99
tpch_q06/datafusion:vortex-file-compressed 309698241 405758587 0.76
tpch_q07/datafusion:vortex-file-compressed 🚨 994336300 464215196 2.14
tpch_q08/datafusion:vortex-file-compressed 🚨 1174749783 883718002 1.33
tpch_q09/datafusion:vortex-file-compressed 567053485 501950867 1.13
tpch_q10/datafusion:vortex-file-compressed 615221083 718381934 0.86
tpch_q11/datafusion:vortex-file-compressed 🚨 536000105 402816985 1.33
tpch_q12/datafusion:vortex-file-compressed 🚨 810226976 443227111 1.83
tpch_q13/datafusion:vortex-file-compressed 🚨 244360280 184251722 1.33
tpch_q14/datafusion:vortex-file-compressed 🚨 358344337 201474919 1.78
tpch_q15/datafusion:vortex-file-compressed 🚨 580024985 334823643 1.73
tpch_q16/datafusion:vortex-file-compressed 257522321 297564882 0.87
tpch_q17/datafusion:vortex-file-compressed 358223159 444100602 0.81
tpch_q18/datafusion:vortex-file-compressed 332792892 375212533 0.89
tpch_q19/datafusion:vortex-file-compressed 431043754 397292816 1.08
tpch_q20/datafusion:vortex-file-compressed 357551319 345510641 1.03
tpch_q21/datafusion:vortex-file-compressed 558423742 521551339 1.07
tpch_q22/datafusion:vortex-file-compressed 234715938 193345541 1.21
datafusion / vortex-compact (1.115x ➖, 1↑ 4↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 277088431 306058863 0.91
tpch_q02/datafusion:vortex-compact 838781268 722205484 1.16
tpch_q03/datafusion:vortex-compact 🚀 453061884 739936215 0.61
tpch_q04/datafusion:vortex-compact 277896352 283716133 0.98
tpch_q05/datafusion:vortex-compact 656514351 519725267 1.26
tpch_q06/datafusion:vortex-compact 405791158 357955082 1.13
tpch_q07/datafusion:vortex-compact 586966936 463425006 1.27
tpch_q08/datafusion:vortex-compact 524936160 499047753 1.05
tpch_q09/datafusion:vortex-compact 419492759 403079834 1.04
tpch_q10/datafusion:vortex-compact 551828715 464724894 1.19
tpch_q11/datafusion:vortex-compact 256424306 265988904 0.96
tpch_q12/datafusion:vortex-compact 🚨 566831012 417781609 1.36
tpch_q13/datafusion:vortex-compact 202842920 199320178 1.02
tpch_q14/datafusion:vortex-compact 248560656 242301801 1.03
tpch_q15/datafusion:vortex-compact 456781881 458429487 1.00
tpch_q16/datafusion:vortex-compact 195271076 177599584 1.10
tpch_q17/datafusion:vortex-compact 🚨 455808083 310760853 1.47
tpch_q18/datafusion:vortex-compact 311204156 290329443 1.07
tpch_q19/datafusion:vortex-compact 🚨 648839006 453685288 1.43
tpch_q20/datafusion:vortex-compact 555044529 448817254 1.24
tpch_q21/datafusion:vortex-compact 🚨 832198427 503719774 1.65
tpch_q22/datafusion:vortex-compact 219267855 204278225 1.07
datafusion / parquet (0.913x ➖, 2↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 220560747 233557250 0.94
tpch_q02/datafusion:parquet 514880084 408778442 1.26
tpch_q03/datafusion:parquet 491823228 438553640 1.12
tpch_q04/datafusion:parquet 229552945 255067298 0.90
tpch_q05/datafusion:parquet 573115946 675912523 0.85
tpch_q06/datafusion:parquet 182119154 238254717 0.76
tpch_q07/datafusion:parquet 565097547 619335590 0.91
tpch_q08/datafusion:parquet 🚀 600482150 1028353124 0.58
tpch_q09/datafusion:parquet 🚀 471680527 707642539 0.67
tpch_q10/datafusion:parquet 507317578 527969328 0.96
tpch_q11/datafusion:parquet 335213871 341097164 0.98
tpch_q12/datafusion:parquet 256660844 248200519 1.03
tpch_q13/datafusion:parquet 443663748 441775984 1.00
tpch_q14/datafusion:parquet 165613441 212412767 0.78
tpch_q15/datafusion:parquet 286043960 305637186 0.94
tpch_q16/datafusion:parquet 169694543 201705922 0.84
tpch_q17/datafusion:parquet 380728212 388418807 0.98
tpch_q18/datafusion:parquet 446516202 453743542 0.98
tpch_q19/datafusion:parquet 386917159 315721111 1.23
tpch_q20/datafusion:parquet 315964498 344529252 0.92
tpch_q21/datafusion:parquet 557791972 664422125 0.84
tpch_q22/datafusion:parquet 153127220 172711615 0.89
duckdb / vortex-file-compressed (1.018x ➖, 0↑ 2↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 381914264 283368565 1.35
tpch_q02/duckdb:vortex-file-compressed 1001971012 871093433 1.15
tpch_q03/duckdb:vortex-file-compressed 595137177 695188035 0.86
tpch_q04/duckdb:vortex-file-compressed 372840888 410484013 0.91
tpch_q05/duckdb:vortex-file-compressed 852337552 976196134 0.87
tpch_q06/duckdb:vortex-file-compressed 453477891 531806879 0.85
tpch_q07/duckdb:vortex-file-compressed 807295850 843753549 0.96
tpch_q08/duckdb:vortex-file-compressed 976582845 915305904 1.07
tpch_q09/duckdb:vortex-file-compressed 918636862 991348802 0.93
tpch_q10/duckdb:vortex-file-compressed 774575424 710538072 1.09
tpch_q11/duckdb:vortex-file-compressed 517314116 496238726 1.04
tpch_q12/duckdb:vortex-file-compressed 526036121 617606414 0.85
tpch_q13/duckdb:vortex-file-compressed 445746205 430300069 1.04
tpch_q14/duckdb:vortex-file-compressed 🚨 553375079 420787621 1.32
tpch_q15/duckdb:vortex-file-compressed 346505654 299640089 1.16
tpch_q16/duckdb:vortex-file-compressed 420481045 364719650 1.15
tpch_q17/duckdb:vortex-file-compressed 765474413 613299967 1.25
tpch_q18/duckdb:vortex-file-compressed 605622147 626334519 0.97
tpch_q19/duckdb:vortex-file-compressed 475471327 444232086 1.07
tpch_q20/duckdb:vortex-file-compressed 883150484 994621954 0.89
tpch_q21/duckdb:vortex-file-compressed 1015130751 1091663056 0.93
tpch_q22/duckdb:vortex-file-compressed 298332878 321875443 0.93
duckdb / vortex-compact (1.047x ➖, 0↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 362863037 303802398 1.19
tpch_q02/duckdb:vortex-compact 994030054 905823178 1.10
tpch_q03/duckdb:vortex-compact 599887138 693290103 0.87
tpch_q04/duckdb:vortex-compact 352970723 305012164 1.16
tpch_q05/duckdb:vortex-compact 858333035 723984648 1.19
tpch_q06/duckdb:vortex-compact 419667016 408032830 1.03
tpch_q07/duckdb:vortex-compact 840589653 693133247 1.21
tpch_q08/duckdb:vortex-compact 1020694584 1194678494 0.85
tpch_q09/duckdb:vortex-compact 1028683855 945144527 1.09
tpch_q10/duckdb:vortex-compact 725619701 647444583 1.12
tpch_q11/duckdb:vortex-compact 🚨 582087300 437816524 1.33
tpch_q12/duckdb:vortex-compact 471237512 458949373 1.03
tpch_q13/duckdb:vortex-compact 469578285 432705784 1.09
tpch_q14/duckdb:vortex-compact 557228207 509572070 1.09
tpch_q15/duckdb:vortex-compact 339246857 305950558 1.11
tpch_q16/duckdb:vortex-compact 376482635 451780642 0.83
tpch_q17/duckdb:vortex-compact 640956054 639623431 1.00
tpch_q18/duckdb:vortex-compact 393704660 496047596 0.79
tpch_q19/duckdb:vortex-compact 403581178 378247987 1.07
tpch_q20/duckdb:vortex-compact 782026050 746895879 1.05
tpch_q21/duckdb:vortex-compact 1072029367 1065093114 1.01
tpch_q22/duckdb:vortex-compact 363908604 358468637 1.02
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 544924633 466304967 1.17
tpch_q02/duckdb:parquet 1433588629 1371855196 1.04
tpch_q03/duckdb:parquet 1169404229 1291056569 0.91
tpch_q04/duckdb:parquet 633147416 860683584 0.74
tpch_q05/duckdb:parquet 1754460177 1732605029 1.01
tpch_q06/duckdb:parquet 423135268 411048244 1.03
tpch_q07/duckdb:parquet 1192062455 1233978349 0.97
tpch_q08/duckdb:parquet 1805817775 1506088102 1.20
tpch_q09/duckdb:parquet 1629075673 1501133591 1.09
tpch_q10/duckdb:parquet 1551208604 1615520460 0.96
tpch_q11/duckdb:parquet 862883027 822147879 1.05
tpch_q12/duckdb:parquet 666074441 744460129 0.89
tpch_q13/duckdb:parquet 918963819 902346343 1.02
tpch_q14/duckdb:parquet 673282398 738851867 0.91
tpch_q15/duckdb:parquet 632326074 597071389 1.06
tpch_q16/duckdb:parquet 586407383 542622375 1.08
tpch_q17/duckdb:parquet 756357855 919381317 0.82
tpch_q18/duckdb:parquet 1154137897 888090708 1.30
tpch_q19/duckdb:parquet 1114119829 940462018 1.18
tpch_q20/duckdb:parquet 1238860182 1126757360 1.10
tpch_q21/duckdb:parquet 1338947982 1382849614 0.97
tpch_q22/duckdb:parquet 525056663 512633767 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -9.5% +5.1% -13.8% +177.6% ➖ noise
1 datafusion:vortex-file-compressed -42.5% +5.1% -45.3% +114.0% ➖ noise
1 duckdb:vortex-compact +19.4% +5.1% +13.7% +123.0% ➖ noise
1 duckdb:vortex-file-compressed +34.8% +5.1% +28.3% +51.2% ➖ noise
2 datafusion:vortex-compact +16.1% +14.7% +1.2% +33.1% ➖ noise
2 datafusion:vortex-file-compressed -24.7% +14.7% -34.4% +30.5% ✅ faster
2 duckdb:vortex-compact +9.7% +14.7% -4.3% +30.5% ➖ noise
2 duckdb:vortex-file-compressed +15.0% +14.7% +0.3% +30.5% ➖ noise
3 datafusion:vortex-compact -38.8% +0.8% -39.2% +111.0% ➖ noise
3 datafusion:vortex-file-compressed -32.8% +0.8% -33.3% +97.0% ➖ noise
3 duckdb:vortex-compact -13.5% +0.8% -14.1% +41.6% ➖ noise
3 duckdb:vortex-file-compressed -14.4% +0.8% -15.1% +41.8% ➖ noise
4 datafusion:vortex-compact -2.1% -18.6% +20.4% +68.1% ➖ noise
4 datafusion:vortex-file-compressed -33.2% -18.6% -17.9% +41.2% ➖ noise
4 duckdb:vortex-compact +15.7% -18.6% +42.2% +56.3% ➖ noise
4 duckdb:vortex-file-compressed -9.2% -18.6% +11.6% +59.4% ➖ noise
5 datafusion:vortex-compact +26.3% -7.3% +36.3% +31.8% 🚨 regression
5 datafusion:vortex-file-compressed -0.8% -7.3% +7.1% +38.6% ➖ noise
5 duckdb:vortex-compact +18.6% -7.3% +27.9% +34.4% ➖ noise
5 duckdb:vortex-file-compressed -12.7% -7.3% -5.8% +30.5% ➖ noise
6 datafusion:vortex-compact +13.4% -11.3% +27.8% +40.9% ➖ noise
6 datafusion:vortex-file-compressed -23.7% -11.3% -14.0% +54.3% ➖ noise
6 duckdb:vortex-compact +2.9% -11.3% +15.9% +41.5% ➖ noise
6 duckdb:vortex-file-compressed -14.7% -11.3% -3.9% +50.6% ➖ noise
7 datafusion:vortex-compact +26.7% -6.1% +34.9% +30.5% 🚨 regression
7 datafusion:vortex-file-compressed +114.2% -6.1% +128.1% +51.9% 🚨 regression
7 duckdb:vortex-compact +21.3% -6.1% +29.2% +30.5% ➖ noise
7 duckdb:vortex-file-compressed -4.3% -6.1% +1.9% +30.5% ➖ noise
8 datafusion:vortex-compact +5.2% -16.3% +25.7% +53.2% ➖ noise
8 datafusion:vortex-file-compressed +32.9% -16.3% +58.9% +50.6% 🚨 regression
8 duckdb:vortex-compact -14.6% -16.3% +2.1% +35.5% ➖ noise
8 duckdb:vortex-file-compressed +6.7% -16.3% +27.5% +30.5% ➖ noise
9 datafusion:vortex-compact +4.1% -14.9% +22.4% +38.8% ➖ noise
9 datafusion:vortex-file-compressed +13.0% -14.9% +32.8% +63.6% ➖ noise
9 duckdb:vortex-compact +8.8% -14.9% +28.0% +34.5% ➖ noise
9 duckdb:vortex-file-compressed -7.3% -14.9% +9.0% +30.8% ➖ noise
10 datafusion:vortex-compact +18.7% -3.9% +23.6% +47.4% ➖ noise
10 datafusion:vortex-file-compressed -14.4% -3.9% -10.8% +65.3% ➖ noise
10 duckdb:vortex-compact +12.1% -3.9% +16.7% +44.7% ➖ noise
10 duckdb:vortex-file-compressed +9.0% -3.9% +13.5% +49.5% ➖ noise
11 datafusion:vortex-compact -3.6% +1.6% -5.1% +30.5% ➖ noise
11 datafusion:vortex-file-compressed +33.1% +1.6% +31.0% +73.7% ➖ noise
11 duckdb:vortex-compact +33.0% +1.6% +30.9% +30.5% 🚨 regression
11 duckdb:vortex-file-compressed +4.2% +1.6% +2.6% +35.9% ➖ noise
12 datafusion:vortex-compact +35.7% -3.8% +41.1% +35.9% 🚨 regression
12 datafusion:vortex-file-compressed +82.8% -3.8% +90.0% +50.3% 🚨 regression
12 duckdb:vortex-compact +2.7% -3.8% +6.7% +70.1% ➖ noise
12 duckdb:vortex-file-compressed -14.8% -3.8% -11.5% +41.8% ➖ noise
13 datafusion:vortex-compact +1.8% +1.1% +0.6% +163.7% ➖ noise
13 datafusion:vortex-file-compressed +32.6% +1.1% +31.1% +98.6% ➖ noise
13 duckdb:vortex-compact +8.5% +1.1% +7.3% +33.7% ➖ noise
13 duckdb:vortex-file-compressed +3.6% +1.1% +2.4% +30.5% ➖ noise
14 datafusion:vortex-compact +2.6% -15.7% +21.7% +30.5% ➖ noise
14 datafusion:vortex-file-compressed +77.9% -15.7% +111.0% +61.7% 🚨 regression
14 duckdb:vortex-compact +9.4% -15.7% +29.7% +56.4% ➖ noise
14 duckdb:vortex-file-compressed +31.5% -15.7% +56.0% +34.2% 🚨 regression
15 datafusion:vortex-compact -0.4% -0.4% +0.1% +30.5% ➖ noise
15 datafusion:vortex-file-compressed +73.2% -0.4% +74.0% +64.8% 🚨 regression
15 duckdb:vortex-compact +10.9% -0.4% +11.4% +66.9% ➖ noise
15 duckdb:vortex-file-compressed +15.6% -0.4% +16.2% +30.5% ➖ noise
16 datafusion:vortex-compact +10.0% -4.6% +15.3% +30.5% ➖ noise
16 datafusion:vortex-file-compressed -13.5% -4.6% -9.2% +87.5% ➖ noise
16 duckdb:vortex-compact -16.7% -4.6% -12.6% +43.8% ➖ noise
16 duckdb:vortex-file-compressed +15.3% -4.6% +20.9% +30.5% ➖ noise
17 datafusion:vortex-compact +46.7% -10.2% +63.3% +33.1% 🚨 regression
17 datafusion:vortex-file-compressed -19.3% -10.2% -10.2% +44.5% ➖ noise
17 duckdb:vortex-compact +0.2% -10.2% +11.6% +40.3% ➖ noise
17 duckdb:vortex-file-compressed +24.8% -10.2% +39.0% +48.2% ➖ noise
18 datafusion:vortex-compact +7.2% +13.1% -5.2% +30.9% ➖ noise
18 datafusion:vortex-file-compressed -11.3% +13.1% -21.6% +65.3% ➖ noise
18 duckdb:vortex-compact -20.6% +13.1% -29.8% +47.9% ➖ noise
18 duckdb:vortex-file-compressed -3.3% +13.1% -14.5% +38.6% ➖ noise
19 datafusion:vortex-compact +43.0% +20.5% +18.7% +47.7% ➖ noise
19 datafusion:vortex-file-compressed +8.5% +20.5% -10.0% +51.7% ➖ noise
19 duckdb:vortex-compact +6.7% +20.5% -11.4% +31.1% ➖ noise
19 duckdb:vortex-file-compressed +7.0% +20.5% -11.2% +30.5% ➖ noise
20 datafusion:vortex-compact +23.7% +0.4% +23.2% +30.5% ➖ noise
20 datafusion:vortex-file-compressed +3.5% +0.4% +3.1% +30.5% ➖ noise
20 duckdb:vortex-compact +4.7% +0.4% +4.3% +40.0% ➖ noise
20 duckdb:vortex-file-compressed -11.2% +0.4% -11.6% +60.4% ➖ noise
21 datafusion:vortex-compact +65.2% -9.8% +83.2% +35.2% 🚨 regression
21 datafusion:vortex-file-compressed +7.1% -9.8% +18.8% +37.4% ➖ noise
21 duckdb:vortex-compact +0.7% -9.8% +11.6% +30.5% ➖ noise
21 duckdb:vortex-file-compressed -7.0% -9.8% +3.1% +46.0% ➖ noise
22 datafusion:vortex-compact +7.3% -4.7% +12.6% +73.8% ➖ noise
22 datafusion:vortex-file-compressed +21.4% -4.7% +27.4% +41.0% ➖ noise
22 duckdb:vortex-compact +1.5% -4.7% +6.5% +36.9% ➖ noise
22 duckdb:vortex-file-compressed -7.3% -4.7% -2.7% +30.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.5%
Vortex (geomean): 0.873x ➖
Parquet (geomean): 0.933x ➖
Shifts: Parquet (control) -6.7% · Median polish -3.7%


datafusion / vortex-file-compressed (0.906x ➖, 1↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 31146424 44022621 0.71
fineweb_q01/datafusion:vortex-file-compressed 🚀 965701637 1408353294 0.69
fineweb_q02/datafusion:vortex-file-compressed 1113876192 1362570459 0.82
fineweb_q03/datafusion:vortex-file-compressed 1502694183 1453294780 1.03
fineweb_q04/datafusion:vortex-file-compressed 1462838574 1364098927 1.07
fineweb_q05/datafusion:vortex-file-compressed 1355499913 1343927203 1.01
fineweb_q06/datafusion:vortex-file-compressed 1656424367 1577262031 1.05
fineweb_q07/datafusion:vortex-file-compressed 1490891112 1450248585 1.03
fineweb_q08/datafusion:vortex-file-compressed 550807226 643149946 0.86
datafusion / vortex-compact (0.686x ✅, 3↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 31420680 59888662 0.52
fineweb_q01/datafusion:vortex-compact 🚀 503331931 1795422028 0.28
fineweb_q02/datafusion:vortex-compact 🚀 640517208 1636661906 0.39
fineweb_q03/datafusion:vortex-compact 1844470240 1889561531 0.98
fineweb_q04/datafusion:vortex-compact 2261472183 2223990817 1.02
fineweb_q05/datafusion:vortex-compact 1683218460 1710264160 0.98
fineweb_q06/datafusion:vortex-compact 1522536887 1701379857 0.89
fineweb_q07/datafusion:vortex-compact 1395192620 1507634781 0.93
fineweb_q08/datafusion:vortex-compact 387617286 535542768 0.72
datafusion / parquet (0.857x ➖, 2↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1107415720 2351044256 0.47
fineweb_q01/datafusion:parquet 🚀 1733397937 2837165722 0.61
fineweb_q02/datafusion:parquet 1937397802 1992027276 0.97
fineweb_q03/datafusion:parquet 2211015027 2369470441 0.93
fineweb_q04/datafusion:parquet 1935120670 2218667365 0.87
fineweb_q05/datafusion:parquet 1963847463 2135123497 0.92
fineweb_q06/datafusion:parquet 1950849899 2166688835 0.90
fineweb_q07/datafusion:parquet 2387324684 1961674551 1.22
fineweb_q08/datafusion:parquet 2346366325 2157258217 1.09
duckdb / vortex-file-compressed (0.955x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85705258 73150532 1.17
fineweb_q01/duckdb:vortex-file-compressed 688009407 738026968 0.93
fineweb_q02/duckdb:vortex-file-compressed 442132209 532859289 0.83
fineweb_q03/duckdb:vortex-file-compressed 1539599477 1503699565 1.02
fineweb_q04/duckdb:vortex-file-compressed 1496625702 1635177234 0.92
fineweb_q05/duckdb:vortex-file-compressed 1526336996 1496410004 1.02
fineweb_q06/duckdb:vortex-file-compressed 1605829125 1575491148 1.02
fineweb_q07/duckdb:vortex-file-compressed 1477577137 1463194809 1.01
fineweb_q08/duckdb:vortex-file-compressed 678526962 919175636 0.74
duckdb / vortex-compact (0.978x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 89838914 69994960 1.28
fineweb_q01/duckdb:vortex-compact 572613138 560917279 1.02
fineweb_q02/duckdb:vortex-compact 552083840 677169244 0.82
fineweb_q03/duckdb:vortex-compact 1584878381 1657354400 0.96
fineweb_q04/duckdb:vortex-compact 1684064316 1693007925 0.99
fineweb_q05/duckdb:vortex-compact 1498669330 1560691209 0.96
fineweb_q06/duckdb:vortex-compact 1408376413 1576110342 0.89
fineweb_q07/duckdb:vortex-compact 1398402392 1488251169 0.94
fineweb_q08/duckdb:vortex-compact 453293641 452261144 1.00
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1186395944 1050604244 1.13
fineweb_q01/duckdb:parquet 1685021019 1665633943 1.01
fineweb_q02/duckdb:parquet 1724984725 1623130340 1.06
fineweb_q03/duckdb:parquet 4196256984 3953237469 1.06
fineweb_q04/duckdb:parquet 2056879385 1864250886 1.10
fineweb_q05/duckdb:parquet 2695150093 2784286121 0.97
fineweb_q06/duckdb:parquet 3268260718 3474011321 0.94
fineweb_q07/duckdb:parquet 4094410663 4222299431 0.97
fineweb_q08/duckdb:parquet 1074674054 1172862851 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -47.5% -27.1% -28.1% +149.0% ➖ noise
0 datafusion:vortex-file-compressed -29.2% -27.1% -3.0% +141.4% ➖ noise
0 duckdb:vortex-compact +28.4% -27.1% +76.0% +76.8% ➖ noise
0 duckdb:vortex-file-compressed +17.2% -27.1% +60.6% +55.5% 🚨 regression
1 datafusion:vortex-compact -72.0% -21.4% -64.3% +81.8% ✅ faster
1 datafusion:vortex-file-compressed -31.4% -21.4% -12.8% +75.0% ➖ noise
1 duckdb:vortex-compact +2.1% -21.4% +29.9% +48.8% ➖ noise
1 duckdb:vortex-file-compressed -6.8% -21.4% +18.6% +56.8% ➖ noise
2 datafusion:vortex-compact -60.9% +1.7% -61.5% +39.2% ✅ faster
2 datafusion:vortex-file-compressed -18.3% +1.7% -19.6% +48.6% ➖ noise
2 duckdb:vortex-compact -18.5% +1.7% -19.8% +81.7% ➖ noise
2 duckdb:vortex-file-compressed -17.0% +1.7% -18.4% +39.2% ➖ noise
3 datafusion:vortex-compact -2.4% -0.5% -1.9% +39.2% ➖ noise
3 datafusion:vortex-file-compressed +3.4% -0.5% +3.9% +39.2% ➖ noise
3 duckdb:vortex-compact -4.4% -0.5% -3.9% +39.2% ➖ noise
3 duckdb:vortex-file-compressed +2.4% -0.5% +2.9% +39.2% ➖ noise
4 datafusion:vortex-compact +1.7% -1.9% +3.7% +39.2% ➖ noise
4 datafusion:vortex-file-compressed +7.2% -1.9% +9.3% +39.2% ➖ noise
4 duckdb:vortex-compact -0.5% -1.9% +1.4% +39.2% ➖ noise
4 duckdb:vortex-file-compressed -8.5% -1.9% -6.7% +39.2% ➖ noise
5 datafusion:vortex-compact -1.6% -5.6% +4.3% +39.2% ➖ noise
5 datafusion:vortex-file-compressed +0.9% -5.6% +6.9% +39.2% ➖ noise
5 duckdb:vortex-compact -4.0% -5.6% +1.8% +39.2% ➖ noise
5 duckdb:vortex-file-compressed +2.0% -5.6% +8.1% +39.2% ➖ noise
6 datafusion:vortex-compact -10.5% -8.0% -2.8% +39.2% ➖ noise
6 datafusion:vortex-file-compressed +5.0% -8.0% +14.1% +39.2% ➖ noise
6 duckdb:vortex-compact -10.6% -8.0% -2.9% +39.2% ➖ noise
6 duckdb:vortex-file-compressed +1.9% -8.0% +10.7% +39.2% ➖ noise
7 datafusion:vortex-compact -7.5% +8.6% -14.8% +39.2% ➖ noise
7 datafusion:vortex-file-compressed +2.8% +8.6% -5.4% +39.2% ➖ noise
7 duckdb:vortex-compact -6.0% +8.6% -13.5% +39.2% ➖ noise
7 duckdb:vortex-file-compressed +1.0% +8.6% -7.0% +60.8% ➖ noise
8 datafusion:vortex-compact -27.6% -0.2% -27.5% +44.2% ➖ noise
8 datafusion:vortex-file-compressed -14.4% -0.2% -14.2% +48.9% ➖ noise
8 duckdb:vortex-compact +0.2% -0.2% +0.4% +39.2% ➖ noise
8 duckdb:vortex-file-compressed -26.2% -0.2% -26.1% +39.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 0.967x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish -2.0%


duckdb / vortex-file-compressed (0.966x ➖, 1↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10664783 11303413 0.94
statpopgen_q01/duckdb:vortex-file-compressed 🚀 25781575 28800432 0.90
statpopgen_q02/duckdb:vortex-file-compressed 1310794742 1323674733 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3061380246 3120903523 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3051960743 3073990497 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1390638589 1440894189 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2054331428 2087706961 0.98
statpopgen_q07/duckdb:vortex-file-compressed 233537768 244945457 0.95
statpopgen_q08/duckdb:vortex-file-compressed 255225363 266373418 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2858418646 2875191636 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4608336687 4738189624 0.97
duckdb / vortex-compact (0.969x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10695842 11627876 0.92
statpopgen_q01/duckdb:vortex-compact 165027124 174204255 0.95
statpopgen_q02/duckdb:vortex-compact 1823367215 1857434119 0.98
statpopgen_q03/duckdb:vortex-compact 3535528871 3547568498 1.00
statpopgen_q04/duckdb:vortex-compact 3493031627 3605920262 0.97
statpopgen_q05/duckdb:vortex-compact 1860497085 1935601155 0.96
statpopgen_q06/duckdb:vortex-compact 2676086330 2731991296 0.98
statpopgen_q07/duckdb:vortex-compact 958312203 974991829 0.98
statpopgen_q08/duckdb:vortex-compact 997646430 1007799938 0.99
statpopgen_q09/duckdb:vortex-compact 3319730147 3478398222 0.95
statpopgen_q10/duckdb:vortex-compact 5416843265 5550508968 0.98
duckdb / parquet (0.951x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307458707 322752820 0.95
statpopgen_q01/duckdb:parquet 396318122 407483627 0.97
statpopgen_q02/duckdb:parquet 971567141 1033135830 0.94
statpopgen_q03/duckdb:parquet 1479062858 1595760658 0.93
statpopgen_q04/duckdb:parquet 1492889672 1603703903 0.93
statpopgen_q05/duckdb:parquet 990038408 1055936568 0.94
statpopgen_q06/duckdb:parquet 1478690029 1557159826 0.95
statpopgen_q07/duckdb:parquet 1866177307 1912650408 0.98
statpopgen_q08/duckdb:parquet 1890177689 1948105442 0.97
statpopgen_q09/duckdb:parquet 1367852213 1413065516 0.97
statpopgen_q10/duckdb:parquet 2639358117 2800344248 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -8.0% -4.7% -3.4% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.6% -4.7% -1.0% +10.0% ➖ noise
1 duckdb:vortex-compact -5.3% -2.7% -2.6% +28.9% ➖ noise
1 duckdb:vortex-file-compressed -10.5% -2.7% -8.0% +240.9% ➖ noise
2 duckdb:vortex-compact -1.8% -6.0% +4.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.0% -6.0% +5.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.3% -7.3% +7.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -7.3% +5.8% +10.0% ➖ noise
4 duckdb:vortex-compact -3.1% -6.9% +4.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -6.9% +6.7% +10.0% ➖ noise
5 duckdb:vortex-compact -3.9% -6.2% +2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.5% -6.2% +2.9% +10.0% ➖ noise
6 duckdb:vortex-compact -2.0% -5.0% +3.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.6% -5.0% +3.6% +10.0% ➖ noise
7 duckdb:vortex-compact -1.7% -2.4% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.7% -2.4% -2.3% +25.7% ➖ noise
8 duckdb:vortex-compact -1.0% -3.0% +2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.2% -3.0% -1.2% +10.0% ➖ noise
9 duckdb:vortex-compact -4.6% -3.2% -1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.6% -3.2% +2.7% +10.0% ➖ noise
10 duckdb:vortex-compact -2.4% -5.7% +3.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.7% -5.7% +3.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 0.893x ✅
Parquet (geomean): 0.906x ➖
Shifts: Parquet (control) -9.4% · Median polish -8.1%


datafusion / vortex-file-compressed (0.880x ✅, 28↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1890481 2072246 0.91
clickbench_q01/datafusion:vortex-file-compressed 14796112 15341542 0.96
clickbench_q02/datafusion:vortex-file-compressed 🚀 34150726 38423245 0.89
clickbench_q03/datafusion:vortex-file-compressed 🚀 38044435 43986561 0.86
clickbench_q04/datafusion:vortex-file-compressed 🚀 307423668 368248124 0.83
clickbench_q05/datafusion:vortex-file-compressed 🚀 319585036 369563808 0.86
clickbench_q06/datafusion:vortex-file-compressed 🚨 2653159 2186320 1.21
clickbench_q07/datafusion:vortex-file-compressed 18020622 19592771 0.92
clickbench_q08/datafusion:vortex-file-compressed 🚀 382923202 462803495 0.83
clickbench_q09/datafusion:vortex-file-compressed 🚀 565597673 648717886 0.87
clickbench_q10/datafusion:vortex-file-compressed 79875981 84980251 0.94
clickbench_q11/datafusion:vortex-file-compressed 🚀 87796590 106625470 0.82
clickbench_q12/datafusion:vortex-file-compressed 🚀 275815139 315954280 0.87
clickbench_q13/datafusion:vortex-file-compressed 🚀 414543741 504890325 0.82
clickbench_q14/datafusion:vortex-file-compressed 🚀 259527721 313264277 0.83
clickbench_q15/datafusion:vortex-file-compressed 🚀 361538958 444520372 0.81
clickbench_q16/datafusion:vortex-file-compressed 🚀 700033582 850931557 0.82
clickbench_q17/datafusion:vortex-file-compressed 🚀 680681442 831416243 0.82
clickbench_q18/datafusion:vortex-file-compressed 🚀 1409904527 1670675300 0.84
clickbench_q19/datafusion:vortex-file-compressed 23085628 25423187 0.91
clickbench_q20/datafusion:vortex-file-compressed 358322071 369332566 0.97
clickbench_q21/datafusion:vortex-file-compressed 🚀 417497816 482050344 0.87
clickbench_q22/datafusion:vortex-file-compressed 🚀 497866519 589388030 0.84
clickbench_q23/datafusion:vortex-file-compressed 858590869 923247026 0.93
clickbench_q24/datafusion:vortex-file-compressed 51650217 56896913 0.91
clickbench_q25/datafusion:vortex-file-compressed 🚀 71118172 79935087 0.89
clickbench_q26/datafusion:vortex-file-compressed 🚀 45839783 60437556 0.76
clickbench_q27/datafusion:vortex-file-compressed 🚀 790373148 884011494 0.89
clickbench_q28/datafusion:vortex-file-compressed 6688643468 7283628284 0.92
clickbench_q29/datafusion:vortex-file-compressed 237214248 250011544 0.95
clickbench_q30/datafusion:vortex-file-compressed 🚀 232365472 279475995 0.83
clickbench_q31/datafusion:vortex-file-compressed 🚀 269880740 322444065 0.84
clickbench_q32/datafusion:vortex-file-compressed 🚀 1289270947 1555231693 0.83
clickbench_q33/datafusion:vortex-file-compressed 🚀 1407653827 1715745887 0.82
clickbench_q34/datafusion:vortex-file-compressed 🚀 1378581275 1682554240 0.82
clickbench_q35/datafusion:vortex-file-compressed 🚀 509425357 574373165 0.89
clickbench_q36/datafusion:vortex-file-compressed 84948569 89644694 0.95
clickbench_q37/datafusion:vortex-file-compressed 39928416 43950117 0.91
clickbench_q38/datafusion:vortex-file-compressed 🚀 23194304 26176700 0.89
clickbench_q39/datafusion:vortex-file-compressed 152410832 163474300 0.93
clickbench_q40/datafusion:vortex-file-compressed 19929426 21133692 0.94
clickbench_q41/datafusion:vortex-file-compressed 🚀 17533062 19896409 0.88
clickbench_q42/datafusion:vortex-file-compressed 🚀 18549652 21537570 0.86
datafusion / parquet (0.885x ✅, 29↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1827968 2528166 0.72
clickbench_q01/datafusion:parquet 🚀 20300507 23342812 0.87
clickbench_q02/datafusion:parquet 🚀 54593215 61131204 0.89
clickbench_q03/datafusion:parquet 🚀 45009230 51606696 0.87
clickbench_q04/datafusion:parquet 🚀 330906039 409834526 0.81
clickbench_q05/datafusion:parquet 370605877 408633800 0.91
clickbench_q06/datafusion:parquet 1772026 1914120 0.93
clickbench_q07/datafusion:parquet 26265816 27145267 0.97
clickbench_q08/datafusion:parquet 🚀 412722315 477135502 0.87
clickbench_q09/datafusion:parquet 🚀 648849552 747986736 0.87
clickbench_q10/datafusion:parquet 🚀 114676536 129955615 0.88
clickbench_q11/datafusion:parquet 🚀 137073599 153159200 0.89
clickbench_q12/datafusion:parquet 🚀 359126100 404646725 0.89
clickbench_q13/datafusion:parquet 🚀 504075480 587271378 0.86
clickbench_q14/datafusion:parquet 🚀 351020722 410514014 0.86
clickbench_q15/datafusion:parquet 🚀 384190891 463439556 0.83
clickbench_q16/datafusion:parquet 🚀 724978719 838524311 0.86
clickbench_q17/datafusion:parquet 🚀 688361377 803649306 0.86
clickbench_q18/datafusion:parquet 🚀 1417300996 1725019643 0.82
clickbench_q19/datafusion:parquet 🚀 31364919 39248433 0.80
clickbench_q20/datafusion:parquet 🚀 610187302 681702989 0.90
clickbench_q21/datafusion:parquet 🚀 659043473 733069911 0.90
clickbench_q22/datafusion:parquet 964089544 1054521396 0.91
clickbench_q23/datafusion:parquet 🚀 3667819244 4303504493 0.85
clickbench_q24/datafusion:parquet 95073023 94628452 1.00
clickbench_q25/datafusion:parquet 142601373 152091446 0.94
clickbench_q26/datafusion:parquet 87880868 92906215 0.95
clickbench_q27/datafusion:parquet 1045873518 1144960088 0.91
clickbench_q28/datafusion:parquet 6690159032 7042468768 0.95
clickbench_q29/datafusion:parquet 244986829 254409361 0.96
clickbench_q30/datafusion:parquet 🚀 361546001 419993896 0.86
clickbench_q31/datafusion:parquet 🚀 394272667 449692200 0.88
clickbench_q32/datafusion:parquet 1342436442 1439021089 0.93
clickbench_q33/datafusion:parquet 🚀 1566123173 1791576911 0.87
clickbench_q34/datafusion:parquet 🚀 1540699815 1778338172 0.87
clickbench_q35/datafusion:parquet 🚀 540574392 611875037 0.88
clickbench_q36/datafusion:parquet 🚀 141682817 167596551 0.85
clickbench_q37/datafusion:parquet 62144055 68509703 0.91
clickbench_q38/datafusion:parquet 90940861 100506407 0.90
clickbench_q39/datafusion:parquet 🚀 267989618 301842555 0.89
clickbench_q40/datafusion:parquet 🚀 32819447 36821786 0.89
clickbench_q41/datafusion:parquet 31223779 32382233 0.96
clickbench_q42/datafusion:parquet 🚀 31159280 34810127 0.90
duckdb / vortex-file-compressed (0.905x ➖, 18↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6142414 6988457 0.88
clickbench_q01/duckdb:vortex-file-compressed 🚀 13664944 15742596 0.87
clickbench_q02/duckdb:vortex-file-compressed 25412262 26268839 0.97
clickbench_q03/duckdb:vortex-file-compressed 29626695 32651014 0.91
clickbench_q04/duckdb:vortex-file-compressed 173849305 186899362 0.93
clickbench_q05/duckdb:vortex-file-compressed 🚀 198038915 234338200 0.85
clickbench_q06/duckdb:vortex-file-compressed 🚀 18576043 21807066 0.85
clickbench_q07/duckdb:vortex-file-compressed 🚀 15749021 17666387 0.89
clickbench_q08/duckdb:vortex-file-compressed 265243303 293308324 0.90
clickbench_q09/duckdb:vortex-file-compressed 375912327 408173856 0.92
clickbench_q10/duckdb:vortex-file-compressed 75189038 81676011 0.92
clickbench_q11/duckdb:vortex-file-compressed 85125468 91970419 0.93
clickbench_q12/duckdb:vortex-file-compressed 🚀 220224863 255474184 0.86
clickbench_q13/duckdb:vortex-file-compressed 🚀 446434839 513754743 0.87
clickbench_q14/duckdb:vortex-file-compressed 🚀 245710089 279845484 0.88
clickbench_q15/duckdb:vortex-file-compressed 🚀 209626797 248804187 0.84
clickbench_q16/duckdb:vortex-file-compressed 🚀 677453711 800262360 0.85
clickbench_q17/duckdb:vortex-file-compressed 🚀 532808244 669356153 0.80
clickbench_q18/duckdb:vortex-file-compressed 1234740840 1356347565 0.91
clickbench_q19/duckdb:vortex-file-compressed 🚀 21277337 24144345 0.88
clickbench_q20/duckdb:vortex-file-compressed 🚀 381689742 457983792 0.83
clickbench_q21/duckdb:vortex-file-compressed 🚀 411634358 481774960 0.85
clickbench_q22/duckdb:vortex-file-compressed 657306121 667354867 0.98
clickbench_q23/duckdb:vortex-file-compressed 2336965723 2506791322 0.93
clickbench_q24/duckdb:vortex-file-compressed 🚀 46891841 57106533 0.82
clickbench_q25/duckdb:vortex-file-compressed 74116556 78417082 0.95
clickbench_q26/duckdb:vortex-file-compressed 44959696 45992650 0.98
clickbench_q27/duckdb:vortex-file-compressed 525497571 579964937 0.91
clickbench_q28/duckdb:vortex-file-compressed 2996143465 3163231090 0.95
clickbench_q29/duckdb:vortex-file-compressed 🚀 28065447 31635181 0.89
clickbench_q30/duckdb:vortex-file-compressed 🚀 181660818 206222626 0.88
clickbench_q31/duckdb:vortex-file-compressed 🚀 259783353 306400102 0.85
clickbench_q32/duckdb:vortex-file-compressed 1413488352 1434600597 0.99
clickbench_q33/duckdb:vortex-file-compressed 1538888422 1701559611 0.90
clickbench_q34/duckdb:vortex-file-compressed 1676207726 1858267802 0.90
clickbench_q35/duckdb:vortex-file-compressed 360211248 395689935 0.91
clickbench_q36/duckdb:vortex-file-compressed 32411962 34093401 0.95
clickbench_q37/duckdb:vortex-file-compressed 25466928 26237054 0.97
clickbench_q38/duckdb:vortex-file-compressed 26129611 26830420 0.97
clickbench_q39/duckdb:vortex-file-compressed 45645588 48591680 0.94
clickbench_q40/duckdb:vortex-file-compressed 25255353 25196651 1.00
clickbench_q41/duckdb:vortex-file-compressed 23161370 25118482 0.92
clickbench_q42/duckdb:vortex-file-compressed 25812886 26054987 0.99
duckdb / parquet (0.928x ➖, 4↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 217696059 278903150 0.78
clickbench_q01/duckdb:parquet 50091106 53302485 0.94
clickbench_q02/duckdb:parquet 65313822 71212617 0.92
clickbench_q03/duckdb:parquet 🚀 62065045 69769256 0.89
clickbench_q04/duckdb:parquet 203947658 223423761 0.91
clickbench_q05/duckdb:parquet 280165572 310216108 0.90
clickbench_q06/duckdb:parquet 60826460 64790685 0.94
clickbench_q07/duckdb:parquet 53043418 54681957 0.97
clickbench_q08/duckdb:parquet 266864690 291334535 0.92
clickbench_q09/duckdb:parquet 400922891 422694770 0.95
clickbench_q10/duckdb:parquet 95063375 102739053 0.93
clickbench_q11/duckdb:parquet 109109536 115406901 0.95
clickbench_q12/duckdb:parquet 296484347 318369457 0.93
clickbench_q13/duckdb:parquet 513761945 556551212 0.92
clickbench_q14/duckdb:parquet 336007193 353497604 0.95
clickbench_q15/duckdb:parquet 242003436 265728116 0.91
clickbench_q16/duckdb:parquet 614570744 668055375 0.92
clickbench_q17/duckdb:parquet 506092518 558976535 0.91
clickbench_q18/duckdb:parquet 1054601480 1164904321 0.91
clickbench_q19/duckdb:parquet 49388378 52400455 0.94
clickbench_q20/duckdb:parquet 434452474 466323079 0.93
clickbench_q21/duckdb:parquet 560624091 587491419 0.95
clickbench_q22/duckdb:parquet 923796103 970644715 0.95
clickbench_q23/duckdb:parquet 318122978 331653767 0.96
clickbench_q24/duckdb:parquet 78130543 84084953 0.93
clickbench_q25/duckdb:parquet 142204127 144655846 0.98
clickbench_q26/duckdb:parquet 52664095 55958364 0.94
clickbench_q27/duckdb:parquet 641919962 680803108 0.94
clickbench_q28/duckdb:parquet 4857421716 5076461250 0.96
clickbench_q29/duckdb:parquet 60772460 65069954 0.93
clickbench_q30/duckdb:parquet 306003934 327441541 0.93
clickbench_q31/duckdb:parquet 349650788 374514043 0.93
clickbench_q32/duckdb:parquet 1177449436 1294044616 0.91
clickbench_q33/duckdb:parquet 🚀 1264910716 1443430486 0.88
clickbench_q34/duckdb:parquet 🚀 1277796963 1460167428 0.88
clickbench_q35/duckdb:parquet 354661564 376608539 0.94
clickbench_q36/duckdb:parquet 67237805 66940908 1.00
clickbench_q37/duckdb:parquet 53247918 56641747 0.94
clickbench_q38/duckdb:parquet 56997414 62296098 0.91
clickbench_q39/duckdb:parquet 98609058 104759073 0.94
clickbench_q40/duckdb:parquet 56198511 59530522 0.94
clickbench_q41/duckdb:parquet 58898432 62843396 0.94
clickbench_q42/duckdb:parquet 48678762 53724100 0.91
duckdb / duckdb (0.943x ➖, 4↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17779219 18607421 0.96
clickbench_q01/duckdb:duckdb 32973646 34653009 0.95
clickbench_q02/duckdb:duckdb 45771610 46024155 0.99
clickbench_q03/duckdb:duckdb 47049706 49268786 0.95
clickbench_q04/duckdb:duckdb 222510152 231092127 0.96
clickbench_q05/duckdb:duckdb 322288504 340931234 0.95
clickbench_q06/duckdb:duckdb 34439199 36550876 0.94
clickbench_q07/duckdb:duckdb 36286139 36430178 1.00
clickbench_q08/duckdb:duckdb 312582477 319597107 0.98
clickbench_q09/duckdb:duckdb 491563385 493261256 1.00
clickbench_q10/duckdb:duckdb 97621541 102598174 0.95
clickbench_q11/duckdb:duckdb 106547461 111136693 0.96
clickbench_q12/duckdb:duckdb 297116669 318119101 0.93
clickbench_q13/duckdb:duckdb 523084432 577137980 0.91
clickbench_q14/duckdb:duckdb 348500775 365608267 0.95
clickbench_q15/duckdb:duckdb 254865800 273553677 0.93
clickbench_q16/duckdb:duckdb 678819070 729748580 0.93
clickbench_q17/duckdb:duckdb 574976234 628618813 0.91
clickbench_q18/duckdb:duckdb 1255748990 1375834846 0.91
clickbench_q19/duckdb:duckdb 35212112 36025506 0.98
clickbench_q20/duckdb:duckdb 944635664 933340325 1.01
clickbench_q21/duckdb:duckdb 991530750 1063281515 0.93
clickbench_q22/duckdb:duckdb 1077494195 1158932809 0.93
clickbench_q23/duckdb:duckdb 253117135 268863460 0.94
clickbench_q24/duckdb:duckdb 60395592 64830014 0.93
clickbench_q25/duckdb:duckdb 124508793 126211200 0.99
clickbench_q26/duckdb:duckdb 🚀 53438856 61494262 0.87
clickbench_q27/duckdb:duckdb 1125251739 1071906837 1.05
clickbench_q28/duckdb:duckdb 4622020191 4858528737 0.95
clickbench_q29/duckdb:duckdb 47910455 49735668 0.96
clickbench_q30/duckdb:duckdb 295991833 315112744 0.94
clickbench_q31/duckdb:duckdb 427799954 456967638 0.94
clickbench_q32/duckdb:duckdb 🚀 1417440453 1772044197 0.80
clickbench_q33/duckdb:duckdb 🚀 2027692866 2356045142 0.86
clickbench_q34/duckdb:duckdb 🚀 2073698113 2415585203 0.86
clickbench_q35/duckdb:duckdb 264840216 279121121 0.95
clickbench_q36/duckdb:duckdb 41006631 43587527 0.94
clickbench_q37/duckdb:duckdb 31414381 32405077 0.97
clickbench_q38/duckdb:duckdb 30825596 32683949 0.94
clickbench_q39/duckdb:duckdb 66686831 72415820 0.92
clickbench_q40/duckdb:duckdb 31151766 33117337 0.94
clickbench_q41/duckdb:duckdb 30386444 31205235 0.97
clickbench_q42/duckdb:duckdb 31733398 33317300 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -8.8% -24.9% +21.4% +565.3% ➖ noise
0 duckdb:duckdb -4.5% -24.9% +27.2% +243.8% ➖ noise
0 duckdb:vortex-file-compressed -12.1% -24.9% +17.0% +297.1% ➖ noise
1 datafusion:vortex-file-compressed -3.6% -9.6% +6.7% +55.5% ➖ noise
1 duckdb:duckdb -4.8% -9.6% +5.3% +58.5% ➖ noise
1 duckdb:vortex-file-compressed -13.2% -9.6% -4.0% +22.4% ➖ noise
2 datafusion:vortex-file-compressed -11.1% -9.5% -1.8% +28.4% ➖ noise
2 duckdb:duckdb -0.5% -9.5% +9.9% +24.0% ➖ noise
2 duckdb:vortex-file-compressed -3.3% -9.5% +6.9% +14.0% ➖ noise
3 datafusion:vortex-file-compressed -13.5% -11.9% -1.8% +142.5% ➖ noise
3 duckdb:duckdb -4.5% -11.9% +8.4% +54.5% ➖ noise
3 duckdb:vortex-file-compressed -9.3% -11.9% +3.0% +26.4% ➖ noise
4 datafusion:vortex-file-compressed -16.5% -14.1% -2.8% +11.4% ➖ noise
4 duckdb:duckdb -3.7% -14.1% +12.2% +11.4% 🚨 regression
4 duckdb:vortex-file-compressed -7.0% -14.1% +8.3% +11.4% ➖ noise
5 datafusion:vortex-file-compressed -13.5% -9.5% -4.4% +11.4% ➖ noise
5 duckdb:duckdb -5.5% -9.5% +4.5% +11.4% ➖ noise
5 duckdb:vortex-file-compressed -15.5% -9.5% -6.6% +11.4% ➖ noise
6 datafusion:vortex-file-compressed +21.4% -6.8% +30.2% +39.1% ➖ noise
6 duckdb:duckdb -5.8% -6.8% +1.1% +28.1% ➖ noise
6 duckdb:vortex-file-compressed -14.8% -6.8% -8.6% +19.2% ➖ noise
7 datafusion:vortex-file-compressed -8.0% -3.1% -5.1% +11.4% ➖ noise
7 duckdb:duckdb -0.4% -3.1% +2.8% +11.4% ➖ noise
7 duckdb:vortex-file-compressed -10.9% -3.1% -8.0% +14.0% ➖ noise
8 datafusion:vortex-file-compressed -17.3% -11.0% -7.0% +11.4% ➖ noise
8 duckdb:duckdb -2.2% -11.0% +9.9% +11.4% ➖ noise
8 duckdb:vortex-file-compressed -9.6% -11.0% +1.6% +11.4% ➖ noise
9 datafusion:vortex-file-compressed -12.8% -9.3% -3.9% +11.4% ➖ noise
9 duckdb:duckdb -0.3% -9.3% +9.9% +11.4% ➖ noise
9 duckdb:vortex-file-compressed -7.9% -9.3% +1.5% +11.4% ➖ noise
10 datafusion:vortex-file-compressed -6.0% -9.6% +4.0% +12.1% ➖ noise
10 duckdb:duckdb -4.9% -9.6% +5.3% +11.4% ➖ noise
10 duckdb:vortex-file-compressed -7.9% -9.6% +1.9% +11.4% ➖ noise
11 datafusion:vortex-file-compressed -17.7% -8.0% -10.5% +11.8% ➖ noise
11 duckdb:duckdb -4.1% -8.0% +4.2% +11.4% ➖ noise
11 duckdb:vortex-file-compressed -7.4% -8.0% +0.6% +11.4% ➖ noise
12 datafusion:vortex-file-compressed -12.7% -9.1% -4.0% +11.4% ➖ noise
12 duckdb:duckdb -6.6% -9.1% +2.7% +11.4% ➖ noise
12 duckdb:vortex-file-compressed -13.8% -9.1% -5.2% +11.4% ➖ noise
13 datafusion:vortex-file-compressed -17.9% -11.0% -7.8% +11.4% ➖ noise
13 duckdb:duckdb -9.4% -11.0% +1.8% +11.4% ➖ noise
13 duckdb:vortex-file-compressed -13.1% -11.0% -2.4% +11.4% ➖ noise
14 datafusion:vortex-file-compressed -17.2% -9.8% -8.1% +11.4% ➖ noise
14 duckdb:duckdb -4.7% -9.8% +5.7% +11.4% ➖ noise
14 duckdb:vortex-file-compressed -12.2% -9.8% -2.6% +14.6% ➖ noise
15 datafusion:vortex-file-compressed -18.7% -13.1% -6.4% +11.4% ➖ noise
15 duckdb:duckdb -6.8% -13.1% +7.2% +11.4% ➖ noise
15 duckdb:vortex-file-compressed -15.7% -13.1% -3.0% +11.4% ➖ noise
16 datafusion:vortex-file-compressed -17.7% -10.8% -7.8% +11.4% ➖ noise
16 duckdb:duckdb -7.0% -10.8% +4.3% +11.4% ➖ noise
16 duckdb:vortex-file-compressed -15.3% -10.8% -5.1% +15.9% ➖ noise
17 datafusion:vortex-file-compressed -18.1% -11.9% -7.0% +11.4% ➖ noise
17 duckdb:duckdb -8.5% -11.9% +3.9% +11.4% ➖ noise
17 duckdb:vortex-file-compressed -20.4% -11.9% -9.6% +12.7% ➖ noise
18 datafusion:vortex-file-compressed -15.6% -13.8% -2.1% +11.4% ➖ noise
18 duckdb:duckdb -8.7% -13.8% +5.8% +11.4% ➖ noise
18 duckdb:vortex-file-compressed -9.0% -13.8% +5.6% +11.4% ➖ noise
19 datafusion:vortex-file-compressed -9.2% -13.2% +4.6% +14.0% ➖ noise
19 duckdb:duckdb -2.3% -13.2% +12.6% +11.4% 🚨 regression
19 duckdb:vortex-file-compressed -11.9% -13.2% +1.5% +34.4% ➖ noise
20 datafusion:vortex-file-compressed -3.0% -8.7% +6.2% +175.8% ➖ noise
20 duckdb:duckdb +1.2% -8.7% +10.8% +25.1% ➖ noise
20 duckdb:vortex-file-compressed -16.7% -8.7% -8.7% +11.4% ➖ noise
21 datafusion:vortex-file-compressed -13.4% -7.4% -6.5% +11.4% ➖ noise
21 duckdb:duckdb -6.7% -7.4% +0.7% +13.0% ➖ noise
21 duckdb:vortex-file-compressed -14.6% -7.4% -7.8% +11.4% ➖ noise
22 datafusion:vortex-file-compressed -15.5% -6.7% -9.4% +11.4% ➖ noise
22 duckdb:duckdb -7.0% -6.7% -0.3% +11.4% ➖ noise
22 duckdb:vortex-file-compressed -1.5% -6.7% +5.6% +19.3% ➖ noise
23 datafusion:vortex-file-compressed -7.0% -9.6% +2.9% +35.4% ➖ noise
23 duckdb:duckdb -5.9% -9.6% +4.1% +11.4% ➖ noise
23 duckdb:vortex-file-compressed -6.8% -9.6% +3.1% +11.4% ➖ noise
24 datafusion:vortex-file-compressed -9.2% -3.4% -6.0% +18.6% ➖ noise
24 duckdb:duckdb -6.8% -3.4% -3.6% +12.6% ➖ noise
24 duckdb:vortex-file-compressed -17.9% -3.4% -15.0% +28.2% ➖ noise
25 datafusion:vortex-file-compressed -11.0% -4.0% -7.3% +11.5% ➖ noise
25 duckdb:duckdb -1.3% -4.0% +2.8% +11.4% ➖ noise
25 duckdb:vortex-file-compressed -5.5% -4.0% -1.6% +17.7% ➖ noise
26 datafusion:vortex-file-compressed -24.2% -5.6% -19.6% +15.6% ✅ faster
26 duckdb:duckdb -13.1% -5.6% -7.9% +13.5% ➖ noise
26 duckdb:vortex-file-compressed -2.2% -5.6% +3.6% +13.4% ➖ noise
27 datafusion:vortex-file-compressed -10.6% -7.2% -3.7% +11.4% ➖ noise
27 duckdb:duckdb +5.0% -7.2% +13.1% +12.4% 🚨 regression
27 duckdb:vortex-file-compressed -9.4% -7.2% -2.4% +11.4% ➖ noise
28 datafusion:vortex-file-compressed -8.2% -4.7% -3.7% +11.4% ➖ noise
28 duckdb:duckdb -4.9% -4.7% -0.2% +11.4% ➖ noise
28 duckdb:vortex-file-compressed -5.3% -4.7% -0.7% +11.4% ➖ noise
29 datafusion:vortex-file-compressed -5.1% -5.2% +0.0% +14.2% ➖ noise
29 duckdb:duckdb -3.7% -5.2% +1.6% +11.4% ➖ noise
29 duckdb:vortex-file-compressed -11.3% -5.2% -6.5% +14.8% ➖ noise
30 datafusion:vortex-file-compressed -16.9% -10.3% -7.3% +11.4% ➖ noise
30 duckdb:duckdb -6.1% -10.3% +4.7% +11.4% ➖ noise
30 duckdb:vortex-file-compressed -11.9% -10.3% -1.8% +11.4% ➖ noise
31 datafusion:vortex-file-compressed -16.3% -9.5% -7.5% +11.4% ➖ noise
31 duckdb:duckdb -6.4% -9.5% +3.5% +11.4% ➖ noise
31 duckdb:vortex-file-compressed -15.2% -9.5% -6.3% +11.4% ➖ noise
32 datafusion:vortex-file-compressed -17.1% -7.9% -10.0% +20.4% ➖ noise
32 duckdb:duckdb -20.0% -7.9% -13.2% +11.4% ✅ faster
32 duckdb:vortex-file-compressed -1.5% -7.9% +6.9% +11.4% ➖ noise
33 datafusion:vortex-file-compressed -18.0% -12.5% -6.3% +11.4% ➖ noise
33 duckdb:duckdb -13.9% -12.5% -1.7% +11.4% ➖ noise
33 duckdb:vortex-file-compressed -9.6% -12.5% +3.3% +11.4% ➖ noise
34 datafusion:vortex-file-compressed -18.1% -12.9% -5.9% +11.4% ➖ noise
34 duckdb:duckdb -14.2% -12.9% -1.4% +11.4% ➖ noise
34 duckdb:vortex-file-compressed -9.8% -12.9% +3.6% +11.4% ➖ noise
35 datafusion:vortex-file-compressed -11.3% -8.8% -2.8% +13.4% ➖ noise
35 duckdb:duckdb -5.1% -8.8% +4.0% +11.4% ➖ noise
35 duckdb:vortex-file-compressed -9.0% -8.8% -0.2% +11.4% ➖ noise
36 datafusion:vortex-file-compressed -5.2% -7.9% +2.8% +11.4% ➖ noise
36 duckdb:duckdb -5.9% -7.9% +2.1% +11.4% ➖ noise
36 duckdb:vortex-file-compressed -4.9% -7.9% +3.2% +11.4% ➖ noise
37 datafusion:vortex-file-compressed -9.2% -7.7% -1.6% +12.7% ➖ noise
37 duckdb:duckdb -3.1% -7.7% +5.0% +11.4% ➖ noise
37 duckdb:vortex-file-compressed -2.9% -7.7% +5.1% +11.4% ➖ noise
38 datafusion:vortex-file-compressed -11.4% -9.0% -2.6% +11.4% ➖ noise
38 duckdb:duckdb -5.7% -9.0% +3.7% +11.4% ➖ noise
38 duckdb:vortex-file-compressed -2.6% -9.0% +7.0% +12.0% ➖ noise
39 datafusion:vortex-file-compressed -6.8% -8.6% +2.0% +11.4% ➖ noise
39 duckdb:duckdb -7.9% -8.6% +0.7% +21.9% ➖ noise
39 duckdb:vortex-file-compressed -6.1% -8.6% +2.8% +11.4% ➖ noise
40 datafusion:vortex-file-compressed -5.7% -8.3% +2.8% +11.4% ➖ noise
40 duckdb:duckdb -5.9% -8.3% +2.5% +11.4% ➖ noise
40 duckdb:vortex-file-compressed +0.2% -8.3% +9.3% +11.4% ➖ noise
41 datafusion:vortex-file-compressed -11.9% -4.9% -7.3% +11.4% ➖ noise
41 duckdb:duckdb -2.6% -4.9% +2.4% +11.4% ➖ noise
41 duckdb:vortex-file-compressed -7.8% -4.9% -3.0% +11.4% ➖ noise
42 datafusion:vortex-file-compressed -13.9% -9.9% -4.4% +11.4% ➖ noise
42 duckdb:duckdb -4.8% -9.9% +5.8% +11.4% ➖ noise
42 duckdb:vortex-file-compressed -0.9% -9.9% +10.0% +11.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.7%
Vortex (geomean): 0.913x ➖
Parquet (geomean): 0.840x ➖
Shifts: Parquet (control) -16.0% · Median polish -7.6%


datafusion / vortex-file-compressed (0.913x ➖, 4↑ 3↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 676590915 1138334875 0.59
tpch_q02/datafusion:vortex-file-compressed 929964908 1014740963 0.92
tpch_q03/datafusion:vortex-file-compressed 🚀 1002184660 1456520553 0.69
tpch_q04/datafusion:vortex-file-compressed 🚨 806245607 614386206 1.31
tpch_q05/datafusion:vortex-file-compressed 1064350293 1131060655 0.94
tpch_q06/datafusion:vortex-file-compressed 640825399 700291220 0.92
tpch_q07/datafusion:vortex-file-compressed 1239140407 1289721862 0.96
tpch_q08/datafusion:vortex-file-compressed 1436627621 1447344680 0.99
tpch_q09/datafusion:vortex-file-compressed 1460409841 1359670319 1.07
tpch_q10/datafusion:vortex-file-compressed 1076354897 1165516379 0.92
tpch_q11/datafusion:vortex-file-compressed 🚨 686385027 519630441 1.32
tpch_q12/datafusion:vortex-file-compressed 942572347 1132458548 0.83
tpch_q13/datafusion:vortex-file-compressed 485030007 453397641 1.07
tpch_q14/datafusion:vortex-file-compressed 620717273 615092924 1.01
tpch_q15/datafusion:vortex-file-compressed 1260617203 1256954591 1.00
tpch_q16/datafusion:vortex-file-compressed 🚨 458405114 325430435 1.41
tpch_q17/datafusion:vortex-file-compressed 1160977995 1176658488 0.99
tpch_q18/datafusion:vortex-file-compressed 1261911776 1501451676 0.84
tpch_q19/datafusion:vortex-file-compressed 🚀 844928715 1414722445 0.60
tpch_q20/datafusion:vortex-file-compressed 1188282236 1233255395 0.96
tpch_q21/datafusion:vortex-file-compressed 1756672288 2046548027 0.86
tpch_q22/datafusion:vortex-file-compressed 🚀 378032891 763307710 0.50
datafusion / vortex-compact (0.850x ➖, 4↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 661890912 698252597 0.95
tpch_q02/datafusion:vortex-compact 710166455 755291415 0.94
tpch_q03/datafusion:vortex-compact 849012587 1044832375 0.81
tpch_q04/datafusion:vortex-compact 773568148 678777394 1.14
tpch_q05/datafusion:vortex-compact 🚀 983380132 1430726935 0.69
tpch_q06/datafusion:vortex-compact 638894898 719967108 0.89
tpch_q07/datafusion:vortex-compact 1017283700 1190542688 0.85
tpch_q08/datafusion:vortex-compact 1122530268 1098555097 1.02
tpch_q09/datafusion:vortex-compact 🚀 1231303635 1801192426 0.68
tpch_q10/datafusion:vortex-compact 🚀 991729720 2086044371 0.48
tpch_q11/datafusion:vortex-compact 🚀 380906746 786718693 0.48
tpch_q12/datafusion:vortex-compact 935386902 1156650994 0.81
tpch_q13/datafusion:vortex-compact 506340198 498819978 1.02
tpch_q14/datafusion:vortex-compact 602901407 656899376 0.92
tpch_q15/datafusion:vortex-compact 1103279866 1361507444 0.81
tpch_q16/datafusion:vortex-compact 395774071 440889617 0.90
tpch_q17/datafusion:vortex-compact 1169885071 1512157571 0.77
tpch_q18/datafusion:vortex-compact 1211707092 1257675136 0.96
tpch_q19/datafusion:vortex-compact 1009145156 817294134 1.23
tpch_q20/datafusion:vortex-compact 986205954 1052433086 0.94
tpch_q21/datafusion:vortex-compact 1700148833 1600970068 1.06
tpch_q22/datafusion:vortex-compact 533222655 667869790 0.80
datafusion / parquet (0.758x ➖, 7↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1183953466 983656409 1.20
tpch_q02/datafusion:parquet 1482851089 1671853790 0.89
tpch_q03/datafusion:parquet 1299361335 1552454963 0.84
tpch_q04/datafusion:parquet 650157372 770647109 0.84
tpch_q05/datafusion:parquet 🚀 1394211165 2529976041 0.55
tpch_q06/datafusion:parquet 🚀 581531065 1180253738 0.49
tpch_q07/datafusion:parquet 🚀 1832043075 3450402172 0.53
tpch_q08/datafusion:parquet 2209885565 1816617873 1.22
tpch_q09/datafusion:parquet 2369362767 2063461616 1.15
tpch_q10/datafusion:parquet 2496709211 3485238481 0.72
tpch_q11/datafusion:parquet 570117674 750393826 0.76
tpch_q12/datafusion:parquet 810817663 1119065860 0.72
tpch_q13/datafusion:parquet 1218583290 1401049610 0.87
tpch_q14/datafusion:parquet 🚀 821469965 1469366648 0.56
tpch_q15/datafusion:parquet 1553544369 2152420004 0.72
tpch_q16/datafusion:parquet 834946971 756537633 1.10
tpch_q17/datafusion:parquet 1480512580 2034661288 0.73
tpch_q18/datafusion:parquet 1677794110 1644790061 1.02
tpch_q19/datafusion:parquet 🚀 1082821579 1751886362 0.62
tpch_q20/datafusion:parquet 🚀 1272040618 3039561005 0.42
tpch_q21/datafusion:parquet 2069784644 2183121471 0.95
tpch_q22/datafusion:parquet 🚀 736671648 1365464719 0.54
duckdb / vortex-file-compressed (0.943x ➖, 1↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 622379608 663996429 0.94
tpch_q02/duckdb:vortex-file-compressed 1277237273 1328305669 0.96
tpch_q03/duckdb:vortex-file-compressed 1189729329 984467062 1.21
tpch_q04/duckdb:vortex-file-compressed 832957946 870702091 0.96
tpch_q05/duckdb:vortex-file-compressed 1135563869 1328025364 0.86
tpch_q06/duckdb:vortex-file-compressed 761170066 917244864 0.83
tpch_q07/duckdb:vortex-file-compressed 1263144009 1114275918 1.13
tpch_q08/duckdb:vortex-file-compressed 1467470481 1547074907 0.95
tpch_q09/duckdb:vortex-file-compressed 1589125053 1571073315 1.01
tpch_q10/duckdb:vortex-file-compressed 1215038567 1122989314 1.08
tpch_q11/duckdb:vortex-file-compressed 690015986 779073786 0.89
tpch_q12/duckdb:vortex-file-compressed 851517220 871075691 0.98
tpch_q13/duckdb:vortex-file-compressed 🚀 970413233 1629589575 0.60
tpch_q14/duckdb:vortex-file-compressed 813737444 1034673580 0.79
tpch_q15/duckdb:vortex-file-compressed 562195034 538126515 1.04
tpch_q16/duckdb:vortex-file-compressed 475566589 599886098 0.79
tpch_q17/duckdb:vortex-file-compressed 1040903322 1003882627 1.04
tpch_q18/duckdb:vortex-file-compressed 958784912 922912685 1.04
tpch_q19/duckdb:vortex-file-compressed 788489480 752311720 1.05
tpch_q20/duckdb:vortex-file-compressed 1345627692 1490181606 0.90
tpch_q21/duckdb:vortex-file-compressed 1921766459 2192099590 0.88
tpch_q22/duckdb:vortex-file-compressed 718572768 684210837 1.05
duckdb / vortex-compact (0.950x ➖, 0↑ 1↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 595583995 623622486 0.96
tpch_q02/duckdb:vortex-compact 🚨 1571542935 1201676988 1.31
tpch_q03/duckdb:vortex-compact 882677345 950756898 0.93
tpch_q04/duckdb:vortex-compact 510916458 639400894 0.80
tpch_q05/duckdb:vortex-compact 987819481 1071391738 0.92
tpch_q06/duckdb:vortex-compact 724875426 884571191 0.82
tpch_q07/duckdb:vortex-compact 1003428625 1169458149 0.86
tpch_q08/duckdb:vortex-compact 1396723243 1344458374 1.04
tpch_q09/duckdb:vortex-compact 1490850008 1494441385 1.00
tpch_q10/duckdb:vortex-compact 1099017541 1086187935 1.01
tpch_q11/duckdb:vortex-compact 644797366 664244202 0.97
tpch_q12/duckdb:vortex-compact 686536207 792368268 0.87
tpch_q13/duckdb:vortex-compact 965129318 1022766889 0.94
tpch_q14/duckdb:vortex-compact 841026230 901580153 0.93
tpch_q15/duckdb:vortex-compact 532195135 499843016 1.06
tpch_q16/duckdb:vortex-compact 414165179 408228938 1.01
tpch_q17/duckdb:vortex-compact 935110587 1138099754 0.82
tpch_q18/duckdb:vortex-compact 756898484 806813591 0.94
tpch_q19/duckdb:vortex-compact 759054181 744265310 1.02
tpch_q20/duckdb:vortex-compact 1074908977 1427844454 0.75
tpch_q21/duckdb:vortex-compact 1659446918 1764758857 0.94
tpch_q22/duckdb:vortex-compact 679187474 590174916 1.15
duckdb / parquet (0.931x ➖, 0↑ 0↓)
name PR 4ebf4f4 (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1129744719 1201902641 0.94
tpch_q02/duckdb:parquet 1899932581 1635435914 1.16
tpch_q03/duckdb:parquet 2432245361 2367023746 1.03
tpch_q04/duckdb:parquet 995480845 1202241369 0.83
tpch_q05/duckdb:parquet 2074103881 2513416328 0.83
tpch_q06/duckdb:parquet 775660504 649045934 1.20
tpch_q07/duckdb:parquet 1708189229 2191712730 0.78
tpch_q08/duckdb:parquet 3103617202 2990132610 1.04
tpch_q09/duckdb:parquet 2186670737 2359075896 0.93
tpch_q10/duckdb:parquet 3110836960 4304197343 0.72
tpch_q11/duckdb:parquet 1120204933 1121011662 1.00
tpch_q12/duckdb:parquet 1294276388 1405474122 0.92
tpch_q13/duckdb:parquet 1306606842 1201945187 1.09
tpch_q14/duckdb:parquet 1277853700 1312563984 0.97
tpch_q15/duckdb:parquet 811197875 1135650954 0.71
tpch_q16/duckdb:parquet 890733223 787397501 1.13
tpch_q17/duckdb:parquet 1323763191 1644904155 0.80
tpch_q18/duckdb:parquet 1621985304 1965262584 0.83
tpch_q19/duckdb:parquet 1515976416 2042718827 0.74
tpch_q20/duckdb:parquet 1969578433 1872306051 1.05
tpch_q21/duckdb:parquet 1865139336 2257324249 0.83
tpch_q22/duckdb:parquet 1281272885 1046107208 1.22
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.2% +6.4% -10.9% +107.8% ➖ noise
1 datafusion:vortex-file-compressed -40.6% +6.4% -44.1% +92.0% ➖ noise
1 duckdb:vortex-compact -4.5% +6.4% -10.2% +57.3% ➖ noise
1 duckdb:vortex-file-compressed -6.3% +6.4% -11.9% +57.3% ➖ noise
2 datafusion:vortex-compact -6.0% +1.5% -7.4% +70.1% ➖ noise
2 datafusion:vortex-file-compressed -8.4% +1.5% -9.7% +62.9% ➖ noise
2 duckdb:vortex-compact +30.8% +1.5% +28.8% +57.3% ➖ noise
2 duckdb:vortex-file-compressed -3.8% +1.5% -5.3% +57.3% ➖ noise
3 datafusion:vortex-compact -18.7% -7.3% -12.4% +78.6% ➖ noise
3 datafusion:vortex-file-compressed -31.2% -7.3% -25.8% +69.7% ➖ noise
3 duckdb:vortex-compact -7.2% -7.3% +0.1% +80.7% ➖ noise
3 duckdb:vortex-file-compressed +20.9% -7.3% +30.3% +66.1% ➖ noise
4 datafusion:vortex-compact +14.0% -16.4% +36.4% +65.6% ➖ noise
4 datafusion:vortex-file-compressed +31.2% -16.4% +57.0% +57.3% ➖ noise
4 duckdb:vortex-compact -20.1% -16.4% -4.4% +57.3% ➖ noise
4 duckdb:vortex-file-compressed -4.3% -16.4% +14.5% +57.3% ➖ noise
5 datafusion:vortex-compact -31.3% -32.6% +1.9% +57.3% ➖ noise
5 datafusion:vortex-file-compressed -5.9% -32.6% +39.5% +57.3% ➖ noise
5 duckdb:vortex-compact -7.8% -32.6% +36.7% +57.3% ➖ noise
5 duckdb:vortex-file-compressed -14.5% -32.6% +26.8% +57.3% ➖ noise
6 datafusion:vortex-compact -11.3% -23.3% +15.6% +57.3% ➖ noise
6 datafusion:vortex-file-compressed -8.5% -23.3% +19.3% +57.3% ➖ noise
6 duckdb:vortex-compact -18.1% -23.3% +6.8% +57.3% ➖ noise
6 duckdb:vortex-file-compressed -17.0% -23.3% +8.1% +57.3% ➖ noise
7 datafusion:vortex-compact -14.6% -35.7% +32.8% +57.3% ➖ noise
7 datafusion:vortex-file-compressed -3.9% -35.7% +49.4% +57.3% ➖ noise
7 duckdb:vortex-compact -14.2% -35.7% +33.4% +57.3% ➖ noise
7 duckdb:vortex-file-compressed +13.4% -35.7% +76.2% +57.3% 🚨 regression
8 datafusion:vortex-compact +2.2% +12.4% -9.1% +57.3% ➖ noise
8 datafusion:vortex-file-compressed -0.7% +12.4% -11.7% +74.4% ➖ noise
8 duckdb:vortex-compact +3.9% +12.4% -7.5% +57.3% ➖ noise
8 duckdb:vortex-file-compressed -5.1% +12.4% -15.6% +57.3% ➖ noise
9 datafusion:vortex-compact -31.6% +3.2% -33.7% +57.3% ➖ noise
9 datafusion:vortex-file-compressed +7.4% +3.2% +4.1% +57.3% ➖ noise
9 duckdb:vortex-compact -0.2% +3.2% -3.3% +57.3% ➖ noise
9 duckdb:vortex-file-compressed +1.1% +3.2% -2.0% +57.3% ➖ noise
10 datafusion:vortex-compact -52.5% -28.0% -33.9% +72.4% ➖ noise
10 datafusion:vortex-file-compressed -7.6% -28.0% +28.3% +57.3% ➖ noise
10 duckdb:vortex-compact +1.2% -28.0% +40.6% +60.7% ➖ noise
10 duckdb:vortex-file-compressed +8.2% -28.0% +50.4% +58.7% ➖ noise
11 datafusion:vortex-compact -51.6% -12.9% -44.4% +61.2% ✅ faster
11 datafusion:vortex-file-compressed +32.1% -12.9% +51.6% +57.3% ➖ noise
11 duckdb:vortex-compact -2.9% -12.9% +11.4% +57.3% ➖ noise
11 duckdb:vortex-file-compressed -11.4% -12.9% +1.6% +57.3% ➖ noise
12 datafusion:vortex-compact -19.1% -18.3% -1.0% +57.3% ➖ noise
12 datafusion:vortex-file-compressed -16.8% -18.3% +1.9% +57.3% ➖ noise
12 duckdb:vortex-compact -13.4% -18.3% +6.1% +57.3% ➖ noise
12 duckdb:vortex-file-compressed -2.2% -18.3% +19.7% +57.3% ➖ noise
13 datafusion:vortex-compact +1.5% -2.8% +4.4% +104.0% ➖ noise
13 datafusion:vortex-file-compressed +7.0% -2.8% +10.0% +83.2% ➖ noise
13 duckdb:vortex-compact -5.6% -2.8% -3.0% +95.5% ➖ noise
13 duckdb:vortex-file-compressed -40.5% -2.8% -38.8% +72.0% ➖ noise
14 datafusion:vortex-compact -8.2% -26.2% +24.4% +57.3% ➖ noise
14 datafusion:vortex-file-compressed +0.9% -26.2% +36.8% +57.3% ➖ noise
14 duckdb:vortex-compact -6.7% -26.2% +26.4% +57.3% ➖ noise
14 duckdb:vortex-file-compressed -21.4% -26.2% +6.6% +57.3% ➖ noise
15 datafusion:vortex-compact -19.0% -28.2% +12.9% +57.3% ➖ noise
15 datafusion:vortex-file-compressed +0.3% -28.2% +39.7% +57.3% ➖ noise
15 duckdb:vortex-compact +6.5% -28.2% +48.3% +57.3% ➖ noise
15 duckdb:vortex-file-compressed +4.5% -28.2% +45.5% +57.3% ➖ noise
16 datafusion:vortex-compact -10.2% +11.7% -19.7% +57.3% ➖ noise
16 datafusion:vortex-file-compressed +40.9% +11.7% +26.1% +57.3% ➖ noise
16 duckdb:vortex-compact +1.5% +11.7% -9.2% +141.8% ➖ noise
16 duckdb:vortex-file-compressed -20.7% +11.7% -29.1% +57.3% ➖ noise
17 datafusion:vortex-compact -22.6% -23.5% +1.1% +57.3% ➖ noise
17 datafusion:vortex-file-compressed -1.3% -23.5% +28.9% +57.3% ➖ noise
17 duckdb:vortex-compact -17.8% -23.5% +7.4% +57.3% ➖ noise
17 duckdb:vortex-file-compressed +3.7% -23.5% +35.5% +57.3% ➖ noise
18 datafusion:vortex-compact -3.7% -8.2% +5.0% +57.3% ➖ noise
18 datafusion:vortex-file-compressed -16.0% -8.2% -8.4% +57.3% ➖ noise
18 duckdb:vortex-compact -6.2% -8.2% +2.2% +57.3% ➖ noise
18 duckdb:vortex-file-compressed +3.9% -8.2% +13.2% +57.3% ➖ noise
19 datafusion:vortex-compact +23.5% -32.3% +82.3% +57.3% 🚨 regression
19 datafusion:vortex-file-compressed -40.3% -32.3% -11.8% +57.3% ➖ noise
19 duckdb:vortex-compact +2.0% -32.3% +50.6% +57.3% ➖ noise
19 duckdb:vortex-file-compressed +4.8% -32.3% +54.8% +57.3% ➖ noise
20 datafusion:vortex-compact -6.3% -33.6% +41.2% +57.3% ➖ noise
20 datafusion:vortex-file-compressed -3.6% -33.6% +45.2% +57.3% ➖ noise
20 duckdb:vortex-compact -24.7% -33.6% +13.5% +57.3% ➖ noise
20 duckdb:vortex-file-compressed -9.7% -33.6% +36.1% +57.3% ➖ noise
21 datafusion:vortex-compact +6.2% -11.5% +20.0% +57.3% ➖ noise
21 datafusion:vortex-file-compressed -14.2% -11.5% -3.0% +57.3% ➖ noise
21 duckdb:vortex-compact -6.0% -11.5% +6.2% +57.3% ➖ noise
21 duckdb:vortex-file-compressed -12.3% -11.5% -0.9% +57.3% ➖ noise
22 datafusion:vortex-compact -20.2% -18.7% -1.8% +60.6% ➖ noise
22 datafusion:vortex-file-compressed -50.5% -18.7% -39.1% +57.9% ✅ faster
22 duckdb:vortex-compact +15.1% -18.7% +41.6% +61.2% ➖ noise
22 duckdb:vortex-file-compressed +5.0% -18.7% +29.2% +57.3% ➖ noise

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant