Skip to content

Sub-segment Reads#7273

Open
gatesn wants to merge 12 commits intodevelopfrom
ngates/lazy-buffers/segment-source-ranges
Open

Sub-segment Reads#7273
gatesn wants to merge 12 commits intodevelopfrom
ngates/lazy-buffers/segment-source-ranges

Conversation

@gatesn
Copy link
Copy Markdown
Contributor

@gatesn gatesn commented Apr 2, 2026

No description provided.

gatesn added 8 commits March 19, 2026 10:45
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the changelog/performance A performance improvement label Apr 2, 2026
gatesn added 3 commits April 2, 2026 17:05
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 2, 2026

Merging this PR will not alter performance

✅ 1122 untouched benchmarks
⏩ 1530 skipped benchmarks1


Comparing ngates/lazy-buffers/segment-source-ranges (f7c78b1) with develop (5d0d627)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added do not merge Pull requests that are not intended to merge action/benchmark Trigger full benchmarks to run on this PR labels Apr 2, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f7c78b1 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.140x ❌


datafusion / vortex-file-compressed (1.140x ❌, 0↑ 6↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 132849098 126982884 1.05
polarsignals_q01/datafusion:vortex-file-compressed 407919590 373932905 1.09
polarsignals_q02/datafusion:vortex-file-compressed 23773528 21666539 1.10
polarsignals_q03/datafusion:vortex-file-compressed 412452540 379223749 1.09
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12903487 11358522 1.14
polarsignals_q05/datafusion:vortex-file-compressed 🚨 19399495 15533985 1.25
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21490316 18554748 1.16
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16993185 13952353 1.22
polarsignals_q08/datafusion:vortex-file-compressed 🚨 516873842 464787938 1.11
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12739154 10451898 1.22

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.9%
Vortex (geomean): 1.056x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish +3.0%


datafusion / vortex-file-compressed (1.045x ➖, 0↑ 3↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 54350513 54631834 0.99
tpch_q02/datafusion:vortex-file-compressed 36408793 35729787 1.02
tpch_q03/datafusion:vortex-file-compressed 30201927 29103257 1.04
tpch_q04/datafusion:vortex-file-compressed 20445967 20152796 1.01
tpch_q05/datafusion:vortex-file-compressed 57554158 54960445 1.05
tpch_q06/datafusion:vortex-file-compressed 🚨 12212359 10586292 1.15
tpch_q07/datafusion:vortex-file-compressed 🚨 73133273 66245070 1.10
tpch_q08/datafusion:vortex-file-compressed 51724277 47555095 1.09
tpch_q09/datafusion:vortex-file-compressed 61283973 57814244 1.06
tpch_q10/datafusion:vortex-file-compressed 48242643 46212919 1.04
tpch_q11/datafusion:vortex-file-compressed 19126057 18736072 1.02
tpch_q12/datafusion:vortex-file-compressed 25839140 24928180 1.04
tpch_q13/datafusion:vortex-file-compressed 28303730 30569131 0.93
tpch_q14/datafusion:vortex-file-compressed 17672007 17447758 1.01
tpch_q15/datafusion:vortex-file-compressed 28080791 26148454 1.07
tpch_q16/datafusion:vortex-file-compressed 26954096 27236123 0.99
tpch_q17/datafusion:vortex-file-compressed 73594090 67977255 1.08
tpch_q18/datafusion:vortex-file-compressed 91243821 85814594 1.06
tpch_q19/datafusion:vortex-file-compressed 🚨 27188519 24147392 1.13
tpch_q20/datafusion:vortex-file-compressed 38109017 35384313 1.08
tpch_q21/datafusion:vortex-file-compressed 82573635 77069063 1.07
tpch_q22/datafusion:vortex-file-compressed 17189386 17704121 0.97
datafusion / vortex-compact (1.065x ➖, 0↑ 5↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61903288 59135765 1.05
tpch_q02/datafusion:vortex-compact 39653483 37392404 1.06
tpch_q03/datafusion:vortex-compact 35025773 34885064 1.00
tpch_q04/datafusion:vortex-compact 25821049 25386993 1.02
tpch_q05/datafusion:vortex-compact 62010253 63639211 0.97
tpch_q06/datafusion:vortex-compact 🚨 15618514 13050607 1.20
tpch_q07/datafusion:vortex-compact 🚨 80921658 72950198 1.11
tpch_q08/datafusion:vortex-compact 57586928 52927322 1.09
tpch_q09/datafusion:vortex-compact 70811640 65505888 1.08
tpch_q10/datafusion:vortex-compact 🚨 62356832 56361942 1.11
tpch_q11/datafusion:vortex-compact 22363317 21552246 1.04
tpch_q12/datafusion:vortex-compact 37435191 34535858 1.08
tpch_q13/datafusion:vortex-compact 39392409 37773914 1.04
tpch_q14/datafusion:vortex-compact 🚨 24938470 22593120 1.10
tpch_q15/datafusion:vortex-compact 🚨 42248548 35794808 1.18
tpch_q16/datafusion:vortex-compact 32704818 31852920 1.03
tpch_q17/datafusion:vortex-compact 78988421 74667054 1.06
tpch_q18/datafusion:vortex-compact 96538497 90846227 1.06
tpch_q19/datafusion:vortex-compact 38427378 35650256 1.08
tpch_q20/datafusion:vortex-compact 44528524 41969221 1.06
tpch_q21/datafusion:vortex-compact 96453074 92965145 1.04
tpch_q22/datafusion:vortex-compact 19055470 19053916 1.00
datafusion / parquet (0.988x ➖, 2↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 96447366 137408678 0.70
tpch_q02/datafusion:parquet 74775632 74661701 1.00
tpch_q03/datafusion:parquet 83085878 86684710 0.96
tpch_q04/datafusion:parquet 51034374 50883624 1.00
tpch_q05/datafusion:parquet 110614743 103153488 1.07
tpch_q06/datafusion:parquet 45141045 44936992 1.00
tpch_q07/datafusion:parquet 123307290 116366690 1.06
tpch_q08/datafusion:parquet 105097012 108733178 0.97
tpch_q09/datafusion:parquet 149116625 140315630 1.06
tpch_q10/datafusion:parquet 128429977 123115634 1.04
tpch_q11/datafusion:parquet 51441619 51066168 1.01
tpch_q12/datafusion:parquet 92942281 98497374 0.94
tpch_q13/datafusion:parquet 221126824 225461207 0.98
tpch_q14/datafusion:parquet 51471395 53031640 0.97
tpch_q15/datafusion:parquet 69693903 66967537 1.04
tpch_q16/datafusion:parquet 52332842 53416218 0.98
tpch_q17/datafusion:parquet 158129039 157391854 1.00
tpch_q18/datafusion:parquet 180153878 174340777 1.03
tpch_q19/datafusion:parquet 🚀 73630541 83139766 0.89
tpch_q20/datafusion:parquet 80577832 79676680 1.01
tpch_q21/datafusion:parquet 157290662 150936260 1.04
tpch_q22/datafusion:parquet 39378767 38255085 1.03
datafusion / arrow (1.007x ➖, 1↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 61633595 62150574 0.99
tpch_q02/datafusion:arrow 23300939 24446971 0.95
tpch_q03/datafusion:arrow 37179606 37599714 0.99
tpch_q04/datafusion:arrow 31364154 33510033 0.94
tpch_q05/datafusion:arrow 85955048 90441209 0.95
tpch_q06/datafusion:arrow 🚀 21545014 24426719 0.88
tpch_q07/datafusion:arrow 122922346 122501075 1.00
tpch_q08/datafusion:arrow 50314748 51050653 0.99
tpch_q09/datafusion:arrow 85147065 78596486 1.08
tpch_q10/datafusion:arrow 60065263 56710841 1.06
tpch_q11/datafusion:arrow 12950610 12670002 1.02
tpch_q12/datafusion:arrow 64758252 60607814 1.07
tpch_q13/datafusion:arrow 53679661 51387879 1.04
tpch_q14/datafusion:arrow 26972183 26309408 1.03
tpch_q15/datafusion:arrow 55583102 52376983 1.06
tpch_q16/datafusion:arrow 23015976 22002842 1.05
tpch_q17/datafusion:arrow 85333416 78854470 1.08
tpch_q18/datafusion:arrow 163962007 172359305 0.95
tpch_q19/datafusion:arrow 43593691 44799839 0.97
tpch_q20/datafusion:arrow 44119223 43354879 1.02
tpch_q21/datafusion:arrow 180307910 167777285 1.07
tpch_q22/datafusion:arrow 21843195 22303066 0.98
duckdb / vortex-file-compressed (1.077x ➖, 0↑ 9↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33667618 34478558 0.98
tpch_q02/duckdb:vortex-file-compressed 🚨 35033851 29112186 1.20
tpch_q03/duckdb:vortex-file-compressed 32832789 31660985 1.04
tpch_q04/duckdb:vortex-file-compressed 32488309 31865008 1.02
tpch_q05/duckdb:vortex-file-compressed 36854962 35429400 1.04
tpch_q06/duckdb:vortex-file-compressed 🚨 12668551 11244766 1.13
tpch_q07/duckdb:vortex-file-compressed 🚨 45003983 40026288 1.12
tpch_q08/duckdb:vortex-file-compressed 🚨 45774052 41212297 1.11
tpch_q09/duckdb:vortex-file-compressed 93700004 89531770 1.05
tpch_q10/duckdb:vortex-file-compressed 37144029 38636398 0.96
tpch_q11/duckdb:vortex-file-compressed 18371319 17587568 1.04
tpch_q12/duckdb:vortex-file-compressed 🚨 32147488 23681427 1.36
tpch_q13/duckdb:vortex-file-compressed 40664925 40130784 1.01
tpch_q14/duckdb:vortex-file-compressed 🚨 28040685 23402549 1.20
tpch_q15/duckdb:vortex-file-compressed 17306913 17857334 0.97
tpch_q16/duckdb:vortex-file-compressed 32436205 31914971 1.02
tpch_q17/duckdb:vortex-file-compressed 🚨 33018801 27457332 1.20
tpch_q18/duckdb:vortex-file-compressed 49941627 50302978 0.99
tpch_q19/duckdb:vortex-file-compressed 🚨 38778355 35211846 1.10
tpch_q20/duckdb:vortex-file-compressed 🚨 40760642 36633686 1.11
tpch_q21/duckdb:vortex-file-compressed 121613627 110560715 1.10
tpch_q22/duckdb:vortex-file-compressed 20378884 19932000 1.02
duckdb / vortex-compact (1.038x ➖, 0↑ 3↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40888981 41593016 0.98
tpch_q02/duckdb:vortex-compact 41154931 41562748 0.99
tpch_q03/duckdb:vortex-compact 36470031 35242793 1.03
tpch_q04/duckdb:vortex-compact 37000373 36382887 1.02
tpch_q05/duckdb:vortex-compact 42273988 39999668 1.06
tpch_q06/duckdb:vortex-compact 17179553 16718557 1.03
tpch_q07/duckdb:vortex-compact 🚨 52163651 45528721 1.15
tpch_q08/duckdb:vortex-compact 51737311 50026400 1.03
tpch_q09/duckdb:vortex-compact 104290775 99597940 1.05
tpch_q10/duckdb:vortex-compact 45181397 43600414 1.04
tpch_q11/duckdb:vortex-compact 21253631 21530489 0.99
tpch_q12/duckdb:vortex-compact 🚨 43795969 38890042 1.13
tpch_q13/duckdb:vortex-compact 46392317 47434774 0.98
tpch_q14/duckdb:vortex-compact 33703849 32277738 1.04
tpch_q15/duckdb:vortex-compact 21070293 20629505 1.02
tpch_q16/duckdb:vortex-compact 40598475 41274286 0.98
tpch_q17/duckdb:vortex-compact 🚨 39558416 32880981 1.20
tpch_q18/duckdb:vortex-compact 53891304 54052227 1.00
tpch_q19/duckdb:vortex-compact 42968550 40852176 1.05
tpch_q20/duckdb:vortex-compact 50766781 46409476 1.09
tpch_q21/duckdb:vortex-compact 125100143 123396500 1.01
tpch_q22/duckdb:vortex-compact 23122558 23233521 1.00
duckdb / parquet (0.991x ➖, 3↑ 4↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77942994 85653519 0.91
tpch_q02/duckdb:parquet 41258823 41346675 1.00
tpch_q03/duckdb:parquet 🚀 73633457 84659309 0.87
tpch_q04/duckdb:parquet 🚨 58962824 49262245 1.20
tpch_q05/duckdb:parquet 69822868 68728721 1.02
tpch_q06/duckdb:parquet 21270048 21387970 0.99
tpch_q07/duckdb:parquet 84796682 85907589 0.99
tpch_q08/duckdb:parquet 85665597 85148100 1.01
tpch_q09/duckdb:parquet 164988362 167424101 0.99
tpch_q10/duckdb:parquet 132065184 133849912 0.99
tpch_q11/duckdb:parquet 24141519 23838565 1.01
tpch_q12/duckdb:parquet 🚀 46875338 56850929 0.82
tpch_q13/duckdb:parquet 289863952 294544778 0.98
tpch_q14/duckdb:parquet 51680904 57033416 0.91
tpch_q15/duckdb:parquet 🚀 25010450 33062977 0.76
tpch_q16/duckdb:parquet 58237556 56867612 1.02
tpch_q17/duckdb:parquet 58617235 57272841 1.02
tpch_q18/duckdb:parquet 122237678 123011293 0.99
tpch_q19/duckdb:parquet 🚨 83158128 75370545 1.10
tpch_q20/duckdb:parquet 🚨 79189851 65599176 1.21
tpch_q21/duckdb:parquet 🚨 204791512 182795326 1.12
tpch_q22/duckdb:parquet 54854957 53767769 1.02
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16289167 16497884 0.99
tpch_q02/duckdb:duckdb 13666892 13241995 1.03
tpch_q03/duckdb:duckdb 19254347 21136944 0.91
tpch_q04/duckdb:duckdb 20256521 21102754 0.96
tpch_q05/duckdb:duckdb 20866252 21097740 0.99
tpch_q06/duckdb:duckdb 5733246 5798087 0.99
tpch_q07/duckdb:duckdb 24256376 23247786 1.04
tpch_q08/duckdb:duckdb 21834267 22383271 0.98
tpch_q09/duckdb:duckdb 61711462 63452510 0.97
tpch_q10/duckdb:duckdb 48983810 48614297 1.01
tpch_q11/duckdb:duckdb 6585719 6465757 1.02
tpch_q12/duckdb:duckdb 15065316 14740138 1.02
tpch_q13/duckdb:duckdb 38808611 39426244 0.98
tpch_q14/duckdb:duckdb 19494038 18698718 1.04
tpch_q15/duckdb:duckdb 12335298 12395699 1.00
tpch_q16/duckdb:duckdb 25606436 25068732 1.02
tpch_q17/duckdb:duckdb 15231586 15305325 1.00
tpch_q18/duckdb:duckdb 40853165 41465243 0.99
tpch_q19/duckdb:duckdb 28329026 28417930 1.00
tpch_q20/duckdb:duckdb 23441436 23341022 1.00
tpch_q21/duckdb:duckdb 60889025 62110205 0.98
tpch_q22/duckdb:duckdb 25293120 25112149 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.8% -20.1% +24.1% +31.7% ➖ noise
1 datafusion:vortex-compact +4.7% -20.1% +31.0% +31.2% ➖ noise
1 datafusion:vortex-file-compressed -0.5% -20.1% +24.5% +31.0% ➖ noise
1 duckdb:duckdb -1.3% -20.1% +23.5% +31.5% ➖ noise
1 duckdb:vortex-compact -1.7% -20.1% +23.0% +30.7% ➖ noise
1 duckdb:vortex-file-compressed -2.4% -20.1% +22.2% +31.9% ➖ noise
2 datafusion:arrow -4.7% -0.0% -4.7% +21.4% ➖ noise
2 datafusion:vortex-compact +6.0% -0.0% +6.1% +21.4% ➖ noise
2 datafusion:vortex-file-compressed +1.9% -0.0% +1.9% +21.4% ➖ noise
2 duckdb:duckdb +3.2% -0.0% +3.2% +21.4% ➖ noise
2 duckdb:vortex-compact -1.0% -0.0% -1.0% +21.4% ➖ noise
2 duckdb:vortex-file-compressed +20.3% -0.0% +20.4% +21.4% ➖ noise
3 datafusion:arrow -1.1% -8.7% +8.3% +21.4% ➖ noise
3 datafusion:vortex-compact +0.4% -8.7% +10.0% +21.4% ➖ noise
3 datafusion:vortex-file-compressed +3.8% -8.7% +13.7% +21.4% ➖ noise
3 duckdb:duckdb -8.9% -8.7% -0.2% +21.4% ➖ noise
3 duckdb:vortex-compact +3.5% -8.7% +13.3% +21.4% ➖ noise
3 duckdb:vortex-file-compressed +3.7% -8.7% +13.6% +21.4% ➖ noise
4 datafusion:arrow -6.4% +9.6% -14.6% +21.4% ➖ noise
4 datafusion:vortex-compact +1.7% +9.6% -7.2% +21.4% ➖ noise
4 datafusion:vortex-file-compressed +1.5% +9.6% -7.4% +21.4% ➖ noise
4 duckdb:duckdb -4.0% +9.6% -12.4% +21.4% ➖ noise
4 duckdb:vortex-compact +1.7% +9.6% -7.2% +21.4% ➖ noise
4 duckdb:vortex-file-compressed +2.0% +9.6% -6.9% +21.4% ➖ noise
5 datafusion:arrow -5.0% +4.4% -8.9% +21.4% ➖ noise
5 datafusion:vortex-compact -2.6% +4.4% -6.6% +21.4% ➖ noise
5 datafusion:vortex-file-compressed +4.7% +4.4% +0.3% +21.4% ➖ noise
5 duckdb:duckdb -1.1% +4.4% -5.2% +21.4% ➖ noise
5 duckdb:vortex-compact +5.7% +4.4% +1.3% +21.4% ➖ noise
5 duckdb:vortex-file-compressed +4.0% +4.4% -0.3% +21.4% ➖ noise
6 datafusion:arrow -11.8% -0.0% -11.8% +23.7% ➖ noise
6 datafusion:vortex-compact +19.7% -0.0% +19.7% +24.1% ➖ noise
6 datafusion:vortex-file-compressed +15.4% -0.0% +15.4% +23.9% ➖ noise
6 duckdb:duckdb -1.1% -0.0% -1.1% +26.2% ➖ noise
6 duckdb:vortex-compact +2.8% -0.0% +2.8% +24.1% ➖ noise
6 duckdb:vortex-file-compressed +12.7% -0.0% +12.7% +25.8% ➖ noise
7 datafusion:arrow +0.3% +2.3% -1.9% +21.4% ➖ noise
7 datafusion:vortex-compact +10.9% +2.3% +8.5% +21.4% ➖ noise
7 datafusion:vortex-file-compressed +10.4% +2.3% +7.9% +21.4% ➖ noise
7 duckdb:duckdb +4.3% +2.3% +2.0% +21.4% ➖ noise
7 duckdb:vortex-compact +14.6% +2.3% +12.0% +21.4% ➖ noise
7 duckdb:vortex-file-compressed +12.4% +2.3% +9.9% +21.4% ➖ noise
8 datafusion:arrow -1.4% -1.4% -0.1% +21.4% ➖ noise
8 datafusion:vortex-compact +8.8% -1.4% +10.3% +21.4% ➖ noise
8 datafusion:vortex-file-compressed +8.8% -1.4% +10.3% +21.4% ➖ noise
8 duckdb:duckdb -2.5% -1.4% -1.1% +21.4% ➖ noise
8 duckdb:vortex-compact +3.4% -1.4% +4.9% +21.4% ➖ noise
8 duckdb:vortex-file-compressed +11.1% -1.4% +12.6% +21.4% ➖ noise
9 datafusion:arrow +8.3% +2.3% +5.9% +21.4% ➖ noise
9 datafusion:vortex-compact +8.1% +2.3% +5.6% +21.4% ➖ noise
9 datafusion:vortex-file-compressed +6.0% +2.3% +3.6% +21.4% ➖ noise
9 duckdb:duckdb -2.7% +2.3% -5.0% +21.4% ➖ noise
9 duckdb:vortex-compact +4.7% +2.3% +2.3% +21.4% ➖ noise
9 duckdb:vortex-file-compressed +4.7% +2.3% +2.3% +21.4% ➖ noise
10 datafusion:arrow +5.9% +1.5% +4.4% +21.4% ➖ noise
10 datafusion:vortex-compact +10.6% +1.5% +9.1% +21.4% ➖ noise
10 datafusion:vortex-file-compressed +4.4% +1.5% +2.9% +21.4% ➖ noise
10 duckdb:duckdb +0.8% +1.5% -0.7% +21.4% ➖ noise
10 duckdb:vortex-compact +3.6% +1.5% +2.1% +21.4% ➖ noise
10 duckdb:vortex-file-compressed -3.9% +1.5% -5.2% +21.4% ➖ noise
11 datafusion:arrow +2.2% +1.0% +1.2% +21.4% ➖ noise
11 datafusion:vortex-compact +3.8% +1.0% +2.7% +21.4% ➖ noise
11 datafusion:vortex-file-compressed +2.1% +1.0% +1.1% +21.4% ➖ noise
11 duckdb:duckdb +1.9% +1.0% +0.8% +21.4% ➖ noise
11 duckdb:vortex-compact -1.3% +1.0% -2.3% +21.4% ➖ noise
11 duckdb:vortex-file-compressed +4.5% +1.0% +3.4% +21.4% ➖ noise
12 datafusion:arrow +6.8% -11.8% +21.1% +21.4% ➖ noise
12 datafusion:vortex-compact +8.4% -11.8% +22.9% +21.4% 🚨 regression
12 datafusion:vortex-file-compressed +3.7% -11.8% +17.5% +21.4% ➖ noise
12 duckdb:duckdb +2.2% -11.8% +15.9% +21.4% ➖ noise
12 duckdb:vortex-compact +12.6% -11.8% +27.7% +21.4% 🚨 regression
12 duckdb:vortex-file-compressed +35.7% -11.8% +53.9% +21.4% 🚨 regression
13 datafusion:arrow +4.5% -1.8% +6.3% +21.4% ➖ noise
13 datafusion:vortex-compact +4.3% -1.8% +6.1% +21.4% ➖ noise
13 datafusion:vortex-file-compressed -7.4% -1.8% -5.8% +21.4% ➖ noise
13 duckdb:duckdb -1.6% -1.8% +0.2% +21.4% ➖ noise
13 duckdb:vortex-compact -2.2% -1.8% -0.4% +21.4% ➖ noise
13 duckdb:vortex-file-compressed +1.3% -1.8% +3.1% +21.4% ➖ noise
14 datafusion:arrow +2.5% -6.2% +9.3% +21.4% ➖ noise
14 datafusion:vortex-compact +10.4% -6.2% +17.7% +21.4% ➖ noise
14 datafusion:vortex-file-compressed +1.3% -6.2% +8.0% +21.4% ➖ noise
14 duckdb:duckdb +4.3% -6.2% +11.2% +21.4% ➖ noise
14 duckdb:vortex-compact +4.4% -6.2% +11.3% +21.4% ➖ noise
14 duckdb:vortex-file-compressed +19.8% -6.2% +27.8% +21.4% 🚨 regression
15 datafusion:arrow +6.1% -11.3% +19.6% +21.4% ➖ noise
15 datafusion:vortex-compact +18.0% -11.3% +33.0% +21.4% 🚨 regression
15 datafusion:vortex-file-compressed +7.4% -11.3% +21.0% +21.4% ➖ noise
15 duckdb:duckdb -0.5% -11.3% +12.2% +23.0% ➖ noise
15 duckdb:vortex-compact +2.1% -11.3% +15.1% +21.4% ➖ noise
15 duckdb:vortex-file-compressed -3.1% -11.3% +9.2% +22.0% ➖ noise
16 datafusion:arrow +4.6% +0.2% +4.4% +21.4% ➖ noise
16 datafusion:vortex-compact +2.7% +0.2% +2.5% +21.4% ➖ noise
16 datafusion:vortex-file-compressed -1.0% +0.2% -1.2% +21.4% ➖ noise
16 duckdb:duckdb +2.1% +0.2% +2.0% +21.4% ➖ noise
16 duckdb:vortex-compact -1.6% +0.2% -1.8% +21.4% ➖ noise
16 duckdb:vortex-file-compressed +1.6% +0.2% +1.5% +21.4% ➖ noise
17 datafusion:arrow +8.2% +1.4% +6.7% +21.4% ➖ noise
17 datafusion:vortex-compact +5.8% +1.4% +4.3% +21.4% ➖ noise
17 datafusion:vortex-file-compressed +8.3% +1.4% +6.8% +21.8% ➖ noise
17 duckdb:duckdb -0.5% +1.4% -1.9% +21.4% ➖ noise
17 duckdb:vortex-compact +20.3% +1.4% +18.6% +21.4% ➖ noise
17 duckdb:vortex-file-compressed +20.3% +1.4% +18.6% +21.4% ➖ noise
18 datafusion:arrow -4.9% +1.3% -6.1% +21.4% ➖ noise
18 datafusion:vortex-compact +6.3% +1.3% +4.9% +21.4% ➖ noise
18 datafusion:vortex-file-compressed +6.3% +1.3% +4.9% +21.4% ➖ noise
18 duckdb:duckdb -1.5% +1.3% -2.8% +21.4% ➖ noise
18 duckdb:vortex-compact -0.3% +1.3% -1.6% +21.4% ➖ noise
18 duckdb:vortex-file-compressed -0.7% +1.3% -2.0% +21.4% ➖ noise
19 datafusion:arrow -2.7% -1.2% -1.6% +21.4% ➖ noise
19 datafusion:vortex-compact +7.8% -1.2% +9.0% +21.4% ➖ noise
19 datafusion:vortex-file-compressed +12.6% -1.2% +13.9% +21.4% ➖ noise
19 duckdb:duckdb -0.3% -1.2% +0.8% +21.4% ➖ noise
19 duckdb:vortex-compact +5.2% -1.2% +6.4% +21.4% ➖ noise
19 duckdb:vortex-file-compressed +10.1% -1.2% +11.4% +21.4% ➖ noise
20 datafusion:arrow +1.8% +10.5% -7.9% +21.4% ➖ noise
20 datafusion:vortex-compact +6.1% +10.5% -4.0% +21.4% ➖ noise
20 datafusion:vortex-file-compressed +7.7% +10.5% -2.5% +21.4% ➖ noise
20 duckdb:duckdb +0.4% +10.5% -9.1% +21.4% ➖ noise
20 duckdb:vortex-compact +9.4% +10.5% -1.0% +21.4% ➖ noise
20 duckdb:vortex-file-compressed +11.3% +10.5% +0.7% +21.5% ➖ noise
21 datafusion:arrow +7.5% +8.1% -0.5% +21.4% ➖ noise
21 datafusion:vortex-compact +3.8% +8.1% -4.0% +21.4% ➖ noise
21 datafusion:vortex-file-compressed +7.1% +8.1% -0.8% +21.4% ➖ noise
21 duckdb:duckdb -2.0% +8.1% -9.3% +21.4% ➖ noise
21 duckdb:vortex-compact +1.4% +8.1% -6.2% +21.4% ➖ noise
21 duckdb:vortex-file-compressed +10.0% +8.1% +1.8% +21.4% ➖ noise
22 datafusion:arrow -2.1% +2.5% -4.4% +21.4% ➖ noise
22 datafusion:vortex-compact +0.0% +2.5% -2.4% +21.4% ➖ noise
22 datafusion:vortex-file-compressed -2.9% +2.5% -5.3% +21.4% ➖ noise
22 duckdb:duckdb +0.7% +2.5% -1.7% +21.4% ➖ noise
22 duckdb:vortex-compact -0.5% +2.5% -2.9% +21.4% ➖ noise
22 duckdb:vortex-file-compressed +2.2% +2.5% -0.2% +21.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.9%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.070x ➖
Shifts: Parquet (control) +7.0% · Median polish +5.8%


datafusion / vortex-file-compressed (1.129x ❌, 2↑ 7↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6191053 4982423 1.24
fineweb_q01/datafusion:vortex-file-compressed 🚀 27259634 30354840 0.90
fineweb_q02/datafusion:vortex-file-compressed 🚨 29430155 26504345 1.11
fineweb_q03/datafusion:vortex-file-compressed 🚨 157798449 91454264 1.73
fineweb_q04/datafusion:vortex-file-compressed 🚨 305055455 255181640 1.20
fineweb_q05/datafusion:vortex-file-compressed 🚨 258826320 222500422 1.16
fineweb_q06/datafusion:vortex-file-compressed 🚨 91523109 70805072 1.29
fineweb_q07/datafusion:vortex-file-compressed 🚨 95632077 67545190 1.42
fineweb_q08/datafusion:vortex-file-compressed 🚀 11775078 21558617 0.55
datafusion / vortex-compact (0.950x ➖, 1↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5349870 4492848 1.19
fineweb_q01/datafusion:vortex-compact 166308615 163520498 1.02
fineweb_q02/datafusion:vortex-compact 166155303 166163575 1.00
fineweb_q03/datafusion:vortex-compact 1582283929 1449731751 1.09
fineweb_q04/datafusion:vortex-compact 1634441579 1582084139 1.03
fineweb_q05/datafusion:vortex-compact 1283095016 1236216808 1.04
fineweb_q06/datafusion:vortex-compact 736279075 699336629 1.05
fineweb_q07/datafusion:vortex-compact 755546370 731669035 1.03
fineweb_q08/datafusion:vortex-compact 🚀 8941528 21953336 0.41
datafusion / parquet (1.108x ❌, 0↑ 3↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7645365 6269820 1.22
fineweb_q01/datafusion:parquet 296898532 272167332 1.09
fineweb_q02/datafusion:parquet 297566504 272550123 1.09
fineweb_q03/datafusion:parquet 🚨 306253674 269259622 1.14
fineweb_q04/datafusion:parquet 🚨 311807140 280441298 1.11
fineweb_q05/datafusion:parquet 302497024 278202670 1.09
fineweb_q06/datafusion:parquet 297161058 280451874 1.06
fineweb_q07/datafusion:parquet 294894981 269801574 1.09
fineweb_q08/datafusion:parquet 290974542 268333822 1.08
duckdb / vortex-file-compressed (1.002x ➖, 2↑ 6↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3721709 3217122 1.16
fineweb_q01/duckdb:vortex-file-compressed 🚀 23549983 26738356 0.88
fineweb_q02/duckdb:vortex-file-compressed 🚨 31684904 26234389 1.21
fineweb_q03/duckdb:vortex-file-compressed 🚨 209744348 161959042 1.30
fineweb_q04/duckdb:vortex-file-compressed 🚨 273523754 225602699 1.21
fineweb_q05/duckdb:vortex-file-compressed 🚨 242268006 216724390 1.12
fineweb_q06/duckdb:vortex-file-compressed 77013806 71480332 1.08
fineweb_q07/duckdb:vortex-file-compressed 🚨 78114023 68092269 1.15
fineweb_q08/duckdb:vortex-file-compressed 🚀 9279499 24387678 0.38
duckdb / vortex-compact (0.958x ➖, 1↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4622792 3869933 1.19
fineweb_q01/duckdb:vortex-compact 111255737 103281099 1.08
fineweb_q02/duckdb:vortex-compact 115763693 122220849 0.95
fineweb_q03/duckdb:vortex-compact 943962156 862672144 1.09
fineweb_q04/duckdb:vortex-compact 962323702 912336340 1.05
fineweb_q05/duckdb:vortex-compact 851925798 811340042 1.05
fineweb_q06/duckdb:vortex-compact 475115200 470087524 1.01
fineweb_q07/duckdb:vortex-compact 488053990 482605061 1.01
fineweb_q08/duckdb:vortex-compact 🚀 9339459 20839417 0.45
duckdb / parquet (1.034x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36565934 34796666 1.05
fineweb_q01/duckdb:parquet 94999736 92174100 1.03
fineweb_q02/duckdb:parquet 101034571 95521727 1.06
fineweb_q03/duckdb:parquet 313353494 309492166 1.01
fineweb_q04/duckdb:parquet 444921431 438052600 1.02
fineweb_q05/duckdb:parquet 416619443 409076522 1.02
fineweb_q06/duckdb:parquet 206472543 198385382 1.04
fineweb_q07/duckdb:parquet 215575765 209159791 1.03
fineweb_q08/duckdb:parquet 60266556 57173346 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +19.1% +13.2% +5.2% +48.7% ➖ noise
0 datafusion:vortex-file-compressed +24.3% +13.2% +9.8% +72.7% ➖ noise
0 duckdb:vortex-compact +19.5% +13.2% +5.5% +39.7% ➖ noise
0 duckdb:vortex-file-compressed +15.7% +13.2% +2.2% +46.6% ➖ noise
1 datafusion:vortex-compact +1.7% +6.0% -4.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -10.2% +6.0% -15.3% +15.2% ✅ faster
1 duckdb:vortex-compact +7.7% +6.0% +1.6% +17.4% ➖ noise
1 duckdb:vortex-file-compressed -11.9% +6.0% -16.9% +42.1% ➖ noise
2 datafusion:vortex-compact -0.0% +7.5% -6.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +11.0% +7.5% +3.3% +24.9% ➖ noise
2 duckdb:vortex-compact -5.3% +7.5% -11.9% +10.0% ✅ faster
2 duckdb:vortex-file-compressed +20.8% +7.5% +12.4% +10.4% 🚨 regression
3 datafusion:vortex-compact +9.1% +7.3% +1.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +72.5% +7.3% +60.8% +29.5% 🚨 regression
3 duckdb:vortex-compact +9.4% +7.3% +2.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +29.5% +7.3% +20.7% +24.2% ➖ noise
4 datafusion:vortex-compact +3.3% +6.3% -2.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +19.5% +6.3% +12.5% +10.6% 🚨 regression
4 duckdb:vortex-compact +5.5% +6.3% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +21.2% +6.3% +14.1% +10.0% 🚨 regression
5 datafusion:vortex-compact +3.8% +5.2% -1.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +16.3% +5.2% +10.5% +10.0% 🚨 regression
5 duckdb:vortex-compact +5.0% +5.2% -0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +11.8% +5.2% +6.2% +10.0% ➖ noise
6 datafusion:vortex-compact +5.3% +5.0% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +29.3% +5.0% +23.1% +20.2% 🚨 regression
6 duckdb:vortex-compact +1.1% +5.0% -3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.7% +5.0% +2.6% +15.8% ➖ noise
7 datafusion:vortex-compact +3.3% +6.1% -2.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +41.6% +6.1% +33.4% +16.4% 🚨 regression
7 duckdb:vortex-compact +1.1% +6.1% -4.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +14.7% +6.1% +8.1% +11.1% ➖ noise
8 datafusion:vortex-compact -59.3% +6.9% -61.9% +22.6% ✅ faster
8 datafusion:vortex-file-compressed -45.4% +6.9% -48.9% +31.4% ✅ faster
8 duckdb:vortex-compact -55.2% +6.9% -58.1% +15.6% ✅ faster
8 duckdb:vortex-file-compressed -62.0% +6.9% -64.4% +19.9% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.9%
Vortex (geomean): 0.935x ➖
Parquet (geomean): 0.927x ➖
Shifts: Parquet (control) -7.3% · Median polish -5.5%


datafusion / vortex-file-compressed (0.952x ➖, 24↑ 9↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 30919502 35621582 0.87
tpcds_q02/datafusion:vortex-file-compressed 🚀 59490534 67324995 0.88
tpcds_q03/datafusion:vortex-file-compressed 🚀 22435221 26376490 0.85
tpcds_q04/datafusion:vortex-file-compressed 345730291 354316426 0.98
tpcds_q05/datafusion:vortex-file-compressed 62231658 67002089 0.93
tpcds_q06/datafusion:vortex-file-compressed 61950588 63015452 0.98
tpcds_q07/datafusion:vortex-file-compressed 59330810 63599226 0.93
tpcds_q08/datafusion:vortex-file-compressed 41347804 44470208 0.93
tpcds_q09/datafusion:vortex-file-compressed 64503479 65990858 0.98
tpcds_q10/datafusion:vortex-file-compressed 52885726 57679231 0.92
tpcds_q11/datafusion:vortex-file-compressed 195856826 202423677 0.97
tpcds_q12/datafusion:vortex-file-compressed 🚀 26447420 30612469 0.86
tpcds_q13/datafusion:vortex-file-compressed 70005602 71798024 0.98
tpcds_q14/datafusion:vortex-file-compressed 227450615 237583492 0.96
tpcds_q15/datafusion:vortex-file-compressed 40842240 44468851 0.92
tpcds_q16/datafusion:vortex-file-compressed 🚀 31513504 36192433 0.87
tpcds_q17/datafusion:vortex-file-compressed 79650265 82021229 0.97
tpcds_q18/datafusion:vortex-file-compressed 94817933 95383691 0.99
tpcds_q19/datafusion:vortex-file-compressed 🚨 37912386 32574608 1.16
tpcds_q20/datafusion:vortex-file-compressed 🚨 29142911 26117221 1.12
tpcds_q21/datafusion:vortex-file-compressed 156800308 163910021 0.96
tpcds_q22/datafusion:vortex-file-compressed 65294537 68854848 0.95
tpcds_q23/datafusion:vortex-file-compressed 173483177 181325762 0.96
tpcds_q24/datafusion:vortex-file-compressed 129878568 139703021 0.93
tpcds_q25/datafusion:vortex-file-compressed 76910245 84167193 0.91
tpcds_q26/datafusion:vortex-file-compressed 41353335 44025083 0.94
tpcds_q27/datafusion:vortex-file-compressed 141083710 147218437 0.96
tpcds_q28/datafusion:vortex-file-compressed 56779080 56212009 1.01
tpcds_q29/datafusion:vortex-file-compressed 77667826 83391045 0.93
tpcds_q30/datafusion:vortex-file-compressed 🚀 34438434 40224011 0.86
tpcds_q31/datafusion:vortex-file-compressed 112167174 123275098 0.91
tpcds_q32/datafusion:vortex-file-compressed 24493494 26048039 0.94
tpcds_q33/datafusion:vortex-file-compressed 🚨 44628475 40334014 1.11
tpcds_q34/datafusion:vortex-file-compressed 37581873 35043381 1.07
tpcds_q35/datafusion:vortex-file-compressed 63329426 59300856 1.07
tpcds_q36/datafusion:vortex-file-compressed 🚨 89708910 77037800 1.16
tpcds_q37/datafusion:vortex-file-compressed 🚨 41681869 33981034 1.23
tpcds_q38/datafusion:vortex-file-compressed 59760095 54848336 1.09
tpcds_q39/datafusion:vortex-file-compressed 157016100 148556991 1.06
tpcds_q40/datafusion:vortex-file-compressed 62015357 56539914 1.10
tpcds_q41/datafusion:vortex-file-compressed 🚨 21342123 18226495 1.17
tpcds_q42/datafusion:vortex-file-compressed 🚨 22094668 19006680 1.16
tpcds_q43/datafusion:vortex-file-compressed 36210556 33751085 1.07
tpcds_q44/datafusion:vortex-file-compressed 52794970 49378085 1.07
tpcds_q45/datafusion:vortex-file-compressed 🚨 39790884 34639528 1.15
tpcds_q46/datafusion:vortex-file-compressed 56310080 51370802 1.10
tpcds_q47/datafusion:vortex-file-compressed 239448665 219138665 1.09
tpcds_q48/datafusion:vortex-file-compressed 🚨 57963265 50333921 1.15
tpcds_q49/datafusion:vortex-file-compressed 81374954 77494861 1.05
tpcds_q50/datafusion:vortex-file-compressed 🚀 52020986 59702420 0.87
tpcds_q51/datafusion:vortex-file-compressed 100197880 105034392 0.95
tpcds_q52/datafusion:vortex-file-compressed 21669695 23501986 0.92
tpcds_q53/datafusion:vortex-file-compressed 29942146 31698990 0.94
tpcds_q54/datafusion:vortex-file-compressed 50187511 54528608 0.92
tpcds_q55/datafusion:vortex-file-compressed 21302890 21343449 1.00
tpcds_q56/datafusion:vortex-file-compressed 45614186 49711497 0.92
tpcds_q57/datafusion:vortex-file-compressed 143018433 157190311 0.91
tpcds_q58/datafusion:vortex-file-compressed 79953476 84135308 0.95
tpcds_q59/datafusion:vortex-file-compressed 83347334 83833199 0.99
tpcds_q60/datafusion:vortex-file-compressed 🚀 47157981 52551994 0.90
tpcds_q61/datafusion:vortex-file-compressed 58801688 62333714 0.94
tpcds_q62/datafusion:vortex-file-compressed 36495997 38626145 0.94
tpcds_q63/datafusion:vortex-file-compressed 31084688 32347807 0.96
tpcds_q64/datafusion:vortex-file-compressed 542389704 585145007 0.93
tpcds_q65/datafusion:vortex-file-compressed 56627634 61122076 0.93
tpcds_q66/datafusion:vortex-file-compressed 104461185 108749228 0.96
tpcds_q67/datafusion:vortex-file-compressed 135340756 141971423 0.95
tpcds_q68/datafusion:vortex-file-compressed 54355188 59535483 0.91
tpcds_q69/datafusion:vortex-file-compressed 51293861 54126335 0.95
tpcds_q70/datafusion:vortex-file-compressed 🚀 123440140 141898583 0.87
tpcds_q71/datafusion:vortex-file-compressed 35079785 37361026 0.94
tpcds_q72/datafusion:vortex-file-compressed 2584862141 2718612400 0.95
tpcds_q73/datafusion:vortex-file-compressed 35749413 36199315 0.99
tpcds_q74/datafusion:vortex-file-compressed 119244065 121768486 0.98
tpcds_q75/datafusion:vortex-file-compressed 120431853 121983205 0.99
tpcds_q76/datafusion:vortex-file-compressed 35989098 37039935 0.97
tpcds_q77/datafusion:vortex-file-compressed 53169139 53100411 1.00
tpcds_q78/datafusion:vortex-file-compressed 126470353 127684730 0.99
tpcds_q79/datafusion:vortex-file-compressed 40913084 42175895 0.97
tpcds_q80/datafusion:vortex-file-compressed 🚀 113187116 142014847 0.80
tpcds_q81/datafusion:vortex-file-compressed 🚀 36436952 47179059 0.77
tpcds_q82/datafusion:vortex-file-compressed 🚀 37463324 45618464 0.82
tpcds_q83/datafusion:vortex-file-compressed 50573777 53683087 0.94
tpcds_q84/datafusion:vortex-file-compressed 🚀 14995379 17161688 0.87
tpcds_q85/datafusion:vortex-file-compressed 🚀 104721825 120684295 0.87
tpcds_q86/datafusion:vortex-file-compressed 🚀 19686569 22298416 0.88
tpcds_q87/datafusion:vortex-file-compressed 🚀 56091276 65171533 0.86
tpcds_q88/datafusion:vortex-file-compressed 83789654 88995445 0.94
tpcds_q89/datafusion:vortex-file-compressed 37140207 38094458 0.97
tpcds_q90/datafusion:vortex-file-compressed 18315545 19408800 0.94
tpcds_q91/datafusion:vortex-file-compressed 🚀 26399947 32951763 0.80
tpcds_q92/datafusion:vortex-file-compressed 🚀 18889353 23576459 0.80
tpcds_q93/datafusion:vortex-file-compressed 🚀 35829171 44278061 0.81
tpcds_q94/datafusion:vortex-file-compressed 🚀 24964740 30600578 0.82
tpcds_q95/datafusion:vortex-file-compressed 🚀 62592085 71172589 0.88
tpcds_q96/datafusion:vortex-file-compressed 18579610 20643818 0.90
tpcds_q97/datafusion:vortex-file-compressed 🚀 32309731 39171285 0.82
tpcds_q98/datafusion:vortex-file-compressed 🚀 31943653 40853638 0.78
tpcds_q99/datafusion:vortex-file-compressed 🚀 48754701 58380319 0.84
datafusion / vortex-compact (0.942x ➖, 34↑ 5↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 36718991 44347577 0.83
tpcds_q02/datafusion:vortex-compact 🚀 59560861 71043115 0.84
tpcds_q03/datafusion:vortex-compact 26391110 28243446 0.93
tpcds_q04/datafusion:vortex-compact 325082116 334861111 0.97
tpcds_q05/datafusion:vortex-compact 67065621 65750435 1.02
tpcds_q06/datafusion:vortex-compact 56655925 56318464 1.01
tpcds_q07/datafusion:vortex-compact 67663113 70021489 0.97
tpcds_q08/datafusion:vortex-compact 44938778 45957504 0.98
tpcds_q09/datafusion:vortex-compact 104676840 102495144 1.02
tpcds_q10/datafusion:vortex-compact 63605009 64430280 0.99
tpcds_q11/datafusion:vortex-compact 189860033 186767233 1.02
tpcds_q12/datafusion:vortex-compact 25020436 26746639 0.94
tpcds_q13/datafusion:vortex-compact 130839973 127729666 1.02
tpcds_q14/datafusion:vortex-compact 🚀 254276141 295549840 0.86
tpcds_q15/datafusion:vortex-compact 🚀 39057770 50267131 0.78
tpcds_q16/datafusion:vortex-compact 🚀 39254270 45069340 0.87
tpcds_q17/datafusion:vortex-compact 🚀 92924627 111128313 0.84
tpcds_q18/datafusion:vortex-compact 🚀 92140546 112902927 0.82
tpcds_q19/datafusion:vortex-compact 🚀 43069318 51140555 0.84
tpcds_q20/datafusion:vortex-compact 🚀 29648895 37836651 0.78
tpcds_q21/datafusion:vortex-compact 🚀 143459582 173491104 0.83
tpcds_q22/datafusion:vortex-compact 🚀 63570357 77627728 0.82
tpcds_q23/datafusion:vortex-compact 🚀 183725793 214590883 0.86
tpcds_q24/datafusion:vortex-compact 🚀 137829420 160876211 0.86
tpcds_q25/datafusion:vortex-compact 🚀 96874966 112808434 0.86
tpcds_q26/datafusion:vortex-compact 🚀 46586139 57243758 0.81
tpcds_q27/datafusion:vortex-compact 🚀 154613650 180049583 0.86
tpcds_q28/datafusion:vortex-compact 101558364 109791240 0.93
tpcds_q29/datafusion:vortex-compact 94242622 101417499 0.93
tpcds_q30/datafusion:vortex-compact 🚀 35472487 42555549 0.83
tpcds_q31/datafusion:vortex-compact 128560967 126535480 1.02
tpcds_q32/datafusion:vortex-compact 26980267 29007195 0.93
tpcds_q33/datafusion:vortex-compact 🚀 50674203 58189603 0.87
tpcds_q34/datafusion:vortex-compact 🚀 48464251 54862123 0.88
tpcds_q35/datafusion:vortex-compact 🚀 68324187 78065662 0.88
tpcds_q36/datafusion:vortex-compact 🚀 94994487 114032519 0.83
tpcds_q37/datafusion:vortex-compact 🚀 48000775 57567169 0.83
tpcds_q38/datafusion:vortex-compact 🚀 65387469 78578622 0.83
tpcds_q39/datafusion:vortex-compact 🚀 148910624 185280765 0.80
tpcds_q40/datafusion:vortex-compact 🚀 59416615 73459916 0.81
tpcds_q41/datafusion:vortex-compact 🚀 19795581 25522049 0.78
tpcds_q42/datafusion:vortex-compact 🚀 25220092 29704586 0.85
tpcds_q43/datafusion:vortex-compact 39095492 40379745 0.97
tpcds_q44/datafusion:vortex-compact 75985091 76333974 1.00
tpcds_q45/datafusion:vortex-compact 38389556 37993619 1.01
tpcds_q46/datafusion:vortex-compact 69090931 67996258 1.02
tpcds_q47/datafusion:vortex-compact 227415180 234469993 0.97
tpcds_q48/datafusion:vortex-compact 94961219 99443108 0.95
tpcds_q49/datafusion:vortex-compact 96754062 100329530 0.96
tpcds_q50/datafusion:vortex-compact 62768051 61378911 1.02
tpcds_q51/datafusion:vortex-compact 95972022 98142434 0.98
tpcds_q52/datafusion:vortex-compact 24711225 25426499 0.97
tpcds_q53/datafusion:vortex-compact 35858408 34919268 1.03
tpcds_q54/datafusion:vortex-compact 58183839 58020174 1.00
tpcds_q55/datafusion:vortex-compact 24732065 24185114 1.02
tpcds_q56/datafusion:vortex-compact 53538671 53440200 1.00
tpcds_q57/datafusion:vortex-compact 140829271 143599568 0.98
tpcds_q58/datafusion:vortex-compact 77918826 79370215 0.98
tpcds_q59/datafusion:vortex-compact 83969493 86529907 0.97
tpcds_q60/datafusion:vortex-compact 56294051 55985682 1.01
tpcds_q61/datafusion:vortex-compact 69693630 74386621 0.94
tpcds_q62/datafusion:vortex-compact 🚀 32700451 37930291 0.86
tpcds_q63/datafusion:vortex-compact 🚀 35177653 40494311 0.87
tpcds_q64/datafusion:vortex-compact 🚀 533749289 637761618 0.84
tpcds_q65/datafusion:vortex-compact 64861595 68411696 0.95
tpcds_q66/datafusion:vortex-compact 98188326 98553672 1.00
tpcds_q67/datafusion:vortex-compact 126166493 138715264 0.91
tpcds_q68/datafusion:vortex-compact 68816811 67027701 1.03
tpcds_q69/datafusion:vortex-compact 59162307 61816185 0.96
tpcds_q70/datafusion:vortex-compact 123358970 127485931 0.97
tpcds_q71/datafusion:vortex-compact 44503554 45897368 0.97
tpcds_q72/datafusion:vortex-compact 3157355759 3152610364 1.00
tpcds_q73/datafusion:vortex-compact 51963689 49924501 1.04
tpcds_q74/datafusion:vortex-compact 148165176 136091281 1.09
tpcds_q75/datafusion:vortex-compact 183141050 184259621 0.99
tpcds_q76/datafusion:vortex-compact 56087291 60192110 0.93
tpcds_q77/datafusion:vortex-compact 71540603 77229685 0.93
tpcds_q78/datafusion:vortex-compact 170187053 179057421 0.95
tpcds_q79/datafusion:vortex-compact 63984580 67413216 0.95
tpcds_q80/datafusion:vortex-compact 151861983 156828952 0.97
tpcds_q81/datafusion:vortex-compact 🚀 46076035 52551380 0.88
tpcds_q82/datafusion:vortex-compact 55270461 59201057 0.93
tpcds_q83/datafusion:vortex-compact 🚀 65565566 73377829 0.89
tpcds_q84/datafusion:vortex-compact 🚀 21030399 24099975 0.87
tpcds_q85/datafusion:vortex-compact 138241612 151611429 0.91
tpcds_q86/datafusion:vortex-compact 🚀 22810275 25822851 0.88
tpcds_q87/datafusion:vortex-compact 73177994 79484547 0.92
tpcds_q88/datafusion:vortex-compact 141671811 136258126 1.04
tpcds_q89/datafusion:vortex-compact 49293528 45236412 1.09
tpcds_q90/datafusion:vortex-compact 26694251 24697830 1.08
tpcds_q91/datafusion:vortex-compact 42668297 39870658 1.07
tpcds_q92/datafusion:vortex-compact 23769626 21662097 1.10
tpcds_q93/datafusion:vortex-compact 🚨 54654289 48037703 1.14
tpcds_q94/datafusion:vortex-compact 🚨 36201244 31516513 1.15
tpcds_q95/datafusion:vortex-compact 78556668 73433249 1.07
tpcds_q96/datafusion:vortex-compact 28283412 26582128 1.06
tpcds_q97/datafusion:vortex-compact 🚨 45007817 40772130 1.10
tpcds_q98/datafusion:vortex-compact 🚨 44576526 37989080 1.17
tpcds_q99/datafusion:vortex-compact 🚨 57515155 52003537 1.11
datafusion / parquet (0.902x ➖, 49↑ 2↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 35922495 36922996 0.97
tpcds_q02/datafusion:parquet 46024148 46752080 0.98
tpcds_q03/datafusion:parquet 15139586 16192292 0.93
tpcds_q04/datafusion:parquet 306255625 332175810 0.92
tpcds_q05/datafusion:parquet 52324349 57703675 0.91
tpcds_q06/datafusion:parquet 66016741 64104493 1.03
tpcds_q07/datafusion:parquet 88105584 90877415 0.97
tpcds_q08/datafusion:parquet 32134245 33473692 0.96
tpcds_q09/datafusion:parquet 57099544 59019174 0.97
tpcds_q10/datafusion:parquet 84366971 85104807 0.99
tpcds_q11/datafusion:parquet 185025905 197330371 0.94
tpcds_q12/datafusion:parquet 🚀 22762854 28039465 0.81
tpcds_q13/datafusion:parquet 🚀 86236117 105176910 0.82
tpcds_q14/datafusion:parquet 🚀 194262807 235506776 0.82
tpcds_q15/datafusion:parquet 🚀 26997164 30404888 0.89
tpcds_q16/datafusion:parquet 🚀 29132413 35686335 0.82
tpcds_q17/datafusion:parquet 71372176 78122177 0.91
tpcds_q18/datafusion:parquet 131429649 138246210 0.95
tpcds_q19/datafusion:parquet 🚀 27656726 32457044 0.85
tpcds_q20/datafusion:parquet 🚀 21755871 26398239 0.82
tpcds_q21/datafusion:parquet 🚀 22711265 28229800 0.80
tpcds_q22/datafusion:parquet 🚀 131032035 157348034 0.83
tpcds_q23/datafusion:parquet 🚀 165686005 189898749 0.87
tpcds_q24/datafusion:parquet 🚀 105721629 126329240 0.84
tpcds_q25/datafusion:parquet 72062912 73152740 0.99
tpcds_q26/datafusion:parquet 78353327 77753573 1.01
tpcds_q27/datafusion:parquet 162815723 165343320 0.98
tpcds_q28/datafusion:parquet 48125615 51046472 0.94
tpcds_q29/datafusion:parquet 72931810 73754932 0.99
tpcds_q30/datafusion:parquet 45853090 44928294 1.02
tpcds_q31/datafusion:parquet 75299857 78458048 0.96
tpcds_q32/datafusion:parquet 🚀 21967633 26574919 0.83
tpcds_q33/datafusion:parquet 🚀 34367082 41973597 0.82
tpcds_q34/datafusion:parquet 🚀 26210291 32831738 0.80
tpcds_q35/datafusion:parquet 🚀 87091023 111631117 0.78
tpcds_q36/datafusion:parquet 🚀 62953817 79097285 0.80
tpcds_q37/datafusion:parquet 🚀 23586266 29186337 0.81
tpcds_q38/datafusion:parquet 🚀 51440707 58872242 0.87
tpcds_q39/datafusion:parquet 🚀 83770548 116242675 0.72
tpcds_q40/datafusion:parquet 🚀 26970401 35925953 0.75
tpcds_q41/datafusion:parquet 🚀 16062422 19993358 0.80
tpcds_q42/datafusion:parquet 🚀 13765865 17399122 0.79
tpcds_q43/datafusion:parquet 🚀 19484346 23885114 0.82
tpcds_q44/datafusion:parquet 🚀 44138030 51009621 0.87
tpcds_q45/datafusion:parquet 🚀 32646900 36864434 0.89
tpcds_q46/datafusion:parquet 🚀 38716607 47152067 0.82
tpcds_q47/datafusion:parquet 🚀 136418565 164349059 0.83
tpcds_q48/datafusion:parquet 🚀 78093554 93960884 0.83
tpcds_q49/datafusion:parquet 🚀 65366740 80207909 0.81
tpcds_q50/datafusion:parquet 🚀 49604105 58737253 0.84
tpcds_q51/datafusion:parquet 🚀 92831377 105307003 0.88
tpcds_q52/datafusion:parquet 🚀 14904977 17537999 0.85
tpcds_q53/datafusion:parquet 22566680 25061136 0.90
tpcds_q54/datafusion:parquet 🚀 43951680 49233142 0.89
tpcds_q55/datafusion:parquet 🚀 13875810 17183472 0.81
tpcds_q56/datafusion:parquet 🚀 36010952 42500026 0.85
tpcds_q57/datafusion:parquet 125233635 128574688 0.97
tpcds_q58/datafusion:parquet 🚀 59002336 68588942 0.86
tpcds_q59/datafusion:parquet 🚀 57891273 70695891 0.82
tpcds_q60/datafusion:parquet 🚀 35029899 41842169 0.84
tpcds_q61/datafusion:parquet 🚀 51195811 59346661 0.86
tpcds_q62/datafusion:parquet 29586089 27184830 1.09
tpcds_q63/datafusion:parquet 🚀 23167524 25918920 0.89
tpcds_q64/datafusion:parquet 🚀 547793150 655465841 0.84
tpcds_q65/datafusion:parquet 🚀 47711609 54771121 0.87
tpcds_q66/datafusion:parquet 🚀 79355097 91546119 0.87
tpcds_q67/datafusion:parquet 174429778 191657174 0.91
tpcds_q68/datafusion:parquet 🚀 42703283 48668164 0.88
tpcds_q69/datafusion:parquet 🚀 86894571 99519896 0.87
tpcds_q70/datafusion:parquet 106189146 112623921 0.94
tpcds_q71/datafusion:parquet 28867750 30756915 0.94
tpcds_q72/datafusion:parquet 747364002 713193665 1.05
tpcds_q73/datafusion:parquet 30020348 31501330 0.95
tpcds_q74/datafusion:parquet 🚨 116066737 104698416 1.11
tpcds_q75/datafusion:parquet 126890762 128995433 0.98
tpcds_q76/datafusion:parquet 38307969 36415065 1.05
tpcds_q77/datafusion:parquet 55098892 50169026 1.10
tpcds_q78/datafusion:parquet 🚨 140114985 124879494 1.12
tpcds_q79/datafusion:parquet 33648906 34147176 0.99
tpcds_q80/datafusion:parquet 104469522 99445376 1.05
tpcds_q81/datafusion:parquet 45472803 41662492 1.09
tpcds_q82/datafusion:parquet 25445050 25877242 0.98
tpcds_q83/datafusion:parquet 52215607 51435721 1.02
tpcds_q84/datafusion:parquet 51594361 54784959 0.94
tpcds_q85/datafusion:parquet 186521729 202857291 0.92
tpcds_q86/datafusion:parquet 20129455 21668692 0.93
tpcds_q87/datafusion:parquet 55899554 61553733 0.91
tpcds_q88/datafusion:parquet 75656089 79609292 0.95
tpcds_q89/datafusion:parquet 🚀 26369559 31036839 0.85
tpcds_q90/datafusion:parquet 21569565 22609207 0.95
tpcds_q91/datafusion:parquet 🚀 75506631 87066297 0.87
tpcds_q92/datafusion:parquet 24343329 25115417 0.97
tpcds_q93/datafusion:parquet 40816590 44176742 0.92
tpcds_q94/datafusion:parquet 🚀 26935769 30215677 0.89
tpcds_q95/datafusion:parquet 74261888 76974746 0.96
tpcds_q96/datafusion:parquet 15610359 17214107 0.91
tpcds_q97/datafusion:parquet 36846225 40531402 0.91
tpcds_q98/datafusion:parquet 28393241 31463209 0.90
tpcds_q99/datafusion:parquet 🚀 31095006 39166803 0.79
duckdb / vortex-file-compressed (0.900x ✅, 47↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 26199825 31433634 0.83
tpcds_q02/duckdb:vortex-file-compressed 85190800 90677585 0.94
tpcds_q03/duckdb:vortex-file-compressed 25474967 23579679 1.08
tpcds_q04/duckdb:vortex-file-compressed 105846886 106821627 0.99
tpcds_q05/duckdb:vortex-file-compressed 🚀 93268452 114788150 0.81
tpcds_q06/duckdb:vortex-file-compressed 35590316 37798482 0.94
tpcds_q07/duckdb:vortex-file-compressed 24506450 25402763 0.96
tpcds_q08/duckdb:vortex-file-compressed 22475146 24873843 0.90
tpcds_q09/duckdb:vortex-file-compressed 🚨 45931123 40617163 1.13
tpcds_q10/duckdb:vortex-file-compressed 38146050 39261895 0.97
tpcds_q11/duckdb:vortex-file-compressed 63007847 62841398 1.00
tpcds_q12/duckdb:vortex-file-compressed 14392770 15140024 0.95
tpcds_q13/duckdb:vortex-file-compressed 35106850 33481792 1.05
tpcds_q14/duckdb:vortex-file-compressed 198199335 182516698 1.09
tpcds_q15/duckdb:vortex-file-compressed 🚀 40467728 50686518 0.80
tpcds_q16/duckdb:vortex-file-compressed 🚀 30138595 36215891 0.83
tpcds_q17/duckdb:vortex-file-compressed 🚀 37706986 48840586 0.77
tpcds_q18/duckdb:vortex-file-compressed 🚀 46458653 57150047 0.81
tpcds_q19/duckdb:vortex-file-compressed 🚀 33161913 42932399 0.77
tpcds_q20/duckdb:vortex-file-compressed 🚀 15523730 22717323 0.68
tpcds_q21/duckdb:vortex-file-compressed 🚀 20202339 26625322 0.76
tpcds_q22/duckdb:vortex-file-compressed 111339996 111002360 1.00
tpcds_q23/duckdb:vortex-file-compressed 125037839 138465807 0.90
tpcds_q24/duckdb:vortex-file-compressed 🚀 58637759 73188883 0.80
tpcds_q25/duckdb:vortex-file-compressed 🚀 37374881 47249918 0.79
tpcds_q26/duckdb:vortex-file-compressed 🚀 40792374 49007305 0.83
tpcds_q27/duckdb:vortex-file-compressed 88687399 90198177 0.98
tpcds_q28/duckdb:vortex-file-compressed 40355475 36935296 1.09
tpcds_q29/duckdb:vortex-file-compressed 38429925 38939017 0.99
tpcds_q30/duckdb:vortex-file-compressed 🚀 29856533 33256689 0.90
tpcds_q31/duckdb:vortex-file-compressed 26611355 26631261 1.00
tpcds_q32/duckdb:vortex-file-compressed 🚀 15903407 18403572 0.86
tpcds_q33/duckdb:vortex-file-compressed 67986851 74038767 0.92
tpcds_q34/duckdb:vortex-file-compressed 19181783 19909872 0.96
tpcds_q35/duckdb:vortex-file-compressed 64117435 62521207 1.03
tpcds_q36/duckdb:vortex-file-compressed 27173421 30179673 0.90
tpcds_q37/duckdb:vortex-file-compressed 22443370 22448620 1.00
tpcds_q38/duckdb:vortex-file-compressed 37966265 36422267 1.04
tpcds_q39/duckdb:vortex-file-compressed 🚀 45032775 50770543 0.89
tpcds_q40/duckdb:vortex-file-compressed 24599773 24898436 0.99
tpcds_q41/duckdb:vortex-file-compressed 13444679 13633775 0.99
tpcds_q42/duckdb:vortex-file-compressed 12091293 11852714 1.02
tpcds_q43/duckdb:vortex-file-compressed 19973865 20240977 0.99
tpcds_q44/duckdb:vortex-file-compressed 24976458 22931475 1.09
tpcds_q45/duckdb:vortex-file-compressed 26844510 28663409 0.94
tpcds_q46/duckdb:vortex-file-compressed 49483083 49945743 0.99
tpcds_q47/duckdb:vortex-file-compressed 🚀 50091456 60846426 0.82
tpcds_q48/duckdb:vortex-file-compressed 🚀 30716261 39437679 0.78
tpcds_q49/duckdb:vortex-file-compressed 🚀 29676395 38530012 0.77
tpcds_q50/duckdb:vortex-file-compressed 🚀 39302413 45153465 0.87
tpcds_q51/duckdb:vortex-file-compressed 🚀 99008830 111034264 0.89
tpcds_q52/duckdb:vortex-file-compressed 🚀 11726623 16442055 0.71
tpcds_q53/duckdb:vortex-file-compressed 🚀 17328364 21605224 0.80
tpcds_q54/duckdb:vortex-file-compressed 🚀 48770727 58298376 0.84
tpcds_q55/duckdb:vortex-file-compressed 🚀 11581876 14270759 0.81
tpcds_q56/duckdb:vortex-file-compressed 🚀 68257537 81155364 0.84
tpcds_q57/duckdb:vortex-file-compressed 🚀 49340996 54924380 0.90
tpcds_q58/duckdb:vortex-file-compressed 35856596 33435730 1.07
tpcds_q59/duckdb:vortex-file-compressed 🚀 55898954 68042876 0.82
tpcds_q60/duckdb:vortex-file-compressed 🚀 68120947 86212768 0.79
tpcds_q61/duckdb:vortex-file-compressed 🚀 38751404 49796774 0.78
tpcds_q62/duckdb:vortex-file-compressed 🚀 18712197 21971002 0.85
tpcds_q63/duckdb:vortex-file-compressed 🚀 17693273 21050743 0.84
tpcds_q64/duckdb:vortex-file-compressed 86885478 82477932 1.05
tpcds_q65/duckdb:vortex-file-compressed 23355348 24097376 0.97
tpcds_q66/duckdb:vortex-file-compressed 56403872 60892886 0.93
tpcds_q67/duckdb:vortex-file-compressed 144764473 147985962 0.98
tpcds_q68/duckdb:vortex-file-compressed 41497502 41046830 1.01
tpcds_q69/duckdb:vortex-file-compressed 37868219 41211637 0.92
tpcds_q70/duckdb:vortex-file-compressed 25534092 26177943 0.98
tpcds_q71/duckdb:vortex-file-compressed 20838528 21490298 0.97
tpcds_q72/duckdb:vortex-file-compressed 177149396 179953271 0.98
tpcds_q73/duckdb:vortex-file-compressed 19826723 19642231 1.01
tpcds_q74/duckdb:vortex-file-compressed 50946542 56393055 0.90
tpcds_q75/duckdb:vortex-file-compressed 🚀 60511829 74866876 0.81
tpcds_q76/duckdb:vortex-file-compressed 🚀 60910667 98142643 0.62
tpcds_q77/duckdb:vortex-file-compressed 🚀 63401274 82443522 0.77
tpcds_q78/duckdb:vortex-file-compressed 🚀 81136754 97621794 0.83
tpcds_q79/duckdb:vortex-file-compressed 🚀 44436205 52269084 0.85
tpcds_q80/duckdb:vortex-file-compressed 🚀 89890710 121596068 0.74
tpcds_q81/duckdb:vortex-file-compressed 🚀 33927403 43435362 0.78
tpcds_q82/duckdb:vortex-file-compressed 🚀 24675503 32175646 0.77
tpcds_q83/duckdb:vortex-file-compressed 🚀 29646190 35749764 0.83
tpcds_q84/duckdb:vortex-file-compressed 🚀 17570616 21047180 0.83
tpcds_q85/duckdb:vortex-file-compressed 🚀 46186615 58218517 0.79
tpcds_q86/duckdb:vortex-file-compressed 🚀 17410542 21428805 0.81
tpcds_q87/duckdb:vortex-file-compressed 🚀 41679574 48401521 0.86
tpcds_q88/duckdb:vortex-file-compressed 🚀 36052838 41744422 0.86
tpcds_q89/duckdb:vortex-file-compressed 17980534 19033783 0.94
tpcds_q90/duckdb:vortex-file-compressed 🚀 14148794 15819576 0.89
tpcds_q91/duckdb:vortex-file-compressed 29422205 28392314 1.04
tpcds_q92/duckdb:vortex-file-compressed 14616553 14693478 0.99
tpcds_q93/duckdb:vortex-file-compressed 29232809 30372330 0.96
tpcds_q94/duckdb:vortex-file-compressed 23052509 22021720 1.05
tpcds_q95/duckdb:vortex-file-compressed 161782610 158620618 1.02
tpcds_q96/duckdb:vortex-file-compressed 11863260 12018329 0.99
tpcds_q97/duckdb:vortex-file-compressed 🚀 39028938 43481044 0.90
tpcds_q98/duckdb:vortex-file-compressed 17843628 19535364 0.91
tpcds_q99/duckdb:vortex-file-compressed 32021336 33357626 0.96
duckdb / vortex-compact (0.948x ➖, 40↑ 7↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 36692191 41229405 0.89
tpcds_q02/duckdb:vortex-compact 🚀 120747948 138211716 0.87
tpcds_q03/duckdb:vortex-compact 52404455 55729971 0.94
tpcds_q04/duckdb:vortex-compact 🚀 121272100 140821773 0.86
tpcds_q05/duckdb:vortex-compact 🚀 160924147 183123279 0.88
tpcds_q06/duckdb:vortex-compact 37693022 39711456 0.95
tpcds_q07/duckdb:vortex-compact 36468635 38128359 0.96
tpcds_q08/duckdb:vortex-compact 28502853 29169752 0.98
tpcds_q09/duckdb:vortex-compact 113727917 122997419 0.92
tpcds_q10/duckdb:vortex-compact 🚀 46420643 55286994 0.84
tpcds_q11/duckdb:vortex-compact 🚀 70699496 83840075 0.84
tpcds_q12/duckdb:vortex-compact 🚀 19001644 24265988 0.78
tpcds_q13/duckdb:vortex-compact 46883252 49850731 0.94
tpcds_q14/duckdb:vortex-compact 🚀 268646123 299229643 0.90
tpcds_q15/duckdb:vortex-compact 🚀 44564521 55614151 0.80
tpcds_q16/duckdb:vortex-compact 🚀 37831163 44233442 0.86
tpcds_q17/duckdb:vortex-compact 🚀 47104564 58288327 0.81
tpcds_q18/duckdb:vortex-compact 🚀 68873806 82420490 0.84
tpcds_q19/duckdb:vortex-compact 37507152 36612872 1.02
tpcds_q20/duckdb:vortex-compact 20069168 20565320 0.98
tpcds_q21/duckdb:vortex-compact 27866572 28130374 0.99
tpcds_q22/duckdb:vortex-compact 118811407 123006290 0.97
tpcds_q23/duckdb:vortex-compact 🚀 169811507 195671115 0.87
tpcds_q24/duckdb:vortex-compact 🚀 75592984 84111201 0.90
tpcds_q25/duckdb:vortex-compact 🚀 50612376 57505414 0.88
tpcds_q26/duckdb:vortex-compact 54328965 60083742 0.90
tpcds_q27/duckdb:vortex-compact 🚀 128612831 149985845 0.86
tpcds_q28/duckdb:vortex-compact 110067961 114180148 0.96
tpcds_q29/duckdb:vortex-compact 🚀 47470951 56256382 0.84
tpcds_q30/duckdb:vortex-compact 🚀 34272943 42460755 0.81
tpcds_q31/duckdb:vortex-compact 🚀 29936417 36023538 0.83
tpcds_q32/duckdb:vortex-compact 23882885 25952777 0.92
tpcds_q33/duckdb:vortex-compact 🚀 132305858 153008299 0.86
tpcds_q34/duckdb:vortex-compact 🚀 22600255 25472890 0.89
tpcds_q35/duckdb:vortex-compact 🚀 68090334 84949897 0.80
tpcds_q36/duckdb:vortex-compact 🚀 32760421 39706214 0.83
tpcds_q37/duckdb:vortex-compact 🚀 30961469 37041409 0.84
tpcds_q38/duckdb:vortex-compact 🚀 37981809 43536206 0.87
tpcds_q39/duckdb:vortex-compact 🚀 53802560 63856759 0.84
tpcds_q40/duckdb:vortex-compact 🚀 31341940 38520542 0.81
tpcds_q41/duckdb:vortex-compact 🚀 17179994 20404980 0.84
tpcds_q42/duckdb:vortex-compact 🚀 14952661 18446293 0.81
tpcds_q43/duckdb:vortex-compact 24582204 26595752 0.92
tpcds_q44/duckdb:vortex-compact 🚀 29515679 34852424 0.85
tpcds_q45/duckdb:vortex-compact 🚀 32361799 42851687 0.76
tpcds_q46/duckdb:vortex-compact 🚀 57090013 67945653 0.84
tpcds_q47/duckdb:vortex-compact 🚀 54137975 63555592 0.85
tpcds_q48/duckdb:vortex-compact 🚀 40953337 46881355 0.87
tpcds_q49/duckdb:vortex-compact 50022494 47643534 1.05
tpcds_q50/duckdb:vortex-compact 37297346 36219023 1.03
tpcds_q51/duckdb:vortex-compact 107122369 110580656 0.97
tpcds_q52/duckdb:vortex-compact 16013273 15737162 1.02
tpcds_q53/duckdb:vortex-compact 21335303 22306148 0.96
tpcds_q54/duckdb:vortex-compact 88290977 87578562 1.01
tpcds_q55/duckdb:vortex-compact 15401303 14725713 1.05
tpcds_q56/duckdb:vortex-compact 133097898 141535904 0.94
tpcds_q57/duckdb:vortex-compact 50170454 55707061 0.90
tpcds_q58/duckdb:vortex-compact 43664847 48449365 0.90
tpcds_q59/duckdb:vortex-compact 🚀 58154118 82087887 0.71
tpcds_q60/duckdb:vortex-compact 🚀 128529395 149123973 0.86
tpcds_q61/duckdb:vortex-compact 🚀 45672182 55217441 0.83
tpcds_q62/duckdb:vortex-compact 🚀 22594197 26853373 0.84
tpcds_q63/duckdb:vortex-compact 🚀 22060223 26383650 0.84
tpcds_q64/duckdb:vortex-compact 104142420 102437801 1.02
tpcds_q65/duckdb:vortex-compact 26539098 27678334 0.96
tpcds_q66/duckdb:vortex-compact 108658187 99944341 1.09
tpcds_q67/duckdb:vortex-compact 🚀 156259395 173814365 0.90
tpcds_q68/duckdb:vortex-compact 56928178 51914667 1.10
tpcds_q69/duckdb:vortex-compact 51077356 46516391 1.10
tpcds_q70/duckdb:vortex-compact 🚨 31201472 28038820 1.11
tpcds_q71/duckdb:vortex-compact 🚨 28830959 25023836 1.15
tpcds_q72/duckdb:vortex-compact 209435439 199809292 1.05
tpcds_q73/duckdb:vortex-compact 23554322 21730621 1.08
tpcds_q74/duckdb:vortex-compact 63524573 60414122 1.05
tpcds_q75/duckdb:vortex-compact 79639751 75207306 1.06
tpcds_q76/duckdb:vortex-compact 129438427 134332569 0.96
tpcds_q77/duckdb:vortex-compact 130842881 133131102 0.98
tpcds_q78/duckdb:vortex-compact 96299555 88962869 1.08
tpcds_q79/duckdb:vortex-compact 73052357 69175878 1.06
tpcds_q80/duckdb:vortex-compact 174553123 160510299 1.09
tpcds_q81/duckdb:vortex-compact 45254851 42224019 1.07
tpcds_q82/duckdb:vortex-compact 🚨 35679701 30729946 1.16
tpcds_q83/duckdb:vortex-compact 🚨 51873165 46946211 1.10
tpcds_q84/duckdb:vortex-compact 🚨 25332145 21112431 1.20
tpcds_q85/duckdb:vortex-compact 69963806 65375068 1.07
tpcds_q86/duckdb:vortex-compact 21582624 19797518 1.09
tpcds_q87/duckdb:vortex-compact 46287328 42722524 1.08
tpcds_q88/duckdb:vortex-compact 37495607 34846540 1.08
tpcds_q89/duckdb:vortex-compact 25141997 22857924 1.10
tpcds_q90/duckdb:vortex-compact 16750780 16530577 1.01
tpcds_q91/duckdb:vortex-compact 50324521 47078218 1.07
tpcds_q92/duckdb:vortex-compact 22592733 20619622 1.10
tpcds_q93/duckdb:vortex-compact 🚨 39309449 34624835 1.14
tpcds_q94/duckdb:vortex-compact 🚨 32843699 27965576 1.17
tpcds_q95/duckdb:vortex-compact 180675408 166783022 1.08
tpcds_q96/duckdb:vortex-compact 12308331 11597485 1.06
tpcds_q97/duckdb:vortex-compact 45272159 42924046 1.05
tpcds_q98/duckdb:vortex-compact 25282228 24535847 1.03
tpcds_q99/duckdb:vortex-compact 39825555 40716438 0.98
duckdb / parquet (0.953x ➖, 22↑ 3↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 46977787 48566330 0.97
tpcds_q02/duckdb:parquet 60454418 61895766 0.98
tpcds_q03/duckdb:parquet 12876746 12615275 1.02
tpcds_q04/duckdb:parquet 132640567 127218674 1.04
tpcds_q05/duckdb:parquet 🚨 79833959 69891365 1.14
tpcds_q06/duckdb:parquet 🚨 32163869 28644918 1.12
tpcds_q07/duckdb:parquet 23825920 23730941 1.00
tpcds_q08/duckdb:parquet 28030532 29047953 0.96
tpcds_q09/duckdb:parquet 40645537 39840283 1.02
tpcds_q10/duckdb:parquet 36935520 36902016 1.00
tpcds_q11/duckdb:parquet 88248544 93399293 0.94
tpcds_q12/duckdb:parquet 14678568 15640359 0.94
tpcds_q13/duckdb:parquet 33684265 35283104 0.95
tpcds_q14/duckdb:parquet 167564229 164424702 1.02
tpcds_q15/duckdb:parquet 🚀 30479943 37668715 0.81
tpcds_q16/duckdb:parquet 🚀 22184622 25441149 0.87
tpcds_q17/duckdb:parquet 🚀 38645459 44813914 0.86
tpcds_q18/duckdb:parquet 🚀 46438025 53320289 0.87
tpcds_q19/duckdb:parquet 🚀 29122400 33200495 0.88
tpcds_q20/duckdb:parquet 16086919 17160214 0.94
tpcds_q21/duckdb:parquet 12150771 11585106 1.05
tpcds_q22/duckdb:parquet 72648227 70483069 1.03
tpcds_q23/duckdb:parquet 116737180 116058569 1.01
tpcds_q24/duckdb:parquet 46683671 46901210 1.00
tpcds_q25/duckdb:parquet 32850177 33750627 0.97
tpcds_q26/duckdb:parquet 37057657 36105200 1.03
tpcds_q27/duckdb:parquet 89892098 91214800 0.99
tpcds_q28/duckdb:parquet 37724356 37573584 1.00
tpcds_q29/duckdb:parquet 34705658 36157862 0.96
tpcds_q30/duckdb:parquet 42638567 42128858 1.01
tpcds_q31/duckdb:parquet 22710495 23342886 0.97
tpcds_q32/duckdb:parquet 10878535 11077673 0.98
tpcds_q33/duckdb:parquet 73150787 76273296 0.96
tpcds_q34/duckdb:parquet 🚀 20781988 24636156 0.84
tpcds_q35/duckdb:parquet 🚀 61629042 70589420 0.87
tpcds_q36/duckdb:parquet 🚀 20718655 23170403 0.89
tpcds_q37/duckdb:parquet 🚀 13842051 15660475 0.88
tpcds_q38/duckdb:parquet 35533577 38987770 0.91
tpcds_q39/duckdb:parquet 🚀 32744823 37905565 0.86
tpcds_q40/duckdb:parquet 🚀 18809064 22251869 0.85
tpcds_q41/duckdb:parquet 🚀 7645508 8625393 0.89
tpcds_q42/duckdb:parquet 🚀 10484723 12546566 0.84
tpcds_q43/duckdb:parquet 15882303 17541404 0.91
tpcds_q44/duckdb:parquet 🚀 21372396 25501888 0.84
tpcds_q45/duckdb:parquet 🚀 26680195 33901242 0.79
tpcds_q46/duckdb:parquet 🚀 45011606 54612960 0.82
tpcds_q47/duckdb:parquet 🚀 46962105 54023514 0.87
tpcds_q48/duckdb:parquet 🚀 31035387 35279264 0.88
tpcds_q49/duckdb:parquet 25936944 26204065 0.99
tpcds_q50/duckdb:parquet 25812235 27361228 0.94
tpcds_q51/duckdb:parquet 96770249 93638503 1.03
tpcds_q52/duckdb:parquet 11347091 10866014 1.04
tpcds_q53/duckdb:parquet 16581742 16566715 1.00
tpcds_q54/duckdb:parquet 40481965 40302361 1.00
tpcds_q55/duckdb:parquet 10666217 11131018 0.96
tpcds_q56/duckdb:parquet 69085673 67737818 1.02
tpcds_q57/duckdb:parquet 34986817 35455516 0.99
tpcds_q58/duckdb:parquet 21452598 22452588 0.96
tpcds_q59/duckdb:parquet 36709373 36547561 1.00
tpcds_q60/duckdb:parquet 71798070 77938096 0.92
tpcds_q61/duckdb:parquet 30749738 31922850 0.96
tpcds_q62/duckdb:parquet 11359124 11625583 0.98
tpcds_q63/duckdb:parquet 15117550 16710953 0.90
tpcds_q64/duckdb:parquet 🚀 73341310 82839224 0.89
tpcds_q65/duckdb:parquet 21602736 20795499 1.04
tpcds_q66/duckdb:parquet 59866468 54863120 1.09
tpcds_q67/duckdb:parquet 136689569 136237525 1.00
tpcds_q68/duckdb:parquet 37677024 38210670 0.99
tpcds_q69/duckdb:parquet 37748195 37099033 1.02
tpcds_q70/duckdb:parquet 19312180 19831099 0.97
tpcds_q71/duckdb:parquet 18389314 20025344 0.92
tpcds_q72/duckdb:parquet 161465460 169022552 0.96
tpcds_q73/duckdb:parquet 18009264 18738818 0.96
tpcds_q74/duckdb:parquet 51479454 50615934 1.02
tpcds_q75/duckdb:parquet 52423638 55470982 0.95
tpcds_q76/duckdb:parquet 68821750 72236914 0.95
tpcds_q77/duckdb:parquet 57705760 63020112 0.92
tpcds_q78/duckdb:parquet 74833680 73840611 1.01
tpcds_q79/duckdb:parquet 27423998 29431201 0.93
tpcds_q80/duckdb:parquet 🚀 82743959 93803888 0.88
tpcds_q81/duckdb:parquet 45599398 47069122 0.97
tpcds_q82/duckdb:parquet 15332909 16203971 0.95
tpcds_q83/duckdb:parquet 16415479 16275948 1.01
tpcds_q84/duckdb:parquet 🚨 20339794 18320575 1.11
tpcds_q85/duckdb:parquet 38825006 40109921 0.97
tpcds_q86/duckdb:parquet 12190869 12741281 0.96
tpcds_q87/duckdb:parquet 36973006 37649491 0.98
tpcds_q88/duckdb:parquet 28601304 30467991 0.94
tpcds_q89/duckdb:parquet 🚀 17236708 20054465 0.86
tpcds_q90/duckdb:parquet 🚀 7180416 8983886 0.80
tpcds_q91/duckdb:parquet 22838266 23830380 0.96
tpcds_q92/duckdb:parquet 11433392 11539713 0.99
tpcds_q93/duckdb:parquet 29055924 29987725 0.97
tpcds_q94/duckdb:parquet 15951488 17678901 0.90
tpcds_q95/duckdb:parquet 144135033 155628714 0.93
tpcds_q96/duckdb:parquet 8988617 9651646 0.93
tpcds_q97/duckdb:parquet 34087356 36168720 0.94
tpcds_q98/duckdb:parquet 18507337 18744148 0.99
tpcds_q99/duckdb:parquet 19595774 20165459 0.97
duckdb / duckdb (0.983x ➖, 14↑ 9↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21800045 20315601 1.07
tpcds_q02/duckdb:duckdb 18856395 18713970 1.01
tpcds_q03/duckdb:duckdb 🚨 9353677 8331534 1.12
tpcds_q04/duckdb:duckdb 167928874 162277147 1.03
tpcds_q05/duckdb:duckdb 19657071 19049434 1.03
tpcds_q06/duckdb:duckdb 23826292 21689737 1.10
tpcds_q07/duckdb:duckdb 41031837 38395845 1.07
tpcds_q08/duckdb:duckdb 121212142 123300697 0.98
tpcds_q09/duckdb:duckdb 20093376 19940346 1.01
tpcds_q10/duckdb:duckdb 24737508 23963879 1.03
tpcds_q11/duckdb:duckdb 144932424 146982933 0.99
tpcds_q12/duckdb:duckdb 11774081 11065142 1.06
tpcds_q13/duckdb:duckdb 25465715 23633014 1.08
tpcds_q14/duckdb:duckdb 97188670 92134737 1.05
tpcds_q15/duckdb:duckdb 27424469 27408805 1.00
tpcds_q16/duckdb:duckdb 🚨 20435694 18187804 1.12
tpcds_q17/duckdb:duckdb 24153011 23264209 1.04
tpcds_q18/duckdb:duckdb 🚨 48757383 43992323 1.11
tpcds_q19/duckdb:duckdb 17393906 16101188 1.08
tpcds_q20/duckdb:duckdb 🚨 13368424 12148262 1.10
tpcds_q21/duckdb:duckdb 6878386 6365236 1.08
tpcds_q22/duckdb:duckdb 73225247 72147236 1.01
tpcds_q23/duckdb:duckdb 80012895 80520444 0.99
tpcds_q24/duckdb:duckdb 24823874 27169063 0.91
tpcds_q25/duckdb:duckdb 17584129 18928207 0.93
tpcds_q26/duckdb:duckdb 27238139 28781032 0.95
tpcds_q27/duckdb:duckdb 43477449 47051258 0.92
tpcds_q28/duckdb:duckdb 22347723 22944111 0.97
tpcds_q29/duckdb:duckdb 🚀 21060101 24027210 0.88
tpcds_q30/duckdb:duckdb 🚀 28230733 33630664 0.84
tpcds_q31/duckdb:duckdb 🚀 20900772 23353509 0.89
tpcds_q32/duckdb:duckdb 🚀 7576456 8634443 0.88
tpcds_q33/duckdb:duckdb 13210121 14409494 0.92
tpcds_q34/duckdb:duckdb 16616095 16635020 1.00
tpcds_q35/duckdb:duckdb 34469348 36025245 0.96
tpcds_q36/duckdb:duckdb 77432603 83252596 0.93
tpcds_q37/duckdb:duckdb 8536508 9453924 0.90
tpcds_q38/duckdb:duckdb 🚀 31963819 36024582 0.89
tpcds_q39/duckdb:duckdb 29498088 28910480 1.02
tpcds_q40/duckdb:duckdb 14608562 16170527 0.90
tpcds_q41/duckdb:duckdb 🚀 9099075 10346886 0.88
tpcds_q42/duckdb:duckdb 6848592 7506662 0.91
tpcds_q43/duckdb:duckdb 11466725 12396494 0.92
tpcds_q44/duckdb:duckdb 🚀 14194471 16172076 0.88
tpcds_q45/duckdb:duckdb 18976773 20193485 0.94
tpcds_q46/duckdb:duckdb 🚀 39480290 44627377 0.88
tpcds_q47/duckdb:duckdb 44385042 47158723 0.94
tpcds_q48/duckdb:duckdb 22755275 23599966 0.96
tpcds_q49/duckdb:duckdb 17216530 16484693 1.04
tpcds_q50/duckdb:duckdb 14944194 15540995 0.96
tpcds_q51/duckdb:duckdb 95221208 104350785 0.91
tpcds_q52/duckdb:duckdb 7716891 8272262 0.93
tpcds_q53/duckdb:duckdb 12584590 13192697 0.95
tpcds_q54/duckdb:duckdb 17403279 18329343 0.95
tpcds_q55/duckdb:duckdb 7788013 7891340 0.99
tpcds_q56/duckdb:duckdb 🚀 14222635 16026639 0.89
tpcds_q57/duckdb:duckdb 34583604 36394504 0.95
tpcds_q58/duckdb:duckdb 13709559 13436618 1.02
tpcds_q59/duckdb:duckdb 35827875 35657358 1.00
tpcds_q60/duckdb:duckdb 15131259 15470832 0.98
tpcds_q61/duckdb:duckdb 14537530 14446166 1.01
tpcds_q62/duckdb:duckdb 9761368 9116142 1.07
tpcds_q63/duckdb:duckdb 11604850 11223394 1.03
tpcds_q64/duckdb:duckdb 🚨 57594986 50812803 1.13
tpcds_q65/duckdb:duckdb 37026049 34815274 1.06
tpcds_q66/duckdb:duckdb 26636470 25246649 1.06
tpcds_q67/duckdb:duckdb 145571466 155733800 0.93
tpcds_q68/duckdb:duckdb 26778423 28756382 0.93
tpcds_q69/duckdb:duckdb 26406047 27789813 0.95
tpcds_q70/duckdb:duckdb 15288567 16097872 0.95
tpcds_q71/duckdb:duckdb 13976335 15028936 0.93
tpcds_q72/duckdb:duckdb 🚀 44191229 49871266 0.89
tpcds_q73/duckdb:duckdb 11631132 11722363 0.99
tpcds_q74/duckdb:duckdb 104156936 99044696 1.05
tpcds_q75/duckdb:duckdb 🚨 46970572 41313721 1.14
tpcds_q76/duckdb:duckdb 12587305 12057680 1.04
tpcds_q77/duckdb:duckdb 🚨 12520420 10968988 1.14
tpcds_q78/duckdb:duckdb 65097075 63566299 1.02
tpcds_q79/duckdb:duckdb 19573788 18207261 1.08
tpcds_q80/duckdb:duckdb 29386906 28034544 1.05
tpcds_q81/duckdb:duckdb 38843024 37823960 1.03
tpcds_q82/duckdb:duckdb 🚀 9107365 10854935 0.84
tpcds_q83/duckdb:duckdb 🚀 9667469 11506781 0.84
tpcds_q84/duckdb:duckdb 🚀 13954390 16008207 0.87
tpcds_q85/duckdb:duckdb 25505301 28232898 0.90
tpcds_q86/duckdb:duckdb 11271610 12070911 0.93
tpcds_q87/duckdb:duckdb 34621172 38214471 0.91
tpcds_q88/duckdb:duckdb 24902428 24909813 1.00
tpcds_q89/duckdb:duckdb 13826338 14728080 0.94
tpcds_q90/duckdb:duckdb 🚀 6123841 7296088 0.84
tpcds_q91/duckdb:duckdb 13577482 14881092 0.91
tpcds_q92/duckdb:duckdb 9545565 8794407 1.09
tpcds_q93/duckdb:duckdb 🚨 24940214 21579244 1.16
tpcds_q94/duckdb:duckdb 🚨 13914187 12600413 1.10
tpcds_q95/duckdb:duckdb 114883991 122789575 0.94
tpcds_q96/duckdb:duckdb 4794836 4536586 1.06
tpcds_q97/duckdb:duckdb 31459385 29093407 1.08
tpcds_q98/duckdb:duckdb 13651955 13287814 1.03
tpcds_q99/duckdb:duckdb 15767302 16121560 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -17.2% -3.0% -14.6% +19.0% ➖ noise
1 datafusion:vortex-file-compressed -13.2% -3.0% -10.5% +19.0% ➖ noise
1 duckdb:duckdb +7.3% -3.0% +10.6% +19.0% ➖ noise
1 duckdb:vortex-compact -11.0% -3.0% -8.3% +19.0% ➖ noise
1 duckdb:vortex-file-compressed -16.7% -3.0% -14.1% +19.0% ➖ noise
2 datafusion:vortex-compact -16.2% -1.9% -14.5% +19.0% ➖ noise
2 datafusion:vortex-file-compressed -11.6% -1.9% -9.9% +19.0% ➖ noise
2 duckdb:duckdb +0.8% -1.9% +2.8% +19.0% ➖ noise
2 duckdb:vortex-compact -12.6% -1.9% -10.9% +19.0% ➖ noise
2 duckdb:vortex-file-compressed -6.1% -1.9% -4.2% +19.0% ➖ noise
3 datafusion:vortex-compact -6.6% -2.3% -4.4% +20.3% ➖ noise
3 datafusion:vortex-file-compressed -14.9% -2.3% -12.9% +20.3% ➖ noise
3 duckdb:duckdb +12.3% -2.3% +14.9% +19.0% ➖ noise
3 duckdb:vortex-compact -6.0% -2.3% -3.7% +19.0% ➖ noise
3 duckdb:vortex-file-compressed +8.0% -2.3% +10.6% +19.0% ➖ noise
4 datafusion:vortex-compact -2.9% -2.0% -1.0% +19.0% ➖ noise
4 datafusion:vortex-file-compressed -2.4% -2.0% -0.5% +19.0% ➖ noise
4 duckdb:duckdb +3.5% -2.0% +5.5% +19.0% ➖ noise
4 duckdb:vortex-compact -13.9% -2.0% -12.2% +19.0% ➖ noise
4 duckdb:vortex-file-compressed -0.9% -2.0% +1.1% +19.0% ➖ noise
5 datafusion:vortex-compact +2.0% +1.8% +0.2% +19.0% ➖ noise
5 datafusion:vortex-file-compressed -7.1% +1.8% -8.7% +19.0% ➖ noise
5 duckdb:duckdb +3.2% +1.8% +1.4% +19.0% ➖ noise
5 duckdb:vortex-compact -12.1% +1.8% -13.7% +19.0% ➖ noise
5 duckdb:vortex-file-compressed -18.7% +1.8% -20.2% +19.0% ✅ faster
6 datafusion:vortex-compact +0.6% +7.5% -6.4% +19.0% ➖ noise
6 datafusion:vortex-file-compressed -1.7% +7.5% -8.6% +19.0% ➖ noise
6 duckdb:duckdb +9.9% +7.5% +2.2% +19.0% ➖ noise
6 duckdb:vortex-compact -5.1% +7.5% -11.7% +19.0% ➖ noise
6 duckdb:vortex-file-compressed -5.8% +7.5% -12.4% +19.0% ➖ noise
7 datafusion:vortex-compact -3.4% -1.3% -2.1% +19.0% ➖ noise
7 datafusion:vortex-file-compressed -6.7% -1.3% -5.4% +19.0% ➖ noise
7 duckdb:duckdb +6.9% -1.3% +8.3% +20.4% ➖ noise
7 duckdb:vortex-compact -4.4% -1.3% -3.1% +19.0% ➖ noise
7 duckdb:vortex-file-compressed -3.5% -1.3% -2.2% +19.0% ➖ noise
8 datafusion:vortex-compact -2.2% -3.8% +1.6% +19.0% ➖ noise
8 datafusion:vortex-file-compressed -7.0% -3.8% -3.4% +19.0% ➖ noise
8 duckdb:duckdb -1.7% -3.8% +2.1% +19.0% ➖ noise
8 duckdb:vortex-compact -2.3% -3.8% +1.5% +19.0% ➖ noise
8 duckdb:vortex-file-compressed -9.6% -3.8% -6.1% +19.0% ➖ noise
9 datafusion:vortex-compact +2.1% -0.7% +2.8% +19.0% ➖ noise
9 datafusion:vortex-file-compressed -2.3% -0.7% -1.6% +19.0% ➖ noise
9 duckdb:duckdb +0.8% -0.7% +1.4% +19.0% ➖ noise
9 duckdb:vortex-compact -7.5% -0.7% -6.9% +19.0% ➖ noise
9 duckdb:vortex-file-compressed +13.1% -0.7% +13.8% +19.0% ➖ noise
10 datafusion:vortex-compact -1.3% -0.4% -0.9% +19.0% ➖ noise
10 datafusion:vortex-file-compressed -8.3% -0.4% -8.0% +19.0% ➖ noise
10 duckdb:duckdb +3.2% -0.4% +3.6% +19.0% ➖ noise
10 duckdb:vortex-compact -16.0% -0.4% -15.7% +19.0% ➖ noise
10 duckdb:vortex-file-compressed -2.8% -0.4% -2.5% +19.0% ➖ noise
11 datafusion:vortex-compact +1.7% -5.9% +8.0% +19.0% ➖ noise
11 datafusion:vortex-file-compressed -3.2% -5.9% +2.8% +19.0% ➖ noise
11 duckdb:duckdb -1.4% -5.9% +4.8% +19.0% ➖ noise
11 duckdb:vortex-compact -15.7% -5.9% -10.4% +19.0% ➖ noise
11 duckdb:vortex-file-compressed +0.3% -5.9% +6.5% +19.0% ➖ noise
12 datafusion:vortex-compact -6.5% -12.7% +7.2% +19.0% ➖ noise
12 datafusion:vortex-file-compressed -13.6% -12.7% -1.0% +19.0% ➖ noise
12 duckdb:duckdb +6.4% -12.7% +21.9% +19.0% 🚨 regression
12 duckdb:vortex-compact -21.7% -12.7% -10.3% +19.0% ➖ noise
12 duckdb:vortex-file-compressed -4.9% -12.7% +8.9% +19.0% ➖ noise
13 datafusion:vortex-compact +2.4% -11.5% +15.8% +19.0% ➖ noise
13 datafusion:vortex-file-compressed -2.5% -11.5% +10.2% +19.0% ➖ noise
13 duckdb:duckdb +7.8% -11.5% +21.8% +19.0% 🚨 regression
13 duckdb:vortex-compact -6.0% -11.5% +6.3% +19.0% ➖ noise
13 duckdb:vortex-file-compressed +4.9% -11.5% +18.5% +19.0% ➖ noise
14 datafusion:vortex-compact -14.0% -8.3% -6.2% +19.0% ➖ noise
14 datafusion:vortex-file-compressed -4.3% -8.3% +4.4% +19.0% ➖ noise
14 duckdb:duckdb +5.5% -8.3% +15.1% +19.0% ➖ noise
14 duckdb:vortex-compact -10.2% -8.3% -2.1% +19.0% ➖ noise
14 duckdb:vortex-file-compressed +8.6% -8.3% +18.4% +19.0% ➖ noise
15 datafusion:vortex-compact -22.3% -15.2% -8.3% +19.0% ➖ noise
15 datafusion:vortex-file-compressed -8.2% -15.2% +8.4% +19.0% ➖ noise
15 duckdb:duckdb +0.1% -15.2% +18.0% +19.0% ➖ noise
15 duckdb:vortex-compact -19.9% -15.2% -5.5% +19.0% ➖ noise
15 duckdb:vortex-file-compressed -20.2% -15.2% -5.8% +19.0% ➖ noise
16 datafusion:vortex-compact -12.9% -15.6% +3.2% +19.0% ➖ noise
16 datafusion:vortex-file-compressed -12.9% -15.6% +3.2% +19.0% ➖ noise
16 duckdb:duckdb +12.4% -15.6% +33.2% +19.9% 🚨 regression
16 duckdb:vortex-compact -14.5% -15.6% +1.4% +19.0% ➖ noise
16 duckdb:vortex-file-compressed -16.8% -15.6% -1.4% +19.0% ➖ noise
17 datafusion:vortex-compact -16.4% -11.2% -5.8% +19.0% ➖ noise
17 datafusion:vortex-file-compressed -2.9% -11.2% +9.4% +19.0% ➖ noise
17 duckdb:duckdb +3.8% -11.2% +17.0% +19.0% ➖ noise
17 duckdb:vortex-compact -19.2% -11.2% -9.0% +19.0% ➖ noise
17 duckdb:vortex-file-compressed -22.8% -11.2% -13.0% +19.0% ➖ noise
18 datafusion:vortex-compact -18.4% -9.0% -10.3% +19.0% ➖ noise
18 datafusion:vortex-file-compressed -0.6% -9.0% +9.2% +19.0% ➖ noise
18 duckdb:duckdb +10.8% -9.0% +21.8% +19.0% 🚨 regression
18 duckdb:vortex-compact -16.4% -9.0% -8.2% +19.0% ➖ noise
18 duckdb:vortex-file-compressed -18.7% -9.0% -10.7% +19.0% ➖ noise
19 datafusion:vortex-compact -15.8% -13.5% -2.6% +19.0% ➖ noise
19 datafusion:vortex-file-compressed +16.4% -13.5% +34.6% +19.0% 🚨 regression
19 duckdb:duckdb +8.0% -13.5% +25.0% +19.0% 🚨 regression
19 duckdb:vortex-compact +2.4% -13.5% +18.5% +19.0% ➖ noise
19 duckdb:vortex-file-compressed -22.8% -13.5% -10.7% +19.0% ➖ noise
20 datafusion:vortex-compact -21.6% -12.1% -10.9% +19.0% ➖ noise
20 datafusion:vortex-file-compressed +11.6% -12.1% +26.9% +19.0% 🚨 regression
20 duckdb:duckdb +10.0% -12.1% +25.2% +19.0% 🚨 regression
20 duckdb:vortex-compact -2.4% -12.1% +11.0% +19.0% ➖ noise
20 duckdb:vortex-file-compressed -31.7% -12.1% -22.3% +19.0% ✅ faster
21 datafusion:vortex-compact -17.3% -8.1% -10.0% +19.0% ➖ noise
21 datafusion:vortex-file-compressed -4.3% -8.1% +4.1% +19.0% ➖ noise
21 duckdb:duckdb +8.1% -8.1% +17.6% +19.0% ➖ noise
21 duckdb:vortex-compact -0.9% -8.1% +7.8% +19.0% ➖ noise
21 duckdb:vortex-file-compressed -24.1% -8.1% -17.4% +19.6% ✅ faster
22 datafusion:vortex-compact -18.1% -7.4% -11.6% +19.0% ➖ noise
22 datafusion:vortex-file-compressed -5.2% -7.4% +2.4% +19.0% ➖ noise
22 duckdb:duckdb +1.5% -7.4% +9.6% +19.0% ➖ noise
22 duckdb:vortex-compact -3.4% -7.4% +4.3% +19.0% ➖ noise
22 duckdb:vortex-file-compressed +0.3% -7.4% +8.3% +20.8% ➖ noise
23 datafusion:vortex-compact -14.4% -6.3% -8.6% +19.0% ➖ noise
23 datafusion:vortex-file-compressed -4.3% -6.3% +2.1% +19.0% ➖ noise
23 duckdb:duckdb -0.6% -6.3% +6.1% +19.0% ➖ noise
23 duckdb:vortex-compact -13.2% -6.3% -7.4% +19.0% ➖ noise
23 duckdb:vortex-file-compressed -9.7% -6.3% -3.6% +19.0% ➖ noise
24 datafusion:vortex-compact -14.3% -8.7% -6.1% +19.0% ➖ noise
24 datafusion:vortex-file-compressed -7.0% -8.7% +1.9% +19.0% ➖ noise
24 duckdb:duckdb -8.6% -8.7% +0.1% +19.0% ➖ noise
24 duckdb:vortex-compact -10.1% -8.7% -1.5% +19.0% ➖ noise
24 duckdb:vortex-file-compressed -19.9% -8.7% -12.2% +19.0% ➖ noise
25 datafusion:vortex-compact -14.1% -2.1% -12.3% +19.0% ➖ noise
25 datafusion:vortex-file-compressed -8.6% -2.1% -6.7% +19.0% ➖ noise
25 duckdb:duckdb -7.1% -2.1% -5.1% +19.0% ➖ noise
25 duckdb:vortex-compact -12.0% -2.1% -10.1% +19.0% ➖ noise
25 duckdb:vortex-file-compressed -20.9% -2.1% -19.2% +19.0% ✅ faster
26 datafusion:vortex-compact -18.6% +1.7% -20.0% +19.0% ✅ faster
26 datafusion:vortex-file-compressed -6.1% +1.7% -7.6% +19.0% ➖ noise
26 duckdb:duckdb -5.4% +1.7% -6.9% +19.0% ➖ noise
26 duckdb:vortex-compact -9.6% +1.7% -11.1% +19.0% ➖ noise
26 duckdb:vortex-file-compressed -16.8% +1.7% -18.2% +20.5% ✅ faster
27 datafusion:vortex-compact -14.1% -1.5% -12.8% +19.0% ➖ noise
27 datafusion:vortex-file-compressed -4.2% -1.5% -2.7% +19.0% ➖ noise
27 duckdb:duckdb -7.6% -1.5% -6.2% +19.0% ➖ noise
27 duckdb:vortex-compact -14.3% -1.5% -13.0% +19.0% ➖ noise
27 duckdb:vortex-file-compressed -1.7% -1.5% -0.2% +19.0% ➖ noise
28 datafusion:vortex-compact -7.5% -2.7% -4.9% +19.0% ➖ noise
28 datafusion:vortex-file-compressed +1.0% -2.7% +3.8% +19.0% ➖ noise
28 duckdb:duckdb -2.6% -2.7% +0.1% +19.0% ➖ noise
28 duckdb:vortex-compact -3.6% -2.7% -0.9% +19.0% ➖ noise
28 duckdb:vortex-file-compressed +9.3% -2.7% +12.3% +19.0% ➖ noise
29 datafusion:vortex-compact -7.1% -2.6% -4.6% +19.0% ➖ noise
29 datafusion:vortex-file-compressed -6.9% -2.6% -4.4% +19.0% ➖ noise
29 duckdb:duckdb -12.3% -2.6% -10.0% +19.0% ➖ noise
29 duckdb:vortex-compact -15.6% -2.6% -13.4% +19.0% ➖ noise
29 duckdb:vortex-file-compressed -1.3% -2.6% +1.3% +19.0% ➖ noise
30 datafusion:vortex-compact -16.6% +1.6% -18.0% +19.9% ✅ faster
30 datafusion:vortex-file-compressed -14.4% +1.6% -15.8% +19.0% ➖ noise
30 duckdb:duckdb -16.1% +1.6% -17.4% +19.0% ✅ faster
30 duckdb:vortex-compact -19.3% +1.6% -20.6% +19.0% ✅ faster
30 duckdb:vortex-file-compressed -10.2% +1.6% -11.7% +19.0% ➖ noise
31 datafusion:vortex-compact +1.6% -3.4% +5.1% +19.0% ➖ noise
31 datafusion:vortex-file-compressed -9.0% -3.4% -5.8% +19.0% ➖ noise
31 duckdb:duckdb -10.5% -3.4% -7.4% +19.0% ➖ noise
31 duckdb:vortex-compact -16.9% -3.4% -14.0% +19.0% ➖ noise
31 duckdb:vortex-file-compressed -0.1% -3.4% +3.4% +19.0% ➖ noise
32 datafusion:vortex-compact -7.0% -9.9% +3.2% +19.0% ➖ noise
32 datafusion:vortex-file-compressed -6.0% -9.9% +4.4% +19.0% ➖ noise
32 duckdb:duckdb -12.3% -9.9% -2.6% +19.0% ➖ noise
32 duckdb:vortex-compact -8.0% -9.9% +2.1% +19.0% ➖ noise
32 duckdb:vortex-file-compressed -13.6% -9.9% -4.1% +19.0% ➖ noise
33 datafusion:vortex-compact -12.9% -11.4% -1.7% +19.0% ➖ noise
33 datafusion:vortex-file-compressed +10.6% -11.4% +24.9% +19.0% 🚨 regression
33 duckdb:duckdb -8.3% -11.4% +3.5% +19.0% ➖ noise
33 duckdb:vortex-compact -13.5% -11.4% -2.4% +19.0% ➖ noise
33 duckdb:vortex-file-compressed -8.2% -11.4% +3.6% +19.0% ➖ noise
34 datafusion:vortex-compact -11.7% -17.9% +7.6% +19.0% ➖ noise
34 datafusion:vortex-file-compressed +7.2% -17.9% +30.7% +19.0% 🚨 regression
34 duckdb:duckdb -0.1% -17.9% +21.7% +19.0% 🚨 regression
34 duckdb:vortex-compact -11.3% -17.9% +8.1% +19.0% ➖ noise
34 duckdb:vortex-file-compressed -3.7% -17.9% +17.4% +19.0% ➖ noise
35 datafusion:vortex-compact -12.5% -17.5% +6.0% +19.0% ➖ noise
35 datafusion:vortex-file-compressed +6.8% -17.5% +29.4% +19.0% 🚨 regression
35 duckdb:duckdb -4.3% -17.5% +15.9% +19.0% ➖ noise
35 duckdb:vortex-compact -19.8% -17.5% -2.9% +19.0% ➖ noise
35 duckdb:vortex-file-compressed +2.6% -17.5% +24.3% +19.0% 🚨 regression
36 datafusion:vortex-compact -16.7% -15.6% -1.3% +19.0% ➖ noise
36 datafusion:vortex-file-compressed +16.4% -15.6% +38.0% +19.0% 🚨 regression
36 duckdb:duckdb -7.0% -15.6% +10.3% +19.0% ➖ noise
36 duckdb:vortex-compact -17.5% -15.6% -2.2% +19.0% ➖ noise
36 duckdb:vortex-file-compressed -10.0% -15.6% +6.7% +19.0% ➖ noise
37 datafusion:vortex-compact -16.6% -15.5% -1.3% +19.0% ➖ noise
37 datafusion:vortex-file-compressed +22.7% -15.5% +45.1% +19.0% 🚨 regression
37 duckdb:duckdb -9.7% -15.5% +6.8% +19.0% ➖ noise
37 duckdb:vortex-compact -16.4% -15.5% -1.1% +19.0% ➖ noise
37 duckdb:vortex-file-compressed -0.0% -15.5% +18.3% +19.0% ➖ noise
38 datafusion:vortex-compact -16.8% -10.8% -6.8% +19.0% ➖ noise
38 datafusion:vortex-file-compressed +9.0% -10.8% +22.1% +19.0% 🚨 regression
38 duckdb:duckdb -11.3% -10.8% -0.6% +19.0% ➖ noise
38 duckdb:vortex-compact -12.8% -10.8% -2.2% +19.0% ➖ noise
38 duckdb:vortex-file-compressed +4.2% -10.8% +16.8% +19.0% ➖ noise
39 datafusion:vortex-compact -19.6% -21.1% +1.9% +19.0% ➖ noise
39 datafusion:vortex-file-compressed +5.7% -21.1% +34.0% +19.0% 🚨 regression
39 duckdb:duckdb +2.0% -21.1% +29.3% +19.0% 🚨 regression
39 duckdb:vortex-compact -15.7% -21.1% +6.8% +19.0% ➖ noise
39 duckdb:vortex-file-compressed -11.3% -21.1% +12.4% +19.0% ➖ noise
40 datafusion:vortex-compact -19.1% -20.3% +1.5% +19.0% ➖ noise
40 datafusion:vortex-file-compressed +9.7% -20.3% +37.7% +19.0% 🚨 regression
40 duckdb:duckdb -9.7% -20.3% +13.4% +19.0% ➖ noise
40 duckdb:vortex-compact -18.6% -20.3% +2.1% +19.0% ➖ noise
40 duckdb:vortex-file-compressed -1.2% -20.3% +24.0% +19.0% 🚨 regression
41 datafusion:vortex-compact -22.4% -15.6% -8.1% +19.0% ➖ noise
41 datafusion:vortex-file-compressed +17.1% -15.6% +38.8% +19.0% 🚨 regression
41 duckdb:duckdb -12.1% -15.6% +4.2% +19.0% ➖ noise
41 duckdb:vortex-compact -15.8% -15.6% -0.2% +19.0% ➖ noise
41 duckdb:vortex-file-compressed -1.4% -15.6% +16.9% +19.0% ➖ noise
42 datafusion:vortex-compact -15.1% -18.7% +4.4% +19.0% ➖ noise
42 datafusion:vortex-file-compressed +16.2% -18.7% +43.0% +19.0% 🚨 regression
42 duckdb:duckdb -8.8% -18.7% +12.2% +19.0% ➖ noise
42 duckdb:vortex-compact -18.9% -18.7% -0.3% +19.0% ➖ noise
42 duckdb:vortex-file-compressed +2.0% -18.7% +25.5% +19.0% 🚨 regression
43 datafusion:vortex-compact -3.2% -14.1% +12.7% +19.0% ➖ noise
43 datafusion:vortex-file-compressed +7.3% -14.1% +24.8% +19.0% 🚨 regression
43 duckdb:duckdb -7.5% -14.1% +7.6% +19.0% ➖ noise
43 duckdb:vortex-compact -7.6% -14.1% +7.5% +19.0% ➖ noise
43 duckdb:vortex-file-compressed -1.3% -14.1% +14.8% +19.0% ➖ noise
44 datafusion:vortex-compact -0.5% -14.8% +16.9% +19.0% ➖ noise
44 datafusion:vortex-file-compressed +6.9% -14.8% +25.6% +19.0% 🚨 regression
44 duckdb:duckdb -12.2% -14.8% +3.1% +19.0% ➖ noise
44 duckdb:vortex-compact -15.3% -14.8% -0.6% +19.0% ➖ noise
44 duckdb:vortex-file-compressed +8.9% -14.8% +27.9% +19.0% 🚨 regression
45 datafusion:vortex-compact +1.0% -16.5% +21.0% +19.0% 🚨 regression
45 datafusion:vortex-file-compressed +14.9% -16.5% +37.6% +19.0% 🚨 regression
45 duckdb:duckdb -6.0% -16.5% +12.6% +19.0% ➖ noise
45 duckdb:vortex-compact -24.5% -16.5% -9.5% +19.0% ➖ noise
45 duckdb:vortex-file-compressed -6.3% -16.5% +12.2% +19.0% ➖ noise
46 datafusion:vortex-compact +1.6% -17.7% +23.5% +19.0% 🚨 regression
46 datafusion:vortex-file-compressed +9.6% -17.7% +33.2% +19.0% 🚨 regression
46 duckdb:duckdb -11.5% -17.7% +7.5% +19.0% ➖ noise
46 duckdb:vortex-compact -16.0% -17.7% +2.1% +19.0% ➖ noise
46 duckdb:vortex-file-compressed -0.9% -17.7% +20.4% +19.0% 🚨 regression
47 datafusion:vortex-compact -3.0% -15.1% +14.2% +19.0% ➖ noise
47 datafusion:vortex-file-compressed +9.3% -15.1% +28.6% +19.0% 🚨 regression
47 duckdb:duckdb -5.9% -15.1% +10.8% +19.0% ➖ noise
47 duckdb:vortex-compact -14.8% -15.1% +0.3% +19.0% ➖ noise
47 duckdb:vortex-file-compressed -17.7% -15.1% -3.1% +19.0% ➖ noise
48 datafusion:vortex-compact -4.5% -14.5% +11.7% +19.0% ➖ noise
48 datafusion:vortex-file-compressed +15.2% -14.5% +34.7% +19.0% 🚨 regression
48 duckdb:duckdb -3.6% -14.5% +12.8% +19.0% ➖ noise
48 duckdb:vortex-compact -12.6% -14.5% +2.2% +19.0% ➖ noise
48 duckdb:vortex-file-compressed -22.1% -14.5% -8.9% +19.0% ➖ noise
49 datafusion:vortex-compact -3.6% -10.2% +7.4% +19.0% ➖ noise
49 datafusion:vortex-file-compressed +5.0% -10.2% +16.9% +19.0% ➖ noise
49 duckdb:duckdb +4.4% -10.2% +16.3% +19.0% ➖ noise
49 duckdb:vortex-compact +5.0% -10.2% +16.9% +19.0% ➖ noise
49 duckdb:vortex-file-compressed -23.0% -10.2% -14.2% +19.0% ➖ noise
50 datafusion:vortex-compact +2.3% -10.7% +14.6% +19.0% ➖ noise
50 datafusion:vortex-file-compressed -12.9% -10.7% -2.4% +19.0% ➖ noise
50 duckdb:duckdb -3.8% -10.7% +7.7% +19.0% ➖ noise
50 duckdb:vortex-compact +3.0% -10.7% +15.4% +19.0% ➖ noise
50 duckdb:vortex-file-compressed -13.0% -10.7% -2.5% +19.0% ➖ noise
51 datafusion:vortex-compact -2.2% -4.6% +2.5% +19.0% ➖ noise
51 datafusion:vortex-file-compressed -4.6% -4.6% -0.1% +19.0% ➖ noise
51 duckdb:duckdb -8.7% -4.6% -4.4% +25.4% ➖ noise
51 duckdb:vortex-compact -3.1% -4.6% +1.5% +19.2% ➖ noise
51 duckdb:vortex-file-compressed -10.8% -4.6% -6.6% +19.0% ➖ noise
52 datafusion:vortex-compact -2.8% -5.8% +3.2% +19.4% ➖ noise
52 datafusion:vortex-file-compressed -7.8% -5.8% -2.1% +22.2% ➖ noise
52 duckdb:duckdb -6.7% -5.8% -1.0% +19.8% ➖ noise
52 duckdb:vortex-compact +1.8% -5.8% +8.0% +19.2% ➖ noise
52 duckdb:vortex-file-compressed -28.7% -5.8% -24.3% +25.4% ✅ faster
53 datafusion:vortex-compact +2.7% -5.1% +8.2% +19.0% ➖ noise
53 datafusion:vortex-file-compressed -5.5% -5.1% -0.5% +19.0% ➖ noise
53 duckdb:duckdb -4.6% -5.1% +0.5% +19.0% ➖ noise
53 duckdb:vortex-compact -4.4% -5.1% +0.7% +19.0% ➖ noise
53 duckdb:vortex-file-compressed -19.8% -5.1% -15.5% +19.0% ➖ noise
54 datafusion:vortex-compact +0.3% -5.3% +5.9% +19.0% ➖ noise
54 datafusion:vortex-file-compressed -8.0% -5.3% -2.8% +19.0% ➖ noise
54 duckdb:duckdb -5.1% -5.3% +0.3% +19.0% ➖ noise
54 duckdb:vortex-compact +0.8% -5.3% +6.5% +19.0% ➖ noise
54 duckdb:vortex-file-compressed -16.3% -5.3% -11.7% +19.0% ➖ noise
55 datafusion:vortex-compact +2.3% -12.0% +16.3% +19.0% ➖ noise
55 datafusion:vortex-file-compressed -0.2% -12.0% +13.5% +19.0% ➖ noise
55 duckdb:duckdb -1.3% -12.0% +12.2% +19.0% ➖ noise
55 duckdb:vortex-compact +4.6% -12.0% +18.9% +19.0% ➖ noise
55 duckdb:vortex-file-compressed -18.8% -12.0% -7.7% +19.0% ➖ noise
56 datafusion:vortex-compact +0.2% -7.0% +7.8% +19.0% ➖ noise
56 datafusion:vortex-file-compressed -8.2% -7.0% -1.3% +19.0% ➖ noise
56 duckdb:duckdb -11.3% -7.0% -4.5% +19.0% ➖ noise
56 duckdb:vortex-compact -6.0% -7.0% +1.2% +19.0% ➖ noise
56 duckdb:vortex-file-compressed -15.9% -7.0% -9.5% +19.0% ➖ noise
57 datafusion:vortex-compact -1.9% -2.0% +0.0% +19.0% ➖ noise
57 datafusion:vortex-file-compressed -9.0% -2.0% -7.2% +19.0% ➖ noise
57 duckdb:duckdb -5.0% -2.0% -3.1% +19.0% ➖ noise
57 duckdb:vortex-compact -9.9% -2.0% -8.1% +19.0% ➖ noise
57 duckdb:vortex-file-compressed -10.2% -2.0% -8.4% +23.8% ➖ noise
58 datafusion:vortex-compact -1.8% -9.3% +8.3% +19.0% ➖ noise
58 datafusion:vortex-file-compressed -5.0% -9.3% +4.8% +19.0% ➖ noise
58 duckdb:duckdb +2.0% -9.3% +12.5% +19.0% ➖ noise
58 duckdb:vortex-compact -9.9% -9.3% -0.6% +19.0% ➖ noise
58 duckdb:vortex-file-compressed +7.2% -9.3% +18.3% +28.5% ➖ noise
59 datafusion:vortex-compact -3.0% -9.3% +7.0% +19.0% ➖ noise
59 datafusion:vortex-file-compressed -0.6% -9.3% +9.6% +19.0% ➖ noise
59 duckdb:duckdb +0.5% -9.3% +10.8% +19.0% ➖ noise
59 duckdb:vortex-compact -29.2% -9.3% -21.9% +19.0% ✅ faster
59 duckdb:vortex-file-compressed -17.8% -9.3% -9.4% +19.0% ➖ noise
60 datafusion:vortex-compact +0.6% -12.2% +14.5% +19.0% ➖ noise
60 datafusion:vortex-file-compressed -10.3% -12.2% +2.2% +19.0% ➖ noise
60 duckdb:duckdb -2.2% -12.2% +11.4% +19.0% ➖ noise
60 duckdb:vortex-compact -13.8% -12.2% -1.9% +19.0% ➖ noise
60 duckdb:vortex-file-compressed -21.0% -12.2% -10.0% +19.0% ➖ noise
61 datafusion:vortex-compact -6.3% -8.8% +2.8% +19.0% ➖ noise
61 datafusion:vortex-file-compressed -5.7% -8.8% +3.5% +19.0% ➖ noise
61 duckdb:duckdb +0.6% -8.8% +10.4% +19.0% ➖ noise
61 duckdb:vortex-compact -17.3% -8.8% -9.3% +19.0% ➖ noise
61 duckdb:vortex-file-compressed -22.2% -8.8% -14.6% +19.0% ➖ noise
62 datafusion:vortex-compact -13.8% +3.1% -16.4% +19.2% ✅ faster
62 datafusion:vortex-file-compressed -5.5% +3.1% -8.4% +20.1% ➖ noise
62 duckdb:duckdb +7.1% +3.1% +3.8% +19.8% ➖ noise
62 duckdb:vortex-compact -15.9% +3.1% -18.4% +27.1% ➖ noise
62 duckdb:vortex-file-compressed -14.8% +3.1% -17.4% +22.1% ➖ noise
63 datafusion:vortex-compact -13.1% -10.1% -3.4% +19.0% ➖ noise
63 datafusion:vortex-file-compressed -3.9% -10.1% +6.9% +19.0% ➖ noise
63 duckdb:duckdb +3.4% -10.1% +15.0% +19.0% ➖ noise
63 duckdb:vortex-compact -16.4% -10.1% -7.0% +19.0% ➖ noise
63 duckdb:vortex-file-compressed -15.9% -10.1% -6.5% +19.0% ➖ noise
64 datafusion:vortex-compact -16.3% -14.0% -2.7% +19.0% ➖ noise
64 datafusion:vortex-file-compressed -7.3% -14.0% +7.8% +19.0% ➖ noise
64 duckdb:duckdb +13.3% -14.0% +31.8% +19.0% 🚨 regression
64 duckdb:vortex-compact +1.7% -14.0% +18.2% +19.0% ➖ noise
64 duckdb:vortex-file-compressed +5.3% -14.0% +22.5% +19.0% 🚨 regression
65 datafusion:vortex-compact -5.2% -4.9% -0.3% +19.0% ➖ noise
65 datafusion:vortex-file-compressed -7.4% -4.9% -2.6% +19.0% ➖ noise
65 duckdb:duckdb +6.4% -4.9% +11.8% +19.0% ➖ noise
65 duckdb:vortex-compact -4.1% -4.9% +0.8% +19.0% ➖ noise
65 duckdb:vortex-file-compressed -3.1% -4.9% +1.9% +19.0% ➖ noise
66 datafusion:vortex-compact -0.4% -2.7% +2.4% +19.0% ➖ noise
66 datafusion:vortex-file-compressed -3.9% -2.7% -1.2% +19.0% ➖ noise
66 duckdb:duckdb +5.5% -2.7% +8.5% +19.0% ➖ noise
66 duckdb:vortex-compact +8.7% -2.7% +11.8% +19.0% ➖ noise
66 duckdb:vortex-file-compressed -7.4% -2.7% -4.8% +19.0% ➖ noise
67 datafusion:vortex-compact -9.0% -4.4% -4.8% +19.0% ➖ noise
67 datafusion:vortex-file-compressed -4.7% -4.4% -0.2% +19.0% ➖ noise
67 duckdb:duckdb -6.5% -4.4% -2.2% +19.0% ➖ noise
67 duckdb:vortex-compact -10.1% -4.4% -5.9% +19.0% ➖ noise
67 duckdb:vortex-file-compressed -2.2% -4.4% +2.4% +19.0% ➖ noise
68 datafusion:vortex-compact +2.7% -7.0% +10.4% +19.0% ➖ noise
68 datafusion:vortex-file-compressed -8.7% -7.0% -1.8% +19.0% ➖ noise
68 duckdb:duckdb -6.9% -7.0% +0.1% +19.0% ➖ noise
68 duckdb:vortex-compact +9.7% -7.0% +17.9% +19.0% ➖ noise
68 duckdb:vortex-file-compressed +1.1% -7.0% +8.7% +19.0% ➖ noise
69 datafusion:vortex-compact -4.3% -5.7% +1.5% +19.0% ➖ noise
69 datafusion:vortex-file-compressed -5.2% -5.7% +0.5% +19.0% ➖ noise
69 duckdb:duckdb -5.0% -5.7% +0.8% +19.0% ➖ noise
69 duckdb:vortex-compact +9.8% -5.7% +16.5% +19.0% ➖ noise
69 duckdb:vortex-file-compressed -8.1% -5.7% -2.5% +19.0% ➖ noise
70 datafusion:vortex-compact -3.2% -4.2% +1.0% +19.0% ➖ noise
70 datafusion:vortex-file-compressed -13.0% -4.2% -9.2% +19.0% ➖ noise
70 duckdb:duckdb -5.0% -4.2% -0.9% +19.0% ➖ noise
70 duckdb:vortex-compact +11.3% -4.2% +16.1% +19.0% ➖ noise
70 duckdb:vortex-file-compressed -2.5% -4.2% +1.8% +19.0% ➖ noise
71 datafusion:vortex-compact -3.0% -7.2% +4.4% +19.0% ➖ noise
71 datafusion:vortex-file-compressed -6.1% -7.2% +1.1% +19.0% ➖ noise
71 duckdb:duckdb -7.0% -7.2% +0.2% +19.0% ➖ noise
71 duckdb:vortex-compact +15.2% -7.2% +24.1% +19.0% 🚨 regression
71 duckdb:vortex-file-compressed -3.0% -7.2% +4.4% +19.0% ➖ noise
72 datafusion:vortex-compact +0.2% +0.1% +0.1% +19.0% ➖ noise
72 datafusion:vortex-file-compressed -4.9% +0.1% -5.0% +19.0% ➖ noise
72 duckdb:duckdb -11.4% +0.1% -11.4% +19.0% ➖ noise
72 duckdb:vortex-compact +4.8% +0.1% +4.8% +19.0% ➖ noise
72 duckdb:vortex-file-compressed -1.6% +0.1% -1.6% +19.0% ➖ noise
73 datafusion:vortex-compact +4.1% -4.3% +8.8% +19.9% ➖ noise
73 datafusion:vortex-file-compressed -1.2% -4.3% +3.2% +20.9% ➖ noise
73 duckdb:duckdb -0.8% -4.3% +3.7% +19.0% ➖ noise
73 duckdb:vortex-compact +8.4% -4.3% +13.3% +19.0% ➖ noise
73 duckdb:vortex-file-compressed +0.9% -4.3% +5.5% +19.0% ➖ noise
74 datafusion:vortex-compact +8.9% +6.2% +2.5% +19.0% ➖ noise
74 datafusion:vortex-file-compressed -2.1% +6.2% -7.8% +19.0% ➖ noise
74 duckdb:duckdb +5.2% +6.2% -1.0% +19.0% ➖ noise
74 duckdb:vortex-compact +5.1% +6.2% -1.0% +19.0% ➖ noise
74 duckdb:vortex-file-compressed -9.7% +6.2% -14.9% +19.0% ➖ noise
75 datafusion:vortex-compact -0.6% -3.6% +3.1% +19.0% ➖ noise
75 datafusion:vortex-file-compressed -1.3% -3.6% +2.4% +19.0% ➖ noise
75 duckdb:duckdb +13.7% -3.6% +17.9% +19.0% ➖ noise
75 duckdb:vortex-compact +5.9% -3.6% +9.8% +19.0% ➖ noise
75 duckdb:vortex-file-compressed -19.2% -3.6% -16.2% +19.0% ✅ faster
76 datafusion:vortex-compact -6.8% +0.1% -6.9% +19.0% ➖ noise
76 datafusion:vortex-file-compressed -2.8% +0.1% -2.9% +19.0% ➖ noise
76 duckdb:duckdb +4.4% +0.1% +4.3% +19.0% ➖ noise
76 duckdb:vortex-compact -3.6% +0.1% -3.8% +19.0% ➖ noise
76 duckdb:vortex-file-compressed -37.9% +0.1% -38.0% +31.0% ✅ faster
77 datafusion:vortex-compact -7.4% +0.3% -7.6% +19.0% ➖ noise
77 datafusion:vortex-file-compressed +0.1% +0.3% -0.2% +19.0% ➖ noise
77 duckdb:duckdb +14.1% +0.3% +13.8% +19.0% ➖ noise
77 duckdb:vortex-compact -1.7% +0.3% -2.0% +19.0% ➖ noise
77 duckdb:vortex-file-compressed -23.1% +0.3% -23.3% +19.0% ✅ faster
78 datafusion:vortex-compact -5.0% +6.6% -10.9% +19.0% ➖ noise
78 datafusion:vortex-file-compressed -1.0% +6.6% -7.1% +19.0% ➖ noise
78 duckdb:duckdb +2.4% +6.6% -4.0% +19.0% ➖ noise
78 duckdb:vortex-compact +8.2% +6.6% +1.5% +19.0% ➖ noise
78 duckdb:vortex-file-compressed -16.9% +6.6% -22.1% +19.0% ✅ faster
79 datafusion:vortex-compact -5.1% -4.2% -0.9% +19.0% ➖ noise
79 datafusion:vortex-file-compressed -3.0% -4.2% +1.2% +19.0% ➖ noise
79 duckdb:duckdb +7.5% -4.2% +12.2% +19.0% ➖ noise
79 duckdb:vortex-compact +5.6% -4.2% +10.2% +19.0% ➖ noise
79 duckdb:vortex-file-compressed -15.0% -4.2% -11.3% +19.0% ➖ noise
80 datafusion:vortex-compact -3.2% -3.7% +0.6% +19.0% ➖ noise
80 datafusion:vortex-file-compressed -20.3% -3.7% -17.2% +19.0% ✅ faster
80 duckdb:duckdb +4.8% -3.7% +8.9% +19.0% ➖ noise
80 duckdb:vortex-compact +8.7% -3.7% +13.0% +19.0% ➖ noise
80 duckdb:vortex-file-compressed -26.1% -3.7% -23.2% +19.0% ✅ faster
81 datafusion:vortex-compact -12.3% +2.8% -14.7% +19.0% ➖ noise
81 datafusion:vortex-file-compressed -22.8% +2.8% -24.9% +19.0% ✅ faster
81 duckdb:duckdb +2.7% +2.8% -0.1% +19.0% ➖ noise
81 duckdb:vortex-compact +7.2% +2.8% +4.2% +19.0% ➖ noise
81 duckdb:vortex-file-compressed -21.9% +2.8% -24.0% +19.0% ✅ faster
82 datafusion:vortex-compact -6.6% -3.5% -3.2% +19.0% ➖ noise
82 datafusion:vortex-file-compressed -17.9% -3.5% -14.9% +19.0% ➖ noise
82 duckdb:duckdb -16.1% -3.5% -13.0% +19.0% ➖ noise
82 duckdb:vortex-compact +16.1% -3.5% +20.4% +19.0% 🚨 regression
82 duckdb:vortex-file-compressed -23.3% -3.5% -20.5% +19.0% ✅ faster
83 datafusion:vortex-compact -10.6% +1.2% -11.7% +19.0% ➖ noise
83 datafusion:vortex-file-compressed -5.8% +1.2% -6.9% +19.0% ➖ noise
83 duckdb:duckdb -16.0% +1.2% -17.0% +19.0% ✅ faster
83 duckdb:vortex-compact +10.5% +1.2% +9.2% +19.0% ➖ noise
83 duckdb:vortex-file-compressed -17.1% +1.2% -18.0% +19.0% ✅ faster
84 datafusion:vortex-compact -12.7% +2.3% -14.7% +19.0% ➖ noise
84 datafusion:vortex-file-compressed -12.6% +2.3% -14.5% +19.0% ➖ noise
84 duckdb:duckdb -12.8% +2.3% -14.8% +19.0% ➖ noise
84 duckdb:vortex-compact +20.0% +2.3% +17.3% +19.0% ➖ noise
84 duckdb:vortex-file-compressed -16.5% +2.3% -18.4% +19.0% ✅ faster
85 datafusion:vortex-compact -8.8% -5.7% -3.3% +19.0% ➖ noise
85 datafusion:vortex-file-compressed -13.2% -5.7% -8.0% +19.0% ➖ noise
85 duckdb:duckdb -9.7% -5.7% -4.2% +19.0% ➖ noise
85 duckdb:vortex-compact +7.0% -5.7% +13.4% +19.0% ➖ noise
85 duckdb:vortex-file-compressed -20.7% -5.7% -15.9% +19.0% ➖ noise
86 datafusion:vortex-compact -11.7% -5.7% -6.3% +19.0% ➖ noise
86 datafusion:vortex-file-compressed -11.7% -5.7% -6.4% +19.0% ➖ noise
86 duckdb:duckdb -6.6% -5.7% -1.0% +19.0% ➖ noise
86 duckdb:vortex-compact +9.0% -5.7% +15.6% +19.0% ➖ noise
86 duckdb:vortex-file-compressed -18.8% -5.7% -13.8% +20.9% ➖ noise
87 datafusion:vortex-compact -7.9% -5.6% -2.5% +19.0% ➖ noise
87 datafusion:vortex-file-compressed -13.9% -5.6% -8.9% +19.0% ➖ noise
87 duckdb:duckdb -9.4% -5.6% -4.1% +19.0% ➖ noise
87 duckdb:vortex-compact +8.3% -5.6% +14.7% +19.0% ➖ noise
87 duckdb:vortex-file-compressed -13.9% -5.6% -8.8% +19.0% ➖ noise
88 datafusion:vortex-compact +4.0% -5.5% +10.1% +19.0% ➖ noise
88 datafusion:vortex-file-compressed -5.8% -5.5% -0.3% +19.0% ➖ noise
88 duckdb:duckdb -0.0% -5.5% +5.8% +19.0% ➖ noise
88 duckdb:vortex-compact +7.6% -5.5% +13.9% +19.0% ➖ noise
88 duckdb:vortex-file-compressed -13.6% -5.5% -8.6% +19.0% ➖ noise
89 datafusion:vortex-compact +9.0% -14.5% +27.5% +19.0% 🚨 regression
89 datafusion:vortex-file-compressed -2.5% -14.5% +14.1% +19.0% ➖ noise
89 duckdb:duckdb -6.1% -14.5% +9.9% +19.0% ➖ noise
89 duckdb:vortex-compact +10.0% -14.5% +28.7% +22.3% 🚨 regression
89 duckdb:vortex-file-compressed -5.5% -14.5% +10.5% +19.0% ➖ noise
90 datafusion:vortex-compact +8.1% -12.7% +23.8% +19.0% 🚨 regression
90 datafusion:vortex-file-compressed -5.6% -12.7% +8.1% +19.0% ➖ noise
90 duckdb:duckdb -16.1% -12.7% -3.9% +21.4% ➖ noise
90 duckdb:vortex-compact +1.3% -12.7% +16.0% +19.3% ➖ noise
90 duckdb:vortex-file-compressed -10.6% -12.7% +2.4% +19.0% ➖ noise
91 datafusion:vortex-compact +7.0% -8.8% +17.4% +19.0% ➖ noise
91 datafusion:vortex-file-compressed -19.9% -8.8% -12.1% +19.0% ➖ noise
91 duckdb:duckdb -8.8% -8.8% +0.1% +19.0% ➖ noise
91 duckdb:vortex-compact +6.9% -8.8% +17.3% +19.0% ➖ noise
91 duckdb:vortex-file-compressed +3.6% -8.8% +13.7% +19.0% ➖ noise
92 datafusion:vortex-compact +9.7% -2.0% +12.0% +19.0% ➖ noise
92 datafusion:vortex-file-compressed -19.9% -2.0% -18.2% +19.0% ✅ faster
92 duckdb:duckdb +8.5% -2.0% +10.8% +19.0% ➖ noise
92 duckdb:vortex-compact +9.6% -2.0% +11.8% +19.0% ➖ noise
92 duckdb:vortex-file-compressed -0.5% -2.0% +1.5% +19.0% ➖ noise
93 datafusion:vortex-compact +13.8% -5.4% +20.2% +19.0% 🚨 regression
93 datafusion:vortex-file-compressed -19.1% -5.4% -14.5% +19.0% ➖ noise
93 duckdb:duckdb +15.6% -5.4% +22.2% +19.0% 🚨 regression
93 duckdb:vortex-compact +13.5% -5.4% +20.0% +19.0% 🚨 regression
93 duckdb:vortex-file-compressed -3.8% -5.4% +1.7% +19.0% ➖ noise
94 datafusion:vortex-compact +14.9% -10.3% +28.1% +19.0% 🚨 regression
94 datafusion:vortex-file-compressed -18.4% -10.3% -9.0% +19.0% ➖ noise
94 duckdb:duckdb +10.4% -10.3% +23.1% +19.0% 🚨 regression
94 duckdb:vortex-compact +17.4% -10.3% +31.0% +19.0% 🚨 regression
94 duckdb:vortex-file-compressed +4.7% -10.3% +16.7% +19.7% ➖ noise
95 datafusion:vortex-compact +7.0% -5.5% +13.2% +19.0% ➖ noise
95 datafusion:vortex-file-compressed -12.1% -5.5% -7.0% +19.0% ➖ noise
95 duckdb:duckdb -6.4% -5.5% -1.0% +19.0% ➖ noise
95 duckdb:vortex-compact +8.3% -5.5% +14.6% +19.0% ➖ noise
95 duckdb:vortex-file-compressed +2.0% -5.5% +7.9% +19.0% ➖ noise
96 datafusion:vortex-compact +6.4% -8.1% +15.8% +19.0% ➖ noise
96 datafusion:vortex-file-compressed -10.0% -8.1% -2.1% +19.0% ➖ noise
96 duckdb:duckdb +5.7% -8.1% +15.0% +19.0% ➖ noise
96 duckdb:vortex-compact +6.1% -8.1% +15.5% +19.0% ➖ noise
96 duckdb:vortex-file-compressed -1.3% -8.1% +7.4% +19.0% ➖ noise
97 datafusion:vortex-compact +10.4% -7.4% +19.3% +19.0% 🚨 regression
97 datafusion:vortex-file-compressed -17.5% -7.4% -10.9% +19.0% ➖ noise
97 duckdb:duckdb +8.1% -7.4% +16.8% +19.0% ➖ noise
97 duckdb:vortex-compact +5.5% -7.4% +13.9% +19.0% ➖ noise
97 duckdb:vortex-file-compressed -10.2% -7.4% -3.0% +19.0% ➖ noise
98 datafusion:vortex-compact +17.3% -5.6% +24.3% +19.0% 🚨 regression
98 datafusion:vortex-file-compressed -21.8% -5.6% -17.2% +19.0% ✅ faster
98 duckdb:duckdb +2.7% -5.6% +8.8% +19.0% ➖ noise
98 duckdb:vortex-compact +3.0% -5.6% +9.2% +19.0% ➖ noise
98 duckdb:vortex-file-compressed -8.7% -5.6% -3.2% +19.0% ➖ noise
99 datafusion:vortex-compact +10.6% -12.2% +25.9% +19.0% 🚨 regression
99 datafusion:vortex-file-compressed -16.5% -12.2% -4.9% +19.0% ➖ noise
99 duckdb:duckdb -2.2% -12.2% +11.3% +19.7% ➖ noise
99 duckdb:vortex-compact -2.2% -12.2% +11.4% +28.7% ➖ noise
99 duckdb:vortex-file-compressed -4.0% -12.2% +9.3% +19.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.7%
Vortex (geomean): 1.089x ➖
Parquet (geomean): 1.022x ➖
Shifts: Parquet (control) +2.2% · Median polish +5.3%


datafusion / vortex-file-compressed (1.076x ➖, 0↑ 5↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 424867746 391516984 1.09
tpch_q02/datafusion:vortex-file-compressed 122036461 115899947 1.05
tpch_q03/datafusion:vortex-file-compressed 221393085 205274596 1.08
tpch_q04/datafusion:vortex-file-compressed 108773644 100653070 1.08
tpch_q05/datafusion:vortex-file-compressed 408925667 391248969 1.05
tpch_q06/datafusion:vortex-file-compressed 🚨 50344027 41451294 1.21
tpch_q07/datafusion:vortex-file-compressed 612335538 564627348 1.08
tpch_q08/datafusion:vortex-file-compressed 398608661 378438849 1.05
tpch_q09/datafusion:vortex-file-compressed 703342174 670576469 1.05
tpch_q10/datafusion:vortex-file-compressed 251126179 236220827 1.06
tpch_q11/datafusion:vortex-file-compressed 88899361 87661852 1.01
tpch_q12/datafusion:vortex-file-compressed 117386192 107487599 1.09
tpch_q13/datafusion:vortex-file-compressed 232335727 219923340 1.06
tpch_q14/datafusion:vortex-file-compressed 🚨 65189712 58006958 1.12
tpch_q15/datafusion:vortex-file-compressed 🚨 125888464 107520454 1.17
tpch_q16/datafusion:vortex-file-compressed 🚨 84373028 75874799 1.11
tpch_q17/datafusion:vortex-file-compressed 677658862 648858838 1.04
tpch_q18/datafusion:vortex-file-compressed 927653460 883944208 1.05
tpch_q19/datafusion:vortex-file-compressed 103472509 97397033 1.06
tpch_q20/datafusion:vortex-file-compressed 🚨 186242438 168734810 1.10
tpch_q21/datafusion:vortex-file-compressed 696609171 663915907 1.05
tpch_q22/datafusion:vortex-file-compressed 61858474 61322550 1.01
datafusion / vortex-compact (1.060x ➖, 0↑ 4↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 457520294 449016363 1.02
tpch_q02/datafusion:vortex-compact 125093771 119200669 1.05
tpch_q03/datafusion:vortex-compact 235416411 217195414 1.08
tpch_q04/datafusion:vortex-compact 125053194 122319559 1.02
tpch_q05/datafusion:vortex-compact 410821802 395226895 1.04
tpch_q06/datafusion:vortex-compact 🚨 73224876 63637817 1.15
tpch_q07/datafusion:vortex-compact 630766224 589740399 1.07
tpch_q08/datafusion:vortex-compact 411940505 385257993 1.07
tpch_q09/datafusion:vortex-compact 715218004 691204174 1.03
tpch_q10/datafusion:vortex-compact 288838697 274656033 1.05
tpch_q11/datafusion:vortex-compact 96030072 92153070 1.04
tpch_q12/datafusion:vortex-compact 177542722 168410838 1.05
tpch_q13/datafusion:vortex-compact 282403201 269712513 1.05
tpch_q14/datafusion:vortex-compact 🚨 83783102 74734574 1.12
tpch_q15/datafusion:vortex-compact 🚨 184301615 167457500 1.10
tpch_q16/datafusion:vortex-compact 88188132 82462420 1.07
tpch_q17/datafusion:vortex-compact 685264139 652504119 1.05
tpch_q18/datafusion:vortex-compact 937203815 892265748 1.05
tpch_q19/datafusion:vortex-compact 149116109 142784119 1.04
tpch_q20/datafusion:vortex-compact 🚨 216231066 196451644 1.10
tpch_q21/datafusion:vortex-compact 737615958 696262189 1.06
tpch_q22/datafusion:vortex-compact 71986358 71204363 1.01
datafusion / parquet (1.028x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 422843005 441433399 0.96
tpch_q02/datafusion:parquet 190220858 188204646 1.01
tpch_q03/datafusion:parquet 306323183 293233358 1.04
tpch_q04/datafusion:parquet 138989027 132656793 1.05
tpch_q05/datafusion:parquet 467170367 444865653 1.05
tpch_q06/datafusion:parquet 126410114 120072780 1.05
tpch_q07/datafusion:parquet 661939455 634170863 1.04
tpch_q08/datafusion:parquet 505756752 489396779 1.03
tpch_q09/datafusion:parquet 797741048 763140761 1.05
tpch_q10/datafusion:parquet 529968252 507424555 1.04
tpch_q11/datafusion:parquet 134655856 130794678 1.03
tpch_q12/datafusion:parquet 217374175 206632271 1.05
tpch_q13/datafusion:parquet 349786001 338160866 1.03
tpch_q14/datafusion:parquet 156447991 153866585 1.02
tpch_q15/datafusion:parquet 253751522 255910605 0.99
tpch_q16/datafusion:parquet 144078171 136386002 1.06
tpch_q17/datafusion:parquet 712185286 685303863 1.04
tpch_q18/datafusion:parquet 946696026 885041168 1.07
tpch_q19/datafusion:parquet 277578963 277341289 1.00
tpch_q20/datafusion:parquet 313681053 307676369 1.02
tpch_q21/datafusion:parquet 761037754 737137329 1.03
tpch_q22/datafusion:parquet 221718512 230383636 0.96
datafusion / arrow (1.064x ➖, 0↑ 2↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 638205442 592535191 1.08
tpch_q02/datafusion:arrow 168989810 164179061 1.03
tpch_q03/datafusion:arrow 493781891 454701111 1.09
tpch_q04/datafusion:arrow 372267528 347242647 1.07
tpch_q05/datafusion:arrow 958219785 913430651 1.05
tpch_q06/datafusion:arrow 294671937 270221024 1.09
tpch_q07/datafusion:arrow 1202110141 1138070661 1.06
tpch_q08/datafusion:arrow 1203970653 1132312477 1.06
tpch_q09/datafusion:arrow 1386541750 1333845629 1.04
tpch_q10/datafusion:arrow 640012013 595542345 1.07
tpch_q11/datafusion:arrow 152420516 151983535 1.00
tpch_q12/datafusion:arrow 700571894 660784383 1.06
tpch_q13/datafusion:arrow 537922715 517932791 1.04
tpch_q14/datafusion:arrow 🚨 349736205 306275878 1.14
tpch_q15/datafusion:arrow 🚨 746668240 656467679 1.14
tpch_q16/datafusion:arrow 110550778 108114333 1.02
tpch_q17/datafusion:arrow 1379709221 1310794892 1.05
tpch_q18/datafusion:arrow 1940300199 1812799187 1.07
tpch_q19/datafusion:arrow 532660424 507572968 1.05
tpch_q20/datafusion:arrow 528811275 485102384 1.09
tpch_q21/datafusion:arrow 2966716855 2827845150 1.05
tpch_q22/datafusion:arrow 148817413 140793730 1.06
duckdb / vortex-file-compressed (1.132x ❌, 0↑ 13↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 183467017 177809781 1.03
tpch_q02/duckdb:vortex-file-compressed 🚨 59495925 52374114 1.14
tpch_q03/duckdb:vortex-file-compressed 135234493 127652189 1.06
tpch_q04/duckdb:vortex-file-compressed 🚨 165307355 149968798 1.10
tpch_q05/duckdb:vortex-file-compressed 139088191 131822261 1.06
tpch_q06/duckdb:vortex-file-compressed 🚨 63023716 48418431 1.30
tpch_q07/duckdb:vortex-file-compressed 🚨 183088379 145282570 1.26
tpch_q08/duckdb:vortex-file-compressed 191191500 175266819 1.09
tpch_q09/duckdb:vortex-file-compressed 350404643 335962901 1.04
tpch_q10/duckdb:vortex-file-compressed 163970919 153711804 1.07
tpch_q11/duckdb:vortex-file-compressed 🚨 42588603 35062964 1.21
tpch_q12/duckdb:vortex-file-compressed 🚨 131306854 91018192 1.44
tpch_q13/duckdb:vortex-file-compressed 🚨 272240993 246538152 1.10
tpch_q14/duckdb:vortex-file-compressed 🚨 88211757 73108959 1.21
tpch_q15/duckdb:vortex-file-compressed 🚨 107776868 95894922 1.12
tpch_q16/duckdb:vortex-file-compressed 83043137 79016744 1.05
tpch_q17/duckdb:vortex-file-compressed 🚨 121230531 100368926 1.21
tpch_q18/duckdb:vortex-file-compressed 276901019 280096264 0.99
tpch_q19/duckdb:vortex-file-compressed 🚨 100678992 89882502 1.12
tpch_q20/duckdb:vortex-file-compressed 🚨 200597601 164688590 1.22
tpch_q21/duckdb:vortex-file-compressed 🚨 615674047 556481926 1.11
tpch_q22/duckdb:vortex-file-compressed 83267995 77930708 1.07
duckdb / vortex-compact (1.089x ➖, 0↑ 7↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 243261741 229692445 1.06
tpch_q02/duckdb:vortex-compact 62649228 58582730 1.07
tpch_q03/duckdb:vortex-compact 151808725 139724423 1.09
tpch_q04/duckdb:vortex-compact 189124683 175717969 1.08
tpch_q05/duckdb:vortex-compact 153294065 143632144 1.07
tpch_q06/duckdb:vortex-compact 🚨 98391893 85516719 1.15
tpch_q07/duckdb:vortex-compact 🚨 242003318 205399752 1.18
tpch_q08/duckdb:vortex-compact 206640250 191405366 1.08
tpch_q09/duckdb:vortex-compact 381431938 362620676 1.05
tpch_q10/duckdb:vortex-compact 198744267 187183700 1.06
tpch_q11/duckdb:vortex-compact 🚨 45659607 41180765 1.11
tpch_q12/duckdb:vortex-compact 🚨 243937984 208154488 1.17
tpch_q13/duckdb:vortex-compact 315550951 293910503 1.07
tpch_q14/duckdb:vortex-compact 🚨 123155093 104532812 1.18
tpch_q15/duckdb:vortex-compact 🚨 132088590 119700840 1.10
tpch_q16/duckdb:vortex-compact 87205213 87945397 0.99
tpch_q17/duckdb:vortex-compact 131609443 120044680 1.10
tpch_q18/duckdb:vortex-compact 290605782 294515058 0.99
tpch_q19/duckdb:vortex-compact 126241292 115539856 1.09
tpch_q20/duckdb:vortex-compact 🚨 245498762 208628693 1.18
tpch_q21/duckdb:vortex-compact 668839067 630954890 1.06
tpch_q22/duckdb:vortex-compact 94892853 89982467 1.05
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257032024 255228201 1.01
tpch_q02/duckdb:parquet 101673636 104926472 0.97
tpch_q03/duckdb:parquet 215523333 213987888 1.01
tpch_q04/duckdb:parquet 139070464 134891126 1.03
tpch_q05/duckdb:parquet 220717940 217258324 1.02
tpch_q06/duckdb:parquet 65063432 68046207 0.96
tpch_q07/duckdb:parquet 184622843 179171858 1.03
tpch_q08/duckdb:parquet 261499404 253065829 1.03
tpch_q09/duckdb:parquet 469989368 449281510 1.05
tpch_q10/duckdb:parquet 617950300 607683940 1.02
tpch_q11/duckdb:parquet 45709394 42896903 1.07
tpch_q12/duckdb:parquet 125890805 123478555 1.02
tpch_q13/duckdb:parquet 461639412 450570726 1.02
tpch_q14/duckdb:parquet 176014528 173919283 1.01
tpch_q15/duckdb:parquet 99987271 100925489 0.99
tpch_q16/duckdb:parquet 160245795 158938949 1.01
tpch_q17/duckdb:parquet 179891088 176266199 1.02
tpch_q18/duckdb:parquet 354856721 352139761 1.01
tpch_q19/duckdb:parquet 286092080 277867299 1.03
tpch_q20/duckdb:parquet 232308417 227580545 1.02
tpch_q21/duckdb:parquet 583294296 570271784 1.02
tpch_q22/duckdb:parquet 299304259 293253243 1.02
duckdb / duckdb (1.006x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117763435 117614572 1.00
tpch_q02/duckdb:duckdb 46030468 45887944 1.00
tpch_q03/duckdb:duckdb 99043575 99432116 1.00
tpch_q04/duckdb:duckdb 137550024 131904739 1.04
tpch_q05/duckdb:duckdb 112289286 110976399 1.01
tpch_q06/duckdb:duckdb 40294674 39741597 1.01
tpch_q07/duckdb:duckdb 88666445 88462253 1.00
tpch_q08/duckdb:duckdb 112107833 112686185 0.99
tpch_q09/duckdb:duckdb 284552559 280556196 1.01
tpch_q10/duckdb:duckdb 208140941 204637472 1.02
tpch_q11/duckdb:duckdb 15737173 15303244 1.03
tpch_q12/duckdb:duckdb 84778796 84189879 1.01
tpch_q13/duckdb:duckdb 256199444 253866343 1.01
tpch_q14/duckdb:duckdb 71502404 71887970 0.99
tpch_q15/duckdb:duckdb 79543603 80344339 0.99
tpch_q16/duckdb:duckdb 74660818 73874566 1.01
tpch_q17/duckdb:duckdb 85475964 84360256 1.01
tpch_q18/duckdb:duckdb 219077582 214871668 1.02
tpch_q19/duckdb:duckdb 116124461 117006587 0.99
tpch_q20/duckdb:duckdb 113412300 110726273 1.02
tpch_q21/duckdb:duckdb 305496953 311471490 0.98
tpch_q22/duckdb:duckdb 68357633 70294107 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +7.7% -1.8% +9.7% +11.2% ➖ noise
1 datafusion:vortex-compact +1.9% -1.8% +3.7% +12.6% ➖ noise
1 datafusion:vortex-file-compressed +8.5% -1.8% +10.5% +12.7% ➖ noise
1 duckdb:duckdb +0.1% -1.8% +1.9% +11.0% ➖ noise
1 duckdb:vortex-compact +5.9% -1.8% +7.8% +11.1% ➖ noise
1 duckdb:vortex-file-compressed +3.2% -1.8% +5.1% +11.7% ➖ noise
2 datafusion:arrow +2.9% -1.0% +4.0% +10.0% ➖ noise
2 datafusion:vortex-compact +4.9% -1.0% +6.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.3% -1.0% +6.4% +10.0% ➖ noise
2 duckdb:duckdb +0.3% -1.0% +1.4% +10.7% ➖ noise
2 duckdb:vortex-compact +6.9% -1.0% +8.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +13.6% -1.0% +14.8% +10.0% 🚨 regression
3 datafusion:arrow +8.6% +2.6% +5.9% +10.0% ➖ noise
3 datafusion:vortex-compact +8.4% +2.6% +5.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +7.9% +2.6% +5.1% +10.0% ➖ noise
3 duckdb:duckdb -0.4% +2.6% -2.9% +10.0% ➖ noise
3 duckdb:vortex-compact +8.6% +2.6% +5.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.9% +2.6% +3.3% +10.0% ➖ noise
4 datafusion:arrow +7.2% +3.9% +3.2% +10.0% ➖ noise
4 datafusion:vortex-compact +2.2% +3.9% -1.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +8.1% +3.9% +4.0% +10.0% ➖ noise
4 duckdb:duckdb +4.3% +3.9% +0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +7.6% +3.9% +3.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +10.2% +3.9% +6.1% +10.0% ➖ noise
5 datafusion:arrow +4.9% +3.3% +1.6% +10.0% ➖ noise
5 datafusion:vortex-compact +3.9% +3.3% +0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.5% +3.3% +1.2% +10.0% ➖ noise
5 duckdb:duckdb +1.2% +3.3% -2.0% +10.0% ➖ noise
5 duckdb:vortex-compact +6.7% +3.3% +3.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +5.5% +3.3% +2.2% +10.0% ➖ noise
6 datafusion:arrow +9.0% +0.3% +8.7% +10.0% ➖ noise
6 datafusion:vortex-compact +15.1% +0.3% +14.7% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +21.5% +0.3% +21.1% +10.1% 🚨 regression
6 duckdb:duckdb +1.4% +0.3% +1.1% +16.7% ➖ noise
6 duckdb:vortex-compact +15.1% +0.3% +14.7% +12.8% 🚨 regression
6 duckdb:vortex-file-compressed +30.2% +0.3% +29.7% +11.6% 🚨 regression
7 datafusion:arrow +5.6% +3.7% +1.9% +10.0% ➖ noise
7 datafusion:vortex-compact +7.0% +3.7% +3.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +8.4% +3.7% +4.6% +10.0% ➖ noise
7 duckdb:duckdb +0.2% +3.7% -3.4% +10.4% ➖ noise
7 duckdb:vortex-compact +17.8% +3.7% +13.6% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +26.0% +3.7% +21.5% +10.0% 🚨 regression
8 datafusion:arrow +6.3% +3.3% +2.9% +10.0% ➖ noise
8 datafusion:vortex-compact +6.9% +3.3% +3.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +5.3% +3.3% +1.9% +10.0% ➖ noise
8 duckdb:duckdb -0.5% +3.3% -3.7% +10.0% ➖ noise
8 duckdb:vortex-compact +8.0% +3.3% +4.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +9.1% +3.3% +5.6% +10.0% ➖ noise
9 datafusion:arrow +4.0% +4.6% -0.6% +10.0% ➖ noise
9 datafusion:vortex-compact +3.5% +4.6% -1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.9% +4.6% +0.3% +10.0% ➖ noise
9 duckdb:duckdb +1.4% +4.6% -3.0% +10.0% ➖ noise
9 duckdb:vortex-compact +5.2% +4.6% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.3% +4.6% -0.3% +10.0% ➖ noise
10 datafusion:arrow +7.5% +3.1% +4.3% +10.0% ➖ noise
10 datafusion:vortex-compact +5.2% +3.1% +2.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +6.3% +3.1% +3.2% +10.0% ➖ noise
10 duckdb:duckdb +1.7% +3.1% -1.3% +10.0% ➖ noise
10 duckdb:vortex-compact +6.2% +3.1% +3.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +6.7% +3.1% +3.5% +10.0% ➖ noise
11 datafusion:arrow +0.3% +4.7% -4.2% +10.0% ➖ noise
11 datafusion:vortex-compact +4.2% +4.7% -0.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +4.7% -3.2% +10.1% ➖ noise
11 duckdb:duckdb +2.8% +4.7% -1.8% +15.6% ➖ noise
11 duckdb:vortex-compact +10.9% +4.7% +5.9% +12.6% ➖ noise
11 duckdb:vortex-file-compressed +21.5% +4.7% +16.0% +12.2% 🚨 regression
12 datafusion:arrow +6.0% +3.6% +2.4% +44.3% ➖ noise
12 datafusion:vortex-compact +5.4% +3.6% +1.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +9.2% +3.6% +5.5% +10.0% ➖ noise
12 duckdb:duckdb +0.7% +3.6% -2.8% +10.0% ➖ noise
12 duckdb:vortex-compact +17.2% +3.6% +13.2% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +44.3% +3.6% +39.3% +10.0% 🚨 regression
13 datafusion:arrow +3.9% +2.9% +0.9% +10.0% ➖ noise
13 datafusion:vortex-compact +4.7% +2.9% +1.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +5.6% +2.9% +2.6% +10.0% ➖ noise
13 duckdb:duckdb +0.9% +2.9% -2.0% +10.0% ➖ noise
13 duckdb:vortex-compact +7.4% +2.9% +4.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +10.4% +2.9% +7.3% +10.0% ➖ noise
14 datafusion:arrow +14.2% +1.4% +12.6% +10.0% 🚨 regression
14 datafusion:vortex-compact +12.1% +1.4% +10.5% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +12.4% +1.4% +10.8% +12.5% ➖ noise
14 duckdb:duckdb -0.5% +1.4% -1.9% +10.0% ➖ noise
14 duckdb:vortex-compact +17.8% +1.4% +16.1% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +20.7% +1.4% +18.9% +10.0% 🚨 regression
15 datafusion:arrow +13.7% -0.9% +14.8% +10.0% 🚨 regression
15 datafusion:vortex-compact +10.1% -0.9% +11.0% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +17.1% -0.9% +18.1% +10.0% 🚨 regression
15 duckdb:duckdb -1.0% -0.9% -0.1% +10.0% ➖ noise
15 duckdb:vortex-compact +10.3% -0.9% +11.3% +10.0% 🚨 regression
15 duckdb:vortex-file-compressed +12.4% -0.9% +13.4% +10.0% 🚨 regression
16 datafusion:arrow +2.3% +3.2% -0.9% +10.0% ➖ noise
16 datafusion:vortex-compact +6.9% +3.2% +3.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +11.2% +3.2% +7.7% +11.3% ➖ noise
16 duckdb:duckdb +1.1% +3.2% -2.1% +10.0% ➖ noise
16 duckdb:vortex-compact -0.8% +3.2% -3.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +5.1% +3.2% +1.8% +10.0% ➖ noise
17 datafusion:arrow +5.3% +3.0% +2.2% +10.0% ➖ noise
17 datafusion:vortex-compact +5.0% +3.0% +2.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +4.4% +3.0% +1.4% +10.0% ➖ noise
17 duckdb:duckdb +1.3% +3.0% -1.6% +10.0% ➖ noise
17 duckdb:vortex-compact +9.6% +3.0% +6.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +20.8% +3.0% +17.3% +10.0% 🚨 regression
18 datafusion:arrow +7.0% +3.8% +3.1% +10.0% ➖ noise
18 datafusion:vortex-compact +5.0% +3.8% +1.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.9% +3.8% +1.1% +10.0% ➖ noise
18 duckdb:duckdb +2.0% +3.8% -1.8% +10.0% ➖ noise
18 duckdb:vortex-compact -1.3% +3.8% -5.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.1% +3.8% -4.8% +10.0% ➖ noise
19 datafusion:arrow +4.9% +1.5% +3.4% +10.0% ➖ noise
19 datafusion:vortex-compact +4.4% +1.5% +2.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.2% +1.5% +4.7% +10.0% ➖ noise
19 duckdb:duckdb -0.8% +1.5% -2.2% +10.0% ➖ noise
19 duckdb:vortex-compact +9.3% +1.5% +7.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +12.0% +1.5% +10.3% +10.0% 🚨 regression
20 datafusion:arrow +9.0% +2.0% +6.9% +10.0% ➖ noise
20 datafusion:vortex-compact +10.1% +2.0% +7.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +10.4% +2.0% +8.2% +10.0% ➖ noise
20 duckdb:duckdb +2.4% +2.0% +0.4% +10.0% ➖ noise
20 duckdb:vortex-compact +17.7% +2.0% +15.3% +10.0% 🚨 regression
20 duckdb:vortex-file-compressed +21.8% +2.0% +19.4% +10.0% 🚨 regression
21 datafusion:arrow +4.9% +2.8% +2.1% +10.0% ➖ noise
21 datafusion:vortex-compact +5.9% +2.8% +3.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.9% +2.8% +2.1% +10.0% ➖ noise
21 duckdb:duckdb -1.9% +2.8% -4.6% +10.0% ➖ noise
21 duckdb:vortex-compact +6.0% +2.8% +3.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +10.6% +2.8% +7.7% +10.0% ➖ noise
22 datafusion:arrow +5.7% -0.9% +6.6% +10.0% ➖ noise
22 datafusion:vortex-compact +1.1% -0.9% +2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.9% -0.9% +1.8% +10.0% ➖ noise
22 duckdb:duckdb -2.8% -0.9% -1.9% +10.0% ➖ noise
22 duckdb:vortex-compact +5.5% -0.9% +6.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +6.8% -0.9% +7.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +21.1%
Vortex (geomean): 1.253x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +18.7%


datafusion / vortex-file-compressed (1.176x ➖, 1↑ 8↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 170412517 207957267 0.82
tpch_q02/datafusion:vortex-file-compressed 517356654 430756634 1.20
tpch_q03/datafusion:vortex-file-compressed 404909161 367867404 1.10
tpch_q04/datafusion:vortex-file-compressed 🚨 261953254 190010943 1.38
tpch_q05/datafusion:vortex-file-compressed 384327057 510103820 0.75
tpch_q06/datafusion:vortex-file-compressed 299935521 351162688 0.85
tpch_q07/datafusion:vortex-file-compressed 527626842 607867593 0.87
tpch_q08/datafusion:vortex-file-compressed 691284933 776850553 0.89
tpch_q09/datafusion:vortex-file-compressed 🚨 501508607 342962840 1.46
tpch_q10/datafusion:vortex-file-compressed 517119261 520639892 0.99
tpch_q11/datafusion:vortex-file-compressed 🚀 318646718 468918377 0.68
tpch_q12/datafusion:vortex-file-compressed 391886946 447543010 0.88
tpch_q13/datafusion:vortex-file-compressed 265962074 209962156 1.27
tpch_q14/datafusion:vortex-file-compressed 🚨 360689168 191205003 1.89
tpch_q15/datafusion:vortex-file-compressed 🚨 429345980 298060631 1.44
tpch_q16/datafusion:vortex-file-compressed 🚨 346707280 191950530 1.81
tpch_q17/datafusion:vortex-file-compressed 359096522 332766442 1.08
tpch_q18/datafusion:vortex-file-compressed 369490062 324969059 1.14
tpch_q19/datafusion:vortex-file-compressed 449624712 391292909 1.15
tpch_q20/datafusion:vortex-file-compressed 🚨 825279627 335922225 2.46
tpch_q21/datafusion:vortex-file-compressed 🚨 824729729 515779472 1.60
tpch_q22/datafusion:vortex-file-compressed 🚨 247143308 154102129 1.60
datafusion / vortex-compact (1.410x ❌, 0↑ 10↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 231366974 272807747 0.85
tpch_q02/datafusion:vortex-compact 🚨 598513297 429962713 1.39
tpch_q03/datafusion:vortex-compact 463819876 405232402 1.14
tpch_q04/datafusion:vortex-compact 283597401 298570486 0.95
tpch_q05/datafusion:vortex-compact 419844838 412532946 1.02
tpch_q06/datafusion:vortex-compact 🚨 438048383 290069075 1.51
tpch_q07/datafusion:vortex-compact 587681994 524814584 1.12
tpch_q08/datafusion:vortex-compact 🚨 882129169 523822083 1.68
tpch_q09/datafusion:vortex-compact 🚨 692517213 393002456 1.76
tpch_q10/datafusion:vortex-compact 🚨 1074470139 438127765 2.45
tpch_q11/datafusion:vortex-compact 🚨 610056114 254562408 2.40
tpch_q12/datafusion:vortex-compact 🚨 648625189 411656216 1.58
tpch_q13/datafusion:vortex-compact 246713143 208403260 1.18
tpch_q14/datafusion:vortex-compact 308675739 242819686 1.27
tpch_q15/datafusion:vortex-compact 506018527 459708825 1.10
tpch_q16/datafusion:vortex-compact 🚨 299953967 176017156 1.70
tpch_q17/datafusion:vortex-compact 422282758 340734711 1.24
tpch_q18/datafusion:vortex-compact 320724703 283755312 1.13
tpch_q19/datafusion:vortex-compact 🚨 770495105 453178634 1.70
tpch_q20/datafusion:vortex-compact 566678809 470364152 1.20
tpch_q21/datafusion:vortex-compact 657960735 510222242 1.29
tpch_q22/datafusion:vortex-compact 🚨 404853808 133972838 3.02
datafusion / parquet (1.013x ➖, 1↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 209049770 209170111 1.00
tpch_q02/datafusion:parquet 🚀 421182106 649402346 0.65
tpch_q03/datafusion:parquet 377673097 355726454 1.06
tpch_q04/datafusion:parquet 139934705 160451760 0.87
tpch_q05/datafusion:parquet 477733067 450949806 1.06
tpch_q06/datafusion:parquet 144140379 186585053 0.77
tpch_q07/datafusion:parquet 502773536 514291185 0.98
tpch_q08/datafusion:parquet 613233565 577285122 1.06
tpch_q09/datafusion:parquet 564746976 506837303 1.11
tpch_q10/datafusion:parquet 554393228 530389621 1.05
tpch_q11/datafusion:parquet 344478481 354162562 0.97
tpch_q12/datafusion:parquet 249112733 261667232 0.95
tpch_q13/datafusion:parquet 439519622 432891103 1.02
tpch_q14/datafusion:parquet 178013973 161074221 1.11
tpch_q15/datafusion:parquet 🚨 407948546 279367317 1.46
tpch_q16/datafusion:parquet 196234788 173896359 1.13
tpch_q17/datafusion:parquet 377380378 341562950 1.10
tpch_q18/datafusion:parquet 474995527 435484184 1.09
tpch_q19/datafusion:parquet 304489813 299942350 1.02
tpch_q20/datafusion:parquet 325275570 303587727 1.07
tpch_q21/datafusion:parquet 513113218 564354811 0.91
tpch_q22/datafusion:parquet 125208049 115419850 1.08
duckdb / vortex-file-compressed (1.200x ➖, 0↑ 7↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 222988911 294200322 0.76
tpch_q02/duckdb:vortex-file-compressed 🚨 1620438627 1011850088 1.60
tpch_q03/duckdb:vortex-file-compressed 755674650 667455444 1.13
tpch_q04/duckdb:vortex-file-compressed 🚨 542158547 344052636 1.58
tpch_q05/duckdb:vortex-file-compressed 1166358220 906605312 1.29
tpch_q06/duckdb:vortex-file-compressed 578187969 489423971 1.18
tpch_q07/duckdb:vortex-file-compressed 936409669 868421200 1.08
tpch_q08/duckdb:vortex-file-compressed 🚨 1485533284 962162050 1.54
tpch_q09/duckdb:vortex-file-compressed 1077948884 1041278836 1.04
tpch_q10/duckdb:vortex-file-compressed 796948725 748902356 1.06
tpch_q11/duckdb:vortex-file-compressed 🚨 686010229 501495525 1.37
tpch_q12/duckdb:vortex-file-compressed 🚨 793747602 484782276 1.64
tpch_q13/duckdb:vortex-file-compressed 514669038 459449015 1.12
tpch_q14/duckdb:vortex-file-compressed 545747437 482573813 1.13
tpch_q15/duckdb:vortex-file-compressed 280314007 301659182 0.93
tpch_q16/duckdb:vortex-file-compressed 🚨 474220203 359925040 1.32
tpch_q17/duckdb:vortex-file-compressed 726078375 584645073 1.24
tpch_q18/duckdb:vortex-file-compressed 457680164 494818731 0.92
tpch_q19/duckdb:vortex-file-compressed 486169071 470343100 1.03
tpch_q20/duckdb:vortex-file-compressed 1108782587 868310476 1.28
tpch_q21/duckdb:vortex-file-compressed 1403048554 1118727497 1.25
tpch_q22/duckdb:vortex-file-compressed 🚨 490356163 353558861 1.39
duckdb / vortex-compact (1.239x ➖, 0↑ 8↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 347028472 366472046 0.95
tpch_q02/duckdb:vortex-compact 🚨 1439193085 1082448342 1.33
tpch_q03/duckdb:vortex-compact 770401723 618576823 1.25
tpch_q04/duckdb:vortex-compact 423566937 366909195 1.15
tpch_q05/duckdb:vortex-compact 1054656360 892855995 1.18
tpch_q06/duckdb:vortex-compact 🚨 598494826 442768979 1.35
tpch_q07/duckdb:vortex-compact 🚨 968974974 631264394 1.53
tpch_q08/duckdb:vortex-compact 1164039513 935189454 1.24
tpch_q09/duckdb:vortex-compact 🚨 1242435759 931268308 1.33
tpch_q10/duckdb:vortex-compact 816606429 692150420 1.18
tpch_q11/duckdb:vortex-compact 558191191 453531833 1.23
tpch_q12/duckdb:vortex-compact 🚨 727544310 464336246 1.57
tpch_q13/duckdb:vortex-compact 398812078 478069260 0.83
tpch_q14/duckdb:vortex-compact 652301102 561164537 1.16
tpch_q15/duckdb:vortex-compact 🚨 506903078 288019725 1.76
tpch_q16/duckdb:vortex-compact 🚨 574292115 381231026 1.51
tpch_q17/duckdb:vortex-compact 🚨 788494599 594336787 1.33
tpch_q18/duckdb:vortex-compact 480446790 495863842 0.97
tpch_q19/duckdb:vortex-compact 509509871 424055784 1.20
tpch_q20/duckdb:vortex-compact 903440028 776516404 1.16
tpch_q21/duckdb:vortex-compact 1333930572 1191267181 1.12
tpch_q22/duckdb:vortex-compact 458345314 354385649 1.29
duckdb / parquet (1.058x ➖, 0↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 490280806 569718274 0.86
tpch_q02/duckdb:parquet 1476762133 1454225930 1.02
tpch_q03/duckdb:parquet 1250822078 1037124473 1.21
tpch_q04/duckdb:parquet 697226165 632526234 1.10
tpch_q05/duckdb:parquet 1426249247 1549807905 0.92
tpch_q06/duckdb:parquet 447602482 553930022 0.81
tpch_q07/duckdb:parquet 1439656674 1190372183 1.21
tpch_q08/duckdb:parquet 1763668075 1700684157 1.04
tpch_q09/duckdb:parquet 1477599394 1512945314 0.98
tpch_q10/duckdb:parquet 1262502156 1500715260 0.84
tpch_q11/duckdb:parquet 1023321777 844894974 1.21
tpch_q12/duckdb:parquet 666886842 608850852 1.10
tpch_q13/duckdb:parquet 981722421 921704816 1.07
tpch_q14/duckdb:parquet 🚨 821084214 606533467 1.35
tpch_q15/duckdb:parquet 507958061 544786609 0.93
tpch_q16/duckdb:parquet 611904879 602338288 1.02
tpch_q17/duckdb:parquet 824398672 800018563 1.03
tpch_q18/duckdb:parquet 1004554746 888828872 1.13
tpch_q19/duckdb:parquet 938172634 767634632 1.22
tpch_q20/duckdb:parquet 1172041452 1069046590 1.10
tpch_q21/duckdb:parquet 1380572739 1186247180 1.16
tpch_q22/duckdb:parquet 629425371 530882713 1.19
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -15.2% -7.3% -8.6% +149.0% ➖ noise
1 datafusion:vortex-file-compressed -18.1% -7.3% -11.6% +183.6% ➖ noise
1 duckdb:vortex-compact -5.3% -7.3% +2.1% +62.4% ➖ noise
1 duckdb:vortex-file-compressed -24.2% -7.3% -18.3% +48.7% ➖ noise
2 datafusion:vortex-compact +39.2% -18.8% +71.5% +54.0% 🚨 regression
2 datafusion:vortex-file-compressed +20.1% -18.8% +48.0% +47.5% 🚨 regression
2 duckdb:vortex-compact +33.0% -18.8% +63.8% +36.8% 🚨 regression
2 duckdb:vortex-file-compressed +60.1% -18.8% +97.3% +51.0% 🚨 regression
3 datafusion:vortex-compact +14.5% +13.2% +1.1% +81.6% ➖ noise
3 datafusion:vortex-file-compressed +10.1% +13.2% -2.7% +93.4% ➖ noise
3 duckdb:vortex-compact +24.5% +13.2% +10.1% +43.2% ➖ noise
3 duckdb:vortex-file-compressed +13.2% +13.2% +0.1% +36.6% ➖ noise
4 datafusion:vortex-compact -5.0% -2.0% -3.1% +103.7% ➖ noise
4 datafusion:vortex-file-compressed +37.9% -2.0% +40.6% +31.5% 🚨 regression
4 duckdb:vortex-compact +15.4% -2.0% +17.7% +35.0% ➖ noise
4 duckdb:vortex-file-compressed +57.6% -2.0% +60.7% +31.5% 🚨 regression
5 datafusion:vortex-compact +1.8% -1.3% +3.1% +33.5% ➖ noise
5 datafusion:vortex-file-compressed -24.7% -1.3% -23.7% +31.5% ➖ noise
5 duckdb:vortex-compact +18.1% -1.3% +19.6% +31.5% ➖ noise
5 duckdb:vortex-file-compressed +28.7% -1.3% +30.3% +40.6% ➖ noise
6 datafusion:vortex-compact +51.0% -21.0% +91.1% +45.8% 🚨 regression
6 datafusion:vortex-file-compressed -14.6% -21.0% +8.1% +39.3% ➖ noise
6 duckdb:vortex-compact +35.2% -21.0% +71.1% +54.3% 🚨 regression
6 duckdb:vortex-file-compressed +18.1% -21.0% +49.5% +48.8% 🚨 regression
7 datafusion:vortex-compact +12.0% +8.7% +3.0% +43.1% ➖ noise
7 datafusion:vortex-file-compressed -13.2% +8.7% -20.2% +44.3% ➖ noise
7 duckdb:vortex-compact +53.5% +8.7% +41.2% +31.5% 🚨 regression
7 duckdb:vortex-file-compressed +7.8% +8.7% -0.8% +31.5% ➖ noise
8 datafusion:vortex-compact +68.4% +5.0% +60.4% +36.6% 🚨 regression
8 datafusion:vortex-file-compressed -11.0% +5.0% -15.2% +32.5% ➖ noise
8 duckdb:vortex-compact +24.5% +5.0% +18.6% +31.5% ➖ noise
8 duckdb:vortex-file-compressed +54.4% +5.0% +47.1% +31.5% 🚨 regression
9 datafusion:vortex-compact +76.2% +4.3% +68.9% +31.5% 🚨 regression
9 datafusion:vortex-file-compressed +46.2% +4.3% +40.2% +34.5% 🚨 regression
9 duckdb:vortex-compact +33.4% +4.3% +27.9% +31.5% ➖ noise
9 duckdb:vortex-file-compressed +3.5% +4.3% -0.8% +61.8% ➖ noise
10 datafusion:vortex-compact +145.2% -6.2% +161.5% +37.1% 🚨 regression
10 datafusion:vortex-file-compressed -0.7% -6.2% +5.9% +41.5% ➖ noise
10 duckdb:vortex-compact +18.0% -6.2% +25.8% +31.5% ➖ noise
10 duckdb:vortex-file-compressed +6.4% -6.2% +13.5% +31.5% ➖ noise
11 datafusion:vortex-compact +139.6% +8.5% +120.8% +35.6% 🚨 regression
11 datafusion:vortex-file-compressed -32.0% +8.5% -37.4% +33.0% ✅ faster
11 duckdb:vortex-compact +23.1% +8.5% +13.4% +31.5% ➖ noise
11 duckdb:vortex-file-compressed +36.8% +8.5% +26.0% +31.5% ➖ noise
12 datafusion:vortex-compact +57.6% +2.1% +54.3% +31.5% 🚨 regression
12 datafusion:vortex-file-compressed -12.4% +2.1% -14.3% +36.3% ➖ noise
12 duckdb:vortex-compact +56.7% +2.1% +53.4% +31.5% 🚨 regression
12 duckdb:vortex-file-compressed +63.7% +2.1% +60.3% +31.5% 🚨 regression
13 datafusion:vortex-compact +18.4% +4.0% +13.8% +57.3% ➖ noise
13 datafusion:vortex-file-compressed +26.7% +4.0% +21.8% +36.8% ➖ noise
13 duckdb:vortex-compact -16.6% +4.0% -19.8% +31.5% ➖ noise
13 duckdb:vortex-file-compressed +12.0% +4.0% +7.7% +34.3% ➖ noise
14 datafusion:vortex-compact +27.1% +22.3% +3.9% +53.3% ➖ noise
14 datafusion:vortex-file-compressed +88.6% +22.3% +54.2% +31.5% 🚨 regression
14 duckdb:vortex-compact +16.2% +22.3% -5.0% +48.4% ➖ noise
14 duckdb:vortex-file-compressed +13.1% +22.3% -7.5% +31.5% ➖ noise
15 datafusion:vortex-compact +10.1% +16.7% -5.7% +31.5% ➖ noise
15 datafusion:vortex-file-compressed +44.0% +16.7% +23.4% +41.0% ➖ noise
15 duckdb:vortex-compact +76.0% +16.7% +50.8% +67.4% ➖ noise
15 duckdb:vortex-file-compressed -7.1% +16.7% -20.4% +46.3% ➖ noise
16 datafusion:vortex-compact +70.4% +7.1% +59.2% +31.5% 🚨 regression
16 datafusion:vortex-file-compressed +80.6% +7.1% +68.7% +60.8% 🚨 regression
16 duckdb:vortex-compact +50.6% +7.1% +40.7% +31.5% 🚨 regression
16 duckdb:vortex-file-compressed +31.8% +7.1% +23.1% +31.5% ➖ noise
17 datafusion:vortex-compact +23.9% +6.7% +16.1% +31.5% ➖ noise
17 datafusion:vortex-file-compressed +7.9% +6.7% +1.1% +35.2% ➖ noise
17 duckdb:vortex-compact +32.7% +6.7% +24.3% +63.1% ➖ noise
17 duckdb:vortex-file-compressed +24.2% +6.7% +16.4% +31.5% ➖ noise
18 datafusion:vortex-compact +13.0% +11.0% +1.8% +31.5% ➖ noise
18 datafusion:vortex-file-compressed +13.7% +11.0% +2.4% +31.5% ➖ noise
18 duckdb:vortex-compact -3.1% +11.0% -12.7% +31.5% ➖ noise
18 duckdb:vortex-file-compressed -7.5% +11.0% -16.7% +31.5% ➖ noise
19 datafusion:vortex-compact +70.0% +11.4% +52.6% +52.6% 🚨 regression
19 datafusion:vortex-file-compressed +14.9% +11.4% +3.2% +31.5% ➖ noise
19 duckdb:vortex-compact +20.2% +11.4% +7.9% +31.5% ➖ noise
19 duckdb:vortex-file-compressed +3.4% +11.4% -7.2% +31.5% ➖ noise
20 datafusion:vortex-compact +20.5% +8.4% +11.2% +31.5% ➖ noise
20 datafusion:vortex-file-compressed +145.7% +8.4% +126.7% +39.8% 🚨 regression
20 duckdb:vortex-compact +16.3% +8.4% +7.3% +31.5% ➖ noise
20 duckdb:vortex-file-compressed +27.7% +8.4% +17.8% +31.5% ➖ noise
21 datafusion:vortex-compact +29.0% +2.9% +25.4% +32.7% ➖ noise
21 datafusion:vortex-file-compressed +59.9% +2.9% +55.4% +31.5% 🚨 regression
21 duckdb:vortex-compact +12.0% +2.9% +8.9% +32.0% ➖ noise
21 duckdb:vortex-file-compressed +25.4% +2.9% +21.9% +31.5% ➖ noise
22 datafusion:vortex-compact +202.2% +13.4% +166.5% +38.9% 🚨 regression
22 datafusion:vortex-file-compressed +60.4% +13.4% +41.4% +31.5% 🚨 regression
22 duckdb:vortex-compact +29.3% +13.4% +14.0% +31.5% ➖ noise
22 duckdb:vortex-file-compressed +38.7% +13.4% +22.3% +31.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.9%
Vortex (geomean): 0.960x ➖
Parquet (geomean): 1.054x ➖
Shifts: Parquet (control) +5.4% · Median polish +4.3%


datafusion / vortex-file-compressed (1.131x ➖, 1↑ 4↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 39362907 28894812 1.36
fineweb_q01/datafusion:vortex-file-compressed 745805251 728387746 1.02
fineweb_q02/datafusion:vortex-file-compressed 434119173 593799142 0.73
fineweb_q03/datafusion:vortex-file-compressed 🚨 2815317939 1330651471 2.12
fineweb_q04/datafusion:vortex-file-compressed 🚨 2805763243 1362788834 2.06
fineweb_q05/datafusion:vortex-file-compressed 🚨 2714991260 1333893205 2.04
fineweb_q06/datafusion:vortex-file-compressed 1503335833 1461870099 1.03
fineweb_q07/datafusion:vortex-file-compressed 1410229155 1392458675 1.01
fineweb_q08/datafusion:vortex-file-compressed 🚀 173234225 538369889 0.32
datafusion / vortex-compact (0.747x ➖, 2↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 37037329 38444857 0.96
fineweb_q01/datafusion:vortex-compact 407382650 571742896 0.71
fineweb_q02/datafusion:vortex-compact 🚀 462660198 933180940 0.50
fineweb_q03/datafusion:vortex-compact 2218286362 1846746759 1.20
fineweb_q04/datafusion:vortex-compact 2407284329 2248074173 1.07
fineweb_q05/datafusion:vortex-compact 1998790016 1686476282 1.19
fineweb_q06/datafusion:vortex-compact 1418154253 1443453103 0.98
fineweb_q07/datafusion:vortex-compact 1253760654 1329457313 0.94
fineweb_q08/datafusion:vortex-compact 🚀 65719494 433826255 0.15
datafusion / parquet (1.068x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1247511416 1015950815 1.23
fineweb_q01/datafusion:parquet 1936620985 1761103645 1.10
fineweb_q02/datafusion:parquet 1739638688 1722226127 1.01
fineweb_q03/datafusion:parquet 1913780258 1760403930 1.09
fineweb_q04/datafusion:parquet 2261311370 1800607219 1.26
fineweb_q05/datafusion:parquet 1822601795 2048245413 0.89
fineweb_q06/datafusion:parquet 2090640324 1885313098 1.11
fineweb_q07/datafusion:parquet 1932022805 2031721277 0.95
fineweb_q08/datafusion:parquet 2036460220 1976187743 1.03
duckdb / vortex-file-compressed (1.095x ➖, 1↑ 4↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 110110049 74810555 1.47
fineweb_q01/duckdb:vortex-file-compressed 499208848 529959416 0.94
fineweb_q02/duckdb:vortex-file-compressed 469041425 487770599 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 2859651743 1523303861 1.88
fineweb_q04/duckdb:vortex-file-compressed 🚨 2885815335 1506357343 1.92
fineweb_q05/duckdb:vortex-file-compressed 🚨 2729866530 1420972166 1.92
fineweb_q06/duckdb:vortex-file-compressed 1649055311 1603994696 1.03
fineweb_q07/duckdb:vortex-file-compressed 1469554979 1456660877 1.01
fineweb_q08/duckdb:vortex-file-compressed 🚀 151746246 638125595 0.24
duckdb / vortex-compact (0.919x ➖, 2↑ 3↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 82986273 84599890 0.98
fineweb_q01/duckdb:vortex-compact 394824543 528304533 0.75
fineweb_q02/duckdb:vortex-compact 🚀 422237475 653178095 0.65
fineweb_q03/duckdb:vortex-compact 🚨 2339387996 1680685010 1.39
fineweb_q04/duckdb:vortex-compact 🚨 2512961275 1719188651 1.46
fineweb_q05/duckdb:vortex-compact 🚨 2330909880 1525734603 1.53
fineweb_q06/duckdb:vortex-compact 1379542616 1426525037 0.97
fineweb_q07/duckdb:vortex-compact 1341569102 1395045246 0.96
fineweb_q08/duckdb:vortex-compact 🚀 163068368 479740220 0.34
duckdb / parquet (1.040x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1174554615 1052510083 1.12
fineweb_q01/duckdb:parquet 1726755513 1635960363 1.06
fineweb_q02/duckdb:parquet 1618012519 1606270930 1.01
fineweb_q03/duckdb:parquet 4212146009 4100701676 1.03
fineweb_q04/duckdb:parquet 1879898548 1835747906 1.02
fineweb_q05/duckdb:parquet 2847226658 2549323970 1.12
fineweb_q06/duckdb:parquet 3396209859 3290400118 1.03
fineweb_q07/duckdb:parquet 4017419771 3976703313 1.01
fineweb_q08/duckdb:parquet 1071730781 1091777602 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -3.7% +17.1% -17.7% +168.5% ➖ noise
0 datafusion:vortex-file-compressed +36.2% +17.1% +16.4% +213.2% ➖ noise
0 duckdb:vortex-compact -1.9% +17.1% -16.2% +86.9% ➖ noise
0 duckdb:vortex-file-compressed +47.2% +17.1% +25.7% +64.7% ➖ noise
1 datafusion:vortex-compact -28.7% +7.7% -33.9% +70.4% ➖ noise
1 datafusion:vortex-file-compressed +2.4% +7.7% -5.0% +65.2% ➖ noise
1 duckdb:vortex-compact -25.3% +7.7% -30.6% +49.2% ➖ noise
1 duckdb:vortex-file-compressed -5.8% +7.7% -12.6% +30.0% ➖ noise
2 datafusion:vortex-compact -50.4% +0.9% -50.8% +30.0% ✅ faster
2 datafusion:vortex-file-compressed -26.9% +0.9% -27.5% +95.6% ➖ noise
2 duckdb:vortex-compact -35.4% +0.9% -35.9% +30.0% ✅ faster
2 duckdb:vortex-file-compressed -3.8% +0.9% -4.7% +30.0% ➖ noise
3 datafusion:vortex-compact +20.1% +5.7% +13.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +111.6% +5.7% +100.2% +30.0% 🚨 regression
3 duckdb:vortex-compact +39.2% +5.7% +31.7% +30.0% 🚨 regression
3 duckdb:vortex-file-compressed +87.7% +5.7% +77.6% +30.0% 🚨 regression
4 datafusion:vortex-compact +7.1% +13.4% -5.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +105.9% +13.4% +81.5% +30.0% 🚨 regression
4 duckdb:vortex-compact +46.2% +13.4% +28.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +91.6% +13.4% +68.9% +30.0% 🚨 regression
5 datafusion:vortex-compact +18.5% -0.3% +18.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +103.5% -0.3% +104.2% +30.0% 🚨 regression
5 duckdb:vortex-compact +52.8% -0.3% +53.2% +30.0% 🚨 regression
5 duckdb:vortex-file-compressed +92.1% -0.3% +92.7% +30.0% 🚨 regression
6 datafusion:vortex-compact -1.8% +7.0% -8.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.8% +7.0% -3.9% +30.0% ➖ noise
6 duckdb:vortex-compact -3.3% +7.0% -9.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.8% +7.0% -3.9% +30.0% ➖ noise
7 datafusion:vortex-compact -5.7% -2.0% -3.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.3% -2.0% +3.3% +32.4% ➖ noise
7 duckdb:vortex-compact -3.8% -2.0% -1.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.9% -2.0% +2.9% +30.0% ➖ noise
8 datafusion:vortex-compact -84.9% +0.6% -84.9% +30.0% ✅ faster
8 datafusion:vortex-file-compressed -67.8% +0.6% -68.0% +30.0% ✅ faster
8 duckdb:vortex-compact -66.0% +0.6% -66.2% +31.0% ✅ faster
8 duckdb:vortex-file-compressed -76.2% +0.6% -76.4% +30.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Random Access

Vortex (geomean): 0.861x ✅
Parquet (geomean): 1.014x ➖


unknown / unknown (0.942x ➖, 10↑ 2↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2601803 4423773 0.59
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1291025 1293835 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11609346112 11564884186 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11273744456 11282702116 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7780213 8592948 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6459275 6819153 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 1456714 1498694 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2373879 2415822 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11258024704 11290430478 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11236265919 11358126270 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12564579 13973440 0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12789293 13979986 0.91
random-access/lance-tokio-local-disk 750723 754405 1.00
random-access/lance-tokio-local-disk-footer 1345282 1366736 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 271620 270766 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 714848 720992 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 141238157 145766340 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138034225 142408790 0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 674954 912066 0.74
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 734643 822537 0.89
random-access/nested-lists/uniform/lance-tokio-local-disk 1171806 1203068 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1658979 1710049 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 135821301 142593822 0.95
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 137873378 141917550 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk 2390316 2504314 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2471474 2673815 0.92
random-access/nested-structs/correlated/lance-tokio-local-disk 431375 439858 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 634557 651357 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 26716803 24736024 1.08
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 27575398 24378287 1.13
random-access/nested-structs/correlated/vortex-tokio-local-disk 879016 878408 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 926652 905993 1.02
random-access/nested-structs/uniform/lance-tokio-local-disk 2842003 2959354 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3093112 3211000 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 26767117 24509825 1.09
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 27717119 24929153 1.11
random-access/nested-structs/uniform/vortex-tokio-local-disk 1713160 1853945 0.92
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1706440 1888796 0.90
random-access/parquet-tokio-local-disk 185631042 183854015 1.01
random-access/parquet-tokio-local-disk-footer 185175313 184486244 1.00
random-access/taxi/correlated/lance-tokio-local-disk 973227 979306 0.99
random-access/taxi/correlated/lance-tokio-local-disk-footer 1657454 1676519 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 277162254 275056486 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 276369713 274376152 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1810096 2518440 0.72
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1803298 2510789 0.72
random-access/taxi/uniform/lance-tokio-local-disk 8708257 8724310 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9434404 9374438 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 290374537 294754524 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 292004728 293105115 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4530689 5582264 0.81
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4597128 5609294 0.82
random-access/vortex-tokio-local-disk 🚀 1307574 1804985 0.72
random-access/vortex-tokio-local-disk-footer 🚀 1288632 1678487 0.77

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.5%


duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11780508 10981328 1.07
statpopgen_q01/duckdb:vortex-file-compressed 20092437 21065661 0.95
statpopgen_q02/duckdb:vortex-file-compressed 1318949166 1315307656 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3042377399 3015560223 1.01
statpopgen_q04/duckdb:vortex-file-compressed 3044472507 3098495853 0.98
statpopgen_q05/duckdb:vortex-file-compressed 1407397344 1390773521 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2097411203 2068212687 1.01
statpopgen_q07/duckdb:vortex-file-compressed 242665220 229698886 1.06
statpopgen_q08/duckdb:vortex-file-compressed 256160989 249648304 1.03
statpopgen_q09/duckdb:vortex-file-compressed 2844138505 2849197138 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4641856940 4672466487 0.99
duckdb / vortex-compact (1.015x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10982716 10841686 1.01
statpopgen_q01/duckdb:vortex-compact 173485988 174104619 1.00
statpopgen_q02/duckdb:vortex-compact 1836020355 1805842851 1.02
statpopgen_q03/duckdb:vortex-compact 3547086766 3511484127 1.01
statpopgen_q04/duckdb:vortex-compact 3596877852 3526107526 1.02
statpopgen_q05/duckdb:vortex-compact 1909184340 1841346632 1.04
statpopgen_q06/duckdb:vortex-compact 2715120188 2659251124 1.02
statpopgen_q07/duckdb:vortex-compact 970015491 971027692 1.00
statpopgen_q08/duckdb:vortex-compact 1007112166 1002520560 1.00
statpopgen_q09/duckdb:vortex-compact 3480228329 3327777752 1.05
statpopgen_q10/duckdb:vortex-compact 5457814361 5465595926 1.00
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 321872653 319218729 1.01
statpopgen_q01/duckdb:parquet 409746039 403049133 1.02
statpopgen_q02/duckdb:parquet 1009394287 1009741597 1.00
statpopgen_q03/duckdb:parquet 1525899454 1535015228 0.99
statpopgen_q04/duckdb:parquet 1514289438 1517301404 1.00
statpopgen_q05/duckdb:parquet 1009497276 1009277338 1.00
statpopgen_q06/duckdb:parquet 1496385469 1487504987 1.01
statpopgen_q07/duckdb:parquet 1919499546 1888973775 1.02
statpopgen_q08/duckdb:parquet 1907328297 1899249534 1.00
statpopgen_q09/duckdb:parquet 1422193980 1415234081 1.00
statpopgen_q10/duckdb:parquet 2691299607 2675009593 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.3% +0.8% +0.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +7.3% +0.8% +6.4% +13.5% ➖ noise
1 duckdb:vortex-compact -0.4% +1.7% -2.0% +27.5% ➖ noise
1 duckdb:vortex-file-compressed -4.6% +1.7% -6.2% +204.7% ➖ noise
2 duckdb:vortex-compact +1.7% -0.0% +1.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.3% -0.0% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.9% -0.6% +1.5% +10.0% ➖ noise
4 duckdb:vortex-compact +2.0% -0.2% +2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.7% -0.2% -1.5% +10.0% ➖ noise
5 duckdb:vortex-compact +3.7% +0.0% +3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% +0.0% +1.2% +10.0% ➖ noise
6 duckdb:vortex-compact +2.1% +0.6% +1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.4% +0.6% +0.8% +10.0% ➖ noise
7 duckdb:vortex-compact -0.1% +1.6% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.6% +1.6% +4.0% +18.2% ➖ noise
8 duckdb:vortex-compact +0.5% +0.4% +0.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.6% +0.4% +2.2% +10.0% ➖ noise
9 duckdb:vortex-compact +4.6% +0.5% +4.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +0.5% -0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% +0.6% -0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% +0.6% -1.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.085x ➖
Parquet (geomean): 1.071x ➖
Shifts: Parquet (control) +7.1% · Median polish +5.6%


datafusion / vortex-file-compressed (1.097x ➖, 1↑ 22↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 3174453 2001055 1.59
clickbench_q01/datafusion:vortex-file-compressed 🚨 19121083 14902795 1.28
clickbench_q02/datafusion:vortex-file-compressed 🚨 42215169 35891111 1.18
clickbench_q03/datafusion:vortex-file-compressed 🚨 46947994 39806374 1.18
clickbench_q04/datafusion:vortex-file-compressed 🚨 385561111 322546003 1.20
clickbench_q05/datafusion:vortex-file-compressed 🚨 397895087 342695076 1.16
clickbench_q06/datafusion:vortex-file-compressed 1954111 1962169 1.00
clickbench_q07/datafusion:vortex-file-compressed 🚨 20463184 18352926 1.11
clickbench_q08/datafusion:vortex-file-compressed 404644830 396166797 1.02
clickbench_q09/datafusion:vortex-file-compressed 606748877 587451922 1.03
clickbench_q10/datafusion:vortex-file-compressed 🚨 86579186 74501641 1.16
clickbench_q11/datafusion:vortex-file-compressed 🚨 105999058 88936621 1.19
clickbench_q12/datafusion:vortex-file-compressed 🚨 367389187 293600406 1.25
clickbench_q13/datafusion:vortex-file-compressed 🚨 539796793 448312151 1.20
clickbench_q14/datafusion:vortex-file-compressed 272094805 279392138 0.97
clickbench_q15/datafusion:vortex-file-compressed 375978788 389617323 0.96
clickbench_q16/datafusion:vortex-file-compressed 723893485 751220620 0.96
clickbench_q17/datafusion:vortex-file-compressed 🚀 692600381 772387569 0.90
clickbench_q18/datafusion:vortex-file-compressed 1451032842 1473709764 0.98
clickbench_q19/datafusion:vortex-file-compressed 27045570 24871454 1.09
clickbench_q20/datafusion:vortex-file-compressed 381246658 361837359 1.05
clickbench_q21/datafusion:vortex-file-compressed 471152639 428359825 1.10
clickbench_q22/datafusion:vortex-file-compressed 🚨 675096466 515435939 1.31
clickbench_q23/datafusion:vortex-file-compressed 🚨 1029927126 837590796 1.23
clickbench_q24/datafusion:vortex-file-compressed 🚨 60350405 50596363 1.19
clickbench_q25/datafusion:vortex-file-compressed 🚨 88712424 76568050 1.16
clickbench_q26/datafusion:vortex-file-compressed 🚨 56017846 48834244 1.15
clickbench_q27/datafusion:vortex-file-compressed 🚨 896244674 809061253 1.11
clickbench_q28/datafusion:vortex-file-compressed 7103319709 7012755678 1.01
clickbench_q29/datafusion:vortex-file-compressed 235857586 248344669 0.95
clickbench_q30/datafusion:vortex-file-compressed 243774915 242152011 1.01
clickbench_q31/datafusion:vortex-file-compressed 283280115 288049893 0.98
clickbench_q32/datafusion:vortex-file-compressed 1436337954 1444601742 0.99
clickbench_q33/datafusion:vortex-file-compressed 1672331577 1592388405 1.05
clickbench_q34/datafusion:vortex-file-compressed 1447517979 1555556417 0.93
clickbench_q35/datafusion:vortex-file-compressed 🚨 649874250 552691000 1.18
clickbench_q36/datafusion:vortex-file-compressed 🚨 113196568 88452781 1.28
clickbench_q37/datafusion:vortex-file-compressed 🚨 52349872 42687811 1.23
clickbench_q38/datafusion:vortex-file-compressed 🚨 29635311 25478662 1.16
clickbench_q39/datafusion:vortex-file-compressed 🚨 180070377 152828538 1.18
clickbench_q40/datafusion:vortex-file-compressed 19134834 20786502 0.92
clickbench_q41/datafusion:vortex-file-compressed 17577727 18652930 0.94
clickbench_q42/datafusion:vortex-file-compressed 18854109 19399873 0.97
datafusion / parquet (1.122x ❌, 0↑ 29↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2538300 1884059 1.35
clickbench_q01/datafusion:parquet 🚨 24849064 21266450 1.17
clickbench_q02/datafusion:parquet 🚨 63513914 57650896 1.10
clickbench_q03/datafusion:parquet 48318007 46586939 1.04
clickbench_q04/datafusion:parquet 🚨 418343124 354215327 1.18
clickbench_q05/datafusion:parquet 🚨 471226694 373669479 1.26
clickbench_q06/datafusion:parquet 🚨 2643821 1795277 1.47
clickbench_q07/datafusion:parquet 🚨 29661200 26517722 1.12
clickbench_q08/datafusion:parquet 418111760 424085108 0.99
clickbench_q09/datafusion:parquet 661024741 685246187 0.96
clickbench_q10/datafusion:parquet 111960397 115391001 0.97
clickbench_q11/datafusion:parquet 139919163 140537631 1.00
clickbench_q12/datafusion:parquet 369937274 369908048 1.00
clickbench_q13/datafusion:parquet 545202216 535077836 1.02
clickbench_q14/datafusion:parquet 🚨 444846656 379287894 1.17
clickbench_q15/datafusion:parquet 🚨 480064599 403429184 1.19
clickbench_q16/datafusion:parquet 🚨 894197596 732841664 1.22
clickbench_q17/datafusion:parquet 🚨 847457566 712232616 1.19
clickbench_q18/datafusion:parquet 🚨 1700473574 1469471486 1.16
clickbench_q19/datafusion:parquet 🚨 38228295 33692270 1.13
clickbench_q20/datafusion:parquet 🚨 706629720 629857198 1.12
clickbench_q21/datafusion:parquet 🚨 777494794 693891479 1.12
clickbench_q22/datafusion:parquet 🚨 1109541058 1003640532 1.11
clickbench_q23/datafusion:parquet 🚨 4425555908 3865329113 1.14
clickbench_q24/datafusion:parquet 🚨 100049100 90353425 1.11
clickbench_q25/datafusion:parquet 159000128 147794493 1.08
clickbench_q26/datafusion:parquet 🚨 105741477 90041776 1.17
clickbench_q27/datafusion:parquet 🚨 1242741710 1128403674 1.10
clickbench_q28/datafusion:parquet 6855677000 6822143618 1.00
clickbench_q29/datafusion:parquet 267403447 249420784 1.07
clickbench_q30/datafusion:parquet 372745048 386417009 0.96
clickbench_q31/datafusion:parquet 🚨 466983620 405302788 1.15
clickbench_q32/datafusion:parquet 1450459804 1558340307 0.93
clickbench_q33/datafusion:parquet 🚨 1871118479 1608845365 1.16
clickbench_q34/datafusion:parquet 1552868600 1591582798 0.98
clickbench_q35/datafusion:parquet 543794792 559483319 0.97
clickbench_q36/datafusion:parquet 🚨 192239961 148181889 1.30
clickbench_q37/datafusion:parquet 🚨 74786105 62084137 1.20
clickbench_q38/datafusion:parquet 🚨 111124934 92146671 1.21
clickbench_q39/datafusion:parquet 🚨 349689432 276993054 1.26
clickbench_q40/datafusion:parquet 🚨 42895989 33034026 1.30
clickbench_q41/datafusion:parquet 🚨 38418260 31183879 1.23
clickbench_q42/datafusion:parquet 🚨 37865725 33280211 1.14
duckdb / vortex-file-compressed (1.074x ➖, 0↑ 15↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5947342 6566472 0.91
clickbench_q01/duckdb:vortex-file-compressed 14526090 15091496 0.96
clickbench_q02/duckdb:vortex-file-compressed 27738854 27313143 1.02
clickbench_q03/duckdb:vortex-file-compressed 31046263 30903609 1.00
clickbench_q04/duckdb:vortex-file-compressed 169555518 177141050 0.96
clickbench_q05/duckdb:vortex-file-compressed 200194066 208825624 0.96
clickbench_q06/duckdb:vortex-file-compressed 19004518 19802150 0.96
clickbench_q07/duckdb:vortex-file-compressed 16364006 15948296 1.03
clickbench_q08/duckdb:vortex-file-compressed 265660788 274565278 0.97
clickbench_q09/duckdb:vortex-file-compressed 380193497 386938165 0.98
clickbench_q10/duckdb:vortex-file-compressed 77627658 76693680 1.01
clickbench_q11/duckdb:vortex-file-compressed 91384181 86865273 1.05
clickbench_q12/duckdb:vortex-file-compressed 🚨 264967740 227414293 1.17
clickbench_q13/duckdb:vortex-file-compressed 🚨 604298061 459000483 1.32
clickbench_q14/duckdb:vortex-file-compressed 🚨 310746543 255700746 1.22
clickbench_q15/duckdb:vortex-file-compressed 🚨 253667977 224773885 1.13
clickbench_q16/duckdb:vortex-file-compressed 🚨 851183898 728195034 1.17
clickbench_q17/duckdb:vortex-file-compressed 🚨 717317414 559564170 1.28
clickbench_q18/duckdb:vortex-file-compressed 1235204604 1214281619 1.02
clickbench_q19/duckdb:vortex-file-compressed 23626622 21918999 1.08
clickbench_q20/duckdb:vortex-file-compressed 🚨 474697389 385693378 1.23
clickbench_q21/duckdb:vortex-file-compressed 🚨 504785472 427653403 1.18
clickbench_q22/duckdb:vortex-file-compressed 🚨 853424549 586459576 1.46
clickbench_q23/duckdb:vortex-file-compressed 988521239 1038632975 0.95
clickbench_q24/duckdb:vortex-file-compressed 🚨 67179955 48179754 1.39
clickbench_q25/duckdb:vortex-file-compressed 89762543 85237627 1.05
clickbench_q26/duckdb:vortex-file-compressed 49851336 50486166 0.99
clickbench_q27/duckdb:vortex-file-compressed 🚨 577334071 502552016 1.15
clickbench_q28/duckdb:vortex-file-compressed 3176811842 3027462605 1.05
clickbench_q29/duckdb:vortex-file-compressed 29499062 28747261 1.03
clickbench_q30/duckdb:vortex-file-compressed 🚨 203389512 183687420 1.11
clickbench_q31/duckdb:vortex-file-compressed 294237564 270182794 1.09
clickbench_q32/duckdb:vortex-file-compressed 1455379311 1365886932 1.07
clickbench_q33/duckdb:vortex-file-compressed 🚨 1785328844 1556166573 1.15
clickbench_q34/duckdb:vortex-file-compressed 1701413231 1705357539 1.00
clickbench_q35/duckdb:vortex-file-compressed 397904325 374751943 1.06
clickbench_q36/duckdb:vortex-file-compressed 🚨 38683371 34315463 1.13
clickbench_q37/duckdb:vortex-file-compressed 28547348 28202090 1.01
clickbench_q38/duckdb:vortex-file-compressed 28470968 30055916 0.95
clickbench_q39/duckdb:vortex-file-compressed 🚨 54296249 46703931 1.16
clickbench_q40/duckdb:vortex-file-compressed 27321286 26799946 1.02
clickbench_q41/duckdb:vortex-file-compressed 26965874 26267806 1.03
clickbench_q42/duckdb:vortex-file-compressed 28504769 27708555 1.03
duckdb / parquet (1.022x ➖, 0↑ 6↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 311375460 259382944 1.20
clickbench_q01/duckdb:parquet 🚨 58211561 50874526 1.14
clickbench_q02/duckdb:parquet 67681241 67724092 1.00
clickbench_q03/duckdb:parquet 63834801 65404119 0.98
clickbench_q04/duckdb:parquet 206154327 208720205 0.99
clickbench_q05/duckdb:parquet 281650164 289461490 0.97
clickbench_q06/duckdb:parquet 🚨 70159411 62115235 1.13
clickbench_q07/duckdb:parquet 🚨 60230617 53159442 1.13
clickbench_q08/duckdb:parquet 301965486 275352583 1.10
clickbench_q09/duckdb:parquet 441054638 409105516 1.08
clickbench_q10/duckdb:parquet 95183045 99447334 0.96
clickbench_q11/duckdb:parquet 107182900 112736869 0.95
clickbench_q12/duckdb:parquet 300441058 308739606 0.97
clickbench_q13/duckdb:parquet 529597915 526216754 1.01
clickbench_q14/duckdb:parquet 365506114 332987511 1.10
clickbench_q15/duckdb:parquet 242687503 247033997 0.98
clickbench_q16/duckdb:parquet 685628452 644781797 1.06
clickbench_q17/duckdb:parquet 542915216 517739332 1.05
clickbench_q18/duckdb:parquet 1075716948 1080006729 1.00
clickbench_q19/duckdb:parquet 49534580 51297746 0.97
clickbench_q20/duckdb:parquet 444021911 447209236 0.99
clickbench_q21/duckdb:parquet 604687661 571229046 1.06
clickbench_q22/duckdb:parquet 957319387 940840671 1.02
clickbench_q23/duckdb:parquet 319566291 317212567 1.01
clickbench_q24/duckdb:parquet 78925892 79856933 0.99
clickbench_q25/duckdb:parquet 139767735 141126976 0.99
clickbench_q26/duckdb:parquet 52616647 55087265 0.96
clickbench_q27/duckdb:parquet 659983090 659997104 1.00
clickbench_q28/duckdb:parquet 4998521244 4871340997 1.03
clickbench_q29/duckdb:parquet 🚨 69655186 62722619 1.11
clickbench_q30/duckdb:parquet 336351396 306359541 1.10
clickbench_q31/duckdb:parquet 🚨 396330213 352403577 1.12
clickbench_q32/duckdb:parquet 1151026016 1200110753 0.96
clickbench_q33/duckdb:parquet 1383710663 1330668548 1.04
clickbench_q34/duckdb:parquet 1410286009 1376956704 1.02
clickbench_q35/duckdb:parquet 357452677 357999564 1.00
clickbench_q36/duckdb:parquet 67006961 67318375 1.00
clickbench_q37/duckdb:parquet 53775393 55859712 0.96
clickbench_q38/duckdb:parquet 58830142 60464779 0.97
clickbench_q39/duckdb:parquet 102641340 100414446 1.02
clickbench_q40/duckdb:parquet 55824695 57985906 0.96
clickbench_q41/duckdb:parquet 59448963 62789295 0.95
clickbench_q42/duckdb:parquet 51870290 52000015 1.00
duckdb / duckdb (1.056x ➖, 0↑ 6↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18564376 18654825 1.00
clickbench_q01/duckdb:duckdb 36886760 33875896 1.09
clickbench_q02/duckdb:duckdb 48695073 46113513 1.06
clickbench_q03/duckdb:duckdb 50491306 47150794 1.07
clickbench_q04/duckdb:duckdb 239592832 222282024 1.08
clickbench_q05/duckdb:duckdb 347825305 338606310 1.03
clickbench_q06/duckdb:duckdb 39012816 36368857 1.07
clickbench_q07/duckdb:duckdb 38035036 36351603 1.05
clickbench_q08/duckdb:duckdb 323808018 328214357 0.99
clickbench_q09/duckdb:duckdb 519555340 501742203 1.04
clickbench_q10/duckdb:duckdb 109489726 99545783 1.10
clickbench_q11/duckdb:duckdb 112571899 109828254 1.02
clickbench_q12/duckdb:duckdb 302996474 313435714 0.97
clickbench_q13/duckdb:duckdb 580458733 561631559 1.03
clickbench_q14/duckdb:duckdb 372375399 354034815 1.05
clickbench_q15/duckdb:duckdb 277259455 275847290 1.01
clickbench_q16/duckdb:duckdb 691577143 702281204 0.98
clickbench_q17/duckdb:duckdb 602693442 594958766 1.01
clickbench_q18/duckdb:duckdb 🚨 1438757639 1285208550 1.12
clickbench_q19/duckdb:duckdb 37817740 34927529 1.08
clickbench_q20/duckdb:duckdb 913555994 1002726566 0.91
clickbench_q21/duckdb:duckdb 1008228629 1067546641 0.94
clickbench_q22/duckdb:duckdb 1193678016 1173281709 1.02
clickbench_q23/duckdb:duckdb 🚨 299678752 251827176 1.19
clickbench_q24/duckdb:duckdb 🚨 67651765 60560109 1.12
clickbench_q25/duckdb:duckdb 130858134 123030579 1.06
clickbench_q26/duckdb:duckdb 61203277 56637604 1.08
clickbench_q27/duckdb:duckdb 1048433637 1094493446 0.96
clickbench_q28/duckdb:duckdb 4839604100 4641201509 1.04
clickbench_q29/duckdb:duckdb 53118167 48597791 1.09
clickbench_q30/duckdb:duckdb 311298069 302886922 1.03
clickbench_q31/duckdb:duckdb 422002502 426538892 0.99
clickbench_q32/duckdb:duckdb 1594521589 1486327194 1.07
clickbench_q33/duckdb:duckdb 2065853725 1918337128 1.08
clickbench_q34/duckdb:duckdb 🚨 2307228608 2053795728 1.12
clickbench_q35/duckdb:duckdb 292960684 268243420 1.09
clickbench_q36/duckdb:duckdb 🚨 47253879 41464860 1.14
clickbench_q37/duckdb:duckdb 34275644 31608545 1.08
clickbench_q38/duckdb:duckdb 34182056 31191793 1.10
clickbench_q39/duckdb:duckdb 🚨 88889546 66422634 1.34
clickbench_q40/duckdb:duckdb 34038284 32024538 1.06
clickbench_q41/duckdb:duckdb 33741325 31059459 1.09
clickbench_q42/duckdb:duckdb 33660180 31877504 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +58.6% +27.2% +24.7% +455.0% ➖ noise
0 duckdb:duckdb -0.5% +27.2% -21.7% +247.4% ➖ noise
0 duckdb:vortex-file-compressed -9.4% +27.2% -28.8% +298.2% ➖ noise
1 datafusion:vortex-file-compressed +28.3% +15.6% +11.0% +70.7% ➖ noise
1 duckdb:duckdb +8.9% +15.6% -5.8% +77.7% ➖ noise
1 duckdb:vortex-file-compressed -3.7% +15.6% -16.8% +20.5% ➖ noise
2 datafusion:vortex-file-compressed +17.6% +4.9% +12.1% +26.8% ➖ noise
2 duckdb:duckdb +5.6% +4.9% +0.6% +27.6% ➖ noise
2 duckdb:vortex-file-compressed +1.6% +4.9% -3.2% +17.8% ➖ noise
3 datafusion:vortex-file-compressed +17.9% +0.6% +17.2% +148.5% ➖ noise
3 duckdb:duckdb +7.1% +0.6% +6.4% +68.6% ➖ noise
3 duckdb:vortex-file-compressed +0.5% +0.6% -0.1% +28.3% ➖ noise
4 datafusion:vortex-file-compressed +19.5% +8.0% +10.7% +17.8% ➖ noise
4 duckdb:duckdb +7.8% +8.0% -0.2% +17.8% ➖ noise
4 duckdb:vortex-file-compressed -4.3% +8.0% -11.4% +17.8% ➖ noise
5 datafusion:vortex-file-compressed +16.1% +10.8% +4.8% +17.8% ➖ noise
5 duckdb:duckdb +2.7% +10.8% -7.3% +17.8% ➖ noise
5 duckdb:vortex-file-compressed -4.1% +10.8% -13.5% +17.8% ➖ noise
6 datafusion:vortex-file-compressed -0.4% +29.0% -22.8% +45.7% ➖ noise
6 duckdb:duckdb +7.3% +29.0% -16.8% +30.1% ➖ noise
6 duckdb:vortex-file-compressed -4.0% +29.0% -25.6% +22.5% ✅ faster
7 datafusion:vortex-file-compressed +11.5% +12.6% -1.0% +17.8% ➖ noise
7 duckdb:duckdb +4.6% +12.6% -7.1% +17.8% ➖ noise
7 duckdb:vortex-file-compressed +2.6% +12.6% -8.9% +17.8% ➖ noise
8 datafusion:vortex-file-compressed +2.1% +4.0% -1.8% +17.8% ➖ noise
8 duckdb:duckdb -1.3% +4.0% -5.1% +17.8% ➖ noise
8 duckdb:vortex-file-compressed -3.2% +4.0% -6.9% +17.8% ➖ noise
9 datafusion:vortex-file-compressed +3.3% +2.0% +1.3% +17.8% ➖ noise
9 duckdb:duckdb +3.6% +2.0% +1.5% +17.8% ➖ noise
9 duckdb:vortex-file-compressed -1.7% +2.0% -3.7% +17.8% ➖ noise
10 datafusion:vortex-file-compressed +16.2% -3.6% +20.6% +17.8% 🚨 regression
10 duckdb:duckdb +10.0% -3.6% +14.1% +17.8% ➖ noise
10 duckdb:vortex-file-compressed +1.2% -3.6% +5.0% +17.8% ➖ noise
11 datafusion:vortex-file-compressed +19.2% -2.7% +22.5% +17.8% 🚨 regression
11 duckdb:duckdb +2.5% -2.7% +5.4% +17.8% ➖ noise
11 duckdb:vortex-file-compressed +5.2% -2.7% +8.1% +17.8% ➖ noise
12 datafusion:vortex-file-compressed +25.1% -1.3% +26.8% +17.8% 🚨 regression
12 duckdb:duckdb -3.3% -1.3% -2.0% +17.8% ➖ noise
12 duckdb:vortex-file-compressed +16.5% -1.3% +18.1% +17.8% 🚨 regression
13 datafusion:vortex-file-compressed +20.4% +1.3% +18.9% +17.8% 🚨 regression
13 duckdb:duckdb +3.4% +1.3% +2.1% +17.8% ➖ noise
13 duckdb:vortex-file-compressed +31.7% +1.3% +30.0% +17.8% 🚨 regression
14 datafusion:vortex-file-compressed -2.6% +13.5% -14.2% +17.8% ➖ noise
14 duckdb:duckdb +5.2% +13.5% -7.3% +17.8% ➖ noise
14 duckdb:vortex-file-compressed +21.5% +13.5% +7.1% +17.8% ➖ noise
15 datafusion:vortex-file-compressed -3.5% +8.1% -10.7% +17.8% ➖ noise
15 duckdb:duckdb +0.5% +8.1% -7.0% +17.8% ➖ noise
15 duckdb:vortex-file-compressed +12.9% +8.1% +4.4% +17.8% ➖ noise
16 datafusion:vortex-file-compressed -3.6% +13.9% -15.4% +17.8% ✅ faster
16 duckdb:duckdb -1.5% +13.9% -13.5% +17.8% ➖ noise
16 duckdb:vortex-file-compressed +16.9% +13.9% +2.6% +17.8% ➖ noise
17 datafusion:vortex-file-compressed -10.3% +11.7% -19.7% +17.8% ✅ faster
17 duckdb:duckdb +1.3% +11.7% -9.3% +17.8% ➖ noise
17 duckdb:vortex-file-compressed +28.2% +11.7% +14.8% +17.8% ➖ noise
18 datafusion:vortex-file-compressed -1.5% +7.4% -8.3% +17.8% ➖ noise
18 duckdb:duckdb +11.9% +7.4% +4.3% +17.8% ➖ noise
18 duckdb:vortex-file-compressed +1.7% +7.4% -5.2% +17.8% ➖ noise
19 datafusion:vortex-file-compressed +8.7% +4.7% +3.9% +17.8% ➖ noise
19 duckdb:duckdb +8.3% +4.7% +3.4% +17.8% ➖ noise
19 duckdb:vortex-file-compressed +7.8% +4.7% +3.0% +45.1% ➖ noise
20 datafusion:vortex-file-compressed +5.4% +5.5% -0.2% +188.5% ➖ noise
20 duckdb:duckdb -8.9% +5.5% -13.7% +38.0% ➖ noise
20 duckdb:vortex-file-compressed +23.1% +5.5% +16.6% +17.8% ➖ noise
21 datafusion:vortex-file-compressed +10.0% +8.9% +1.0% +17.8% ➖ noise
21 duckdb:duckdb -5.6% +8.9% -13.3% +17.8% ➖ noise
21 duckdb:vortex-file-compressed +18.0% +8.9% +8.4% +17.8% ➖ noise
22 datafusion:vortex-file-compressed +31.0% +6.1% +23.5% +17.8% 🚨 regression
22 duckdb:duckdb +1.7% +6.1% -4.1% +17.8% ➖ noise
22 duckdb:vortex-file-compressed +45.5% +6.1% +37.2% +17.8% 🚨 regression
23 datafusion:vortex-file-compressed +23.0% +7.4% +14.5% +37.0% ➖ noise
23 duckdb:duckdb +19.0% +7.4% +10.8% +17.8% ➖ noise
23 duckdb:vortex-file-compressed -4.8% +7.4% -11.4% +43.4% ➖ noise
24 datafusion:vortex-file-compressed +19.3% +4.6% +14.0% +17.8% ➖ noise
24 duckdb:duckdb +11.7% +4.6% +6.8% +17.8% ➖ noise
24 duckdb:vortex-file-compressed +39.4% +4.6% +33.3% +18.3% 🚨 regression
25 datafusion:vortex-file-compressed +15.9% +3.2% +12.2% +17.8% ➖ noise
25 duckdb:duckdb +6.4% +3.2% +3.0% +17.8% ➖ noise
25 duckdb:vortex-file-compressed +5.3% +3.2% +2.0% +17.8% ➖ noise
26 datafusion:vortex-file-compressed +14.7% +5.9% +8.3% +17.8% ➖ noise
26 duckdb:duckdb +8.1% +5.9% +2.0% +17.8% ➖ noise
26 duckdb:vortex-file-compressed -1.3% +5.9% -6.8% +17.8% ➖ noise
27 datafusion:vortex-file-compressed +10.8% +4.9% +5.6% +17.8% ➖ noise
27 duckdb:duckdb -4.2% +4.9% -8.7% +17.8% ➖ noise
27 duckdb:vortex-file-compressed +14.9% +4.9% +9.5% +17.8% ➖ noise
28 datafusion:vortex-file-compressed +1.3% +1.5% -0.3% +17.8% ➖ noise
28 duckdb:duckdb +4.3% +1.5% +2.7% +17.8% ➖ noise
28 duckdb:vortex-file-compressed +4.9% +1.5% +3.3% +17.8% ➖ noise
29 datafusion:vortex-file-compressed -5.0% +9.1% -13.0% +17.8% ➖ noise
29 duckdb:duckdb +9.3% +9.1% +0.2% +17.8% ➖ noise
29 duckdb:vortex-file-compressed +2.6% +9.1% -6.0% +17.8% ➖ noise
30 datafusion:vortex-file-compressed +0.7% +2.9% -2.2% +17.8% ➖ noise
30 duckdb:duckdb +2.8% +2.9% -0.1% +17.8% ➖ noise
30 duckdb:vortex-file-compressed +10.7% +2.9% +7.6% +17.8% ➖ noise
31 datafusion:vortex-file-compressed -1.7% +13.8% -13.6% +17.8% ➖ noise
31 duckdb:duckdb -1.1% +13.8% -13.1% +17.8% ➖ noise
31 duckdb:vortex-file-compressed +8.9% +13.8% -4.3% +17.8% ➖ noise
32 datafusion:vortex-file-compressed -0.6% -5.5% +5.2% +17.8% ➖ noise
32 duckdb:duckdb +7.3% -5.5% +13.5% +17.8% ➖ noise
32 duckdb:vortex-file-compressed +6.6% -5.5% +12.8% +17.8% ➖ noise
33 datafusion:vortex-file-compressed +5.0% +10.0% -4.5% +23.5% ➖ noise
33 duckdb:duckdb +7.7% +10.0% -2.1% +17.8% ➖ noise
33 duckdb:vortex-file-compressed +14.7% +10.0% +4.3% +17.8% ➖ noise
34 datafusion:vortex-file-compressed -6.9% -0.0% -6.9% +17.8% ➖ noise
34 duckdb:duckdb +12.3% -0.0% +12.4% +17.8% ➖ noise
34 duckdb:vortex-file-compressed -0.2% -0.0% -0.2% +17.8% ➖ noise
35 datafusion:vortex-file-compressed +17.6% -1.5% +19.4% +17.8% 🚨 regression
35 duckdb:duckdb +9.2% -1.5% +10.9% +17.8% ➖ noise
35 duckdb:vortex-file-compressed +6.2% -1.5% +7.8% +17.8% ➖ noise
36 datafusion:vortex-file-compressed +28.0% +13.6% +12.6% +17.8% ➖ noise
36 duckdb:duckdb +14.0% +13.6% +0.3% +17.8% ➖ noise
36 duckdb:vortex-file-compressed +12.7% +13.6% -0.8% +17.8% ➖ noise
37 datafusion:vortex-file-compressed +22.6% +7.7% +13.9% +17.8% ➖ noise
37 duckdb:duckdb +8.4% +7.7% +0.7% +17.8% ➖ noise
37 duckdb:vortex-file-compressed +1.2% +7.7% -6.0% +17.8% ➖ noise
38 datafusion:vortex-file-compressed +16.3% +8.3% +7.4% +17.8% ➖ noise
38 duckdb:duckdb +9.6% +8.3% +1.2% +17.8% ➖ noise
38 duckdb:vortex-file-compressed -5.3% +8.3% -12.6% +17.8% ➖ noise
39 datafusion:vortex-file-compressed +17.8% +13.6% +3.7% +19.2% ➖ noise
39 duckdb:duckdb +33.8% +13.6% +17.8% +17.8% 🚨 regression
39 duckdb:vortex-file-compressed +16.3% +13.6% +2.3% +17.8% ➖ noise
40 datafusion:vortex-file-compressed -7.9% +11.8% -17.7% +17.8% ✅ faster
40 duckdb:duckdb +6.3% +11.8% -4.9% +17.8% ➖ noise
40 duckdb:vortex-file-compressed +1.9% +11.8% -8.8% +17.8% ➖ noise
41 datafusion:vortex-file-compressed -5.8% +8.0% -12.7% +17.8% ➖ noise
41 duckdb:duckdb +8.6% +8.0% +0.6% +17.8% ➖ noise
41 duckdb:vortex-file-compressed +2.7% +8.0% -4.9% +17.8% ➖ noise
42 datafusion:vortex-file-compressed -2.8% +6.5% -8.8% +17.8% ➖ noise
42 duckdb:duckdb +5.6% +6.5% -0.9% +17.8% ➖ noise
42 duckdb:vortex-file-compressed +2.9% +6.5% -3.4% +17.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +22.5%
Vortex (geomean): 1.300x ❌
Parquet (geomean): 1.062x ➖
Shifts: Parquet (control) +6.2% · Median polish +24.6%


datafusion / vortex-file-compressed (1.337x ❌, 0↑ 11↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 782357947 662343243 1.18
tpch_q02/datafusion:vortex-file-compressed 🚨 1584782190 745863112 2.12
tpch_q03/datafusion:vortex-file-compressed 🚨 1139893717 799421318 1.43
tpch_q04/datafusion:vortex-file-compressed 🚨 874302303 602651282 1.45
tpch_q05/datafusion:vortex-file-compressed 🚨 1273633968 919758092 1.38
tpch_q06/datafusion:vortex-file-compressed 🚨 939028828 604124533 1.55
tpch_q07/datafusion:vortex-file-compressed 1291799488 1021832165 1.26
tpch_q08/datafusion:vortex-file-compressed 1445274088 1289366474 1.12
tpch_q09/datafusion:vortex-file-compressed 1622680368 1538165811 1.05
tpch_q10/datafusion:vortex-file-compressed 1106294959 944746255 1.17
tpch_q11/datafusion:vortex-file-compressed 707223190 562578237 1.26
tpch_q12/datafusion:vortex-file-compressed 🚨 1289733171 863340971 1.49
tpch_q13/datafusion:vortex-file-compressed 504486816 421579448 1.20
tpch_q14/datafusion:vortex-file-compressed 701703332 563369827 1.25
tpch_q15/datafusion:vortex-file-compressed 🚨 1547252767 1052688874 1.47
tpch_q16/datafusion:vortex-file-compressed 464330963 364743132 1.27
tpch_q17/datafusion:vortex-file-compressed 1254637440 1136363678 1.10
tpch_q18/datafusion:vortex-file-compressed 1327778102 1237452846 1.07
tpch_q19/datafusion:vortex-file-compressed 🚨 1129723670 776866497 1.45
tpch_q20/datafusion:vortex-file-compressed 🚨 1180287374 846760997 1.39
tpch_q21/datafusion:vortex-file-compressed 🚨 2180128253 1599294663 1.36
tpch_q22/datafusion:vortex-file-compressed 🚨 645067002 362544011 1.78
datafusion / vortex-compact (1.216x ➖, 0↑ 8↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 810895169 734400814 1.10
tpch_q02/datafusion:vortex-compact 🚨 1484062745 816893673 1.82
tpch_q03/datafusion:vortex-compact 962225792 851545254 1.13
tpch_q04/datafusion:vortex-compact 🚨 866627898 582295271 1.49
tpch_q05/datafusion:vortex-compact 🚨 1206539845 905051958 1.33
tpch_q06/datafusion:vortex-compact 🚨 878497054 589946038 1.49
tpch_q07/datafusion:vortex-compact 🚨 1423268970 973330384 1.46
tpch_q08/datafusion:vortex-compact 1317973506 1030929971 1.28
tpch_q09/datafusion:vortex-compact 1380561201 1218067205 1.13
tpch_q10/datafusion:vortex-compact 🚨 1250708042 825940202 1.51
tpch_q11/datafusion:vortex-compact 🚨 649284605 399261153 1.63
tpch_q12/datafusion:vortex-compact 920641769 899581086 1.02
tpch_q13/datafusion:vortex-compact 506798393 469593318 1.08
tpch_q14/datafusion:vortex-compact 675887941 672347941 1.01
tpch_q15/datafusion:vortex-compact 1250115628 1241192420 1.01
tpch_q16/datafusion:vortex-compact 558807855 511966845 1.09
tpch_q17/datafusion:vortex-compact 1144270454 1258720371 0.91
tpch_q18/datafusion:vortex-compact 1236616860 1269839867 0.97
tpch_q19/datafusion:vortex-compact 1130999402 1244467925 0.91
tpch_q20/datafusion:vortex-compact 1272593965 1007983917 1.26
tpch_q21/datafusion:vortex-compact 🚨 1878170810 1389247809 1.35
tpch_q22/datafusion:vortex-compact 448104213 355458607 1.26
datafusion / parquet (1.105x ➖, 0↑ 2↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 822821443 807789524 1.02
tpch_q02/datafusion:parquet 722129840 744890318 0.97
tpch_q03/datafusion:parquet 941023999 1040917628 0.90
tpch_q04/datafusion:parquet 520612818 548727850 0.95
tpch_q05/datafusion:parquet 1097260830 1203680696 0.91
tpch_q06/datafusion:parquet 533875437 521021001 1.02
tpch_q07/datafusion:parquet 1583750660 1372096630 1.15
tpch_q08/datafusion:parquet 1602721288 1749467288 0.92
tpch_q09/datafusion:parquet 2018110528 1899981954 1.06
tpch_q10/datafusion:parquet 2286327239 2013029507 1.14
tpch_q11/datafusion:parquet 611274375 605825031 1.01
tpch_q12/datafusion:parquet 🚨 1000492675 756836611 1.32
tpch_q13/datafusion:parquet 913547535 742122625 1.23
tpch_q14/datafusion:parquet 1017938611 784473929 1.30
tpch_q15/datafusion:parquet 1378762752 1347055347 1.02
tpch_q16/datafusion:parquet 🚨 688986403 386453868 1.78
tpch_q17/datafusion:parquet 1556176909 1399560428 1.11
tpch_q18/datafusion:parquet 1816398585 1418074996 1.28
tpch_q19/datafusion:parquet 1126750100 933591114 1.21
tpch_q20/datafusion:parquet 1202328174 1079088320 1.11
tpch_q21/datafusion:parquet 2039220719 1707370564 1.19
tpch_q22/datafusion:parquet 835744045 832329899 1.00
duckdb / vortex-file-compressed (1.341x ❌, 0↑ 10↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 914345145 640041069 1.43
tpch_q02/duckdb:vortex-file-compressed 1433850106 1259700936 1.14
tpch_q03/duckdb:vortex-file-compressed 1214723113 1186524165 1.02
tpch_q04/duckdb:vortex-file-compressed 941844541 791228546 1.19
tpch_q05/duckdb:vortex-file-compressed 1542558086 1237421241 1.25
tpch_q06/duckdb:vortex-file-compressed 🚨 1098132680 832161054 1.32
tpch_q07/duckdb:vortex-file-compressed 🚨 2256519647 1091915302 2.07
tpch_q08/duckdb:vortex-file-compressed 1724204046 1568628176 1.10
tpch_q09/duckdb:vortex-file-compressed 1806420865 1603394257 1.13
tpch_q10/duckdb:vortex-file-compressed 1312165185 1193558798 1.10
tpch_q11/duckdb:vortex-file-compressed 765905219 685439077 1.12
tpch_q12/duckdb:vortex-file-compressed 🚨 2084452641 893778353 2.33
tpch_q13/duckdb:vortex-file-compressed 1076779514 925445025 1.16
tpch_q14/duckdb:vortex-file-compressed 🚨 1494389292 898154111 1.66
tpch_q15/duckdb:vortex-file-compressed 🚨 828892163 593866930 1.40
tpch_q16/duckdb:vortex-file-compressed 598519481 533518422 1.12
tpch_q17/duckdb:vortex-file-compressed 🚨 1618602214 1031300924 1.57
tpch_q18/duckdb:vortex-file-compressed 967837562 973519774 0.99
tpch_q19/duckdb:vortex-file-compressed 🚨 1021057960 761867011 1.34
tpch_q20/duckdb:vortex-file-compressed 🚨 2466694903 1280311529 1.93
tpch_q21/duckdb:vortex-file-compressed 🚨 3487025392 2028838568 1.72
tpch_q22/duckdb:vortex-file-compressed 838672129 657580658 1.28
duckdb / vortex-compact (1.310x ❌, 0↑ 9↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 806483171 628766177 1.28
tpch_q02/duckdb:vortex-compact 1515104060 1230307036 1.23
tpch_q03/duckdb:vortex-compact 1009335838 881903948 1.14
tpch_q04/duckdb:vortex-compact 🚨 857630033 572816314 1.50
tpch_q05/duckdb:vortex-compact 1250664406 1103684925 1.13
tpch_q06/duckdb:vortex-compact 🚨 1140419944 788151206 1.45
tpch_q07/duckdb:vortex-compact 🚨 2065612419 1132115259 1.82
tpch_q08/duckdb:vortex-compact 1691871364 1465108039 1.15
tpch_q09/duckdb:vortex-compact 1743234403 1475528348 1.18
tpch_q10/duckdb:vortex-compact 1221851774 1132906633 1.08
tpch_q11/duckdb:vortex-compact 684702142 678987993 1.01
tpch_q12/duckdb:vortex-compact 🚨 1527961912 725822987 2.11
tpch_q13/duckdb:vortex-compact 939774753 923903794 1.02
tpch_q14/duckdb:vortex-compact 🚨 1474183766 861460726 1.71
tpch_q15/duckdb:vortex-compact 🚨 837918593 586270811 1.43
tpch_q16/duckdb:vortex-compact 484362848 531690115 0.91
tpch_q17/duckdb:vortex-compact 1504374907 1180952550 1.27
tpch_q18/duckdb:vortex-compact 730961384 716980054 1.02
tpch_q19/duckdb:vortex-compact 1013892999 788647710 1.29
tpch_q20/duckdb:vortex-compact 🚨 2343061119 1181767153 1.98
tpch_q21/duckdb:vortex-compact 🚨 2576328032 1762622527 1.46
tpch_q22/duckdb:vortex-compact 🚨 826443584 603935334 1.37
duckdb / parquet (1.020x ➖, 1↑ 1↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 965990897 1009861779 0.96
tpch_q02/duckdb:parquet 1829759225 1609120829 1.14
tpch_q03/duckdb:parquet 1872742514 1634703924 1.15
tpch_q04/duckdb:parquet 1000145377 1234674872 0.81
tpch_q05/duckdb:parquet 2487211448 2499156748 1.00
tpch_q06/duckdb:parquet 🚨 898399494 677310721 1.33
tpch_q07/duckdb:parquet 1811784129 1802429735 1.01
tpch_q08/duckdb:parquet 2395853318 2664387212 0.90
tpch_q09/duckdb:parquet 2299777523 2109817387 1.09
tpch_q10/duckdb:parquet 3825093504 3161206386 1.21
tpch_q11/duckdb:parquet 883718120 932853366 0.95
tpch_q12/duckdb:parquet 🚀 955489924 1406073778 0.68
tpch_q13/duckdb:parquet 1443237623 1309806478 1.10
tpch_q14/duckdb:parquet 1372732786 1262966415 1.09
tpch_q15/duckdb:parquet 904140666 812690435 1.11
tpch_q16/duckdb:parquet 785767794 808356445 0.97
tpch_q17/duckdb:parquet 1262082678 1232775439 1.02
tpch_q18/duckdb:parquet 1364725947 1346328200 1.01
tpch_q19/duckdb:parquet 1499257401 1680985042 0.89
tpch_q20/duckdb:parquet 1776144083 1794834723 0.99
tpch_q21/duckdb:parquet 2183443938 1910895450 1.14
tpch_q22/duckdb:parquet 1136555610 1020406915 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +10.4% -1.3% +11.9% +72.0% ➖ noise
1 datafusion:vortex-file-compressed +18.1% -1.3% +19.7% +85.0% ➖ noise
1 duckdb:vortex-compact +28.3% -1.3% +29.9% +30.8% ➖ noise
1 duckdb:vortex-file-compressed +42.9% -1.3% +44.7% +34.6% 🚨 regression
2 datafusion:vortex-compact +81.7% +5.0% +73.0% +65.6% 🚨 regression
2 datafusion:vortex-file-compressed +112.5% +5.0% +102.4% +73.0% 🚨 regression
2 duckdb:vortex-compact +23.1% +5.0% +17.3% +36.4% ➖ noise
2 duckdb:vortex-file-compressed +13.8% +5.0% +8.4% +46.5% ➖ noise
3 datafusion:vortex-compact +13.0% +1.8% +11.0% +78.8% ➖ noise
3 datafusion:vortex-file-compressed +42.6% +1.8% +40.1% +71.8% ➖ noise
3 duckdb:vortex-compact +14.4% +1.8% +12.5% +47.4% ➖ noise
3 duckdb:vortex-file-compressed +2.4% +1.8% +0.6% +48.0% ➖ noise
4 datafusion:vortex-compact +48.8% -12.3% +69.8% +47.5% 🚨 regression
4 datafusion:vortex-file-compressed +45.1% -12.3% +65.5% +44.3% 🚨 regression
4 duckdb:vortex-compact +49.7% -12.3% +70.8% +42.8% 🚨 regression
4 duckdb:vortex-file-compressed +19.0% -12.3% +35.8% +35.6% 🚨 regression
5 datafusion:vortex-compact +33.3% -4.8% +40.0% +30.0% 🚨 regression
5 datafusion:vortex-file-compressed +38.5% -4.8% +45.4% +30.0% 🚨 regression
5 duckdb:vortex-compact +13.3% -4.8% +19.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +24.7% -4.8% +30.9% +30.0% 🚨 regression
6 datafusion:vortex-compact +48.9% +16.6% +27.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +55.4% +16.6% +33.3% +30.0% 🚨 regression
6 duckdb:vortex-compact +44.7% +16.6% +24.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +32.0% +16.6% +13.2% +30.0% ➖ noise
7 datafusion:vortex-compact +46.2% +7.7% +35.8% +30.0% 🚨 regression
7 datafusion:vortex-file-compressed +26.4% +7.7% +17.4% +30.0% ➖ noise
7 duckdb:vortex-compact +82.5% +7.7% +69.4% +30.0% 🚨 regression
7 duckdb:vortex-file-compressed +106.7% +7.7% +91.9% +30.0% 🚨 regression
8 datafusion:vortex-compact +27.8% -9.2% +40.9% +30.0% 🚨 regression
8 datafusion:vortex-file-compressed +12.1% -9.2% +23.5% +30.0% ➖ noise
8 duckdb:vortex-compact +15.5% -9.2% +27.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +9.9% -9.2% +21.1% +30.0% ➖ noise
9 datafusion:vortex-compact +13.3% +7.6% +5.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +5.5% +7.6% -2.0% +30.0% ➖ noise
9 duckdb:vortex-compact +18.1% +7.6% +9.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +12.7% +7.6% +4.7% +30.0% ➖ noise
10 datafusion:vortex-compact +51.4% +17.2% +29.2% +36.2% ➖ noise
10 datafusion:vortex-file-compressed +17.1% +17.2% -0.1% +50.5% ➖ noise
10 duckdb:vortex-compact +7.9% +17.2% -8.0% +42.7% ➖ noise
10 duckdb:vortex-file-compressed +9.9% +17.2% -6.2% +34.1% ➖ noise
11 datafusion:vortex-compact +62.6% -2.2% +66.3% +32.8% 🚨 regression
11 datafusion:vortex-file-compressed +25.7% -2.2% +28.6% +58.1% ➖ noise
11 duckdb:vortex-compact +0.8% -2.2% +3.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +11.7% -2.2% +14.3% +30.0% ➖ noise
12 datafusion:vortex-compact +2.3% -5.2% +8.0% +31.6% ➖ noise
12 datafusion:vortex-file-compressed +49.4% -5.2% +57.6% +32.2% 🚨 regression
12 duckdb:vortex-compact +110.5% -5.2% +122.1% +30.0% 🚨 regression
12 duckdb:vortex-file-compressed +133.2% -5.2% +146.1% +42.3% 🚨 regression
13 datafusion:vortex-compact +7.9% +16.5% -7.3% +44.2% ➖ noise
13 datafusion:vortex-file-compressed +19.7% +16.5% +2.7% +40.5% ➖ noise
13 duckdb:vortex-compact +1.7% +16.5% -12.7% +48.7% ➖ noise
13 duckdb:vortex-file-compressed +16.4% +16.5% -0.1% +54.2% ➖ noise
14 datafusion:vortex-compact +0.5% +18.8% -15.4% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +24.6% +18.8% +4.9% +30.0% ➖ noise
14 duckdb:vortex-compact +71.1% +18.8% +44.1% +30.0% 🚨 regression
14 duckdb:vortex-file-compressed +66.4% +18.8% +40.1% +30.0% 🚨 regression
15 datafusion:vortex-compact +0.7% +6.7% -5.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +47.0% +6.7% +37.7% +30.0% 🚨 regression
15 duckdb:vortex-compact +42.9% +6.7% +33.9% +30.0% 🚨 regression
15 duckdb:vortex-file-compressed +39.6% +6.7% +30.8% +30.0% 🚨 regression
16 datafusion:vortex-compact +9.1% +31.6% -17.1% +40.5% ➖ noise
16 datafusion:vortex-file-compressed +27.3% +31.6% -3.3% +33.3% ➖ noise
16 duckdb:vortex-compact -8.9% +31.6% -30.8% +30.0% ✅ faster
16 duckdb:vortex-file-compressed +12.2% +31.6% -14.8% +51.4% ➖ noise
17 datafusion:vortex-compact -9.1% +6.7% -14.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +10.4% +6.7% +3.5% +42.3% ➖ noise
17 duckdb:vortex-compact +27.4% +6.7% +19.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +56.9% +6.7% +47.1% +30.0% 🚨 regression
18 datafusion:vortex-compact -2.6% +13.9% -14.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +7.3% +13.9% -5.8% +30.0% ➖ noise
18 duckdb:vortex-compact +2.0% +13.9% -10.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -0.6% +13.9% -12.8% +30.0% ➖ noise
19 datafusion:vortex-compact -9.1% +3.8% -12.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +45.4% +3.8% +40.2% +37.2% 🚨 regression
19 duckdb:vortex-compact +28.6% +3.8% +23.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +34.0% +3.8% +29.2% +30.0% ➖ noise
20 datafusion:vortex-compact +26.3% +5.0% +20.2% +31.7% ➖ noise
20 datafusion:vortex-file-compressed +39.4% +5.0% +32.7% +35.6% ➖ noise
20 duckdb:vortex-compact +98.3% +5.0% +88.8% +30.3% 🚨 regression
20 duckdb:vortex-file-compressed +92.7% +5.0% +83.5% +32.7% 🚨 regression
21 datafusion:vortex-compact +35.2% +16.8% +15.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +36.3% +16.8% +16.7% +30.0% ➖ noise
21 duckdb:vortex-compact +46.2% +16.8% +25.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +71.9% +16.8% +47.1% +30.0% 🚨 regression
22 datafusion:vortex-compact +26.1% +5.8% +19.2% +50.1% ➖ noise
22 datafusion:vortex-file-compressed +77.9% +5.8% +68.2% +30.0% 🚨 regression
22 duckdb:vortex-compact +36.8% +5.8% +29.4% +37.8% ➖ noise
22 duckdb:vortex-file-compressed +27.5% +5.8% +20.6% +32.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Compression

Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.032x ➖


unknown / unknown (1.043x ➖, 3↑ 21↓)
name PR f7c78b1 (ns) base b573853 (ns) ratio (PR/base)
compress time/Arade 1266798124 1208947299 1.05
compress time/Bimbo 7234734287 7324704598 0.99
compress time/CMSprovider 3109673342 3077352859 1.01
compress time/Euro2016 448935047 435271793 1.03
compress time/Food 431318348 413242853 1.04
compress time/HashTags 822855414 836507855 0.98
compress time/TPC-H l_comment canonical 1406262328 1290864594 1.09
compress time/TPC-H l_comment chunked 1423955092 1337394388 1.06
compress time/taxi 766921123 734316053 1.04
compress time/wide table cols=100 chunks=1 rows=1000 🚨 13859106 12510355 1.11
compress time/wide table cols=100 chunks=50 rows=1000 🚀 12647339 14115617 0.90
compress time/wide table cols=1000 chunks=1 rows=1000 135182245 125843404 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 🚨 132917076 120374261 1.10
compress time/wide table cols=10000 chunks=1 rows=1000 1325726159 1243180291 1.07
compress time/wide table cols=10000 chunks=50 rows=1000 1343792063 1253557408 1.07
decompress time/Arade 🚨 32405459 29287184 1.11
decompress time/Bimbo 113230884 105223303 1.08
decompress time/CMSprovider 83778489 76574479 1.09
decompress time/Euro2016 🚨 29732055 20828530 1.43
decompress time/Food 9448703 8645318 1.09
decompress time/HashTags 88215365 84594696 1.04
decompress time/TPC-H l_comment canonical 46393414 42526413 1.09
decompress time/TPC-H l_comment chunked 🚨 51153325 42693175 1.20
decompress time/taxi 🚨 22605326 19007993 1.19
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3432701 2599358 1.32
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3191504 2680666 1.19
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 28925595 24328070 1.19
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 25567472 22803581 1.12
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 281383754 243352742 1.16
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 297783654 243910289 1.22
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3326102278 3061083542 1.09
parquet_rs-zstd compress time/Bimbo 18042043973 17347338614 1.04
parquet_rs-zstd compress time/CMSprovider 8344340962 7991130745 1.04
parquet_rs-zstd compress time/Euro2016 1377130708 1351928412 1.02
parquet_rs-zstd compress time/Food 955503565 951859023 1.00
parquet_rs-zstd compress time/HashTags 2566582204 2486754418 1.03
parquet_rs-zstd compress time/TPC-H l_comment canonical 3367329876 3151850330 1.07
parquet_rs-zstd compress time/TPC-H l_comment chunked 3286291429 3103017236 1.06
parquet_rs-zstd compress time/taxi 1630896616 1525879043 1.07
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8869390 6953550 1.28
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 8556985 6769623 1.26
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 91486348 89746954 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90800908 89077910 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 959725427 930186158 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 930342665 945501122 0.98
parquet_rs-zstd decompress time/Arade 675531157 651778558 1.04
parquet_rs-zstd decompress time/Bimbo 1844469130 1786827159 1.03
parquet_rs-zstd decompress time/CMSprovider 2072354339 1951666177 1.06
parquet_rs-zstd decompress time/Euro2016 392683199 386598909 1.02
parquet_rs-zstd decompress time/Food 234634142 226168949 1.04
parquet_rs-zstd decompress time/HashTags 679711993 621596950 1.09
parquet_rs-zstd decompress time/TPC-H l_comment canonical 610906352 572877472 1.07
parquet_rs-zstd decompress time/TPC-H l_comment chunked 601326041 572748454 1.05
parquet_rs-zstd decompress time/taxi 265990209 251131237 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3367580 2777648 1.21
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3154262 2694744 1.17
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 35136616 32466077 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33936884 31913529 1.06
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 389111591 381193718 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 387406243 375340093 1.03
vortex-file-compressed size/Arade 143600332 143600332 1.00
vortex-file-compressed size/Bimbo 510400068 510400068 1.00
vortex-file-compressed size/CMSprovider 448304012 448304012 1.00
vortex-file-compressed size/Euro2016 164462340 164458388 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195864476 195864476 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481896 179481896 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481896 179481896 1.00
vortex-file-compressed size/taxi 51040172 51040172 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.96
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 1.04
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.87
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 2 0.71
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.04
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.41
vortex:parquet-zstd ratio decompress time/Food 0 0 1.05
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.18
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant