Skip to content

perf(layout): evaluate plain struct field projections directly - #10372

Closed
joseph-isaacs wants to merge 2 commits into
developfrom
ji/struct-field-projection
Closed

joseph-isaacs wants to merge 2 commits into
developfrom
ji/struct-field-projection

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Plain multi-column struct projections rebuild partition packs and expression arrays for each batch. Recognize projections made entirely of root-field accesses, evaluate the child readers directly, and assemble the requested struct. Computed expressions retain the general evaluator.

Changes

Regression cases cover reordered and repeated fields, output nullability, parent nulls, row masks, and computed-projection fallback.

Validation

  • cargo test -p vortex-layout --lib --locked -j2 layouts::struct_::reader:: — 12 passed.

Signed-off-by: Joseph Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5500ebb fineweb 1 Explore Profiling Data
🟢 Done 5500ebb random-access-bench 1 Explore Profiling Data
🟢 Done 5500ebb statpopgen 1 Explore Profiling Data
🟢 Done 5500ebb clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 5500ebb tpch-nvme-10 1 Explore Profiling Data
🟢 Done 5500ebb tpch-s3-10 1 Explore Profiling Data
🟢 Done 5500ebb tpcds-nvme 1 Explore Profiling Data
🟢 Done 5500ebb clickbench-nvme 1 Explore Profiling Data
🟢 Done 5500ebb fineweb-s3 1 Explore Profiling Data
🟢 Done 5500ebb appian-nvme 1 Explore Profiling Data
🟢 Done 5500ebb tpch-s3 1 Explore Profiling Data
🟢 Done 5500ebb polarsignals 1 Explore Profiling Data
🟢 Done 5500ebb tpch-nvme 1 Explore Profiling Data
🟢 Done 5500ebb compress-bench 1 Explore Profiling Data
🟢 Done 5500ebb string-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 5500ebbe vs base 46d518b4
Vortex (geomean): hot 0.997x ➖ · cold 0.929x ➖


datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57386934 / 57381298 / +0.0% 101366533 / 110235871 / -8.0% 0.57 / 0.52 / +8.8%
polarsignals_q01/datafusion:vortex-file-compressed 63315362 / 63767749 / -0.7% 122782211 / 129308849 / -5.0% 0.52 / 0.49 / +4.6%
polarsignals_q02/datafusion:vortex-file-compressed 72687492 / 71166094 / +2.1% 113963912 / 115933660 / -1.7% 0.64 / 0.61 / +3.9%
polarsignals_q03/datafusion:vortex-file-compressed 79473097 / 78989732 / +0.6% 138899745 / 143607707 / -3.3% 0.57 / 0.55 / +4.0%
polarsignals_q04/datafusion:vortex-file-compressed 9513096 / 9612618 / -1.0% 46621024 / 54814778 / -14.9% 🟢 0.20 / 0.18 / +16.4%
polarsignals_q05/datafusion:vortex-file-compressed 24472374 / 24368274 / +0.4% 63334143 / 70563463 / -10.2% 🟢 0.39 / 0.35 / +11.9%
polarsignals_q06/datafusion:vortex-file-compressed 20969992 / 21910222 / -4.3% 63185808 / 67060044 / -5.8% 0.33 / 0.33 / +1.6%
polarsignals_q07/datafusion:vortex-file-compressed 39493669 / 39964504 / -1.2% 79659100 / 83690959 / -4.8% 0.50 / 0.48 / +3.8%
polarsignals_q08/datafusion:vortex-file-compressed 98903657 / 97979458 / +0.9% 164075639 / 167547011 / -2.1% 0.60 / 0.58 / +3.1%
polarsignals_q09/datafusion:vortex-file-compressed 10054301 / 10036479 / +0.2% 46453596 / 53880298 / -13.8% 🟢 0.22 / 0.19 / +16.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 5500ebbe vs base 46d518b4


vortex / vortex-file-compressed / ms (1.002x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.918 / 32.992984 / -0.2%
read/clickbench/URL/shard-0/onpair-12 21.289075 / 21.168988 / +0.6%
read/tpch/l_comment/fsst 58.101089 / 57.803587 / +0.5%
read/tpch/l_comment/onpair-12 53.825916 / 53.671631 / +0.3%
write/clickbench/URL/shard-0/fsst 591.113202 / 590.049175 / +0.2%
write/clickbench/URL/shard-0/onpair-12 963.103965 / 965.596631 / -0.3%
write/tpch/l_comment/fsst 1911.66483 / 1908.00846 / +0.2%
write/tpch/l_comment/onpair-12 2072.07397 / 2062.16071 / +0.5%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.984x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16795425 / 16454630 / +2.1% 45054147 / 47275650 / -4.7% 0.37 / 0.35 / +7.1%
tpch_q02/datafusion:vortex-file-compressed 17577876 / 17356909 / +1.3% 35010168 / 37520832 / -6.7% 0.50 / 0.46 / +8.5%
tpch_q03/datafusion:vortex-file-compressed 19165480 / 19294463 / -0.7% 46799203 / 48685675 / -3.9% 0.41 / 0.40 / +3.3%
tpch_q04/datafusion:vortex-file-compressed 9972697 / 10173482 / -2.0% 29365951 / 34989565 / -16.1% 🟢 0.34 / 0.29 / +16.8%
tpch_q05/datafusion:vortex-file-compressed 36986851 / 36895440 / +0.2% 64485903 / 68417108 / -5.7% 0.57 / 0.54 / +6.4%
tpch_q06/datafusion:vortex-file-compressed 6212095 / 6093075 / +2.0% 27946417 / 29802591 / -6.2% 0.22 / 0.20 / +8.7%
tpch_q07/datafusion:vortex-file-compressed 52344335 / 52726935 / -0.7% 72812168 / 81976942 / -11.2% 🟢 0.72 / 0.64 / +11.8%
tpch_q08/datafusion:vortex-file-compressed 51645875 / 52525226 / -1.7% 80863952 / 81538975 / -0.8% 0.64 / 0.64 / -0.9%
tpch_q09/datafusion:vortex-file-compressed 49467538 / 49938152 / -0.9% 76724423 / 75263354 / +1.9% 0.64 / 0.66 / -2.8%
tpch_q10/datafusion:vortex-file-compressed 16801607 / 16917240 / -0.7% 48601126 / 50334993 / -3.4% 0.35 / 0.34 / +2.9%
tpch_q11/datafusion:vortex-file-compressed 15218957 / 15042928 / +1.2% 31859064 / 34757872 / -8.3% 0.48 / 0.43 / +10.4%
tpch_q12/datafusion:vortex-file-compressed 22222859 / 22371290 / -0.7% 43037842 / 49311753 / -12.7% 🟢 0.52 / 0.45 / +13.8%
tpch_q13/datafusion:vortex-file-compressed 19927037 / 20063755 / -0.7% 41375039 / 41427174 / -0.1% 0.48 / 0.48 / -0.6%
tpch_q14/datafusion:vortex-file-compressed 15033941 / 14625112 / +2.8% 38266215 / 40876275 / -6.4% 0.39 / 0.36 / +9.8%
tpch_q15/datafusion:vortex-file-compressed 18301973 / 18556639 / -1.4% 44976784 / 48546330 / -7.4% 0.41 / 0.38 / +6.5%
tpch_q16/datafusion:vortex-file-compressed 18604015 / 18821564 / -1.2% 36335318 / 38506501 / -5.6% 0.51 / 0.49 / +4.8%
tpch_q17/datafusion:vortex-file-compressed 28171387 / 27919180 / +0.9% 57572009 / 59946617 / -4.0% 0.49 / 0.47 / +5.1%
tpch_q18/datafusion:vortex-file-compressed 36361316 / 36909323 / -1.5% 56612603 / 57877050 / -2.2% 0.64 / 0.64 / +0.7%
tpch_q19/datafusion:vortex-file-compressed 13635378 / 13445082 / +1.4% 36127849 / 39792157 / -9.2% 0.38 / 0.34 / +11.7%
tpch_q20/datafusion:vortex-file-compressed 20860767 / 21167074 / -1.4% 43751550 / 46462011 / -5.8% 0.48 / 0.46 / +4.7%
tpch_q21/datafusion:vortex-file-compressed 39274367 / 39427091 / -0.4% 64908001 / 69859387 / -7.1% 0.61 / 0.56 / +7.2%
tpch_q22/datafusion:vortex-file-compressed 11232206 / 11614017 / -3.3% 30054130 / 32350278 / -7.1% 0.37 / 0.36 / +4.1%
datafusion / vortex-compact / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18320790 / 17884239 / +2.4% 42905890 / 43643907 / -1.7% 0.43 / 0.41 / +4.2%
tpch_q02/datafusion:vortex-compact 19591791 / 19931720 / -1.7% 36114024 / 37409508 / -3.5% 0.54 / 0.53 / +1.8%
tpch_q03/datafusion:vortex-compact 20711074 / 19843542 / +4.4% 46824996 / 48471672 / -3.4% 0.44 / 0.41 / +8.0%
tpch_q04/datafusion:vortex-compact 12165493 / 11225592 / +8.4% 29714661 / 32121205 / -7.5% 0.41 / 0.35 / +17.1%
tpch_q05/datafusion:vortex-compact 37780957 / 38250158 / -1.2% 65409704 / 67114799 / -2.5% 0.58 / 0.57 / +1.3%
tpch_q06/datafusion:vortex-compact 6913827 / 6705499 / +3.1% 27611869 / 30832478 / -10.4% 🟢 0.25 / 0.22 / +15.1%
tpch_q07/datafusion:vortex-compact 52497409 / 52807859 / -0.6% 78943154 / 74776599 / +5.6% 0.67 / 0.71 / -5.8%
tpch_q08/datafusion:vortex-compact 52227874 / 52956164 / -1.4% 81194268 / 85988597 / -5.6% 0.64 / 0.62 / +4.4%
tpch_q09/datafusion:vortex-compact 51811379 / 50611923 / +2.4% 75713476 / 81828813 / -7.5% 0.68 / 0.62 / +10.6%
tpch_q10/datafusion:vortex-compact 19035606 / 18919982 / +0.6% 46761158 / 48433894 / -3.5% 0.41 / 0.39 / +4.2%
tpch_q11/datafusion:vortex-compact 16270949 / 16183705 / +0.5% 33056431 / 34619747 / -4.5% 0.49 / 0.47 / +5.3%
tpch_q12/datafusion:vortex-compact 23970052 / 24153511 / -0.8% 43282085 / 48327935 / -10.4% 🟢 0.55 / 0.50 / +10.8%
tpch_q13/datafusion:vortex-compact 21097564 / 21213348 / -0.5% 39052879 / 40759253 / -4.2% 0.54 / 0.52 / +3.8%
tpch_q14/datafusion:vortex-compact 16327708 / 15857400 / +3.0% 41294473 / 42654683 / -3.2% 0.40 / 0.37 / +6.4%
tpch_q15/datafusion:vortex-compact 20103551 / 19845603 / +1.3% 44757113 / 47918820 / -6.6% 0.45 / 0.41 / +8.5%
tpch_q16/datafusion:vortex-compact 19225285 / 18291615 / +5.1% 37729705 / 38309772 / -1.5% 0.51 / 0.48 / +6.7%
tpch_q17/datafusion:vortex-compact 28785332 / 28790819 / -0.0% 55389739 / 58907179 / -6.0% 0.52 / 0.49 / +6.3%
tpch_q18/datafusion:vortex-compact 38161474 / 38376559 / -0.6% 56686849 / 57192910 / -0.9% 0.67 / 0.67 / +0.3%
tpch_q19/datafusion:vortex-compact 16561443 / 16436511 / +0.8% 39474110 / 42927922 / -8.0% 0.42 / 0.38 / +9.6%
tpch_q20/datafusion:vortex-compact 22308203 / 21609640 / +3.2% 44178720 / 46285158 / -4.6% 0.50 / 0.47 / +8.2%
tpch_q21/datafusion:vortex-compact 42412238 / 41011479 / +3.4% 69446851 / 69557054 / -0.2% 0.61 / 0.59 / +3.6%
tpch_q22/datafusion:vortex-compact 11776923 / 11676968 / +0.9% 30688862 / 31511004 / -2.6% 0.38 / 0.37 / +3.6%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72448181 / 72357904 / +0.1% 86821659 / 92164165 / -5.8% 0.83 / 0.79 / +6.3%
tpch_q02/datafusion:parquet 57402726 / 56518072 / +1.6% 73756465 / 77114333 / -4.4% 0.78 / 0.73 / +6.2%
tpch_q03/datafusion:parquet 84384884 / 84176193 / +0.2% 106446395 / 112843570 / -5.7% 0.79 / 0.75 / +6.3%
tpch_q04/datafusion:parquet 46236519 / 46904585 / -1.4% 61239390 / 67954235 / -9.9% 0.76 / 0.69 / +9.4%
tpch_q05/datafusion:parquet 99999326 / 99726058 / +0.3% 125961142 / 133784172 / -5.8% 0.79 / 0.75 / +6.5%
tpch_q06/datafusion:parquet 31867614 / 32063682 / -0.6% 48693831 / 52822788 / -7.8% 0.65 / 0.61 / +7.8%
tpch_q07/datafusion:parquet 104700654 / 104627104 / +0.1% 129899605 / 133338822 / -2.6% 0.81 / 0.78 / +2.7%
tpch_q08/datafusion:parquet 113359343 / 111248354 / +1.9% 133966113 / 144524508 / -7.3% 0.85 / 0.77 / +9.9%
tpch_q09/datafusion:parquet 130609028 / 131661749 / -0.8% 156181166 / 165525300 / -5.6% 0.84 / 0.80 / +5.1%
tpch_q10/datafusion:parquet 104120457 / 104291194 / -0.2% 131680205 / 133661837 / -1.5% 0.79 / 0.78 / +1.3%
tpch_q11/datafusion:parquet 41723489 / 42176250 / -1.1% 63290949 / 67512732 / -6.3% 0.66 / 0.62 / +5.5%
tpch_q12/datafusion:parquet 69370193 / 69217857 / +0.2% 90021621 / 94266163 / -4.5% 0.77 / 0.73 / +4.9%
tpch_q13/datafusion:parquet 186883573 / 187434080 / -0.3% 206773143 / 210545401 / -1.8% 0.90 / 0.89 / +1.5%
tpch_q14/datafusion:parquet 48395403 / 48284810 / +0.2% 72411102 / 77417298 / -6.5% 0.67 / 0.62 / +7.2%
tpch_q15/datafusion:parquet 54495541 / 55218337 / -1.3% 74304606 / 79326133 / -6.3% 0.73 / 0.70 / +5.4%
tpch_q16/datafusion:parquet 40758705 / 40814572 / -0.1% 56577036 / 59629822 / -5.1% 0.72 / 0.68 / +5.3%
tpch_q17/datafusion:parquet 128601896 / 130745902 / -1.6% 149505038 / 155997657 / -4.2% 0.86 / 0.84 / +2.6%
tpch_q18/datafusion:parquet 130338613 / 130745762 / -0.3% 151012820 / 152682914 / -1.1% 0.86 / 0.86 / +0.8%
tpch_q19/datafusion:parquet 58968772 / 59268730 / -0.5% 82840717 / 90688176 / -8.7% 0.71 / 0.65 / +8.9%
tpch_q20/datafusion:parquet 66958764 / 67367332 / -0.6% 90283631 / 94761768 / -4.7% 0.74 / 0.71 / +4.3%
tpch_q21/datafusion:parquet 108496985 / 108660995 / -0.2% 129429532 / 130254843 / -0.6% 0.84 / 0.83 / +0.5%
tpch_q22/datafusion:parquet 47254338 / 47623535 / -0.8% 64528736 / 65363877 / -1.3% 0.73 / 0.73 / +0.5%
duckdb / vortex-file-compressed / ns (1.010x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9135138 / 10476896 / -12.8% 🟢 18701091 / 19106756 / -2.1% 0.49 / 0.55 / -10.9%
tpch_q02/duckdb:vortex-file-compressed 17492595 / 17331122 / +0.9% 26871561 / 26572759 / +1.1% 0.65 / 0.65 / -0.2%
tpch_q03/duckdb:vortex-file-compressed 18358987 / 18157483 / +1.1% 33053311 / 35821723 / -7.7% 0.56 / 0.51 / +9.6%
tpch_q04/duckdb:vortex-file-compressed 17124171 / 17549475 / -2.4% 30137985 / 31283730 / -3.7% 0.57 / 0.56 / +1.3%
tpch_q05/duckdb:vortex-file-compressed 21779862 / 22134284 / -1.6% 41578395 / 37441798 / +11.0% 🔴 0.52 / 0.59 / -11.4%
tpch_q06/duckdb:vortex-file-compressed 7488946 / 5615456 / +33.4% 🔴 18765698 / 14336981 / +30.9% 🔴 0.40 / 0.39 / +1.9%
tpch_q07/duckdb:vortex-file-compressed 20189446 / 20514118 / -1.6% 35491721 / 38840108 / -8.6% 0.57 / 0.53 / +7.7%
tpch_q08/duckdb:vortex-file-compressed 23412991 / 23107491 / +1.3% 40268510 / 39541536 / +1.8% 0.58 / 0.58 / -0.5%
tpch_q09/duckdb:vortex-file-compressed 28523603 / 30050045 / -5.1% 50490246 / 47691091 / +5.9% 0.56 / 0.63 / -10.3%
tpch_q10/duckdb:vortex-file-compressed 28118828 / 27374923 / +2.7% 44857473 / 44112793 / +1.7% 0.63 / 0.62 / +1.0%
tpch_q11/duckdb:vortex-file-compressed 8804090 / 8748732 / +0.6% 14967884 / 14143805 / +5.8% 0.59 / 0.62 / -4.9%
tpch_q12/duckdb:vortex-file-compressed 16068856 / 17694455 / -9.2% 34226509 / 33281346 / +2.8% 0.47 / 0.53 / -11.7%
tpch_q13/duckdb:vortex-file-compressed 22555885 / 22180346 / +1.7% 41605519 / 42043430 / -1.0% 0.54 / 0.53 / +2.8%
tpch_q14/duckdb:vortex-file-compressed 13437799 / 13403154 / +0.3% 30482835 / 25582893 / +19.2% 🔴 0.44 / 0.52 / -15.9%
tpch_q15/duckdb:vortex-file-compressed 10109843 / 9760734 / +3.6% 18133626 / 19771083 / -8.3% 0.56 / 0.49 / +12.9%
tpch_q16/duckdb:vortex-file-compressed 19520370 / 18143911 / +7.6% 26647664 / 23776906 / +12.1% 🔴 0.73 / 0.76 / -4.0%
tpch_q17/duckdb:vortex-file-compressed 16120396 / 15483901 / +4.1% 36690113 / 33865478 / +8.3% 0.44 / 0.46 / -3.9%
tpch_q18/duckdb:vortex-file-compressed 25802481 / 25109901 / +2.8% 36924795 / 37410667 / -1.3% 0.70 / 0.67 / +4.1%
tpch_q19/duckdb:vortex-file-compressed 23901369 / 23513147 / +1.7% 37014329 / 35012628 / +5.7% 0.65 / 0.67 / -3.8%
tpch_q20/duckdb:vortex-file-compressed 17783267 / 16903756 / +5.2% 33505087 / 34776878 / -3.7% 0.53 / 0.49 / +9.2%
tpch_q21/duckdb:vortex-file-compressed 66444625 / 66418728 / +0.0% 82435279 / 82100179 / +0.4% 0.81 / 0.81 / -0.4%
tpch_q22/duckdb:vortex-file-compressed 12300912 / 13007668 / -5.4% 21360419 / 20453588 / +4.4% 0.58 / 0.64 / -9.4%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 12081385 / 13179764 / -8.3% 23459450 / 21540940 / +8.9% 0.51 / 0.61 / -15.8%
tpch_q02/duckdb:vortex-compact 19851718 / 19820883 / +0.2% 28394510 / 28546064 / -0.5% 0.70 / 0.69 / +0.7%
tpch_q03/duckdb:vortex-compact 19550139 / 19278947 / +1.4% 35083078 / 35388392 / -0.9% 0.56 / 0.54 / +2.3%
tpch_q04/duckdb:vortex-compact 18179020 / 18384430 / -1.1% 29204874 / 30997368 / -5.8% 0.62 / 0.59 / +5.0%
tpch_q05/duckdb:vortex-compact 22136171 / 22419620 / -1.3% 34924124 / 39306372 / -11.1% 🟢 0.63 / 0.57 / +11.1%
tpch_q06/duckdb:vortex-compact 5640199 / 5722678 / -1.4% 16679314 / 16535167 / +0.9% 0.34 / 0.35 / -2.3%
tpch_q07/duckdb:vortex-compact 21216882 / 21744551 / -2.4% 37588935 / 35166081 / +6.9% 0.56 / 0.62 / -8.7%
tpch_q08/duckdb:vortex-compact 25802951 / 25288896 / +2.0% 40787350 / 41289811 / -1.2% 0.63 / 0.61 / +3.3%
tpch_q09/duckdb:vortex-compact 31323065 / 29624097 / +5.7% 51842056 / 49113269 / +5.6% 0.60 / 0.60 / +0.2%
tpch_q10/duckdb:vortex-compact 29056200 / 30128695 / -3.6% 44619698 / 47494337 / -6.1% 0.65 / 0.63 / +2.7%
tpch_q11/duckdb:vortex-compact 10079348 / 9780923 / +3.1% 19480538 / 15538162 / +25.4% 🔴 0.52 / 0.63 / -17.8%
tpch_q12/duckdb:vortex-compact 18504081 / 18017485 / +2.7% 33380933 / 31111486 / +7.3% 0.55 / 0.58 / -4.3%
tpch_q13/duckdb:vortex-compact 22553377 / 22629238 / -0.3% 44352422 / 46067331 / -3.7% 0.51 / 0.49 / +3.5%
tpch_q14/duckdb:vortex-compact 14443836 / 15193938 / -4.9% 25172610 / 25812943 / -2.5% 0.57 / 0.59 / -2.5%
tpch_q15/duckdb:vortex-compact 11310086 / 9890288 / +14.4% 🔴 25767485 / 22145495 / +16.4% 🔴 0.44 / 0.45 / -1.7%
tpch_q16/duckdb:vortex-compact 20729623 / 20298059 / +2.1% 24799344 / 25491166 / -2.7% 0.84 / 0.80 / +5.0%
tpch_q17/duckdb:vortex-compact 16590159 / 15464922 / +7.3% 32523472 / 30998071 / +4.9% 0.51 / 0.50 / +2.2%
tpch_q18/duckdb:vortex-compact 26582622 / 27009482 / -1.6% 36734057 / 37169823 / -1.2% 0.72 / 0.73 / -0.4%
tpch_q19/duckdb:vortex-compact 23967754 / 26124786 / -8.3% 35434014 / 39612516 / -10.5% 🟢 0.68 / 0.66 / +2.6%
tpch_q20/duckdb:vortex-compact 19107612 / 18936581 / +0.9% 38656933 / 35076253 / +10.2% 🔴 0.49 / 0.54 / -8.4%
tpch_q21/duckdb:vortex-compact 67622370 / 70030466 / -3.4% 82319489 / 91018618 / -9.6% 0.82 / 0.77 / +6.8%
tpch_q22/duckdb:vortex-compact 12962684 / 12814833 / +1.2% 21447052 / 22451726 / -4.5% 0.60 / 0.57 / +5.9%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 63375218 / 63078248 / +0.5% 69631280 / 69674853 / -0.1% 0.91 / 0.91 / +0.5%
tpch_q02/duckdb:parquet 38141033 / 37827887 / +0.8% 48028062 / 45404745 / +5.8% 0.79 / 0.83 / -4.7%
tpch_q03/duckdb:parquet 68506707 / 67856020 / +1.0% 80100592 / 78724618 / +1.7% 0.86 / 0.86 / -0.8%
tpch_q04/duckdb:parquet 49948174 / 46727028 / +6.9% 58981996 / 56062043 / +5.2% 0.85 / 0.83 / +1.6%
tpch_q05/duckdb:parquet 66294594 / 66074076 / +0.3% 77827888 / 80607265 / -3.4% 0.85 / 0.82 / +3.9%
tpch_q06/duckdb:parquet 22192453 / 21961255 / +1.1% 27186762 / 26499113 / +2.6% 0.82 / 0.83 / -1.5%
tpch_q07/duckdb:parquet 65606786 / 65337012 / +0.4% 76064122 / 75810794 / +0.3% 0.86 / 0.86 / +0.1%
tpch_q08/duckdb:parquet 80853170 / 80049521 / +1.0% 92729896 / 91763719 / +1.1% 0.87 / 0.87 / -0.0%
tpch_q09/duckdb:parquet 120691694 / 119957493 / +0.6% 133015491 / 132534530 / +0.4% 0.91 / 0.91 / +0.2%
tpch_q10/duckdb:parquet 120399579 / 122301671 / -1.6% 133288152 / 135166163 / -1.4% 0.90 / 0.90 / -0.2%
tpch_q11/duckdb:parquet 21480346 / 21320067 / +0.8% 26083240 / 24854354 / +4.9% 0.82 / 0.86 / -4.0%
tpch_q12/duckdb:parquet 45212305 / 44808501 / +0.9% 52430670 / 51705190 / +1.4% 0.86 / 0.87 / -0.5%
tpch_q13/duckdb:parquet 244730552 / 244044117 / +0.3% 253773926 / 253075276 / +0.3% 0.96 / 0.96 / +0.0%
tpch_q14/duckdb:parquet 47604656 / 47366543 / +0.5% 56178752 / 56746024 / -1.0% 0.85 / 0.83 / +1.5%
tpch_q15/duckdb:parquet 27105354 / 29031843 / -6.6% 35533345 / 33210389 / +7.0% 0.76 / 0.87 / -12.7%
tpch_q16/duckdb:parquet 51599902 / 52392107 / -1.5% 59975701 / 58470110 / +2.6% 0.86 / 0.90 / -4.0%
tpch_q17/duckdb:parquet 49505832 / 49002917 / +1.0% 59490484 / 59256381 / +0.4% 0.83 / 0.83 / +0.6%
tpch_q18/duckdb:parquet 96643280 / 96867447 / -0.2% 107496522 / 104428766 / +2.9% 0.90 / 0.93 / -3.1%
tpch_q19/duckdb:parquet 65634405 / 64936805 / +1.1% 75264460 / 75497775 / -0.3% 0.87 / 0.86 / +1.4%
tpch_q20/duckdb:parquet 62533613 / 61680671 / +1.4% 75330104 / 73945672 / +1.9% 0.83 / 0.83 / -0.5%
tpch_q21/duckdb:parquet 143887781 / 141843938 / +1.4% 164884603 / 152466329 / +8.1% 0.87 / 0.93 / -6.2%
tpch_q22/duckdb:parquet 51984281 / 51530036 / +0.9% 58979744 / 59099066 / -0.2% 0.88 / 0.87 / +1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 5500ebbe vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (-6.4%, environment too noisy confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.957x ➖
Parquet (geomean): hot 1.030x ➖ · cold 0.974x ➖
Shifts: Parquet (control) +3.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 185646892 / 194286795 / -4.4% 526267059 / 707893739 / -25.7% 🟢 0.35 / 0.27 / +28.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11414420 / 11496304 / -0.7% 47083328 / 50323534 / -6.4% 0.24 / 0.23 / +6.1%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11853848 / 11281940 / +5.1% 46957155 / 50813278 / -7.6% 0.25 / 0.22 / +13.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23961579 / 23566252 / +1.7% 66881923 / 70295699 / -4.9% 0.36 / 0.34 / +6.9%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18094205 / 18768734 / -3.6% 61087806 / 61817585 / -1.2% 0.30 / 0.30 / -2.4%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17763552 / 17295972 / +2.7% 57695707 / 62347073 / -7.5% 0.31 / 0.28 / +11.0%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41000162 / 41419039 / -1.0% 90847900 / 96801634 / -6.2% 0.45 / 0.43 / +5.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12172157 / 12335910 / -1.3% 41380824 / 47475395 / -12.8% 🟢 0.29 / 0.26 / +13.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11709458 / 12477235 / -6.2% 43140200 / 46055313 / -6.3% 0.27 / 0.27 / +0.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9917829 / 9660308 / +2.7% 34564619 / 37736821 / -8.4% 0.29 / 0.26 / +12.1%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 211888404 / 197362209 / +7.4% 570202712 / 461563084 / +23.5% 🔴 0.37 / 0.43 / -13.1%
clickbench-sorted_q24/datafusion:vortex-compact 21297944 / 22557619 / -5.6% 50759566 / 53802778 / -5.7% 0.42 / 0.42 / +0.1%
clickbench-sorted_q26/datafusion:vortex-compact 22791934 / 23296609 / -2.2% 51102736 / 52136778 / -2.0% 0.45 / 0.45 / -0.2%
clickbench-sorted_q36/datafusion:vortex-compact 26607010 / 26619052 / -0.0% 64887516 / 70201594 / -7.6% 0.41 / 0.38 / +8.1%
clickbench-sorted_q37/datafusion:vortex-compact 21708023 / 22276162 / -2.6% 64469404 / 69686623 / -7.5% 0.34 / 0.32 / +5.3%
clickbench-sorted_q38/datafusion:vortex-compact 21091780 / 21046482 / +0.2% 64014149 / 66844077 / -4.2% 0.33 / 0.31 / +4.6%
clickbench-sorted_q39/datafusion:vortex-compact 43913134 / 44442296 / -1.2% 81208738 / 90586179 / -10.4% 🟢 0.54 / 0.49 / +10.2%
clickbench-sorted_q40/datafusion:vortex-compact 14755961 / 14452891 / +2.1% 41365774 / 47190977 / -12.3% 🟢 0.36 / 0.31 / +16.5%
clickbench-sorted_q41/datafusion:vortex-compact 13860765 / 14347142 / -3.4% 43752410 / 51968082 / -15.8% 🟢 0.32 / 0.28 / +14.8%
clickbench-sorted_q42/datafusion:vortex-compact 11111058 / 10837816 / +2.5% 34546963 / 38481731 / -10.2% 🟢 0.32 / 0.28 / +14.2%
datafusion / parquet / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 764580176 / 763762197 / +0.1% 960077960 / 979558953 / -2.0% 0.80 / 0.78 / +2.1%
clickbench-sorted_q24/datafusion:parquet 9315186 / 8868106 / +5.0% 70520308 / 71497648 / -1.4% 0.13 / 0.12 / +6.5%
clickbench-sorted_q26/datafusion:parquet 9201517 / 9224361 / -0.2% 70583969 / 74206330 / -4.9% 0.13 / 0.12 / +4.9%
clickbench-sorted_q36/datafusion:parquet 94565601 / 94086892 / +0.5% 171559524 / 170576835 / +0.6% 0.55 / 0.55 / -0.1%
clickbench-sorted_q37/datafusion:parquet 64961320 / 64074848 / +1.4% 130981506 / 133162251 / -1.6% 0.50 / 0.48 / +3.1%
clickbench-sorted_q38/datafusion:parquet 88025758 / 87460906 / +0.6% 162947642 / 166931857 / -2.4% 0.54 / 0.52 / +3.1%
clickbench-sorted_q39/datafusion:parquet 161650122 / 160295113 / +0.8% 235459335 / 237717485 / -0.9% 0.69 / 0.67 / +1.8%
clickbench-sorted_q40/datafusion:parquet 44929922 / 44265278 / +1.5% 114382493 / 119909165 / -4.6% 0.39 / 0.37 / +6.4%
clickbench-sorted_q41/datafusion:parquet 42773856 / 41949003 / +2.0% 110973489 / 115677587 / -4.1% 0.39 / 0.36 / +6.3%
clickbench-sorted_q42/datafusion:parquet 26203456 / 26133354 / +0.3% 85701789 / 89302343 / -4.0% 0.31 / 0.29 / +4.5%
duckdb / vortex-file-compressed / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 56994364 / 56999964 / -0.0% 74533807 / 88466068 / -15.7% 🟢 0.76 / 0.64 / +18.7%
clickbench-sorted_q24/duckdb:vortex-file-compressed 19383740 / 18796086 / +3.1% 37957998 / 36967781 / +2.7% 0.51 / 0.51 / +0.4%
clickbench-sorted_q26/duckdb:vortex-file-compressed 13713004 / 15888116 / -13.7% 🟢 26171949 / 22907945 / +14.2% 🔴 0.52 / 0.69 / -24.5%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29084061 / 30609335 / -5.0% 60212983 / 62619464 / -3.8% 0.48 / 0.49 / -1.2%
clickbench-sorted_q37/duckdb:vortex-file-compressed 24008974 / 23395180 / +2.6% 51239296 / 51493783 / -0.5% 0.47 / 0.45 / +3.1%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25399484 / 25923519 / -2.0% 55283587 / 58291207 / -5.2% 0.46 / 0.44 / +3.3%
clickbench-sorted_q39/duckdb:vortex-file-compressed 47330216 / 46695576 / +1.4% 94177290 / 101420607 / -7.1% 0.50 / 0.46 / +9.2%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15193372 / 15687252 / -3.1% 36343211 / 39820244 / -8.7% 0.42 / 0.39 / +6.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15794702 / 15683418 / +0.7% 38162829 / 41257283 / -7.5% 0.41 / 0.38 / +8.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13202616 / 12030921 / +9.7% 34619491 / 30166996 / +14.8% 🔴 0.38 / 0.40 / -4.4%
duckdb / vortex-compact / ns (0.970x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 64314504 / 66251248 / -2.9% 89249570 / 82539807 / +8.1% 0.72 / 0.80 / -10.2%
clickbench-sorted_q24/duckdb:vortex-compact 23728680 / 24193872 / -1.9% 34393631 / 32268997 / +6.6% 0.69 / 0.75 / -8.0%
clickbench-sorted_q26/duckdb:vortex-compact 17616088 / 18677297 / -5.7% 29530943 / 31842970 / -7.3% 0.60 / 0.59 / +1.7%
clickbench-sorted_q36/duckdb:vortex-compact 35441805 / 34098778 / +3.9% 68052357 / 69822853 / -2.5% 0.52 / 0.49 / +6.6%
clickbench-sorted_q37/duckdb:vortex-compact 29987888 / 27929548 / +7.4% 62980888 / 63334755 / -0.6% 0.48 / 0.44 / +8.0%
clickbench-sorted_q38/duckdb:vortex-compact 30689156 / 30645115 / +0.1% 60667868 / 64967511 / -6.6% 0.51 / 0.47 / +7.2%
clickbench-sorted_q39/duckdb:vortex-compact 60571258 / 58726630 / +3.1% 97760453 / 100380525 / -2.6% 0.62 / 0.59 / +5.9%
clickbench-sorted_q40/duckdb:vortex-compact 17677972 / 19028861 / -7.1% 37773157 / 38993836 / -3.1% 0.47 / 0.49 / -4.1%
clickbench-sorted_q41/duckdb:vortex-compact 17419598 / 19716304 / -11.6% 🟢 40957439 / 39133720 / +4.7% 0.43 / 0.50 / -15.6%
clickbench-sorted_q42/duckdb:vortex-compact 13299732 / 15299266 / -13.1% 🟢 31806729 / 30991727 / +2.6% 0.42 / 0.49 / -15.3%
duckdb / parquet / ns (1.048x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 125819460 / 129526524 / -2.9% 152276601 / 143260796 / +6.3% 0.83 / 0.90 / -8.6%
clickbench-sorted_q24/duckdb:parquet 19089186 / 17097256 / +11.7% 🔴 25966823 / 29745535 / -12.7% 🟢 0.74 / 0.57 / +27.9%
clickbench-sorted_q26/duckdb:parquet 15843172 / 12760536 / +24.2% 🔴 25971495 / 24240641 / +7.1% 0.61 / 0.53 / +15.9%
clickbench-sorted_q36/duckdb:parquet 45466346 / 42967766 / +5.8% 61531814 / 64191318 / -4.1% 0.74 / 0.67 / +10.4%
clickbench-sorted_q37/duckdb:parquet 32839048 / 31640985 / +3.8% 47998993 / 48781619 / -1.6% 0.68 / 0.65 / +5.5%
clickbench-sorted_q38/duckdb:parquet 41125992 / 38283742 / +7.4% 58791538 / 61418695 / -4.3% 0.70 / 0.62 / +12.2%
clickbench-sorted_q39/duckdb:parquet 73134290 / 71438060 / +2.4% 86822907 / 85083449 / +2.0% 0.84 / 0.84 / +0.3%
clickbench-sorted_q40/duckdb:parquet 17492574 / 17010950 / +2.8% 41028199 / 41552683 / -1.3% 0.43 / 0.41 / +4.1%
clickbench-sorted_q41/duckdb:parquet 16582198 / 17539022 / -5.5% 37587021 / 41492929 / -9.4% 0.44 / 0.42 / +4.4%
clickbench-sorted_q42/duckdb:parquet 11146030 / 11011320 / +1.2% 23836594 / 25468573 / -6.4% 0.47 / 0.43 / +8.2%

File Size Changes (200 files changed, -0.0% overall, 98↑ 102↓)
File Scale Format Base HEAD Change %
hits_080.vortex 1.0 vortex-compact 94.19 MB 96.43 MB +2.24 MB +2.4%
hits_038.vortex 1.0 vortex-file-compressed 189.69 MB 193.13 MB +3.44 MB +1.8%
hits_024.vortex 1.0 vortex-compact 123.34 MB 124.94 MB +1.60 MB +1.3%
hits_026.vortex 1.0 vortex-compact 97.58 MB 98.71 MB +1.13 MB +1.2%
hits_096.vortex 1.0 vortex-file-compressed 199.09 MB 200.58 MB +1.50 MB +0.8%
hits_038.vortex 1.0 vortex-compact 138.26 MB 139.29 MB +1.03 MB +0.7%
hits_033.vortex 1.0 vortex-file-compressed 199.63 MB 201.01 MB +1.38 MB +0.7%
hits_018.vortex 1.0 vortex-file-compressed 199.39 MB 200.72 MB +1.33 MB +0.7%
hits_089.vortex 1.0 vortex-compact 98.65 MB 99.30 MB +663.91 KB +0.7%
hits_034.vortex 1.0 vortex-compact 132.32 MB 133.15 MB +851.04 KB +0.6%
hits_098.vortex 1.0 vortex-file-compressed 137.77 MB 138.51 MB +755.33 KB +0.5%
hits_066.vortex 1.0 vortex-compact 117.41 MB 117.97 MB +572.64 KB +0.5%
hits_093.vortex 1.0 vortex-compact 98.30 MB 98.74 MB +458.05 KB +0.5%
hits_069.vortex 1.0 vortex-compact 99.28 MB 99.64 MB +370.66 KB +0.4%
hits_077.vortex 1.0 vortex-file-compressed 173.08 MB 173.70 MB +632.34 KB +0.4%
hits_070.vortex 1.0 vortex-compact 152.82 MB 153.34 MB +532.99 KB +0.3%
hits_063.vortex 1.0 vortex-compact 98.16 MB 98.46 MB +307.31 KB +0.3%
hits_058.vortex 1.0 vortex-compact 111.07 MB 111.41 MB +346.09 KB +0.3%
hits_000.vortex 1.0 vortex-compact 98.37 MB 98.65 MB +295.00 KB +0.3%
hits_043.vortex 1.0 vortex-compact 93.87 MB 94.08 MB +210.77 KB +0.2%
hits_077.vortex 1.0 vortex-compact 134.08 MB 134.37 MB +296.43 KB +0.2%
hits_055.vortex 1.0 vortex-compact 152.41 MB 152.68 MB +272.40 KB +0.2%
hits_020.vortex 1.0 vortex-file-compressed 159.88 MB 160.16 MB +285.26 KB +0.2%
hits_007.vortex 1.0 vortex-compact 153.51 MB 153.78 MB +273.38 KB +0.2%
hits_022.vortex 1.0 vortex-compact 152.97 MB 153.23 MB +266.95 KB +0.2%
hits_091.vortex 1.0 vortex-compact 111.79 MB 111.95 MB +168.78 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.38 MB 158.60 MB +228.02 KB +0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.58 MB 172.82 MB +246.95 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.45 MB 154.66 MB +219.45 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.79 MB 101.93 MB +143.77 KB +0.1%
hits_016.vortex 1.0 vortex-compact 127.24 MB 127.41 MB +177.00 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.70 MB 153.90 MB +204.84 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.71 MB 161.90 MB +201.48 KB +0.1%
hits_049.vortex 1.0 vortex-compact 139.38 MB 139.54 MB +160.72 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.62 MB 130.77 MB +148.07 KB +0.1%
hits_006.vortex 1.0 vortex-compact 95.51 MB 95.61 MB +105.56 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.68 MB 100.79 MB +111.12 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.08 MB 152.24 MB +166.77 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.66 MB 130.79 MB +133.67 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 200.29 MB 200.49 MB +200.09 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.06 MB 140.18 MB +126.09 KB +0.1%
hits_096.vortex 1.0 vortex-compact 152.98 MB 153.10 MB +122.04 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 127.05 MB 127.14 MB +98.58 KB +0.1%
hits_086.vortex 1.0 vortex-compact 139.54 MB 139.64 MB +101.94 KB +0.1%
hits_072.vortex 1.0 vortex-compact 75.60 MB 75.65 MB +51.80 KB +0.1%
hits_097.vortex 1.0 vortex-compact 140.13 MB 140.22 MB +91.14 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.28 MB 136.37 MB +88.38 KB +0.1%
hits_029.vortex 1.0 vortex-compact 153.45 MB 153.55 MB +98.79 KB +0.1%
hits_044.vortex 1.0 vortex-compact 153.49 MB 153.58 MB +98.46 KB +0.1%
hits_040.vortex 1.0 vortex-compact 110.00 MB 110.06 MB +64.44 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.04 MB 161.14 MB +93.01 KB +0.1%
hits_013.vortex 1.0 vortex-compact 125.27 MB 125.33 MB +68.05 KB +0.1%
hits_010.vortex 1.0 vortex-compact 123.05 MB 123.12 MB +65.04 KB +0.1%
hits_092.vortex 1.0 vortex-compact 153.42 MB 153.50 MB +81.05 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.23 MB 139.30 MB +72.87 KB +0.1%
hits_082.vortex 1.0 vortex-compact 105.66 MB 105.71 MB +55.26 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.44 MB 199.54 MB +98.29 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.52 MB 200.61 MB +98.68 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.39 MB 111.44 MB +54.55 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.02 MB 201.11 MB +90.88 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.31 MB 172.38 MB +77.55 KB +0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.97 MB 169.04 MB +73.55 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.10 MB 191.17 MB +81.48 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.93 MB 130.98 MB +55.43 KB +0.0%
hits_003.vortex 1.0 vortex-compact 104.53 MB 104.57 MB +43.14 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.35 MB 147.41 MB +57.83 KB +0.0%
hits_048.vortex 1.0 vortex-compact 153.34 MB 153.40 MB +57.92 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.56 MB 189.63 MB +71.38 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.62 MB 161.68 MB +60.42 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.69 MB 126.73 MB +45.59 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.20 MB 147.25 MB +49.80 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.78 MB 191.84 MB +62.05 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.57 MB 111.60 MB +33.70 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.70 MB 192.75 MB +54.89 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.11 MB 178.16 MB +50.64 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.17 MB 102.20 MB +27.12 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.27 MB 192.32 MB +49.69 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.75 MB 181.79 MB +39.27 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.05 MB 189.08 MB +36.30 KB +0.0%
hits_045.vortex 1.0 vortex-file-compressed 139.80 MB 139.82 MB +22.46 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.96 MB 153.98 MB +24.26 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.36 MB 130.38 MB +19.01 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.83 MB 153.85 MB +19.55 KB +0.0%
hits_044.vortex 1.0 vortex-file-compressed 201.11 MB 201.13 MB +23.47 KB +0.0%
hits_059.vortex 1.0 vortex-compact 152.78 MB 152.80 MB +16.89 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.64 MB 110.66 MB +11.57 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.68 MB 130.69 MB +11.63 KB +0.0%
hits_051.vortex 1.0 vortex-compact 134.05 MB 134.06 MB +11.89 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.11 MB 131.12 MB +11.46 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.59 MB 110.60 MB +8.66 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.16 MB 134.16 MB +6.09 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.80 MB 161.81 MB +5.84 KB +0.0%
hits_071.vortex 1.0 vortex-compact 105.53 MB 105.54 MB +2.86 KB +0.0%
hits_054.vortex 1.0 vortex-compact 111.66 MB 111.66 MB +2.60 KB +0.0%
hits_060.vortex 1.0 vortex-compact 140.18 MB 140.18 MB +2.70 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.62 MB 110.62 MB +2.02 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.94 MB 171.94 MB +1.23 KB +0.0%
hits_025.vortex 1.0 vortex-compact 133.45 MB 133.45 MB +608 B +0.0%
hits_020.vortex 1.0 vortex-compact 111.61 MB 111.61 MB 736 B -0.0%
hits_085.vortex 1.0 vortex-compact 153.27 MB 153.26 MB 1.08 KB -0.0%
hits_012.vortex 1.0 vortex-compact 138.84 MB 138.84 MB 1016 B -0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.84 MB 171.84 MB 3.63 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.31 MB 139.30 MB 3.08 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.61 MB 126.61 MB 3.62 KB -0.0%
hits_064.vortex 1.0 vortex-compact 139.78 MB 139.78 MB 5.27 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.03 MB 173.03 MB 8.36 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 139.34 MB 139.33 MB 7.49 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.79 MB 200.78 MB 12.41 KB -0.0%
hits_056.vortex 1.0 vortex-compact 100.77 MB 100.77 MB 7.25 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.00 MB 105.99 MB 10.77 KB -0.0%
hits_088.vortex 1.0 vortex-compact 133.74 MB 133.73 MB 13.80 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.83 MB 115.81 MB 20.27 KB -0.0%
hits_079.vortex 1.0 vortex-compact 127.96 MB 127.94 MB 25.34 KB -0.0%
hits_068.vortex 1.0 vortex-compact 111.94 MB 111.91 MB 25.23 KB -0.0%
hits_081.vortex 1.0 vortex-compact 153.62 MB 153.59 MB 35.35 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.91 MB 200.86 MB 47.51 KB -0.0%
hits_099.vortex 1.0 vortex-compact 133.11 MB 133.07 MB 31.82 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.70 MB 180.66 MB 44.47 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 201.26 MB 201.21 MB 50.66 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.86 MB 130.82 MB 34.08 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.63 MB 161.59 MB 43.38 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.29 MB 156.25 MB 43.45 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.89 MB 142.85 MB 41.73 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.67 MB 130.63 MB 38.90 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 201.01 MB 200.95 MB 61.48 KB -0.0%
hits_039.vortex 1.0 vortex-compact 123.76 MB 123.72 MB 38.67 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.52 MB 190.46 MB 59.75 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.64 MB 110.61 MB 35.98 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.57 MB 136.52 MB 46.97 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.63 MB 159.57 MB 60.98 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.72 MB 153.66 MB 59.05 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.91 MB 194.83 MB 79.29 KB -0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.84 MB 192.76 MB 78.97 KB -0.0%
hits_083.vortex 1.0 vortex-compact 110.10 MB 110.06 MB 45.21 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.31 MB 147.25 MB 61.16 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.21 MB 115.16 MB 48.42 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.89 MB 159.82 MB 73.62 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 75.21 MB 35.00 KB -0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.96 MB 153.89 MB 71.81 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.32 MB 130.26 MB 61.36 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.35 MB 130.29 MB 63.65 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.21 MB 167.13 MB 87.64 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.90 MB 161.82 MB 86.99 KB -0.1%
hits_094.vortex 1.0 vortex-compact 110.78 MB 110.72 MB 63.12 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.19 MB 101.14 MB 58.02 KB -0.1%
hits_008.vortex 1.0 vortex-compact 105.70 MB 105.64 MB 61.75 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.15 MB 130.07 MB 76.23 KB -0.1%
hits_045.vortex 1.0 vortex-compact 105.67 MB 105.61 MB 62.91 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.94 MB 130.86 MB 78.67 KB -0.1%
hits_014.vortex 1.0 vortex-compact 133.75 MB 133.67 MB 83.80 KB -0.1%
hits_075.vortex 1.0 vortex-compact 137.82 MB 137.73 MB 87.00 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 161.53 MB 161.43 MB 103.91 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.72 MB 161.62 MB 107.17 KB -0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.18 MB 202.04 MB 138.59 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.50 MB 132.40 MB 100.00 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 200.22 MB 200.07 MB 154.27 KB -0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.08 MB 134.97 MB 117.60 KB -0.1%
hits_098.vortex 1.0 vortex-compact 103.69 MB 103.60 MB 92.21 KB -0.1%
hits_035.vortex 1.0 vortex-compact 75.98 MB 75.91 MB 75.20 KB -0.1%
hits_046.vortex 1.0 vortex-compact 75.00 MB 74.91 MB 88.56 KB -0.1%
hits_033.vortex 1.0 vortex-compact 153.60 MB 153.40 MB 201.32 KB -0.1%
hits_036.vortex 1.0 vortex-compact 133.38 MB 133.20 MB 179.98 KB -0.1%
hits_017.vortex 1.0 vortex-compact 111.97 MB 111.81 MB 165.32 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.75 MB 189.47 MB 294.20 KB -0.2%
hits_014.vortex 1.0 vortex-file-compressed 173.16 MB 172.87 MB 290.64 KB -0.2%
hits_011.vortex 1.0 vortex-compact 153.13 MB 152.88 MB 260.76 KB -0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.54 MB 160.24 MB 308.05 KB -0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.79 MB 190.41 MB 386.07 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 173.61 MB 173.26 MB 354.34 KB -0.2%
hits_047.vortex 1.0 vortex-compact 110.81 MB 110.47 MB 343.55 KB -0.3%
hits_040.vortex 1.0 vortex-file-compressed 144.45 MB 144.01 MB 458.01 KB -0.3%
hits_074.vortex 1.0 vortex-compact 153.06 MB 152.56 MB 511.43 KB -0.3%
hits_015.vortex 1.0 vortex-compact 98.43 MB 98.07 MB 374.17 KB -0.4%
hits_011.vortex 1.0 vortex-file-compressed 200.32 MB 199.57 MB 771.85 KB -0.4%
hits_092.vortex 1.0 vortex-file-compressed 200.60 MB 199.82 MB 791.53 KB -0.4%
hits_041.vortex 1.0 vortex-compact 98.22 MB 97.83 MB 400.17 KB -0.4%
hits_030.vortex 1.0 vortex-compact 98.64 MB 98.23 MB 419.86 KB -0.4%
hits_078.vortex 1.0 vortex-compact 97.92 MB 97.49 MB 437.80 KB -0.4%
hits_052.vortex 1.0 vortex-compact 97.74 MB 97.24 MB 519.28 KB -0.5%
hits_018.vortex 1.0 vortex-compact 153.75 MB 152.90 MB 872.62 KB -0.6%
hits_066.vortex 1.0 vortex-file-compressed 165.17 MB 164.22 MB 974.59 KB -0.6%
hits_004.vortex 1.0 vortex-compact 97.62 MB 97.05 MB 587.06 KB -0.6%
hits_053.vortex 1.0 vortex-compact 138.28 MB 137.45 MB 854.02 KB -0.6%
hits_062.vortex 1.0 vortex-file-compressed 172.38 MB 171.33 MB 1.05 MB -0.6%
hits_023.vortex 1.0 vortex-compact 142.52 MB 141.54 MB 1000.55 KB -0.7%
hits_022.vortex 1.0 vortex-file-compressed 200.20 MB 198.83 MB 1.38 MB -0.7%
hits_050.vortex 1.0 vortex-file-compressed 161.55 MB 160.38 MB 1.17 MB -0.7%
hits_090.vortex 1.0 vortex-compact 141.02 MB 140.00 MB 1.02 MB -0.7%
hits_076.vortex 1.0 vortex-compact 125.26 MB 124.29 MB 986.32 KB -0.8%
hits_027.vortex 1.0 vortex-compact 139.06 MB 137.96 MB 1.10 MB -0.8%
hits_037.vortex 1.0 vortex-compact 133.25 MB 132.10 MB 1.16 MB -0.9%
hits_001.vortex 1.0 vortex-compact 139.16 MB 137.80 MB 1.36 MB -1.0%
hits_002.vortex 1.0 vortex-compact 125.05 MB 123.83 MB 1.23 MB -1.0%
hits_016.vortex 1.0 vortex-file-compressed 181.71 MB 179.83 MB 1.88 MB -1.0%
hits_050.vortex 1.0 vortex-compact 125.35 MB 123.81 MB 1.54 MB -1.2%
hits_061.vortex 1.0 vortex-compact 124.81 MB 123.23 MB 1.57 MB -1.3%
hits_065.vortex 1.0 vortex-compact 125.57 MB 123.95 MB 1.62 MB -1.3%
hits_087.vortex 1.0 vortex-compact 125.60 MB 123.84 MB 1.77 MB -1.4%
hits_067.vortex 1.0 vortex-compact 99.88 MB 98.34 MB 1.55 MB -1.5%
hits_001.vortex 1.0 vortex-file-compressed 193.11 MB 188.76 MB 4.34 MB -2.2%

Totals:

  • vortex-compact: 11.91 GB → 11.90 GB (-0.1%)
  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52341603 / 52252170 / +0.2% 71843743 / 72601893 / -1.0% 0.73 / 0.72 / +1.2%
appian_q02/datafusion:vortex-compact 236651984 / 234825518 / +0.8% 268278756 / 270643468 / -0.9% 0.88 / 0.87 / +1.7%
appian_q03/datafusion:vortex-compact 146922104 / 147392580 / -0.3% 185323012 / 184971643 / +0.2% 0.79 / 0.80 / -0.5%
appian_q04/datafusion:vortex-compact 9897060533 / 9837291804 / +0.6% 9759981477 / 9831095338 / -0.7% 1.01 / 1.00 / +1.3%
appian_q05/datafusion:vortex-compact 137296200 / 136228855 / +0.8% 159314884 / 162647617 / -2.0% 0.86 / 0.84 / +2.9%
appian_q06/datafusion:vortex-compact 145404228 / 142882037 / +1.8% 165878182 / 164495664 / +0.8% 0.88 / 0.87 / +0.9%
appian_q07/datafusion:vortex-compact 163290158 / 165597023 / -1.4% 192921029 / 199590832 / -3.3% 0.85 / 0.83 / +2.0%
appian_q08/datafusion:vortex-compact 563883965 / 546464062 / +3.2% 591487149 / 604450886 / -2.1% 0.95 / 0.90 / +5.4%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 73744317 / 72721361 / +1.4% 93493457 / 93339516 / +0.2% 0.79 / 0.78 / +1.2%
appian_q02/datafusion:parquet 305166013 / 306459107 / -0.4% 336149215 / 330447073 / +1.7% 0.91 / 0.93 / -2.1%
appian_q03/datafusion:parquet 190926788 / 189722496 / +0.6% 229089977 / 232148205 / -1.3% 0.83 / 0.82 / +2.0%
appian_q04/datafusion:parquet 9926291215 / 9934916574 / -0.1% 9910852088 / 9877843482 / +0.3% 1.00 / 1.01 / -0.4%
appian_q05/datafusion:parquet 199358623 / 198780423 / +0.3% 229725309 / 223683404 / +2.7% 0.87 / 0.89 / -2.3%
appian_q06/datafusion:parquet 168480759 / 168652452 / -0.1% 192674864 / 193925888 / -0.6% 0.87 / 0.87 / +0.5%
appian_q07/datafusion:parquet 209465388 / 209070259 / +0.2% 243370645 / 246257558 / -1.2% 0.86 / 0.85 / +1.4%
appian_q08/datafusion:parquet 688549069 / 677538512 / +1.6% 691321987 / 687933321 / +0.5% 1.00 / 0.98 / +1.1%
duckdb / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 90735024 / 91779476 / -1.1% 107128486 / 103088857 / +3.9% 0.85 / 0.89 / -4.9%
appian_q02/duckdb:vortex-compact 211918732 / 212431654 / -0.2% 230321603 / 233646508 / -1.4% 0.92 / 0.91 / +1.2%
appian_q03/duckdb:vortex-compact 122243088 / 120821573 / +1.2% 136525370 / 139259879 / -2.0% 0.90 / 0.87 / +3.2%
appian_q04/duckdb:vortex-compact 564991644 / 565235129 / -0.0% 598400160 / 560844387 / +6.7% 0.94 / 1.01 / -6.3%
appian_q05/duckdb:vortex-compact 131390867 / 134330951 / -2.2% 148375040 / 147951947 / +0.3% 0.89 / 0.91 / -2.5%
appian_q06/duckdb:vortex-compact 404747619 / 405195968 / -0.1% 392591547 / 419371119 / -6.4% 1.03 / 0.97 / +6.7%
appian_q07/duckdb:vortex-compact 136351032 / 136393449 / -0.0% 153891602 / 151009853 / +1.9% 0.89 / 0.90 / -1.9%
appian_q08/duckdb:vortex-compact 433825112 / 433015749 / +0.2% 459221244 / 450330153 / +2.0% 0.94 / 0.96 / -1.8%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99308826 / 99478551 / -0.2% 118362491 / 114950005 / +3.0% 0.84 / 0.87 / -3.0%
appian_q02/duckdb:parquet 195653281 / 195327460 / +0.2% 199408272 / 199310700 / +0.0% 0.98 / 0.98 / +0.1%
appian_q03/duckdb:parquet 128184749 / 123838364 / +3.5% 138561171 / 133633834 / +3.7% 0.93 / 0.93 / -0.2%
appian_q04/duckdb:parquet 446603331 / 444927838 / +0.4% 455580003 / 441802561 / +3.1% 0.98 / 1.01 / -2.7%
appian_q05/duckdb:parquet 142333687 / 143440829 / -0.8% 166114278 / 157197234 / +5.7% 0.86 / 0.91 / -6.1%
appian_q06/duckdb:parquet 253736623 / 249356790 / +1.8% 290927493 / 276714479 / +5.1% 0.87 / 0.90 / -3.2%
appian_q07/duckdb:parquet 153773804 / 153428810 / +0.2% 166421925 / 164861449 / +0.9% 0.92 / 0.93 / -0.7%
appian_q08/duckdb:parquet 379229244 / 378431627 / +0.2% 361547241 / 377963077 / -4.3% 1.05 / 1.00 / +4.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -14.9%
Engines: DataFusion No clear signal (-19.0%, environment too noisy confidence) · DuckDB No clear signal (-10.6%, environment too noisy confidence)
Vortex (geomean): hot 1.074x ➖ · cold 1.053x ➖
Parquet (geomean): hot 1.262x ➖ · cold 1.204x ➖
Shifts: Parquet (control) +26.2% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.206x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 80264646 / 50669620 / +58.4% 🔴 160081677 / 112061882 / +42.9% 🔴 0.50 / 0.45 / +10.9%
fineweb_q01/datafusion:vortex-file-compressed 530087412 / 390213994 / +35.8% 🔴 724052689 / 878810461 / -17.6% 0.73 / 0.44 / +64.9%
fineweb_q02/datafusion:vortex-file-compressed 436915630 / 399072900 / +9.5% 740017102 / 579112705 / +27.8% 0.59 / 0.69 / -14.3%
fineweb_q03/datafusion:vortex-file-compressed 722691590 / 697493880 / +3.6% 924097487 / 855447194 / +8.0% 0.78 / 0.82 / -4.1%
fineweb_q04/datafusion:vortex-file-compressed 855156304 / 536353093 / +59.4% 🔴 655389240 / 668608965 / -2.0% 1.30 / 0.80 / +62.7%
fineweb_q05/datafusion:vortex-file-compressed 475263178 / 447071512 / +6.3% 639404862 / 480015526 / +33.2% 🔴 0.74 / 0.93 / -20.2%
fineweb_q06/datafusion:vortex-file-compressed 812571178 / 754638820 / +7.7% 806537274 / 741599383 / +8.8% 1.01 / 1.02 / -1.0%
fineweb_q07/datafusion:vortex-file-compressed 565234949 / 701254858 / -19.4% 559876790 / 577071746 / -3.0% 1.01 / 1.22 / -16.9%
fineweb_q08/datafusion:vortex-file-compressed 316046225 / 210487920 / +50.1% 🔴 273547823 / 298731344 / -8.4% 1.16 / 0.70 / +64.0%
datafusion / vortex-compact / ns (1.119x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 52626113 / 59884002 / -12.1% 129320149 / 140172855 / -7.7% 0.41 / 0.43 / -4.7%
fineweb_q01/datafusion:vortex-compact 559834252 / 445534952 / +25.7% 899425235 / 914804629 / -1.7% 0.62 / 0.49 / +27.8%
fineweb_q02/datafusion:vortex-compact 1039005635 / 410783072 / +152.9% 🔴 834993924 / 518635748 / +61.0% 🔴 1.24 / 0.79 / +57.1%
fineweb_q03/datafusion:vortex-compact 559675538 / 633234687 / -11.6% 1023936230 / 823267000 / +24.4% 0.55 / 0.77 / -28.9%
fineweb_q04/datafusion:vortex-compact 499248448 / 669471239 / -25.4% 548623428 / 841841629 / -34.8% 🟢 0.91 / 0.80 / +14.4%
fineweb_q05/datafusion:vortex-compact 478005995 / 482808014 / -1.0% 506040904 / 483808724 / +4.6% 0.94 / 1.00 / -5.3%
fineweb_q06/datafusion:vortex-compact 692571036 / 769609471 / -10.0% 695319633 / 661615072 / +5.1% 1.00 / 1.16 / -14.4%
fineweb_q07/datafusion:vortex-compact 670869934 / 546145752 / +22.8% 659725268 / 557585835 / +18.3% 1.02 / 0.98 / +3.8%
fineweb_q08/datafusion:vortex-compact 293801132 / 215568863 / +36.3% 🔴 319789926 / 218698715 / +46.2% 🔴 0.92 / 0.99 / -6.8%
datafusion / parquet / ns (1.434x ❌, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 747591729 / 397137712 / +88.2% 🔴 969648464 / 862342888 / +12.4% 0.77 / 0.46 / +67.4%
fineweb_q01/datafusion:parquet 1324859688 / 728447575 / +81.9% 🔴 1078405217 / 822895321 / +31.1% 🔴 1.23 / 0.89 / +38.8%
fineweb_q02/datafusion:parquet 1002240499 / 824429967 / +21.6% 1170726159 / 703192009 / +66.5% 🔴 0.86 / 1.17 / -27.0%
fineweb_q03/datafusion:parquet 1146987506 / 819545193 / +40.0% 🔴 1105291634 / 885379581 / +24.8% 1.04 / 0.93 / +12.1%
fineweb_q04/datafusion:parquet 1210607392 / 1137344151 / +6.4% 1095028008 / 1143858088 / -4.3% 1.11 / 0.99 / +11.2%
fineweb_q05/datafusion:parquet 1112729121 / 692116884 / +60.8% 🔴 1267683703 / 802882577 / +57.9% 🔴 0.88 / 0.86 / +1.8%
fineweb_q06/datafusion:parquet 1247292982 / 859239421 / +45.2% 🔴 1106886747 / 801253548 / +38.1% 🔴 1.13 / 1.07 / +5.1%
fineweb_q07/datafusion:parquet 1231792794 / 801610110 / +53.7% 🔴 2097495700 / 937967058 / +123.6% 🔴 0.59 / 0.85 / -31.3%
fineweb_q08/datafusion:parquet 1104695364 / 955851636 / +15.6% 1001087669 / 1787863389 / -44.0% 🟢 1.10 / 0.53 / +106.4%
duckdb / vortex-file-compressed / ns (0.897x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 69194308 / 66993492 / +3.3% 68237893 / 68306143 / -0.1% 1.01 / 0.98 / +3.4%
fineweb_q01/duckdb:vortex-file-compressed 468268158 / 451163397 / +3.8% 629301997 / 569966789 / +10.4% 0.74 / 0.79 / -6.0%
fineweb_q02/duckdb:vortex-file-compressed 680045506 / 1136491790 / -40.2% 🟢 830021300 / 988083438 / -16.0% 0.82 / 1.15 / -28.8%
fineweb_q03/duckdb:vortex-file-compressed 956494631 / 1050930020 / -9.0% 1139338059 / 1229336909 / -7.3% 0.84 / 0.85 / -1.8%
fineweb_q04/duckdb:vortex-file-compressed 993693538 / 1095911868 / -9.3% 967292113 / 1072190060 / -9.8% 1.03 / 1.02 / +0.5%
fineweb_q05/duckdb:vortex-file-compressed 899181526 / 909143919 / -1.1% 999575734 / 992277990 / +0.7% 0.90 / 0.92 / -1.8%
fineweb_q06/duckdb:vortex-file-compressed 1224340290 / 1255780741 / -2.5% 1287675756 / 1213877288 / +6.1% 0.95 / 1.03 / -8.1%
fineweb_q07/duckdb:vortex-file-compressed 978374872 / 1013396694 / -3.5% 1013918231 / 1252543814 / -19.1% 0.96 / 0.81 / +19.3%
fineweb_q08/duckdb:vortex-file-compressed 402462976 / 528438595 / -23.8% 481386191 / 635835526 / -24.3% 0.84 / 0.83 / +0.6%
duckdb / vortex-compact / ns (1.100x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 76938946 / 83174483 / -7.5% 74640994 / 95652503 / -22.0% 1.03 / 0.87 / +18.5%
fineweb_q01/duckdb:vortex-compact 750241912 / 457018784 / +64.2% 🔴 935390412 / 556620341 / +68.0% 🔴 0.80 / 0.82 / -2.3%
fineweb_q02/duckdb:vortex-compact 843463990 / 626333624 / +34.7% 🔴 891074886 / 603157425 / +47.7% 🔴 0.95 / 1.04 / -8.8%
fineweb_q03/duckdb:vortex-compact 1127877536 / 1105217354 / +2.1% 1291549949 / 1290830853 / +0.1% 0.87 / 0.86 / +2.0%
fineweb_q04/duckdb:vortex-compact 1039639858 / 1168846048 / -11.1% 1108885901 / 1035254507 / +7.1% 0.94 / 1.13 / -17.0%
fineweb_q05/duckdb:vortex-compact 908826880 / 976039463 / -6.9% 1092813234 / 1045646155 / +4.5% 0.83 / 0.93 / -10.9%
fineweb_q06/duckdb:vortex-compact 1165152672 / 1294971032 / -10.0% 1362897854 / 1563289940 / -12.8% 0.85 / 0.83 / +3.2%
fineweb_q07/duckdb:vortex-compact 989086444 / 934283539 / +5.9% 1237086294 / 959789341 / +28.9% 0.80 / 0.97 / -17.9%
fineweb_q08/duckdb:vortex-compact 506339292 / 352466808 / +43.7% 🔴 455088837 / 406870064 / +11.9% 1.11 / 0.87 / +28.4%
duckdb / parquet / ns (1.111x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 612426992 / 511730938 / +19.7% 698667410 / 541115818 / +29.1% 0.88 / 0.95 / -7.3%
fineweb_q01/duckdb:parquet 735033502 / 670706452 / +9.6% 755909929 / 564593265 / +33.9% 🔴 0.97 / 1.19 / -18.1%
fineweb_q02/duckdb:parquet 797346502 / 797842362 / -0.1% 738170007 / 863617196 / -14.5% 1.08 / 0.92 / +16.9%
fineweb_q03/duckdb:parquet 1929375074 / 1520440415 / +26.9% 1873356121 / 1797173067 / +4.2% 1.03 / 0.85 / +21.7%
fineweb_q04/duckdb:parquet 917625354 / 967884960 / -5.2% 1218714606 / 953943088 / +27.8% 0.75 / 1.01 / -25.8%
fineweb_q05/duckdb:parquet 1023220476 / 1082582534 / -5.5% 1117921525 / 958127809 / +16.7% 0.92 / 1.13 / -19.0%
fineweb_q06/duckdb:parquet 2165782940 / 1772728992 / +22.2% 1971876605 / 1753252532 / +12.5% 1.10 / 1.01 / +8.6%
fineweb_q07/duckdb:parquet 1664458436 / 1213814638 / +37.1% 🔴 1497886154 / 1132126812 / +32.3% 🔴 1.11 / 1.07 / +3.6%
fineweb_q08/duckdb:parquet 615317112 / 595467297 / +3.3% 670986243 / 647472775 / +3.6% 0.92 / 0.92 / -0.3%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.2%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.981x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1259200 / 1237544 / +1.7% 19928186 / 21368398 / -6.7% 0.06 / 0.06 / +9.1%
clickbench_q01/datafusion:vortex-file-compressed 5938239 / 5913656 / +0.4% 33815096 / 34504372 / -2.0% 0.18 / 0.17 / +2.5%
clickbench_q02/datafusion:vortex-file-compressed 10386067 / 10470568 / -0.8% 34669820 / 38398893 / -9.7% 0.30 / 0.27 / +9.9%
clickbench_q03/datafusion:vortex-file-compressed 11580278 / 11639724 / -0.5% 50691575 / 54348270 / -6.7% 0.23 / 0.21 / +6.7%
clickbench_q04/datafusion:vortex-file-compressed 56265120 / 55035900 / +2.2% 92038962 / 92655267 / -0.7% 0.61 / 0.59 / +2.9%
clickbench_q05/datafusion:vortex-file-compressed 76561992 / 75886698 / +0.9% 116404950 / 122582433 / -5.0% 0.66 / 0.62 / +6.2%
clickbench_q06/datafusion:vortex-file-compressed 1250128 / 1234123 / +1.3% 20055066 / 21881568 / -8.3% 0.06 / 0.06 / +10.5%
clickbench_q07/datafusion:vortex-file-compressed 9518036 / 9713668 / -2.0% 32909445 / 35015429 / -6.0% 0.29 / 0.28 / +4.3%
clickbench_q08/datafusion:vortex-file-compressed 78176165 / 78788758 / -0.8% 117795493 / 117864691 / -0.1% 0.66 / 0.67 / -0.7%
clickbench_q09/datafusion:vortex-file-compressed 173068266 / 173748448 / -0.4% 205727228 / 214555017 / -4.1% 0.84 / 0.81 / +3.9%
clickbench_q10/datafusion:vortex-file-compressed 24443220 / 24029706 / +1.7% 65084000 / 67833994 / -4.1% 0.38 / 0.35 / +6.0%
clickbench_q11/datafusion:vortex-file-compressed 25769708 / 26874173 / -4.1% 67575985 / 71064523 / -4.9% 0.38 / 0.38 / +0.8%
clickbench_q12/datafusion:vortex-file-compressed 71026610 / 72387224 / -1.9% 116463599 / 118690135 / -1.9% 0.61 / 0.61 / -0.0%
clickbench_q13/datafusion:vortex-file-compressed 120931552 / 116412480 / +3.9% 180213206 / 183186235 / -1.6% 0.67 / 0.64 / +5.6%
clickbench_q14/datafusion:vortex-file-compressed 74383584 / 77937173 / -4.6% 117814240 / 119809744 / -1.7% 0.63 / 0.65 / -2.9%
clickbench_q15/datafusion:vortex-file-compressed 61745628 / 60637446 / +1.8% 95260803 / 103500726 / -8.0% 0.65 / 0.59 / +10.6%
clickbench_q16/datafusion:vortex-file-compressed 149079359 / 149916914 / -0.6% 206130548 / 208766595 / -1.3% 0.72 / 0.72 / +0.7%
clickbench_q17/datafusion:vortex-file-compressed 150317128 / 148254772 / +1.4% 213579294 / 211399594 / +1.0% 0.70 / 0.70 / +0.4%
clickbench_q18/datafusion:vortex-file-compressed 299547222 / 294533629 / +1.7% 368277200 / 383197894 / -3.9% 0.81 / 0.77 / +5.8%
clickbench_q19/datafusion:vortex-file-compressed 7963360 / 7676823 / +3.7% 45378356 / 51589171 / -12.0% 🟢 0.18 / 0.15 / +17.9%
clickbench_q20/datafusion:vortex-file-compressed 62889842 / 63951310 / -1.7% 225629641 / 229068455 / -1.5% 0.28 / 0.28 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed 90903324 / 89769392 / +1.3% 270129653 / 268957085 / +0.4% 0.34 / 0.33 / +0.8%
clickbench_q22/datafusion:vortex-file-compressed 103132307 / 104443464 / -1.3% 341902514 / 350621903 / -2.5% 0.30 / 0.30 / +1.3%
clickbench_q23/datafusion:vortex-file-compressed 204656968 / 193583238 / +5.7% 533181920 / 473652283 / +12.6% 🔴 0.38 / 0.41 / -6.1%
clickbench_q24/datafusion:vortex-file-compressed 16579634 / 16646550 / -0.4% 62602407 / 65798454 / -4.9% 0.26 / 0.25 / +4.7%
clickbench_q25/datafusion:vortex-file-compressed 17744952 / 18435374 / -3.7% 56694792 / 57274124 / -1.0% 0.31 / 0.32 / -2.8%
clickbench_q26/datafusion:vortex-file-compressed 16165702 / 16168048 / -0.0% 61650157 / 66072398 / -6.7% 0.26 / 0.24 / +7.2%
clickbench_q27/datafusion:vortex-file-compressed 100723954 / 97561058 / +3.2% 242627853 / 244897537 / -0.9% 0.42 / 0.40 / +4.2%
clickbench_q28/datafusion:vortex-file-compressed 561992856 / 568613787 / -1.2% 629274183 / 617190489 / +2.0% 0.89 / 0.92 / -3.1%
clickbench_q29/datafusion:vortex-file-compressed 22991586 / 23039781 / -0.2% 51042244 / 50509994 / +1.1% 0.45 / 0.46 / -1.2%
clickbench_q30/datafusion:vortex-file-compressed 59098782 / 58413857 / +1.2% 104589136 / 105270939 / -0.6% 0.57 / 0.55 / +1.8%
clickbench_q31/datafusion:vortex-file-compressed 69293942 / 70774980 / -2.1% 149748836 / 157934737 / -5.2% 0.46 / 0.45 / +3.3%
clickbench_q32/datafusion:vortex-file-compressed 296533302 / 302981430 / -2.1% 383458078 / 381163125 / +0.6% 0.77 / 0.79 / -2.7%
clickbench_q33/datafusion:vortex-file-compressed 325748851 / 327693230 / -0.6% 423257451 / 441784495 / -4.2% 0.77 / 0.74 / +3.8%
clickbench_q34/datafusion:vortex-file-compressed 336903908 / 334607558 / +0.7% 433700344 / 433843714 / -0.0% 0.78 / 0.77 / +0.7%
clickbench_q35/datafusion:vortex-file-compressed 56258152 / 57571937 / -2.3% 90490885 / 86701901 / +4.4% 0.62 / 0.66 / -6.4%
clickbench_q36/datafusion:vortex-file-compressed 37275031 / 36993262 / +0.8% 64119777 / 66679505 / -3.8% 0.58 / 0.55 / +4.8%
clickbench_q37/datafusion:vortex-file-compressed 21905685 / 21506972 / +1.9% 47288933 / 47987527 / -1.5% 0.46 / 0.45 / +3.4%
clickbench_q38/datafusion:vortex-file-compressed 11833860 / 11969744 / -1.1% 38044304 / 40248124 / -5.5% 0.31 / 0.30 / +4.6%
clickbench_q39/datafusion:vortex-file-compressed 77259636 / 78432706 / -1.5% 108392541 / 109618883 / -1.1% 0.71 / 0.72 / -0.4%
clickbench_q40/datafusion:vortex-file-compressed 11373080 / 11394950 / -0.2% 35409887 / 36392715 / -2.7% 0.32 / 0.31 / +2.6%
clickbench_q41/datafusion:vortex-file-compressed 10583784 / 10705600 / -1.1% 34885813 / 37931128 / -8.0% 0.30 / 0.28 / +7.5%
clickbench_q42/datafusion:vortex-file-compressed 11082989 / 10944028 / +1.3% 34564972 / 36324232 / -4.8% 0.32 / 0.30 / +6.4%
datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1225246 / 1244447 / -1.5% 19127223 / 19972756 / -4.2% 0.06 / 0.06 / +2.8%
clickbench_q01/datafusion:vortex-compact 7089784 / 6831053 / +3.8% 32659243 / 34470396 / -5.3% 0.22 / 0.20 / +9.5%
clickbench_q02/datafusion:vortex-compact 19567621 / 19199599 / +1.9% 43040905 / 44302165 / -2.8% 0.45 / 0.43 / +4.9%
clickbench_q03/datafusion:vortex-compact 13687890 / 13986070 / -2.1% 39255275 / 38542051 / +1.9% 0.35 / 0.36 / -3.9%
clickbench_q04/datafusion:vortex-compact 57866758 / 56425992 / +2.6% 87155672 / 87383084 / -0.3% 0.66 / 0.65 / +2.8%
clickbench_q05/datafusion:vortex-compact 83874230 / 88217538 / -4.9% 122432522 / 121887430 / +0.4% 0.69 / 0.72 / -5.3%
clickbench_q06/datafusion:vortex-compact 1234976 / 1250060 / -1.2% 19408463 / 20510034 / -5.4% 0.06 / 0.06 / +4.4%
clickbench_q07/datafusion:vortex-compact 12177412 / 12230654 / -0.4% 34071301 / 38175784 / -10.8% 🟢 0.36 / 0.32 / +11.6%
clickbench_q08/datafusion:vortex-compact 86754124 / 86971014 / -0.2% 117519772 / 118983907 / -1.2% 0.74 / 0.73 / +1.0%
clickbench_q09/datafusion:vortex-compact 191118138 / 188394087 / +1.4% 216618123 / 220400432 / -1.7% 0.88 / 0.85 / +3.2%
clickbench_q10/datafusion:vortex-compact 43397682 / 44285022 / -2.0% 67571195 / 71538104 / -5.5% 0.64 / 0.62 / +3.7%
clickbench_q11/datafusion:vortex-compact 55061016 / 55209778 / -0.3% 79528390 / 82261326 / -3.3% 0.69 / 0.67 / +3.2%
clickbench_q12/datafusion:vortex-compact 83438178 / 83043608 / +0.5% 123859239 / 132263440 / -6.4% 0.67 / 0.63 / +7.3%
clickbench_q13/datafusion:vortex-compact 135209647 / 138561207 / -2.4% 182094268 / 182662082 / -0.3% 0.74 / 0.76 / -2.1%
clickbench_q14/datafusion:vortex-compact 90877765 / 92098852 / -1.3% 124328933 / 127868474 / -2.8% 0.73 / 0.72 / +1.5%
clickbench_q15/datafusion:vortex-compact 65924329 / 64144078 / +2.8% 93206941 / 92864234 / +0.4% 0.71 / 0.69 / +2.4%
clickbench_q16/datafusion:vortex-compact 164268718 / 164881515 / -0.4% 218081102 / 221065181 / -1.3% 0.75 / 0.75 / +1.0%
clickbench_q17/datafusion:vortex-compact 163378895 / 162664037 / +0.4% 214861887 / 218576551 / -1.7% 0.76 / 0.74 / +2.2%
clickbench_q18/datafusion:vortex-compact 303721538 / 299623044 / +1.4% 374495482 / 363675922 / +3.0% 0.81 / 0.82 / -1.6%
clickbench_q19/datafusion:vortex-compact 10415056 / 10414710 / +0.0% 39215294 / 41791018 / -6.2% 0.27 / 0.25 / +6.6%
clickbench_q20/datafusion:vortex-compact 72911182 / 71970297 / +1.3% 188019298 / 196677794 / -4.4% 0.39 / 0.37 / +6.0%
clickbench_q21/datafusion:vortex-compact 116834820 / 117068662 / -0.2% 225756765 / 224352159 / +0.6% 0.52 / 0.52 / -0.8%
clickbench_q22/datafusion:vortex-compact 184891247 / 183840774 / +0.6% 273413763 / 271864034 / +0.6% 0.68 / 0.68 / +0.0%
clickbench_q23/datafusion:vortex-compact 518486560 / 548023554 / -5.4% 654337453 / 648353081 / +0.9% 0.79 / 0.85 / -6.3%
clickbench_q24/datafusion:vortex-compact 27679750 / 27432669 / +0.9% 58540733 / 61119523 / -4.2% 0.47 / 0.45 / +5.3%
clickbench_q25/datafusion:vortex-compact 35680794 / 35691831 / -0.0% 63119007 / 65750411 / -4.0% 0.57 / 0.54 / +4.1%
clickbench_q26/datafusion:vortex-compact 27498350 / 27508680 / -0.0% 57913907 / 59855054 / -3.2% 0.47 / 0.46 / +3.3%
clickbench_q27/datafusion:vortex-compact 103138610 / 103446711 / -0.3% 211155922 / 212480439 / -0.6% 0.49 / 0.49 / +0.3%
clickbench_q28/datafusion:vortex-compact 584873413 / 578500883 / +1.1% 619796028 / 606407349 / +2.2% 0.94 / 0.95 / -1.1%
clickbench_q29/datafusion:vortex-compact 31009404 / 31126398 / -0.4% 54751210 / 55373129 / -1.1% 0.57 / 0.56 / +0.8%
clickbench_q30/datafusion:vortex-compact 92227138 / 92388870 / -0.2% 128453708 / 125352124 / +2.5% 0.72 / 0.74 / -2.6%
clickbench_q31/datafusion:vortex-compact 99456494 / 98082451 / +1.4% 150646601 / 148078510 / +1.7% 0.66 / 0.66 / -0.3%
clickbench_q32/datafusion:vortex-compact 305622526 / 304626547 / +0.3% 382846163 / 386148875 / -0.9% 0.80 / 0.79 / +1.2%
clickbench_q33/datafusion:vortex-compact 346705286 / 343435710 / +1.0% 425871183 / 408461109 / +4.3% 0.81 / 0.84 / -3.2%
clickbench_q34/datafusion:vortex-compact 334187865 / 341797299 / -2.2% 416354624 / 414576641 / +0.4% 0.80 / 0.82 / -2.6%
clickbench_q35/datafusion:vortex-compact 62253190 / 62544451 / -0.5% 90666908 / 92278590 / -1.7% 0.69 / 0.68 / +1.3%
clickbench_q36/datafusion:vortex-compact 38330210 / 38508664 / -0.5% 65139254 / 67418151 / -3.4% 0.59 / 0.57 / +3.0%
clickbench_q37/datafusion:vortex-compact 22545388 / 22700292 / -0.7% 46666133 / 48553294 / -3.9% 0.48 / 0.47 / +3.3%
clickbench_q38/datafusion:vortex-compact 12712250 / 13524097 / -6.0% 38164688 / 40704292 / -6.2% 0.33 / 0.33 / +0.3%
clickbench_q39/datafusion:vortex-compact 79053022 / 78897322 / +0.2% 111692805 / 111607961 / +0.1% 0.71 / 0.71 / +0.1%
clickbench_q40/datafusion:vortex-compact 12513872 / 12411718 / +0.8% 36163829 / 37262166 / -2.9% 0.35 / 0.33 / +3.9%
clickbench_q41/datafusion:vortex-compact 12869054 / 13069838 / -1.5% 35833275 / 36184604 / -1.0% 0.36 / 0.36 / -0.6%
clickbench_q42/datafusion:vortex-compact 10971533 / 11581164 / -5.3% 34079308 / 35742320 / -4.7% 0.32 / 0.32 / -0.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1257445 / 1276148 / -1.5% 49368414 / 48729726 / +1.3% 0.03 / 0.03 / -2.7%
clickbench_q01/datafusion:parquet 15965454 / 15971121 / -0.0% 74248803 / 70020932 / +6.0% 0.22 / 0.23 / -5.7%
clickbench_q02/datafusion:parquet 18769158 / 19231370 / -2.4% 83282275 / 83351979 / -0.1% 0.23 / 0.23 / -2.3%
clickbench_q03/datafusion:parquet 16735445 / 17103444 / -2.2% 81596517 / 82660509 / -1.3% 0.21 / 0.21 / -0.9%
clickbench_q04/datafusion:parquet 62542294 / 63359998 / -1.3% 126984431 / 129491522 / -1.9% 0.49 / 0.49 / +0.7%
clickbench_q05/datafusion:parquet 89971814 / 89001183 / +1.1% 158683177 / 160035115 / -0.8% 0.57 / 0.56 / +2.0%
clickbench_q06/datafusion:parquet 1293079 / 1292659 / +0.0% 49595904 / 49528427 / +0.1% 0.03 / 0.03 / -0.1%
clickbench_q07/datafusion:parquet 16705048 / 16689116 / +0.1% 69428575 / 70474332 / -1.5% 0.24 / 0.24 / +1.6%
clickbench_q08/datafusion:parquet 84243776 / 85769160 / -1.8% 172778203 / 167231798 / +3.3% 0.49 / 0.51 / -4.9%
clickbench_q09/datafusion:parquet 190780313 / 189294032 / +0.8% 266476606 / 266064583 / +0.2% 0.72 / 0.71 / +0.6%
clickbench_q10/datafusion:parquet 37316136 / 36491358 / +2.3% 102195421 / 104783175 / -2.5% 0.37 / 0.35 / +4.8%
clickbench_q11/datafusion:parquet 43921187 / 43392081 / +1.2% 111738684 / 112389848 / -0.6% 0.39 / 0.39 / +1.8%
clickbench_q12/datafusion:parquet 95203096 / 96430850 / -1.3% 161849059 / 165141119 / -2.0% 0.59 / 0.58 / +0.7%
clickbench_q13/datafusion:parquet 149688586 / 148684185 / +0.7% 229717065 / 234589967 / -2.1% 0.65 / 0.63 / +2.8%
clickbench_q14/datafusion:parquet 101656428 / 102198704 / -0.5% 174347075 / 177979666 / -2.0% 0.58 / 0.57 / +1.5%
clickbench_q15/datafusion:parquet 71565614 / 73162486 / -2.2% 133578933 / 133038036 / +0.4% 0.54 / 0.55 / -2.6%
clickbench_q16/datafusion:parquet 156823066 / 157433351 / -0.4% 239647260 / 234997778 / +2.0% 0.65 / 0.67 / -2.3%
clickbench_q17/datafusion:parquet 157494562 / 156630504 / +0.6% 241128648 / 240618985 / +0.2% 0.65 / 0.65 / +0.3%
clickbench_q18/datafusion:parquet 317472328 / 318296656 / -0.3% 423711492 / 424855020 / -0.3% 0.75 / 0.75 / +0.0%
clickbench_q19/datafusion:parquet 19112196 / 19348828 / -1.2% 77016529 / 78972473 / -2.5% 0.25 / 0.25 / +1.3%
clickbench_q20/datafusion:parquet 179102480 / 179935246 / -0.5% 278292791 / 298782987 / -6.9% 0.64 / 0.60 / +6.9%
clickbench_q21/datafusion:parquet 172499025 / 175640975 / -1.8% 292532072 / 315958064 / -7.4% 0.59 / 0.56 / +6.1%
clickbench_q22/datafusion:parquet 262717544 / 262986604 / -0.1% 414722740 / 458623028 / -9.6% 0.63 / 0.57 / +10.5%
clickbench_q23/datafusion:parquet 1155426868 / 1195193213 / -3.3% 1232323682 / 1238715053 / -0.5% 0.94 / 0.96 / -2.8%
clickbench_q24/datafusion:parquet 29755892 / 30624322 / -2.8% 86840351 / 91544437 / -5.1% 0.34 / 0.33 / +2.4%
clickbench_q25/datafusion:parquet 36595920 / 36707436 / -0.3% 100669774 / 104517473 / -3.7% 0.36 / 0.35 / +3.5%
clickbench_q26/datafusion:parquet 30815211 / 31370011 / -1.8% 87151336 / 92598723 / -5.9% 0.35 / 0.34 / +4.4%
clickbench_q27/datafusion:parquet 194675928 / 193103422 / +0.8% 287231284 / 307045861 / -6.5% 0.68 / 0.63 / +7.8%
clickbench_q28/datafusion:parquet 627062856 / 622979524 / +0.7% 698123595 / 706543513 / -1.2% 0.90 / 0.88 / +1.9%
clickbench_q29/datafusion:parquet 28793934 / 29256321 / -1.6% 93466066 / 94873620 / -1.5% 0.31 / 0.31 / -0.1%
clickbench_q30/datafusion:parquet 90621912 / 90587192 / +0.0% 171125395 / 176063158 / -2.8% 0.53 / 0.51 / +2.9%
clickbench_q31/datafusion:parquet 105020738 / 104888823 / +0.1% 190774923 / 202140963 / -5.6% 0.55 / 0.52 / +6.1%
clickbench_q32/datafusion:parquet 328301864 / 324771012 / +1.1% 430566895 / 434695899 / -0.9% 0.76 / 0.75 / +2.1%
clickbench_q33/datafusion:parquet 384534745 / 385847362 / -0.3% 476287527 / 478519395 / -0.5% 0.81 / 0.81 / +0.1%
clickbench_q34/datafusion:parquet 385152307 / 383020442 / +0.6% 476450632 / 476507704 / -0.0% 0.81 / 0.80 / +0.6%
clickbench_q35/datafusion:parquet 64093619 / 64784314 / -1.1% 128143094 / 126563374 / +1.2% 0.50 / 0.51 / -2.3%
clickbench_q36/datafusion:parquet 73506182 / 73651898 / -0.2% 134562896 / 136753511 / -1.6% 0.55 / 0.54 / +1.4%
clickbench_q37/datafusion:parquet 35558237 / 35039778 / +1.5% 91575614 / 91653823 / -0.1% 0.39 / 0.38 / +1.6%
clickbench_q38/datafusion:parquet 47640748 / 47494008 / +0.3% 108000625 / 109412949 / -1.3% 0.44 / 0.43 / +1.6%
clickbench_q39/datafusion:parquet 143273539 / 144710460 / -1.0% 206590979 / 212123174 / -2.6% 0.69 / 0.68 / +1.7%
clickbench_q40/datafusion:parquet 20209258 / 20256758 / -0.2% 78360786 / 78013437 / +0.4% 0.26 / 0.26 / -0.7%
clickbench_q41/datafusion:parquet 18812214 / 18984846 / -0.9% 76377493 / 76762478 / -0.5% 0.25 / 0.25 / -0.4%
clickbench_q42/datafusion:parquet 19391328 / 19188089 / +1.1% 75109666 / 75321197 / -0.3% 0.26 / 0.25 / +1.3%
duckdb / vortex-file-compressed / ns (0.995x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1713400 / 1578789 / +8.5% 27032710 / 24529118 / +10.2% 🔴 0.06 / 0.06 / -1.5%
clickbench_q01/duckdb:vortex-file-compressed 12455947 / 13324354 / -6.5% 32601723 / 30589453 / +6.6% 0.38 / 0.44 / -12.3%
clickbench_q02/duckdb:vortex-file-compressed 13143175 / 14494198 / -9.3% 35997580 / 34232190 / +5.2% 0.37 / 0.42 / -13.8%
clickbench_q03/duckdb:vortex-file-compressed 18409484 / 18283256 / +0.7% 42907075 / 50463176 / -15.0% 🟢 0.43 / 0.36 / +18.4%
clickbench_q04/duckdb:vortex-file-compressed 71627332 / 69306406 / +3.3% 101821777 / 109039097 / -6.6% 0.70 / 0.64 / +10.7%
clickbench_q05/duckdb:vortex-file-compressed 68227456 / 66918524 / +2.0% 103344246 / 100524128 / +2.8% 0.66 / 0.67 / -0.8%
clickbench_q06/duckdb:vortex-file-compressed 1900060 / 1806816 / +5.2% 31421992 / 32730103 / -4.0% 0.06 / 0.06 / +9.5%
clickbench_q07/duckdb:vortex-file-compressed 13674302 / 16167798 / -15.4% 🟢 32339898 / 32381929 / -0.1% 0.42 / 0.50 / -15.3%
clickbench_q08/duckdb:vortex-file-compressed 82297273 / 84096564 / -2.1% 122896164 / 123863193 / -0.8% 0.67 / 0.68 / -1.4%
clickbench_q09/duckdb:vortex-file-compressed 106873814 / 105975568 / +0.8% 146252108 / 145473484 / +0.5% 0.73 / 0.73 / +0.3%
clickbench_q10/duckdb:vortex-file-compressed 33277662 / 32869870 / +1.2% 64851560 / 72259214 / -10.3% 🟢 0.51 / 0.45 / +12.8%
clickbench_q11/duckdb:vortex-file-compressed 34907196 / 36278807 / -3.8% 68954023 / 71819707 / -4.0% 0.51 / 0.51 / +0.2%
clickbench_q12/duckdb:vortex-file-compressed 73896924 / 74876479 / -1.3% 105508144 / 115217692 / -8.4% 0.70 / 0.65 / +7.8%
clickbench_q13/duckdb:vortex-file-compressed 134394390 / 137343210 / -2.1% 174750871 / 186403219 / -6.3% 0.77 / 0.74 / +4.4%
clickbench_q14/duckdb:vortex-file-compressed 79140720 / 78718704 / +0.5% 105439218 / 111186247 / -5.2% 0.75 / 0.71 / +6.0%
clickbench_q15/duckdb:vortex-file-compressed 91115412 / 92186543 / -1.2% 124395621 / 130541884 / -4.7% 0.73 / 0.71 / +3.7%
clickbench_q16/duckdb:vortex-file-compressed 162249783 / 164355924 / -1.3% 205329366 / 213129423 / -3.7% 0.79 / 0.77 / +2.5%
clickbench_q17/duckdb:vortex-file-compressed 164676868 / 169376620 / -2.8% 211762857 / 211814152 / -0.0% 0.78 / 0.80 / -2.8%
clickbench_q18/duckdb:vortex-file-compressed 316435400 / 318252491 / -0.6% 383987827 / 371254117 / +3.4% 0.82 / 0.86 / -3.9%
clickbench_q19/duckdb:vortex-file-compressed 16336616 / 15944375 / +2.5% 38430142 / 46892903 / -18.0% 🟢 0.43 / 0.34 / +25.0%
clickbench_q20/duckdb:vortex-file-compressed 108200629 / 110575446 / -2.1% 193453359 / 190611510 / +1.5% 0.56 / 0.58 / -3.6%
clickbench_q21/duckdb:vortex-file-compressed 155493004 / 156280926 / -0.5% 286837443 / 308972813 / -7.2% 0.54 / 0.51 / +7.2%
clickbench_q22/duckdb:vortex-file-compressed 233529453 / 236968724 / -1.5% 426276613 / 462823576 / -7.9% 0.55 / 0.51 / +7.0%
clickbench_q23/duckdb:vortex-file-compressed 58950230 / 57995725 / +1.6% 103455491 / 99825342 / +3.6% 0.57 / 0.58 / -1.9%
clickbench_q24/duckdb:vortex-file-compressed 26316586 / 26112140 / +0.8% 48182848 / 49463733 / -2.6% 0.55 / 0.53 / +3.5%
clickbench_q25/duckdb:vortex-file-compressed 31971484 / 30934766 / +3.4% 56055272 / 50440704 / +11.1% 🔴 0.57 / 0.61 / -7.0%
clickbench_q26/duckdb:vortex-file-compressed 21571890 / 20466976 / +5.4% 41729937 / 44160704 / -5.5% 0.52 / 0.46 / +11.5%
clickbench_q27/duckdb:vortex-file-compressed 135579916 / 136451772 / -0.6% 241016486 / 255961822 / -5.8% 0.56 / 0.53 / +5.5%
clickbench_q28/duckdb:vortex-file-compressed 603727046 / 766012112 / -21.2% 🟢 676030738 / 695294474 / -2.8% 0.89 / 1.10 / -18.9%
clickbench_q29/duckdb:vortex-file-compressed 19117472 / 18875306 / +1.3% 40143024 / 36452168 / +10.1% 🔴 0.48 / 0.52 / -8.0%
clickbench_q30/duckdb:vortex-file-compressed 65217864 / 65625466 / -0.6% 105492147 / 111966689 / -5.8% 0.62 / 0.59 / +5.5%
clickbench_q31/duckdb:vortex-file-compressed 123417896 / 122030605 / +1.1% 196177276 / 209221183 / -6.2% 0.63 / 0.58 / +7.9%
clickbench_q32/duckdb:vortex-file-compressed 446162930 / 442346572 / +0.9% 516877656 / 491235228 / +5.2% 0.86 / 0.90 / -4.1%
clickbench_q33/duckdb:vortex-file-compressed 400879188 / 395317712 / +1.4% 508001519 / 509352331 / -0.3% 0.79 / 0.78 / +1.7%
clickbench_q34/duckdb:vortex-file-compressed 412167158 / 419908893 / -1.8% 521179790 / 529876543 / -1.6% 0.79 / 0.79 / -0.2%
clickbench_q35/duckdb:vortex-file-compressed 103793701 / 102545280 / +1.2% 135333176 / 138481921 / -2.3% 0.77 / 0.74 / +3.6%
clickbench_q36/duckdb:vortex-file-compressed 15714198 / 15679862 / +0.2% 32918160 / 32041929 / +2.7% 0.48 / 0.49 / -2.4%
clickbench_q37/duckdb:vortex-file-compressed 11764900 / 11259686 / +4.5% 29226024 / 27826173 / +5.0% 0.40 / 0.40 / -0.5%
clickbench_q38/duckdb:vortex-file-compressed 12963768 / 12901802 / +0.5% 28814969 / 28455969 / +1.3% 0.45 / 0.45 / -0.8%
clickbench_q39/duckdb:vortex-file-compressed 22685805 / 23375850 / -3.0% 45197208 / 39352425 / +14.9% 🔴 0.50 / 0.59 / -15.5%
clickbench_q40/duckdb:vortex-file-compressed 11064777 / 11072159 / -0.1% 26568374 / 28420339 / -6.5% 0.42 / 0.39 / +6.9%
clickbench_q41/duckdb:vortex-file-compressed 11777863 / 10534389 / +11.8% 🔴 27147850 / 27721094 / -2.1% 0.43 / 0.38 / +14.2%
clickbench_q42/duckdb:vortex-file-compressed 11741268 / 11276398 / +4.1% 28596692 / 28970916 / -1.3% 0.41 / 0.39 / +5.5%
duckdb / vortex-compact / ns (1.001x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1679590 / 1652820 / +1.6% 25309448 / 25964550 / -2.5% 0.07 / 0.06 / +4.2%
clickbench_q01/duckdb:vortex-compact 15097002 / 12621634 / +19.6% 🔴 33392598 / 29032475 / +15.0% 🔴 0.45 / 0.43 / +4.0%
clickbench_q02/duckdb:vortex-compact 19940169 / 19481157 / +2.4% 40394306 / 38011702 / +6.3% 0.49 / 0.51 / -3.7%
clickbench_q03/duckdb:vortex-compact 20917146 / 20015398 / +4.5% 46456929 / 49044320 / -5.3% 0.45 / 0.41 / +10.3%
clickbench_q04/duckdb:vortex-compact 72697338 / 74029126 / -1.8% 102555449 / 113601890 / -9.7% 0.71 / 0.65 / +8.8%
clickbench_q05/duckdb:vortex-compact 77471170 / 75125354 / +3.1% 102315095 / 102215199 / +0.1% 0.76 / 0.73 / +3.0%
clickbench_q06/duckdb:vortex-compact 1935830 / 1816723 / +6.6% 30284692 / 32506514 / -6.8% 0.06 / 0.06 / +14.4%
clickbench_q07/duckdb:vortex-compact 14611518 / 14395406 / +1.5% 35472535 / 34652265 / +2.4% 0.41 / 0.42 / -0.8%
clickbench_q08/duckdb:vortex-compact 94516456 / 95941973 / -1.5% 147513290 / 134236040 / +9.9% 0.64 / 0.71 / -10.4%
clickbench_q09/duckdb:vortex-compact 157296476 / 145339799 / +8.2% 182973199 / 181596788 / +0.8% 0.86 / 0.80 / +7.4%
clickbench_q10/duckdb:vortex-compact 53479336 / 53028275 / +0.9% 85598150 / 91116073 / -6.1% 0.62 / 0.58 / +7.4%
clickbench_q11/duckdb:vortex-compact 65637154 / 65579892 / +0.1% 104288213 / 105687105 / -1.3% 0.63 / 0.62 / +1.4%
clickbench_q12/duckdb:vortex-compact 88374924 / 86821782 / +1.8% 121837579 / 124684007 / -2.3% 0.73 / 0.70 / +4.2%
clickbench_q13/duckdb:vortex-compact 164483396 / 162771022 / +1.1% 205629690 / 211306435 / -2.7% 0.80 / 0.77 / +3.8%
clickbench_q14/duckdb:vortex-compact 98278052 / 100428035 / -2.1% 136999284 / 130292249 / +5.1% 0.72 / 0.77 / -6.9%
clickbench_q15/duckdb:vortex-compact 97194326 / 96069080 / +1.2% 131439421 / 135339000 / -2.9% 0.74 / 0.71 / +4.2%
clickbench_q16/duckdb:vortex-compact 178833876 / 177068844 / +1.0% 226771611 / 222057948 / +2.1% 0.79 / 0.80 / -1.1%
clickbench_q17/duckdb:vortex-compact 179118354 / 187629660 / -4.5% 220755646 / 236931828 / -6.8% 0.81 / 0.79 / +2.5%
clickbench_q18/duckdb:vortex-compact 345863485 / 330635880 / +4.6% 433926401 / 392724607 / +10.5% 🔴 0.80 / 0.84 / -5.3%
clickbench_q19/duckdb:vortex-compact 17927439 / 16358393 / +9.6% 38735358 / 40060332 / -3.3% 0.46 / 0.41 / +13.3%
clickbench_q20/duckdb:vortex-compact 104188690 / 109626239 / -5.0% 165425205 / 178488238 / -7.3% 0.63 / 0.61 / +2.5%
clickbench_q21/duckdb:vortex-compact 169026234 / 174714578 / -3.3% 291858300 / 320368932 / -8.9% 0.58 / 0.55 / +6.2%
clickbench_q22/duckdb:vortex-compact 344495842 / 349766913 / -1.5% 497127010 / 563008626 / -11.7% 🟢 0.69 / 0.62 / +11.5%
clickbench_q23/duckdb:vortex-compact 91481053 / 106388000 / -14.0% 🟢 138382997 / 129362981 / +7.0% 0.66 / 0.82 / -19.6%
clickbench_q24/duckdb:vortex-compact 31089265 / 30046650 / +3.5% 53202699 / 47940600 / +11.0% 🔴 0.58 / 0.63 / -6.8%
clickbench_q25/duckdb:vortex-compact 47666894 / 45934916 / +3.8% 68364467 / 77900997 / -12.2% 🟢 0.70 / 0.59 / +18.2%
clickbench_q26/duckdb:vortex-compact 26178187 / 24924038 / +5.0% 41914155 / 43068479 / -2.7% 0.62 / 0.58 / +7.9%
clickbench_q27/duckdb:vortex-compact 189558398 / 193386452 / -2.0% 290264301 / 322320581 / -9.9% 0.65 / 0.60 / +8.8%
clickbench_q28/duckdb:vortex-compact 574581876 / 585347024 / -1.8% 697273523 / 711336070 / -2.0% 0.82 / 0.82 / +0.1%
clickbench_q29/duckdb:vortex-compact 21648862 / 22066613 / -1.9% 47322748 / 44392743 / +6.6% 0.46 / 0.50 / -8.0%
clickbench_q30/duckdb:vortex-compact 112458719 / 110204070 / +2.0% 151441574 / 155170600 / -2.4% 0.74 / 0.71 / +4.6%
clickbench_q31/duckdb:vortex-compact 171787599 / 178000558 / -3.5% 239218049 / 247324401 / -3.3% 0.72 / 0.72 / -0.2%
clickbench_q32/duckdb:vortex-compact 449438077 / 484503903 / -7.2% 503294408 / 520136050 / -3.2% 0.89 / 0.93 / -4.1%
clickbench_q33/duckdb:vortex-compact 400598728 / 399164863 / +0.4% 493356365 / 510187368 / -3.3% 0.81 / 0.78 / +3.8%
clickbench_q34/duckdb:vortex-compact 416717374 / 412856104 / +0.9% 516991892 / 542942071 / -4.8% 0.81 / 0.76 / +6.0%
clickbench_q35/duckdb:vortex-compact 109054530 / 109202779 / -0.1% 133256512 / 139792924 / -4.7% 0.82 / 0.78 / +4.8%
clickbench_q36/duckdb:vortex-compact 16980799 / 17161869 / -1.1% 34534961 / 32643371 / +5.8% 0.49 / 0.53 / -6.5%
clickbench_q37/duckdb:vortex-compact 13782755 / 13085065 / +5.3% 31723095 / 30439827 / +4.2% 0.43 / 0.43 / +1.1%
clickbench_q38/duckdb:vortex-compact 13165731 / 14058222 / -6.3% 30123695 / 34056778 / -11.5% 🟢 0.44 / 0.41 / +5.9%
clickbench_q39/duckdb:vortex-compact 25305036 / 27316832 / -7.4% 43351506 / 45014239 / -3.7% 0.58 / 0.61 / -3.8%
clickbench_q40/duckdb:vortex-compact 12217270 / 12559303 / -2.7% 30476732 / 28540945 / +6.8% 0.40 / 0.44 / -8.9%
clickbench_q41/duckdb:vortex-compact 13273766 / 14735450 / -9.9% 28420340 / 28104773 / +1.1% 0.47 / 0.52 / -10.9%
clickbench_q42/duckdb:vortex-compact 11437846 / 11306704 / +1.2% 29593234 / 27341957 / +8.2% 0.39 / 0.41 / -6.5%
duckdb / parquet / ns (1.000x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8684224 / 9821812 / -11.6% 🟢 22845992 / 23669044 / -3.5% 0.38 / 0.41 / -8.4%
clickbench_q01/duckdb:parquet 9994138 / 9313450 / +7.3% 19158778 / 19567786 / -2.1% 0.52 / 0.48 / +9.6%
clickbench_q02/duckdb:parquet 16057960 / 20524228 / -21.8% 🟢 31317954 / 33009907 / -5.1% 0.51 / 0.62 / -17.5%
clickbench_q03/duckdb:parquet 15825708 / 16492412 / -4.0% 52414992 / 53851489 / -2.7% 0.30 / 0.31 / -1.4%
clickbench_q04/duckdb:parquet 69650043 / 69184025 / +0.7% 95405197 / 98168609 / -2.8% 0.73 / 0.70 / +3.6%
clickbench_q05/duckdb:parquet 87887886 / 80859148 / +8.7% 115891669 / 117399515 / -1.3% 0.76 / 0.69 / +10.1%
clickbench_q06/duckdb:parquet 15524012 / 15165445 / +2.4% 26496873 / 24220423 / +9.4% 0.59 / 0.63 / -6.4%
clickbench_q07/duckdb:parquet 11618515 / 12097226 / -4.0% 24362635 / 22505843 / +8.3% 0.48 / 0.54 / -11.3%
clickbench_q08/duckdb:parquet 84153854 / 85818660 / -1.9% 131843243 / 129250153 / +2.0% 0.64 / 0.66 / -3.9%
clickbench_q09/duckdb:parquet 119077335 / 114829314 / +3.7% 158433291 / 160469622 / -1.3% 0.75 / 0.72 / +5.0%
clickbench_q10/duckdb:parquet 34408314 / 32348173 / +6.4% 68878484 / 69673237 / -1.1% 0.50 / 0.46 / +7.6%
clickbench_q11/duckdb:parquet 37632484 / 35503107 / +6.0% 76408997 / 77647035 / -1.6% 0.49 / 0.46 / +7.7%
clickbench_q12/duckdb:parquet 93712460 / 93084518 / +0.7% 141760295 / 129906786 / +9.1% 0.66 / 0.72 / -7.7%
clickbench_q13/duckdb:parquet 163300575 / 143655617 / +13.7% 🔴 212116192 / 223373739 / -5.0% 0.77 / 0.64 / +19.7%
clickbench_q14/duckdb:parquet 101668711 / 98100120 / +3.6% 140007523 / 144348090 / -3.0% 0.73 / 0.68 / +6.9%
clickbench_q15/duckdb:parquet 93454752 / 91763037 / +1.8% 118719497 / 126143761 / -5.9% 0.79 / 0.73 / +8.2%
clickbench_q16/duckdb:parquet 178398998 / 171023727 / +4.3% 227512168 / 262312943 / -13.3% 🟢 0.78 / 0.65 / +20.3%
clickbench_q17/duckdb:parquet 182382372 / 194196719 / -6.1% 226133974 / 237799545 / -4.9% 0.81 / 0.82 / -1.2%
clickbench_q18/duckdb:parquet 328929049 / 324597833 / +1.3% 409210995 / 443213538 / -7.7% 0.80 / 0.73 / +9.8%
clickbench_q19/duckdb:parquet 14006952 / 13378414 / +4.7% 39985793 / 42852109 / -6.7% 0.35 / 0.31 / +12.2%
clickbench_q20/duckdb:parquet 136742420 / 133588866 / +2.4% 248267720 / 247978552 / +0.1% 0.55 / 0.54 / +2.2%
clickbench_q21/duckdb:parquet 183502356 / 179054076 / +2.5% 318315311 / 320354790 / -0.6% 0.58 / 0.56 / +3.1%
clickbench_q22/duckdb:parquet 247431800 / 238516386 / +3.7% 404185049 / 425775872 / -5.1% 0.61 / 0.56 / +9.3%
clickbench_q23/duckdb:parquet 145778481 / 146809746 / -0.7% 171257700 / 175834812 / -2.6% 0.85 / 0.83 / +2.0%
clickbench_q24/duckdb:parquet 41996135 / 48040393 / -12.6% 🟢 59974675 / 60656031 / -1.1% 0.70 / 0.79 / -11.6%
clickbench_q25/duckdb:parquet 39731594 / 39567478 / +0.4% 88552540 / 92983999 / -4.8% 0.45 / 0.43 / +5.4%
clickbench_q26/duckdb:parquet 31321646 / 29665575 / +5.6% 45276889 / 46593820 / -2.8% 0.69 / 0.64 / +8.7%
clickbench_q27/duckdb:parquet 146539635 / 145101658 / +1.0% 255498462 / 254689044 / +0.3% 0.57 / 0.57 / +0.7%
clickbench_q28/duckdb:parquet 898082262 / 903967838 / -0.7% 1021828739 / 993984593 / +2.8% 0.88 / 0.91 / -3.4%
clickbench_q29/duckdb:parquet 17508981 / 17240290 / +1.6% 32563802 / 32192131 / +1.2% 0.54 / 0.54 / +0.4%
clickbench_q30/duckdb:parquet 91206671 / 90937337 / +0.3% 173930126 / 173472289 / +0.3% 0.52 / 0.52 / +0.0%
clickbench_q31/duckdb:parquet 143766249 / 157123869 / -8.5% 288440560 / 294027875 / -1.9% 0.50 / 0.53 / -6.7%
clickbench_q32/duckdb:parquet 455737882 / 453955480 / +0.4% 494987281 / 513655497 / -3.6% 0.92 / 0.88 / +4.2%
clickbench_q33/duckdb:parquet 465231051 / 445444489 / +4.4% 514703507 / 495513130 / +3.9% 0.90 / 0.90 / +0.5%
clickbench_q34/duckdb:parquet 461698625 / 471154396 / -2.0% 499757258 / 498600306 / +0.2% 0.92 / 0.94 / -2.2%
clickbench_q35/duckdb:parquet 100172494 / 100417462 / -0.2% 123955487 / 121742160 / +1.8% 0.81 / 0.82 / -2.0%
clickbench_q36/duckdb:parquet 30595536 / 31042618 / -1.4% 42528258 / 41362319 / +2.8% 0.72 / 0.75 / -4.1%
clickbench_q37/duckdb:parquet 23147101 / 24024682 / -3.7% 32610721 / 34881613 / -6.5% 0.71 / 0.69 / +3.1%
clickbench_q38/duckdb:parquet 23648722 / 23591624 / +0.2% 34114735 / 50420662 / -32.3% 🟢 0.69 / 0.47 / +48.2%
clickbench_q39/duckdb:parquet 56332782 / 56704222 / -0.7% 65679361 / 67011659 / -2.0% 0.86 / 0.85 / +1.4%
clickbench_q40/duckdb:parquet 12843900 / 12878810 / -0.3% 22122233 / 23435776 / -5.6% 0.58 / 0.55 / +5.7%
clickbench_q41/duckdb:parquet 13458798 / 13517481 / -0.4% 33162245 / 24202315 / +37.0% 🔴 0.41 / 0.56 / -27.3%
clickbench_q42/duckdb:parquet 14540394 / 14312158 / +1.6% 25152988 / 24819105 / +1.3% 0.58 / 0.58 / +0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24056598 / 24163068 / -0.4% 44811712 / 43774832 / +2.4% 0.54 / 0.55 / -2.7%
tpcds_q02/datafusion:vortex-file-compressed 46027737 / 45637784 / +0.9% 62647120 / 63269281 / -1.0% 0.73 / 0.72 / +1.9%
tpcds_q03/datafusion:vortex-file-compressed 11493542 / 11582400 / -0.8% 30055358 / 29230857 / +2.8% 0.38 / 0.40 / -3.5%
tpcds_q04/datafusion:vortex-file-compressed 113073672 / 112770664 / +0.3% 143105548 / 142689332 / +0.3% 0.79 / 0.79 / -0.0%
tpcds_q05/datafusion:vortex-file-compressed 60420986 / 61125324 / -1.2% 83571337 / 83691423 / -0.1% 0.72 / 0.73 / -1.0%
tpcds_q06/datafusion:vortex-file-compressed 24077044 / 23868142 / +0.9% 46697456 / 48964360 / -4.6% 0.52 / 0.49 / +5.8%
tpcds_q07/datafusion:vortex-file-compressed 32494555 / 33161036 / -2.0% 56714937 / 58883506 / -3.7% 0.57 / 0.56 / +1.7%
tpcds_q08/datafusion:vortex-file-compressed 25469347 / 25857710 / -1.5% 44450972 / 46962870 / -5.3% 0.57 / 0.55 / +4.1%
tpcds_q09/datafusion:vortex-file-compressed 17752798 / 16856758 / +5.3% 35798517 / 36462539 / -1.8% 0.50 / 0.46 / +7.3%
tpcds_q10/datafusion:vortex-file-compressed 29178586 / 28863278 / +1.1% 51089225 / 51023438 / +0.1% 0.57 / 0.57 / +1.0%
tpcds_q11/datafusion:vortex-file-compressed 63528030 / 63125954 / +0.6% 89207898 / 90451713 / -1.4% 0.71 / 0.70 / +2.0%
tpcds_q12/datafusion:vortex-file-compressed 16212654 / 16089138 / +0.8% 33732305 / 33130178 / +1.8% 0.48 / 0.49 / -1.0%
tpcds_q13/datafusion:vortex-file-compressed 33767640 / 34651763 / -2.6% 53639111 / 54577922 / -1.7% 0.63 / 0.63 / -0.8%
tpcds_q14/datafusion:vortex-file-compressed 92059311 / 91234090 / +0.9% 121252177 / 122898801 / -1.3% 0.76 / 0.74 / +2.3%
tpcds_q15/datafusion:vortex-file-compressed 23810796 / 23816234 / -0.0% 43424064 / 43624834 / -0.5% 0.55 / 0.55 / +0.4%
tpcds_q16/datafusion:vortex-file-compressed 21036210 / 20718892 / +1.5% 43487470 / 42505292 / +2.3% 0.48 / 0.49 / -0.8%
tpcds_q17/datafusion:vortex-file-compressed 62324018 / 62469686 / -0.2% 84051341 / 83947654 / +0.1% 0.74 / 0.74 / -0.4%
tpcds_q18/datafusion:vortex-file-compressed 68864620 / 69667451 / -1.2% 97799648 / 93006893 / +5.2% 0.70 / 0.75 / -6.0%
tpcds_q19/datafusion:vortex-file-compressed 18014970 / 18573342 / -3.0% 41389615 / 39883247 / +3.8% 0.44 / 0.47 / -6.5%
tpcds_q20/datafusion:vortex-file-compressed 17331582 / 17776746 / -2.5% 35867699 / 35340122 / +1.5% 0.48 / 0.50 / -3.9%
tpcds_q21/datafusion:vortex-file-compressed 16401400 / 17556130 / -6.6% 40347845 / 39297480 / +2.7% 0.41 / 0.45 / -9.0%
tpcds_q22/datafusion:vortex-file-compressed 49886140 / 50185336 / -0.6% 71159107 / 70814534 / +0.5% 0.70 / 0.71 / -1.1%
tpcds_q23/datafusion:vortex-file-compressed 74748794 / 74830970 / -0.1% 101675848 / 102293352 / -0.6% 0.74 / 0.73 / +0.5%
tpcds_q24/datafusion:vortex-file-compressed 70342526 / 70897081 / -0.8% 95527473 / 95429269 / +0.1% 0.74 / 0.74 / -0.9%
tpcds_q25/datafusion:vortex-file-compressed 55426355 / 53553098 / +3.5% 83446488 / 82137275 / +1.6% 0.66 / 0.65 / +1.9%
tpcds_q26/datafusion:vortex-file-compressed 30185490 / 30127830 / +0.2% 51416857 / 52712396 / -2.5% 0.59 / 0.57 / +2.7%
tpcds_q27/datafusion:vortex-file-compressed 62017468 / 63023474 / -1.6% 90839444 / 87874319 / +3.4% 0.68 / 0.72 / -4.8%
tpcds_q28/datafusion:vortex-file-compressed 18080947 / 18127736 / -0.3% 38256026 / 38746866 / -1.3% 0.47 / 0.47 / +1.0%
tpcds_q29/datafusion:vortex-file-compressed 61472012 / 60575720 / +1.5% 86513745 / 86131633 / +0.4% 0.71 / 0.70 / +1.0%
tpcds_q30/datafusion:vortex-file-compressed 27211450 / 27529172 / -1.2% 46942672 / 45289685 / +3.6% 0.58 / 0.61 / -4.6%
tpcds_q31/datafusion:vortex-file-compressed 64646182 / 64970681 / -0.5% 91529548 / 93733219 / -2.4% 0.71 / 0.69 / +1.9%
tpcds_q32/datafusion:vortex-file-compressed 13640078 / 13563442 / +0.6% 32513615 / 32395802 / +0.4% 0.42 / 0.42 / +0.2%
tpcds_q33/datafusion:vortex-file-compressed 27167216 / 27149859 / +0.1% 49905635 / 49690418 / +0.4% 0.54 / 0.55 / -0.4%
tpcds_q34/datafusion:vortex-file-compressed 18182680 / 18246792 / -0.4% 39477293 / 40048605 / -1.4% 0.46 / 0.46 / +1.1%
tpcds_q35/datafusion:vortex-file-compressed 35791652 / 35716450 / +0.2% 58921956 / 59476314 / -0.9% 0.61 / 0.60 / +1.2%
tpcds_q36/datafusion:vortex-file-compressed 48496793 / 47429849 / +2.2% 77698002 / 71906659 / +8.1% 0.62 / 0.66 / -5.4%
tpcds_q37/datafusion:vortex-file-compressed 13583638 / 14038558 / -3.2% 34999556 / 36892869 / -5.1% 0.39 / 0.38 / +2.0%
tpcds_q38/datafusion:vortex-file-compressed 30244688 / 29448402 / +2.7% 54706053 / 53420174 / +2.4% 0.55 / 0.55 / +0.3%
tpcds_q39/datafusion:vortex-file-compressed 65368686 / 65270585 / +0.2% 92840716 / 92883117 / -0.0% 0.70 / 0.70 / +0.2%
tpcds_q40/datafusion:vortex-file-compressed 26037422 / 24920602 / +4.5% 44503560 / 46444497 / -4.2% 0.59 / 0.54 / +9.0%
tpcds_q41/datafusion:vortex-file-compressed 16741714 / 16801068 / -0.4% 31276149 / 31099165 / +0.6% 0.54 / 0.54 / -0.9%
tpcds_q42/datafusion:vortex-file-compressed 11341574 / 11597862 / -2.2% 28314155 / 27988597 / +1.2% 0.40 / 0.41 / -3.3%
tpcds_q43/datafusion:vortex-file-compressed 13947266 / 13440415 / +3.8% 32176181 / 32651479 / -1.5% 0.43 / 0.41 / +5.3%
tpcds_q44/datafusion:vortex-file-compressed 26920782 / 25787644 / +4.4% 50881287 / 50587652 / +0.6% 0.53 / 0.51 / +3.8%
tpcds_q45/datafusion:vortex-file-compressed 28268880 / 27742688 / +1.9% 48016437 / 48932235 / -1.9% 0.59 / 0.57 / +3.8%
tpcds_q46/datafusion:vortex-file-compressed 24637757 / 24437472 / +0.8% 48300564 / 47884372 / +0.9% 0.51 / 0.51 / -0.0%
tpcds_q47/datafusion:vortex-file-compressed 79822866 / 77927350 / +2.4% 110185628 / 108161819 / +1.9% 0.72 / 0.72 / +0.6%
tpcds_q48/datafusion:vortex-file-compressed 31779742 / 31457898 / +1.0% 50860045 / 52713632 / -3.5% 0.62 / 0.60 / +4.7%
tpcds_q49/datafusion:vortex-file-compressed 59736322 / 60542442 / -1.3% 82301153 / 86966583 / -5.4% 0.73 / 0.70 / +4.3%
tpcds_q50/datafusion:vortex-file-compressed 33789038 / 34055689 / -0.8% 56140123 / 57525349 / -2.4% 0.60 / 0.59 / +1.7%
tpcds_q51/datafusion:vortex-file-compressed 61309881 / 61408391 / -0.2% 86884774 / 85090625 / +2.1% 0.71 / 0.72 / -2.2%
tpcds_q52/datafusion:vortex-file-compressed 11794388 / 11733191 / +0.5% 29507625 / 30639944 / -3.7% 0.40 / 0.38 / +4.4%
tpcds_q53/datafusion:vortex-file-compressed 18348865 / 18245437 / +0.6% 38883907 / 38891553 / -0.0% 0.47 / 0.47 / +0.6%
tpcds_q54/datafusion:vortex-file-compressed 33843504 / 33786731 / +0.2% 60188867 / 61557192 / -2.2% 0.56 / 0.55 / +2.4%
tpcds_q55/datafusion:vortex-file-compressed 11198799 / 11251327 / -0.5% 28703655 / 28447838 / +0.9% 0.39 / 0.40 / -1.4%
tpcds_q56/datafusion:vortex-file-compressed 27127310 / 26563451 / +2.1% 49850502 / 50547026 / -1.4% 0.54 / 0.53 / +3.5%
tpcds_q57/datafusion:vortex-file-compressed 73174964 / 73206396 / -0.0% 97795505 / 98342975 / -0.6% 0.75 / 0.74 / +0.5%
tpcds_q58/datafusion:vortex-file-compressed 40621310 / 40948525 / -0.8% 68850401 / 69363720 / -0.7% 0.59 / 0.59 / -0.1%
tpcds_q59/datafusion:vortex-file-compressed 32434220 / 32538772 / -0.3% 54083931 / 54217176 / -0.2% 0.60 / 0.60 / -0.1%
tpcds_q60/datafusion:vortex-file-compressed 27041826 / 26665502 / +1.4% 50339509 / 50361492 / -0.0% 0.54 / 0.53 / +1.5%
tpcds_q61/datafusion:vortex-file-compressed 24525884 / 24280790 / +1.0% 48642508 / 48206678 / +0.9% 0.50 / 0.50 / +0.1%
tpcds_q62/datafusion:vortex-file-compressed 17377967 / 17286110 / +0.5% 36988260 / 37297741 / -0.8% 0.47 / 0.46 / +1.4%
tpcds_q63/datafusion:vortex-file-compressed 18620896 / 18700194 / -0.4% 40229863 / 38695222 / +4.0% 0.46 / 0.48 / -4.2%
tpcds_q64/datafusion:vortex-file-compressed 323135510 / 325854208 / -0.8% 358809316 / 352813534 / +1.7% 0.90 / 0.92 / -2.5%
tpcds_q65/datafusion:vortex-file-compressed 75847444 / 75668632 / +0.2% 94559342 / 100447270 / -5.9% 0.80 / 0.75 / +6.5%
tpcds_q66/datafusion:vortex-file-compressed 53220529 / 53270924 / -0.1% 76601660 / 77351381 / -1.0% 0.69 / 0.69 / +0.9%
tpcds_q67/datafusion:vortex-file-compressed 55309353 / 55708194 / -0.7% 86190314 / 86145263 / +0.1% 0.64 / 0.65 / -0.8%
tpcds_q68/datafusion:vortex-file-compressed 24339026 / 24653552 / -1.3% 48345284 / 47029825 / +2.8% 0.50 / 0.52 / -4.0%
tpcds_q69/datafusion:vortex-file-compressed 29107488 / 27790266 / +4.7% 49056659 / 49933643 / -1.8% 0.59 / 0.56 / +6.6%
tpcds_q70/datafusion:vortex-file-compressed 71473342 / 71720850 / -0.3% 93993795 / 95827563 / -1.9% 0.76 / 0.75 / +1.6%
tpcds_q71/datafusion:vortex-file-compressed 18930638 / 18605718 / +1.7% 40257858 / 41739516 / -3.5% 0.47 / 0.45 / +5.5%
tpcds_q72/datafusion:vortex-file-compressed 457602050 / 470580891 / -2.8% 480235266 / 487139955 / -1.4% 0.95 / 0.97 / -1.4%
tpcds_q73/datafusion:vortex-file-compressed 17538636 / 17732419 / -1.1% 37923001 / 39049400 / -2.9% 0.46 / 0.45 / +1.8%
tpcds_q74/datafusion:vortex-file-compressed 45288164 / 45718045 / -0.9% 71071734 / 70493316 / +0.8% 0.64 / 0.65 / -1.7%
tpcds_q75/datafusion:vortex-file-compressed 130432452 / 132912118 / -1.9% 162731120 / 163103084 / -0.2% 0.80 / 0.81 / -1.6%
tpcds_q76/datafusion:vortex-file-compressed 44157957 / 42769599 / +3.2% 63083628 / 64797429 / -2.6% 0.70 / 0.66 / +6.1%
tpcds_q77/datafusion:vortex-file-compressed 35589352 / 34733855 / +2.5% 59382581 / 60873174 / -2.4% 0.60 / 0.57 / +5.0%
tpcds_q78/datafusion:vortex-file-compressed 80025834 / 81245800 / -1.5% 110803374 / 109882269 / +0.8% 0.72 / 0.74 / -2.3%
tpcds_q79/datafusion:vortex-file-compressed 21272222 / 20908758 / +1.7% 43558523 / 43926029 / -0.8% 0.49 / 0.48 / +2.6%
tpcds_q80/datafusion:vortex-file-compressed 76937962 / 76068055 / +1.1% 113774714 / 111039277 / +2.5% 0.68 / 0.69 / -1.3%
tpcds_q81/datafusion:vortex-file-compressed 27986188 / 28045770 / -0.2% 44996124 / 46813661 / -3.9% 0.62 / 0.60 / +3.8%
tpcds_q82/datafusion:vortex-file-compressed 13039762 / 13723832 / -5.0% 33365417 / 36602403 / -8.8% 0.39 / 0.37 / +4.2%
tpcds_q83/datafusion:vortex-file-compressed 36081766 / 36126160 / -0.1% 58234069 / 58574654 / -0.6% 0.62 / 0.62 / +0.5%
tpcds_q84/datafusion:vortex-file-compressed 11978034 / 11815944 / +1.4% 28911918 / 28890809 / +0.1% 0.41 / 0.41 / +1.3%
tpcds_q85/datafusion:vortex-file-compressed 59380466 / 59596584 / -0.4% 84587546 / 84221896 / +0.4% 0.70 / 0.71 / -0.8%
tpcds_q86/datafusion:vortex-file-compressed 16274662 / 16911888 / -3.8% 34024544 / 34220325 / -0.6% 0.48 / 0.49 / -3.2%
tpcds_q87/datafusion:vortex-file-compressed 29267080 / 29757487 / -1.6% 53639104 / 52399838 / +2.4% 0.55 / 0.57 / -3.9%
tpcds_q88/datafusion:vortex-file-compressed 34458100 / 34200800 / +0.8% 63352258 / 62320003 / +1.7% 0.54 / 0.55 / -0.9%
tpcds_q89/datafusion:vortex-file-compressed 21360480 / 21114277 / +1.2% 42421731 / 42605227 / -0.4% 0.50 / 0.50 / +1.6%
tpcds_q90/datafusion:vortex-file-compressed 10517132 / 10461269 / +0.5% 27440447 / 27743519 / -1.1% 0.38 / 0.38 / +1.6%
tpcds_q91/datafusion:vortex-file-compressed 16752132 / 17431820 / -3.9% 35840870 / 37151800 / -3.5% 0.47 / 0.47 / -0.4%
tpcds_q92/datafusion:vortex-file-compressed 13810844 / 13868748 / -0.4% 32416731 / 32330913 / +0.3% 0.43 / 0.43 / -0.7%
tpcds_q93/datafusion:vortex-file-compressed 23649282 / 24239101 / -2.4% 47239118 / 44723444 / +5.6% 0.50 / 0.54 / -7.6%
tpcds_q94/datafusion:vortex-file-compressed 19702346 / 19598816 / +0.5% 40328928 / 40304843 / +0.1% 0.49 / 0.49 / +0.5%
tpcds_q95/datafusion:vortex-file-compressed 46407124 / 46569322 / -0.3% 67986427 / 67688758 / +0.4% 0.68 / 0.69 / -0.8%
tpcds_q96/datafusion:vortex-file-compressed 9458054 / 9346330 / +1.2% 25916193 / 25627780 / +1.1% 0.36 / 0.36 / +0.1%
tpcds_q97/datafusion:vortex-file-compressed 21171206 / 21431073 / -1.2% 44438845 / 44689913 / -0.6% 0.48 / 0.48 / -0.7%
tpcds_q98/datafusion:vortex-file-compressed 17432834 / 17045712 / +2.3% 39082634 / 36977385 / +5.7% 0.45 / 0.46 / -3.2%
tpcds_q99/datafusion:vortex-file-compressed 19419810 / 19632842 / -1.1% 38970616 / 38973413 / -0.0% 0.50 / 0.50 / -1.1%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25615886 / 26381896 / -2.9% 45265893 / 45711888 / -1.0% 0.57 / 0.58 / -1.9%
tpcds_q02/datafusion:vortex-compact 49124864 / 49206458 / -0.2% 67554486 / 69560091 / -2.9% 0.73 / 0.71 / +2.8%
tpcds_q03/datafusion:vortex-compact 12566071 / 12964872 / -3.1% 33044294 / 34148194 / -3.2% 0.38 / 0.38 / +0.2%
tpcds_q04/datafusion:vortex-compact 122553428 / 124014154 / -1.2% 153770532 / 154626728 / -0.6% 0.80 / 0.80 / -0.6%
tpcds_q05/datafusion:vortex-compact 62989118 / 62802564 / +0.3% 84863918 / 84750970 / +0.1% 0.74 / 0.74 / +0.2%
tpcds_q06/datafusion:vortex-compact 26832029 / 27148250 / -1.2% 48451508 / 48483033 / -0.1% 0.55 / 0.56 / -1.1%
tpcds_q07/datafusion:vortex-compact 35603202 / 35781422 / -0.5% 54510383 / 58187605 / -6.3% 0.65 / 0.61 / +6.2%
tpcds_q08/datafusion:vortex-compact 30436564 / 30238282 / +0.7% 46281558 / 49775104 / -7.0% 0.66 / 0.61 / +8.3%
tpcds_q09/datafusion:vortex-compact 21563322 / 22233783 / -3.0% 41927122 / 40652864 / +3.1% 0.51 / 0.55 / -6.0%
tpcds_q10/datafusion:vortex-compact 38367142 / 38218247 / +0.4% 58950149 / 59475000 / -0.9% 0.65 / 0.64 / +1.3%
tpcds_q11/datafusion:vortex-compact 67744016 / 67540481 / +0.3% 93567314 / 95628870 / -2.2% 0.72 / 0.71 / +2.5%
tpcds_q12/datafusion:vortex-compact 20869404 / 21020398 / -0.7% 41087521 / 40532553 / +1.4% 0.51 / 0.52 / -2.1%
tpcds_q13/datafusion:vortex-compact 54313721 / 54544330 / -0.4% 74162250 / 76359475 / -2.9% 0.73 / 0.71 / +2.5%
tpcds_q14/datafusion:vortex-compact 96886883 / 97177568 / -0.3% 120900586 / 121312461 / -0.3% 0.80 / 0.80 / +0.0%
tpcds_q15/datafusion:vortex-compact 27798569 / 27512532 / +1.0% 46228092 / 47908062 / -3.5% 0.60 / 0.57 / +4.7%
tpcds_q16/datafusion:vortex-compact 23102495 / 24917624 / -7.3% 43639177 / 45100261 / -3.2% 0.53 / 0.55 / -4.2%
tpcds_q17/datafusion:vortex-compact 69519012 / 64403106 / +7.9% 91263294 / 92285583 / -1.1% 0.76 / 0.70 / +9.2%
tpcds_q18/datafusion:vortex-compact 68976066 / 68405956 / +0.8% 94431591 / 91679541 / +3.0% 0.73 / 0.75 / -2.1%
tpcds_q19/datafusion:vortex-compact 23888560 / 22643134 / +5.5% 42549059 / 43593614 / -2.4% 0.56 / 0.52 / +8.1%
tpcds_q20/datafusion:vortex-compact 22162902 / 22063578 / +0.5% 41884107 / 41153621 / +1.8% 0.53 / 0.54 / -1.3%
tpcds_q21/datafusion:vortex-compact 17926692 / 17981607 / -0.3% 40701874 / 42216086 / -3.6% 0.44 / 0.43 / +3.4%
tpcds_q22/datafusion:vortex-compact 49949180 / 50394506 / -0.9% 73188734 / 74561156 / -1.8% 0.68 / 0.68 / +1.0%
tpcds_q23/datafusion:vortex-compact 78201602 / 76253002 / +2.6% 104907431 / 105834127 / -0.9% 0.75 / 0.72 / +3.5%
tpcds_q24/datafusion:vortex-compact 77801390 / 78806986 / -1.3% 102422606 / 102893377 / -0.5% 0.76 / 0.77 / -0.8%
tpcds_q25/datafusion:vortex-compact 58952132 / 62269362 / -5.3% 88175410 / 82031006 / +7.5% 0.67 / 0.76 / -11.9%
tpcds_q26/datafusion:vortex-compact 32874058 / 32914974 / -0.1% 55328849 / 52023501 / +6.4% 0.59 / 0.63 / -6.1%
tpcds_q27/datafusion:vortex-compact 62685710 / 65871546 / -4.8% 91919805 / 85664844 / +7.3% 0.68 / 0.77 / -11.3%
tpcds_q28/datafusion:vortex-compact 27137296 / 27702532 / -2.0% 50606057 / 50660810 / -0.1% 0.54 / 0.55 / -1.9%
tpcds_q29/datafusion:vortex-compact 66202224 / 61694033 / +7.3% 85310359 / 86375157 / -1.2% 0.78 / 0.71 / +8.6%
tpcds_q30/datafusion:vortex-compact 31088462 / 29881807 / +4.0% 49634632 / 49162420 / +1.0% 0.63 / 0.61 / +3.0%
tpcds_q31/datafusion:vortex-compact 77022016 / 77234121 / -0.3% 104280710 / 101693068 / +2.5% 0.74 / 0.76 / -2.7%
tpcds_q32/datafusion:vortex-compact 16530244 / 16461226 / +0.4% 36275208 / 35840349 / +1.2% 0.46 / 0.46 / -0.8%
tpcds_q33/datafusion:vortex-compact 29853459 / 27851576 / +7.2% 50899895 / 50541974 / +0.7% 0.59 / 0.55 / +6.4%
tpcds_q34/datafusion:vortex-compact 22600262 / 20829875 / +8.5% 46487820 / 40768164 / +14.0% 🔴 0.49 / 0.51 / -4.9%
tpcds_q35/datafusion:vortex-compact 40655240 / 41106830 / -1.1% 66450680 / 67215274 / -1.1% 0.61 / 0.61 / +0.0%
tpcds_q36/datafusion:vortex-compact 51784274 / 52011986 / -0.4% 74753589 / 79759742 / -6.3% 0.69 / 0.65 / +6.2%
tpcds_q37/datafusion:vortex-compact 15879038 / 15460734 / +2.7% 37939407 / 38344959 / -1.1% 0.42 / 0.40 / +3.8%
tpcds_q38/datafusion:vortex-compact 34238830 / 34399470 / -0.5% 56473213 / 56330493 / +0.3% 0.61 / 0.61 / -0.7%
tpcds_q39/datafusion:vortex-compact 67095116 / 67458438 / -0.5% 91663975 / 89564492 / +2.3% 0.73 / 0.75 / -2.8%
tpcds_q40/datafusion:vortex-compact 27809509 / 28160152 / -1.2% 51259858 / 51651838 / -0.8% 0.54 / 0.55 / -0.5%
tpcds_q41/datafusion:vortex-compact 18772172 / 18853854 / -0.4% 33106169 / 32846757 / +0.8% 0.57 / 0.57 / -1.2%
tpcds_q42/datafusion:vortex-compact 12042646 / 12764923 / -5.7% 32409988 / 34505097 / -6.1% 0.37 / 0.37 / +0.4%
tpcds_q43/datafusion:vortex-compact 15327725 / 16155313 / -5.1% 34617491 / 34982376 / -1.0% 0.44 / 0.46 / -4.1%
tpcds_q44/datafusion:vortex-compact 31146668 / 30547522 / +2.0% 53642656 / 56071832 / -4.3% 0.58 / 0.54 / +6.6%
tpcds_q45/datafusion:vortex-compact 30341894 / 30615166 / -0.9% 52666135 / 50249924 / +4.8% 0.58 / 0.61 / -5.4%
tpcds_q46/datafusion:vortex-compact 29466760 / 28066585 / +5.0% 51575133 / 49712400 / +3.7% 0.57 / 0.56 / +1.2%
tpcds_q47/datafusion:vortex-compact 87619581 / 88779759 / -1.3% 117177198 / 116738922 / +0.4% 0.75 / 0.76 / -1.7%
tpcds_q48/datafusion:vortex-compact 50574336 / 50550524 / +0.0% 70624468 / 70565684 / +0.1% 0.72 / 0.72 / -0.0%
tpcds_q49/datafusion:vortex-compact 65634480 / 65174604 / +0.7% 96495907 / 91849246 / +5.1% 0.68 / 0.71 / -4.1%
tpcds_q50/datafusion:vortex-compact 37851079 / 37050494 / +2.2% 59197616 / 58573688 / +1.1% 0.64 / 0.63 / +1.1%
tpcds_q51/datafusion:vortex-compact 62498550 / 63545436 / -1.6% 83317872 / 87293535 / -4.6% 0.75 / 0.73 / +3.0%
tpcds_q52/datafusion:vortex-compact 13978226 / 12927536 / +8.1% 33069080 / 32291415 / +2.4% 0.42 / 0.40 / +5.6%
tpcds_q53/datafusion:vortex-compact 22146190 / 23126081 / -4.2% 42434920 / 43852564 / -3.2% 0.52 / 0.53 / -1.0%
tpcds_q54/datafusion:vortex-compact 38612644 / 40263338 / -4.1% 64936281 / 64765060 / +0.3% 0.59 / 0.62 / -4.4%
tpcds_q55/datafusion:vortex-compact 12719294 / 12594568 / +1.0% 32149176 / 32259868 / -0.3% 0.40 / 0.39 / +1.3%
tpcds_q56/datafusion:vortex-compact 28716909 / 29641720 / -3.1% 53204719 / 50529589 / +5.3% 0.54 / 0.59 / -8.0%
tpcds_q57/datafusion:vortex-compact 80590984 / 81047049 / -0.6% 107413595 / 107598834 / -0.2% 0.75 / 0.75 / -0.4%
tpcds_q58/datafusion:vortex-compact 47599814 / 48773860 / -2.4% 75211216 / 76336223 / -1.5% 0.63 / 0.64 / -0.9%
tpcds_q59/datafusion:vortex-compact 40361486 / 41302516 / -2.3% 61310022 / 61250416 / +0.1% 0.66 / 0.67 / -2.4%
tpcds_q60/datafusion:vortex-compact 28982500 / 29170073 / -0.6% 52572583 / 50377040 / +4.4% 0.55 / 0.58 / -4.8%
tpcds_q61/datafusion:vortex-compact 28067086 / 27031464 / +3.8% 47144649 / 49039149 / -3.9% 0.60 / 0.55 / +8.0%
tpcds_q62/datafusion:vortex-compact 18071015 / 18156382 / -0.5% 36577352 / 36891958 / -0.9% 0.49 / 0.49 / +0.4%
tpcds_q63/datafusion:vortex-compact 23525843 / 23523990 / +0.0% 43523055 / 43540409 / -0.0% 0.54 / 0.54 / +0.0%
tpcds_q64/datafusion:vortex-compact 445374542 / 445896268 / -0.1% 464086949 / 468671468 / -1.0% 0.96 / 0.95 / +0.9%
tpcds_q65/datafusion:vortex-compact 81233608 / 81595430 / -0.4% 102343460 / 102503765 / -0.2% 0.79 / 0.80 / -0.3%
tpcds_q66/datafusion:vortex-compact 54955653 / 55113063 / -0.3% 77765110 / 79314012 / -2.0% 0.71 / 0.69 / +1.7%
tpcds_q67/datafusion:vortex-compact 59272116 / 59675053 / -0.7% 91485630 / 90081294 / +1.6% 0.65 / 0.66 / -2.2%
tpcds_q68/datafusion:vortex-compact 30926542 / 27681817 / +11.7% 🔴 51539195 / 51698732 / -0.3% 0.60 / 0.54 / +12.1%
tpcds_q69/datafusion:vortex-compact 36394682 / 37393936 / -2.7% 58860637 / 60043283 / -2.0% 0.62 / 0.62 / -0.7%
tpcds_q70/datafusion:vortex-compact 76036742 / 75981554 / +0.1% 96322226 / 99498931 / -3.2% 0.79 / 0.76 / +3.4%
tpcds_q71/datafusion:vortex-compact 21636772 / 20131696 / +7.5% 39946913 / 41483329 / -3.7% 0.54 / 0.49 / +11.6%
tpcds_q72/datafusion:vortex-compact 466672393 / 475859891 / -1.9% 511176777 / 506110892 / +1.0% 0.91 / 0.94 / -2.9%
tpcds_q73/datafusion:vortex-compact 19729250 / 21198046 / -6.9% 40726360 / 43973011 / -7.4% 0.48 / 0.48 / +0.5%
tpcds_q74/datafusion:vortex-compact 51917140 / 51319051 / +1.2% 75048963 / 77475920 / -3.1% 0.69 / 0.66 / +4.4%
tpcds_q75/datafusion:vortex-compact 137872914 / 139206709 / -1.0% 166746147 / 166196239 / +0.3% 0.83 / 0.84 / -1.3%
tpcds_q76/datafusion:vortex-compact 41990208 / 41136326 / +2.1% 60170823 / 62797775 / -4.2% 0.70 / 0.66 / +6.5%
tpcds_q77/datafusion:vortex-compact 39244230 / 37964824 / +3.4% 64448077 / 64315045 / +0.2% 0.61 / 0.59 / +3.2%
tpcds_q78/datafusion:vortex-compact 86774130 / 86734609 / +0.0% 116695971 / 113673930 / +2.7% 0.74 / 0.76 / -2.5%
tpcds_q79/datafusion:vortex-compact 27956338 / 27202592 / +2.8% 50074364 / 46148111 / +8.5% 0.56 / 0.59 / -5.3%
tpcds_q80/datafusion:vortex-compact 80103356 / 79582734 / +0.7% 114734783 / 109796840 / +4.5% 0.70 / 0.72 / -3.7%
tpcds_q81/datafusion:vortex-compact 29932124 / 29898680 / +0.1% 47377592 / 48171404 / -1.6% 0.63 / 0.62 / +1.8%
tpcds_q82/datafusion:vortex-compact 15428998 / 15676989 / -1.6% 39640641 / 42228186 / -6.1% 0.39 / 0.37 / +4.8%
tpcds_q83/datafusion:vortex-compact 37057496 / 37454244 / -1.1% 61236712 / 58138511 / +5.3% 0.61 / 0.64 / -6.1%
tpcds_q84/datafusion:vortex-compact 13092362 / 13390438 / -2.2% 29829048 / 30286686 / -1.5% 0.44 / 0.44 / -0.7%
tpcds_q85/datafusion:vortex-compact 102798390 / 103168960 / -0.4% 125425892 / 127991376 / -2.0% 0.82 / 0.81 / +1.7%
tpcds_q86/datafusion:vortex-compact 16990959 / 16501794 / +3.0% 35666806 / 35953390 / -0.8% 0.48 / 0.46 / +3.8%
tpcds_q87/datafusion:vortex-compact 34712376 / 34117762 / +1.7% 58406898 / 57206435 / +2.1% 0.59 / 0.60 / -0.3%
tpcds_q88/datafusion:vortex-compact 41193157 / 42354771 / -2.7% 65856767 / 66075146 / -0.3% 0.63 / 0.64 / -2.4%
tpcds_q89/datafusion:vortex-compact 24925222 / 26142850 / -4.7% 47880734 / 47624579 / +0.5% 0.52 / 0.55 / -5.2%
tpcds_q90/datafusion:vortex-compact 11586426 / 11414604 / +1.5% 28507740 / 28729443 / -0.8% 0.41 / 0.40 / +2.3%
tpcds_q91/datafusion:vortex-compact 27170464 / 27075318 / +0.4% 47913886 / 48822107 / -1.9% 0.57 / 0.55 / +2.3%
tpcds_q92/datafusion:vortex-compact 15397928 / 15823360 / -2.7% 35070967 / 33643651 / +4.2% 0.44 / 0.47 / -6.6%
tpcds_q93/datafusion:vortex-compact 25317776 / 25184556 / +0.5% 45667198 / 46596345 / -2.0% 0.55 / 0.54 / +2.6%
tpcds_q94/datafusion:vortex-compact 21978547 / 22323130 / -1.5% 42191302 / 41776048 / +1.0% 0.52 / 0.53 / -2.5%
tpcds_q95/datafusion:vortex-compact 50483205 / 49799036 / +1.4% 73010329 / 71559053 / +2.0% 0.69 / 0.70 / -0.6%
tpcds_q96/datafusion:vortex-compact 10992336 / 10447024 / +5.2% 27516367 / 26176559 / +5.1% 0.40 / 0.40 / +0.1%
tpcds_q97/datafusion:vortex-compact 25819006 / 24247870 / +6.5% 45602489 / 46555310 / -2.0% 0.57 / 0.52 / +8.7%
tpcds_q98/datafusion:vortex-compact 21866342 / 22395156 / -2.4% 44741119 / 42632034 / +4.9% 0.49 / 0.53 / -7.0%
tpcds_q99/datafusion:vortex-compact 20895604 / 20852994 / +0.2% 40652633 / 41016146 / -0.9% 0.51 / 0.51 / +1.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 32548678 / 31521298 / +3.3% 48864524 / 49887904 / -2.1% 0.67 / 0.63 / +5.4%
tpcds_q02/datafusion:parquet 39902899 / 40426902 / -1.3% 57838399 / 58338144 / -0.9% 0.69 / 0.69 / -0.4%
tpcds_q03/datafusion:parquet 16201454 / 16264266 / -0.4% 32072398 / 30082637 / +6.6% 0.51 / 0.54 / -6.6%
tpcds_q04/datafusion:parquet 200646740 / 202264262 / -0.8% 233647036 / 230811650 / +1.2% 0.86 / 0.88 / -2.0%
tpcds_q05/datafusion:parquet 71851872 / 72685985 / -1.1% 95556823 / 99044291 / -3.5% 0.75 / 0.73 / +2.5%
tpcds_q06/datafusion:parquet 28706528 / 28595434 / +0.4% 49520232 / 50193253 / -1.3% 0.58 / 0.57 / +1.8%
tpcds_q07/datafusion:parquet 46598171 / 47505507 / -1.9% 69026500 / 68686488 / +0.5% 0.68 / 0.69 / -2.4%
tpcds_q08/datafusion:parquet 31130595 / 30019390 / +3.7% 46939405 / 49119624 / -4.4% 0.66 / 0.61 / +8.5%
tpcds_q09/datafusion:parquet 33864660 / 31090780 / +8.9% 45166489 / 48798990 / -7.4% 0.75 / 0.64 / +17.7%
tpcds_q10/datafusion:parquet 41862428 / 43159140 / -3.0% 63033689 / 63561236 / -0.8% 0.66 / 0.68 / -2.2%
tpcds_q11/datafusion:parquet 95250724 / 94740534 / +0.5% 119242835 / 119247640 / -0.0% 0.80 / 0.79 / +0.5%
tpcds_q12/datafusion:parquet 21256400 / 21913870 / -3.0% 36507448 / 36150758 / +1.0% 0.58 / 0.61 / -3.9%
tpcds_q13/datafusion:parquet 42926446 / 42795456 / +0.3% 69543480 / 66399075 / +4.7% 0.62 / 0.64 / -4.2%
tpcds_q14/datafusion:parquet 125144356 / 126381011 / -1.0% 148192813 / 153556936 / -3.5% 0.84 / 0.82 / +2.6%
tpcds_q15/datafusion:parquet 33263962 / 33260236 / +0.0% 51958859 / 50134058 / +3.6% 0.64 / 0.66 / -3.5%
tpcds_q16/datafusion:parquet 38618094 / 37409536 / +3.2% 55338381 / 55387506 / -0.1% 0.70 / 0.68 / +3.3%
tpcds_q17/datafusion:parquet 78600228 / 78511442 / +0.1% 105284598 / 105464439 / -0.2% 0.75 / 0.74 / +0.3%
tpcds_q18/datafusion:parquet 61110492 / 61122915 / -0.0% 83209438 / 85212018 / -2.4% 0.73 / 0.72 / +2.4%
tpcds_q19/datafusion:parquet 26400377 / 26007206 / +1.5% 49209275 / 47021689 / +4.7% 0.54 / 0.55 / -3.0%
tpcds_q20/datafusion:parquet 22636086 / 23248546 / -2.6% 37125099 / 36322901 / +2.2% 0.61 / 0.64 / -4.7%
tpcds_q21/datafusion:parquet 18315031 / 17735419 / +3.3% 33472454 / 32787203 / +2.1% 0.55 / 0.54 / +1.2%
tpcds_q22/datafusion:parquet 75943031 / 76633602 / -0.9% 89884481 / 90208375 / -0.4% 0.84 / 0.85 / -0.5%
tpcds_q23/datafusion:parquet 106974854 / 109917808 / -2.7% 140272455 / 139937143 / +0.2% 0.76 / 0.79 / -2.9%
tpcds_q24/datafusion:parquet 97041554 / 97250868 / -0.2% 123456899 / 125664961 / -1.8% 0.79 / 0.77 / +1.6%
tpcds_q25/datafusion:parquet 78262749 / 79180100 / -1.2% 106174531 / 105969842 / +0.2% 0.74 / 0.75 / -1.3%
tpcds_q26/datafusion:parquet 44411180 / 44085076 / +0.7% 63354829 / 64098926 / -1.2% 0.70 / 0.69 / +1.9%
tpcds_q27/datafusion:parquet 78970928 / 76705506 / +3.0% 100123610 / 98273515 / +1.9% 0.79 / 0.78 / +1.1%
tpcds_q28/datafusion:parquet 27545842 / 27767202 / -0.8% 46552278 / 44858804 / +3.8% 0.59 / 0.62 / -4.4%
tpcds_q29/datafusion:parquet 79638736 / 79335360 / +0.4% 107715974 / 104545585 / +3.0% 0.74 / 0.76 / -2.6%
tpcds_q30/datafusion:parquet 44665085 / 44345434 / +0.7% 66551554 / 67731147 / -1.7% 0.67 / 0.65 / +2.5%
tpcds_q31/datafusion:parquet 80204836 / 80234717 / -0.0% 104164477 / 101761497 / +2.4% 0.77 / 0.79 / -2.3%
tpcds_q32/datafusion:parquet 23649009 / 23852500 / -0.9% 42632811 / 40262449 / +5.9% 0.55 / 0.59 / -6.4%
tpcds_q33/datafusion:parquet 33378854 / 32903866 / +1.4% 52474618 / 52361250 / +0.2% 0.64 / 0.63 / +1.2%
tpcds_q34/datafusion:parquet 22356928 / 23517468 / -4.9% 38529274 / 38291142 / +0.6% 0.58 / 0.61 / -5.5%
tpcds_q35/datafusion:parquet 49113616 / 49234150 / -0.2% 68794361 / 67943369 / +1.3% 0.71 / 0.72 / -1.5%
tpcds_q36/datafusion:parquet 53151174 / 54046683 / -1.7% 75302311 / 78314502 / -3.8% 0.71 / 0.69 / +2.3%
tpcds_q37/datafusion:parquet 22963340 / 23509160 / -2.3% 38775211 / 38545248 / +0.6% 0.59 / 0.61 / -2.9%
tpcds_q38/datafusion:parquet 43624150 / 44197332 / -1.3% 64506041 / 64037756 / +0.7% 0.68 / 0.69 / -2.0%
tpcds_q39/datafusion:parquet 72013664 / 71900816 / +0.2% 90536029 / 91382189 / -0.9% 0.80 / 0.79 / +1.1%
tpcds_q40/datafusion:parquet 30094618 / 29995660 / +0.3% 51963082 / 50844408 / +2.2% 0.58 / 0.59 / -1.8%
tpcds_q41/datafusion:parquet 17587420 / 17673962 / -0.5% 29830683 / 29411323 / +1.4% 0.59 / 0.60 / -1.9%
tpcds_q42/datafusion:parquet 15701779 / 15799816 / -0.6% 30939417 / 29336464 / +5.5% 0.51 / 0.54 / -5.8%
tpcds_q43/datafusion:parquet 17408867 / 17610595 / -1.1% 33167297 / 31986852 / +3.7% 0.52 / 0.55 / -4.7%
tpcds_q44/datafusion:parquet 33677710 / 33501919 / +0.5% 52660174 / 51718013 / +1.8% 0.64 / 0.65 / -1.3%
tpcds_q45/datafusion:parquet 37510180 / 37619314 / -0.3% 56179246 / 55709625 / +0.8% 0.67 / 0.68 / -1.1%
tpcds_q46/datafusion:parquet 28927132 / 29109452 / -0.6% 50648784 / 49376655 / +2.6% 0.57 / 0.59 / -3.1%
tpcds_q47/datafusion:parquet 96663286 / 96536644 / +0.1% 125188561 / 124541820 / +0.5% 0.77 / 0.78 / -0.4%
tpcds_q48/datafusion:parquet 38337577 / 38566439 / -0.6% 59761163 / 59705890 / +0.1% 0.64 / 0.65 / -0.7%
tpcds_q49/datafusion:parquet 76001874 / 73892860 / +2.9% 107326537 / 98068657 / +9.4% 0.71 / 0.75 / -6.0%
tpcds_q50/datafusion:parquet 49324224 / 49393182 / -0.1% 73123838 / 70673860 / +3.5% 0.67 / 0.70 / -3.5%
tpcds_q51/datafusion:parquet 68022814 / 67853300 / +0.2% 92854087 / 89862896 / +3.3% 0.73 / 0.76 / -3.0%
tpcds_q52/datafusion:parquet 16094442 / 15907584 / +1.2% 31224026 / 29397120 / +6.2% 0.52 / 0.54 / -4.7%
tpcds_q53/datafusion:parquet 21964696 / 21729401 / +1.1% 39290602 / 39099525 / +0.5% 0.56 / 0.56 / +0.6%
tpcds_q54/datafusion:parquet 46154089 / 45943080 / +0.5% 70818987 / 64832593 / +9.2% 0.65 / 0.71 / -8.0%
tpcds_q55/datafusion:parquet 15737155 / 15332277 / +2.6% 30055743 / 28804891 / +4.3% 0.52 / 0.53 / -1.6%
tpcds_q56/datafusion:parquet 31303828 / 31642489 / -1.1% 56578303 / 53958640 / +4.9% 0.55 / 0.59 / -5.7%
tpcds_q57/datafusion:parquet 98830556 / 99127813 / -0.3% 124064883 / 121624813 / +2.0% 0.80 / 0.82 / -2.3%
tpcds_q58/datafusion:parquet 65879340 / 64876026 / +1.5% 90332862 / 88043741 / +2.6% 0.73 / 0.74 / -1.0%
tpcds_q59/datafusion:parquet 42902779 / 42648544 / +0.6% 63759820 / 63407902 / +0.6% 0.67 / 0.67 / +0.0%
tpcds_q60/datafusion:parquet 31782148 / 32157901 / -1.2% 54472720 / 53898625 / +1.1% 0.58 / 0.60 / -2.2%
tpcds_q61/datafusion:parquet 35232502 / 33947146 / +3.8% 56530046 / 55749641 / +1.4% 0.62 / 0.61 / +2.4%
tpcds_q62/datafusion:parquet 24270269 / 24196295 / +0.3% 39564181 / 39648791 / -0.2% 0.61 / 0.61 / +0.5%
tpcds_q63/datafusion:parquet 21939340 / 21807428 / +0.6% 39215268 / 39281792 / -0.2% 0.56 / 0.56 / +0.8%
tpcds_q64/datafusion:parquet 208463143 / 200822884 / +3.8% 236116122 / 236863660 / -0.3% 0.88 / 0.85 / +4.1%
tpcds_q65/datafusion:parquet 39004326 / 38677366 / +0.8% 61218759 / 59661663 / +2.6% 0.64 / 0.65 / -1.7%
tpcds_q66/datafusion:parquet 61425972 / 62491632 / -1.7% 79594479 / 79597745 / -0.0% 0.77 / 0.79 / -1.7%
tpcds_q67/datafusion:parquet 69821034 / 70471416 / -0.9% 95363652 / 96219256 / -0.9% 0.73 / 0.73 / -0.0%
tpcds_q68/datafusion:parquet 28930824 / 28954358 / -0.1% 52491306 / 52095916 / +0.8% 0.55 / 0.56 / -0.8%
tpcds_q69/datafusion:parquet 41928910 / 41737454 / +0.5% 59411347 / 60415956 / -1.7% 0.71 / 0.69 / +2.2%
tpcds_q70/datafusion:parquet 32700162 / 32694769 / +0.0% 55631908 / 54669483 / +1.8% 0.59 / 0.60 / -1.7%
tpcds_q71/datafusion:parquet 23715446 / 24396559 / -2.8% 39456635 / 39660030 / -0.5% 0.60 / 0.62 / -2.3%
tpcds_q72/datafusion:parquet 543405823 / 543491010 / -0.0% 576076700 / 577487728 / -0.2% 0.94 / 0.94 / +0.2%
tpcds_q73/datafusion:parquet 21722902 / 21565186 / +0.7% 39126600 / 38079263 / +2.8% 0.56 / 0.57 / -2.0%
tpcds_q74/datafusion:parquet 67505454 / 66133570 / +2.1% 88181455 / 88176529 / +0.0% 0.77 / 0.75 / +2.1%
tpcds_q75/datafusion:parquet 150462214 / 147903599 / +1.7% 180352135 / 175808187 / +2.6% 0.83 / 0.84 / -0.8%
tpcds_q76/datafusion:parquet 49300496 / 46800078 / +5.3% 66377627 / 67069407 / -1.0% 0.74 / 0.70 / +6.4%
tpcds_q77/datafusion:parquet 53196112 / 53212486 / -0.0% 74585829 / 75710678 / -1.5% 0.71 / 0.70 / +1.5%
tpcds_q78/datafusion:parquet 91214944 / 95881282 / -4.9% 124566835 / 127853602 / -2.6% 0.73 / 0.75 / -2.4%
tpcds_q79/datafusion:parquet 26021999 / 26374316 / -1.3% 45983133 / 45640442 / +0.8% 0.57 / 0.58 / -2.1%
tpcds_q80/datafusion:parquet 82519233 / 83656846 / -1.4% 118387980 / 112595154 / +5.1% 0.70 / 0.74 / -6.2%
tpcds_q81/datafusion:parquet 38311888 / 37986350 / +0.9% 57973374 / 60336206 / -3.9% 0.66 / 0.63 / +5.0%
tpcds_q82/datafusion:parquet 25196578 / 24966456 / +0.9% 40652065 / 41253806 / -1.5% 0.62 / 0.61 / +2.4%
tpcds_q83/datafusion:parquet 47459803 / 47944399 / -1.0% 67587379 / 67923357 / -0.5% 0.70 / 0.71 / -0.5%
tpcds_q84/datafusion:parquet 30303851 / 29461901 / +2.9% 45649759 / 44537810 / +2.5% 0.66 / 0.66 / +0.4%
tpcds_q85/datafusion:parquet 85371683 / 86457927 / -1.3% 109551185 / 110702314 / -1.0% 0.78 / 0.78 / -0.2%
tpcds_q86/datafusion:parquet 20891010 / 20421668 / +2.3% 34529513 / 33706020 / +2.4% 0.61 / 0.61 / -0.1%
tpcds_q87/datafusion:parquet 42857222 / 42488624 / +0.9% 62305922 / 60539234 / +2.9% 0.69 / 0.70 / -2.0%
tpcds_q88/datafusion:parquet 38004522 / 38598466 / -1.5% 61795684 / 63014598 / -1.9% 0.62 / 0.61 / +0.4%
tpcds_q89/datafusion:parquet 25080010 / 25213754 / -0.5% 43214609 / 43193798 / +0.0% 0.58 / 0.58 / -0.6%
tpcds_q90/datafusion:parquet 15515434 / 15554699 / -0.3% 30594725 / 31749449 / -3.6% 0.51 / 0.49 / +3.5%
tpcds_q91/datafusion:parquet 32532047 / 31785964 / +2.3% 49737648 / 48538333 / +2.5% 0.65 / 0.65 / -0.1%
tpcds_q92/datafusion:parquet 23694526 / 23533352 / +0.7% 41458182 / 41300660 / +0.4% 0.57 / 0.57 / +0.3%
tpcds_q93/datafusion:parquet 27626168 / 28383745 / -2.7% 45509996 / 49272156 / -7.6% 0.61 / 0.58 / +5.4%
tpcds_q94/datafusion:parquet 32215228 / 31467198 / +2.4% 48549493 / 49590316 / -2.1% 0.66 / 0.63 / +4.6%
tpcds_q95/datafusion:parquet 65685208 / 68811452 / -4.5% 81028312 / 81181027 / -0.2% 0.81 / 0.85 / -4.4%
tpcds_q96/datafusion:parquet 12811574 / 12866424 / -0.4% 27834001 / 27840532 / -0.0% 0.46 / 0.46 / -0.4%
tpcds_q97/datafusion:parquet 32333122 / 32562332 / -0.7% 51303312 / 52945041 / -3.1% 0.63 / 0.62 / +2.5%
tpcds_q98/datafusion:parquet 22623271 / 22831398 / -0.9% 40197449 / 38856471 / +3.5% 0.56 / 0.59 / -4.2%
tpcds_q99/datafusion:parquet 28797168 / 28801558 / -0.0% 42637251 / 43135674 / -1.2% 0.68 / 0.67 / +1.2%
duckdb / vortex-file-compressed / ns (0.999x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15375360 / 15008895 / +2.4% 23671190 / 23101505 / +2.5% 0.65 / 0.65 / -0.0%
tpcds_q02/duckdb:vortex-file-compressed 14948882 / 14953071 / -0.0% 25336929 / 20470142 / +23.8% 🔴 0.59 / 0.73 / -19.2%
tpcds_q03/duckdb:vortex-file-compressed 10968648 / 10960772 / +0.1% 21686572 / 21995245 / -1.4% 0.51 / 0.50 / +1.5%
tpcds_q04/duckdb:vortex-file-compressed 50918264 / 50566914 / +0.7% 59022816 / 60001177 / -1.6% 0.86 / 0.84 / +2.4%
tpcds_q05/duckdb:vortex-file-compressed 19011254 / 18830910 / +1.0% 25427049 / 24874659 / +2.2% 0.75 / 0.76 / -1.2%
tpcds_q06/duckdb:vortex-file-compressed 29482910 / 26633926 / +10.7% 🔴 38919147 / 40141872 / -3.0% 0.76 / 0.66 / +14.2%
tpcds_q07/duckdb:vortex-file-compressed 15901224 / 16245312 / -2.1% 30850407 / 29392917 / +5.0% 0.52 / 0.55 / -6.7%
tpcds_q08/duckdb:vortex-file-compressed 18928608 / 18925696 / +0.0% 28099139 / 30862793 / -9.0% 0.67 / 0.61 / +9.9%
tpcds_q09/duckdb:vortex-file-compressed 13776967 / 13585764 / +1.4% 22745139 / 25130830 / -9.5% 0.61 / 0.54 / +12.0%
tpcds_q10/duckdb:vortex-file-compressed 27322188 / 27441014 / -0.4% 41126373 / 41259529 / -0.3% 0.66 / 0.67 / -0.1%
tpcds_q11/duckdb:vortex-file-compressed 40327520 / 40038932 / +0.7% 50378327 / 51212965 / -1.6% 0.80 / 0.78 / +2.4%
tpcds_q12/duckdb:vortex-file-compressed 9986576 / 9961757 / +0.2% 16504997 / 16634308 / -0.8% 0.61 / 0.60 / +1.0%
tpcds_q13/duckdb:vortex-file-compressed 21345984 / 21737606 / -1.8% 35919230 / 35154736 / +2.2% 0.59 / 0.62 / -3.9%
tpcds_q14/duckdb:vortex-file-compressed 57608300 / 59387572 / -3.0% 69940123 / 70213925 / -0.4% 0.82 / 0.85 / -2.6%
tpcds_q15/duckdb:vortex-file-compressed 20812605 / 20849798 / -0.2% 25988101 / 25226576 / +3.0% 0.80 / 0.83 / -3.1%
tpcds_q16/duckdb:vortex-file-compressed 17532517 / 19423830 / -9.7% 28328193 / 26507421 / +6.9% 0.62 / 0.73 / -15.5%
tpcds_q17/duckdb:vortex-file-compressed 29525148 / 29796148 / -0.9% 44317002 / 43814452 / +1.1% 0.67 / 0.68 / -2.0%
tpcds_q18/duckdb:vortex-file-compressed 27738323 / 27986733 / -0.9% 38655154 / 38571135 / +0.2% 0.72 / 0.73 / -1.1%
tpcds_q19/duckdb:vortex-file-compressed 24125144 / 23395029 / +3.1% 34969551 / 35718350 / -2.1% 0.69 / 0.65 / +5.3%
tpcds_q20/duckdb:vortex-file-compressed 10587342 / 10863706 / -2.5% 17413660 / 15608832 / +11.6% 🔴 0.61 / 0.70 / -12.6%
tpcds_q21/duckdb:vortex-file-compressed 9708935 / 9563362 / +1.5% 18606198 / 18568226 / +0.2% 0.52 / 0.52 / +1.3%
tpcds_q22/duckdb:vortex-file-compressed 29377334 / 28686191 / +2.4% 39962429 / 40185519 / -0.6% 0.74 / 0.71 / +3.0%
tpcds_q23/duckdb:vortex-file-compressed 37866467 / 36444074 / +3.9% 47999423 / 46225680 / +3.8% 0.79 / 0.79 / +0.1%
tpcds_q24/duckdb:vortex-file-compressed 28398410 / 27571730 / +3.0% 40380135 / 42546006 / -5.1% 0.70 / 0.65 / +8.5%
tpcds_q25/duckdb:vortex-file-compressed 25468706 / 25610849 / -0.6% 40397725 / 41752778 / -3.2% 0.63 / 0.61 / +2.8%
tpcds_q26/duckdb:vortex-file-compressed 13073462 / 13390580 / -2.4% 20190774 / 20759402 / -2.7% 0.65 / 0.65 / +0.4%
tpcds_q27/duckdb:vortex-file-compressed 17748176 / 17164226 / +3.4% 30774301 / 35524372 / -13.4% 🟢 0.58 / 0.48 / +19.4%
tpcds_q28/duckdb:vortex-file-compressed 12571609 / 11802874 / +6.5% 20391101 / 18341711 / +11.2% 🔴 0.62 / 0.64 / -4.2%
tpcds_q29/duckdb:vortex-file-compressed 28409359 / 28432024 / -0.1% 43784368 / 43690364 / +0.2% 0.65 / 0.65 / -0.3%
tpcds_q30/duckdb:vortex-file-compressed 19356677 / 18997852 / +1.9% 31227536 / 30161032 / +3.5% 0.62 / 0.63 / -1.6%
tpcds_q31/duckdb:vortex-file-compressed 19290422 / 19233638 / +0.3% 26531828 / 26305833 / +0.9% 0.73 / 0.73 / -0.6%
tpcds_q32/duckdb:vortex-file-compressed 9812332 / 9960326 / -1.5% 17457424 / 15748655 / +10.9% 🔴 0.56 / 0.63 / -11.1%
tpcds_q33/duckdb:vortex-file-compressed 16564618 / 16439970 / +0.8% 27138545 / 28166345 / -3.6% 0.61 / 0.58 / +4.6%
tpcds_q34/duckdb:vortex-file-compressed 15120717 / 15359866 / -1.6% 28181875 / 20900591 / +34.8% 🔴 0.54 / 0.73 / -27.0%
tpcds_q35/duckdb:vortex-file-compressed 46267132 / 45595895 / +1.5% 59191452 / 59627263 / -0.7% 0.78 / 0.76 / +2.2%
tpcds_q36/duckdb:vortex-file-compressed 17993062 / 15847833 / +13.5% 🔴 26353713 / 29031568 / -9.2% 0.68 / 0.55 / +25.1%
tpcds_q37/duckdb:vortex-file-compressed 13782163 / 13566364 / +1.6% 22523179 / 22387915 / +0.6% 0.61 / 0.61 / +1.0%
tpcds_q38/duckdb:vortex-file-compressed 22162246 / 22152552 / +0.0% 29226837 / 27945817 / +4.6% 0.76 / 0.79 / -4.3%
tpcds_q39/duckdb:vortex-file-compressed 18169845 / 18811605 / -3.4% 26630325 / 32736747 / -18.7% 🟢 0.68 / 0.57 / +18.7%
tpcds_q40/duckdb:vortex-file-compressed 13396779 / 13013625 / +2.9% 21805984 / 18987732 / +14.8% 🔴 0.61 / 0.69 / -10.4%
tpcds_q41/duckdb:vortex-file-compressed 6354083 / 6362364 / -0.1% 9911201 / 9233800 / +7.3% 0.64 / 0.69 / -7.0%
tpcds_q42/duckdb:vortex-file-compressed 8004653 / 9574918 / -16.4% 🟢 18417234 / 20272698 / -9.2% 0.43 / 0.47 / -8.0%
tpcds_q43/duckdb:vortex-file-compressed 10006716 / 9683974 / +3.3% 18246233 / 20394372 / -10.5% 🟢 0.55 / 0.47 / +15.5%
tpcds_q44/duckdb:vortex-file-compressed 15378118 / 15705908 / -2.1% 25711142 / 26668320 / -3.6% 0.60 / 0.59 / +1.6%
tpcds_q45/duckdb:vortex-file-compressed 22131256 / 22204079 / -0.3% 29697230 / 30758971 / -3.5% 0.75 / 0.72 / +3.2%
tpcds_q46/duckdb:vortex-file-compressed 18601884 / 18384096 / +1.2% 31860387 / 30628313 / +4.0% 0.58 / 0.60 / -2.7%
tpcds_q47/duckdb:vortex-file-compressed 30608100 / 30495042 / +0.4% 44094751 / 41635201 / +5.9% 0.69 / 0.73 / -5.2%
tpcds_q48/duckdb:vortex-file-compressed 19198000 / 19032034 / +0.9% 32433391 / 29623889 / +9.5% 0.59 / 0.64 / -7.9%
tpcds_q49/duckdb:vortex-file-compressed 16420474 / 16618646 / -1.2% 29683837 / 30133800 / -1.5% 0.55 / 0.55 / +0.3%
tpcds_q50/duckdb:vortex-file-compressed 16543110 / 16381828 / +1.0% 28479759 / 28234533 / +0.9% 0.58 / 0.58 / +0.1%
tpcds_q51/duckdb:vortex-file-compressed 77143956 / 64145229 / +20.3% 🔴 62366939 / 60857646 / +2.5% 1.24 / 1.05 / +17.4%
tpcds_q52/duckdb:vortex-file-compressed 8694026 / 11131056 / -21.9% 🟢 18503870 / 19314935 / -4.2% 0.47 / 0.58 / -18.5%
tpcds_q53/duckdb:vortex-file-compressed 14548538 / 14264004 / +2.0% 25140573 / 24749776 / +1.6% 0.58 / 0.58 / +0.4%
tpcds_q54/duckdb:vortex-file-compressed 20177406 / 20545942 / -1.8% 29823418 / 34681685 / -14.0% 🟢 0.68 / 0.59 / +14.2%
tpcds_q55/duckdb:vortex-file-compressed 8140222 / 8461615 / -3.8% 17346852 / 18499659 / -6.2% 0.47 / 0.46 / +2.6%
tpcds_q56/duckdb:vortex-file-compressed 16879181 / 17111230 / -1.4% 29229997 / 29893897 / -2.2% 0.58 / 0.57 / +0.9%
tpcds_q57/duckdb:vortex-file-compressed 25668044 / 24319972 / +5.5% 31564254 / 31584075 / -0.1% 0.81 / 0.77 / +5.6%
tpcds_q58/duckdb:vortex-file-compressed 17593921 / 17858365 / -1.5% 27843799 / 28678735 / -2.9% 0.63 / 0.62 / +1.5%
tpcds_q59/duckdb:vortex-file-compressed 19081027 / 18376654 / +3.8% 25209681 / 25660223 / -1.8% 0.76 / 0.72 / +5.7%
tpcds_q60/duckdb:vortex-file-compressed 17704614 / 17731566 / -0.2% 30353001 / 29812515 / +1.8% 0.58 / 0.59 / -1.9%
tpcds_q61/duckdb:vortex-file-compressed 19185718 / 18976158 / +1.1% 32121677 / 32933082 / -2.5% 0.60 / 0.58 / +3.7%
tpcds_q62/duckdb:vortex-file-compressed 10140230 / 10118417 / +0.2% 15753903 / 15777596 / -0.2% 0.64 / 0.64 / +0.4%
tpcds_q63/duckdb:vortex-file-compressed 13282849 / 13244852 / +0.3% 23633841 / 23344575 / +1.2% 0.56 / 0.57 / -0.9%
tpcds_q64/duckdb:vortex-file-compressed 61916806 / 62762402 / -1.3% 79961900 / 77737659 / +2.9% 0.77 / 0.81 / -4.1%
tpcds_q65/duckdb:vortex-file-compressed 15241924 / 15021623 / +1.5% 27347869 / 27345504 / +0.0% 0.56 / 0.55 / +1.5%
tpcds_q66/duckdb:vortex-file-compressed 21197569 / 21181058 / +0.1% 35523982 / 33963381 / +4.6% 0.60 / 0.62 / -4.3%
tpcds_q67/duckdb:vortex-file-compressed 65630265 / 65630133 / +0.0% 81888325 / 80379784 / +1.9% 0.80 / 0.82 / -1.8%
tpcds_q68/duckdb:vortex-file-compressed 17922900 / 18145538 / -1.2% 30962125 / 31303775 / -1.1% 0.58 / 0.58 / -0.1%
tpcds_q69/duckdb:vortex-file-compressed 28391516 / 28811668 / -1.5% 41910852 / 45154323 / -7.2% 0.68 / 0.64 / +6.2%
tpcds_q70/duckdb:vortex-file-compressed 18439516 / 18278650 / +0.9% 31322090 / 29339407 / +6.8% 0.59 / 0.62 / -5.5%
tpcds_q71/duckdb:vortex-file-compressed 12877076 / 12819907 / +0.4% 24356088 / 26014817 / -6.4% 0.53 / 0.49 / +7.3%
tpcds_q72/duckdb:vortex-file-compressed 62973543 / 61594276 / +2.2% 74916958 / 78032664 / -4.0% 0.84 / 0.79 / +6.5%
tpcds_q73/duckdb:vortex-file-compressed 14998444 / 14900900 / +0.7% 21269043 / 22294518 / -4.6% 0.71 / 0.67 / +5.5%
tpcds_q74/duckdb:vortex-file-compressed 27392111 / 27240962 / +0.6% 40831730 / 36244247 / +12.7% 🔴 0.67 / 0.75 / -10.7%
tpcds_q75/duckdb:vortex-file-compressed 28464679 / 28622400 / -0.6% 44638750 / 47123763 / -5.3% 0.64 / 0.61 / +5.0%
tpcds_q76/duckdb:vortex-file-compressed 12382670 / 12278884 / +0.8% 27348395 / 24261220 / +12.7% 🔴 0.45 / 0.51 / -10.5%
tpcds_q77/duckdb:vortex-file-compressed 16005438 / 15812623 / +1.2% 26182160 / 25653903 / +2.1% 0.61 / 0.62 / -0.8%
tpcds_q78/duckdb:vortex-file-compressed 36980710 / 38107160 / -3.0% 46042150 / 50200669 / -8.3% 0.80 / 0.76 / +5.8%
tpcds_q79/duckdb:vortex-file-compressed 15426762 / 14183485 / +8.8% 28428325 / 27259995 / +4.3% 0.54 / 0.52 / +4.3%
tpcds_q80/duckdb:vortex-file-compressed 27243828 / 27211642 / +0.1% 43676914 / 43836271 / -0.4% 0.62 / 0.62 / +0.5%
tpcds_q81/duckdb:vortex-file-compressed 22051355 / 22262991 / -1.0% 32012487 / 32464115 / -1.4% 0.69 / 0.69 / +0.4%
tpcds_q82/duckdb:vortex-file-compressed 32017238 / 34995676 / -8.5% 40219333 / 43141961 / -6.8% 0.80 / 0.81 / -1.9%
tpcds_q83/duckdb:vortex-file-compressed 19579727 / 19495834 / +0.4% 25066145 / 25849839 / -3.0% 0.78 / 0.75 / +3.6%
tpcds_q84/duckdb:vortex-file-compressed 12527670 / 12376030 / +1.2% 18752364 / 19225352 / -2.5% 0.67 / 0.64 / +3.8%
tpcds_q85/duckdb:vortex-file-compressed 30580878 / 31193696 / -2.0% 39863990 / 39306435 / +1.4% 0.77 / 0.79 / -3.3%
tpcds_q86/duckdb:vortex-file-compressed 10690169 / 10622140 / +0.6% 16917024 / 17906796 / -5.5% 0.63 / 0.59 / +6.5%
tpcds_q87/duckdb:vortex-file-compressed 24465566 / 24174870 / +1.2% 30642454 / 29614843 / +3.5% 0.80 / 0.82 / -2.2%
tpcds_q88/duckdb:vortex-file-compressed 32098468 / 32974725 / -2.7% 44704460 / 45689149 / -2.2% 0.72 / 0.72 / -0.5%
tpcds_q89/duckdb:vortex-file-compressed 13615671 / 13606271 / +0.1% 24479182 / 27591401 / -11.3% 🟢 0.56 / 0.49 / +12.8%
tpcds_q90/duckdb:vortex-file-compressed 8194918 / 8251748 / -0.7% 14007550 / 12148011 / +15.3% 🔴 0.59 / 0.68 / -13.9%
tpcds_q91/duckdb:vortex-file-compressed 15017753 / 15077573 / -0.4% 23408667 / 26750729 / -12.5% 🟢 0.64 / 0.56 / +13.8%
tpcds_q92/duckdb:vortex-file-compressed 12659784 / 12877322 / -1.7% 20671936 / 22150585 / -6.7% 0.61 / 0.58 / +5.3%
tpcds_q93/duckdb:vortex-file-compressed 16763470 / 18036876 / -7.1% 25551741 / 25124639 / +1.7% 0.66 / 0.72 / -8.6%
tpcds_q94/duckdb:vortex-file-compressed 16367859 / 15960426 / +2.6% 28616535 / 27775193 / +3.0% 0.57 / 0.57 / -0.5%
tpcds_q95/duckdb:vortex-file-compressed 43694246 / 44554996 / -1.9% 54445609 / 54593325 / -0.3% 0.80 / 0.82 / -1.7%
tpcds_q96/duckdb:vortex-file-compressed 7304268 / 9271378 / -21.2% 🟢 16943186 / 15871367 / +6.8% 0.43 / 0.58 / -26.2%
tpcds_q97/duckdb:vortex-file-compressed 23054530 / 22097679 / +4.3% 28963987 / 30560142 / -5.2% 0.80 / 0.72 / +10.1%
tpcds_q98/duckdb:vortex-file-compressed 13916104 / 13261005 / +4.9% 23206533 / 23027144 / +0.8% 0.60 / 0.58 / +4.1%
tpcds_q99/duckdb:vortex-file-compressed 13175970 / 13288925 / -0.8% 18734728 / 19207508 / -2.5% 0.70 / 0.69 / +1.7%
duckdb / vortex-compact / ns (1.002x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 18735828 / 16485392 / +13.7% 🔴 23926334 / 27649291 / -13.5% 🟢 0.78 / 0.60 / +31.3%
tpcds_q02/duckdb:vortex-compact 16177272 / 16518394 / -2.1% 21666913 / 27734741 / -21.9% 🟢 0.75 / 0.60 / +25.4%
tpcds_q03/duckdb:vortex-compact 21310856 / 21508548 / -0.9% 34717111 / 29290468 / +18.5% 🔴 0.61 / 0.73 / -16.4%
tpcds_q04/duckdb:vortex-compact 53397538 / 54033796 / -1.2% 65444499 / 64821119 / +1.0% 0.82 / 0.83 / -2.1%
tpcds_q05/duckdb:vortex-compact 22352341 / 21562954 / +3.7% 31372739 / 30338923 / +3.4% 0.71 / 0.71 / +0.2%
tpcds_q06/duckdb:vortex-compact 33321630 / 33363540 / -0.1% 44566156 / 45131698 / -1.3% 0.75 / 0.74 / +1.1%
tpcds_q07/duckdb:vortex-compact 26952494 / 25759287 / +4.6% 34734208 / 35947056 / -3.4% 0.78 / 0.72 / +8.3%
tpcds_q08/duckdb:vortex-compact 48323176 / 48925722 / -1.2% 56704196 / 57315805 / -1.1% 0.85 / 0.85 / -0.2%
tpcds_q09/duckdb:vortex-compact 19354737 / 18829146 / +2.8% 30470462 / 28489872 / +7.0% 0.64 / 0.66 / -3.9%
tpcds_q10/duckdb:vortex-compact 44939696 / 45176910 / -0.5% 57059155 / 57475509 / -0.7% 0.79 / 0.79 / +0.2%
tpcds_q11/duckdb:vortex-compact 45383435 / 46412854 / -2.2% 55165040 / 58708087 / -6.0% 0.82 / 0.79 / +4.1%
tpcds_q12/duckdb:vortex-compact 13907802 / 13306114 / +4.5% 20181782 / 19407383 / +4.0% 0.69 / 0.69 / +0.5%
tpcds_q13/duckdb:vortex-compact 36135656 / 35809467 / +0.9% 47592817 / 49878517 / -4.6% 0.76 / 0.72 / +5.8%
tpcds_q14/duckdb:vortex-compact 67471650 / 67921704 / -0.7% 79651041 / 78209851 / +1.8% 0.85 / 0.87 / -2.5%
tpcds_q15/duckdb:vortex-compact 26316152 / 26024020 / +1.1% 31776776 / 31344426 / +1.4% 0.83 / 0.83 / -0.3%
tpcds_q16/duckdb:vortex-compact 24660802 / 24606818 / +0.2% 32517568 / 34357289 / -5.4% 0.76 / 0.72 / +5.9%
tpcds_q17/duckdb:vortex-compact 44943149 / 44521946 / +0.9% 57708118 / 57300041 / +0.7% 0.78 / 0.78 / +0.2%
tpcds_q18/duckdb:vortex-compact 36863298 / 36152083 / +2.0% 44855102 / 48408172 / -7.3% 0.82 / 0.75 / +10.0%
tpcds_q19/duckdb:vortex-compact 36082448 / 35350684 / +2.1% 43800482 / 46329215 / -5.5% 0.82 / 0.76 / +8.0%
tpcds_q20/duckdb:vortex-compact 13884990 / 14140791 / -1.8% 20239849 / 19812501 / +2.2% 0.69 / 0.71 / -3.9%
tpcds_q21/duckdb:vortex-compact 10290829 / 10296378 / -0.1% 18142502 / 18462061 / -1.7% 0.57 / 0.56 / +1.7%
tpcds_q22/duckdb:vortex-compact 30604043 / 30438707 / +0.5% 40603520 / 40051741 / +1.4% 0.75 / 0.76 / -0.8%
tpcds_q23/duckdb:vortex-compact 43683973 / 43015946 / +1.6% 54152679 / 51959955 / +4.2% 0.81 / 0.83 / -2.6%
tpcds_q24/duckdb:vortex-compact 40711960 / 39822589 / +2.2% 50772488 / 47838696 / +6.1% 0.80 / 0.83 / -3.7%
tpcds_q25/duckdb:vortex-compact 43214694 / 43173520 / +0.1% 54353538 / 54717024 / -0.7% 0.80 / 0.79 / +0.8%
tpcds_q26/duckdb:vortex-compact 22067162 / 21860172 / +0.9% 26792156 / 29055744 / -7.8% 0.82 / 0.75 / +9.5%
tpcds_q27/duckdb:vortex-compact 30000742 / 29291390 / +2.4% 45516384 / 38181933 / +19.2% 🔴 0.66 / 0.77 / -14.1%
tpcds_q28/duckdb:vortex-compact 23191761 / 21860954 / +6.1% 30831221 / 32330904 / -4.6% 0.75 / 0.68 / +11.2%
tpcds_q29/duckdb:vortex-compact 44161928 / 44274228 / -0.3% 58132030 / 57000811 / +2.0% 0.76 / 0.78 / -2.2%
tpcds_q30/duckdb:vortex-compact 22524695 / 22275470 / +1.1% 33577009 / 30797681 / +9.0% 0.67 / 0.72 / -7.3%
tpcds_q31/duckdb:vortex-compact 23515354 / 23605426 / -0.4% 30420413 / 35336394 / -13.9% 🟢 0.77 / 0.67 / +15.7%
tpcds_q32/duckdb:vortex-compact 14319590 / 13788144 / +3.9% 20642953 / 24713416 / -16.5% 🟢 0.69 / 0.56 / +24.3%
tpcds_q33/duckdb:vortex-compact 23096677 / 23138912 / -0.2% 34003316 / 33175076 / +2.5% 0.68 / 0.70 / -2.6%
tpcds_q34/duckdb:vortex-compact 22004412 / 22149500 / -0.7% 32319474 / 29798998 / +8.5% 0.68 / 0.74 / -8.4%
tpcds_q35/duckdb:vortex-compact 61786390 / 61849103 / -0.1% 74260700 / 73183637 / +1.5% 0.83 / 0.85 / -1.6%
tpcds_q36/duckdb:vortex-compact 21613335 / 21964722 / -1.6% 32096087 / 33079913 / -3.0% 0.67 / 0.66 / +1.4%
tpcds_q37/duckdb:vortex-compact 15058002 / 15336034 / -1.8% 24910293 / 24208419 / +2.9% 0.60 / 0.63 / -4.6%
tpcds_q38/duckdb:vortex-compact 26107076 / 26487192 / -1.4% 36312546 / 35245194 / +3.0% 0.72 / 0.75 / -4.3%
tpcds_q39/duckdb:vortex-compact 19499828 / 20443040 / -4.6% 29775864 / 28111324 / +5.9% 0.65 / 0.73 / -9.9%
tpcds_q40/duckdb:vortex-compact 16567990 / 16391056 / +1.1% 20797515 / 21513886 / -3.3% 0.80 / 0.76 / +4.6%
tpcds_q41/duckdb:vortex-compact 7502234 / 7398492 / +1.4% 12062384 / 11323063 / +6.5% 0.62 / 0.65 / -4.8%
tpcds_q42/duckdb:vortex-compact 12112498 / 13131802 / -7.8% 21012950 / 21259402 / -1.2% 0.58 / 0.62 / -6.7%
tpcds_q43/duckdb:vortex-compact 16461570 / 16201016 / +1.6% 23909936 / 23542082 / +1.6% 0.69 / 0.69 / +0.0%
tpcds_q44/duckdb:vortex-compact 21888506 / 22268946 / -1.7% 33686574 / 38001942 / -11.4% 🟢 0.65 / 0.59 / +10.9%
tpcds_q45/duckdb:vortex-compact 27460283 / 27110101 / +1.3% 32805255 / 35480546 / -7.5% 0.84 / 0.76 / +9.6%
tpcds_q46/duckdb:vortex-compact 29049436 / 29302938 / -0.9% 39245710 / 39114559 / +0.3% 0.74 / 0.75 / -1.2%
tpcds_q47/duckdb:vortex-compact 36663370 / 36391446 / +0.7% 46741710 / 53340453 / -12.4% 🟢 0.78 / 0.68 / +15.0%
tpcds_q48/duckdb:vortex-compact 33677192 / 33085875 / +1.8% 42393138 / 44154821 / -4.0% 0.79 / 0.75 / +6.0%
tpcds_q49/duckdb:vortex-compact 24715127 / 24873674 / -0.6% 38202816 / 36615058 / +4.3% 0.65 / 0.68 / -4.8%
tpcds_q50/duckdb:vortex-compact 26983198 / 27444096 / -1.7% 36253722 / 37005155 / -2.0% 0.74 / 0.74 / +0.4%
tpcds_q51/duckdb:vortex-compact 53435334 / 53456980 / -0.0% 94822263 / 71383359 / +32.8% 🔴 0.56 / 0.75 / -24.7%
tpcds_q52/duckdb:vortex-compact 12426084 / 11912363 / +4.3% 20944770 / 20621836 / +1.6% 0.59 / 0.58 / +2.7%
tpcds_q53/duckdb:vortex-compact 22121171 / 21151704 / +4.6% 30470139 / 30305209 / +0.5% 0.73 / 0.70 / +4.0%
tpcds_q54/duckdb:vortex-compact 27221911 / 26948988 / +1.0% 35026982 / 35681181 / -1.8% 0.78 / 0.76 / +2.9%
tpcds_q55/duckdb:vortex-compact 13596298 / 12016500 / +13.1% 🔴 20555205 / 21330663 / -3.6% 0.66 / 0.56 / +17.4%
tpcds_q56/duckdb:vortex-compact 24486305 / 23676398 / +3.4% 35021712 / 33423336 / +4.8% 0.70 / 0.71 / -1.3%
tpcds_q57/duckdb:vortex-compact 27740015 / 28657504 / -3.2% 35754442 / 34070767 / +4.9% 0.78 / 0.84 / -7.8%
tpcds_q58/duckdb:vortex-compact 24767009 / 23370616 / +6.0% 35193148 / 33678100 / +4.5% 0.70 / 0.69 / +1.4%
tpcds_q59/duckdb:vortex-compact 23083926 / 23340643 / -1.1% 28899190 / 28707277 / +0.7% 0.80 / 0.81 / -1.8%
tpcds_q60/duckdb:vortex-compact 24329390 / 24552050 / -0.9% 35200761 / 43913115 / -19.8% 🟢 0.69 / 0.56 / +23.6%
tpcds_q61/duckdb:vortex-compact 35383678 / 30614438 / +15.6% 🔴 44431586 / 42448939 / +4.7% 0.80 / 0.72 / +10.4%
tpcds_q62/duckdb:vortex-compact 11510386 / 11700477 / -1.6% 16895284 / 19358337 / -12.7% 🟢 0.68 / 0.60 / +12.7%
tpcds_q63/duckdb:vortex-compact 20915808 / 20453204 / +2.3% 28649212 / 27760906 / +3.2% 0.73 / 0.74 / -0.9%
tpcds_q64/duckdb:vortex-compact 84401656 / 85417331 / -1.2% 99135792 / 99702369 / -0.6% 0.85 / 0.86 / -0.6%
tpcds_q65/duckdb:vortex-compact 20089925 / 21506052 / -6.6% 35214899 / 30343978 / +16.1% 🔴 0.57 / 0.71 / -19.5%
tpcds_q66/duckdb:vortex-compact 25295850 / 25608937 / -1.2% 37944064 / 31408052 / +20.8% 🔴 0.67 / 0.82 / -18.2%
tpcds_q67/duckdb:vortex-compact 72205076 / 71225695 / +1.4% 88513035 / 85731463 / +3.2% 0.82 / 0.83 / -1.8%
tpcds_q68/duckdb:vortex-compact 29564542 / 29466050 / +0.3% 41124043 / 42177400 / -2.5% 0.72 / 0.70 / +2.9%
tpcds_q69/duckdb:vortex-compact 46500771 / 46535665 / -0.1% 60112571 / 59160677 / +1.6% 0.77 / 0.79 / -1.7%
tpcds_q70/duckdb:vortex-compact 31156148 / 30748385 / +1.3% 38760564 / 39203785 / -1.1% 0.80 / 0.78 / +2.5%
tpcds_q71/duckdb:vortex-compact 19082946 / 19970834 / -4.4% 28815994 / 29158461 / -1.2% 0.66 / 0.68 / -3.3%
tpcds_q72/duckdb:vortex-compact 69465023 / 69247004 / +0.3% 84022635 / 81363275 / +3.3% 0.83 / 0.85 / -2.9%
tpcds_q73/duckdb:vortex-compact 21275626 / 21349940 / -0.3% 31617741 / 28039135 / +12.8% 🔴 0.67 / 0.76 / -11.6%
tpcds_q74/duckdb:vortex-compact 31966150 / 32190198 / -0.7% 42849939 / 40456034 / +5.9% 0.75 / 0.80 / -6.2%
tpcds_q75/duckdb:vortex-compact 32633438 / 34048764 / -4.2% 43304228 / 43426064 / -0.3% 0.75 / 0.78 / -3.9%
tpcds_q76/duckdb:vortex-compact 16884354 / 15840972 / +6.6% 27525938 / 26717756 / +3.0% 0.61 / 0.59 / +3.5%
tpcds_q77/duckdb:vortex-compact 22247668 / 23324482 / -4.6% 31068507 / 33113079 / -6.2% 0.72 / 0.70 / +1.7%
tpcds_q78/duckdb:vortex-compact 41521268 / 41689176 / -0.4% 50461479 / 52308838 / -3.5% 0.82 / 0.80 / +3.2%
tpcds_q79/duckdb:vortex-compact 37423379 / 37537622 / -0.3% 47130144 / 45580578 / +3.4% 0.79 / 0.82 / -3.6%
tpcds_q80/duckdb:vortex-compact 36513424 / 35729248 / +2.2% 50040392 / 51090521 / -2.1% 0.73 / 0.70 / +4.3%
tpcds_q81/duckdb:vortex-compact 24440727 / 24356622 / +0.3% 31838801 / 31899296 / -0.2% 0.77 / 0.76 / +0.5%
tpcds_q82/duckdb:vortex-compact 36582863 / 37663986 / -2.9% 40939516 / 42882086 / -4.5% 0.89 / 0.88 / +1.7%
tpcds_q83/duckdb:vortex-compact 29709484 / 28811416 / +3.1% 34045329 / 34196189 / -0.4% 0.87 / 0.84 / +3.6%
tpcds_q84/duckdb:vortex-compact 14640526 / 14665159 / -0.2% 21073235 / 20783184 / +1.4% 0.69 / 0.71 / -1.5%
tpcds_q85/duckdb:vortex-compact 41169401 / 41058769 / +0.3% 49643755 / 50324412 / -1.4% 0.83 / 0.82 / +1.6%
tpcds_q86/duckdb:vortex-compact 12126801 / 12263487 / -1.1% 19423159 / 19898165 / -2.4% 0.62 / 0.62 / +1.3%
tpcds_q87/duckdb:vortex-compact 27939450 / 28229672 / -1.0% 36255171 / 35866632 / +1.1% 0.77 / 0.79 / -2.1%
tpcds_q88/duckdb:vortex-compact 66625837 / 72477007 / -8.1% 79319688 / 77591886 / +2.2% 0.84 / 0.93 / -10.1%
tpcds_q89/duckdb:vortex-compact 21068422 / 21102140 / -0.2% 29007829 / 30926013 / -6.2% 0.73 / 0.68 / +6.4%
tpcds_q90/duckdb:vortex-compact 12423336 / 13476336 / -7.8% 19471556 / 19594755 / -0.6% 0.64 / 0.69 / -7.2%
tpcds_q91/duckdb:vortex-compact 30037879 / 30200868 / -0.5% 37183522 / 40011219 / -7.1% 0.81 / 0.75 / +7.0%
tpcds_q92/duckdb:vortex-compact 20565230 / 20157078 / +2.0% 27371790 / 28618111 / -4.4% 0.75 / 0.70 / +6.7%
tpcds_q93/duckdb:vortex-compact 18612026 / 19867128 / -6.3% 25474720 / 25964305 / -1.9% 0.73 / 0.77 / -4.5%
tpcds_q94/duckdb:vortex-compact 21973250 / 24926662 / -11.8% 🟢 34057485 / 36964114 / -7.9% 0.65 / 0.67 / -4.3%
tpcds_q95/duckdb:vortex-compact 46355421 / 46071952 / +0.6% 58203205 / 54816767 / +6.2% 0.80 / 0.84 / -5.2%
tpcds_q96/duckdb:vortex-compact 16942629 / 17004220 / -0.4% 23431463 / 23852917 / -1.8% 0.72 / 0.71 / +1.4%
tpcds_q97/duckdb:vortex-compact 25576807 / 25816621 / -0.9% 37275412 / 38917392 / -4.2% 0.69 / 0.66 / +3.4%
tpcds_q98/duckdb:vortex-compact 18280892 / 18356745 / -0.4% 27454650 / 28459055 / -3.5% 0.67 / 0.65 / +3.2%
tpcds_q99/duckdb:vortex-compact 16792019 / 16681964 / +0.7% 22677274 / 22841530 / -0.7% 0.74 / 0.73 / +1.4%
duckdb / parquet / ns (1.006x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24810920 / 24724232 / +0.4% 32410556 / 34977127 / -7.3% 0.77 / 0.71 / +8.3%
tpcds_q02/duckdb:parquet 15598894 / 15666585 / -0.4% 20925662 / 21065865 / -0.7% 0.75 / 0.74 / +0.2%
tpcds_q03/duckdb:parquet 9253706 / 9189896 / +0.7% 15997031 / 15767064 / +1.5% 0.58 / 0.58 / -0.8%
tpcds_q04/duckdb:parquet 130346654 / 129739978 / +0.5% 135684896 / 136116846 / -0.3% 0.96 / 0.95 / +0.8%
tpcds_q05/duckdb:parquet 22220194 / 22306102 / -0.4% 26411601 / 26183045 / +0.9% 0.84 / 0.85 / -1.2%
tpcds_q06/duckdb:parquet 27243138 / 26989875 / +0.9% 38312877 / 37392902 / +2.5% 0.71 / 0.72 / -1.5%
tpcds_q07/duckdb:parquet 16925060 / 15698357 / +7.8% 24317725 / 22690674 / +7.2% 0.70 / 0.69 / +0.6%
tpcds_q08/duckdb:parquet 26076878 / 26554929 / -1.8% 33230947 / 32609457 / +1.9% 0.78 / 0.81 / -3.6%
tpcds_q09/duckdb:parquet 18720437 / 19068879 / -1.8% 23528819 / 21933608 / +7.3% 0.80 / 0.87 / -8.5%
tpcds_q10/duckdb:parquet 28050047 / 28082428 / -0.1% 37918363 / 38029795 / -0.3% 0.74 / 0.74 / +0.2%
tpcds_q11/duckdb:parquet 73571866 / 73196182 / +0.5% 80965450 / 79417575 / +1.9% 0.91 / 0.92 / -1.4%
tpcds_q12/duckdb:parquet 12857165 / 13005261 / -1.1% 18444903 / 18429937 / +0.1% 0.70 / 0.71 / -1.2%
tpcds_q13/duckdb:parquet 24538289 / 24563436 / -0.1% 31388584 / 31109563 / +0.9% 0.78 / 0.79 / -1.0%
tpcds_q14/duckdb:parquet 62919976 / 61642063 / +2.1% 71854528 / 67165942 / +7.0% 0.88 / 0.92 / -4.6%
tpcds_q15/duckdb:parquet 25347896 / 28444718 / -10.9% 🟢 30030140 / 32926972 / -8.8% 0.84 / 0.86 / -2.3%
tpcds_q16/duckdb:parquet 20977258 / 21068803 / -0.4% 28287616 / 29111152 / -2.8% 0.74 / 0.72 / +2.5%
tpcds_q17/duckdb:parquet 32952533 / 33062462 / -0.3% 40481393 / 40802877 / -0.8% 0.81 / 0.81 / +0.5%
tpcds_q18/duckdb:parquet 41896261 / 40191038 / +4.2% 51341699 / 50205390 / +2.3% 0.82 / 0.80 / +1.9%
tpcds_q19/duckdb:parquet 25307601 / 25417560 / -0.4% 32252586 / 32328143 / -0.2% 0.78 / 0.79 / -0.2%
tpcds_q20/duckdb:parquet 13848192 / 13889629 / -0.3% 20954822 / 18720936 / +11.9% 🔴 0.66 / 0.74 / -10.9%
tpcds_q21/duckdb:parquet 9780323 / 9446806 / +3.5% 12260567 / 12798283 / -4.2% 0.80 / 0.74 / +8.1%
tpcds_q22/duckdb:parquet 35266123 / 35171444 / +0.3% 39325786 / 39196103 / +0.3% 0.90 / 0.90 / -0.1%
tpcds_q23/duckdb:parquet 41315939 / 41354476 / -0.1% 47884662 / 48358097 / -1.0% 0.86 / 0.86 / +0.9%
tpcds_q24/duckdb:parquet 34003958 / 33978882 / +0.1% 42258032 / 41227223 / +2.5% 0.80 / 0.82 / -2.4%
tpcds_q25/duckdb:parquet 31763256 / 31521467 / +0.8% 40041476 / 39909121 / +0.3% 0.79 / 0.79 / +0.4%
tpcds_q26/duckdb:parquet 31883726 / 31491594 / +1.2% 38268678 / 38971164 / -1.8% 0.83 / 0.81 / +3.1%
tpcds_q27/duckdb:parquet 32159896 / 32264621 / -0.3% 39542276 / 41752407 / -5.3% 0.81 / 0.77 / +5.2%
tpcds_q28/duckdb:parquet 17475278 / 17479130 / -0.0% 22007964 / 22309479 / -1.4% 0.79 / 0.78 / +1.3%
tpcds_q29/duckdb:parquet 31275890 / 31277602 / -0.0% 38922635 / 39740146 / -2.1% 0.80 / 0.79 / +2.1%
tpcds_q30/duckdb:parquet 34254216 / 34508868 / -0.7% 42600068 / 42966974 / -0.9% 0.80 / 0.80 / +0.1%
tpcds_q31/duckdb:parquet 20884272 / 20461596 / +2.1% 29691448 / 25636912 / +15.8% 🔴 0.70 / 0.80 / -11.9%
tpcds_q32/duckdb:parquet 12244780 / 12282251 / -0.3% 19113118 / 18166231 / +5.2% 0.64 / 0.68 / -5.2%
tpcds_q33/duckdb:parquet 17042449 / 16076942 / +6.0% 23486403 / 25654286 / -8.5% 0.73 / 0.63 / +15.8%
tpcds_q34/duckdb:parquet 16452271 / 16529250 / -0.5% 22124294 / 22191483 / -0.3% 0.74 / 0.74 / -0.2%
tpcds_q35/duckdb:parquet 47180714 / 47608254 / -0.9% 59756662 / 59876419 / -0.2% 0.79 / 0.80 / -0.7%
tpcds_q36/duckdb:parquet 15912500 / 16084422 / -1.1% 23601699 / 27085564 / -12.9% 🟢 0.67 / 0.59 / +13.5%
tpcds_q37/duckdb:parquet 12528487 / 12425630 / +0.8% 19997743 / 19570996 / +2.2% 0.63 / 0.63 / -1.3%
tpcds_q38/duckdb:parquet 27104884 / 26805036 / +1.1% 32948317 / 31453231 / +4.8% 0.82 / 0.85 / -3.5%
tpcds_q39/duckdb:parquet 24531290 / 24411028 / +0.5% 27083771 / 34178751 / -20.8% 🟢 0.91 / 0.71 / +26.8%
tpcds_q40/duckdb:parquet 19522988 / 16561232 / +17.9% 🔴 24527621 / 24769543 / -1.0% 0.80 / 0.67 / +19.0%
tpcds_q41/duckdb:parquet 7859372 / 8359451 / -6.0% 13132830 / 13727131 / -4.3% 0.60 / 0.61 / -1.7%
tpcds_q42/duckdb:parquet 8859046 / 8804813 / +0.6% 15554781 / 14995997 / +3.7% 0.57 / 0.59 / -3.0%
tpcds_q43/duckdb:parquet 10741118 / 10734705 / +0.1% 15046766 / 15195941 / -1.0% 0.71 / 0.71 / +1.1%
tpcds_q44/duckdb:parquet 17306310 / 16125684 / +7.3% 20913298 / 21159221 / -1.2% 0.83 / 0.76 / +8.6%
tpcds_q45/duckdb:parquet 23678629 / 23567741 / +0.5% 29983089 / 29754343 / +0.8% 0.79 / 0.79 / -0.3%
tpcds_q46/duckdb:parquet 37225089 / 36989519 / +0.6% 46241294 / 46215791 / +0.1% 0.81 / 0.80 / +0.6%
tpcds_q47/duckdb:parquet 31894247 / 33742111 / -5.5% 37253260 / 37629561 / -1.0% 0.86 / 0.90 / -4.5%
tpcds_q48/duckdb:parquet 21446136 / 21325642 / +0.6% 27972761 / 28469601 / -1.7% 0.77 / 0.75 / +2.4%
tpcds_q49/duckdb:parquet 20519688 / 20254952 / +1.3% 28238482 / 30802272 / -8.3% 0.73 / 0.66 / +10.5%
tpcds_q50/duckdb:parquet 17963358 / 17920167 / +0.2% 23680874 / 24088672 / -1.7% 0.76 / 0.74 / +2.0%
tpcds_q51/duckdb:parquet 53622412 / 54114154 / -0.9% 60446158 / 64118560 / -5.7% 0.89 / 0.84 / +5.1%
tpcds_q52/duckdb:parquet 9023986 / 8956120 / +0.8% 15884663 / 15847462 / +0.2% 0.57 / 0.57 / +0.5%
tpcds_q53/duckdb:parquet 12010560 / 11869266 / +1.2% 17646574 / 17059736 / +3.4% 0.68 / 0.70 / -2.2%
tpcds_q54/duckdb:parquet 20863732 / 21019434 / -0.7% 29901584 / 29102472 / +2.7% 0.70 / 0.72 / -3.4%
tpcds_q55/duckdb:parquet 9037736 / 8885518 / +1.7% 15469792 / 15242588 / +1.5% 0.58 / 0.58 / +0.2%
tpcds_q56/duckdb:parquet 17236984 / 17100204 / +0.8% 24337987 / 24177966 / +0.7% 0.71 / 0.71 / +0.1%
tpcds_q57/duckdb:parquet 29798412 / 29104464 / +2.4% 37652925 / 36862962 / +2.1% 0.79 / 0.79 / +0.2%
tpcds_q58/duckdb:parquet 19449150 / 18957147 / +2.6% 27883965 / 26285362 / +6.1% 0.70 / 0.72 / -3.3%
tpcds_q59/duckdb:parquet 20212486 / 20108600 / +0.5% 25086743 / 25334363 / -1.0% 0.81 / 0.79 / +1.5%
tpcds_q60/duckdb:parquet 17544800 / 17670020 / -0.7% 24966824 / 24890475 / +0.3% 0.70 / 0.71 / -1.0%
tpcds_q61/duckdb:parquet 22394882 / 22231451 / +0.7% 29132479 / 28659588 / +1.7% 0.77 / 0.78 / -0.9%
tpcds_q62/duckdb:parquet 10951008 / 11011869 / -0.6% 16647515 / 15122146 / +10.1% 🔴 0.66 / 0.73 / -9.7%
tpcds_q63/duckdb:parquet 11421829 / 11666162 / -2.1% 16886061 / 16327242 / +3.4% 0.68 / 0.71 / -5.3%
tpcds_q64/duckdb:parquet 54176352 / 53711008 / +0.9% 65768248 / 66353957 / -0.9% 0.82 / 0.81 / +1.8%
tpcds_q65/duckdb:parquet 14800072 / 14818126 / -0.1% 21094623 / 20898362 / +0.9% 0.70 / 0.71 / -1.1%
tpcds_q66/duckdb:parquet 25027248 / 24835470 / +0.8% 31976563 / 31820423 / +0.5% 0.78 / 0.78 / +0.3%
tpcds_q67/duckdb:parquet 77583920 / 79481534 / -2.4% 85339336 / 85647439 / -0.4% 0.91 / 0.93 / -2.0%
tpcds_q68/duckdb:parquet 30280528 / 30483394 / -0.7% 40620239 / 39793726 / +2.1% 0.75 / 0.77 / -2.7%
tpcds_q69/duckdb:parquet 29124354 / 29174170 / -0.2% 38412083 / 39126912 / -1.8% 0.76 / 0.75 / +1.7%
tpcds_q70/duckdb:parquet 16563384 / 16299490 / +1.6% 25232643 / 25255882 / -0.1% 0.66 / 0.65 / +1.7%
tpcds_q71/duckdb:parquet 15105846 / 14816212 / +2.0% 21378416 / 20822482 / +2.7% 0.71 / 0.71 / -0.7%
tpcds_q72/duckdb:parquet 81825832 / 81615420 / +0.3% 87322956 / 87168237 / +0.2% 0.94 / 0.94 / +0.1%
tpcds_q73/duckdb:parquet 13841561 / 16365318 / -15.4% 🟢 19609725 / 21941598 / -10.6% 🟢 0.71 / 0.75 / -5.4%
tpcds_q74/duckdb:parquet 101992176 / 101229689 / +0.8% 110962273 / 108525176 / +2.2% 0.92 / 0.93 / -1.5%
tpcds_q75/duckdb:parquet 41533739 / 41062396 / +1.1% 52896307 / 51115135 / +3.5% 0.79 / 0.80 / -2.3%
tpcds_q76/duckdb:parquet 13960808 / 13961131 / -0.0% 21294549 / 22036753 / -3.4% 0.66 / 0.63 / +3.5%
tpcds_q77/duckdb:parquet 17570530 / 17394832 / +1.0% 25014258 / 25557759 / -2.1% 0.70 / 0.68 / +3.2%
tpcds_q78/duckdb:parquet 48719634 / 49565074 / -1.7% 54900310 / 53954868 / +1.8% 0.89 / 0.92 / -3.4%
tpcds_q79/duckdb:parquet 21355188 / 21288250 / +0.3% 28843433 / 29323591 / -1.6% 0.74 / 0.73 / +2.0%
tpcds_q80/duckdb:parquet 32883242 / 32669982 / +0.7% 43466594 / 43640790 / -0.4% 0.76 / 0.75 / +1.1%
tpcds_q81/duckdb:parquet 31617664 / 33680124 / -6.1% 39701291 / 43045026 / -7.8% 0.80 / 0.78 / +1.8%
tpcds_q82/duckdb:parquet 14511679 / 12624028 / +15.0% 🔴 19626268 / 18691087 / +5.0% 0.74 / 0.68 / +9.5%
tpcds_q83/duckdb:parquet 17157279 / 16412554 / +4.5% 21571425 / 21584489 / -0.1% 0.80 / 0.76 / +4.6%
tpcds_q84/duckdb:parquet 18662998 / 18581382 / +0.4% 24232325 / 23736599 / +2.1% 0.77 / 0.78 / -1.6%
tpcds_q85/duckdb:parquet 35794819 / 35506327 / +0.8% 44615972 / 47961048 / -7.0% 0.80 / 0.74 / +8.4%
tpcds_q86/duckdb:parquet 11778636 / 11330558 / +4.0% 20228163 / 16558440 / +22.2% 🔴 0.58 / 0.68 / -14.9%
tpcds_q87/duckdb:parquet 28575495 / 28323194 / +0.9% 33106871 / 32639089 / +1.4% 0.86 / 0.87 / -0.5%
tpcds_q88/duckdb:parquet 28626640 / 27019770 / +5.9% 32050378 / 35937093 / -10.8% 🟢 0.89 / 0.75 / +18.8%
tpcds_q89/duckdb:parquet 12989400 / 12698664 / +2.3% 18795670 / 18926107 / -0.7% 0.69 / 0.67 / +3.0%
tpcds_q90/duckdb:parquet 7102447 / 6987192 / +1.6% 11309197 / 11155309 / +1.4% 0.63 / 0.63 / +0.3%
tpcds_q91/duckdb:parquet 21529432 / 21361180 / +0.8% 34413291 / 28503503 / +20.7% 🔴 0.63 / 0.75 / -16.5%
tpcds_q92/duckdb:parquet 14977475 / 12448200 / +20.3% 🔴 19917744 / 19810374 / +0.5% 0.75 / 0.63 / +19.7%
tpcds_q93/duckdb:parquet 21590164 / 21766188 / -0.8% 26924570 / 27295945 / -1.4% 0.80 / 0.80 / +0.6%
tpcds_q94/duckdb:parquet 16990496 / 17076572 / -0.5% 25838111 / 25629836 / +0.8% 0.66 / 0.67 / -1.3%
tpcds_q95/duckdb:parquet 90629925 / 90699283 / -0.1% 97012469 / 98737066 / -1.7% 0.93 / 0.92 / +1.7%
tpcds_q96/duckdb:parquet 7002104 / 7060964 / -0.8% 10631687 / 10601946 / +0.3% 0.66 / 0.67 / -1.1%
tpcds_q97/duckdb:parquet 26104208 / 26889585 / -2.9% 32733964 / 33806800 / -3.2% 0.80 / 0.80 / +0.3%
tpcds_q98/duckdb:parquet 15493005 / 15546728 / -0.3% 22450847 / 23039098 / -2.6% 0.69 / 0.67 / +2.3%
tpcds_q99/duckdb:parquet 17434508 / 17536753 / -0.6% 21068903 / 23351228 / -9.8% 0.83 / 0.75 / +10.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95339058 / 95792304 / -0.5% 167948321 / 174813268 / -3.9% 0.57 / 0.55 / +3.6%
tpch_q02/datafusion:vortex-file-compressed 64525669 / 64854898 / -0.5% 96552410 / 99257338 / -2.7% 0.67 / 0.65 / +2.3%
tpch_q03/datafusion:vortex-file-compressed 65263314 / 64666263 / +0.9% 119278064 / 119200134 / +0.1% 0.55 / 0.54 / +0.9%
tpch_q04/datafusion:vortex-file-compressed 35431589 / 35097364 / +1.0% 82760141 / 81017697 / +2.2% 0.43 / 0.43 / -1.2%
tpch_q05/datafusion:vortex-file-compressed 114991118 / 118149127 / -2.7% 177423799 / 183336633 / -3.2% 0.65 / 0.64 / +0.6%
tpch_q06/datafusion:vortex-file-compressed 14227249 / 14719174 / -3.3% 72600684 / 70394383 / +3.1% 0.20 / 0.21 / -6.3%
tpch_q07/datafusion:vortex-file-compressed 142342620 / 137935680 / +3.2% 203083282 / 194610206 / +4.4% 0.70 / 0.71 / -1.1%
tpch_q08/datafusion:vortex-file-compressed 143391879 / 144439575 / -0.7% 216660536 / 208532007 / +3.9% 0.66 / 0.69 / -4.4%
tpch_q09/datafusion:vortex-file-compressed 188171282 / 185655135 / +1.4% 260363118 / 261186984 / -0.3% 0.72 / 0.71 / +1.7%
tpch_q10/datafusion:vortex-file-compressed 73473980 / 74008799 / -0.7% 139861417 / 141040416 / -0.8% 0.53 / 0.52 / +0.1%
tpch_q11/datafusion:vortex-file-compressed 43150518 / 43403083 / -0.6% 69152134 / 69345369 / -0.3% 0.62 / 0.63 / -0.3%
tpch_q12/datafusion:vortex-file-compressed 44701774 / 43005816 / +3.9% 95753703 / 95961386 / -0.2% 0.47 / 0.45 / +4.2%
tpch_q13/datafusion:vortex-file-compressed 46766102 / 46633452 / +0.3% 84775560 / 83387610 / +1.7% 0.55 / 0.56 / -1.4%
tpch_q14/datafusion:vortex-file-compressed 25191067 / 24947215 / +1.0% 101396768 / 98223340 / +3.2% 0.25 / 0.25 / -2.2%
tpch_q15/datafusion:vortex-file-compressed 36110944 / 36710751 / -1.6% 100050489 / 102709544 / -2.6% 0.36 / 0.36 / +1.0%
tpch_q16/datafusion:vortex-file-compressed 37368657 / 37411717 / -0.1% 67352892 / 67580612 / -0.3% 0.55 / 0.55 / +0.2%
tpch_q17/datafusion:vortex-file-compressed 182568470 / 176854252 / +3.2% 231922922 / 226172400 / +2.5% 0.79 / 0.78 / +0.7%
tpch_q18/datafusion:vortex-file-compressed 199876640 / 204061740 / -2.1% 265516255 / 264008674 / +0.6% 0.75 / 0.77 / -2.6%
tpch_q19/datafusion:vortex-file-compressed 34292341 / 34443201 / -0.4% 101194527 / 94736727 / +6.8% 0.34 / 0.36 / -6.8%
tpch_q20/datafusion:vortex-file-compressed 63131192 / 63147266 / -0.0% 128975960 / 122958771 / +4.9% 0.49 / 0.51 / -4.7%
tpch_q21/datafusion:vortex-file-compressed 182434505 / 183198394 / -0.4% 249542774 / 241694655 / +3.2% 0.73 / 0.76 / -3.5%
tpch_q22/datafusion:vortex-file-compressed 25521433 / 25221296 / +1.2% 56490818 / 56621572 / -0.2% 0.45 / 0.45 / +1.4%
datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 100763503 / 99367721 / +1.4% 158787994 / 167932369 / -5.4% 0.63 / 0.59 / +7.2%
tpch_q02/datafusion:vortex-compact 65864327 / 65823612 / +0.1% 95210106 / 93635340 / +1.7% 0.69 / 0.70 / -1.6%
tpch_q03/datafusion:vortex-compact 66282606 / 65827049 / +0.7% 117236851 / 115591378 / +1.4% 0.57 / 0.57 / -0.7%
tpch_q04/datafusion:vortex-compact 42356933 / 42088277 / +0.6% 83000955 / 82309079 / +0.8% 0.51 / 0.51 / -0.2%
tpch_q05/datafusion:vortex-compact 117224381 / 116466304 / +0.7% 182921784 / 184169269 / -0.7% 0.64 / 0.63 / +1.3%
tpch_q06/datafusion:vortex-compact 17959249 / 18086740 / -0.7% 64263048 / 59500937 / +8.0% 0.28 / 0.30 / -8.1%
tpch_q07/datafusion:vortex-compact 143561360 / 143664520 / -0.1% 187897875 / 187831251 / +0.0% 0.76 / 0.76 / -0.1%
tpch_q08/datafusion:vortex-compact 145472651 / 144193033 / +0.9% 205768033 / 200215068 / +2.8% 0.71 / 0.72 / -1.8%
tpch_q09/datafusion:vortex-compact 185466125 / 191015127 / -2.9% 247252256 / 247018085 / +0.1% 0.75 / 0.77 / -3.0%
tpch_q10/datafusion:vortex-compact 78848002 / 78733074 / +0.1% 128306178 / 138287679 / -7.2% 0.61 / 0.57 / +7.9%
tpch_q11/datafusion:vortex-compact 43794524 / 43897966 / -0.2% 65262834 / 66065193 / -1.2% 0.67 / 0.66 / +1.0%
tpch_q12/datafusion:vortex-compact 56936726 / 57701709 / -1.3% 92969109 / 95599782 / -2.8% 0.61 / 0.60 / +1.5%
tpch_q13/datafusion:vortex-compact 53259526 / 53958775 / -1.3% 80504900 / 81397764 / -1.1% 0.66 / 0.66 / -0.2%
tpch_q14/datafusion:vortex-compact 26828012 / 27439723 / -2.2% 95746200 / 97186405 / -1.5% 0.28 / 0.28 / -0.8%
tpch_q15/datafusion:vortex-compact 44695272 / 45359479 / -1.5% 100851484 / 99840150 / +1.0% 0.44 / 0.45 / -2.5%
tpch_q16/datafusion:vortex-compact 39965341 / 40554282 / -1.5% 69705377 / 69367918 / +0.5% 0.57 / 0.58 / -1.9%
tpch_q17/datafusion:vortex-compact 172304750 / 173541899 / -0.7% 213007537 / 218838713 / -2.7% 0.81 / 0.79 / +2.0%
tpch_q18/datafusion:vortex-compact 204056738 / 202457466 / +0.8% 267169517 / 259525808 / +2.9% 0.76 / 0.78 / -2.1%
tpch_q19/datafusion:vortex-compact 40516548 / 41630050 / -2.7% 88862087 / 88233906 / +0.7% 0.46 / 0.47 / -3.4%
tpch_q20/datafusion:vortex-compact 66162323 / 65477176 / +1.0% 122842895 / 116966321 / +5.0% 0.54 / 0.56 / -3.8%
tpch_q21/datafusion:vortex-compact 191049103 / 192401289 / -0.7% 241308991 / 242090120 / -0.3% 0.79 / 0.79 / -0.4%
tpch_q22/datafusion:vortex-compact 27276758 / 27031807 / +0.9% 53091720 / 55371138 / -4.1% 0.51 / 0.49 / +5.2%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87498934 / 87192829 / +0.4% 130098168 / 130591067 / -0.4% 0.67 / 0.67 / +0.7%
tpch_q02/datafusion:parquet 160075967 / 157892829 / +1.4% 186461446 / 184513438 / +1.1% 0.86 / 0.86 / +0.3%
tpch_q03/datafusion:parquet 142439316 / 142539480 / -0.1% 198217080 / 201807473 / -1.8% 0.72 / 0.71 / +1.7%
tpch_q04/datafusion:parquet 59266077 / 59163545 / +0.2% 100335742 / 99377289 / +1.0% 0.59 / 0.60 / -0.8%
tpch_q05/datafusion:parquet 182373750 / 182351779 / +0.0% 245229592 / 238541012 / +2.8% 0.74 / 0.76 / -2.7%
tpch_q06/datafusion:parquet 35117852 / 35205478 / -0.2% 79793015 / 79125591 / +0.8% 0.44 / 0.44 / -1.1%
tpch_q07/datafusion:parquet 232042261 / 228794221 / +1.4% 291154816 / 285743328 / +1.9% 0.80 / 0.80 / -0.5%
tpch_q08/datafusion:parquet 233776328 / 235149647 / -0.6% 305913666 / 305140983 / +0.3% 0.76 / 0.77 / -0.8%
tpch_q09/datafusion:parquet 316385636 / 316294415 / +0.0% 390061427 / 384162484 / +1.5% 0.81 / 0.82 / -1.5%
tpch_q10/datafusion:parquet 411563847 / 405685096 / +1.4% 460041101 / 456928823 / +0.7% 0.89 / 0.89 / +0.8%
tpch_q11/datafusion:parquet 105125637 / 104921276 / +0.2% 128543699 / 129214232 / -0.5% 0.82 / 0.81 / +0.7%
tpch_q12/datafusion:parquet 84649725 / 84148197 / +0.6% 129129203 / 126320184 / +2.2% 0.66 / 0.67 / -1.6%
tpch_q13/datafusion:parquet 228600796 / 228183250 / +0.2% 260143161 / 257678743 / +1.0% 0.88 / 0.89 / -0.8%
tpch_q14/datafusion:parquet 88897744 / 87634727 / +1.4% 195422422 / 194752041 / +0.3% 0.45 / 0.45 / +1.1%
tpch_q15/datafusion:parquet 90924792 / 89968442 / +1.1% 148682411 / 142597828 / +4.3% 0.61 / 0.63 / -3.1%
tpch_q16/datafusion:parquet 95412637 / 95629499 / -0.2% 121296223 / 122718200 / -1.2% 0.79 / 0.78 / +0.9%
tpch_q17/datafusion:parquet 216359403 / 215813115 / +0.3% 269941612 / 271204085 / -0.5% 0.80 / 0.80 / +0.7%
tpch_q18/datafusion:parquet 291607504 / 288218777 / +1.2% 333532117 / 332851011 / +0.2% 0.87 / 0.87 / +1.0%
tpch_q19/datafusion:parquet 109237349 / 109832131 / -0.5% 174441575 / 177494889 / -1.7% 0.63 / 0.62 / +1.2%
tpch_q20/datafusion:parquet 183148941 / 183398483 / -0.1% 243402141 / 248110206 / -1.9% 0.75 / 0.74 / +1.8%
tpch_q21/datafusion:parquet 246497089 / 243291365 / +1.3% 318075683 / 312753663 / +1.7% 0.77 / 0.78 / -0.4%
tpch_q22/datafusion:parquet 199870553 / 199069845 / +0.4% 222149089 / 223505573 / -0.6% 0.90 / 0.89 / +1.0%
duckdb / vortex-file-compressed / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 51043154 / 53218981 / -4.1% 100481735 / 94106967 / +6.8% 0.51 / 0.57 / -10.2%
tpch_q02/duckdb:vortex-file-compressed 31260106 / 31881430 / -1.9% 46470985 / 54030248 / -14.0% 🟢 0.67 / 0.59 / +14.0%
tpch_q03/duckdb:vortex-file-compressed 56018191 / 56354348 / -0.6% 115587963 / 111385426 / +3.8% 0.48 / 0.51 / -4.2%
tpch_q04/duckdb:vortex-file-compressed 80934362 / 83064876 / -2.6% 122700270 / 122192892 / +0.4% 0.66 / 0.68 / -3.0%
tpch_q05/duckdb:vortex-file-compressed 63868648 / 69844883 / -8.6% 120882159 / 137890970 / -12.3% 🟢 0.53 / 0.51 / +4.3%
tpch_q06/duckdb:vortex-file-compressed 20343547 / 22350518 / -9.0% 65560652 / 69494568 / -5.7% 0.31 / 0.32 / -3.5%
tpch_q07/duckdb:vortex-file-compressed 59263455 / 60935638 / -2.7% 136538002 / 137616497 / -0.8% 0.43 / 0.44 / -2.0%
tpch_q08/duckdb:vortex-file-compressed 83212922 / 83556442 / -0.4% 158468776 / 153884916 / +3.0% 0.53 / 0.54 / -3.3%
tpch_q09/duckdb:vortex-file-compressed 167541789 / 165036099 / +1.5% 242358742 / 244791002 / -1.0% 0.69 / 0.67 / +2.5%
tpch_q10/duckdb:vortex-file-compressed 109154180 / 112195693 / -2.7% 190767437 / 176387824 / +8.2% 0.57 / 0.64 / -10.0%
tpch_q11/duckdb:vortex-file-compressed 17129533 / 17439512 / -1.8% 31022726 / 33374057 / -7.0% 0.55 / 0.52 / +5.7%
tpch_q12/duckdb:vortex-file-compressed 53538250 / 56997763 / -6.1% 95842123 / 114920502 / -16.6% 🟢 0.56 / 0.50 / +12.6%
tpch_q13/duckdb:vortex-file-compressed 92345033 / 90687239 / +1.8% 144821436 / 151866432 / -4.6% 0.64 / 0.60 / +6.8%
tpch_q14/duckdb:vortex-file-compressed 31354088 / 30846786 / +1.6% 76703448 / 83957492 / -8.6% 0.41 / 0.37 / +11.3%
tpch_q15/duckdb:vortex-file-compressed 38572580 / 39118261 / -1.4% 92105078 / 90408385 / +1.9% 0.42 / 0.43 / -3.2%
tpch_q16/duckdb:vortex-file-compressed 41995145 / 42339523 / -0.8% 56957969 / 56222288 / +1.3% 0.74 / 0.75 / -2.1%
tpch_q17/duckdb:vortex-file-compressed 64539128 / 63870377 / +1.0% 144290291 / 138874424 / +3.9% 0.45 / 0.46 / -2.7%
tpch_q18/duckdb:vortex-file-compressed 135075249 / 126589418 / +6.7% 162298368 / 164906350 / -1.6% 0.83 / 0.77 / +8.4%
tpch_q19/duckdb:vortex-file-compressed 42618485 / 43222637 / -1.4% 102128750 / 97823826 / +4.4% 0.42 / 0.44 / -5.6%
tpch_q20/duckdb:vortex-file-compressed 59988562 / 61675432 / -2.7% 136720605 / 131963477 / +3.6% 0.44 / 0.47 / -6.1%
tpch_q21/duckdb:vortex-file-compressed 242191906 / 241541610 / +0.3% 294402183 / 281070274 / +4.7% 0.82 / 0.86 / -4.3%
tpch_q22/duckdb:vortex-file-compressed 42023033 / 41502452 / +1.3% 66496992 / 63177536 / +5.3% 0.63 / 0.66 / -3.8%
duckdb / vortex-compact / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 68739455 / 67921386 / +1.2% 107271832 / 107068174 / +0.2% 0.64 / 0.63 / +1.0%
tpch_q02/duckdb:vortex-compact 35097494 / 34926127 / +0.5% 50439769 / 51124357 / -1.3% 0.70 / 0.68 / +1.9%
tpch_q03/duckdb:vortex-compact 60473711 / 61142744 / -1.1% 104033215 / 108463549 / -4.1% 0.58 / 0.56 / +3.1%
tpch_q04/duckdb:vortex-compact 87494092 / 88329612 / -0.9% 115005357 / 122430313 / -6.1% 0.76 / 0.72 / +5.4%
tpch_q05/duckdb:vortex-compact 67808009 / 69531441 / -2.5% 119040647 / 124458614 / -4.4% 0.57 / 0.56 / +2.0%
tpch_q06/duckdb:vortex-compact 23788975 / 24295614 / -2.1% 63700764 / 65979633 / -3.5% 0.37 / 0.37 / +1.4%
tpch_q07/duckdb:vortex-compact 70741936 / 71392193 / -0.9% 137567193 / 140027554 / -1.8% 0.51 / 0.51 / +0.9%
tpch_q08/duckdb:vortex-compact 90965907 / 90929262 / +0.0% 152829056 / 152298273 / +0.3% 0.60 / 0.60 / -0.3%
tpch_q09/duckdb:vortex-compact 171269075 / 171185716 / +0.0% 237990691 / 241963202 / -1.6% 0.72 / 0.71 / +1.7%
tpch_q10/duckdb:vortex-compact 118830039 / 117599704 / +1.0% 174079679 / 164243683 / +6.0% 0.68 / 0.72 / -4.7%
tpch_q11/duckdb:vortex-compact 18951782 / 19157807 / -1.1% 36779525 / 37121976 / -0.9% 0.52 / 0.52 / -0.2%
tpch_q12/duckdb:vortex-compact 69222714 / 70161444 / -1.3% 110241901 / 111938138 / -1.5% 0.63 / 0.63 / +0.2%
tpch_q13/duckdb:vortex-compact 93782280 / 96260084 / -2.6% 145857055 / 151791374 / -3.9% 0.64 / 0.63 / +1.4%
tpch_q14/duckdb:vortex-compact 33650250 / 35113084 / -4.2% 78829893 / 78738459 / +0.1% 0.43 / 0.45 / -4.3%
tpch_q15/duckdb:vortex-compact 42495751 / 42648267 / -0.4% 103171481 / 94281483 / +9.4% 0.41 / 0.45 / -8.9%
tpch_q16/duckdb:vortex-compact 44245847 / 44153054 / +0.2% 57412918 / 54943685 / +4.5% 0.77 / 0.80 / -4.1%
tpch_q17/duckdb:vortex-compact 60729927 / 58303425 / +4.2% 128055498 / 115286715 / +11.1% 🔴 0.47 / 0.51 / -6.2%
tpch_q18/duckdb:vortex-compact 144190114 / 143800665 / +0.3% 160129862 / 165826297 / -3.4% 0.90 / 0.87 / +3.8%
tpch_q19/duckdb:vortex-compact 43826259 / 44589561 / -1.7% 86029233 / 86475324 / -0.5% 0.51 / 0.52 / -1.2%
tpch_q20/duckdb:vortex-compact 65096058 / 68436933 / -4.9% 140213902 / 138381334 / +1.3% 0.46 / 0.49 / -6.1%
tpch_q21/duckdb:vortex-compact 251067506 / 259314513 / -3.2% 290409973 / 294492417 / -1.4% 0.86 / 0.88 / -1.8%
tpch_q22/duckdb:vortex-compact 43851531 / 44372905 / -1.2% 77329848 / 67368198 / +14.8% 🔴 0.57 / 0.66 / -13.9%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72289754 / 72798022 / -0.7% 85950847 / 87736298 / -2.0% 0.84 / 0.83 / +1.4%
tpch_q02/duckdb:parquet 80571113 / 80767910 / -0.2% 94523064 / 92257459 / +2.5% 0.85 / 0.88 / -2.6%
tpch_q03/duckdb:parquet 122626087 / 120854568 / +1.5% 144808738 / 147095866 / -1.6% 0.85 / 0.82 / +3.1%
tpch_q04/duckdb:parquet 75485979 / 76203116 / -0.9% 95354809 / 98617803 / -3.3% 0.79 / 0.77 / +2.4%
tpch_q05/duckdb:parquet 128801143 / 130267626 / -1.1% 177508295 / 192918751 / -8.0% 0.73 / 0.68 / +7.5%
tpch_q06/duckdb:parquet 33656504 / 34006749 / -1.0% 47054918 / 46569616 / +1.0% 0.72 / 0.73 / -2.1%
tpch_q07/duckdb:parquet 94010261 / 93152111 / +0.9% 140603772 / 132394542 / +6.2% 0.67 / 0.70 / -5.0%
tpch_q08/duckdb:parquet 148858885 / 151837664 / -2.0% 189801033 / 187349881 / +1.3% 0.78 / 0.81 / -3.2%
tpch_q09/duckdb:parquet 228549696 / 230805354 / -1.0% 264374072 / 266688668 / -0.9% 0.86 / 0.87 / -0.1%
tpch_q10/duckdb:parquet 510655652 / 513336894 / -0.5% 542640385 / 546965650 / -0.8% 0.94 / 0.94 / +0.3%
tpch_q11/duckdb:parquet 33338050 / 33767062 / -1.3% 38778756 / 39067612 / -0.7% 0.86 / 0.86 / -0.5%
tpch_q12/duckdb:parquet 75886363 / 76660079 / -1.0% 88670572 / 89228332 / -0.6% 0.86 / 0.86 / -0.4%
tpch_q13/duckdb:parquet 322688964 / 323211738 / -0.2% 338216030 / 335262069 / +0.9% 0.95 / 0.96 / -1.0%
tpch_q14/duckdb:parquet 111650646 / 108943546 / +2.5% 133539002 / 136125531 / -1.9% 0.84 / 0.80 / +4.5%
tpch_q15/duckdb:parquet 42138878 / 43427877 / -3.0% 79885188 / 67380420 / +18.6% 🔴 0.53 / 0.64 / -18.2%
tpch_q16/duckdb:parquet 118015900 / 118744610 / -0.6% 128345597 / 126958476 / +1.1% 0.92 / 0.94 / -1.7%
tpch_q17/duckdb:parquet 80066859 / 80411798 / -0.4% 105262276 / 104487946 / +0.7% 0.76 / 0.77 / -1.2%
tpch_q18/duckdb:parquet 214209667 / 210681536 / +1.7% 171504759 / 171793280 / -0.2% 1.25 / 1.23 / +1.8%
tpch_q19/duckdb:parquet 168196195 / 166844826 / +0.8% 196489942 / 193080971 / +1.8% 0.86 / 0.86 / -0.9%
tpch_q20/duckdb:parquet 135214467 / 136142333 / -0.7% 168350851 / 169301592 / -0.6% 0.80 / 0.80 / -0.1%
tpch_q21/duckdb:parquet 274103285 / 273327258 / +0.3% 292556192 / 276373978 / +5.9% 0.94 / 0.99 / -5.3%
tpch_q22/duckdb:parquet 270891526 / 269822539 / +0.4% 282321675 / 278132828 / +1.5% 0.96 / 0.97 / -1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.989x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1801864 / 1805868 / -0.2% 5809624 / 5756057 / +0.9% 0.31 / 0.31 / -1.1%
statpopgen_q01/datafusion:vortex-file-compressed 25608508 / 26317056 / -2.7% 30051904 / 27696908 / +8.5% 0.85 / 0.95 / -10.3%
statpopgen_q02/datafusion:vortex-file-compressed 113844380 / 108653541 / +4.8% 145821252 / 142959029 / +2.0% 0.78 / 0.76 / +2.7%
statpopgen_q03/datafusion:vortex-file-compressed 350231230 / 347559438 / +0.8% 385622053 / 401510172 / -4.0% 0.91 / 0.87 / +4.9%
statpopgen_q04/datafusion:vortex-file-compressed 347280830 / 353671690 / -1.8% 393811546 / 384547692 / +2.4% 0.88 / 0.92 / -4.1%
statpopgen_q05/datafusion:vortex-file-compressed 215548150 / 210680401 / +2.3% 262047981 / 314474310 / -16.7% 🟢 0.82 / 0.67 / +22.8%
statpopgen_q06/datafusion:vortex-file-compressed 756053343 / 755808396 / +0.0% 797077073 / 795081097 / +0.3% 0.95 / 0.95 / -0.2%
statpopgen_q07/datafusion:vortex-file-compressed 411132270 / 412071372 / -0.2% 429958419 / 424079557 / +1.4% 0.96 / 0.97 / -1.6%
statpopgen_q08/datafusion:vortex-file-compressed 408494526 / 416463176 / -1.9% 424469053 / 435850011 / -2.6% 0.96 / 0.96 / +0.7%
statpopgen_q09/datafusion:vortex-file-compressed 249234935 / 248645406 / +0.2% 288982918 / 293455809 / -1.5% 0.86 / 0.85 / +1.8%
statpopgen_q10/datafusion:vortex-file-compressed 754789679 / 753389341 / +0.2% 780570278 / 775999075 / +0.6% 0.97 / 0.97 / -0.4%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1796916 / 1801597 / -0.3% 5890747 / 5774449 / +2.0% 0.31 / 0.31 / -2.2%
statpopgen_q01/datafusion:vortex-compact 28698008 / 28081624 / +2.2% 26334863 / 29396910 / -10.4% 🟢 1.09 / 0.96 / +14.1%
statpopgen_q02/datafusion:vortex-compact 212606579 / 211822935 / +0.4% 229107088 / 234666898 / -2.4% 0.93 / 0.90 / +2.8%
statpopgen_q03/datafusion:vortex-compact 461974622 / 461281612 / +0.2% 488329987 / 489374490 / -0.2% 0.95 / 0.94 / +0.4%
statpopgen_q04/datafusion:vortex-compact 474164154 / 465236598 / +1.9% 486261839 / 483463200 / +0.6% 0.98 / 0.96 / +1.3%
statpopgen_q05/datafusion:vortex-compact 315766227 / 320559205 / -1.5% 343807242 / 382011677 / -10.0% 🟢 0.92 / 0.84 / +9.5%
statpopgen_q06/datafusion:vortex-compact 881424854 / 879923410 / +0.2% 899693011 / 897907536 / +0.2% 0.98 / 0.98 / -0.0%
statpopgen_q07/datafusion:vortex-compact 973470709 / 968960942 / +0.5% 974269294 / 973797699 / +0.0% 1.00 / 1.00 / +0.4%
statpopgen_q08/datafusion:vortex-compact 968545292 / 970689355 / -0.2% 995658320 / 980742944 / +1.5% 0.97 / 0.99 / -1.7%
statpopgen_q09/datafusion:vortex-compact 362799438 / 364821577 / -0.6% 385904202 / 387507342 / -0.4% 0.94 / 0.94 / -0.1%
statpopgen_q10/datafusion:vortex-compact 980196526 / 975031435 / +0.5% 987247713 / 1008079700 / -2.1% 0.99 / 0.97 / +2.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1985022 / 1952526 / +1.7% 89670698 / 91355933 / -1.8% 0.02 / 0.02 / +3.6%
statpopgen_q01/datafusion:parquet 163523300 / 161721974 / +1.1% 174466793 / 170290740 / +2.5% 0.94 / 0.95 / -1.3%
statpopgen_q02/datafusion:parquet 300051998 / 298862302 / +0.4% 422992122 / 427578115 / -1.1% 0.71 / 0.70 / +1.5%
statpopgen_q03/datafusion:parquet 408454772 / 388765900 / +5.1% 516084399 / 482273174 / +7.0% 0.79 / 0.81 / -1.8%
statpopgen_q04/datafusion:parquet 392623352 / 385159359 / +1.9% 522179805 / 505369428 / +3.3% 0.75 / 0.76 / -1.3%
statpopgen_q05/datafusion:parquet 315305787 / 329483763 / -4.3% 449749019 / 435407915 / +3.3% 0.70 / 0.76 / -7.4%
statpopgen_q06/datafusion:parquet 480062556 / 503105190 / -4.6% 617206216 / 617659797 / -0.1% 0.78 / 0.81 / -4.5%
statpopgen_q07/datafusion:parquet 442518640 / 446265812 / -0.8% 545279299 / 540248123 / +0.9% 0.81 / 0.83 / -1.8%
statpopgen_q08/datafusion:parquet 449112856 / 453330407 / -0.9% 556781240 / 552741687 / +0.7% 0.81 / 0.82 / -1.6%
statpopgen_q09/datafusion:parquet 365223240 / 365256296 / -0.0% 487285600 / 494855004 / -1.5% 0.75 / 0.74 / +1.5%
statpopgen_q10/datafusion:parquet 572878160 / 563668934 / +1.6% 687174540 / 689109742 / -0.3% 0.83 / 0.82 / +1.9%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9088824 / 8995722 / +1.0% 9538885 / 9434709 / +1.1% 0.95 / 0.95 / -0.1%
statpopgen_q01/duckdb:vortex-file-compressed 10425002 / 10280246 / +1.4% 14672353 / 14014209 / +4.7% 0.71 / 0.73 / -3.1%
statpopgen_q02/duckdb:vortex-file-compressed 310609335 / 309334640 / +0.4% 348751980 / 330612361 / +5.5% 0.89 / 0.94 / -4.8%
statpopgen_q03/duckdb:vortex-file-compressed 818650348 / 809415818 / +1.1% 836365311 / 822420287 / +1.7% 0.98 / 0.98 / -0.5%
statpopgen_q04/duckdb:vortex-file-compressed 823303103 / 809771658 / +1.7% 833156344 / 811640747 / +2.7% 0.99 / 1.00 / -1.0%
statpopgen_q05/duckdb:vortex-file-compressed 320272074 / 321931192 / -0.5% 345277787 / 343914477 / +0.4% 0.93 / 0.94 / -0.9%
statpopgen_q06/duckdb:vortex-file-compressed 1136461810 / 1148200044 / -1.0% 1153316160 / 1171581166 / -1.6% 0.99 / 0.98 / +0.5%
statpopgen_q07/duckdb:vortex-file-compressed 366556349 / 387594030 / -5.4% 375539781 / 428419563 / -12.3% 🟢 0.98 / 0.90 / +7.9%
statpopgen_q08/duckdb:vortex-file-compressed 378458238 / 388044892 / -2.5% 374594687 / 431531717 / -13.2% 🟢 1.01 / 0.90 / +12.4%
statpopgen_q09/duckdb:vortex-file-compressed 621067956 / 619373744 / +0.3% 642020548 / 644823837 / -0.4% 0.97 / 0.96 / +0.7%
statpopgen_q10/duckdb:vortex-file-compressed 1908661190 / 1937996837 / -1.5% 1879192134 / 1884564046 / -0.3% 1.02 / 1.03 / -1.2%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8944859 / 9074848 / -1.4% 9449014 / 9404021 / +0.5% 0.95 / 0.96 / -1.9%
statpopgen_q01/duckdb:vortex-compact 10131858 / 10171830 / -0.4% 13612409 / 13343945 / +2.0% 0.74 / 0.76 / -2.4%
statpopgen_q02/duckdb:vortex-compact 380223156 / 382196385 / -0.5% 397874709 / 400826501 / -0.7% 0.96 / 0.95 / +0.2%
statpopgen_q03/duckdb:vortex-compact 901756315 / 894999331 / +0.8% 905627896 / 903610061 / +0.2% 1.00 / 0.99 / +0.5%
statpopgen_q04/duckdb:vortex-compact 893393062 / 904078278 / -1.2% 912711708 / 902924465 / +1.1% 0.98 / 1.00 / -2.2%
statpopgen_q05/duckdb:vortex-compact 426787038 / 428909092 / -0.5% 436077671 / 436341261 / -0.1% 0.98 / 0.98 / -0.4%
statpopgen_q06/duckdb:vortex-compact 1190557014 / 1165954357 / +2.1% 1172577442 / 1169372920 / +0.3% 1.02 / 1.00 / +1.8%
statpopgen_q07/duckdb:vortex-compact 929840429 / 946435011 / -1.8% 934614835 / 946910846 / -1.3% 0.99 / 1.00 / -0.5%
statpopgen_q08/duckdb:vortex-compact 941795912 / 948334887 / -0.7% 933692994 / 957379079 / -2.5% 1.01 / 0.99 / +1.8%
statpopgen_q09/duckdb:vortex-compact 707745896 / 706993622 / +0.1% 709112018 / 711258551 / -0.3% 1.00 / 0.99 / +0.4%
statpopgen_q10/duckdb:vortex-compact 2024507018 / 2031746806 / -0.4% 1980974434 / 1982310177 / -0.1% 1.02 / 1.02 / -0.3%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244958256 / 244969437 / -0.0% 244854538 / 245463242 / -0.2% 1.00 / 1.00 / +0.2%
statpopgen_q01/duckdb:parquet 300953134 / 301531487 / -0.2% 301534850 / 303204891 / -0.6% 1.00 / 0.99 / +0.4%
statpopgen_q02/duckdb:parquet 571636724 / 569950978 / +0.3% 597114282 / 560022987 / +6.6% 0.96 / 1.02 / -5.9%
statpopgen_q03/duckdb:parquet 819135043 / 858253554 / -4.6% 806205551 / 866890864 / -7.0% 1.02 / 0.99 / +2.6%
statpopgen_q04/duckdb:parquet 850647692 / 858757114 / -0.9% 855058041 / 867536435 / -1.4% 0.99 / 0.99 / +0.5%
statpopgen_q05/duckdb:parquet 588619934 / 580186128 / +1.5% 573827709 / 590573832 / -2.8% 1.03 / 0.98 / +4.4%
statpopgen_q06/duckdb:parquet 743645599 / 744747312 / -0.1% 707434403 / 707105806 / +0.0% 1.05 / 1.05 / -0.2%
statpopgen_q07/duckdb:parquet 611686960 / 605734050 / +1.0% 725308682 / 708516195 / +2.4% 0.84 / 0.85 / -1.4%
statpopgen_q08/duckdb:parquet 621943252 / 619388268 / +0.4% 694412761 / 697398323 / -0.4% 0.90 / 0.89 / +0.8%
statpopgen_q09/duckdb:parquet 792736214 / 835731250 / -5.1% 800827955 / 842453547 / -4.9% 0.99 / 0.99 / -0.2%
statpopgen_q10/duckdb:parquet 1439884664 / 1383781325 / +4.1% 1223190010 / 1316982333 / -7.1% 1.18 / 1.05 / +12.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-2.1%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 0.980x ➖ · cold 1.023x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.926x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.950x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6802398 / 7260912 / -6.3% 20329880 / 21143700 / -3.8% 0.33 / 0.34 / -2.6%
fineweb_q01/datafusion:vortex-file-compressed 12117170 / 13060632 / -7.2% 47530761 / 49214467 / -3.4% 0.25 / 0.27 / -3.9%
fineweb_q02/datafusion:vortex-file-compressed 13057358 / 13302128 / -1.8% 52172525 / 52634770 / -0.9% 0.25 / 0.25 / -1.0%
fineweb_q03/datafusion:vortex-file-compressed 21001562 / 22308765 / -5.9% 100625745 / 120916593 / -16.8% 🟢 0.21 / 0.18 / +13.1%
fineweb_q04/datafusion:vortex-file-compressed 81206652 / 80954558 / +0.3% 158334706 / 172448461 / -8.2% 0.51 / 0.47 / +9.3%
fineweb_q05/datafusion:vortex-file-compressed 68106118 / 67952260 / +0.2% 144520927 / 155643149 / -7.1% 0.47 / 0.44 / +7.9%
fineweb_q06/datafusion:vortex-file-compressed 20121499 / 20018388 / +0.5% 102671092 / 122867708 / -16.4% 🟢 0.20 / 0.16 / +20.3%
fineweb_q07/datafusion:vortex-file-compressed 18705464 / 19562372 / -4.4% 98314729 / 118134573 / -16.8% 🟢 0.19 / 0.17 / +14.9%
fineweb_q08/datafusion:vortex-file-compressed 9457903 / 11636592 / -18.7% 🟢 42753060 / 46021526 / -7.1% 0.22 / 0.25 / -12.5%
datafusion / vortex-compact / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7146548 / 7124698 / +0.3% 19790339 / 21758318 / -9.0% 0.36 / 0.33 / +10.3%
fineweb_q01/datafusion:vortex-compact 76864428 / 77674248 / -1.0% 77797686 / 79620343 / -2.3% 0.99 / 0.98 / +1.3%
fineweb_q02/datafusion:vortex-compact 44550188 / 43936655 / +1.4% 114366116 / 115614884 / -1.1% 0.39 / 0.38 / +2.5%
fineweb_q03/datafusion:vortex-compact 155491105 / 156956898 / -0.9% 225896680 / 233556536 / -3.3% 0.69 / 0.67 / +2.4%
fineweb_q04/datafusion:vortex-compact 193290352 / 191813016 / +0.8% 238329060 / 240863624 / -1.1% 0.81 / 0.80 / +1.8%
fineweb_q05/datafusion:vortex-compact 153375738 / 172822800 / -11.3% 🟢 228680244 / 239824976 / -4.6% 0.67 / 0.72 / -6.9%
fineweb_q06/datafusion:vortex-compact 87022966 / 86897147 / +0.1% 158726077 / 164525275 / -3.5% 0.55 / 0.53 / +3.8%
fineweb_q07/datafusion:vortex-compact 88052318 / 89231238 / -1.3% 155911190 / 163427244 / -4.6% 0.56 / 0.55 / +3.4%
fineweb_q08/datafusion:vortex-compact 9297162 / 8608164 / +8.0% 44572377 / 37693157 / +18.3% 🔴 0.21 / 0.23 / -8.7%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9310971 / 9216518 / +1.0% 32448642 / 35247959 / -7.9% 0.29 / 0.26 / +9.7%
fineweb_q01/datafusion:parquet 75264637 / 75733313 / -0.6% 148503652 / 171387235 / -13.4% 🟢 0.51 / 0.44 / +14.7%
fineweb_q02/datafusion:parquet 76295759 / 75306268 / +1.3% 146010030 / 163512277 / -10.7% 🟢 0.52 / 0.46 / +13.5%
fineweb_q03/datafusion:parquet 73632524 / 73755262 / -0.2% 139239611 / 170069285 / -18.1% 🟢 0.53 / 0.43 / +21.9%
fineweb_q04/datafusion:parquet 82580540 / 85251516 / -3.1% 152043134 / 175351552 / -13.3% 🟢 0.54 / 0.49 / +11.7%
fineweb_q05/datafusion:parquet 80161554 / 83200235 / -3.7% 149895293 / 176390848 / -15.0% 🟢 0.53 / 0.47 / +13.4%
fineweb_q06/datafusion:parquet 75081251 / 75796692 / -0.9% 154536469 / 176681712 / -12.5% 🟢 0.49 / 0.43 / +13.3%
fineweb_q07/datafusion:parquet 74341216 / 74544341 / -0.3% 147072984 / 161148656 / -8.7% 0.51 / 0.46 / +9.3%
fineweb_q08/datafusion:parquet 74044764 / 74183970 / -0.2% 143577643 / 174061456 / -17.5% 🟢 0.52 / 0.43 / +21.0%
duckdb / vortex-file-compressed / ns (1.008x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2037201 / 3403131 / -40.1% 🟢 5127134 / 4893801 / +4.8% 0.40 / 0.70 / -42.9%
fineweb_q01/duckdb:vortex-file-compressed 19425710 / 20787588 / -6.6% 65322758 / 57760996 / +13.1% 🔴 0.30 / 0.36 / -17.4%
fineweb_q02/duckdb:vortex-file-compressed 19785305 / 19436489 / +1.8% 55409751 / 51766339 / +7.0% 0.36 / 0.38 / -4.9%
fineweb_q03/duckdb:vortex-file-compressed 33762894 / 33057998 / +2.1% 175359097 / 131075859 / +33.8% 🔴 0.19 / 0.25 / -23.7%
fineweb_q04/duckdb:vortex-file-compressed 96760461 / 80847640 / +19.7% 🔴 198074701 / 146451264 / +35.2% 🔴 0.49 / 0.55 / -11.5%
fineweb_q05/duckdb:vortex-file-compressed 85651592 / 69337098 / +23.5% 🔴 187964752 / 108609835 / +73.1% 🔴 0.46 / 0.64 / -28.6%
fineweb_q06/duckdb:vortex-file-compressed 38370402 / 38593062 / -0.6% 129186256 / 148676361 / -13.1% 🟢 0.30 / 0.26 / +14.4%
fineweb_q07/duckdb:vortex-file-compressed 33132390 / 28392944 / +16.7% 🔴 130338279 / 121977741 / +6.9% 0.25 / 0.23 / +9.2%
fineweb_q08/duckdb:vortex-file-compressed 7159104 / 6647975 / +7.7% 14817171 / 15692221 / -5.6% 0.48 / 0.42 / +14.0%
duckdb / vortex-compact / ns (0.968x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 4321772 / 4575590 / -5.5% 6798028 / 5079039 / +33.8% 🔴 0.64 / 0.90 / -29.4%
fineweb_q01/duckdb:vortex-compact 55136407 / 58291914 / -5.4% 94055892 / 88678851 / +6.1% 0.59 / 0.66 / -10.8%
fineweb_q02/duckdb:vortex-compact 53353360 / 52263939 / +2.1% 86387695 / 95495554 / -9.5% 0.62 / 0.55 / +12.8%
fineweb_q03/duckdb:vortex-compact 183815242 / 194567138 / -5.5% 290473855 / 254993405 / +13.9% 🔴 0.63 / 0.76 / -17.1%
fineweb_q04/duckdb:vortex-compact 187977816 / 199497036 / -5.8% 229118997 / 250216318 / -8.4% 0.82 / 0.80 / +2.9%
fineweb_q05/duckdb:vortex-compact 187379046 / 187110962 / +0.1% 206059906 / 234140171 / -12.0% 🟢 0.91 / 0.80 / +13.8%
fineweb_q06/duckdb:vortex-compact 106893004 / 91338299 / +17.0% 🔴 189721675 / 142435659 / +33.2% 🔴 0.56 / 0.64 / -12.1%
fineweb_q07/duckdb:vortex-compact 100358494 / 96406316 / +4.1% 165042463 / 156811099 / +5.2% 0.61 / 0.61 / -1.1%
fineweb_q08/duckdb:vortex-compact 5981816 / 7905646 / -24.3% 🟢 14497601 / 13339957 / +8.7% 0.41 / 0.59 / -30.4%
duckdb / parquet / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21215958 / 22741285 / -6.7% 22813282 / 26596351 / -14.2% 🟢 0.93 / 0.86 / +8.8%
fineweb_q01/duckdb:parquet 44454818 / 44534684 / -0.2% 56486544 / 56345259 / +0.3% 0.79 / 0.79 / -0.4%
fineweb_q02/duckdb:parquet 44596411 / 44232470 / +0.8% 55476583 / 54703017 / +1.4% 0.80 / 0.81 / -0.6%
fineweb_q03/duckdb:parquet 95432706 / 95181470 / +0.3% 183100957 / 170655951 / +7.3% 0.52 / 0.56 / -6.6%
fineweb_q04/duckdb:parquet 154164851 / 152249370 / +1.3% 210704631 / 202095169 / +4.3% 0.73 / 0.75 / -2.9%
fineweb_q05/duckdb:parquet 143208270 / 144612887 / -1.0% 207205138 / 201689480 / +2.7% 0.69 / 0.72 / -3.6%
fineweb_q06/duckdb:parquet 70280016 / 71356960 / -1.5% 116641841 / 133375075 / -12.5% 🟢 0.60 / 0.54 / +12.6%
fineweb_q07/duckdb:parquet 72047036 / 73004716 / -1.3% 152511968 / 154237321 / -1.1% 0.47 / 0.47 / -0.2%
fineweb_q08/duckdb:parquet 25413887 / 22780358 / +11.6% 🔴 27399427 / 26612505 / +3.0% 0.93 / 0.86 / +8.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 5500ebbe vs base 46d518b4


vortex / vortex-file-compressed / ns (0.944x ➖, 7↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 759144831 / 773001321 / -1.8%
compress time/Bimbo 3696465426 / 3707163881 / -0.3%
compress time/CMSprovider 2517976027 / 2657380551 / -5.2%
compress time/Euro2016 265610396 / 274688052 / -3.3%
compress time/Food 280493817 / 282975712 / -0.9%
compress time/HashTags 475926504 / 481386807 / -1.1%
compress time/TPC-H l_comment canonical 625755931 / 634182393 / -1.3%
compress time/TPC-H l_comment chunked 627005933 / 628881275 / -0.3%
compress time/taxi 400129865 / 407948595 / -1.9%
compress time/wide table cols=100 chunks=1 rows=1000 7217321 / 7110877 / +1.5%
compress time/wide table cols=100 chunks=50 rows=1000 7276559 / 7313340 / -0.5%
compress time/wide table cols=1000 chunks=1 rows=1000 70782370 / 70200073 / +0.8%
compress time/wide table cols=1000 chunks=50 rows=1000 69993608 / 69519612 / +0.7%
compress time/wide table cols=10000 chunks=1 rows=1000 774415084 / 773892218 / +0.1%
compress time/wide table cols=10000 chunks=50 rows=1000 778449978 / 769847904 / +1.1%
decompress time/Arade 8947725 / 9191170 / -2.6%
decompress time/Bimbo 34816016 / 38777618 / -10.2% 🟢
decompress time/CMSprovider 27563372 / 29874682 / -7.7%
decompress time/Euro2016 6683667 / 7230296 / -7.6%
decompress time/Food 2660610 / 2962526 / -10.2% 🟢
decompress time/HashTags 44856599 / 49345538 / -9.1%
decompress time/TPC-H l_comment canonical 18703012 / 21944516 / -14.8% 🟢
decompress time/TPC-H l_comment chunked 18455762 / 22041716 / -16.3% 🟢
decompress time/taxi 5217791 / 5598146 / -6.8%
decompress time/wide table cols=100 chunks=1 rows=1000 1793520 / 1983471 / -9.6%
decompress time/wide table cols=100 chunks=50 rows=1000 1791183 / 1998645 / -10.4% 🟢
decompress time/wide table cols=1000 chunks=1 rows=1000 17510486 / 19277962 / -9.2%
decompress time/wide table cols=1000 chunks=50 rows=1000 17439506 / 19066467 / -8.5%
decompress time/wide table cols=10000 chunks=1 rows=1000 197264005 / 224381913 / -12.1% 🟢
decompress time/wide table cols=10000 chunks=50 rows=1000 191534790 / 231111442 / -17.1% 🟢
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420778804 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016 164045668 / 164046268 / -0.0%
vortex-file-compressed size/Food 38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags 190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.963x ➖, 5↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.337337045 / 0.342799556 / -1.6%
vortex:parquet-zstd ratio compress time/Bimbo 0.312517273 / 0.313559359 / -0.3%
vortex:parquet-zstd ratio compress time/CMSprovider 0.393346228 / 0.41513168 / -5.2%
vortex:parquet-zstd ratio compress time/Euro2016 0.246451203 / 0.253797894 / -2.9%
vortex:parquet-zstd ratio compress time/Food 0.378678137 / 0.381710312 / -0.8%
vortex:parquet-zstd ratio compress time/HashTags 0.260766766 / 0.262595245 / -0.7%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.23826147 / 0.241237076 / -1.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.238072121 / 0.237701962 / +0.2%
vortex:parquet-zstd ratio compress time/taxi 0.367140953 / 0.372955109 / -1.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.81393002 / 1.76346953 / +2.9%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.8416549 / 1.85206645 / -0.6%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.60517064 / 1.55023062 / +3.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.56464646 / 1.56028415 / +0.3%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.68041977 / 1.68594373 / -0.3%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.68491275 / 1.68215162 / +0.2%
vortex:parquet-zstd ratio decompress time/Arade 0.0160757193 / 0.0164093835 / -2.0%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0216938949 / 0.0237954158 / -8.8%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0201107175 / 0.0218029425 / -7.8%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0201121009 / 0.0216016568 / -6.9%
vortex:parquet-zstd ratio decompress time/Food 0.0156156851 / 0.0173259105 / -9.9%
vortex:parquet-zstd ratio decompress time/HashTags 0.0869379753 / 0.0952979656 / -8.8%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0375201177 / 0.0439636732 / -14.7% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0372101878 / 0.0441742124 / -15.8% 🟢
vortex:parquet-zstd ratio decompress time/taxi 0.0240062629 / 0.0256225903 / -6.3%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.869205743 / 0.937502836 / -7.3%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.793196214 / 0.976472077 / -18.8% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.770560173 / 0.79663729 / -3.3%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.731923557 / 0.8116801 / -9.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.802869983 / 0.920799251 / -12.8% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.778797704 / 0.929845414 / -16.2% 🟢
vortex:parquet-zstd size/Arade 0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11645609 / 1.11645609 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33393183 / 1.33393671 / -0.0%
vortex:parquet-zstd size/Food 1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags 1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (0.998x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2250404581 / 2254965935 / -0.2%
parquet_rs-zstd compress time/Bimbo 11828035572 / 11822845579 / +0.0%
parquet_rs-zstd compress time/CMSprovider 6401424108 / 6401295484 / +0.0%
parquet_rs-zstd compress time/Euro2016 1077740312 / 1082310210 / -0.4%
parquet_rs-zstd compress time/Food 740718276 / 741336305 / -0.1%
parquet_rs-zstd compress time/HashTags 1825104136 / 1833189352 / -0.4%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2626341265 / 2628876143 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2633680622 / 2645671365 / -0.5%
parquet_rs-zstd compress time/taxi 1089853535 / 1093827609 / -0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3978831 / 4032322 / -1.3%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3951098 / 3948746 / +0.1%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44096477 / 45283632 / -2.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44734456 / 44555738 / +0.4%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 460846210 / 459026125 / +0.4%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 462012042 / 457656668 / +1.0%
parquet_rs-zstd decompress time/Arade 556598732 / 560116716 / -0.6%
parquet_rs-zstd decompress time/Bimbo 1604876220 / 1629625566 / -1.5%
parquet_rs-zstd decompress time/CMSprovider 1370581237 / 1370213308 / +0.0%
parquet_rs-zstd decompress time/Euro2016 332320677 / 334710252 / -0.7%
parquet_rs-zstd decompress time/Food 170380613 / 170988186 / -0.4%
parquet_rs-zstd decompress time/HashTags 515960935 / 517802638 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 498479566 / 499151104 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 495986801 / 498972473 / -0.6%
parquet_rs-zstd decompress time/taxi 217351240 / 218484780 / -0.5%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2063401 / 2115696 / -2.5%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2258184 / 2046802 / +10.3% 🔴
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 22724359 / 24199171 / -6.1%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23826950 / 23490125 / +1.4%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 245698568 / 243681685 / +0.8%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 245936511 / 248548241 / -1.1%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.972x ➖, 4↑ 1↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98928089 / 99905038 / -1.0%
arrow-ipc compress time/Bimbo 619796149 / 630382877 / -1.7%
arrow-ipc compress time/CMSprovider 383083974 / 386995428 / -1.0%
arrow-ipc compress time/Euro2016 38397987 / 38747396 / -0.9%
arrow-ipc compress time/Food 33845141 / 34296630 / -1.3%
arrow-ipc compress time/HashTags 78830491 / 79420905 / -0.7%
arrow-ipc compress time/TPC-H l_comment canonical 519300133 / 497828847 / +4.3%
arrow-ipc compress time/TPC-H l_comment chunked 647585016 / 522580301 / +23.9% 🔴
arrow-ipc compress time/taxi 74798142 / 75426724 / -0.8%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 210686 / 205865 / +2.3%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 201859 / 201690 / +0.1%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2234064 / 2278457 / -1.9%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2215976 / 2256912 / -1.8%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25412787 / 25709770 / -1.2%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25557282 / 26116672 / -2.1%
arrow-ipc decompress time/Arade 139783061 / 181883859 / -23.1% 🟢
arrow-ipc decompress time/Bimbo 393833975 / 405884873 / -3.0%
arrow-ipc decompress time/CMSprovider 580822359 / 584175072 / -0.6%
arrow-ipc decompress time/Euro2016 63741726 / 75158608 / -15.2% 🟢
arrow-ipc decompress time/Food 48497227 / 58341284 / -16.9% 🟢
arrow-ipc decompress time/HashTags 120053931 / 143110098 / -16.1% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical 531879530 / 533582951 / -0.3%
arrow-ipc decompress time/TPC-H l_comment chunked 541983708 / 534900750 / +1.3%
arrow-ipc decompress time/taxi 45147658 / 48576438 / -7.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 317696 / 319382 / -0.5%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 317346 / 319258 / -0.6%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3473295 / 3524833 / -1.5%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3629155 / 3801264 / -4.5%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36559236 / 36772428 / -0.6%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35512170 / 36793769 / -3.5%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.6%
Engines: DataFusion No clear signal (-10.8%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 1.016x ➖ · cold 1.024x ➖
Parquet (geomean): hot 1.076x ➖ · cold 1.043x ➖
Shifts: Parquet (control) +7.6% · Median polish +3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.121x ➖, 3↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 290609855 / 215603220 / +34.8% 🔴 828003575 / 1010392599 / -18.1% 0.35 / 0.21 / +64.5%
tpch_q02/datafusion:vortex-file-compressed 376640360 / 362039361 / +4.0% 785276524 / 713197691 / +10.1% 0.48 / 0.51 / -5.5%
tpch_q03/datafusion:vortex-file-compressed 525471940 / 409867900 / +28.2% 1578138067 / 1101068343 / +43.3% 🔴 0.33 / 0.37 / -10.6%
tpch_q04/datafusion:vortex-file-compressed 271936053 / 230546916 / +18.0% 494294169 / 402179517 / +22.9% 0.55 / 0.57 / -4.0%
tpch_q05/datafusion:vortex-file-compressed 549125021 / 544111163 / +0.9% 636323968 / 598362110 / +6.3% 0.86 / 0.91 / -5.1%
tpch_q06/datafusion:vortex-file-compressed 329609022 / 385957644 / -14.6% 614932533 / 447359864 / +37.5% 🔴 0.54 / 0.86 / -37.9%
tpch_q07/datafusion:vortex-file-compressed 517513521 / 511310133 / +1.2% 877489241 / 669466216 / +31.1% 🔴 0.59 / 0.76 / -22.8%
tpch_q08/datafusion:vortex-file-compressed 517518985 / 1069894768 / -51.6% 🟢 658108782 / 913654188 / -28.0% 0.79 / 1.17 / -32.8%
tpch_q09/datafusion:vortex-file-compressed 777272780 / 576958297 / +34.7% 🔴 873137787 / 556339470 / +56.9% 🔴 0.89 / 1.04 / -14.2%
tpch_q10/datafusion:vortex-file-compressed 566502235 / 444722724 / +27.4% 735278195 / 686520367 / +7.1% 0.77 / 0.65 / +18.9%
tpch_q11/datafusion:vortex-file-compressed 315308526 / 324949866 / -3.0% 658594858 / 463988935 / +41.9% 🔴 0.48 / 0.70 / -31.6%
tpch_q12/datafusion:vortex-file-compressed 937059688 / 421569312 / +122.3% 🔴 1002025267 / 708058217 / +41.5% 🔴 0.94 / 0.60 / +57.1%
tpch_q13/datafusion:vortex-file-compressed 246834830 / 195114000 / +26.5% 367393417 / 423084777 / -13.2% 0.67 / 0.46 / +45.7%
tpch_q14/datafusion:vortex-file-compressed 300289599 / 238345006 / +26.0% 457217269 / 374291876 / +22.2% 0.66 / 0.64 / +3.1%
tpch_q15/datafusion:vortex-file-compressed 757873453 / 365760670 / +107.2% 🔴 844841602 / 763976439 / +10.6% 0.90 / 0.48 / +87.4%
tpch_q16/datafusion:vortex-file-compressed 311313830 / 169971352 / +83.2% 🔴 320841029 / 286354421 / +12.0% 0.97 / 0.59 / +63.5%
tpch_q17/datafusion:vortex-file-compressed 572770247 / 305767168 / +87.3% 🔴 608766104 / 478378156 / +27.3% 0.94 / 0.64 / +47.2%
tpch_q18/datafusion:vortex-file-compressed 341693049 / 506148934 / -32.5% 🟢 589926620 / 507376333 / +16.3% 0.58 / 1.00 / -41.9%
tpch_q19/datafusion:vortex-file-compressed 439982248 / 350358929 / +25.6% 573977166 / 561299361 / +2.3% 0.77 / 0.62 / +22.8%
tpch_q20/datafusion:vortex-file-compressed 323165272 / 370586769 / -12.8% 504013414 / 634749277 / -20.6% 0.64 / 0.58 / +9.8%
tpch_q21/datafusion:vortex-file-compressed 737050372 / 752769645 / -2.1% 1016880621 / 1053499403 / -3.5% 0.72 / 0.71 / +1.4%
tpch_q22/datafusion:vortex-file-compressed 199650731 / 442619068 / -54.9% 🟢 430863210 / 743145263 / -42.0% 🟢 0.46 / 0.60 / -22.2%
datafusion / vortex-compact / ns (0.921x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 230607733 / 220193983 / +4.7% 746239244 / 784047633 / -4.8% 0.31 / 0.28 / +10.0%
tpch_q02/datafusion:vortex-compact 349413634 / 467519410 / -25.3% 738581765 / 1110730978 / -33.5% 🟢 0.47 / 0.42 / +12.4%
tpch_q03/datafusion:vortex-compact 337286972 / 331263315 / +1.8% 758472050 / 932075194 / -18.6% 0.44 / 0.36 / +25.1%
tpch_q04/datafusion:vortex-compact 160110142 / 185437907 / -13.7% 370277384 / 362851221 / +2.0% 0.43 / 0.51 / -15.4%
tpch_q05/datafusion:vortex-compact 366724562 / 528355870 / -30.6% 🟢 760893828 / 704036135 / +8.1% 0.48 / 0.75 / -35.8%
tpch_q06/datafusion:vortex-compact 263851633 / 302808951 / -12.9% 476962599 / 396557213 / +20.3% 0.55 / 0.76 / -27.6%
tpch_q07/datafusion:vortex-compact 380594860 / 495593141 / -23.2% 470090752 / 700062415 / -32.9% 🟢 0.81 / 0.71 / +14.4%
tpch_q08/datafusion:vortex-compact 557402833 / 661390290 / -15.7% 800306879 / 855371847 / -6.4% 0.70 / 0.77 / -9.9%
tpch_q09/datafusion:vortex-compact 321502594 / 359091194 / -10.5% 542114973 / 525203242 / +3.2% 0.59 / 0.68 / -13.3%
tpch_q10/datafusion:vortex-compact 381046618 / 319220430 / +19.4% 531716254 / 497280998 / +6.9% 0.72 / 0.64 / +11.6%
tpch_q11/datafusion:vortex-compact 292240555 / 477589639 / -38.8% 🟢 424324199 / 546605692 / -22.4% 0.69 / 0.87 / -21.2%
tpch_q12/datafusion:vortex-compact 337733054 / 328441156 / +2.8% 520282666 / 608475052 / -14.5% 0.65 / 0.54 / +20.3%
tpch_q13/datafusion:vortex-compact 153509428 / 126768015 / +21.1% 464282003 / 350773900 / +32.4% 🔴 0.33 / 0.36 / -8.5%
tpch_q14/datafusion:vortex-compact 182589333 / 183347839 / -0.4% 341767215 / 298730380 / +14.4% 0.53 / 0.61 / -13.0%
tpch_q15/datafusion:vortex-compact 305515643 / 509759932 / -40.1% 🟢 432306342 / 821609880 / -47.4% 🟢 0.71 / 0.62 / +13.9%
tpch_q16/datafusion:vortex-compact 161452987 / 198786780 / -18.8% 348062478 / 395207890 / -11.9% 0.46 / 0.50 / -7.8%
tpch_q17/datafusion:vortex-compact 366798027 / 291666297 / +25.8% 662427212 / 429197083 / +54.3% 🔴 0.55 / 0.68 / -18.5%
tpch_q18/datafusion:vortex-compact 300420767 / 323157374 / -7.0% 447189633 / 501504342 / -10.8% 0.67 / 0.64 / +4.3%
tpch_q19/datafusion:vortex-compact 416800794 / 456547428 / -8.7% 563867096 / 583545357 / -3.4% 0.74 / 0.78 / -5.5%
tpch_q20/datafusion:vortex-compact 567559189 / 333398399 / +70.2% 🔴 741719419 / 616164366 / +20.4% 0.77 / 0.54 / +41.4%
tpch_q21/datafusion:vortex-compact 459875227 / 520885239 / -11.7% 637369826 / 626830932 / +1.7% 0.72 / 0.83 / -13.2%
tpch_q22/datafusion:vortex-compact 181034181 / 190037420 / -4.7% 345870220 / 443561635 / -22.0% 0.52 / 0.43 / +22.2%
datafusion / parquet / ns (1.139x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 200421590 / 157022623 / +27.6% 579428229 / 444797745 / +30.3% 🔴 0.35 / 0.35 / -2.0%
tpch_q02/datafusion:parquet 295849208 / 285390536 / +3.7% 564100306 / 473446623 / +19.1% 0.52 / 0.60 / -13.0%
tpch_q03/datafusion:parquet 301439567 / 275573618 / +9.4% 707176591 / 730388054 / -3.2% 0.43 / 0.38 / +13.0%
tpch_q04/datafusion:parquet 220467234 / 216113446 / +2.0% 353656360 / 424032816 / -16.6% 0.62 / 0.51 / +22.3%
tpch_q05/datafusion:parquet 380602904 / 402283432 / -5.4% 487653699 / 537775754 / -9.3% 0.78 / 0.75 / +4.3%
tpch_q06/datafusion:parquet 158447416 / 115510400 / +37.2% 🔴 340278254 / 229970678 / +48.0% 🔴 0.47 / 0.50 / -7.3%
tpch_q07/datafusion:parquet 379415207 / 342359216 / +10.8% 474944930 / 434919030 / +9.2% 0.80 / 0.79 / +1.5%
tpch_q08/datafusion:parquet 607695412 / 413693713 / +46.9% 🔴 723853348 / 570676257 / +26.8% 0.84 / 0.72 / +15.8%
tpch_q09/datafusion:parquet 499198408 / 373858078 / +33.5% 🔴 648559207 / 526062689 / +23.3% 0.77 / 0.71 / +8.3%
tpch_q10/datafusion:parquet 367007409 / 320731282 / +14.4% 504933219 / 468495002 / +7.8% 0.73 / 0.68 / +6.2%
tpch_q11/datafusion:parquet 286843813 / 264485461 / +8.5% 395951308 / 362779793 / +9.1% 0.72 / 0.73 / -0.6%
tpch_q12/datafusion:parquet 263406927 / 219045486 / +20.3% 382924887 / 431385588 / -11.2% 0.69 / 0.51 / +35.5%
tpch_q13/datafusion:parquet 356873264 / 366255208 / -2.6% 593807113 / 557886302 / +6.4% 0.60 / 0.66 / -8.5%
tpch_q14/datafusion:parquet 158483694 / 165536184 / -4.3% 322469033 / 279449933 / +15.4% 0.49 / 0.59 / -17.0%
tpch_q15/datafusion:parquet 377943119 / 290260202 / +30.2% 🔴 476108923 / 467618751 / +1.8% 0.79 / 0.62 / +27.9%
tpch_q16/datafusion:parquet 107691035 / 106415695 / +1.2% 290807252 / 288317430 / +0.9% 0.37 / 0.37 / +0.3%
tpch_q17/datafusion:parquet 346276225 / 303343628 / +14.2% 672440469 / 435622486 / +54.4% 🔴 0.51 / 0.70 / -26.0%
tpch_q18/datafusion:parquet 393208716 / 369408048 / +6.4% 527504988 / 624788858 / -15.6% 0.75 / 0.59 / +26.1%
tpch_q19/datafusion:parquet 173086569 / 161076306 / +7.5% 304873422 / 311302771 / -2.1% 0.57 / 0.52 / +9.7%
tpch_q20/datafusion:parquet 274929204 / 246453318 / +11.6% 507882430 / 442793951 / +14.7% 0.54 / 0.56 / -2.7%
tpch_q21/datafusion:parquet 386160841 / 329448361 / +17.2% 491921112 / 471402768 / +4.4% 0.79 / 0.70 / +12.3%
tpch_q22/datafusion:parquet 215718585 / 161864843 / +33.3% 🔴 422213634 / 296379301 / +42.5% 🔴 0.51 / 0.55 / -6.4%
duckdb / vortex-file-compressed / ns (1.023x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 239050742 / 202004497 / +18.3% 443813920 / 301581046 / +47.2% 🔴 0.54 / 0.67 / -19.6%
tpch_q02/duckdb:vortex-file-compressed 471522113 / 418993805 / +12.5% 554706967 / 487930342 / +13.7% 0.85 / 0.86 / -1.0%
tpch_q03/duckdb:vortex-file-compressed 476528190 / 604467221 / -21.2% 759986819 / 640593041 / +18.6% 0.63 / 0.94 / -33.6%
tpch_q04/duckdb:vortex-file-compressed 326768328 / 353876230 / -7.7% 406360846 / 387953075 / +4.7% 0.80 / 0.91 / -11.8%
tpch_q05/duckdb:vortex-file-compressed 496028033 / 466509317 / +6.3% 522757098 / 598870568 / -12.7% 0.95 / 0.78 / +21.8%
tpch_q06/duckdb:vortex-file-compressed 349529320 / 290324558 / +20.4% 433591891 / 269852133 / +60.7% 🔴 0.81 / 1.08 / -25.1%
tpch_q07/duckdb:vortex-file-compressed 559083316 / 486295825 / +15.0% 669232972 / 527564184 / +26.9% 0.84 / 0.92 / -9.4%
tpch_q08/duckdb:vortex-file-compressed 699613984 / 648259277 / +7.9% 811942356 / 665883065 / +21.9% 0.86 / 0.97 / -11.5%
tpch_q09/duckdb:vortex-file-compressed 521268946 / 524069468 / -0.5% 539172583 / 561027816 / -3.9% 0.97 / 0.93 / +3.5%
tpch_q10/duckdb:vortex-file-compressed 559103673 / 480926680 / +16.3% 557904378 / 516111973 / +8.1% 1.00 / 0.93 / +7.5%
tpch_q11/duckdb:vortex-file-compressed 192378186 / 206682560 / -6.9% 245534803 / 244697971 / +0.3% 0.78 / 0.84 / -7.2%
tpch_q12/duckdb:vortex-file-compressed 444277930 / 545610262 / -18.6% 470892343 / 735711216 / -36.0% 🟢 0.94 / 0.74 / +27.2%
tpch_q13/duckdb:vortex-file-compressed 503502508 / 408383915 / +23.3% 506449073 / 484945742 / +4.4% 0.99 / 0.84 / +18.1%
tpch_q14/duckdb:vortex-file-compressed 278744313 / 253585368 / +9.9% 325507385 / 328581056 / -0.9% 0.86 / 0.77 / +11.0%
tpch_q15/duckdb:vortex-file-compressed 214007036 / 154619197 / +38.4% 🔴 226541555 / 307924434 / -26.4% 0.94 / 0.50 / +88.1%
tpch_q16/duckdb:vortex-file-compressed 188817095 / 177671076 / +6.3% 212306933 / 179973342 / +18.0% 0.89 / 0.99 / -9.9%
tpch_q17/duckdb:vortex-file-compressed 438297670 / 439977603 / -0.4% 497294229 / 476634204 / +4.3% 0.88 / 0.92 / -4.5%
tpch_q18/duckdb:vortex-file-compressed 353110663 / 358518516 / -1.5% 385992142 / 349309083 / +10.5% 0.91 / 1.03 / -10.9%
tpch_q19/duckdb:vortex-file-compressed 352025250 / 331640163 / +6.1% 429552417 / 365698292 / +17.5% 0.82 / 0.91 / -9.6%
tpch_q20/duckdb:vortex-file-compressed 422973718 / 374415036 / +13.0% 504427193 / 444216322 / +13.6% 0.84 / 0.84 / -0.5%
tpch_q21/duckdb:vortex-file-compressed 696007561 / 806482566 / -13.7% 757167791 / 611022090 / +23.9% 0.92 / 1.32 / -30.4%
tpch_q22/duckdb:vortex-file-compressed 177075715 / 291716863 / -39.3% 🟢 221744388 / 333774554 / -33.6% 🟢 0.80 / 0.87 / -8.6%
duckdb / vortex-compact / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 214183077 / 211285869 / +1.4% 265882743 / 451039514 / -41.1% 🟢 0.81 / 0.47 / +72.0%
tpch_q02/duckdb:vortex-compact 396803268 / 533070826 / -25.6% 456587028 / 510908402 / -10.6% 0.87 / 1.04 / -16.7%
tpch_q03/duckdb:vortex-compact 682414338 / 399135293 / +71.0% 🔴 627239452 / 549873538 / +14.1% 1.09 / 0.73 / +49.9%
tpch_q04/duckdb:vortex-compact 257612407 / 238490303 / +8.0% 353094755 / 298620409 / +18.2% 0.73 / 0.80 / -8.6%
tpch_q05/duckdb:vortex-compact 414667075 / 382659761 / +8.4% 584377014 / 415097883 / +40.8% 🔴 0.71 / 0.92 / -23.0%
tpch_q06/duckdb:vortex-compact 355546955 / 284110141 / +25.1% 320117557 / 333063274 / -3.9% 1.11 / 0.85 / +30.2%
tpch_q07/duckdb:vortex-compact 442520370 / 450178777 / -1.7% 585395410 / 523884460 / +11.7% 0.76 / 0.86 / -12.0%
tpch_q08/duckdb:vortex-compact 609812224 / 611194527 / -0.2% 664488880 / 727701289 / -8.7% 0.92 / 0.84 / +9.3%
tpch_q09/duckdb:vortex-compact 472309220 / 506195242 / -6.7% 520134762 / 490845318 / +6.0% 0.91 / 1.03 / -11.9%
tpch_q10/duckdb:vortex-compact 423124538 / 418068346 / +1.2% 471653628 / 492320486 / -4.2% 0.90 / 0.85 / +5.6%
tpch_q11/duckdb:vortex-compact 187352305 / 226247032 / -17.2% 226258753 / 229389565 / -1.4% 0.83 / 0.99 / -16.0%
tpch_q12/duckdb:vortex-compact 392880815 / 480298349 / -18.2% 650554420 / 529415654 / +22.9% 0.60 / 0.91 / -33.4%
tpch_q13/duckdb:vortex-compact 218476163 / 246277144 / -11.3% 279427363 / 287957340 / -3.0% 0.78 / 0.86 / -8.6%
tpch_q14/duckdb:vortex-compact 304102024 / 246435263 / +23.4% 502040704 / 313604603 / +60.1% 🔴 0.61 / 0.79 / -22.9%
tpch_q15/duckdb:vortex-compact 152313877 / 149326743 / +2.0% 198461773 / 192763482 / +3.0% 0.77 / 0.77 / -0.9%
tpch_q16/duckdb:vortex-compact 192103720 / 172963553 / +11.1% 207754731 / 199406094 / +4.2% 0.92 / 0.87 / +6.6%
tpch_q17/duckdb:vortex-compact 400691552 / 457394995 / -12.4% 440699825 / 708314008 / -37.8% 🟢 0.91 / 0.65 / +40.8%
tpch_q18/duckdb:vortex-compact 283654817 / 342118883 / -17.1% 311338371 / 350716729 / -11.2% 0.91 / 0.98 / -6.6%
tpch_q19/duckdb:vortex-compact 395764269 / 353758038 / +11.9% 453845117 / 371476162 / +22.2% 0.87 / 0.95 / -8.4%
tpch_q20/duckdb:vortex-compact 463306420 / 369437992 / +25.4% 549301157 / 452720356 / +21.3% 0.84 / 0.82 / +3.4%
tpch_q21/duckdb:vortex-compact 614917016 / 795638559 / -22.7% 731448012 / 1019677687 / -28.3% 0.84 / 0.78 / +7.7%
tpch_q22/duckdb:vortex-compact 180658163 / 167810093 / +7.7% 222534872 / 197963145 / +12.4% 0.81 / 0.85 / -4.2%
duckdb / parquet / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 312894372 / 351849909 / -11.1% 295615460 / 374538831 / -21.1% 1.06 / 0.94 / +12.7%
tpch_q02/duckdb:parquet 721771764 / 664454306 / +8.6% 675366939 / 740911899 / -8.8% 1.07 / 0.90 / +19.2%
tpch_q03/duckdb:parquet 828841006 / 775534324 / +6.9% 814987752 / 973076499 / -16.2% 1.02 / 0.80 / +27.6%
tpch_q04/duckdb:parquet 478706539 / 491640666 / -2.6% 486072516 / 615644630 / -21.0% 0.98 / 0.80 / +23.3%
tpch_q05/duckdb:parquet 982746694 / 931781188 / +5.5% 1003671743 / 987997845 / +1.6% 0.98 / 0.94 / +3.8%
tpch_q06/duckdb:parquet 325871876 / 323997268 / +0.6% 306949380 / 294942557 / +4.1% 1.06 / 1.10 / -3.4%
tpch_q07/duckdb:parquet 917769718 / 868086192 / +5.7% 1204850799 / 934989694 / +28.9% 0.76 / 0.93 / -18.0%
tpch_q08/duckdb:parquet 1067581870 / 1066593358 / +0.1% 1090531249 / 1123987002 / -3.0% 0.98 / 0.95 / +3.2%
tpch_q09/duckdb:parquet 1035207261 / 998974911 / +3.6% 962411520 / 1014469117 / -5.1% 1.08 / 0.98 / +9.2%
tpch_q10/duckdb:parquet 957466277 / 1001530556 / -4.4% 1031030547 / 968800741 / +6.4% 0.93 / 1.03 / -10.2%
tpch_q11/duckdb:parquet 425111118 / 424442542 / +0.2% 443250415 / 449391903 / -1.4% 0.96 / 0.94 / +1.5%
tpch_q12/duckdb:parquet 731825364 / 541672478 / +35.1% 🔴 900544736 / 678789933 / +32.7% 🔴 0.81 / 0.80 / +1.8%
tpch_q13/duckdb:parquet 693937558 / 707569272 / -1.9% 750331461 / 867402479 / -13.5% 0.92 / 0.82 / +13.4%
tpch_q14/duckdb:parquet 526539579 / 559233926 / -5.8% 460989480 / 511712723 / -9.9% 1.14 / 1.09 / +4.5%
tpch_q15/duckdb:parquet 378030349 / 383004703 / -1.3% 444655930 / 381188039 / +16.7% 0.85 / 1.00 / -15.4%
tpch_q16/duckdb:parquet 490275533 / 491672221 / -0.3% 490330884 / 468053464 / +4.8% 1.00 / 1.05 / -4.8%
tpch_q17/duckdb:parquet 462301066 / 475286903 / -2.7% 473418666 / 503132737 / -5.9% 0.98 / 0.94 / +3.4%
tpch_q18/duckdb:parquet 606238741 / 651154504 / -6.9% 594699979 / 580726932 / +2.4% 1.02 / 1.12 / -9.1%
tpch_q19/duckdb:parquet 561004521 / 542427739 / +3.4% 542141616 / 673463636 / -19.5% 1.03 / 0.81 / +28.5%
tpch_q20/duckdb:parquet 914858671 / 827665828 / +10.5% 974912780 / 857142311 / +13.7% 0.94 / 0.97 / -2.8%
tpch_q21/duckdb:parquet 762641218 / 707300009 / +7.8% 808663839 / 680750052 / +18.8% 0.94 / 1.04 / -9.2%
tpch_q22/duckdb:parquet 404924608 / 425479960 / -4.8% 425056743 / 446686266 / -4.8% 0.95 / 0.95 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 5500ebbe vs base 9eb20ba0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +12.9%
Engines: DataFusion No clear signal (+11.2%, environment too noisy confidence) · DuckDB No clear signal (+14.6%, environment too noisy confidence)
Vortex (geomean): hot 1.150x ➖ · cold 1.055x ➖
Parquet (geomean): hot 1.019x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +1.9% · Median polish +4.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.247x ➖, 0↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 320598269 / 338635062 / -5.3% 1112593462 / 1282765989 / -13.3% 0.29 / 0.26 / +9.2%
tpch_q02/datafusion:vortex-compact 594456344 / 557894951 / +6.6% 1181288845 / 1212470509 / -2.6% 0.50 / 0.46 / +9.4%
tpch_q03/datafusion:vortex-compact 884111460 / 664300593 / +33.1% 🔴 1829233002 / 1771731601 / +3.2% 0.48 / 0.37 / +28.9%
tpch_q04/datafusion:vortex-compact 401652796 / 380714177 / +5.5% 1177391431 / 684863101 / +71.9% 🔴 0.34 / 0.56 / -38.6%
tpch_q05/datafusion:vortex-compact 821162909 / 668070693 / +22.9% 1118163792 / 1351816141 / -17.3% 0.73 / 0.49 / +48.6%
tpch_q06/datafusion:vortex-compact 596699399 / 398635554 / +49.7% 🔴 707859336 / 660263917 / +7.2% 0.84 / 0.60 / +39.6%
tpch_q07/datafusion:vortex-compact 734174508 / 574361885 / +27.8% 872589158 / 1011439095 / -13.7% 0.84 / 0.57 / +48.2%
tpch_q08/datafusion:vortex-compact 1166149380 / 967029192 / +20.6% 1584094672 / 1153669384 / +37.3% 🔴 0.74 / 0.84 / -12.2%
tpch_q09/datafusion:vortex-compact 1297436036 / 718973143 / +80.5% 🔴 1363534443 / 1044237641 / +30.6% 🔴 0.95 / 0.69 / +38.2%
tpch_q10/datafusion:vortex-compact 995836758 / 721520878 / +38.0% 🔴 1232477828 / 1073261495 / +14.8% 0.81 / 0.67 / +20.2%
tpch_q11/datafusion:vortex-compact 838931923 / 400571473 / +109.4% 🔴 962875931 / 611623666 / +57.4% 🔴 0.87 / 0.65 / +33.0%
tpch_q12/datafusion:vortex-compact 612214230 / 477491868 / +28.2% 910874641 / 1005724904 / -9.4% 0.67 / 0.47 / +41.6%
tpch_q13/datafusion:vortex-compact 463255764 / 361453831 / +28.2% 1099066346 / 1182022363 / -7.0% 0.42 / 0.31 / +37.8%
tpch_q14/datafusion:vortex-compact 478096395 / 387595027 / +23.3% 491180695 / 478338273 / +2.7% 0.97 / 0.81 / +20.1%
tpch_q15/datafusion:vortex-compact 716244617 / 683634612 / +4.8% 1007489270 / 812046777 / +24.1% 0.71 / 0.84 / -15.6%
tpch_q16/datafusion:vortex-compact 273498761 / 299848930 / -8.8% 570154550 / 603191217 / -5.5% 0.48 / 0.50 / -3.5%
tpch_q17/datafusion:vortex-compact 766085221 / 731583532 / +4.7% 984427303 / 891982940 / +10.4% 0.78 / 0.82 / -5.1%
tpch_q18/datafusion:vortex-compact 738579880 / 545769428 / +35.3% 🔴 1028596718 / 627740683 / +63.9% 🔴 0.72 / 0.87 / -17.4%
tpch_q19/datafusion:vortex-compact 700696958 / 808455380 / -13.3% 629354063 / 850193988 / -26.0% 1.11 / 0.95 / +17.1%
tpch_q20/datafusion:vortex-compact 662025287 / 688345433 / -3.8% 899722664 / 782771315 / +14.9% 0.74 / 0.88 / -16.3%
tpch_q21/datafusion:vortex-compact 1015580836 / 780899970 / +30.1% 🔴 1888269871 / 983285226 / +92.0% 🔴 0.54 / 0.79 / -32.3%
tpch_q22/datafusion:vortex-compact 752468841 / 364889184 / +106.2% 🔴 1157217426 / 573279620 / +101.9% 🔴 0.65 / 0.64 / +2.2%
datafusion / parquet / ns (1.121x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 394119011 / 236034238 / +67.0% 🔴 755703972 / 636412214 / +18.7% 0.52 / 0.37 / +40.6%
tpch_q02/datafusion:parquet 451631780 / 537632425 / -16.0% 1099449513 / 1227467830 / -10.4% 0.41 / 0.44 / -6.2%
tpch_q03/datafusion:parquet 507473053 / 528921753 / -4.1% 1067130129 / 949277170 / +12.4% 0.48 / 0.56 / -14.7%
tpch_q04/datafusion:parquet 626570773 / 262436114 / +138.8% 🔴 596197771 / 525839685 / +13.4% 1.05 / 0.50 / +110.6%
tpch_q05/datafusion:parquet 695902584 / 646933878 / +7.6% 1187601289 / 894810731 / +32.7% 🔴 0.59 / 0.72 / -19.0%
tpch_q06/datafusion:parquet 1108078103 / 450765840 / +145.8% 🔴 1689485298 / 652031751 / +159.1% 🔴 0.66 / 0.69 / -5.1%
tpch_q07/datafusion:parquet 736342002 / 648901111 / +13.5% 807209956 / 880548656 / -8.3% 0.91 / 0.74 / +23.8%
tpch_q08/datafusion:parquet 972170223 / 1189755328 / -18.3% 1559015374 / 1663361079 / -6.3% 0.62 / 0.72 / -12.8%
tpch_q09/datafusion:parquet 1174388495 / 1499377757 / -21.7% 1278715213 / 2053501834 / -37.7% 🟢 0.92 / 0.73 / +25.8%
tpch_q10/datafusion:parquet 1608665258 / 1393106943 / +15.5% 1882538282 / 1976045515 / -4.7% 0.85 / 0.70 / +21.2%
tpch_q11/datafusion:parquet 381860369 / 574885517 / -33.6% 🟢 717917552 / 885992458 / -19.0% 0.53 / 0.65 / -18.0%
tpch_q12/datafusion:parquet 450506184 / 400766014 / +12.4% 762470652 / 737435111 / +3.4% 0.59 / 0.54 / +8.7%
tpch_q13/datafusion:parquet 458353145 / 444963087 / +3.0% 823421962 / 1052600403 / -21.8% 0.56 / 0.42 / +31.7%
tpch_q14/datafusion:parquet 411339224 / 437043416 / -5.9% 784852998 / 764021293 / +2.7% 0.52 / 0.57 / -8.4%
tpch_q15/datafusion:parquet 766351966 / 540664859 / +41.7% 🔴 1958543907 / 980145220 / +99.8% 🔴 0.39 / 0.55 / -29.1%
tpch_q16/datafusion:parquet 234071003 / 248284480 / -5.7% 611462847 / 537906961 / +13.7% 0.38 / 0.46 / -17.1%
tpch_q17/datafusion:parquet 876375612 / 653946192 / +34.0% 🔴 949202756 / 759753133 / +24.9% 0.92 / 0.86 / +7.3%
tpch_q18/datafusion:parquet 943174974 / 868794053 / +8.6% 1194856244 / 1048058150 / +14.0% 0.79 / 0.83 / -4.8%
tpch_q19/datafusion:parquet 488305684 / 445310784 / +9.7% 524611724 / 703024786 / -25.4% 0.93 / 0.63 / +46.9%
tpch_q20/datafusion:parquet 762818461 / 793230389 / -3.8% 1008628133 / 1036507855 / -2.7% 0.76 / 0.77 / -1.2%
tpch_q21/datafusion:parquet 1248152176 / 1109736616 / +12.5% 1264111393 / 1052514748 / +20.1% 0.99 / 1.05 / -6.4%
tpch_q22/datafusion:parquet 640205120 / 613026487 / +4.4% 799712169 / 795343718 / +0.5% 0.80 / 0.77 / +3.9%
duckdb / vortex-compact / ns (1.061x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 942186722 / 968882516 / -2.8% 1338556251 / 2598198034 / -48.5% 🟢 0.70 / 0.37 / +88.8%
tpch_q02/duckdb:vortex-compact 635447158 / 513929503 / +23.6% 714251313 / 607185475 / +17.6% 0.89 / 0.85 / +5.1%
tpch_q03/duckdb:vortex-compact 1225237260 / 1250759598 / -2.0% 1612498065 / 2090404424 / -22.9% 0.76 / 0.60 / +27.0%
tpch_q04/duckdb:vortex-compact 807158715 / 850861412 / -5.1% 1091466149 / 1149852522 / -5.1% 0.74 / 0.74 / -0.1%
tpch_q05/duckdb:vortex-compact 1584868277 / 1182716389 / +34.0% 🔴 1689390673 / 1839529351 / -8.2% 0.94 / 0.64 / +45.9%
tpch_q06/duckdb:vortex-compact 1193020264 / 1153178932 / +3.5% 1318757832 / 1251738942 / +5.4% 0.90 / 0.92 / -1.8%
tpch_q07/duckdb:vortex-compact 1638079155 / 1586668621 / +3.2% 1576218227 / 1675227676 / -5.9% 1.04 / 0.95 / +9.7%
tpch_q08/duckdb:vortex-compact 1888731201 / 1571443055 / +20.2% 2163826394 / 1706753141 / +26.8% 0.87 / 0.92 / -5.2%
tpch_q09/duckdb:vortex-compact 1885803343 / 1858176057 / +1.5% 2131280167 / 2331762766 / -8.6% 0.88 / 0.80 / +11.0%
tpch_q10/duckdb:vortex-compact 1912675790 / 1554765758 / +23.0% 2224985781 / 2019232671 / +10.2% 0.86 / 0.77 / +11.6%
tpch_q11/duckdb:vortex-compact 579537485 / 550004109 / +5.4% 711912696 / 897392720 / -20.7% 0.81 / 0.61 / +32.8%
tpch_q12/duckdb:vortex-compact 2291738504 / 2283839052 / +0.3% 2515283738 / 2510380670 / +0.2% 0.91 / 0.91 / +0.2%
tpch_q13/duckdb:vortex-compact 1379389243 / 1108866554 / +24.4% 2137518164 / 2091695754 / +2.2% 0.65 / 0.53 / +21.7%
tpch_q14/duckdb:vortex-compact 960936645 / 907627043 / +5.9% 965721139 / 968197696 / -0.3% 1.00 / 0.94 / +6.1%
tpch_q15/duckdb:vortex-compact 963340286 / 1036384763 / -7.0% 1000209758 / 1251320772 / -20.1% 0.96 / 0.83 / +16.3%
tpch_q16/duckdb:vortex-compact 230335121 / 232141025 / -0.8% 312818717 / 271419860 / +15.3% 0.74 / 0.86 / -13.9%
tpch_q17/duckdb:vortex-compact 1361604873 / 1459449622 / -6.7% 1447317234 / 1478174580 / -2.1% 0.94 / 0.99 / -4.7%
tpch_q18/duckdb:vortex-compact 1906223427 / 1901904393 / +0.2% 1823984383 / 1699687556 / +7.3% 1.05 / 1.12 / -6.6%
tpch_q19/duckdb:vortex-compact 1402460362 / 1197446940 / +17.1% 1352668831 / 1277125387 / +5.9% 1.04 / 0.94 / +10.6%
tpch_q20/duckdb:vortex-compact 1728512052 / 2262670137 / -23.6% 1972466359 / 2354248552 / -16.2% 0.88 / 0.96 / -8.8%
tpch_q21/duckdb:vortex-compact 2669838877 / 2365024490 / +12.9% 2668997772 / 2524357407 / +5.7% 1.00 / 0.94 / +6.8%
tpch_q22/duckdb:vortex-compact 632684779 / 503599476 / +25.6% 977646349 / 784086239 / +24.7% 0.65 / 0.64 / +0.8%
duckdb / parquet / ns (0.926x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 355856195 / 429976733 / -17.2% 534264680 / 917107256 / -41.7% 🟢 0.67 / 0.47 / +42.1%
tpch_q02/duckdb:parquet 859584102 / 885952098 / -3.0% 1084357698 / 1206492972 / -10.1% 0.79 / 0.73 / +8.0%
tpch_q03/duckdb:parquet 990417718 / 1047482422 / -5.4% 1504578383 / 1689350697 / -10.9% 0.66 / 0.62 / +6.2%
tpch_q04/duckdb:parquet 659062569 / 605506233 / +8.8% 648966134 / 908973496 / -28.6% 1.02 / 0.67 / +52.5%
tpch_q05/duckdb:parquet 1048270423 / 1185672093 / -11.6% 1343628845 / 1748956656 / -23.2% 0.78 / 0.68 / +15.1%
tpch_q06/duckdb:parquet 400804742 / 496938287 / -19.3% 367307767 / 490433895 / -25.1% 1.09 / 1.01 / +7.7%
tpch_q07/duckdb:parquet 991225105 / 1214278613 / -18.4% 987277234 / 1193738846 / -17.3% 1.00 / 1.02 / -1.3%
tpch_q08/duckdb:parquet 1298196065 / 1502101187 / -13.6% 1472271062 / 1673331050 / -12.0% 0.88 / 0.90 / -1.8%
tpch_q09/duckdb:parquet 1279174717 / 1602484011 / -20.2% 1539601978 / 1759476363 / -12.5% 0.83 / 0.91 / -8.8%
tpch_q10/duckdb:parquet 1874659537 / 2038670278 / -8.0% 2460694521 / 2220695689 / +10.8% 0.76 / 0.92 / -17.0%
tpch_q11/duckdb:parquet 517302662 / 552417026 / -6.4% 551496836 / 632354075 / -12.8% 0.94 / 0.87 / +7.4%
tpch_q12/duckdb:parquet 668547286 / 823945167 / -18.9% 1056964599 / 904396886 / +16.9% 0.63 / 0.91 / -30.6%
tpch_q13/duckdb:parquet 937372087 / 834205864 / +12.4% 1068577382 / 1159184982 / -7.8% 0.88 / 0.72 / +21.9%
tpch_q14/duckdb:parquet 699742409 / 851849683 / -17.9% 1148435307 / 751849070 / +52.7% 🔴 0.61 / 1.13 / -46.2%
tpch_q15/duckdb:parquet 488189532 / 498741101 / -2.1% 562416082 / 578891180 / -2.8% 0.87 / 0.86 / +0.8%
tpch_q16/duckdb:parquet 668661638 / 710935998 / -5.9% 786291141 / 636646505 / +23.5% 0.85 / 1.12 / -23.8%
tpch_q17/duckdb:parquet 650052802 / 810850688 / -19.8% 703663021 / 902593095 / -22.0% 0.92 / 0.90 / +2.8%
tpch_q18/duckdb:parquet 891115718 / 878265543 / +1.5% 906229972 / 890814141 / +1.7% 0.98 / 0.99 / -0.3%
tpch_q19/duckdb:parquet 861798693 / 892373963 / -3.4% 947073251 / 925432515 / +2.3% 0.91 / 0.96 / -5.6%
tpch_q20/duckdb:parquet 1202621272 / 1154695385 / +4.2% 1178501829 / 1336979564 / -11.9% 1.02 / 0.86 / +18.2%
tpch_q21/duckdb:parquet 1066862502 / 1020278227 / +4.6% 1660788886 / 977714084 / +69.9% 🔴 0.64 / 1.04 / -38.4%
tpch_q22/duckdb:parquet 828360816 / 765660297 / +8.2% 1010364191 / 898445528 / +12.5% 0.82 / 0.85 / -3.8%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.5%
Engines: random-access No clear signal (-4.5%, low confidence)
Vortex (geomean): hot 0.958x ➖
Parquet (geomean): hot 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.032x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 74265 / 70634 / +5.1%
random-access/arrow-tokio-local-disk-footer 169676 / 163556 / +3.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2446999 / 2591732 / -5.6%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 3386214 / 3370316 / +0.5%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 54438890 / 53884879 / +1.0%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 32843234 / 31783227 / +3.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk 63247 / 59644 / +6.0%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 108569 / 101835 / +6.6%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1167218 / 1096504 / +6.4%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1233396 / 1138831 / +8.3%
random-access/nested-structs/correlated/arrow-tokio-local-disk 57826 / 55944 / +3.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 100820 / 93672 / +7.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk 952104 / 907967 / +4.9%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 985878 / 940560 / +4.8%
random-access/taxi/correlated/arrow-tokio-local-disk 124724 / 119168 / +4.7%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 225145 / 215680 / +4.4%
random-access/taxi/uniform/arrow-tokio-local-disk 2859899 / 2961679 / -3.4%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2991812 / 3097818 / -3.4%
random-access / vortex-file-compressed / ns (0.958x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 237797 / 242717 / -2.0%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1245264 / 1262369 / -1.4%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1420872 / 1410820 / +0.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2710272 / 2731609 / -0.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk 235898 / 234198 / +0.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 369461 / 374801 / -1.4%
random-access/nested-lists/uniform/vortex-tokio-local-disk 727885 / 720840 / +1.0%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 969038 / 961269 / +0.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk 254067 / 273718 / -7.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 498113 / 532224 / -6.4%
random-access/nested-structs/uniform/vortex-tokio-local-disk 640422 / 671748 / -4.7%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 917305 / 942605 / -2.7%
random-access/taxi/correlated/vortex-tokio-local-disk 594646 / 663900 / -10.4% 🟢
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1356350 / 1428231 / -5.0%
random-access/taxi/uniform/vortex-tokio-local-disk 2457553 / 2657740 / -7.5%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3568332 / 3865870 / -7.7%
random-access/vortex-tokio-local-disk 386564 / 447784 / -13.7% 🟢
random-access/vortex-tokio-local-disk-footer 1012905 / 1080252 / -6.2%
random-access / parquet / ns (1.003x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107367197887 / 107296888354 / +0.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 107697848115 / 107945661931 / -0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 114074459271 / 106230716402 / +7.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 108006161945 / 114055086895 / -5.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk 144253814 / 147604458 / -2.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 148312025 / 144717343 / +2.5%
random-access/nested-lists/uniform/parquet-tokio-local-disk 144166009 / 144683562 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 145946329 / 144452322 / +1.0%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44010347 / 43951287 / +0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 44206381 / 44065534 / +0.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44008801 / 44021159 / -0.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 44205302 / 44451774 / -0.6%
random-access/parquet-tokio-local-disk 120164294 / 118945579 / +1.0%
random-access/parquet-tokio-local-disk-footer 118560026 / 118875244 / -0.3%
random-access/taxi/correlated/parquet-tokio-local-disk 180461862 / 178565734 / +1.1%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 178002199 / 178314986 / -0.2%
random-access/taxi/uniform/parquet-tokio-local-disk 190285318 / 192855389 / -1.3%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 193994494 / 188830906 / +2.7%
random-access / lance / ns (1.009x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 296644 / 298105 / -0.5%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1245798 / 1265322 / -1.5%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1023666 / 1040997 / -1.7%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2037123 / 1995658 / +2.1%
random-access/lance-tokio-local-disk 543955 / 521717 / +4.3%
random-access/lance-tokio-local-disk-footer 1484714 / 1487366 / -0.2%
random-access/nested-lists/correlated/lance-tokio-local-disk 159343 / 158074 / +0.8%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 742342 / 737972 / +0.6%
random-access/nested-lists/uniform/lance-tokio-local-disk 841570 / 843520 / -0.2%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1461715 / 1414194 / +3.4%
random-access/nested-structs/correlated/lance-tokio-local-disk 281392 / 271267 / +3.7%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 651809 / 642369 / +1.5%
random-access/nested-structs/uniform/lance-tokio-local-disk 2340464 / 2274912 / +2.9%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2759022 / 2733079 / +0.9%
random-access/taxi/correlated/lance-tokio-local-disk 758649 / 754676 / +0.5%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2039562 / 2056033 / -0.8%
random-access/taxi/uniform/lance-tokio-local-disk 8249873 / 8124235 / +1.5%
random-access/taxi/uniform/lance-tokio-local-disk-footer 9100502 / 9112620 / -0.1%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 5500ebbe vs base 46d518b4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.9%
Engines: random-access No clear signal (-2.9%, environment too noisy confidence)
Vortex (geomean): hot 1.059x ➖
Parquet (geomean): hot 1.090x ➖
Shifts: Parquet (control) +9.0% · Median polish +3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.059x ➖, 0↑ 3↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 56859380 / 41560720 / +36.8% 🔴
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 121276450 / 107664556 / +12.6%
random-access/feature-vectors/uniform/vortex-tokio-s3 228086138 / 270485608 / -15.7%
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 255670098 / 158454522 / +61.4% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3 47565414 / 56140913 / -15.3%
random-access/nested-lists/correlated/vortex-tokio-s3-footer 98901271 / 94524258 / +4.6%
random-access/nested-lists/uniform/vortex-tokio-s3 163267220 / 159919844 / +2.1%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 207757276 / 199121126 / +4.3%
random-access/nested-structs/correlated/vortex-tokio-s3 56521051 / 56429084 / +0.2%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 92280885 / 92240063 / +0.0%
random-access/nested-structs/uniform/vortex-tokio-s3 168727952 / 190596305 / -11.5%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 206185558 / 209289495 / -1.5%
random-access/taxi/correlated/vortex-tokio-s3 98994484 / 96928148 / +2.1%
random-access/taxi/correlated/vortex-tokio-s3-footer 138435572 / 132767134 / +4.3%
random-access/taxi/uniform/vortex-tokio-s3 186837134 / 181768981 / +2.8%
random-access/taxi/uniform/vortex-tokio-s3-footer 213615872 / 235270704 / -9.2%
random-access/vortex-tokio-s3 81073253 / 48755796 / +66.3% 🔴
random-access/vortex-tokio-s3-footer 99372217 / 101954654 / -2.5%
random-access / parquet / ns (1.090x ➖, 0↑ 3↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 182937946804 / 170848533466 / +7.1%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 179308534030 / 171193593992 / +4.7%
random-access/feature-vectors/uniform/parquet-tokio-s3 244644987298 / 166203570310 / +47.2% 🔴
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 188866373228 / 169350293147 / +11.5%
random-access/nested-lists/correlated/parquet-tokio-s3 1028847210 / 1033235167 / -0.4%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1138597063 / 1097622506 / +3.7%
random-access/nested-lists/uniform/parquet-tokio-s3 1049546782 / 1032410307 / +1.7%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1199504428 / 1113026346 / +7.8%
random-access/nested-structs/correlated/parquet-tokio-s3 453836740 / 451866379 / +0.4%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 534334617 / 532615977 / +0.3%
random-access/nested-structs/uniform/parquet-tokio-s3 457319689 / 461192397 / -0.8%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 547552843 / 530400083 / +3.2%
random-access/parquet-tokio-s3 498604178 / 494566105 / +0.8%
random-access/parquet-tokio-s3-footer 847502473 / 557756626 / +51.9% 🔴
random-access/taxi/correlated/parquet-tokio-s3 766530496 / 737091394 / +4.0%
random-access/taxi/correlated/parquet-tokio-s3-footer 1171570099 / 801661941 / +46.1% 🔴
random-access/taxi/uniform/parquet-tokio-s3 804195638 / 810743478 / -0.8%
random-access/taxi/uniform/parquet-tokio-s3-footer 892338764 / 932341450 / -4.3%
random-access / lance / ns (1.305x ❌, 0↑ 5↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 44322972 / 34881434 / +27.1%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 199317657 / 177815538 / +12.1%
random-access/feature-vectors/uniform/lance-tokio-s3 104643828 / 85882618 / +21.8%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 240835656 / 217575485 / +10.7%
random-access/lance-tokio-s3 60708990 / 58709765 / +3.4%
random-access/lance-tokio-s3-footer 295347961 / 265536409 / +11.2%
random-access/nested-lists/correlated/lance-tokio-s3 109414512 / 35274346 / +210.2% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer 396976033 / 211979933 / +87.3% 🔴
random-access/nested-lists/uniform/lance-tokio-s3 251833276 / 68811039 / +266.0% 🔴
random-access/nested-lists/uniform/lance-tokio-s3-footer 357241769 / 260120863 / +37.3% 🔴
random-access/nested-structs/correlated/lance-tokio-s3 53828992 / 49345012 / +9.1%
random-access/nested-structs/correlated/lance-tokio-s3-footer 261244222 / 224562482 / +16.3%
random-access/nested-structs/uniform/lance-tokio-s3 121886679 / 114467314 / +6.5%
random-access/nested-structs/uniform/lance-tokio-s3-footer 314065041 / 277313395 / +13.3%
random-access/taxi/correlated/lance-tokio-s3 85245406 / 58994895 / +44.5% 🔴
random-access/taxi/correlated/lance-tokio-s3-footer 270692965 / 255834494 / +5.8%
random-access/taxi/uniform/lance-tokio-s3 241758246 / 311332080 / -22.3%
random-access/taxi/uniform/lance-tokio-s3-footer 498512698 / 485372692 / +2.7%

Single-expression partitions are no longer wrapped in a one-field pack, and
repeated sub-expressions within a partition share one output. Struct field
projections therefore evaluate each field reader with its identity expression
and recombine via the existing get_item/pack optimizer rules, replacing the
reader-level FieldProjection fast path. The plan rewrites drop their
collapse-single-field-pack post-pass, and single boolean partitions keep their
Bool dtype.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FitS5Twto7znn1ek6JZKh6
@github-actions

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Oct 24, 2026

Copy link
Copy Markdown
Contributor Author

Closing as superseded and stale. The PR targets the old plan/plans layer and is several hundred commits behind develop. Its V2 equivalent is #10858 (one pack of column plans for a projection of fields), which is ported to ji/charming-cray-28l167.


Generated by Claude Code

@robert3005
robert3005 deleted the ji/struct-field-projection branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stale This PR is stale and will be auto-closed soon

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants