Skip to content

Drop null patch elements when sparse lists share their elements - #11182

Merged
mhk197 merged 1 commit into
developfrom
mk/sparse-list-empty-nulls
Nov 4, 2026
Merged

mhk197 merged 1 commit into
developfrom
mk/sparse-list-empty-nulls

Conversation

@mhk197

@mhk197 mhk197 commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Since #11173, sparse lists with a null or empty fill reuse the patch lists' elements in their output. When the patch lists are already zero-copy to a list, MakeExact only trims the ends, so null patch lists keep their elements. Those elements are exported and written.

This PR uses MakeExactWithEmptyNulls on the null or empty fill path so that null patches are lists of length 0.

Changes

  • The shared-elements path rebuilds the patch lists with MakeExactWithEmptyNulls.
  • If null lists hold nothing, the rebuild returns the array as is; otherwise the elements become a lazy filter over the ranges valid lists use.
  • empty_fill_reuses_elements test now uses a null patch with no elements.

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 marked this pull request as ready for review November 3, 2026 21:34
@mhk197 mhk197 added changelog/chore A trivial change changelog/performance A performance improvement and removed changelog/chore A trivial change labels Nov 3, 2026
@mhk197
mhk197 merged commit c9a3fbe into develop Nov 4, 2026
@mhk197
mhk197 deleted the mk/sparse-list-empty-nulls branch November 4, 2026 15:03
@mhk197 mhk197 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 4, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 4, 2026
@github-actions

ghost commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 496169f vortex-queries 1 Explore Profiling Data
🟢 Done 496169f clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 496169f clickbench-nvme 1 Explore Profiling Data
🟢 Done 496169f job-nvme 1 Explore Profiling Data
🟢 Done 496169f fineweb-s3 1 Explore Profiling Data
🟢 Done 496169f tpch-s3-10 1 Explore Profiling Data
🟢 Done 496169f tpch-nvme-10 1 Explore Profiling Data
🟢 Done 496169f tpch-nvme 1 Explore Profiling Data
🟢 Done 496169f fineweb 1 Explore Profiling Data
🟢 Done 496169f statpopgen 1 Explore Profiling Data
🟢 Done 496169f appian-nvme 1 Explore Profiling Data
🟢 Done 496169f tpcds-nvme 1 Explore Profiling Data
🟢 Done 496169f tpch-s3 1 Explore Profiling Data
🟢 Done 496169f polarsignals 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 496169f tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 496169fc vs base 22e02f18
Vortex (geomean): hot 1.002x ➖ · cold 0.858x ✅


datafusion / vortex-file-compressed / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 43958750 / 44327755 / -0.8% 84454545 / 96318687 / -12.3% 🟢 0.52 / 0.46 / +13.1%
polarsignals_q01/datafusion:vortex-file-compressed 69570774 / 69434110 / +0.2% 106647290 / 119774998 / -11.0% 🟢 0.65 / 0.58 / +12.5%
polarsignals_q02/datafusion:vortex-file-compressed 11916080 / 14184464 / -16.0% 🟢 40723313 / 48709381 / -16.4% 🟢 0.29 / 0.29 / +0.5%
polarsignals_q03/datafusion:vortex-file-compressed 70056240 / 54306222 / +29.0% 🔴 107099301 / 119135756 / -10.1% 🟢 0.65 / 0.46 / +43.5%
polarsignals_q04/datafusion:vortex-file-compressed 9156091 / 9187568 / -0.3% 36503688 / 46277172 / -21.1% 🟢 0.25 / 0.20 / +26.3%
polarsignals_q05/datafusion:vortex-file-compressed 11545594 / 11556270 / -0.1% 41931349 / 48747436 / -14.0% 🟢 0.28 / 0.24 / +16.1%
polarsignals_q06/datafusion:vortex-file-compressed 22643608 / 23074089 / -1.9% 51252948 / 58667591 / -12.6% 🟢 0.44 / 0.39 / +12.3%
polarsignals_q07/datafusion:vortex-file-compressed 10662087 / 10813247 / -1.4% 38215245 / 46119099 / -17.1% 🟢 0.28 / 0.23 / +19.0%
polarsignals_q08/datafusion:vortex-file-compressed 98667398 / 102943158 / -4.2% 153604856 / 162470088 / -5.5% 0.64 / 0.63 / +1.4%
polarsignals_q09/datafusion:vortex-file-compressed 10053898 / 9786696 / +2.7% 35322424 / 44651357 / -20.9% 🟢 0.28 / 0.22 / +29.9%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-2.2%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.970x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.979x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.983x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6048856 / 6073024 / -0.4% 21270096 / 20913645 / +1.7% 0.28 / 0.29 / -2.1%
fineweb_q01/datafusion:vortex-file-compressed 10105904 / 9367094 / +7.9% 36832312 / 43370783 / -15.1% 🟢 0.27 / 0.22 / +27.0%
fineweb_q02/datafusion:vortex-file-compressed 11296775 / 11640692 / -3.0% 42279863 / 41524841 / +1.8% 0.27 / 0.28 / -4.7%
fineweb_q03/datafusion:vortex-file-compressed 17895862 / 17091950 / +4.7% 101793887 / 105798210 / -3.8% 0.18 / 0.16 / +8.8%
fineweb_q04/datafusion:vortex-file-compressed 67469826 / 65253156 / +3.4% 142611137 / 144308423 / -1.2% 0.47 / 0.45 / +4.6%
fineweb_q05/datafusion:vortex-file-compressed 62991096 / 64924892 / -3.0% 135676414 / 134253575 / +1.1% 0.46 / 0.48 / -4.0%
fineweb_q06/datafusion:vortex-file-compressed 17349572 / 15986940 / +8.5% 100217400 / 106544556 / -5.9% 0.17 / 0.15 / +15.4%
fineweb_q07/datafusion:vortex-file-compressed 19516340 / 19592146 / -0.4% 97618364 / 103740532 / -5.9% 0.20 / 0.19 / +5.9%
fineweb_q08/datafusion:vortex-file-compressed 8894344 / 12313200 / -27.8% 🟢 32406058 / 28046356 / +15.5% 🔴 0.27 / 0.44 / -37.5%
datafusion / vortex-compact / ns (0.974x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 5995590 / 6161965 / -2.7% 19868497 / 20666320 / -3.9% 0.30 / 0.30 / +1.2%
fineweb_q01/datafusion:vortex-compact 102043536 / 102745826 / -0.7% 137254017 / 138736290 / -1.1% 0.74 / 0.74 / +0.4%
fineweb_q02/datafusion:vortex-compact 103298562 / 103479821 / -0.2% 135958409 / 132878258 / +2.3% 0.76 / 0.78 / -2.4%
fineweb_q03/datafusion:vortex-compact 177487320 / 177345448 / +0.1% 264552475 / 268919775 / -1.6% 0.67 / 0.66 / +1.7%
fineweb_q04/datafusion:vortex-compact 190883958 / 196818006 / -3.0% 257132930 / 323032687 / -20.4% 🟢 0.74 / 0.61 / +21.8%
fineweb_q05/datafusion:vortex-compact 179141742 / 180908976 / -1.0% 252163321 / 259434494 / -2.8% 0.71 / 0.70 / +1.9%
fineweb_q06/datafusion:vortex-compact 126959248 / 118273482 / +7.3% 195452169 / 199129706 / -1.8% 0.65 / 0.59 / +9.4%
fineweb_q07/datafusion:vortex-compact 123497700 / 126764335 / -2.6% 191325420 / 209977188 / -8.9% 0.65 / 0.60 / +6.9%
fineweb_q08/datafusion:vortex-compact 8510414 / 10426598 / -18.4% 🟢 36258143 / 29623295 / +22.4% 🔴 0.23 / 0.35 / -33.3%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9785666 / 9506028 / +2.9% 31466439 / 32605420 / -3.5% 0.31 / 0.29 / +6.7%
fineweb_q01/datafusion:parquet 74245072 / 74534338 / -0.4% 146774725 / 146820790 / -0.0% 0.51 / 0.51 / -0.4%
fineweb_q02/datafusion:parquet 75245742 / 74381419 / +1.2% 158037926 / 156698147 / +0.9% 0.48 / 0.47 / +0.3%
fineweb_q03/datafusion:parquet 74251718 / 74816424 / -0.8% 145696281 / 146841639 / -0.8% 0.51 / 0.51 / +0.0%
fineweb_q04/datafusion:parquet 81875418 / 81370274 / +0.6% 142638079 / 154071319 / -7.4% 0.57 / 0.53 / +8.7%
fineweb_q05/datafusion:parquet 80830894 / 81432622 / -0.7% 144412086 / 154669906 / -6.6% 0.56 / 0.53 / +6.3%
fineweb_q06/datafusion:parquet 75137310 / 74888920 / +0.3% 143843749 / 156068888 / -7.8% 0.52 / 0.48 / +8.9%
fineweb_q07/datafusion:parquet 74405985 / 74921872 / -0.7% 140784245 / 149342791 / -5.7% 0.53 / 0.50 / +5.3%
fineweb_q08/datafusion:parquet 72508736 / 73836644 / -1.8% 143259556 / 151787621 / -5.6% 0.51 / 0.49 / +4.0%
duckdb / vortex-file-compressed / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2130230 / 2051874 / +3.8% 7587967 / 8074032 / -6.0% 0.28 / 0.25 / +10.5%
fineweb_q01/duckdb:vortex-file-compressed 7536962 / 7915755 / -4.8% 25624539 / 27882678 / -8.1% 0.29 / 0.28 / +3.6%
fineweb_q02/duckdb:vortex-file-compressed 9058869 / 9623007 / -5.9% 26252044 / 30765238 / -14.7% 🟢 0.35 / 0.31 / +10.3%
fineweb_q03/duckdb:vortex-file-compressed 19405736 / 19579281 / -0.9% 87265010 / 99764467 / -12.5% 🟢 0.22 / 0.20 / +13.3%
fineweb_q04/duckdb:vortex-file-compressed 65794947 / 65823863 / -0.0% 102648040 / 104308813 / -1.6% 0.64 / 0.63 / +1.6%
fineweb_q05/duckdb:vortex-file-compressed 65073214 / 64802114 / +0.4% 101593700 / 103293449 / -1.6% 0.64 / 0.63 / +2.1%
fineweb_q06/duckdb:vortex-file-compressed 18007464 / 18470818 / -2.5% 87608345 / 91639641 / -4.4% 0.21 / 0.20 / +2.0%
fineweb_q07/duckdb:vortex-file-compressed 17890308 / 17532568 / +2.0% 86830187 / 88687401 / -2.1% 0.21 / 0.20 / +4.2%
fineweb_q08/duckdb:vortex-file-compressed 4590256 / 4803402 / -4.4% 13140230 / 12853468 / +2.2% 0.35 / 0.37 / -6.5%
duckdb / vortex-compact / ns (1.013x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2448474 / 2214517 / +10.6% 🔴 7326838 / 8563216 / -14.4% 🟢 0.33 / 0.26 / +29.2%
fineweb_q01/duckdb:vortex-compact 38817285 / 38490830 / +0.8% 56713610 / 56900499 / -0.3% 0.68 / 0.68 / +1.2%
fineweb_q02/duckdb:vortex-compact 40019056 / 39263819 / +1.9% 58421453 / 58350762 / +0.1% 0.69 / 0.67 / +1.8%
fineweb_q03/duckdb:vortex-compact 153752054 / 150690911 / +2.0% 180900899 / 182620697 / -0.9% 0.85 / 0.83 / +3.0%
fineweb_q04/duckdb:vortex-compact 159156730 / 159975997 / -0.5% 195705157 / 191164571 / +2.4% 0.81 / 0.84 / -2.8%
fineweb_q05/duckdb:vortex-compact 151536950 / 153036392 / -1.0% 188076642 / 187000892 / +0.6% 0.81 / 0.82 / -1.5%
fineweb_q06/duckdb:vortex-compact 83045073 / 82579084 / +0.6% 125091053 / 126603150 / -1.2% 0.66 / 0.65 / +1.8%
fineweb_q07/duckdb:vortex-compact 83907493 / 84216602 / -0.4% 125971222 / 124906624 / +0.9% 0.67 / 0.67 / -1.2%
fineweb_q08/duckdb:vortex-compact 4784584 / 4875750 / -1.9% 9810764 / 10564889 / -7.1% 0.49 / 0.46 / +5.7%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24162161 / 23827788 / +1.4% 28148389 / 28919565 / -2.7% 0.86 / 0.82 / +4.2%
fineweb_q01/duckdb:parquet 56166414 / 54790314 / +2.5% 76861748 / 74520692 / +3.1% 0.73 / 0.74 / -0.6%
fineweb_q02/duckdb:parquet 58771277 / 58342214 / +0.7% 73581026 / 76966202 / -4.4% 0.80 / 0.76 / +5.4%
fineweb_q03/duckdb:parquet 119281932 / 119421978 / -0.1% 180746598 / 180627035 / +0.1% 0.66 / 0.66 / -0.2%
fineweb_q04/duckdb:parquet 161760142 / 163453301 / -1.0% 209225281 / 202393577 / +3.4% 0.77 / 0.81 / -4.3%
fineweb_q05/duckdb:parquet 160710176 / 158840940 / +1.2% 201611046 / 197252759 / +2.2% 0.80 / 0.81 / -1.0%
fineweb_q06/duckdb:parquet 88297975 / 87371832 / +1.1% 143145155 / 146263433 / -2.1% 0.62 / 0.60 / +3.3%
fineweb_q07/duckdb:parquet 91239711 / 90338775 / +1.0% 147952981 / 145676037 / +1.6% 0.62 / 0.62 / -0.6%
fineweb_q08/duckdb:parquet 29313482 / 29259450 / +0.2% 30723347 / 30839314 / -0.4% 0.95 / 0.95 / +0.6%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.963x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15834363 / 15955034 / -0.8% 40653179 / 43725354 / -7.0% 0.39 / 0.36 / +6.7%
tpch_q02/datafusion:vortex-file-compressed 16954020 / 17040517 / -0.5% 33628213 / 36571270 / -8.0% 0.50 / 0.47 / +8.2%
tpch_q03/datafusion:vortex-file-compressed 19790744 / 19750329 / +0.2% 42722421 / 44627997 / -4.3% 0.46 / 0.44 / +4.7%
tpch_q04/datafusion:vortex-file-compressed 9981052 / 11127545 / -10.3% 🟢 33033837 / 34684157 / -4.8% 0.30 / 0.32 / -5.8%
tpch_q05/datafusion:vortex-file-compressed 37313075 / 37296118 / +0.0% 65027268 / 65011333 / +0.0% 0.57 / 0.57 / +0.0%
tpch_q06/datafusion:vortex-file-compressed 6026178 / 6246528 / -3.5% 26547708 / 28639069 / -7.3% 0.23 / 0.22 / +4.1%
tpch_q07/datafusion:vortex-file-compressed 51332612 / 51353846 / -0.0% 79405154 / 82597003 / -3.9% 0.65 / 0.62 / +4.0%
tpch_q08/datafusion:vortex-file-compressed 51995283 / 51504897 / +1.0% 82643330 / 81584992 / +1.3% 0.63 / 0.63 / -0.3%
tpch_q09/datafusion:vortex-file-compressed 48149093 / 47473166 / +1.4% 73307378 / 77807811 / -5.8% 0.66 / 0.61 / +7.7%
tpch_q10/datafusion:vortex-file-compressed 17162242 / 17255884 / -0.5% 48060076 / 50379011 / -4.6% 0.36 / 0.34 / +4.3%
tpch_q11/datafusion:vortex-file-compressed 14231309 / 14344411 / -0.8% 33079071 / 33197308 / -0.4% 0.43 / 0.43 / -0.4%
tpch_q12/datafusion:vortex-file-compressed 18541897 / 18453969 / +0.5% 40146458 / 44085603 / -8.9% 0.46 / 0.42 / +10.3%
tpch_q13/datafusion:vortex-file-compressed 19568227 / 19580501 / -0.1% 40109937 / 40423622 / -0.8% 0.49 / 0.48 / +0.7%
tpch_q14/datafusion:vortex-file-compressed 14382298 / 14692121 / -2.1% 35920148 / 36880541 / -2.6% 0.40 / 0.40 / +0.5%
tpch_q15/datafusion:vortex-file-compressed 18943828 / 18990179 / -0.2% 40627932 / 45367236 / -10.4% 🟢 0.47 / 0.42 / +11.4%
tpch_q16/datafusion:vortex-file-compressed 18459409 / 18467699 / -0.0% 37620846 / 38681106 / -2.7% 0.49 / 0.48 / +2.8%
tpch_q17/datafusion:vortex-file-compressed 28704281 / 28985782 / -1.0% 59281863 / 61289919 / -3.3% 0.48 / 0.47 / +2.4%
tpch_q18/datafusion:vortex-file-compressed 35605319 / 36119624 / -1.4% 58348443 / 60261225 / -3.2% 0.61 / 0.60 / +1.8%
tpch_q19/datafusion:vortex-file-compressed 11433868 / 11930446 / -4.2% 35054482 / 38797786 / -9.6% 0.33 / 0.31 / +6.1%
tpch_q20/datafusion:vortex-file-compressed 20229493 / 20215034 / +0.1% 41523813 / 45087840 / -7.9% 0.49 / 0.45 / +8.7%
tpch_q21/datafusion:vortex-file-compressed 39477424 / 39387808 / +0.2% 70038741 / 72441062 / -3.3% 0.56 / 0.54 / +3.7%
tpch_q22/datafusion:vortex-file-compressed 10712648 / 10824462 / -1.0% 29580130 / 31353119 / -5.7% 0.36 / 0.35 / +4.9%
datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16293681 / 16358132 / -0.4% 41955900 / 43088725 / -2.6% 0.39 / 0.38 / +2.3%
tpch_q02/datafusion:vortex-compact 18113197 / 18236595 / -0.7% 35679190 / 37229225 / -4.2% 0.51 / 0.49 / +3.6%
tpch_q03/datafusion:vortex-compact 20266298 / 20235801 / +0.2% 43969645 / 46312626 / -5.1% 0.46 / 0.44 / +5.5%
tpch_q04/datafusion:vortex-compact 11065960 / 11532630 / -4.0% 32824412 / 33113257 / -0.9% 0.34 / 0.35 / -3.2%
tpch_q05/datafusion:vortex-compact 37232597 / 37755411 / -1.4% 66086080 / 66596485 / -0.8% 0.56 / 0.57 / -0.6%
tpch_q06/datafusion:vortex-compact 7014447 / 6778417 / +3.5% 25506714 / 30298189 / -15.8% 🟢 0.28 / 0.22 / +22.9%
tpch_q07/datafusion:vortex-compact 52445286 / 53056873 / -1.2% 77202077 / 79289643 / -2.6% 0.68 / 0.67 / +1.5%
tpch_q08/datafusion:vortex-compact 52570164 / 51862782 / +1.4% 79625914 / 81994356 / -2.9% 0.66 / 0.63 / +4.4%
tpch_q09/datafusion:vortex-compact 49140329 / 49171067 / -0.1% 76538469 / 80646008 / -5.1% 0.64 / 0.61 / +5.3%
tpch_q10/datafusion:vortex-compact 18952832 / 18838656 / +0.6% 46816846 / 51474407 / -9.0% 0.40 / 0.37 / +10.6%
tpch_q11/datafusion:vortex-compact 14398018 / 14417575 / -0.1% 33264524 / 35272793 / -5.7% 0.43 / 0.41 / +5.9%
tpch_q12/datafusion:vortex-compact 19816689 / 19944185 / -0.6% 40653727 / 44109685 / -7.8% 0.49 / 0.45 / +7.8%
tpch_q13/datafusion:vortex-compact 20533883 / 20660882 / -0.6% 39204914 / 38232360 / +2.5% 0.52 / 0.54 / -3.1%
tpch_q14/datafusion:vortex-compact 15358436 / 15318150 / +0.3% 38262889 / 38769421 / -1.3% 0.40 / 0.40 / +1.6%
tpch_q15/datafusion:vortex-compact 20569230 / 20642937 / -0.4% 43289009 / 45397092 / -4.6% 0.48 / 0.45 / +4.5%
tpch_q16/datafusion:vortex-compact 19050817 / 18995801 / +0.3% 38048343 / 39052206 / -2.6% 0.50 / 0.49 / +2.9%
tpch_q17/datafusion:vortex-compact 29426104 / 28468788 / +3.4% 59907403 / 60825616 / -1.5% 0.49 / 0.47 / +4.9%
tpch_q18/datafusion:vortex-compact 36396383 / 36139910 / +0.7% 56427042 / 58941546 / -4.3% 0.65 / 0.61 / +5.2%
tpch_q19/datafusion:vortex-compact 13988787 / 13638211 / +2.6% 39772305 / 41153381 / -3.4% 0.35 / 0.33 / +6.1%
tpch_q20/datafusion:vortex-compact 21599583 / 21285126 / +1.5% 43889272 / 47058304 / -6.7% 0.49 / 0.45 / +8.8%
tpch_q21/datafusion:vortex-compact 41426522 / 40701979 / +1.8% 67454042 / 73182925 / -7.8% 0.61 / 0.56 / +10.4%
tpch_q22/datafusion:vortex-compact 11326774 / 11139970 / +1.7% 30032820 / 31313641 / -4.1% 0.38 / 0.36 / +6.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72016841 / 71957433 / +0.1% 87316308 / 90964744 / -4.0% 0.82 / 0.79 / +4.3%
tpch_q02/datafusion:parquet 75334232 / 75819049 / -0.6% 91502126 / 92460055 / -1.0% 0.82 / 0.82 / +0.4%
tpch_q03/datafusion:parquet 81958010 / 81898729 / +0.1% 103764583 / 103768784 / -0.0% 0.79 / 0.79 / +0.1%
tpch_q04/datafusion:parquet 39442508 / 39408685 / +0.1% 56158573 / 57894466 / -3.0% 0.70 / 0.68 / +3.2%
tpch_q05/datafusion:parquet 110105264 / 110482679 / -0.3% 135973604 / 138594289 / -1.9% 0.81 / 0.80 / +1.6%
tpch_q06/datafusion:parquet 31522617 / 31458437 / +0.2% 47124686 / 48684337 / -3.2% 0.67 / 0.65 / +3.5%
tpch_q07/datafusion:parquet 113913417 / 113067507 / +0.7% 134336006 / 139837889 / -3.9% 0.85 / 0.81 / +4.9%
tpch_q08/datafusion:parquet 117339843 / 117486747 / -0.1% 141073227 / 144522941 / -2.4% 0.83 / 0.81 / +2.3%
tpch_q09/datafusion:parquet 137525089 / 137968028 / -0.3% 164686355 / 164771682 / -0.1% 0.84 / 0.84 / -0.3%
tpch_q10/datafusion:parquet 103945015 / 103661847 / +0.3% 125326217 / 129561898 / -3.3% 0.83 / 0.80 / +3.7%
tpch_q11/datafusion:parquet 61338905 / 62672217 / -2.1% 80317328 / 82367617 / -2.5% 0.76 / 0.76 / +0.4%
tpch_q12/datafusion:parquet 64483100 / 64436862 / +0.1% 84926249 / 86285278 / -1.6% 0.76 / 0.75 / +1.7%
tpch_q13/datafusion:parquet 143300570 / 143291810 / +0.0% 159945089 / 164168118 / -2.6% 0.90 / 0.87 / +2.6%
tpch_q14/datafusion:parquet 47771358 / 47774129 / -0.0% 71690238 / 70045912 / +2.3% 0.67 / 0.68 / -2.3%
tpch_q15/datafusion:parquet 74889243 / 74544772 / +0.5% 92272394 / 97052833 / -4.9% 0.81 / 0.77 / +5.7%
tpch_q16/datafusion:parquet 43350893 / 43689964 / -0.8% 62657652 / 62582047 / +0.1% 0.69 / 0.70 / -0.9%
tpch_q17/datafusion:parquet 123078152 / 123905489 / -0.7% 143225830 / 146457907 / -2.2% 0.86 / 0.85 / +1.6%
tpch_q18/datafusion:parquet 120495962 / 121103496 / -0.5% 142166879 / 141534235 / +0.4% 0.85 / 0.86 / -0.9%
tpch_q19/datafusion:parquet 57656085 / 57093544 / +1.0% 82974609 / 83214653 / -0.3% 0.69 / 0.69 / +1.3%
tpch_q20/datafusion:parquet 77998509 / 78169665 / -0.2% 99645482 / 100977654 / -1.3% 0.78 / 0.77 / +1.1%
tpch_q21/datafusion:parquet 113758379 / 113919197 / -0.1% 138586441 / 138904869 / -0.2% 0.82 / 0.82 / +0.1%
tpch_q22/datafusion:parquet 51777700 / 52071167 / -0.6% 70059745 / 68719018 / +2.0% 0.74 / 0.76 / -2.5%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9455815 / 9549046 / -1.0% 19575816 / 19723996 / -0.8% 0.48 / 0.48 / -0.2%
tpch_q02/duckdb:vortex-file-compressed 15454624 / 15161327 / +1.9% 24757957 / 24764232 / -0.0% 0.62 / 0.61 / +2.0%
tpch_q03/duckdb:vortex-file-compressed 19120998 / 19190328 / -0.4% 34303788 / 33981592 / +0.9% 0.56 / 0.56 / -1.3%
tpch_q04/duckdb:vortex-file-compressed 12481865 / 12500970 / -0.2% 26224684 / 26312664 / -0.3% 0.48 / 0.48 / +0.2%
tpch_q05/duckdb:vortex-file-compressed 20280971 / 20184866 / +0.5% 35452621 / 36679432 / -3.3% 0.57 / 0.55 / +4.0%
tpch_q06/duckdb:vortex-file-compressed 4590632 / 4724563 / -2.8% 14138131 / 14693803 / -3.8% 0.32 / 0.32 / +1.0%
tpch_q07/duckdb:vortex-file-compressed 24277176 / 24552356 / -1.1% 39740119 / 41758291 / -4.8% 0.61 / 0.59 / +3.9%
tpch_q08/duckdb:vortex-file-compressed 21019505 / 21278443 / -1.2% 37406752 / 36634328 / +2.1% 0.56 / 0.58 / -3.3%
tpch_q09/duckdb:vortex-file-compressed 22745732 / 22794784 / -0.2% 38368684 / 39761282 / -3.5% 0.59 / 0.57 / +3.4%
tpch_q10/duckdb:vortex-file-compressed 27117456 / 27324714 / -0.8% 43643123 / 44042637 / -0.9% 0.62 / 0.62 / +0.1%
tpch_q11/duckdb:vortex-file-compressed 8079979 / 8475261 / -4.7% 17473309 / 17859937 / -2.2% 0.46 / 0.47 / -2.6%
tpch_q12/duckdb:vortex-file-compressed 14546756 / 14489419 / +0.4% 25413140 / 27175339 / -6.5% 0.57 / 0.53 / +7.4%
tpch_q13/duckdb:vortex-file-compressed 19559966 / 19613519 / -0.3% 32603747 / 31473158 / +3.6% 0.60 / 0.62 / -3.7%
tpch_q14/duckdb:vortex-file-compressed 11364141 / 11380852 / -0.1% 24125905 / 25493568 / -5.4% 0.47 / 0.45 / +5.5%
tpch_q15/duckdb:vortex-file-compressed 8686562 / 8773172 / -1.0% 18474464 / 21239230 / -13.0% 🟢 0.47 / 0.41 / +13.8%
tpch_q16/duckdb:vortex-file-compressed 16699158 / 16711195 / -0.1% 23184682 / 22963006 / +1.0% 0.72 / 0.73 / -1.0%
tpch_q17/duckdb:vortex-file-compressed 12721258 / 12635549 / +0.7% 27031865 / 27849159 / -2.9% 0.47 / 0.45 / +3.7%
tpch_q18/duckdb:vortex-file-compressed 24802800 / 24246194 / +2.3% 33264052 / 33445411 / -0.5% 0.75 / 0.72 / +2.9%
tpch_q19/duckdb:vortex-file-compressed 11940974 / 11898553 / +0.4% 25647976 / 28359465 / -9.6% 0.47 / 0.42 / +11.0%
tpch_q20/duckdb:vortex-file-compressed 14470641 / 14358242 / +0.8% 29268410 / 32825675 / -10.8% 🟢 0.49 / 0.44 / +13.0%
tpch_q21/duckdb:vortex-file-compressed 48739102 / 49093289 / -0.7% 64437677 / 65629416 / -1.8% 0.76 / 0.75 / +1.1%
tpch_q22/duckdb:vortex-file-compressed 16748960 / 16645156 / +0.6% 26265335 / 26562269 / -1.1% 0.64 / 0.63 / +1.8%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 10810583 / 10913790 / -0.9% 18544106 / 21544021 / -13.9% 🟢 0.58 / 0.51 / +15.1%
tpch_q02/duckdb:vortex-compact 18278505 / 18797758 / -2.8% 27510407 / 26715170 / +3.0% 0.66 / 0.70 / -5.6%
tpch_q03/duckdb:vortex-compact 20298222 / 20088917 / +1.0% 35693957 / 34823450 / +2.5% 0.57 / 0.58 / -1.4%
tpch_q04/duckdb:vortex-compact 13158671 / 13358325 / -1.5% 25140061 / 25407826 / -1.1% 0.52 / 0.53 / -0.4%
tpch_q05/duckdb:vortex-compact 20927623 / 20775683 / +0.7% 35521325 / 36124273 / -1.7% 0.59 / 0.58 / +2.4%
tpch_q06/duckdb:vortex-compact 5140415 / 5422303 / -5.2% 14233849 / 14801798 / -3.8% 0.36 / 0.37 / -1.4%
tpch_q07/duckdb:vortex-compact 26176798 / 25479968 / +2.7% 39223278 / 41038638 / -4.4% 0.67 / 0.62 / +7.5%
tpch_q08/duckdb:vortex-compact 22230113 / 21780455 / +2.1% 37748676 / 38477822 / -1.9% 0.59 / 0.57 / +4.0%
tpch_q09/duckdb:vortex-compact 23825641 / 24070279 / -1.0% 38796795 / 39753056 / -2.4% 0.61 / 0.61 / +1.4%
tpch_q10/duckdb:vortex-compact 30521739 / 30718768 / -0.6% 44979318 / 46909315 / -4.1% 0.68 / 0.65 / +3.6%
tpch_q11/duckdb:vortex-compact 8607623 / 8715178 / -1.2% 17876424 / 17890668 / -0.1% 0.48 / 0.49 / -1.2%
tpch_q12/duckdb:vortex-compact 17642098 / 17706612 / -0.4% 28720003 / 27156716 / +5.8% 0.61 / 0.65 / -5.8%
tpch_q13/duckdb:vortex-compact 20167396 / 19808519 / +1.8% 32739420 / 32211935 / +1.6% 0.62 / 0.61 / +0.2%
tpch_q14/duckdb:vortex-compact 12599083 / 12370457 / +1.8% 24490006 / 26661297 / -8.1% 0.51 / 0.46 / +10.9%
tpch_q15/duckdb:vortex-compact 9669846 / 9930363 / -2.6% 20363119 / 22925208 / -11.2% 🟢 0.47 / 0.43 / +9.6%
tpch_q16/duckdb:vortex-compact 17605570 / 17602316 / +0.0% 23345893 / 23580132 / -1.0% 0.75 / 0.75 / +1.0%
tpch_q17/duckdb:vortex-compact 13607235 / 14066025 / -3.3% 30604222 / 29109497 / +5.1% 0.44 / 0.48 / -8.0%
tpch_q18/duckdb:vortex-compact 24722668 / 24553720 / +0.7% 34482206 / 34458828 / +0.1% 0.72 / 0.71 / +0.6%
tpch_q19/duckdb:vortex-compact 15086787 / 15318764 / -1.5% 29018585 / 31730681 / -8.5% 0.52 / 0.48 / +7.7%
tpch_q20/duckdb:vortex-compact 17005039 / 16995421 / +0.1% 31784464 / 33507386 / -5.1% 0.54 / 0.51 / +5.5%
tpch_q21/duckdb:vortex-compact 49589385 / 49908900 / -0.6% 63719569 / 65159332 / -2.2% 0.78 / 0.77 / +1.6%
tpch_q22/duckdb:vortex-compact 19623039 / 19482144 / +0.7% 29056081 / 28968396 / +0.3% 0.68 / 0.67 / +0.4%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47719922 / 47516130 / +0.4% 53677883 / 54091120 / -0.8% 0.89 / 0.88 / +1.2%
tpch_q02/duckdb:parquet 48384201 / 48503503 / -0.2% 55201396 / 55388013 / -0.3% 0.88 / 0.88 / +0.1%
tpch_q03/duckdb:parquet 60495309 / 60205049 / +0.5% 67487492 / 69512857 / -2.9% 0.90 / 0.87 / +3.5%
tpch_q04/duckdb:parquet 34897361 / 34830351 / +0.2% 42942792 / 42875425 / +0.2% 0.81 / 0.81 / +0.0%
tpch_q05/duckdb:parquet 67192478 / 67386744 / -0.3% 76488198 / 77905718 / -1.8% 0.88 / 0.86 / +1.6%
tpch_q06/duckdb:parquet 21748965 / 21693306 / +0.3% 27657272 / 26742774 / +3.4% 0.79 / 0.81 / -3.1%
tpch_q07/duckdb:parquet 63892609 / 64029436 / -0.2% 73104781 / 72584417 / +0.7% 0.87 / 0.88 / -0.9%
tpch_q08/duckdb:parquet 75851898 / 75587262 / +0.4% 86239925 / 86937979 / -0.8% 0.88 / 0.87 / +1.2%
tpch_q09/duckdb:parquet 107883772 / 107802475 / +0.1% 118561238 / 119659867 / -0.9% 0.91 / 0.90 / +1.0%
tpch_q10/duckdb:parquet 105880994 / 105852868 / +0.0% 117500590 / 117811758 / -0.3% 0.90 / 0.90 / +0.3%
tpch_q11/duckdb:parquet 29466798 / 29455254 / +0.0% 34994966 / 34858525 / +0.4% 0.84 / 0.84 / -0.4%
tpch_q12/duckdb:parquet 37295936 / 37147809 / +0.4% 43791420 / 44366132 / -1.3% 0.85 / 0.84 / +1.7%
tpch_q13/duckdb:parquet 175559848 / 175219970 / +0.2% 181727366 / 181658305 / +0.0% 0.97 / 0.96 / +0.2%
tpch_q14/duckdb:parquet 42540545 / 42349397 / +0.5% 50411972 / 51085844 / -1.3% 0.84 / 0.83 / +1.8%
tpch_q15/duckdb:parquet 32646863 / 32730483 / -0.3% 40988762 / 41351095 / -0.9% 0.80 / 0.79 / +0.6%
tpch_q16/duckdb:parquet 47459449 / 47567572 / -0.2% 53126275 / 53197102 / -0.1% 0.89 / 0.89 / -0.1%
tpch_q17/duckdb:parquet 47881277 / 47926378 / -0.1% 57157605 / 57084599 / +0.1% 0.84 / 0.84 / -0.2%
tpch_q18/duckdb:parquet 74746457 / 73966225 / +1.1% 80766748 / 80276549 / +0.6% 0.93 / 0.92 / +0.4%
tpch_q19/duckdb:parquet 49109619 / 49773585 / -1.3% 53650226 / 56913836 / -5.7% 0.92 / 0.87 / +4.7%
tpch_q20/duckdb:parquet 63668969 / 63529711 / +0.2% 72552734 / 73678576 / -1.5% 0.88 / 0.86 / +1.8%
tpch_q21/duckdb:parquet 106496327 / 106477365 / +0.0% 115930512 / 116144914 / -0.2% 0.92 / 0.92 / +0.2%
tpch_q22/duckdb:parquet 50688980 / 50594351 / +0.2% 58491049 / 58652061 / -0.3% 0.87 / 0.86 / +0.5%
duckdb / duckdb / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6286055 / 6238408 / +0.8% 13890748 / 14185101 / -2.1% 0.45 / 0.44 / +2.9%
tpch_q02/duckdb:duckdb 8689905 / 8611795 / +0.9% 16073013 / 16510996 / -2.7% 0.54 / 0.52 / +3.7%
tpch_q03/duckdb:duckdb 15776749 / 15755170 / +0.1% 24424658 / 26019605 / -6.1% 0.65 / 0.61 / +6.7%
tpch_q04/duckdb:duckdb 11227900 / 11407770 / -1.6% 21291718 / 21218086 / +0.3% 0.53 / 0.54 / -1.9%
tpch_q05/duckdb:duckdb 15695260 / 15462254 / +1.5% 25664211 / 27535176 / -6.8% 0.61 / 0.56 / +8.9%
tpch_q06/duckdb:duckdb 3185170 / 3164945 / +0.6% 9111165 / 9792149 / -7.0% 0.35 / 0.32 / +8.2%
tpch_q07/duckdb:duckdb 18436389 / 18315359 / +0.7% 27502393 / 29265902 / -6.0% 0.67 / 0.63 / +7.1%
tpch_q08/duckdb:duckdb 17341387 / 17291753 / +0.3% 29143691 / 30827974 / -5.5% 0.60 / 0.56 / +6.1%
tpch_q09/duckdb:duckdb 23894754 / 23763452 / +0.6% 34728779 / 36683509 / -5.3% 0.69 / 0.65 / +6.2%
tpch_q10/duckdb:duckdb 28992351 / 30175738 / -3.9% 40394946 / 43075810 / -6.2% 0.72 / 0.70 / +2.5%
tpch_q11/duckdb:duckdb 5920975 / 5767552 / +2.7% 11731699 / 12241712 / -4.2% 0.50 / 0.47 / +7.1%
tpch_q12/duckdb:duckdb 10721918 / 10832030 / -1.0% 19749578 / 20522562 / -3.8% 0.54 / 0.53 / +2.9%
tpch_q13/duckdb:duckdb 32203568 / 32072301 / +0.4% 39273616 / 40608760 / -3.3% 0.82 / 0.79 / +3.8%
tpch_q14/duckdb:duckdb 12620758 / 12535645 / +0.7% 20706840 / 21542258 / -3.9% 0.61 / 0.58 / +4.7%
tpch_q15/duckdb:duckdb 6927942 / 6904400 / +0.3% 16156769 / 16336755 / -1.1% 0.43 / 0.42 / +1.5%
tpch_q16/duckdb:duckdb 19161342 / 19020597 / +0.7% 25039255 / 24955636 / +0.3% 0.77 / 0.76 / +0.4%
tpch_q17/duckdb:duckdb 8520480 / 8355071 / +2.0% 17291556 / 17259989 / +0.2% 0.49 / 0.48 / +1.8%
tpch_q18/duckdb:duckdb 18500651 / 18398297 / +0.6% 25147633 / 26602049 / -5.5% 0.74 / 0.69 / +6.4%
tpch_q19/duckdb:duckdb 12926717 / 12506549 / +3.4% 21376436 / 22072899 / -3.2% 0.60 / 0.57 / +6.7%
tpch_q20/duckdb:duckdb 14407728 / 14430036 / -0.2% 25906315 / 26934795 / -3.8% 0.56 / 0.54 / +3.8%
tpch_q21/duckdb:duckdb 21816705 / 22132527 / -1.4% 32195952 / 32513764 / -1.0% 0.68 / 0.68 / -0.5%
tpch_q22/duckdb:duckdb 23554055 / 23392696 / +0.7% 31692671 / 32071385 / -1.2% 0.74 / 0.73 / +1.9%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (-1.4%, low confidence) · DuckDB No clear signal (+3.4%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.021x ➖
Parquet (geomean): hot 0.988x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 175700739 / 180366706 / -2.6% 569997506 / 561976625 / +1.4% 0.31 / 0.32 / -4.0%
clickbench-sorted_q24/datafusion:vortex-file-compressed 9330454 / 9906464 / -5.8% 54334723 / 55020799 / -1.2% 0.17 / 0.18 / -4.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11020830 / 10696134 / +3.0% 54369334 / 54669724 / -0.5% 0.20 / 0.20 / +3.6%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22725982 / 24046075 / -5.5% 75929898 / 67755696 / +12.1% 🔴 0.30 / 0.35 / -15.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18451140 / 17977221 / +2.6% 66210248 / 62861852 / +5.3% 0.28 / 0.29 / -2.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed 12918275 / 12896397 / +0.2% 65555066 / 61924909 / +5.9% 0.20 / 0.21 / -5.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed 37342788 / 37374122 / -0.1% 95422559 / 97899816 / -2.5% 0.39 / 0.38 / +2.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 10955776 / 11265996 / -2.8% 44418418 / 45460208 / -2.3% 0.25 / 0.25 / -0.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11091670 / 11046682 / +0.4% 47369540 / 44947380 / +5.4% 0.23 / 0.25 / -4.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9477314 / 9484136 / -0.1% 37844138 / 37388763 / +1.2% 0.25 / 0.25 / -1.3%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 747167916 / 745327703 / +0.2% 952784503 / 946154151 / +0.7% 0.78 / 0.79 / -0.5%
clickbench-sorted_q24/datafusion:parquet 9046175 / 8855555 / +2.2% 73428720 / 72760768 / +0.9% 0.12 / 0.12 / +1.2%
clickbench-sorted_q26/datafusion:parquet 9244835 / 9108788 / +1.5% 72656345 / 71874015 / +1.1% 0.13 / 0.13 / +0.4%
clickbench-sorted_q36/datafusion:parquet 89893709 / 90322404 / -0.5% 164203777 / 169735547 / -3.3% 0.55 / 0.53 / +2.9%
clickbench-sorted_q37/datafusion:parquet 61172109 / 61299894 / -0.2% 127409358 / 126710032 / +0.6% 0.48 / 0.48 / -0.8%
clickbench-sorted_q38/datafusion:parquet 83702612 / 83488706 / +0.3% 159446486 / 157092994 / +1.5% 0.52 / 0.53 / -1.2%
clickbench-sorted_q39/datafusion:parquet 152695812 / 152081984 / +0.4% 229977307 / 228163093 / +0.8% 0.66 / 0.67 / -0.4%
clickbench-sorted_q40/datafusion:parquet 41476756 / 41987240 / -1.2% 110665543 / 110742762 / -0.1% 0.37 / 0.38 / -1.1%
clickbench-sorted_q41/datafusion:parquet 39072726 / 39311747 / -0.6% 108749786 / 107606468 / +1.1% 0.36 / 0.37 / -1.7%
clickbench-sorted_q42/datafusion:parquet 25168038 / 24956594 / +0.8% 87142704 / 85730235 / +1.6% 0.29 / 0.29 / -0.8%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 35690050 / 34917737 / +2.2% 71549391 / 73993591 / -3.3% 0.50 / 0.47 / +5.7%
clickbench-sorted_q24/duckdb:vortex-file-compressed 9526402 / 9473302 / +0.6% 31479487 / 29586273 / +6.4% 0.30 / 0.32 / -5.5%
clickbench-sorted_q26/duckdb:vortex-file-compressed 8455875 / 8500133 / -0.5% 31851598 / 32097470 / -0.8% 0.27 / 0.26 / +0.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 21948288 / 21727589 / +1.0% 49163979 / 46109135 / +6.6% 0.45 / 0.47 / -5.3%
clickbench-sorted_q37/duckdb:vortex-file-compressed 17088704 / 17448900 / -2.1% 42404550 / 42899685 / -1.2% 0.40 / 0.41 / -0.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18498029 / 18498108 / -0.0% 51019746 / 50707629 / +0.6% 0.36 / 0.36 / -0.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 41962730 / 42767891 / -1.9% 84996750 / 81850566 / +3.8% 0.49 / 0.52 / -5.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10806809 / 10573586 / +2.2% 36249751 / 34804427 / +4.2% 0.30 / 0.30 / -1.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11987990 / 12003803 / -0.1% 35828361 / 36428977 / -1.6% 0.33 / 0.33 / +1.5%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8903206 / 8863226 / +0.5% 30931050 / 29667455 / +4.3% 0.29 / 0.30 / -3.7%
duckdb / parquet / ns (0.974x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 141074431 / 147416013 / -4.3% 179175691 / 180914690 / -1.0% 0.79 / 0.81 / -3.4%
clickbench-sorted_q24/duckdb:parquet 15110150 / 15176534 / -0.4% 23914903 / 18564692 / +28.8% 🔴 0.63 / 0.82 / -22.7%
clickbench-sorted_q26/duckdb:parquet 15601238 / 17249791 / -9.6% 19460098 / 24279311 / -19.8% 🟢 0.80 / 0.71 / +12.8%
clickbench-sorted_q36/duckdb:parquet 47977680 / 46581670 / +3.0% 58937923 / 57653940 / +2.2% 0.81 / 0.81 / +0.8%
clickbench-sorted_q37/duckdb:parquet 35789396 / 38950785 / -8.1% 45675861 / 43842201 / +4.2% 0.78 / 0.89 / -11.8%
clickbench-sorted_q38/duckdb:parquet 42390860 / 42292116 / +0.2% 52829351 / 53127678 / -0.6% 0.80 / 0.80 / +0.8%
clickbench-sorted_q39/duckdb:parquet 74590434 / 76182147 / -2.1% 83252135 / 83345316 / -0.1% 0.90 / 0.91 / -2.0%
clickbench-sorted_q40/duckdb:parquet 22121536 / 22622028 / -2.2% 27448339 / 28075181 / -2.2% 0.81 / 0.81 / +0.0%
clickbench-sorted_q41/duckdb:parquet 23149306 / 23211269 / -0.3% 28933960 / 30565295 / -5.3% 0.80 / 0.76 / +5.4%
clickbench-sorted_q42/duckdb:parquet 16712224 / 17033870 / -1.9% 23863764 / 22687945 / +5.2% 0.70 / 0.75 / -6.7%
duckdb / duckdb / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 67401364 / 68235368 / -1.2% 121066420 / 119444611 / +1.4% 0.56 / 0.57 / -2.5%
clickbench-sorted_q24/duckdb:duckdb 23238846 / 22942751 / +1.3% 28409901 / 29960854 / -5.2% 0.82 / 0.77 / +6.8%
clickbench-sorted_q26/duckdb:duckdb 22999400 / 23084728 / -0.4% 31237376 / 31626698 / -1.2% 0.74 / 0.73 / +0.9%
clickbench-sorted_q36/duckdb:duckdb 41359200 / 39442057 / +4.9% 74805386 / 73521309 / +1.7% 0.55 / 0.54 / +3.1%
clickbench-sorted_q37/duckdb:duckdb 38883922 / 36435856 / +6.7% 77736443 / 78074652 / -0.4% 0.50 / 0.47 / +7.2%
clickbench-sorted_q38/duckdb:duckdb 30553681 / 29967739 / +2.0% 66713176 / 66032303 / +1.0% 0.46 / 0.45 / +0.9%
clickbench-sorted_q39/duckdb:duckdb 53528303 / 55833243 / -4.1% 110122867 / 110449936 / -0.3% 0.49 / 0.51 / -3.8%
clickbench-sorted_q40/duckdb:duckdb 21863780 / 21770896 / +0.4% 45771800 / 45743989 / +0.1% 0.48 / 0.48 / +0.4%
clickbench-sorted_q41/duckdb:duckdb 21021345 / 20750752 / +1.3% 39765516 / 38005759 / +4.6% 0.53 / 0.55 / -3.2%
clickbench-sorted_q42/duckdb:duckdb 16922870 / 16847174 / +0.4% 28480267 / 29322876 / -2.9% 0.59 / 0.57 / +3.4%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-2.6%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.022x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1800189 / 1795728 / +0.2% 6760716 / 7269835 / -7.0% 0.27 / 0.25 / +7.8%
statpopgen_q01/datafusion:vortex-file-compressed 3899392 / 4185982 / -6.8% 12826628 / 13132003 / -2.3% 0.30 / 0.32 / -4.6%
statpopgen_q02/datafusion:vortex-file-compressed 39060490 / 40226834 / -2.9% 64502200 / 64538829 / -0.1% 0.61 / 0.62 / -2.8%
statpopgen_q03/datafusion:vortex-file-compressed 122250626 / 116175764 / +5.2% 155845099 / 154164361 / +1.1% 0.78 / 0.75 / +4.1%
statpopgen_q04/datafusion:vortex-file-compressed 118856284 / 118870500 / -0.0% 157906864 / 154091096 / +2.5% 0.75 / 0.77 / -2.4%
statpopgen_q05/datafusion:vortex-file-compressed 69452662 / 68891940 / +0.8% 110395125 / 106529616 / +3.6% 0.63 / 0.65 / -2.7%
statpopgen_q06/datafusion:vortex-file-compressed 198040061 / 198744844 / -0.4% 230908142 / 245026365 / -5.8% 0.86 / 0.81 / +5.7%
statpopgen_q07/datafusion:vortex-file-compressed 281018422 / 281328008 / -0.1% 340369300 / 313483932 / +8.6% 0.83 / 0.90 / -8.0%
statpopgen_q08/datafusion:vortex-file-compressed 282958950 / 287055728 / -1.4% 317198365 / 318949147 / -0.5% 0.89 / 0.90 / -0.9%
statpopgen_q09/datafusion:vortex-file-compressed 97169600 / 96875915 / +0.3% 132655896 / 132834805 / -0.1% 0.73 / 0.73 / +0.4%
statpopgen_q10/datafusion:vortex-file-compressed 256605196 / 255341828 / +0.5% 298748143 / 298601059 / +0.0% 0.86 / 0.86 / +0.4%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1840654 / 1809284 / +1.7% 6736811 / 7088078 / -5.0% 0.27 / 0.26 / +7.0%
statpopgen_q01/datafusion:vortex-compact 4431906 / 4250901 / +4.3% 12876575 / 12670813 / +1.6% 0.34 / 0.34 / +2.6%
statpopgen_q02/datafusion:vortex-compact 42580150 / 43917304 / -3.0% 65454690 / 65265246 / +0.3% 0.65 / 0.67 / -3.3%
statpopgen_q03/datafusion:vortex-compact 123072890 / 119204938 / +3.2% 157585757 / 157947873 / -0.2% 0.78 / 0.75 / +3.5%
statpopgen_q04/datafusion:vortex-compact 119160374 / 117990136 / +1.0% 154089095 / 154139316 / -0.0% 0.77 / 0.77 / +1.0%
statpopgen_q05/datafusion:vortex-compact 72611892 / 74371624 / -2.4% 108441452 / 104807570 / +3.5% 0.67 / 0.71 / -5.6%
statpopgen_q06/datafusion:vortex-compact 198647965 / 196511260 / +1.1% 230671435 / 232023458 / -0.6% 0.86 / 0.85 / +1.7%
statpopgen_q07/datafusion:vortex-compact 351683385 / 353777543 / -0.6% 376562641 / 369369465 / +1.9% 0.93 / 0.96 / -2.5%
statpopgen_q08/datafusion:vortex-compact 359734904 / 362166078 / -0.7% 387729873 / 387027686 / +0.2% 0.93 / 0.94 / -0.9%
statpopgen_q09/datafusion:vortex-compact 99840766 / 99638167 / +0.2% 131754359 / 132455500 / -0.5% 0.76 / 0.75 / +0.7%
statpopgen_q10/datafusion:vortex-compact 255871296 / 261293252 / -2.1% 299960206 / 298476371 / +0.5% 0.85 / 0.88 / -2.6%
datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1968024 / 1945994 / +1.1% 90086527 / 91140369 / -1.2% 0.02 / 0.02 / +2.3%
statpopgen_q01/datafusion:parquet 164191011 / 163845832 / +0.2% 172629519 / 173401343 / -0.4% 0.95 / 0.94 / +0.7%
statpopgen_q02/datafusion:parquet 279805793 / 292575708 / -4.4% 417579961 / 419035438 / -0.3% 0.67 / 0.70 / -4.0%
statpopgen_q03/datafusion:parquet 385431482 / 390043294 / -1.2% 512873325 / 539179026 / -4.9% 0.75 / 0.72 / +3.9%
statpopgen_q04/datafusion:parquet 382030354 / 387339012 / -1.4% 512430880 / 482688973 / +6.2% 0.75 / 0.80 / -7.1%
statpopgen_q05/datafusion:parquet 315939474 / 323752700 / -2.4% 460374583 / 425544532 / +8.2% 0.69 / 0.76 / -9.8%
statpopgen_q06/datafusion:parquet 473718116 / 479028860 / -1.1% 634018880 / 634948852 / -0.1% 0.75 / 0.75 / -1.0%
statpopgen_q07/datafusion:parquet 421305319 / 425385926 / -1.0% 605510238 / 557149073 / +8.7% 0.70 / 0.76 / -8.9%
statpopgen_q08/datafusion:parquet 426024444 / 427477684 / -0.3% 546336907 / 551578317 / -1.0% 0.78 / 0.78 / +0.6%
statpopgen_q09/datafusion:parquet 365640629 / 361789594 / +1.1% 500013089 / 479670287 / +4.2% 0.73 / 0.75 / -3.0%
statpopgen_q10/datafusion:parquet 538394510 / 540813282 / -0.4% 707024676 / 675497703 / +4.7% 0.76 / 0.80 / -4.9%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12992020 / 12973154 / +0.1% 15004133 / 14988465 / +0.1% 0.87 / 0.87 / +0.0%
statpopgen_q01/duckdb:vortex-file-compressed 14141680 / 13671094 / +3.4% 18287628 / 18146963 / +0.8% 0.77 / 0.75 / +2.6%
statpopgen_q02/duckdb:vortex-file-compressed 129942755 / 135024282 / -3.8% 152624175 / 158803503 / -3.9% 0.85 / 0.85 / +0.1%
statpopgen_q03/duckdb:vortex-file-compressed 331466245 / 323007850 / +2.6% 355574705 / 353927706 / +0.5% 0.93 / 0.91 / +2.1%
statpopgen_q04/duckdb:vortex-file-compressed 321027114 / 323863982 / -0.9% 344279539 / 351784263 / -2.1% 0.93 / 0.92 / +1.3%
statpopgen_q05/duckdb:vortex-file-compressed 99651489 / 98787696 / +0.9% 128733364 / 125940009 / +2.2% 0.77 / 0.78 / -1.3%
statpopgen_q06/duckdb:vortex-file-compressed 226749382 / 224545748 / +1.0% 247102505 / 247555956 / -0.2% 0.92 / 0.91 / +1.2%
statpopgen_q07/duckdb:vortex-file-compressed 140080999 / 140595446 / -0.4% 164388301 / 164927566 / -0.3% 0.85 / 0.85 / -0.0%
statpopgen_q08/duckdb:vortex-file-compressed 150101376 / 148533452 / +1.1% 172760822 / 172346659 / +0.2% 0.87 / 0.86 / +0.8%
statpopgen_q09/duckdb:vortex-file-compressed 295905070 / 281784285 / +5.0% 315676016 / 301801660 / +4.6% 0.94 / 0.93 / +0.4%
statpopgen_q10/duckdb:vortex-file-compressed 763728946 / 804452434 / -5.1% 785080503 / 853870873 / -8.1% 0.97 / 0.94 / +3.3%
duckdb / vortex-compact / ns (0.986x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12943081 / 13014489 / -0.5% 14984205 / 14959144 / +0.2% 0.86 / 0.87 / -0.7%
statpopgen_q01/duckdb:vortex-compact 13908124 / 13890851 / +0.1% 18174616 / 17772177 / +2.3% 0.77 / 0.78 / -2.1%
statpopgen_q02/duckdb:vortex-compact 142728192 / 131658654 / +8.4% 159940631 / 155115361 / +3.1% 0.89 / 0.85 / +5.1%
statpopgen_q03/duckdb:vortex-compact 330867962 / 343951480 / -3.8% 352027216 / 361248113 / -2.6% 0.94 / 0.95 / -1.3%
statpopgen_q04/duckdb:vortex-compact 281947523 / 348365647 / -19.1% 🟢 349232575 / 362427078 / -3.6% 0.81 / 0.96 / -16.0%
statpopgen_q05/duckdb:vortex-compact 100056030 / 102353041 / -2.2% 123949991 / 121068175 / +2.4% 0.81 / 0.85 / -4.5%
statpopgen_q06/duckdb:vortex-compact 232120550 / 230249404 / +0.8% 255466822 / 249116490 / +2.5% 0.91 / 0.92 / -1.7%
statpopgen_q07/duckdb:vortex-compact 199062563 / 198573643 / +0.2% 218354716 / 211698556 / +3.1% 0.91 / 0.94 / -2.8%
statpopgen_q08/duckdb:vortex-compact 212059738 / 212521020 / -0.2% 235144148 / 221130822 / +6.3% 0.90 / 0.96 / -6.2%
statpopgen_q09/duckdb:vortex-compact 308244388 / 295497518 / +4.3% 330548086 / 318259132 / +3.9% 0.93 / 0.93 / +0.4%
statpopgen_q10/duckdb:vortex-compact 800803982 / 806229380 / -0.7% 809275554 / 847040672 / -4.5% 0.99 / 0.95 / +4.0%
duckdb / parquet / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 251540728 / 237954775 / +5.7% 249951260 / 238032920 / +5.0% 1.01 / 1.00 / +0.7%
statpopgen_q01/duckdb:parquet 307896216 / 296344554 / +3.9% 311485652 / 296761678 / +5.0% 0.99 / 1.00 / -1.0%
statpopgen_q02/duckdb:parquet 572194299 / 559708277 / +2.2% 561769120 / 558821512 / +0.5% 1.02 / 1.00 / +1.7%
statpopgen_q03/duckdb:parquet 778029912 / 754268764 / +3.2% 859294956 / 813680416 / +5.6% 0.91 / 0.93 / -2.3%
statpopgen_q04/duckdb:parquet 764975174 / 752625456 / +1.6% 795712493 / 823449763 / -3.4% 0.96 / 0.91 / +5.2%
statpopgen_q05/duckdb:parquet 540632872 / 539893051 / +0.1% 573940984 / 584434630 / -1.8% 0.94 / 0.92 / +2.0%
statpopgen_q06/duckdb:parquet 661761400 / 628486895 / +5.3% 715601497 / 676058469 / +5.8% 0.92 / 0.93 / -0.5%
statpopgen_q07/duckdb:parquet 567939919 / 557190865 / +1.9% 567650213 / 550051874 / +3.2% 1.00 / 1.01 / -1.2%
statpopgen_q08/duckdb:parquet 575158264 / 561154424 / +2.5% 570799961 / 561701367 / +1.6% 1.01 / 1.00 / +0.9%
statpopgen_q09/duckdb:parquet 723488520 / 715366430 / +1.1% 785344833 / 785407764 / -0.0% 0.92 / 0.91 / +1.1%
statpopgen_q10/duckdb:parquet 1071621066 / 1118774208 / -4.2% 1150057423 / 1097494593 / +4.8% 0.93 / 1.02 / -8.6%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.958x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.980x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 94697534 / 93333894 / +1.5% 150144473 / 144587114 / +3.8% 0.63 / 0.65 / -2.3%
tpch_q02/datafusion:vortex-file-compressed 64631251 / 64890172 / -0.4% 92655616 / 97403754 / -4.9% 0.70 / 0.67 / +4.7%
tpch_q03/datafusion:vortex-file-compressed 63410466 / 63018194 / +0.6% 123568582 / 129798659 / -4.8% 0.51 / 0.49 / +5.7%
tpch_q04/datafusion:vortex-file-compressed 34558078 / 34719342 / -0.5% 65637933 / 76185938 / -13.8% 🟢 0.53 / 0.46 / +15.5%
tpch_q05/datafusion:vortex-file-compressed 118360001 / 118268213 / +0.1% 172865556 / 184008874 / -6.1% 0.68 / 0.64 / +6.5%
tpch_q06/datafusion:vortex-file-compressed 10939247 / 10773579 / +1.5% 56974582 / 58434430 / -2.5% 0.19 / 0.18 / +4.1%
tpch_q07/datafusion:vortex-file-compressed 130084194 / 135216552 / -3.8% 197043366 / 197001060 / +0.0% 0.66 / 0.69 / -3.8%
tpch_q08/datafusion:vortex-file-compressed 144391063 / 143306691 / +0.8% 206524844 / 226159991 / -8.7% 0.70 / 0.63 / +10.3%
tpch_q09/datafusion:vortex-file-compressed 184110706 / 184181386 / -0.0% 261403132 / 264466929 / -1.2% 0.70 / 0.70 / +1.1%
tpch_q10/datafusion:vortex-file-compressed 69590866 / 69905900 / -0.5% 125276098 / 132469056 / -5.4% 0.56 / 0.53 / +5.3%
tpch_q11/datafusion:vortex-file-compressed 43507284 / 43555752 / -0.1% 63100634 / 70175401 / -10.1% 🟢 0.69 / 0.62 / +11.1%
tpch_q12/datafusion:vortex-file-compressed 35179464 / 35081189 / +0.3% 74052319 / 82291684 / -10.0% 🟢 0.48 / 0.43 / +11.4%
tpch_q13/datafusion:vortex-file-compressed 48914168 / 47936845 / +2.0% 79245610 / 82267589 / -3.7% 0.62 / 0.58 / +5.9%
tpch_q14/datafusion:vortex-file-compressed 21837352 / 21663537 / +0.8% 81643694 / 84752371 / -3.7% 0.27 / 0.26 / +4.6%
tpch_q15/datafusion:vortex-file-compressed 34453239 / 34220755 / +0.7% 86799689 / 94028344 / -7.7% 0.40 / 0.36 / +9.1%
tpch_q16/datafusion:vortex-file-compressed 37265083 / 37542338 / -0.7% 63575596 / 68896694 / -7.7% 0.59 / 0.54 / +7.6%
tpch_q17/datafusion:vortex-file-compressed 182666837 / 181042329 / +0.9% 229081890 / 230983088 / -0.8% 0.80 / 0.78 / +1.7%
tpch_q18/datafusion:vortex-file-compressed 205392989 / 207092876 / -0.8% 271085262 / 265030319 / +2.3% 0.76 / 0.78 / -3.0%
tpch_q19/datafusion:vortex-file-compressed 30058053 / 30443691 / -1.3% 86393434 / 86366003 / +0.0% 0.35 / 0.35 / -1.3%
tpch_q20/datafusion:vortex-file-compressed 60656522 / 60016500 / +1.1% 116562664 / 119997066 / -2.9% 0.52 / 0.50 / +4.0%
tpch_q21/datafusion:vortex-file-compressed 180608535 / 180463487 / +0.1% 235098595 / 246874171 / -4.8% 0.77 / 0.73 / +5.1%
tpch_q22/datafusion:vortex-file-compressed 25376180 / 24810837 / +2.3% 48209655 / 52072415 / -7.4% 0.53 / 0.48 / +10.5%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 102385468 / 101896248 / +0.5% 151752113 / 155149455 / -2.2% 0.67 / 0.66 / +2.7%
tpch_q02/datafusion:vortex-compact 65325718 / 64844686 / +0.7% 93191422 / 92124976 / +1.2% 0.70 / 0.70 / -0.4%
tpch_q03/datafusion:vortex-compact 67165312 / 67615245 / -0.7% 115461603 / 110620543 / +4.4% 0.58 / 0.61 / -4.8%
tpch_q04/datafusion:vortex-compact 38501349 / 38021519 / +1.3% 59610577 / 67598150 / -11.8% 🟢 0.65 / 0.56 / +14.8%
tpch_q05/datafusion:vortex-compact 119142600 / 119105261 / +0.0% 180925430 / 172151960 / +5.1% 0.66 / 0.69 / -4.8%
tpch_q06/datafusion:vortex-compact 15384421 / 15328414 / +0.4% 50868288 / 57006582 / -10.8% 🟢 0.30 / 0.27 / +12.5%
tpch_q07/datafusion:vortex-compact 139061192 / 141613707 / -1.8% 185509567 / 196320854 / -5.5% 0.75 / 0.72 / +3.9%
tpch_q08/datafusion:vortex-compact 143874795 / 143071557 / +0.6% 206977681 / 212607893 / -2.6% 0.70 / 0.67 / +3.3%
tpch_q09/datafusion:vortex-compact 186470236 / 186123979 / +0.2% 263045336 / 255615779 / +2.9% 0.71 / 0.73 / -2.6%
tpch_q10/datafusion:vortex-compact 78777056 / 79122472 / -0.4% 121262895 / 125391212 / -3.3% 0.65 / 0.63 / +3.0%
tpch_q11/datafusion:vortex-compact 43826704 / 43895625 / -0.2% 61279004 / 69063458 / -11.3% 🟢 0.72 / 0.64 / +12.5%
tpch_q12/datafusion:vortex-compact 47753362 / 47128953 / +1.3% 78038601 / 81931020 / -4.8% 0.61 / 0.58 / +6.4%
tpch_q13/datafusion:vortex-compact 56876600 / 57160089 / -0.5% 80773877 / 95682329 / -15.6% 🟢 0.70 / 0.60 / +17.9%
tpch_q14/datafusion:vortex-compact 25337577 / 27314411 / -7.2% 86803573 / 87819688 / -1.2% 0.29 / 0.31 / -6.2%
tpch_q15/datafusion:vortex-compact 47294438 / 47827505 / -1.1% 98359215 / 98220105 / +0.1% 0.48 / 0.49 / -1.3%
tpch_q16/datafusion:vortex-compact 39767250 / 39517141 / +0.6% 64050431 / 67728385 / -5.4% 0.62 / 0.58 / +6.4%
tpch_q17/datafusion:vortex-compact 177086235 / 179712276 / -1.5% 221658969 / 223887671 / -1.0% 0.80 / 0.80 / -0.5%
tpch_q18/datafusion:vortex-compact 208039706 / 206187745 / +0.9% 262340512 / 268825474 / -2.4% 0.79 / 0.77 / +3.4%
tpch_q19/datafusion:vortex-compact 36396501 / 36095102 / +0.8% 81271642 / 81498512 / -0.3% 0.45 / 0.44 / +1.1%
tpch_q20/datafusion:vortex-compact 66507020 / 66248453 / +0.4% 110540522 / 117485186 / -5.9% 0.60 / 0.56 / +6.7%
tpch_q21/datafusion:vortex-compact 186700073 / 186850933 / -0.1% 232235511 / 239484307 / -3.0% 0.80 / 0.78 / +3.0%
tpch_q22/datafusion:vortex-compact 26635504 / 26608785 / +0.1% 47966818 / 55371036 / -13.4% 🟢 0.56 / 0.48 / +15.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88053976 / 88130415 / -0.1% 121859612 / 127419701 / -4.4% 0.72 / 0.69 / +4.5%
tpch_q02/datafusion:parquet 173318499 / 175316187 / -1.1% 194872353 / 202205106 / -3.6% 0.89 / 0.87 / +2.6%
tpch_q03/datafusion:parquet 135792281 / 134582566 / +0.9% 176517310 / 179517812 / -1.7% 0.77 / 0.75 / +2.6%
tpch_q04/datafusion:parquet 57394985 / 57396990 / -0.0% 82876224 / 92198837 / -10.1% 🟢 0.69 / 0.62 / +11.2%
tpch_q05/datafusion:parquet 167171512 / 168125826 / -0.6% 225236956 / 226297815 / -0.5% 0.74 / 0.74 / -0.1%
tpch_q06/datafusion:parquet 37135720 / 36323335 / +2.2% 69501690 / 75809734 / -8.3% 0.53 / 0.48 / +11.5%
tpch_q07/datafusion:parquet 217696401 / 218416986 / -0.3% 272166228 / 268076017 / +1.5% 0.80 / 0.81 / -1.8%
tpch_q08/datafusion:parquet 217894290 / 218967218 / -0.5% 279694989 / 284954671 / -1.8% 0.78 / 0.77 / +1.4%
tpch_q09/datafusion:parquet 309631515 / 309298146 / +0.1% 372155183 / 370472528 / +0.5% 0.83 / 0.83 / -0.3%
tpch_q10/datafusion:parquet 311052811 / 312706810 / -0.5% 366827556 / 374234610 / -2.0% 0.85 / 0.84 / +1.5%
tpch_q11/datafusion:parquet 126333082 / 126830861 / -0.4% 145558463 / 151060058 / -3.6% 0.87 / 0.84 / +3.4%
tpch_q12/datafusion:parquet 83006564 / 82732434 / +0.3% 113154952 / 121740793 / -7.1% 0.73 / 0.68 / +7.9%
tpch_q13/datafusion:parquet 211382514 / 210248253 / +0.5% 234218853 / 241418913 / -3.0% 0.90 / 0.87 / +3.6%
tpch_q14/datafusion:parquet 85956500 / 86655989 / -0.8% 187670134 / 184927995 / +1.5% 0.46 / 0.47 / -2.3%
tpch_q15/datafusion:parquet 106387690 / 106277261 / +0.1% 152221934 / 156529917 / -2.8% 0.70 / 0.68 / +2.9%
tpch_q16/datafusion:parquet 95008714 / 96801119 / -1.9% 117358199 / 121408596 / -3.3% 0.81 / 0.80 / +1.5%
tpch_q17/datafusion:parquet 214522055 / 214376771 / +0.1% 255801074 / 268233946 / -4.6% 0.84 / 0.80 / +4.9%
tpch_q18/datafusion:parquet 269927154 / 268708282 / +0.5% 310250980 / 322047341 / -3.7% 0.87 / 0.83 / +4.3%
tpch_q19/datafusion:parquet 108457950 / 107982921 / +0.4% 162220993 / 172825709 / -6.1% 0.67 / 0.62 / +7.0%
tpch_q20/datafusion:parquet 185666909 / 186919317 / -0.7% 235547018 / 246113793 / -4.3% 0.79 / 0.76 / +3.8%
tpch_q21/datafusion:parquet 245027805 / 245444396 / -0.2% 306855749 / 312510628 / -1.8% 0.80 / 0.79 / +1.7%
tpch_q22/datafusion:parquet 150042381 / 150109460 / -0.0% 168182771 / 176622210 / -4.8% 0.89 / 0.85 / +5.0%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 34144553 / 32287534 / +5.8% 61373799 / 69378168 / -11.5% 🟢 0.56 / 0.47 / +19.5%
tpch_q02/duckdb:vortex-file-compressed 28697558 / 28512404 / +0.6% 44496180 / 43894992 / +1.4% 0.64 / 0.65 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 52503766 / 53108230 / -1.1% 99511508 / 102862383 / -3.3% 0.53 / 0.52 / +2.2%
tpch_q04/duckdb:vortex-file-compressed 51158019 / 51808879 / -1.3% 83213738 / 90396707 / -7.9% 0.61 / 0.57 / +7.3%
tpch_q05/duckdb:vortex-file-compressed 69060323 / 68087467 / +1.4% 106061826 / 111880399 / -5.2% 0.65 / 0.61 / +7.0%
tpch_q06/duckdb:vortex-file-compressed 15424198 / 15345105 / +0.5% 48153072 / 52249792 / -7.8% 0.32 / 0.29 / +9.1%
tpch_q07/duckdb:vortex-file-compressed 56057708 / 57026752 / -1.7% 103873932 / 111562581 / -6.9% 0.54 / 0.51 / +5.6%
tpch_q08/duckdb:vortex-file-compressed 85827364 / 85026764 / +0.9% 127054760 / 130682845 / -2.8% 0.68 / 0.65 / +3.8%
tpch_q09/duckdb:vortex-file-compressed 103241847 / 104221932 / -0.9% 155602272 / 160449754 / -3.0% 0.66 / 0.65 / +2.1%
tpch_q10/duckdb:vortex-file-compressed 96556092 / 96090534 / +0.5% 142456943 / 148876308 / -4.3% 0.68 / 0.65 / +5.0%
tpch_q11/duckdb:vortex-file-compressed 13362686 / 13197082 / +1.3% 28943862 / 29601627 / -2.2% 0.46 / 0.45 / +3.6%
tpch_q12/duckdb:vortex-file-compressed 45101994 / 45809630 / -1.5% 77900211 / 81442454 / -4.3% 0.58 / 0.56 / +2.9%
tpch_q13/duckdb:vortex-file-compressed 71212055 / 71561692 / -0.5% 93656202 / 101911748 / -8.1% 0.76 / 0.70 / +8.3%
tpch_q14/duckdb:vortex-file-compressed 28380535 / 28342208 / +0.1% 69589277 / 75220446 / -7.5% 0.41 / 0.38 / +8.2%
tpch_q15/duckdb:vortex-file-compressed 25074520 / 24748427 / +1.3% 60005600 / 63501777 / -5.5% 0.42 / 0.39 / +7.2%
tpch_q16/duckdb:vortex-file-compressed 49201752 / 48549466 / +1.3% 58939354 / 60427582 / -2.5% 0.83 / 0.80 / +3.9%
tpch_q17/duckdb:vortex-file-compressed 36099081 / 35060593 / +3.0% 66788701 / 68779943 / -2.9% 0.54 / 0.51 / +6.0%
tpch_q18/duckdb:vortex-file-compressed 104321484 / 109665256 / -4.9% 122462493 / 124371150 / -1.5% 0.85 / 0.88 / -3.4%
tpch_q19/duckdb:vortex-file-compressed 27784354 / 27729593 / +0.2% 72025191 / 74931709 / -3.9% 0.39 / 0.37 / +4.2%
tpch_q20/duckdb:vortex-file-compressed 42376457 / 41955292 / +1.0% 85797452 / 91611469 / -6.3% 0.49 / 0.46 / +7.8%
tpch_q21/duckdb:vortex-file-compressed 95073862 / 94310121 / +0.8% 142917183 / 148348836 / -3.7% 0.67 / 0.64 / +4.6%
tpch_q22/duckdb:vortex-file-compressed 33065984 / 33096578 / -0.1% 48515927 / 48426332 / +0.2% 0.68 / 0.68 / -0.3%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 47879838 / 46797594 / +2.3% 69353070 / 80073579 / -13.4% 🟢 0.69 / 0.58 / +18.1%
tpch_q02/duckdb:vortex-compact 31054452 / 31775181 / -2.3% 47359664 / 44682009 / +6.0% 0.66 / 0.71 / -7.8%
tpch_q03/duckdb:vortex-compact 57831105 / 57881145 / -0.1% 88911537 / 97620581 / -8.9% 0.65 / 0.59 / +9.7%
tpch_q04/duckdb:vortex-compact 54443316 / 53988898 / +0.8% 79301191 / 79899188 / -0.7% 0.69 / 0.68 / +1.6%
tpch_q05/duckdb:vortex-compact 71795910 / 72142845 / -0.5% 103599087 / 104109631 / -0.5% 0.69 / 0.69 / +0.0%
tpch_q06/duckdb:vortex-compact 19520826 / 20019791 / -2.5% 45669054 / 50302251 / -9.2% 0.43 / 0.40 / +7.4%
tpch_q07/duckdb:vortex-compact 63630058 / 63516269 / +0.2% 103154952 / 106417383 / -3.1% 0.62 / 0.60 / +3.3%
tpch_q08/duckdb:vortex-compact 87008677 / 88001662 / -1.1% 120725724 / 123980826 / -2.6% 0.72 / 0.71 / +1.5%
tpch_q09/duckdb:vortex-compact 109508791 / 109177081 / +0.3% 142398533 / 151945773 / -6.3% 0.77 / 0.72 / +7.0%
tpch_q10/duckdb:vortex-compact 105751096 / 103910790 / +1.8% 134377980 / 141384181 / -5.0% 0.79 / 0.73 / +7.1%
tpch_q11/duckdb:vortex-compact 14111537 / 14216085 / -0.7% 29423601 / 28626220 / +2.8% 0.48 / 0.50 / -3.4%
tpch_q12/duckdb:vortex-compact 59278858 / 59168608 / +0.2% 82610860 / 83566409 / -1.1% 0.72 / 0.71 / +1.3%
tpch_q13/duckdb:vortex-compact 77845031 / 77074304 / +1.0% 101578293 / 99910936 / +1.7% 0.77 / 0.77 / -0.7%
tpch_q14/duckdb:vortex-compact 33044676 / 33315384 / -0.8% 67441266 / 69346965 / -2.7% 0.49 / 0.48 / +2.0%
tpch_q15/duckdb:vortex-compact 31641445 / 31148421 / +1.6% 61078883 / 68043861 / -10.2% 🟢 0.52 / 0.46 / +13.2%
tpch_q16/duckdb:vortex-compact 49383449 / 50656755 / -2.5% 60108380 / 58722472 / +2.4% 0.82 / 0.86 / -4.8%
tpch_q17/duckdb:vortex-compact 37179266 / 36420975 / +2.1% 63996467 / 65748284 / -2.7% 0.58 / 0.55 / +4.9%
tpch_q18/duckdb:vortex-compact 105900374 / 111613372 / -5.1% 118666459 / 124100236 / -4.4% 0.89 / 0.90 / -0.8%
tpch_q19/duckdb:vortex-compact 35035834 / 34283314 / +2.2% 72183788 / 79435559 / -9.1% 0.49 / 0.43 / +12.5%
tpch_q20/duckdb:vortex-compact 53130912 / 52463910 / +1.3% 94227453 / 100123325 / -5.9% 0.56 / 0.52 / +7.6%
tpch_q21/duckdb:vortex-compact 104914786 / 105660549 / -0.7% 143932713 / 150766133 / -4.5% 0.73 / 0.70 / +4.0%
tpch_q22/duckdb:vortex-compact 35447515 / 35251849 / +0.6% 51480446 / 51586649 / -0.2% 0.69 / 0.68 / +0.8%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68032766 / 67498432 / +0.8% 91839809 / 91860677 / -0.0% 0.74 / 0.73 / +0.8%
tpch_q02/duckdb:parquet 87404582 / 87062005 / +0.4% 96829331 / 98539297 / -1.7% 0.90 / 0.88 / +2.2%
tpch_q03/duckdb:parquet 110332603 / 110590651 / -0.2% 143357098 / 145673175 / -1.6% 0.77 / 0.76 / +1.4%
tpch_q04/duckdb:parquet 76638889 / 76441935 / +0.3% 98318980 / 98857043 / -0.5% 0.78 / 0.77 / +0.8%
tpch_q05/duckdb:parquet 122230252 / 122158069 / +0.1% 161300613 / 158016703 / +2.1% 0.76 / 0.77 / -2.0%
tpch_q06/duckdb:parquet 35588203 / 34916470 / +1.9% 60735887 / 64528874 / -5.9% 0.59 / 0.54 / +8.3%
tpch_q07/duckdb:parquet 117308886 / 116185618 / +1.0% 159590542 / 156769706 / +1.8% 0.74 / 0.74 / -0.8%
tpch_q08/duckdb:parquet 147351238 / 149171388 / -1.2% 194627802 / 188556355 / +3.2% 0.76 / 0.79 / -4.3%
tpch_q09/duckdb:parquet 236559473 / 237544911 / -0.4% 280991067 / 286361920 / -1.9% 0.84 / 0.83 / +1.5%
tpch_q10/duckdb:parquet 313410280 / 315133924 / -0.5% 338295379 / 344360313 / -1.8% 0.93 / 0.92 / +1.2%
tpch_q11/duckdb:parquet 43620031 / 43370998 / +0.6% 50539833 / 50698056 / -0.3% 0.86 / 0.86 / +0.9%
tpch_q12/duckdb:parquet 71439973 / 71819844 / -0.5% 92309308 / 91619751 / +0.8% 0.77 / 0.78 / -1.3%
tpch_q13/duckdb:parquet 294551501 / 292392874 / +0.7% 311124287 / 310112127 / +0.3% 0.95 / 0.94 / +0.4%
tpch_q14/duckdb:parquet 101950555 / 102706728 / -0.7% 141686558 / 143555704 / -1.3% 0.72 / 0.72 / +0.6%
tpch_q15/duckdb:parquet 58092610 / 58329976 / -0.4% 87149369 / 87354321 / -0.2% 0.67 / 0.67 / -0.2%
tpch_q16/duckdb:parquet 100931054 / 99786275 / +1.1% 107234152 / 106762006 / +0.4% 0.94 / 0.93 / +0.7%
tpch_q17/duckdb:parquet 82443501 / 80737863 / +2.1% 115123079 / 120526647 / -4.5% 0.72 / 0.67 / +6.9%
tpch_q18/duckdb:parquet 160150227 / 154068036 / +3.9% 171487070 / 172264740 / -0.5% 0.93 / 0.89 / +4.4%
tpch_q19/duckdb:parquet 98168404 / 98570690 / -0.4% 138360936 / 136321389 / +1.5% 0.71 / 0.72 / -1.9%
tpch_q20/duckdb:parquet 146559018 / 146332612 / +0.2% 183119315 / 189695324 / -3.5% 0.80 / 0.77 / +3.8%
tpch_q21/duckdb:parquet 253835224 / 250643577 / +1.3% 277889755 / 273230385 / +1.7% 0.91 / 0.92 / -0.4%
tpch_q22/duckdb:parquet 168503828 / 168140489 / +0.2% 179409060 / 179347858 / +0.0% 0.94 / 0.94 / +0.2%
duckdb / duckdb / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 23868066 / 23589879 / +1.2% 51418639 / 53726100 / -4.3% 0.46 / 0.44 / +5.7%
tpch_q02/duckdb:duckdb 21120294 / 20307494 / +4.0% 32211801 / 33463545 / -3.7% 0.66 / 0.61 / +8.0%
tpch_q03/duckdb:duckdb 45498578 / 45394910 / +0.2% 74781492 / 76786148 / -2.6% 0.61 / 0.59 / +2.9%
tpch_q04/duckdb:duckdb 56165820 / 55707789 / +0.8% 76885367 / 82874269 / -7.2% 0.73 / 0.67 / +8.7%
tpch_q05/duckdb:duckdb 60581567 / 59668177 / +1.5% 93115925 / 91819628 / +1.4% 0.65 / 0.65 / +0.1%
tpch_q06/duckdb:duckdb 14780689 / 14880623 / -0.7% 44076089 / 42651465 / +3.3% 0.34 / 0.35 / -3.9%
tpch_q07/duckdb:duckdb 43278044 / 43340037 / -0.1% 82216526 / 79205630 / +3.8% 0.53 / 0.55 / -3.8%
tpch_q08/duckdb:duckdb 65645135 / 66154543 / -0.8% 104594146 / 106590676 / -1.9% 0.63 / 0.62 / +1.1%
tpch_q09/duckdb:duckdb 77012766 / 77265446 / -0.3% 112937296 / 116228092 / -2.8% 0.68 / 0.66 / +2.6%
tpch_q10/duckdb:duckdb 93016884 / 90994909 / +2.2% 119218213 / 123836686 / -3.7% 0.78 / 0.73 / +6.2%
tpch_q11/duckdb:duckdb 9912623 / 9740842 / +1.8% 17028106 / 17761780 / -4.1% 0.58 / 0.55 / +6.1%
tpch_q12/duckdb:duckdb 39402629 / 39484789 / -0.2% 69041875 / 71705707 / -3.7% 0.57 / 0.55 / +3.6%
tpch_q13/duckdb:duckdb 100807618 / 100317936 / +0.5% 111319046 / 114244242 / -2.6% 0.91 / 0.88 / +3.1%
tpch_q14/duckdb:duckdb 32267755 / 32399478 / -0.4% 66181928 / 68767524 / -3.8% 0.49 / 0.47 / +3.5%
tpch_q15/duckdb:duckdb 25355246 / 24795710 / +2.3% 51856043 / 57290771 / -9.5% 0.49 / 0.43 / +13.0%
tpch_q16/duckdb:duckdb 44962376 / 44851210 / +0.2% 51188394 / 51848487 / -1.3% 0.88 / 0.87 / +1.5%
tpch_q17/duckdb:duckdb 26176974 / 26207793 / -0.1% 58168125 / 59702845 / -2.6% 0.45 / 0.44 / +2.5%
tpch_q18/duckdb:duckdb 71334020 / 71059216 / +0.4% 92225274 / 92667516 / -0.5% 0.77 / 0.77 / +0.9%
tpch_q19/duckdb:duckdb 29349265 / 29302909 / +0.2% 64117332 / 68030186 / -5.8% 0.46 / 0.43 / +6.3%
tpch_q20/duckdb:duckdb 38099511 / 37908884 / +0.5% 77953595 / 81472054 / -4.3% 0.49 / 0.47 / +5.0%
tpch_q21/duckdb:duckdb 64091417 / 63257268 / +1.3% 93249528 / 93380243 / -0.1% 0.69 / 0.68 / +1.5%
tpch_q22/duckdb:duckdb 35807392 / 35447595 / +1.0% 45610833 / 45596442 / +0.0% 0.79 / 0.78 / +1.0%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.7%
Engines: DataFusion No clear signal (-3.8%, environment too noisy confidence) · DuckDB No clear signal (-5.5%, environment too noisy confidence)
Vortex (geomean): hot 1.007x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.056x ➖ · cold 1.104x ➖
Shifts: Parquet (control) +5.6% · Median polish +4.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 40832058 / 44712816 / -8.7% 178957783 / 184411563 / -3.0% 0.23 / 0.24 / -5.9%
fineweb_q01/datafusion:vortex-file-compressed 399381218 / 259523629 / +53.9% 🔴 647087048 / 633340421 / +2.2% 0.62 / 0.41 / +50.6%
fineweb_q02/datafusion:vortex-file-compressed 369780444 / 238110902 / +55.3% 🔴 500810769 / 463462065 / +8.1% 0.74 / 0.51 / +43.7%
fineweb_q03/datafusion:vortex-file-compressed 430089042 / 403054052 / +6.7% 513509435 / 504571026 / +1.8% 0.84 / 0.80 / +4.9%
fineweb_q04/datafusion:vortex-file-compressed 419838128 / 412001204 / +1.9% 504628048 / 448390957 / +12.5% 0.83 / 0.92 / -9.5%
fineweb_q05/datafusion:vortex-file-compressed 521727672 / 490865444 / +6.3% 583719263 / 488842626 / +19.4% 0.89 / 1.00 / -11.0%
fineweb_q06/datafusion:vortex-file-compressed 481744318 / 578250200 / -16.7% 495421602 / 558548445 / -11.3% 0.97 / 1.04 / -6.1%
fineweb_q07/datafusion:vortex-file-compressed 458890620 / 478974516 / -4.2% 463123693 / 491578639 / -5.8% 0.99 / 0.97 / +1.7%
fineweb_q08/datafusion:vortex-file-compressed 169567355 / 309285056 / -45.2% 🟢 185973008 / 549586209 / -66.2% 🟢 0.91 / 0.56 / +62.0%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 37092839 / 33250038 / +11.6% 102182009 / 173860938 / -41.2% 🟢 0.36 / 0.19 / +89.8%
fineweb_q01/datafusion:vortex-compact 374133638 / 335066194 / +11.7% 1106782651 / 733868638 / +50.8% 🔴 0.34 / 0.46 / -26.0%
fineweb_q02/datafusion:vortex-compact 341983220 / 372265524 / -8.1% 461218375 / 532216288 / -13.3% 0.74 / 0.70 / +6.0%
fineweb_q03/datafusion:vortex-compact 475675623 / 678702808 / -29.9% 650704385 / 663577500 / -1.9% 0.73 / 1.02 / -28.5%
fineweb_q04/datafusion:vortex-compact 480833460 / 556153074 / -13.5% 532495199 / 575838870 / -7.5% 0.90 / 0.97 / -6.5%
fineweb_q05/datafusion:vortex-compact 478448976 / 505123042 / -5.3% 491940097 / 591417630 / -16.8% 0.97 / 0.85 / +13.9%
fineweb_q06/datafusion:vortex-compact 764385198 / 631765996 / +21.0% 813835592 / 574973449 / +41.5% 🔴 0.94 / 1.10 / -14.5%
fineweb_q07/datafusion:vortex-compact 540647664 / 482494646 / +12.1% 630688590 / 507785048 / +24.2% 0.86 / 0.95 / -9.8%
fineweb_q08/datafusion:vortex-compact 164721166 / 142414890 / +15.7% 282714598 / 212445937 / +33.1% 🔴 0.58 / 0.67 / -13.1%
datafusion / parquet / ns (1.047x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 464129248 / 446766496 / +3.9% 878148419 / 774619272 / +13.4% 0.53 / 0.58 / -8.4%
fineweb_q01/datafusion:parquet 838819620 / 742129316 / +13.0% 1432500003 / 665248451 / +115.3% 🔴 0.59 / 1.12 / -47.5%
fineweb_q02/datafusion:parquet 850820070 / 758033612 / +12.2% 851462066 / 691112493 / +23.2% 1.00 / 1.10 / -8.9%
fineweb_q03/datafusion:parquet 734587588 / 753840810 / -2.6% 679535718 / 867540143 / -21.7% 1.08 / 0.87 / +24.4%
fineweb_q04/datafusion:parquet 966314614 / 815845986 / +18.4% 1048446148 / 680416093 / +54.1% 🔴 0.92 / 1.20 / -23.1%
fineweb_q05/datafusion:parquet 792066102 / 755631924 / +4.8% 737666816 / 900354561 / -18.1% 1.07 / 0.84 / +27.9%
fineweb_q06/datafusion:parquet 744877212 / 848764496 / -12.2% 668927121 / 885969739 / -24.5% 1.11 / 0.96 / +16.2%
fineweb_q07/datafusion:parquet 772503410 / 731701484 / +5.6% 780167672 / 778806908 / +0.2% 0.99 / 0.94 / +5.4%
fineweb_q08/datafusion:parquet 756303645 / 739631405 / +2.3% 726138229 / 681898155 / +6.5% 1.04 / 1.08 / -4.0%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 71062522 / 50247724 / +41.4% 🔴 121214277 / 60031123 / +101.9% 🔴 0.59 / 0.84 / -30.0%
fineweb_q01/duckdb:vortex-file-compressed 301202306 / 260255818 / +15.7% 474939839 / 383176683 / +23.9% 0.63 / 0.68 / -6.6%
fineweb_q02/duckdb:vortex-file-compressed 417330516 / 595254870 / -29.9% 361860830 / 358053812 / +1.1% 1.15 / 1.66 / -30.6%
fineweb_q03/duckdb:vortex-file-compressed 901559967 / 843025448 / +6.9% 957582782 / 1030966256 / -7.1% 0.94 / 0.82 / +15.1%
fineweb_q04/duckdb:vortex-file-compressed 891946210 / 922116778 / -3.3% 1015454559 / 1011649236 / +0.4% 0.88 / 0.91 / -3.6%
fineweb_q05/duckdb:vortex-file-compressed 886839672 / 927999672 / -4.4% 928955944 / 1045622559 / -11.2% 0.95 / 0.89 / +7.6%
fineweb_q06/duckdb:vortex-file-compressed 933464418 / 912955829 / +2.2% 975531836 / 994513271 / -1.9% 0.96 / 0.92 / +4.2%
fineweb_q07/duckdb:vortex-file-compressed 1004890886 / 937581377 / +7.2% 914911162 / 995530734 / -8.1% 1.10 / 0.94 / +16.6%
fineweb_q08/duckdb:vortex-file-compressed 193644014 / 193890581 / -0.1% 222808189 / 221501931 / +0.6% 0.87 / 0.88 / -0.7%
duckdb / vortex-compact / ns (0.990x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 80625356 / 72613304 / +11.0% 88660193 / 108496546 / -18.3% 0.91 / 0.67 / +35.9%
fineweb_q01/duckdb:vortex-compact 308584194 / 289265472 / +6.7% 428165990 / 367923677 / +16.4% 0.72 / 0.79 / -8.3%
fineweb_q02/duckdb:vortex-compact 460981762 / 342536440 / +34.6% 🔴 511493388 / 373406572 / +37.0% 🔴 0.90 / 0.92 / -1.8%
fineweb_q03/duckdb:vortex-compact 895730010 / 842375338 / +6.3% 1003806706 / 918409849 / +9.3% 0.89 / 0.92 / -2.7%
fineweb_q04/duckdb:vortex-compact 867048608 / 889315367 / -2.5% 1165900827 / 954968909 / +22.1% 0.74 / 0.93 / -20.1%
fineweb_q05/duckdb:vortex-compact 885161040 / 847688044 / +4.4% 905611114 / 871310998 / +3.9% 0.98 / 0.97 / +0.5%
fineweb_q06/duckdb:vortex-compact 865104706 / 951577692 / -9.1% 926745485 / 900529955 / +2.9% 0.93 / 1.06 / -11.7%
fineweb_q07/duckdb:vortex-compact 835092998 / 845765540 / -1.3% 863224708 / 888331406 / -2.8% 0.97 / 0.95 / +1.6%
fineweb_q08/duckdb:vortex-compact 214557152 / 364937190 / -41.2% 🟢 173353022 / 524531480 / -67.0% 🟢 1.24 / 0.70 / +77.9%
duckdb / parquet / ns (1.066x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 317835807 / 305230392 / +4.1% 412862752 / 374928703 / +10.1% 0.77 / 0.81 / -5.4%
fineweb_q01/duckdb:parquet 550217783 / 519724098 / +5.9% 573546059 / 401916119 / +42.7% 🔴 0.96 / 1.29 / -25.8%
fineweb_q02/duckdb:parquet 549832168 / 554757484 / -0.9% 720956780 / 615651394 / +17.1% 0.76 / 0.90 / -15.4%
fineweb_q03/duckdb:parquet 791771647 / 786287562 / +0.7% 944331682 / 813257843 / +16.1% 0.84 / 0.97 / -13.3%
fineweb_q04/duckdb:parquet 877373362 / 772157966 / +13.6% 851707853 / 793157945 / +7.4% 1.03 / 0.97 / +5.8%
fineweb_q05/duckdb:parquet 787978771 / 842864282 / -6.5% 799651902 / 809809354 / -1.3% 0.99 / 1.04 / -5.3%
fineweb_q06/duckdb:parquet 736402710 / 737970016 / -0.2% 810408790 / 779431534 / +4.0% 0.91 / 0.95 / -4.0%
fineweb_q07/duckdb:parquet 781768637 / 740559224 / +5.6% 817238625 / 799265941 / +2.2% 0.96 / 0.93 / +3.2%
fineweb_q08/duckdb:parquet 425335618 / 295118879 / +44.1% 🔴 390667786 / 380190831 / +2.8% 1.09 / 0.78 / +40.3%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 53316103 / 51065980 / +4.4% 81398795 / 79184312 / +2.8% 0.65 / 0.64 / +1.6%
appian_q02/datafusion:vortex-file-compressed 228363249 / 229884447 / -0.7% 279837571 / 270187414 / +3.6% 0.82 / 0.85 / -4.1%
appian_q03/datafusion:vortex-file-compressed 141493037 / 142031166 / -0.4% 186989441 / 189625346 / -1.4% 0.76 / 0.75 / +1.0%
appian_q04/datafusion:vortex-file-compressed 9654776261 / 9622071162 / +0.3% 9755375851 / 9650415327 / +1.1% 0.99 / 1.00 / -0.7%
appian_q05/datafusion:vortex-file-compressed 132866450 / 132267273 / +0.5% 168024624 / 170577546 / -1.5% 0.79 / 0.78 / +2.0%
appian_q06/datafusion:vortex-file-compressed 139850821 / 141107815 / -0.9% 165901748 / 168962489 / -1.8% 0.84 / 0.84 / +0.9%
appian_q07/datafusion:vortex-file-compressed 156154508 / 155918468 / +0.2% 202558957 / 203983840 / -0.7% 0.77 / 0.76 / +0.9%
appian_q08/datafusion:vortex-file-compressed 522118375 / 523648462 / -0.3% 576184851 / 597945400 / -3.6% 0.91 / 0.88 / +3.5%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71504401 / 72257847 / -1.0% 90431571 / 92975441 / -2.7% 0.79 / 0.78 / +1.7%
appian_q02/datafusion:parquet 289762423 / 292173553 / -0.8% 331918059 / 329673482 / +0.7% 0.87 / 0.89 / -1.5%
appian_q03/datafusion:parquet 183787747 / 183787993 / -0.0% 222864713 / 231475795 / -3.7% 0.82 / 0.79 / +3.9%
appian_q04/datafusion:parquet 9703180097 / 9648238976 / +0.6% 9772257502 / 9764865079 / +0.1% 0.99 / 0.99 / +0.5%
appian_q05/datafusion:parquet 190514963 / 192330583 / -0.9% 219882058 / 218238631 / +0.8% 0.87 / 0.88 / -1.7%
appian_q06/datafusion:parquet 166977947 / 167035105 / -0.0% 192405728 / 190412340 / +1.0% 0.87 / 0.88 / -1.1%
appian_q07/datafusion:parquet 204558811 / 206344283 / -0.9% 240555816 / 238131567 / +1.0% 0.85 / 0.87 / -1.9%
appian_q08/datafusion:parquet 627971207 / 628900533 / -0.1% 687127476 / 692719739 / -0.8% 0.91 / 0.91 / +0.7%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 83469470 / 83731036 / -0.3% 96412783 / 97006094 / -0.6% 0.87 / 0.86 / +0.3%
appian_q02/duckdb:vortex-file-compressed 233306557 / 233763415 / -0.2% 249982075 / 261401948 / -4.4% 0.93 / 0.89 / +4.4%
appian_q03/duckdb:vortex-file-compressed 112406062 / 113104179 / -0.6% 132250688 / 131926956 / +0.2% 0.85 / 0.86 / -0.9%
appian_q04/duckdb:vortex-file-compressed 616694129 / 619525094 / -0.5% 644038533 / 641308825 / +0.4% 0.96 / 0.97 / -0.9%
appian_q05/duckdb:vortex-file-compressed 118992604 / 118118151 / +0.7% 130711693 / 132269117 / -1.2% 0.91 / 0.89 / +1.9%
appian_q06/duckdb:vortex-file-compressed 196012209 / 196094568 / -0.0% 196905959 / 211988670 / -7.1% 1.00 / 0.93 / +7.6%
appian_q07/duckdb:vortex-file-compressed 118767769 / 116181326 / +2.2% 127697138 / 131400392 / -2.8% 0.93 / 0.88 / +5.2%
appian_q08/duckdb:vortex-file-compressed 341488164 / 340115034 / +0.4% 344269744 / 356939467 / -3.5% 0.99 / 0.95 / +4.1%
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 93748496 / 93837677 / -0.1% 100364182 / 101390422 / -1.0% 0.93 / 0.93 / +0.9%
appian_q02/duckdb:parquet 241137331 / 238617214 / +1.1% 248726318 / 252933392 / -1.7% 0.97 / 0.94 / +2.8%
appian_q03/duckdb:parquet 131356127 / 129088537 / +1.8% 140348622 / 140402269 / -0.0% 0.94 / 0.92 / +1.8%
appian_q04/duckdb:parquet 491314231 / 488392163 / +0.6% 494611204 / 484699767 / +2.0% 0.99 / 1.01 / -1.4%
appian_q05/duckdb:parquet 130086703 / 129370162 / +0.6% 137798979 / 139640059 / -1.3% 0.94 / 0.93 / +1.9%
appian_q06/duckdb:parquet 114956367 / 114186701 / +0.7% 120825490 / 120147588 / +0.6% 0.95 / 0.95 / +0.1%
appian_q07/duckdb:parquet 107653871 / 108427137 / -0.7% 120077457 / 115303567 / +4.1% 0.90 / 0.94 / -4.7%
appian_q08/duckdb:parquet 360139779 / 357360917 / +0.8% 358052409 / 350545940 / +2.1% 1.01 / 1.02 / -1.3%
duckdb / duckdb / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 79836026 / 78501071 / +1.7% 89858928 / 91361754 / -1.6% 0.89 / 0.86 / +3.4%
appian_q02/duckdb:duckdb 213681170 / 214612556 / -0.4% 233353703 / 220511061 / +5.8% 0.92 / 0.97 / -5.9%
appian_q03/duckdb:duckdb 84072470 / 83826650 / +0.3% 90849170 / 91969562 / -1.2% 0.93 / 0.91 / +1.5%
appian_q04/duckdb:duckdb 549890515 / 549186614 / +0.1% 547639206 / 570796179 / -4.1% 1.00 / 0.96 / +4.4%
appian_q05/duckdb:duckdb 107205158 / 106321496 / +0.8% 117645053 / 122371226 / -3.9% 0.91 / 0.87 / +4.9%
appian_q06/duckdb:duckdb 187664462 / 184128627 / +1.9% 194805765 / 193636699 / +0.6% 0.96 / 0.95 / +1.3%
appian_q07/duckdb:duckdb 87183143 / 87860767 / -0.8% 98239520 / 99784653 / -1.5% 0.89 / 0.88 / +0.8%
appian_q08/duckdb:duckdb 314288175 / 306373335 / +2.6% 317960926 / 315302568 / +0.8% 0.99 / 0.97 / +1.7%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.975x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1263062 / 1251038 / +1.0% 21685549 / 23388326 / -7.3% 0.06 / 0.05 / +8.9%
clickbench_q01/datafusion:vortex-file-compressed 6150805 / 6671868 / -7.8% 29181813 / 30106995 / -3.1% 0.21 / 0.22 / -4.9%
clickbench_q02/datafusion:vortex-file-compressed 10265653 / 10535223 / -2.6% 49101072 / 46430880 / +5.8% 0.21 / 0.23 / -7.9%
clickbench_q03/datafusion:vortex-file-compressed 13232630 / 13650316 / -3.1% 54561809 / 57102642 / -4.4% 0.24 / 0.24 / +1.5%
clickbench_q04/datafusion:vortex-file-compressed 58117200 / 58887615 / -1.3% 101394282 / 100716609 / +0.7% 0.57 / 0.58 / -2.0%
clickbench_q05/datafusion:vortex-file-compressed 77830116 / 76914796 / +1.2% 130993910 / 129124874 / +1.4% 0.59 / 0.60 / -0.3%
clickbench_q06/datafusion:vortex-file-compressed 1277310 / 1262308 / +1.2% 20880123 / 22953918 / -9.0% 0.06 / 0.05 / +11.2%
clickbench_q07/datafusion:vortex-file-compressed 9284193 / 9709446 / -4.4% 33728205 / 34840915 / -3.2% 0.28 / 0.28 / -1.2%
clickbench_q08/datafusion:vortex-file-compressed 79356759 / 78769592 / +0.7% 122872288 / 125534641 / -2.1% 0.65 / 0.63 / +2.9%
clickbench_q09/datafusion:vortex-file-compressed 174025182 / 170402084 / +2.1% 217194848 / 220161471 / -1.3% 0.80 / 0.77 / +3.5%
clickbench_q10/datafusion:vortex-file-compressed 23447268 / 23715367 / -1.1% 67774418 / 73338768 / -7.6% 0.35 / 0.32 / +7.0%
clickbench_q11/datafusion:vortex-file-compressed 26063230 / 26221523 / -0.6% 69969146 / 73645679 / -5.0% 0.37 / 0.36 / +4.6%
clickbench_q12/datafusion:vortex-file-compressed 73010930 / 72812212 / +0.3% 121445596 / 126266041 / -3.8% 0.60 / 0.58 / +4.3%
clickbench_q13/datafusion:vortex-file-compressed 117022784 / 118471482 / -1.2% 183842740 / 183939831 / -0.1% 0.64 / 0.64 / -1.2%
clickbench_q14/datafusion:vortex-file-compressed 74445854 / 74935672 / -0.7% 126360045 / 126012579 / +0.3% 0.59 / 0.59 / -0.9%
clickbench_q15/datafusion:vortex-file-compressed 62801104 / 62981420 / -0.3% 99924625 / 104351500 / -4.2% 0.63 / 0.60 / +4.1%
clickbench_q16/datafusion:vortex-file-compressed 155160360 / 155884254 / -0.5% 212867977 / 215934890 / -1.4% 0.73 / 0.72 / +1.0%
clickbench_q17/datafusion:vortex-file-compressed 153575892 / 154790532 / -0.8% 221447513 / 226365552 / -2.2% 0.69 / 0.68 / +1.4%
clickbench_q18/datafusion:vortex-file-compressed 299162466 / 292160200 / +2.4% 378469279 / 380757956 / -0.6% 0.79 / 0.77 / +3.0%
clickbench_q19/datafusion:vortex-file-compressed 8295596 / 8265854 / +0.4% 45986611 / 48428658 / -5.0% 0.18 / 0.17 / +5.7%
clickbench_q20/datafusion:vortex-file-compressed 68818346 / 69082940 / -0.4% 254965200 / 252056531 / +1.2% 0.27 / 0.27 / -1.5%
clickbench_q21/datafusion:vortex-file-compressed 79055962 / 78617448 / +0.6% 282735030 / 289710470 / -2.4% 0.28 / 0.27 / +3.0%
clickbench_q22/datafusion:vortex-file-compressed 93009368 / 92775071 / +0.3% 401232104 / 395097278 / +1.6% 0.23 / 0.23 / -1.3%
clickbench_q23/datafusion:vortex-file-compressed 189116808 / 184420078 / +2.5% 559807463 / 544518979 / +2.8% 0.34 / 0.34 / -0.3%
clickbench_q24/datafusion:vortex-file-compressed 15830668 / 16247230 / -2.6% 62757844 / 70990749 / -11.6% 🟢 0.25 / 0.23 / +10.2%
clickbench_q25/datafusion:vortex-file-compressed 19884633 / 19549382 / +1.7% 64411428 / 65288775 / -1.3% 0.31 / 0.30 / +3.1%
clickbench_q26/datafusion:vortex-file-compressed 16743442 / 17314149 / -3.3% 67074560 / 71600807 / -6.3% 0.25 / 0.24 / +3.2%
clickbench_q27/datafusion:vortex-file-compressed 101941468 / 100740173 / +1.2% 253457832 / 256824754 / -1.3% 0.40 / 0.39 / +2.5%
clickbench_q28/datafusion:vortex-file-compressed 558685788 / 570033986 / -2.0% 642135350 / 649657824 / -1.2% 0.87 / 0.88 / -0.8%
clickbench_q29/datafusion:vortex-file-compressed 24155012 / 24478926 / -1.3% 57315552 / 55881044 / +2.6% 0.42 / 0.44 / -3.8%
clickbench_q30/datafusion:vortex-file-compressed 56745996 / 57490084 / -1.3% 109302642 / 117062567 / -6.6% 0.52 / 0.49 / +5.7%
clickbench_q31/datafusion:vortex-file-compressed 67034906 / 66725002 / +0.5% 155459707 / 166473170 / -6.6% 0.43 / 0.40 / +7.6%
clickbench_q32/datafusion:vortex-file-compressed 290744785 / 289878580 / +0.3% 388241769 / 391608436 / -0.9% 0.75 / 0.74 / +1.2%
clickbench_q33/datafusion:vortex-file-compressed 321731922 / 325650909 / -1.2% 428161147 / 436234141 / -1.9% 0.75 / 0.75 / +0.7%
clickbench_q34/datafusion:vortex-file-compressed 321485654 / 319208700 / +0.7% 428722171 / 439961061 / -2.6% 0.75 / 0.73 / +3.4%
clickbench_q35/datafusion:vortex-file-compressed 56936447 / 57839366 / -1.6% 92578679 / 93226457 / -0.7% 0.62 / 0.62 / -0.9%
clickbench_q36/datafusion:vortex-file-compressed 37998608 / 37745588 / +0.7% 65797540 / 69721737 / -5.6% 0.58 / 0.54 / +6.7%
clickbench_q37/datafusion:vortex-file-compressed 21292914 / 21372779 / -0.4% 46515285 / 48104002 / -3.3% 0.46 / 0.44 / +3.0%
clickbench_q38/datafusion:vortex-file-compressed 13254404 / 13410148 / -1.2% 40087389 / 42126784 / -4.8% 0.33 / 0.32 / +3.9%
clickbench_q39/datafusion:vortex-file-compressed 79542387 / 79240056 / +0.4% 110637611 / 113013772 / -2.1% 0.72 / 0.70 / +2.5%
clickbench_q40/datafusion:vortex-file-compressed 10334990 / 10509014 / -1.7% 34186318 / 36771967 / -7.0% 0.30 / 0.29 / +5.8%
clickbench_q41/datafusion:vortex-file-compressed 9943380 / 10291524 / -3.4% 33750154 / 36892337 / -8.5% 0.29 / 0.28 / +5.6%
clickbench_q42/datafusion:vortex-file-compressed 10456632 / 10076038 / +3.8% 35840815 / 36258824 / -1.2% 0.29 / 0.28 / +5.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1275088 / 1245404 / +2.4% 50466422 / 51795133 / -2.6% 0.03 / 0.02 / +5.1%
clickbench_q01/datafusion:parquet 16170232 / 15827375 / +2.2% 75340617 / 66630797 / +13.1% 🔴 0.21 / 0.24 / -9.6%
clickbench_q02/datafusion:parquet 18790734 / 19001452 / -1.1% 83210502 / 83251120 / -0.0% 0.23 / 0.23 / -1.1%
clickbench_q03/datafusion:parquet 17608640 / 17175166 / +2.5% 81181741 / 82753651 / -1.9% 0.22 / 0.21 / +4.5%
clickbench_q04/datafusion:parquet 63222884 / 63729738 / -0.8% 129363906 / 130399003 / -0.8% 0.49 / 0.49 / -0.0%
clickbench_q05/datafusion:parquet 88381361 / 89094702 / -0.8% 158568200 / 159095464 / -0.3% 0.56 / 0.56 / -0.5%
clickbench_q06/datafusion:parquet 1293366 / 1234242 / +4.8% 49849352 / 51825327 / -3.8% 0.03 / 0.02 / +8.9%
clickbench_q07/datafusion:parquet 16873530 / 17032274 / -0.9% 68676472 / 70378014 / -2.4% 0.25 / 0.24 / +1.5%
clickbench_q08/datafusion:parquet 85544298 / 86027972 / -0.6% 163405233 / 166984172 / -2.1% 0.52 / 0.52 / +1.6%
clickbench_q09/datafusion:parquet 192240161 / 192276886 / -0.0% 269903994 / 275649588 / -2.1% 0.71 / 0.70 / +2.1%
clickbench_q10/datafusion:parquet 36280164 / 36234946 / +0.1% 99041357 / 104756083 / -5.5% 0.37 / 0.35 / +5.9%
clickbench_q11/datafusion:parquet 43188545 / 42605906 / +1.4% 112121065 / 113797724 / -1.5% 0.39 / 0.37 / +2.9%
clickbench_q12/datafusion:parquet 97382339 / 96750346 / +0.7% 164092748 / 164940962 / -0.5% 0.59 / 0.59 / +1.2%
clickbench_q13/datafusion:parquet 148319612 / 150254668 / -1.3% 228097157 / 230805501 / -1.2% 0.65 / 0.65 / -0.1%
clickbench_q14/datafusion:parquet 102439488 / 101834993 / +0.6% 175362367 / 176199896 / -0.5% 0.58 / 0.58 / +1.1%
clickbench_q15/datafusion:parquet 73318144 / 73027595 / +0.4% 130492498 / 132841877 / -1.8% 0.56 / 0.55 / +2.2%
clickbench_q16/datafusion:parquet 158163487 / 158093803 / +0.0% 235137760 / 238717381 / -1.5% 0.67 / 0.66 / +1.6%
clickbench_q17/datafusion:parquet 157868037 / 156776182 / +0.7% 236015692 / 236353736 / -0.1% 0.67 / 0.66 / +0.8%
clickbench_q18/datafusion:parquet 311945108 / 311438886 / +0.2% 417459972 / 419589788 / -0.5% 0.75 / 0.74 / +0.7%
clickbench_q19/datafusion:parquet 19482538 / 19462650 / +0.1% 75638886 / 77709014 / -2.7% 0.26 / 0.25 / +2.8%
clickbench_q20/datafusion:parquet 179980495 / 178910062 / +0.6% 275710827 / 300154034 / -8.1% 0.65 / 0.60 / +9.5%
clickbench_q21/datafusion:parquet 174112932 / 173673738 / +0.3% 290492299 / 314616147 / -7.7% 0.60 / 0.55 / +8.6%
clickbench_q22/datafusion:parquet 262769020 / 261626773 / +0.4% 416260204 / 455639795 / -8.6% 0.63 / 0.57 / +9.9%
clickbench_q23/datafusion:parquet 1010705780 / 1009416824 / +0.1% 1196169669 / 1181551399 / +1.2% 0.84 / 0.85 / -1.1%
clickbench_q24/datafusion:parquet 30252442 / 30548342 / -1.0% 89423701 / 93340871 / -4.2% 0.34 / 0.33 / +3.4%
clickbench_q25/datafusion:parquet 37290735 / 37514038 / -0.6% 99938604 / 103797759 / -3.7% 0.37 / 0.36 / +3.2%
clickbench_q26/datafusion:parquet 30956362 / 30759312 / +0.6% 88100740 / 92950510 / -5.2% 0.35 / 0.33 / +6.2%
clickbench_q27/datafusion:parquet 192912099 / 193533283 / -0.3% 285875717 / 305605252 / -6.5% 0.67 / 0.63 / +6.6%
clickbench_q28/datafusion:parquet 620027218 / 621943104 / -0.3% 699291615 / 716125944 / -2.4% 0.89 / 0.87 / +2.1%
clickbench_q29/datafusion:parquet 28604604 / 29130846 / -1.8% 89986221 / 91322046 / -1.5% 0.32 / 0.32 / -0.3%
clickbench_q30/datafusion:parquet 89409304 / 90263073 / -0.9% 167133245 / 179131201 / -6.7% 0.53 / 0.50 / +6.2%
clickbench_q31/datafusion:parquet 103515010 / 105138032 / -1.5% 193020963 / 204682994 / -5.7% 0.54 / 0.51 / +4.4%
clickbench_q32/datafusion:parquet 310613533 / 307399440 / +1.0% 431515514 / 434129459 / -0.6% 0.72 / 0.71 / +1.7%
clickbench_q33/datafusion:parquet 380355872 / 380305616 / +0.0% 475644115 / 478693364 / -0.6% 0.80 / 0.79 / +0.7%
clickbench_q34/datafusion:parquet 376475719 / 376350142 / +0.0% 471850828 / 482689679 / -2.2% 0.80 / 0.78 / +2.3%
clickbench_q35/datafusion:parquet 65127868 / 64109394 / +1.6% 125886517 / 124769577 / +0.9% 0.52 / 0.51 / +0.7%
clickbench_q36/datafusion:parquet 73951512 / 74134422 / -0.2% 135653547 / 137134940 / -1.1% 0.55 / 0.54 / +0.8%
clickbench_q37/datafusion:parquet 35729254 / 35831282 / -0.3% 91970473 / 92401933 / -0.5% 0.39 / 0.39 / +0.2%
clickbench_q38/datafusion:parquet 48004356 / 48073340 / -0.1% 108066433 / 110604170 / -2.3% 0.44 / 0.43 / +2.2%
clickbench_q39/datafusion:parquet 144507052 / 144415158 / +0.1% 208154505 / 212585615 / -2.1% 0.69 / 0.68 / +2.2%
clickbench_q40/datafusion:parquet 20249884 / 20219932 / +0.1% 76682575 / 78483385 / -2.3% 0.26 / 0.26 / +2.5%
clickbench_q41/datafusion:parquet 19200864 / 18821729 / +2.0% 77104150 / 75963639 / +1.5% 0.25 / 0.25 / +0.5%
clickbench_q42/datafusion:parquet 19330892 / 19381488 / -0.3% 76011181 / 75358808 / +0.9% 0.25 / 0.26 / -1.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2284314 / 2201907 / +3.7% 24193580 / 23602474 / +2.5% 0.09 / 0.09 / +1.2%
clickbench_q01/duckdb:vortex-file-compressed 7670570 / 7622836 / +0.6% 29582139 / 29483977 / +0.3% 0.26 / 0.26 / +0.3%
clickbench_q02/duckdb:vortex-file-compressed 9031828 / 9053353 / -0.2% 32789174 / 36436339 / -10.0% 🟢 0.28 / 0.25 / +10.9%
clickbench_q03/duckdb:vortex-file-compressed 13998048 / 13909394 / +0.6% 47375189 / 52198741 / -9.2% 0.30 / 0.27 / +10.9%
clickbench_q04/duckdb:vortex-file-compressed 56523693 / 57135545 / -1.1% 91229174 / 90363638 / +1.0% 0.62 / 0.63 / -2.0%
clickbench_q05/duckdb:vortex-file-compressed 64343528 / 64727771 / -0.6% 95932018 / 95236486 / +0.7% 0.67 / 0.68 / -1.3%
clickbench_q06/duckdb:vortex-file-compressed 2613925 / 2712878 / -3.6% 30211602 / 29657152 / +1.9% 0.09 / 0.09 / -5.4%
clickbench_q07/duckdb:vortex-file-compressed 9512164 / 9666324 / -1.6% 29440456 / 29701466 / -0.9% 0.32 / 0.33 / -0.7%
clickbench_q08/duckdb:vortex-file-compressed 70714588 / 68984398 / +2.5% 103130657 / 103977903 / -0.8% 0.69 / 0.66 / +3.4%
clickbench_q09/duckdb:vortex-file-compressed 95741372 / 90710968 / +5.5% 128509962 / 127297767 / +1.0% 0.75 / 0.71 / +4.5%
clickbench_q10/duckdb:vortex-file-compressed 27722848 / 27679821 / +0.2% 65891427 / 72194679 / -8.7% 0.42 / 0.38 / +9.7%
clickbench_q11/duckdb:vortex-file-compressed 30696107 / 30413870 / +0.9% 66424334 / 73907839 / -10.1% 🟢 0.46 / 0.41 / +12.3%
clickbench_q12/duckdb:vortex-file-compressed 68961412 / 71087202 / -3.0% 98084434 / 99252109 / -1.2% 0.70 / 0.72 / -1.8%
clickbench_q13/duckdb:vortex-file-compressed 126138653 / 126240316 / -0.1% 163302234 / 168697739 / -3.2% 0.77 / 0.75 / +3.2%
clickbench_q14/duckdb:vortex-file-compressed 73919568 / 74839658 / -1.2% 101585642 / 103857456 / -2.2% 0.73 / 0.72 / +1.0%
clickbench_q15/duckdb:vortex-file-compressed 76442438 / 75433843 / +1.3% 107390360 / 109439178 / -1.9% 0.71 / 0.69 / +3.3%
clickbench_q16/duckdb:vortex-file-compressed 134488738 / 138848448 / -3.1% 169198328 / 173296902 / -2.4% 0.79 / 0.80 / -0.8%
clickbench_q17/duckdb:vortex-file-compressed 136737568 / 139153850 / -1.7% 169964066 / 169907062 / +0.0% 0.80 / 0.82 / -1.8%
clickbench_q18/duckdb:vortex-file-compressed 257596106 / 265911218 / -3.1% 307067219 / 305120685 / +0.6% 0.84 / 0.87 / -3.7%
clickbench_q19/duckdb:vortex-file-compressed 9332468 / 9468048 / -1.4% 35249062 / 37990104 / -7.2% 0.26 / 0.25 / +6.2%
clickbench_q20/duckdb:vortex-file-compressed 68118526 / 68612395 / -0.7% 162041548 / 170510266 / -5.0% 0.42 / 0.40 / +4.5%
clickbench_q21/duckdb:vortex-file-compressed 84162342 / 84497973 / -0.4% 182979108 / 195208950 / -6.3% 0.46 / 0.43 / +6.3%
clickbench_q22/duckdb:vortex-file-compressed 175593690 / 172454992 / +1.8% 330484855 / 345243131 / -4.3% 0.53 / 0.50 / +6.4%
clickbench_q23/duckdb:vortex-file-compressed 41416480 / 40618710 / +2.0% 87604252 / 86700744 / +1.0% 0.47 / 0.47 / +0.9%
clickbench_q24/duckdb:vortex-file-compressed 14584963 / 14188609 / +2.8% 39354425 / 36645024 / +7.4% 0.37 / 0.39 / -4.3%
clickbench_q25/duckdb:vortex-file-compressed 19494263 / 19493128 / +0.0% 52568457 / 54682192 / -3.9% 0.37 / 0.36 / +4.0%
clickbench_q26/duckdb:vortex-file-compressed 11614222 / 11542194 / +0.6% 38018584 / 32748797 / +16.1% 🔴 0.31 / 0.35 / -13.3%
clickbench_q27/duckdb:vortex-file-compressed 53715885 / 54603637 / -1.6% 166162907 / 183473458 / -9.4% 0.32 / 0.30 / +8.6%
clickbench_q28/duckdb:vortex-file-compressed 509074192 / 513685262 / -0.9% 557768318 / 558901387 / -0.2% 0.91 / 0.92 / -0.7%
clickbench_q29/duckdb:vortex-file-compressed 16965410 / 17165104 / -1.2% 35825872 / 43165878 / -17.0% 🟢 0.47 / 0.40 / +19.1%
clickbench_q30/duckdb:vortex-file-compressed 61051297 / 60947676 / +0.2% 103179876 / 110686239 / -6.8% 0.59 / 0.55 / +7.5%
clickbench_q31/duckdb:vortex-file-compressed 111290370 / 111197206 / +0.1% 183459932 / 177888211 / +3.1% 0.61 / 0.63 / -3.0%
clickbench_q32/duckdb:vortex-file-compressed 364736978 / 367202350 / -0.7% 400482793 / 388742995 / +3.0% 0.91 / 0.94 / -3.6%
clickbench_q33/duckdb:vortex-file-compressed 351410605 / 339871745 / +3.4% 409606486 / 397039936 / +3.2% 0.86 / 0.86 / +0.2%
clickbench_q34/duckdb:vortex-file-compressed 352096974 / 354820482 / -0.8% 410671472 / 415936386 / -1.3% 0.86 / 0.85 / +0.5%
clickbench_q35/duckdb:vortex-file-compressed 57840398 / 57122534 / +1.3% 87074625 / 90666729 / -4.0% 0.66 / 0.63 / +5.4%
clickbench_q36/duckdb:vortex-file-compressed 11801806 / 11629262 / +1.5% 33871681 / 34720914 / -2.4% 0.35 / 0.33 / +4.0%
clickbench_q37/duckdb:vortex-file-compressed 8336148 / 8133478 / +2.5% 27658338 / 28291828 / -2.2% 0.30 / 0.29 / +4.8%
clickbench_q38/duckdb:vortex-file-compressed 9043042 / 8664608 / +4.4% 27290982 / 30055789 / -9.2% 0.33 / 0.29 / +14.9%
clickbench_q39/duckdb:vortex-file-compressed 18851716 / 19136848 / -1.5% 42071229 / 41576788 / +1.2% 0.45 / 0.46 / -2.6%
clickbench_q40/duckdb:vortex-file-compressed 7578038 / 7548208 / +0.4% 27513753 / 28924428 / -4.9% 0.28 / 0.26 / +5.5%
clickbench_q41/duckdb:vortex-file-compressed 8447616 / 8512967 / -0.8% 29863641 / 29578773 / +1.0% 0.28 / 0.29 / -1.7%
clickbench_q42/duckdb:vortex-file-compressed 7524407 / 7494638 / +0.4% 29789081 / 28201834 / +5.6% 0.25 / 0.27 / -5.0%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9600220 / 9400728 / +2.1% 14773532 / 14330937 / +3.1% 0.65 / 0.66 / -0.9%
clickbench_q01/duckdb:parquet 15417794 / 15345596 / +0.5% 22301082 / 19916573 / +12.0% 🔴 0.69 / 0.77 / -10.3%
clickbench_q02/duckdb:parquet 22389991 / 22438298 / -0.2% 32417462 / 30496157 / +6.3% 0.69 / 0.74 / -6.1%
clickbench_q03/duckdb:parquet 23311098 / 23221389 / +0.4% 34991819 / 37084566 / -5.6% 0.67 / 0.63 / +6.4%
clickbench_q04/duckdb:parquet 62401444 / 61942499 / +0.7% 71933922 / 77095060 / -6.7% 0.87 / 0.80 / +8.0%
clickbench_q05/duckdb:parquet 83263746 / 83288057 / -0.0% 95174554 / 97238121 / -2.1% 0.87 / 0.86 / +2.1%
clickbench_q06/duckdb:parquet 20656300 / 20775950 / -0.6% 27494858 / 28305885 / -2.9% 0.75 / 0.73 / +2.4%
clickbench_q07/duckdb:parquet 16876316 / 17429122 / -3.2% 24267597 / 24490506 / -0.9% 0.70 / 0.71 / -2.3%
clickbench_q08/duckdb:parquet 74204188 / 75158948 / -1.3% 91203043 / 90757761 / +0.5% 0.81 / 0.83 / -1.8%
clickbench_q09/duckdb:parquet 102718667 / 103099476 / -0.4% 120103266 / 121853684 / -1.4% 0.86 / 0.85 / +1.1%
clickbench_q10/duckdb:parquet 42099420 / 42155570 / -0.1% 53901402 / 57073402 / -5.6% 0.78 / 0.74 / +5.7%
clickbench_q11/duckdb:parquet 47839910 / 47125571 / +1.5% 62166683 / 62874245 / -1.1% 0.77 / 0.75 / +2.7%
clickbench_q12/duckdb:parquet 92862608 / 94085283 / -1.3% 107554986 / 107375972 / +0.2% 0.86 / 0.88 / -1.5%
clickbench_q13/duckdb:parquet 150445905 / 151162090 / -0.5% 168881069 / 168543306 / +0.2% 0.89 / 0.90 / -0.7%
clickbench_q14/duckdb:parquet 100505539 / 100474552 / +0.0% 117203578 / 117048583 / +0.1% 0.86 / 0.86 / -0.1%
clickbench_q15/duckdb:parquet 86547019 / 86825199 / -0.3% 104801910 / 104331521 / +0.5% 0.83 / 0.83 / -0.8%
clickbench_q16/duckdb:parquet 166203442 / 170459094 / -2.5% 181613820 / 177813256 / +2.1% 0.92 / 0.96 / -4.5%
clickbench_q17/duckdb:parquet 165780380 / 166143034 / -0.2% 181683932 / 179513976 / +1.2% 0.91 / 0.93 / -1.4%
clickbench_q18/duckdb:parquet 299063392 / 294098907 / +1.7% 318408486 / 318083814 / +0.1% 0.94 / 0.92 / +1.6%
clickbench_q19/duckdb:parquet 20001066 / 20141696 / -0.7% 25632564 / 27110328 / -5.5% 0.78 / 0.74 / +5.0%
clickbench_q20/duckdb:parquet 177493246 / 186884826 / -5.0% 232868968 / 224309033 / +3.8% 0.76 / 0.83 / -8.5%
clickbench_q21/duckdb:parquet 220394995 / 217346234 / +1.4% 262439935 / 265361810 / -1.1% 0.84 / 0.82 / +2.5%
clickbench_q22/duckdb:parquet 309965414 / 314206800 / -1.3% 372933527 / 361136216 / +3.3% 0.83 / 0.87 / -4.5%
clickbench_q23/duckdb:parquet 168944731 / 159647769 / +5.8% 260354643 / 243601361 / +6.9% 0.65 / 0.66 / -1.0%
clickbench_q24/duckdb:parquet 30139299 / 29846220 / +1.0% 41228655 / 43938388 / -6.2% 0.73 / 0.68 / +7.6%
clickbench_q25/duckdb:parquet 41896679 / 42278966 / -0.9% 59829752 / 58286148 / +2.6% 0.70 / 0.73 / -3.5%
clickbench_q26/duckdb:parquet 30625856 / 30326062 / +1.0% 46482253 / 47592937 / -2.3% 0.66 / 0.64 / +3.4%
clickbench_q27/duckdb:parquet 189489080 / 186256236 / +1.7% 224367718 / 235122392 / -4.6% 0.84 / 0.79 / +6.6%
clickbench_q28/duckdb:parquet 965817080 / 964496264 / +0.1% 956817647 / 944120941 / +1.3% 1.01 / 1.02 / -1.2%
clickbench_q29/duckdb:parquet 24443876 / 24041449 / +1.7% 30806488 / 31438698 / -2.0% 0.79 / 0.76 / +3.8%
clickbench_q30/duckdb:parquet 106132232 / 105298826 / +0.8% 127393180 / 125181824 / +1.8% 0.83 / 0.84 / -1.0%
clickbench_q31/duckdb:parquet 159978185 / 157709250 / +1.4% 174866584 / 176555680 / -1.0% 0.91 / 0.89 / +2.4%
clickbench_q32/duckdb:parquet 391623350 / 384126326 / +2.0% 416776267 / 412688012 / +1.0% 0.94 / 0.93 / +1.0%
clickbench_q33/duckdb:parquet 473106361 / 495108680 / -4.4% 464614727 / 471320742 / -1.4% 1.02 / 1.05 / -3.1%
clickbench_q34/duckdb:parquet 466767158 / 468879003 / -0.5% 461182558 / 461973006 / -0.2% 1.01 / 1.01 / -0.3%
clickbench_q35/duckdb:parquet 61744093 / 61426610 / +0.5% 75081002 / 75760437 / -0.9% 0.82 / 0.81 / +1.4%
clickbench_q36/duckdb:parquet 30535120 / 31046550 / -1.6% 36641101 / 36716975 / -0.2% 0.83 / 0.85 / -1.4%
clickbench_q37/duckdb:parquet 23513808 / 23104854 / +1.8% 29750809 / 29360197 / +1.3% 0.79 / 0.79 / +0.4%
clickbench_q38/duckdb:parquet 24089162 / 23343310 / +3.2% 29198864 / 30585716 / -4.5% 0.83 / 0.76 / +8.1%
clickbench_q39/duckdb:parquet 53851764 / 53236565 / +1.2% 59895974 / 60529594 / -1.0% 0.90 / 0.88 / +2.2%
clickbench_q40/duckdb:parquet 14581522 / 14369300 / +1.5% 20263262 / 20255764 / +0.0% 0.72 / 0.71 / +1.4%
clickbench_q41/duckdb:parquet 15794528 / 15283664 / +3.3% 20729576 / 20290986 / +2.2% 0.76 / 0.75 / +1.2%
clickbench_q42/duckdb:parquet 14423105 / 14535210 / -0.8% 20299768 / 20243021 / +0.3% 0.71 / 0.72 / -1.0%
duckdb / duckdb / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11047350 / 11334426 / -2.5% 13641693 / 13964909 / -2.3% 0.81 / 0.81 / -0.2%
clickbench_q01/duckdb:duckdb 26443210 / 26625010 / -0.7% 43100528 / 45718522 / -5.7% 0.61 / 0.58 / +5.3%
clickbench_q02/duckdb:duckdb 22688234 / 22463160 / +1.0% 46617531 / 49038159 / -4.9% 0.49 / 0.46 / +6.2%
clickbench_q03/duckdb:duckdb 21183213 / 21466424 / -1.3% 43188618 / 46640517 / -7.4% 0.49 / 0.46 / +6.6%
clickbench_q04/duckdb:duckdb 73483356 / 74936854 / -1.9% 94684876 / 99790037 / -5.1% 0.78 / 0.75 / +3.3%
clickbench_q05/duckdb:duckdb 79290528 / 79577625 / -0.4% 101225530 / 106000630 / -4.5% 0.78 / 0.75 / +4.3%
clickbench_q06/duckdb:duckdb 21414580 / 21606464 / -0.9% 28982778 / 30561722 / -5.2% 0.74 / 0.71 / +4.5%
clickbench_q07/duckdb:duckdb 17674002 / 17635186 / +0.2% 34370406 / 36747454 / -6.5% 0.51 / 0.48 / +7.2%
clickbench_q08/duckdb:duckdb 88786664 / 86563860 / +2.6% 115932157 / 118103022 / -1.8% 0.77 / 0.73 / +4.5%
clickbench_q09/duckdb:duckdb 98422185 / 97164526 / +1.3% 133434399 / 141186447 / -5.5% 0.74 / 0.69 / +7.2%
clickbench_q10/duckdb:duckdb 52319884 / 52982642 / -1.3% 88422670 / 92403317 / -4.3% 0.59 / 0.57 / +3.2%
clickbench_q11/duckdb:duckdb 55299648 / 55376278 / -0.1% 95488506 / 96123415 / -0.7% 0.58 / 0.58 / +0.5%
clickbench_q12/duckdb:duckdb 82232420 / 82862614 / -0.8% 103601203 / 108029833 / -4.1% 0.79 / 0.77 / +3.5%
clickbench_q13/duckdb:duckdb 145558426 / 146412054 / -0.6% 179039394 / 183494813 / -2.4% 0.81 / 0.80 / +1.9%
clickbench_q14/duckdb:duckdb 91274410 / 91300821 / -0.0% 114597052 / 117528041 / -2.5% 0.80 / 0.78 / +2.5%
clickbench_q15/duckdb:duckdb 83471271 / 82488328 / +1.2% 102428302 / 106721628 / -4.0% 0.81 / 0.77 / +5.4%
clickbench_q16/duckdb:duckdb 165353076 / 164859787 / +0.3% 185570574 / 191172461 / -2.9% 0.89 / 0.86 / +3.3%
clickbench_q17/duckdb:duckdb 153018115 / 154192732 / -0.8% 186482237 / 187225684 / -0.4% 0.82 / 0.82 / -0.4%
clickbench_q18/duckdb:duckdb 304042894 / 306484398 / -0.8% 344086224 / 350748727 / -1.9% 0.88 / 0.87 / +1.1%
clickbench_q19/duckdb:duckdb 17683845 / 17697670 / -0.1% 32607388 / 34999838 / -6.8% 0.54 / 0.51 / +7.3%
clickbench_q20/duckdb:duckdb 184239325 / 195658708 / -5.8% 435527151 / 455582859 / -4.4% 0.42 / 0.43 / -1.5%
clickbench_q21/duckdb:duckdb 171809081 / 181134058 / -5.1% 430389033 / 462810730 / -7.0% 0.40 / 0.39 / +2.0%
clickbench_q22/duckdb:duckdb 193119326 / 214329944 / -9.9% 430817523 / 483147595 / -10.8% 🟢 0.45 / 0.44 / +1.0%
clickbench_q23/duckdb:duckdb 68999554 / 69693183 / -1.0% 133696640 / 150800715 / -11.3% 🟢 0.52 / 0.46 / +11.7%
clickbench_q24/duckdb:duckdb 30859505 / 30861216 / -0.0% 44026816 / 46300933 / -4.9% 0.70 / 0.67 / +5.2%
clickbench_q25/duckdb:duckdb 41040929 / 41000137 / +0.1% 73793142 / 76582778 / -3.6% 0.56 / 0.54 / +3.9%
clickbench_q26/duckdb:duckdb 31147278 / 31314963 / -0.5% 45549334 / 49983201 / -8.9% 0.68 / 0.63 / +9.1%
clickbench_q27/duckdb:duckdb 154284488 / 160350023 / -3.8% 399674644 / 428648672 / -6.8% 0.39 / 0.37 / +3.2%
clickbench_q28/duckdb:duckdb 841621692 / 842934260 / -0.2% 871816395 / 901820961 / -3.3% 0.97 / 0.93 / +3.3%
clickbench_q29/duckdb:duckdb 27137016 / 27495476 / -1.3% 42862006 / 45880770 / -6.6% 0.63 / 0.60 / +5.6%
clickbench_q30/duckdb:duckdb 101737071 / 102008430 / -0.3% 170046374 / 170781649 / -0.4% 0.60 / 0.60 / +0.2%
clickbench_q31/duckdb:duckdb 173155763 / 171375070 / +1.0% 248519307 / 234962193 / +5.8% 0.70 / 0.73 / -4.5%
clickbench_q32/duckdb:duckdb 464568702 / 473288681 / -1.8% 486292330 / 495345507 / -1.8% 0.96 / 0.96 / -0.0%
clickbench_q33/duckdb:duckdb 458186104 / 455846262 / +0.5% 572709390 / 599580350 / -4.5% 0.80 / 0.76 / +5.2%
clickbench_q34/duckdb:duckdb 469889071 / 487235744 / -3.6% 581488447 / 613275953 / -5.2% 0.81 / 0.79 / +1.7%
clickbench_q35/duckdb:duckdb 74968244 / 75033977 / -0.1% 92189711 / 95283923 / -3.2% 0.81 / 0.79 / +3.3%
clickbench_q36/duckdb:duckdb 32618304 / 32169964 / +1.4% 44724940 / 48124812 / -7.1% 0.73 / 0.67 / +9.1%
clickbench_q37/duckdb:duckdb 16803440 / 17104813 / -1.8% 23665480 / 28091288 / -15.8% 🟢 0.71 / 0.61 / +16.6%
clickbench_q38/duckdb:duckdb 18924258 / 18805299 / +0.6% 31195489 / 35210496 / -11.4% 🟢 0.61 / 0.53 / +13.6%
clickbench_q39/duckdb:duckdb 55785446 / 54672070 / +2.0% 74618722 / 80687984 / -7.5% 0.75 / 0.68 / +10.3%
clickbench_q40/duckdb:duckdb 15982844 / 16279150 / -1.8% 26459458 / 31320817 / -15.5% 🟢 0.60 / 0.52 / +16.2%
clickbench_q41/duckdb:duckdb 15916334 / 16238514 / -2.0% 23834718 / 28610308 / -16.7% 🟢 0.67 / 0.57 / +17.7%
clickbench_q42/duckdb:duckdb 15854372 / 16098781 / -1.5% 23714495 / 27324538 / -13.2% 🟢 0.67 / 0.59 / +13.5%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 15127731 / 14761866 / +2.5% 29914795 / 30446316 / -1.7% 0.51 / 0.48 / +4.3%
job_q02/duckdb:vortex-file-compressed 25762720 / 25252632 / +2.0% 39143411 / 38837916 / +0.8% 0.66 / 0.65 / +1.2%
job_q03/duckdb:vortex-file-compressed 15800180 / 15736764 / +0.4% 31302895 / 30837659 / +1.5% 0.50 / 0.51 / -1.1%
job_q04/duckdb:vortex-file-compressed 27737768 / 27139734 / +2.2% 41793256 / 41805925 / -0.0% 0.66 / 0.65 / +2.2%
job_q05/duckdb:vortex-file-compressed 20077320 / 19685196 / +2.0% 36038599 / 35884950 / +0.4% 0.56 / 0.55 / +1.6%
job_q06/duckdb:vortex-file-compressed 16352072 / 16422969 / -0.4% 33505725 / 31877889 / +5.1% 0.49 / 0.52 / -5.3%
job_q07/duckdb:vortex-file-compressed 9869336 / 9540872 / +3.4% 26180904 / 27271776 / -4.0% 0.38 / 0.35 / +7.8%
job_q08/duckdb:vortex-file-compressed 22072054 / 21358744 / +3.3% 37468301 / 38269658 / -2.1% 0.59 / 0.56 / +5.5%
job_q09/duckdb:vortex-file-compressed 66803449 / 66597920 / +0.3% 98230647 / 97688328 / +0.6% 0.68 / 0.68 / -0.2%
job_q10/duckdb:vortex-file-compressed 43309466 / 43296344 / +0.0% 76211910 / 75588411 / +0.8% 0.57 / 0.57 / -0.8%
job_q100/duckdb:vortex-file-compressed 39922746 / 40367792 / -1.1% 77785794 / 77108308 / +0.9% 0.51 / 0.52 / -2.0%
job_q101/duckdb:vortex-file-compressed 38371286 / 38785760 / -1.1% 75322983 / 74570996 / +1.0% 0.51 / 0.52 / -2.1%
job_q102/duckdb:vortex-file-compressed 72336386 / 72358798 / -0.0% 113492370 / 111188409 / +2.1% 0.64 / 0.65 / -2.1%
job_q103/duckdb:vortex-file-compressed 50400671 / 50983158 / -1.1% 87829593 / 87361518 / +0.5% 0.57 / 0.58 / -1.7%
job_q104/duckdb:vortex-file-compressed 38869438 / 39279614 / -1.0% 77211482 / 78109162 / -1.1% 0.50 / 0.50 / +0.1%
job_q105/duckdb:vortex-file-compressed 69682720 / 69900098 / -0.3% 105180229 / 106750539 / -1.5% 0.66 / 0.65 / +1.2%
job_q106/duckdb:vortex-file-compressed 62660703 / 63324196 / -1.0% 100364286 / 98398790 / +2.0% 0.62 / 0.64 / -3.0%
job_q107/duckdb:vortex-file-compressed 44360020 / 44234691 / +0.3% 83354533 / 81011295 / +2.9% 0.53 / 0.55 / -2.5%
job_q108/duckdb:vortex-file-compressed 64278112 / 64761381 / -0.7% 103969810 / 104045020 / -0.1% 0.62 / 0.62 / -0.7%
job_q109/duckdb:vortex-file-compressed 11145381 / 11314610 / -1.5% 24119105 / 24346682 / -0.9% 0.46 / 0.46 / -0.6%
job_q11/duckdb:vortex-file-compressed 38045768 / 38484534 / -1.1% 71021044 / 69877746 / +1.6% 0.54 / 0.55 / -2.7%
job_q110/duckdb:vortex-file-compressed 17913879 / 17654066 / +1.5% 31117181 / 32623856 / -4.6% 0.58 / 0.54 / +6.4%
job_q111/duckdb:vortex-file-compressed 29282618 / 29022141 / +0.9% 46571477 / 48093330 / -3.2% 0.63 / 0.60 / +4.2%
job_q112/duckdb:vortex-file-compressed 28934512 / 28501258 / +1.5% 46263714 / 44109727 / +4.9% 0.63 / 0.65 / -3.2%
job_q113/duckdb:vortex-file-compressed 31631453 / 31720852 / -0.3% 53783173 / 51947199 / +3.5% 0.59 / 0.61 / -3.7%
job_q12/duckdb:vortex-file-compressed 38707318 / 38501224 / +0.5% 55433181 / 56833708 / -2.5% 0.70 / 0.68 / +3.1%
job_q13/duckdb:vortex-file-compressed 13858088 / 14083371 / -1.6% 30256275 / 31442740 / -3.8% 0.46 / 0.45 / +2.3%
job_q14/duckdb:vortex-file-compressed 47002432 / 47936114 / -1.9% 64876484 / 67086695 / -3.3% 0.72 / 0.71 / +1.4%
job_q15/duckdb:vortex-file-compressed 25367622 / 25372639 / -0.0% 56649773 / 58236536 / -2.7% 0.45 / 0.44 / +2.8%
job_q16/duckdb:vortex-file-compressed 24855812 / 24490030 / +1.5% 56376234 / 54477806 / +3.5% 0.44 / 0.45 / -1.9%
job_q17/duckdb:vortex-file-compressed 34641160 / 35309970 / -1.9% 68387856 / 66678015 / +2.6% 0.51 / 0.53 / -4.3%
job_q18/duckdb:vortex-file-compressed 38612982 / 38783710 / -0.4% 53725133 / 55045071 / -2.4% 0.72 / 0.70 / +2.0%
job_q19/duckdb:vortex-file-compressed 19168784 / 18429062 / +4.0% 42181153 / 42020886 / +0.4% 0.45 / 0.44 / +3.6%
job_q20/duckdb:vortex-file-compressed 18076984 / 18935688 / -4.5% 40858467 / 41243773 / -0.9% 0.44 / 0.46 / -3.6%
job_q21/duckdb:vortex-file-compressed 38124169 / 38015847 / +0.3% 66733170 / 65629305 / +1.7% 0.57 / 0.58 / -1.4%
job_q22/duckdb:vortex-file-compressed 30128317 / 29961064 / +0.6% 54168056 / 54733688 / -1.0% 0.56 / 0.55 / +1.6%
job_q23/duckdb:vortex-file-compressed 68814366 / 67432449 / +2.0% 97176060 / 95925777 / +1.3% 0.71 / 0.70 / +0.7%
job_q24/duckdb:vortex-file-compressed 41631804 / 41703176 / -0.2% 72141858 / 72187470 / -0.1% 0.58 / 0.58 / -0.1%
job_q25/duckdb:vortex-file-compressed 35808083 / 35117153 / +2.0% 64700566 / 64087819 / +1.0% 0.55 / 0.55 / +1.0%
job_q26/duckdb:vortex-file-compressed 86762690 / 86955265 / -0.2% 123650005 / 123177181 / +0.4% 0.70 / 0.71 / -0.6%
job_q27/duckdb:vortex-file-compressed 28036726 / 27523804 / +1.9% 56362082 / 56045525 / +0.6% 0.50 / 0.49 / +1.3%
job_q28/duckdb:vortex-file-compressed 23063468 / 23411338 / -1.5% 52341112 / 53676364 / -2.5% 0.44 / 0.44 / +1.0%
job_q29/duckdb:vortex-file-compressed 85271646 / 85340318 / -0.1% 101409464 / 106640370 / -4.9% 0.84 / 0.80 / +5.1%
job_q30/duckdb:vortex-file-compressed 68471058 / 68413970 / +0.1% 85915628 / 85323584 / +0.7% 0.80 / 0.80 / -0.6%
job_q31/duckdb:vortex-file-compressed 60856758 / 60252392 / +1.0% 97957174 / 96189626 / +1.8% 0.62 / 0.63 / -0.8%
job_q32/duckdb:vortex-file-compressed 47362928 / 47524319 / -0.3% 81772448 / 82102718 / -0.4% 0.58 / 0.58 / +0.1%
job_q33/duckdb:vortex-file-compressed 61785426 / 61978055 / -0.3% 89585147 / 90060138 / -0.5% 0.69 / 0.69 / +0.2%
job_q34/duckdb:vortex-file-compressed 125209556 / 126160672 / -0.8% 154218113 / 154657195 / -0.3% 0.81 / 0.82 / -0.5%
job_q35/duckdb:vortex-file-compressed 26742514 / 26781721 / -0.1% 53511418 / 52556689 / +1.8% 0.50 / 0.51 / -1.9%
job_q36/duckdb:vortex-file-compressed 21052660 / 21065502 / -0.1% 47313557 / 49488793 / -4.4% 0.44 / 0.43 / +4.5%
job_q37/duckdb:vortex-file-compressed 50666856 / 50286124 / +0.8% 83267202 / 83420923 / -0.2% 0.61 / 0.60 / +0.9%
job_q38/duckdb:vortex-file-compressed 18501544 / 18922635 / -2.2% 35868638 / 37435722 / -4.2% 0.52 / 0.51 / +2.0%
job_q39/duckdb:vortex-file-compressed 15750907 / 16286349 / -3.3% 32330473 / 31957686 / +1.2% 0.49 / 0.51 / -4.4%
job_q40/duckdb:vortex-file-compressed 96358792 / 94827209 / +1.6% 114827672 / 114280019 / +0.5% 0.84 / 0.83 / +1.1%
job_q41/duckdb:vortex-file-compressed 262300901 / 262391444 / -0.0% 282943376 / 281688086 / +0.4% 0.93 / 0.93 / -0.5%
job_q42/duckdb:vortex-file-compressed 30034938 / 30493442 / -1.5% 52405617 / 52705878 / -0.6% 0.57 / 0.58 / -0.9%
job_q43/duckdb:vortex-file-compressed 17295334 / 17236929 / +0.3% 37260144 / 34802384 / +7.1% 0.46 / 0.50 / -6.3%
job_q44/duckdb:vortex-file-compressed 45853956 / 46005704 / -0.3% 67012896 / 68782501 / -2.6% 0.68 / 0.67 / +2.3%
job_q45/duckdb:vortex-file-compressed 67950999 / 68338661 / -0.6% 87150767 / 87621086 / -0.5% 0.78 / 0.78 / -0.0%
job_q46/duckdb:vortex-file-compressed 21756006 / 21897374 / -0.6% 41164039 / 40787897 / +0.9% 0.53 / 0.54 / -1.6%
job_q47/duckdb:vortex-file-compressed 18635578 / 18675342 / -0.2% 38142967 / 36594244 / +4.2% 0.49 / 0.51 / -4.3%
job_q48/duckdb:vortex-file-compressed 72853247 / 72610758 / +0.3% 89380374 / 89365991 / +0.0% 0.82 / 0.81 / +0.3%
job_q49/duckdb:vortex-file-compressed 50438658 / 50432828 / +0.0% 71299452 / 70018094 / +1.8% 0.71 / 0.72 / -1.8%
job_q50/duckdb:vortex-file-compressed 37748160 / 37324701 / +1.1% 56041987 / 55973926 / +0.1% 0.67 / 0.67 / +1.0%
job_q51/duckdb:vortex-file-compressed 57096492 / 57150617 / -0.1% 78393575 / 78195655 / +0.3% 0.73 / 0.73 / -0.3%
job_q52/duckdb:vortex-file-compressed 47661744 / 47036445 / +1.3% 71277901 / 72372346 / -1.5% 0.67 / 0.65 / +2.9%
job_q53/duckdb:vortex-file-compressed 43728541 / 43558556 / +0.4% 68480575 / 69265568 / -1.1% 0.64 / 0.63 / +1.5%
job_q54/duckdb:vortex-file-compressed 57818143 / 56755644 / +1.9% 80522482 / 79841300 / +0.9% 0.72 / 0.71 / +1.0%
job_q55/duckdb:vortex-file-compressed 55834222 / 56182942 / -0.6% 79010215 / 79550832 / -0.7% 0.71 / 0.71 / +0.1%
job_q56/duckdb:vortex-file-compressed 36117984 / 36188724 / -0.2% 67490426 / 67049542 / +0.7% 0.54 / 0.54 / -0.8%
job_q57/duckdb:vortex-file-compressed 83634524 / 83905174 / -0.3% 107720737 / 108385726 / -0.6% 0.78 / 0.77 / +0.3%
job_q58/duckdb:vortex-file-compressed 66361742 / 67419580 / -1.6% 97671319 / 95975017 / +1.8% 0.68 / 0.70 / -3.3%
job_q59/duckdb:vortex-file-compressed 62566764 / 61617038 / +1.5% 92015177 / 89778906 / +2.5% 0.68 / 0.69 / -0.9%
job_q60/duckdb:vortex-file-compressed 41170816 / 41951042 / -1.9% 66391450 / 65349615 / +1.6% 0.62 / 0.64 / -3.4%
job_q61/duckdb:vortex-file-compressed 32822440 / 32636546 / +0.6% 60127047 / 61873899 / -2.8% 0.55 / 0.53 / +3.5%
job_q62/duckdb:vortex-file-compressed 31287866 / 31692716 / -1.3% 59866907 / 59321603 / +0.9% 0.52 / 0.53 / -2.2%
job_q63/duckdb:vortex-file-compressed 34686453 / 33866572 / +2.4% 62212920 / 63148425 / -1.5% 0.56 / 0.54 / +4.0%
job_q64/duckdb:vortex-file-compressed 57720464 / 57428842 / +0.5% 85669809 / 85834933 / -0.2% 0.67 / 0.67 / +0.7%
job_q65/duckdb:vortex-file-compressed 48597441 / 48765793 / -0.3% 76191845 / 76647446 / -0.6% 0.64 / 0.64 / +0.3%
job_q66/duckdb:vortex-file-compressed 48079134 / 48378905 / -0.6% 80246862 / 80475803 / -0.3% 0.60 / 0.60 / -0.3%
job_q67/duckdb:vortex-file-compressed 35138446 / 35482567 / -1.0% 64827979 / 68244127 / -5.0% 0.54 / 0.52 / +4.2%
job_q68/duckdb:vortex-file-compressed 54696648 / 54722736 / -0.0% 86084007 / 88947268 / -3.2% 0.64 / 0.62 / +3.3%
job_q69/duckdb:vortex-file-compressed 74004540 / 73921416 / +0.1% 109506192 / 110300211 / -0.7% 0.68 / 0.67 / +0.8%
job_q70/duckdb:vortex-file-compressed 43150100 / 43752928 / -1.4% 77612502 / 74744562 / +3.8% 0.56 / 0.59 / -5.0%
job_q71/duckdb:vortex-file-compressed 65299232 / 65029596 / +0.4% 99946270 / 99009481 / +0.9% 0.65 / 0.66 / -0.5%
job_q72/duckdb:vortex-file-compressed 139817249 / 139983248 / -0.1% 166930138 / 168427575 / -0.9% 0.84 / 0.83 / +0.8%
job_q73/duckdb:vortex-file-compressed 81648942 / 82285345 / -0.8% 120211099 / 122863858 / -2.2% 0.68 / 0.67 / +1.4%
job_q74/duckdb:vortex-file-compressed 68337199 / 67165034 / +1.7% 106410492 / 107015512 / -0.6% 0.64 / 0.63 / +2.3%
job_q75/duckdb:vortex-file-compressed 64978388 / 64722354 / +0.4% 107561979 / 107199424 / +0.3% 0.60 / 0.60 / +0.1%
job_q76/duckdb:vortex-file-compressed 25577880 / 25927546 / -1.3% 50682405 / 50074927 / +1.2% 0.50 / 0.52 / -2.5%
job_q77/duckdb:vortex-file-compressed 25416814 / 25485200 / -0.3% 49618366 / 49268315 / +0.7% 0.51 / 0.52 / -1.0%
job_q78/duckdb:vortex-file-compressed 27241102 / 27243942 / -0.0% 54201592 / 52391036 / +3.5% 0.50 / 0.52 / -3.4%
job_q79/duckdb:vortex-file-compressed 60095468 / 60078410 / +0.0% 81590214 / 85879365 / -5.0% 0.74 / 0.70 / +5.3%
job_q80/duckdb:vortex-file-compressed 47663330 / 47646878 / +0.0% 70209601 / 71197339 / -1.4% 0.68 / 0.67 / +1.4%
job_q81/duckdb:vortex-file-compressed 90438014 / 90669556 / -0.3% 113696904 / 113735031 / -0.0% 0.80 / 0.80 / -0.2%
job_q82/duckdb:vortex-file-compressed 136719985 / 136290551 / +0.3% 157249935 / 159382249 / -1.3% 0.87 / 0.86 / +1.7%
job_q83/duckdb:vortex-file-compressed 39740826 / 39305332 / +1.1% 62691711 / 62589800 / +0.2% 0.63 / 0.63 / +0.9%
job_q84/duckdb:vortex-file-compressed 38445830 / 38779758 / -0.9% 61418626 / 61886469 / -0.8% 0.63 / 0.63 / -0.1%
job_q85/duckdb:vortex-file-compressed 45694180 / 45353236 / +0.8% 69598361 / 69375854 / +0.3% 0.66 / 0.65 / +0.4%
job_q86/duckdb:vortex-file-compressed 63382790 / 63154700 / +0.4% 102783748 / 101283556 / +1.5% 0.62 / 0.62 / -1.1%
job_q87/duckdb:vortex-file-compressed 58987935 / 59138660 / -0.3% 95328332 / 96404115 / -1.1% 0.62 / 0.61 / +0.9%
job_q88/duckdb:vortex-file-compressed 58590344 / 58533551 / +0.1% 94944980 / 94106365 / +0.9% 0.62 / 0.62 / -0.8%
job_q89/duckdb:vortex-file-compressed 47340112 / 46788986 / +1.2% 82081113 / 82664382 / -0.7% 0.58 / 0.57 / +1.9%
job_q90/duckdb:vortex-file-compressed 69385460 / 69818064 / -0.6% 105821095 / 105967477 / -0.1% 0.66 / 0.66 / -0.5%
job_q91/duckdb:vortex-file-compressed 60939356 / 61033865 / -0.2% 104221295 / 105437137 / -1.2% 0.58 / 0.58 / +1.0%
job_q92/duckdb:vortex-file-compressed 44343282 / 43778338 / +1.3% 84478315 / 81337645 / +3.9% 0.52 / 0.54 / -2.5%
job_q93/duckdb:vortex-file-compressed 69777736 / 68103978 / +2.5% 108166839 / 108523791 / -0.3% 0.65 / 0.63 / +2.8%
job_q94/duckdb:vortex-file-compressed 26848472 / 27550450 / -2.5% 49209975 / 50272242 / -2.1% 0.55 / 0.55 / -0.4%
job_q95/duckdb:vortex-file-compressed 25424364 / 25174908 / +1.0% 47965713 / 48087647 / -0.3% 0.53 / 0.52 / +1.2%
job_q96/duckdb:vortex-file-compressed 28134197 / 27869214 / +1.0% 51260562 / 52167100 / -1.7% 0.55 / 0.53 / +2.7%
job_q97/duckdb:vortex-file-compressed 84373030 / 84352191 / +0.0% 122243145 / 122486287 / -0.2% 0.69 / 0.69 / +0.2%
job_q98/duckdb:vortex-file-compressed 56787522 / 56316007 / +0.8% 98624716 / 96722680 / +2.0% 0.58 / 0.58 / -1.1%
job_q99/duckdb:vortex-file-compressed 79408586 / 78814870 / +0.8% 117682252 / 120109210 / -2.0% 0.67 / 0.66 / +2.8%
duckdb / parquet / ns (0.999x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 60193420 / 60520531 / -0.5% 69253268 / 70223075 / -1.4% 0.87 / 0.86 / +0.9%
job_q02/duckdb:parquet 153632046 / 150097723 / +2.4% 164698654 / 163009888 / +1.0% 0.93 / 0.92 / +1.3%
job_q03/duckdb:parquet 90298376 / 90240520 / +0.1% 98304092 / 97861001 / +0.5% 0.92 / 0.92 / -0.4%
job_q04/duckdb:parquet 166628758 / 169371548 / -1.6% 180773074 / 180172396 / +0.3% 0.92 / 0.94 / -1.9%
job_q05/duckdb:parquet 77039202 / 77311978 / -0.4% 87207494 / 89720757 / -2.8% 0.88 / 0.86 / +2.5%
job_q06/duckdb:parquet 73544546 / 73304958 / +0.3% 83556793 / 84834408 / -1.5% 0.88 / 0.86 / +1.9%
job_q07/duckdb:parquet 31352882 / 31422051 / -0.2% 42836479 / 42988253 / -0.4% 0.73 / 0.73 / +0.1%
job_q08/duckdb:parquet 93780038 / 93845920 / -0.1% 104087575 / 105376017 / -1.2% 0.90 / 0.89 / +1.2%
job_q09/duckdb:parquet 292368518 / 294082149 / -0.6% 313485086 / 323235726 / -3.0% 0.93 / 0.91 / +2.5%
job_q10/duckdb:parquet 234616140 / 243247110 / -3.5% 257186376 / 265882408 / -3.3% 0.91 / 0.91 / -0.3%
job_q100/duckdb:parquet 226961914 / 232793266 / -2.5% 251860258 / 262806653 / -4.2% 0.90 / 0.89 / +1.7%
job_q101/duckdb:parquet 228890422 / 234774158 / -2.5% 256345076 / 253597019 / +1.1% 0.89 / 0.93 / -3.6%
job_q102/duckdb:parquet 259913730 / 259822428 / +0.0% 281263331 / 296255635 / -5.1% 0.92 / 0.88 / +5.4%
job_q103/duckdb:parquet 202307396 / 197419216 / +2.5% 251591291 / 246131940 / +2.2% 0.80 / 0.80 / +0.3%
job_q104/duckdb:parquet 159761704 / 166581702 / -4.1% 1968264 / 193787189 / +1.6% 0.81 / 0.86 / -5.6%
job_q105/duckdb:parquet 211910432 / 217310001 / -2.5% 231679968 / 235220195 / -1.5% 0.91 / 0.92 / -1.0%
job_q106/duckdb:parquet 222614045 / 219723468 / +1.3% 250269647 / 251328760 / -0.4% 0.89 / 0.87 / +1.7%
job_q107/duckdb:parquet 204550164 / 185949322 / +10.0% 🔴 217841050 / 252402946 / -13.7% 🟢 0.94 / 0.74 / +27.5%
job_q108/duckdb:parquet 217592762 / 220180560 / -1.2% 266613972 / 255849726 / +4.2% 0.82 / 0.86 / -5.2%
job_q109/duckdb:parquet 29947236 / 29982454 / -0.1% 37105630 / 37220655 / -0.3% 0.81 / 0.81 / +0.2%
job_q11/duckdb:parquet 326381636 / 323733016 / +0.8% 342798064 / 344958593 / -0.6% 0.95 / 0.94 / +1.5%
job_q110/duckdb:parquet 78251816 / 78742988 / -0.6% 86332228 / 86936793 / -0.7% 0.91 / 0.91 / +0.1%
job_q111/duckdb:parquet 109300117 / 109316454 / -0.0% 118688960 / 119704082 / -0.8% 0.92 / 0.91 / +0.8%
job_q112/duckdb:parquet 105883832 / 105906114 / -0.0% 117146823 / 117237158 / -0.1% 0.90 / 0.90 / +0.1%
job_q113/duckdb:parquet 117516301 / 117785625 / -0.2% 127515083 / 128938736 / -1.1% 0.92 / 0.91 / +0.9%
job_q12/duckdb:parquet 107975448 / 105986266 / +1.9% 119019576 / 116939157 / +1.8% 0.91 / 0.91 / +0.1%
job_q13/duckdb:parquet 59896479 / 60180905 / -0.5% 70100675 / 70959055 / -1.2% 0.85 / 0.85 / +0.7%
job_q14/duckdb:parquet 125463665 / 125152649 / +0.2% 136909703 / 135836861 / +0.8% 0.92 / 0.92 / -0.5%
job_q15/duckdb:parquet 363085414 / 363272737 / -0.1% 385292504 / 386866227 / -0.4% 0.94 / 0.94 / +0.4%
job_q16/duckdb:parquet 314603674 / 315855167 / -0.4% 335933619 / 340269719 / -1.3% 0.94 / 0.93 / +0.9%
job_q17/duckdb:parquet 330841958 / 305327824 / +8.4% 380926019 / 329196479 / +15.7% 🔴 0.87 / 0.93 / -6.4%
job_q18/duckdb:parquet 85508930 / 84830876 / +0.8% 99989507 / 103014168 / -2.9% 0.86 / 0.82 / +3.8%
job_q19/duckdb:parquet 72771055 / 72380270 / +0.5% 84712202 / 85465830 / -0.9% 0.86 / 0.85 / +1.4%
job_q20/duckdb:parquet 72431971 / 72500853 / -0.1% 84549029 / 83372360 / +1.4% 0.86 / 0.87 / -1.5%
job_q21/duckdb:parquet 116143816 / 116419202 / -0.2% 132186981 / 134161533 / -1.5% 0.88 / 0.87 / +1.3%
job_q22/duckdb:parquet 110693818 / 111199217 / -0.5% 126696557 / 128420629 / -1.3% 0.87 / 0.87 / +0.9%
job_q23/duckdb:parquet 198493492 / 196481466 / +1.0% 219656818 / 218133420 / +0.7% 0.90 / 0.90 / +0.3%
job_q24/duckdb:parquet 166164845 / 166000052 / +0.1% 186339554 / 187945040 / -0.9% 0.89 / 0.88 / +1.0%
job_q25/duckdb:parquet 132965480 / 132649116 / +0.2% 153970262 / 155219983 / -0.8% 0.86 / 0.85 / +1.1%
job_q26/duckdb:parquet 319290048 / 324229295 / -1.5% 348591221 / 347708686 / +0.3% 0.92 / 0.93 / -1.8%
job_q27/duckdb:parquet 132464118 / 132709634 / -0.2% 150655900 / 150353872 / +0.2% 0.88 / 0.88 / -0.4%
job_q28/duckdb:parquet 143716190 / 144379598 / -0.5% 162005786 / 163191360 / -0.7% 0.89 / 0.88 / +0.3%
job_q29/duckdb:parquet 389507058 / 388223074 / +0.3% 411009427 / 407233871 / +0.9% 0.95 / 0.95 / -0.6%
job_q30/duckdb:parquet 203876456 / 202404908 / +0.7% 219631386 / 218440052 / +0.5% 0.93 / 0.93 / +0.2%
job_q31/duckdb:parquet 308343032 / 310595380 / -0.7% 330423150 / 328938501 / +0.5% 0.93 / 0.94 / -1.2%
job_q32/duckdb:parquet 271269988 / 274268162 / -1.1% 292082780 / 294407397 / -0.8% 0.93 / 0.93 / -0.3%
job_q33/duckdb:parquet 277238657 / 270456666 / +2.5% 285455006 / 285056822 / +0.1% 0.97 / 0.95 / +2.4%
job_q34/duckdb:parquet 415100859 / 414524746 / +0.1% 440134949 / 439129215 / +0.2% 0.94 / 0.94 / -0.1%
job_q35/duckdb:parquet 142592318 / 141935938 / +0.5% 158654035 / 159314913 / -0.4% 0.90 / 0.89 / +0.9%
job_q36/duckdb:parquet 86581829 / 85841888 / +0.9% 102718824 / 101906109 / +0.8% 0.84 / 0.84 / +0.1%
job_q37/duckdb:parquet 247617172 / 246527782 / +0.4% 270648438 / 268988532 / +0.6% 0.91 / 0.92 / -0.2%
job_q38/duckdb:parquet 67285481 / 67430740 / -0.2% 77215612 / 77152665 / +0.1% 0.87 / 0.87 / -0.3%
job_q39/duckdb:parquet 61372397 / 62498801 / -1.8% 71196597 / 71669244 / -0.7% 0.86 / 0.87 / -1.2%
job_q40/duckdb:parquet 80152210 / 79741004 / +0.5% 91542378 / 89949894 / +1.8% 0.88 / 0.89 / -1.2%
job_q41/duckdb:parquet 92178514 / 92570839 / -0.4% 101180680 / 103905234 / -2.6% 0.91 / 0.89 / +2.3%
job_q42/duckdb:parquet 150826207 / 146779800 / +2.8% 165130210 / 236126198 / -30.1% 🟢 0.91 / 0.62 / +46.9%
job_q43/duckdb:parquet 53774892 / 55456866 / -3.0% 70600816 / 70639070 / -0.1% 0.76 / 0.79 / -3.0%
job_q44/duckdb:parquet 183274348 / 180227807 / +1.7% 187928390 / 207652869 / -9.5% 0.98 / 0.87 / +12.4%
job_q45/duckdb:parquet 178669052 / 177423640 / +0.7% 190442479 / 191244455 / -0.4% 0.94 / 0.93 / +1.1%
job_q46/duckdb:parquet 114391349 / 114408222 / -0.0% 127434939 / 123522592 / +3.2% 0.90 / 0.93 / -3.1%
job_q47/duckdb:parquet 92259928 / 91930084 / +0.4% 104763262 / 105589353 / -0.8% 0.88 / 0.87 / +1.2%
job_q48/duckdb:parquet 172271368 / 172375155 / -0.1% 183971096 / 185233154 / -0.7% 0.94 / 0.93 / +0.6%
job_q49/duckdb:parquet 175517988 / 165067112 / +6.3% 202984992 / 191148530 / +6.2% 0.86 / 0.86 / +0.1%
job_q50/duckdb:parquet 133000192 / 140315753 / -5.2% 154000446 / 152979560 / +0.7% 0.86 / 0.92 / -5.8%
job_q51/duckdb:parquet 196898368 / 195022495 / +1.0% 205032468 / 226381366 / -9.4% 0.96 / 0.86 / +11.5%
job_q52/duckdb:parquet 185186299 / 177440998 / +4.4% 201914475 / 199503197 / +1.2% 0.92 / 0.89 / +3.1%
job_q53/duckdb:parquet 164062730 / 179066632 / -8.4% 190099489 / 187359613 / +1.5% 0.86 / 0.96 / -9.7%
job_q54/duckdb:parquet 178442525 / 172307538 / +3.6% 184146382 / 202525480 / -9.1% 0.97 / 0.85 / +13.9%
job_q55/duckdb:parquet 174360836 / 173488326 / +0.5% 190291125 / 186908515 / +1.8% 0.92 / 0.93 / -1.3%
job_q56/duckdb:parquet 155675024 / 154993250 / +0.4% 180941026 / 181028096 / -0.0% 0.86 / 0.86 / +0.5%
job_q57/duckdb:parquet 207551752 / 207757871 / -0.1% 231072247 / 230992951 / +0.0% 0.90 / 0.90 / -0.1%
job_q58/duckdb:parquet 240115399 / 240282976 / -0.1% 266829251 / 265373478 / +0.5% 0.90 / 0.91 / -0.6%
job_q59/duckdb:parquet 225254413 / 225361516 / -0.0% 245754592 / 252430274 / -2.6% 0.92 / 0.89 / +2.7%
job_q60/duckdb:parquet 94468086 / 93843859 / +0.7% 109116463 / 107725944 / +1.3% 0.87 / 0.87 / -0.6%
job_q61/duckdb:parquet 76267414 / 75728868 / +0.7% 93163287 / 92079521 / +1.2% 0.82 / 0.82 / -0.5%
job_q62/duckdb:parquet 73135442 / 73502096 / -0.5% 89496411 / 89502833 / -0.0% 0.82 / 0.82 / -0.5%
job_q63/duckdb:parquet 90421305 / 90293112 / +0.1% 108217159 / 108433081 / -0.2% 0.84 / 0.83 / +0.3%
job_q64/duckdb:parquet 160254777 / 160392261 / -0.1% 185745340 / 183798688 / +1.1% 0.86 / 0.87 / -1.1%
job_q65/duckdb:parquet 111305440 / 111785482 / -0.4% 126735881 / 130979175 / -3.2% 0.88 / 0.85 / +2.9%
job_q66/duckdb:parquet 186479997 / 187673834 / -0.6% 210670258 / 210924182 / -0.1% 0.89 / 0.89 / -0.5%
job_q67/duckdb:parquet 199058294 / 235554284 / -15.5% 🟢 191850052 / 194734683 / -1.5% 1.04 / 1.21 / -14.2%
job_q68/duckdb:parquet 177080582 / 201618068 / -12.2% 🟢 233718831 / 211969233 / +10.3% 🔴 0.76 / 0.95 / -20.3%
job_q69/duckdb:parquet 305638606 / 303148658 / +0.8% 350979809 / 328477194 / +6.9% 0.87 / 0.92 / -5.6%
job_q70/duckdb:parquet 226641594 / 232727100 / -2.6% 261241620 / 275719892 / -5.3% 0.87 / 0.84 / +2.8%
job_q71/duckdb:parquet 202913208 / 201087338 / +0.9% 223440251 / 231008912 / -3.3% 0.91 / 0.87 / +4.3%
job_q72/duckdb:parquet 286329280 / 289031971 / -0.9% 308711105 / 304878667 / +1.3% 0.93 / 0.95 / -2.2%
job_q73/duckdb:parquet 197639666 / 197681722 / -0.0% 220063064 / 217422248 / +1.2% 0.90 / 0.91 / -1.2%
job_q74/duckdb:parquet 195336185 / 196157739 / -0.4% 219558182 / 223593842 / -1.8% 0.89 / 0.88 / +1.4%
job_q75/duckdb:parquet 225716540 / 226094146 / -0.2% 251903618 / 254885817 / -1.2% 0.90 / 0.89 / +1.0%
job_q76/duckdb:parquet 135066890 / 138377020 / -2.4% 159219709 / 147406175 / +8.0% 0.85 / 0.94 / -9.6%
job_q77/duckdb:parquet 123681136 / 125375132 / -1.4% 152250425 / 142065913 / +7.2% 0.81 / 0.88 / -8.0%
job_q78/duckdb:parquet 129994506 / 128537676 / +1.1% 147668409 / 157260127 / -6.1% 0.88 / 0.82 / +7.7%
job_q79/duckdb:parquet 256351602 / 261050704 / -1.8% 272986694 / 278890947 / -2.1% 0.94 / 0.94 / +0.3%
job_q80/duckdb:parquet 244687117 / 259602063 / -5.7% 254810106 / 263101302 / -3.2% 0.96 / 0.99 / -2.7%
job_q81/duckdb:parquet 384379754 / 369246027 / +4.1% 389920711 / 392518574 / -0.7% 0.99 / 0.94 / +4.8%
job_q82/duckdb:parquet 282409448 / 279946662 / +0.9% 321953926 / 310772685 / +3.6% 0.88 / 0.90 / -2.6%
job_q83/duckdb:parquet 122558384 / 121582855 / +0.8% 168451604 / 175329013 / -3.9% 0.73 / 0.69 / +4.9%
job_q84/duckdb:parquet 123162840 / 131545363 / -6.4% 144869310 / 133819384 / +8.3% 0.85 / 0.98 / -13.5%
job_q85/duckdb:parquet 143804494 / 158702740 / -9.4% 157036343 / 183123844 / -14.2% 🟢 0.92 / 0.87 / +5.7%
job_q86/duckdb:parquet 230757308 / 221380752 / +4.2% 251201269 / 265559366 / -5.4% 0.92 / 0.83 / +10.2%
job_q87/duckdb:parquet 209145562 / 205757285 / +1.6% 234053978 / 219796926 / +6.5% 0.89 / 0.94 / -4.5%
job_q88/duckdb:parquet 199528932 / 191503395 / +4.2% 239938381 / 227723860 / +5.4% 0.83 / 0.84 / -1.1%
job_q89/duckdb:parquet 165300806 / 163932156 / +0.8% 208830834 / 201815853 / +3.5% 0.79 / 0.81 / -2.6%
job_q90/duckdb:parquet 213961061 / 219355608 / -2.5% 254565639 / 268079108 / -5.0% 0.84 / 0.82 / +2.7%
job_q91/duckdb:parquet 256778764 / 257240926 / -0.2% 287318175 / 287077803 / +0.1% 0.89 / 0.90 / -0.3%
job_q92/duckdb:parquet 199728932 / 198430083 / +0.7% 224515208 / 230721734 / -2.7% 0.89 / 0.86 / +3.4%
job_q93/duckdb:parquet 241707829 / 241332840 / +0.2% 271069204 / 271665570 / -0.2% 0.89 / 0.89 / +0.4%
job_q94/duckdb:parquet 142895778 / 135966948 / +5.1% 158034393 / 171181923 / -7.7% 0.90 / 0.79 / +13.8%
job_q95/duckdb:parquet 131739017 / 129199125 / +2.0% 151209952 / 152627916 / -0.9% 0.87 / 0.85 / +2.9%
job_q96/duckdb:parquet 137933354 / 140725824 / -2.0% 165562043 / 154909630 / +6.9% 0.83 / 0.91 / -8.3%
job_q97/duckdb:parquet 259754252 / 260502758 / -0.3% 293245330 / 302780767 / -3.1% 0.89 / 0.86 / +3.0%
job_q98/duckdb:parquet 193764162 / 209592849 / -7.6% 217735774 / 243511130 / -10.6% 🟢 0.89 / 0.86 / +3.4%
job_q99/duckdb:parquet 328569434 / 253536782 / +29.6% 🔴 300698935 / 264596205 / +13.6% 🔴 1.09 / 0.96 / +14.0%
duckdb / duckdb / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7809132 / 7720716 / +1.1% 16758780 / 17330285 / -3.3% 0.47 / 0.45 / +4.6%
job_q02/duckdb:duckdb 5826928 / 5722692 / +1.8% 12824782 / 13020094 / -1.5% 0.45 / 0.44 / +3.4%
job_q03/duckdb:duckdb 6211970 / 6129235 / +1.3% 14110896 / 14084589 / +0.2% 0.44 / 0.44 / +1.2%
job_q04/duckdb:duckdb 5781334 / 5955482 / -2.9% 13263698 / 13131025 / +1.0% 0.44 / 0.45 / -3.9%
job_q05/duckdb:duckdb 14565357 / 14555850 / +0.1% 25834255 / 25599842 / +0.9% 0.56 / 0.57 / -0.8%
job_q06/duckdb:duckdb 14209576 / 14259814 / -0.4% 24841286 / 25348133 / -2.0% 0.57 / 0.56 / +1.7%
job_q07/duckdb:duckdb 10873361 / 11084309 / -1.9% 19855423 / 20343323 / -2.4% 0.55 / 0.54 / +0.5%
job_q08/duckdb:duckdb 16370919 / 16480499 / -0.7% 27359311 / 27810215 / -1.6% 0.60 / 0.59 / +1.0%
job_q09/duckdb:duckdb 63369442 / 63430571 / -0.1% 89225926 / 88851493 / +0.4% 0.71 / 0.71 / -0.5%
job_q10/duckdb:duckdb 41269608 / 41121750 / +0.4% 74117603 / 69915365 / +6.0% 0.56 / 0.59 / -5.3%
job_q100/duckdb:duckdb 24193362 / 23891170 / +1.3% 43817118 / 44551491 / -1.6% 0.55 / 0.54 / +3.0%
job_q101/duckdb:duckdb 24978960 / 25571740 / -2.3% 52011205 / 47319448 / +9.9% 0.48 / 0.54 / -11.1%
job_q102/duckdb:duckdb 45402938 / 44432551 / +2.2% 70861741 / 72025606 / -1.6% 0.64 / 0.62 / +3.9%
job_q103/duckdb:duckdb 54179162 / 54293488 / -0.2% 84525326 / 83926555 / +0.7% 0.64 / 0.65 / -0.9%
job_q104/duckdb:duckdb 46439690 / 46499362 / -0.1% 72528774 / 72968132 / -0.6% 0.64 / 0.64 / +0.5%
job_q105/duckdb:duckdb 74059646 / 73591612 / +0.6% 103401355 / 103797842 / -0.4% 0.72 / 0.71 / +1.0%
job_q106/duckdb:duckdb 64526785 / 64120022 / +0.6% 94069928 / 92517410 / +1.7% 0.69 / 0.69 / -1.0%
job_q107/duckdb:duckdb 59062222 / 59283117 / -0.4% 88018949 / 87354314 / +0.8% 0.67 / 0.68 / -1.1%
job_q108/duckdb:duckdb 75938536 / 75197704 / +1.0% 107185343 / 107096930 / +0.1% 0.71 / 0.70 / +0.9%
job_q109/duckdb:duckdb 7087355 / 7109006 / -0.3% 15945278 / 15812921 / +0.8% 0.44 / 0.45 / -1.1%
job_q11/duckdb:duckdb 47063668 / 47919484 / -1.8% 81687866 / 86453735 / -5.5% 0.58 / 0.55 / +3.9%
job_q110/duckdb:duckdb 13910594 / 13861366 / +0.4% 23738239 / 23275780 / +2.0% 0.59 / 0.60 / -1.6%
job_q111/duckdb:duckdb 16362822 / 16559942 / -1.2% 27991709 / 28920676 / -3.2% 0.58 / 0.57 / +2.1%
job_q112/duckdb:duckdb 22229896 / 22147844 / +0.4% 34316581 / 33839755 / +1.4% 0.65 / 0.65 / -1.0%
job_q113/duckdb:duckdb 18399200 / 18453862 / -0.3% 31365029 / 31928801 / -1.8% 0.59 / 0.58 / +1.5%
job_q12/duckdb:duckdb 27689386 / 27657552 / +0.1% 37713129 / 36984321 / +2.0% 0.73 / 0.75 / -1.8%
job_q13/duckdb:duckdb 10225896 / 10086798 / +1.4% 18576634 / 18632442 / -0.3% 0.55 / 0.54 / +1.7%
job_q14/duckdb:duckdb 35533174 / 35758558 / -0.6% 46773955 / 46259290 / +1.1% 0.76 / 0.77 / -1.7%
job_q15/duckdb:duckdb 55306972 / 55644462 / -0.6% 85935835 / 89859028 / -4.4% 0.64 / 0.62 / +3.9%
job_q16/duckdb:duckdb 45892418 / 45777448 / +0.3% 75041269 / 78780114 / -4.7% 0.61 / 0.58 / +5.2%
job_q17/duckdb:duckdb 54696302 / 54685816 / +0.0% 87773258 / 84116836 / +4.3% 0.62 / 0.65 / -4.1%
job_q18/duckdb:duckdb 22294028 / 21924060 / +1.7% 44219483 / 41659916 / +6.1% 0.50 / 0.53 / -4.2%
job_q19/duckdb:duckdb 12092836 / 12121424 / -0.2% 21111454 / 20620637 / +2.4% 0.57 / 0.59 / -2.6%
job_q20/duckdb:duckdb 15392979 / 15342961 / +0.3% 33084017 / 33474378 / -1.2% 0.47 / 0.46 / +1.5%
job_q21/duckdb:duckdb 22529480 / 22372667 / +0.7% 33412887 / 32935586 / +1.4% 0.67 / 0.68 / -0.7%
job_q22/duckdb:duckdb 21443041 / 21802608 / -1.6% 43703189 / 43921154 / -0.5% 0.49 / 0.50 / -1.2%
job_q23/duckdb:duckdb 40437324 / 40299677 / +0.3% 56288065 / 57644513 / -2.4% 0.72 / 0.70 / +2.8%
job_q24/duckdb:duckdb 16595807 / 17196650 / -3.5% 33944780 / 33315232 / +1.9% 0.49 / 0.52 / -5.3%
job_q25/duckdb:duckdb 15561701 / 15428379 / +0.9% 28445563 / 31074592 / -8.5% 0.55 / 0.50 / +10.2%
job_q26/duckdb:duckdb 78247520 / 77559372 / +0.9% 129537459 / 127641316 / +1.5% 0.60 / 0.61 / -0.6%
job_q27/duckdb:duckdb 26342528 / 26914099 / -2.1% 42891979 / 43673292 / -1.8% 0.61 / 0.62 / -0.3%
job_q28/duckdb:duckdb 25029660 / 25258743 / -0.9% 41208123 / 41454584 / -0.6% 0.61 / 0.61 / -0.3%
job_q29/duckdb:duckdb 86881785 / 86194119 / +0.8% 98349558 / 99450388 / -1.1% 0.88 / 0.87 / +1.9%
job_q30/duckdb:duckdb 56255420 / 55491273 / +1.4% 69777042 / 70620743 / -1.2% 0.81 / 0.79 / +2.6%
job_q31/duckdb:duckdb 67313836 / 67102728 / +0.3% 89876675 / 90260469 / -0.4% 0.75 / 0.74 / +0.7%
job_q32/duckdb:duckdb 47643338 / 47758017 / -0.2% 72333537 / 72183099 / +0.2% 0.66 / 0.66 / -0.4%
job_q33/duckdb:duckdb 58310460 / 57746332 / +1.0% 77277599 / 78523620 / -1.6% 0.75 / 0.74 / +2.6%
job_q34/duckdb:duckdb 92343650 / 92541517 / -0.2% 114605146 / 114105928 / +0.4% 0.81 / 0.81 / -0.6%
job_q35/duckdb:duckdb 21992582 / 22073977 / -0.4% 39476823 / 40968406 / -3.6% 0.56 / 0.54 / +3.4%
job_q36/duckdb:duckdb 15736563 / 15239644 / +3.3% 31561946 / 31710518 / -0.5% 0.50 / 0.48 / +3.7%
job_q37/duckdb:duckdb 52191032 / 51861985 / +0.6% 74950182 / 74861104 / +0.1% 0.70 / 0.69 / +0.5%
job_q38/duckdb:duckdb 17380093 / 17047351 / +2.0% 30899219 / 33129676 / -6.7% 0.56 / 0.51 / +9.3%
job_q39/duckdb:duckdb 13614746 / 13912280 / -2.1% 27200868 / 28167727 / -3.4% 0.50 / 0.49 / +1.3%
job_q40/duckdb:duckdb 25829269 / 25316644 / +2.0% 37824179 / 38062027 / -0.6% 0.68 / 0.67 / +2.7%
job_q41/duckdb:duckdb 41166704 / 41037267 / +0.3% 52750489 / 52698642 / +0.1% 0.78 / 0.78 / +0.2%
job_q42/duckdb:duckdb 20553994 / 20467444 / +0.4% 31346631 / 31838603 / -1.5% 0.66 / 0.64 / +2.0%
job_q43/duckdb:duckdb 24019726 / 23958752 / +0.3% 35390174 / 36289276 / -2.5% 0.68 / 0.66 / +2.8%
job_q44/duckdb:duckdb 29160465 / 29307725 / -0.5% 39660209 / 40405841 / -1.8% 0.74 / 0.73 / +1.4%
job_q45/duckdb:duckdb 21997180 / 21987023 / +0.0% 35375233 / 33929531 / +4.3% 0.62 / 0.65 / -4.0%
job_q46/duckdb:duckdb 34979538 / 34529850 / +1.3% 47930905 / 46965706 / +2.1% 0.73 / 0.74 / -0.7%
job_q47/duckdb:duckdb 32073943 / 32189709 / -0.4% 44592954 / 44447997 / +0.3% 0.72 / 0.72 / -0.7%
job_q48/duckdb:duckdb 58260618 / 58799442 / -0.9% 71180731 / 71125031 / +0.1% 0.82 / 0.83 / -1.0%
job_q49/duckdb:duckdb 52354801 / 52627942 / -0.5% 67509549 / 67827512 / -0.5% 0.78 / 0.78 / -0.1%
job_q50/duckdb:duckdb 27073339 / 27236970 / -0.6% 39489310 / 39602804 / -0.3% 0.69 / 0.69 / -0.3%
job_q51/duckdb:duckdb 39182408 / 39471244 / -0.7% 51755601 / 50931444 / +1.6% 0.76 / 0.77 / -2.3%
job_q52/duckdb:duckdb 34698289 / 34753924 / -0.2% 50337320 / 50889446 / -1.1% 0.69 / 0.68 / +0.9%
job_q53/duckdb:duckdb 22230931 / 22212809 / +0.1% 36153986 / 38222810 / -5.4% 0.61 / 0.58 / +5.8%
job_q54/duckdb:duckdb 58748094 / 58544305 / +0.3% 75816828 / 74198388 / +2.2% 0.77 / 0.79 / -1.8%
job_q55/duckdb:duckdb 66445280 / 64781098 / +2.6% 81761279 / 83034432 / -1.5% 0.81 / 0.78 / +4.2%
job_q56/duckdb:duckdb 25026636 / 24982931 / +0.2% 46897042 / 47726061 / -1.7% 0.53 / 0.52 / +1.9%
job_q57/duckdb:duckdb 112071646 / 113011576 / -0.8% 132644253 / 133667690 / -0.8% 0.84 / 0.85 / -0.1%
job_q58/duckdb:duckdb 45498298 / 45197218 / +0.7% 68621552 / 69108998 / -0.7% 0.66 / 0.65 / +1.4%
job_q59/duckdb:duckdb 43005906 / 42057660 / +2.3% 65446591 / 65179896 / +0.4% 0.66 / 0.65 / +1.8%
job_q60/duckdb:duckdb 48166700 / 47777032 / +0.8% 65440597 / 66157550 / -1.1% 0.74 / 0.72 / +1.9%
job_q61/duckdb:duckdb 54685550 / 53688530 / +1.9% 71625783 / 72802295 / -1.6% 0.76 / 0.74 / +3.5%
job_q62/duckdb:duckdb 52695669 / 51999793 / +1.3% 70995587 / 71621748 / -0.9% 0.74 / 0.73 / +2.2%
job_q63/duckdb:duckdb 58084318 / 58985978 / -1.5% 76292947 / 78264937 / -2.5% 0.76 / 0.75 / +1.0%
job_q64/duckdb:duckdb 46494872 / 46502848 / -0.0% 66560524 / 64981121 / +2.4% 0.70 / 0.72 / -2.4%
job_q65/duckdb:duckdb 75105869 / 73590920 / +2.1% 90912855 / 91658696 / -0.8% 0.83 / 0.80 / +2.9%
job_q66/duckdb:duckdb 54270060 / 53797546 / +0.9% 84601191 / 83270502 / +1.6% 0.64 / 0.65 / -0.7%
job_q67/duckdb:duckdb 24209902 / 24143789 / +0.3% 48032368 / 49638216 / -3.2% 0.50 / 0.49 / +3.6%
job_q68/duckdb:duckdb 53705202 / 52860478 / +1.6% 77898864 / 77445295 / +0.6% 0.69 / 0.68 / +1.0%
job_q69/duckdb:duckdb 77157802 / 76529370 / +0.8% 96618150 / 97644894 / -1.1% 0.80 / 0.78 / +1.9%
job_q70/duckdb:duckdb 46884872 / 47780714 / -1.9% 66041369 / 66280845 / -0.4% 0.71 / 0.72 / -1.5%
job_q71/duckdb:duckdb 79733094 / 79406012 / +0.4% 102204137 / 100766811 / +1.4% 0.78 / 0.79 / -1.0%
job_q72/duckdb:duckdb 111138854 / 109748568 / +1.3% 131610885 / 129249154 / +1.8% 0.84 / 0.85 / -0.6%
job_q73/duckdb:duckdb 65111054 / 64613000 / +0.8% 87772738 / 87815083 / -0.0% 0.74 / 0.74 / +0.8%
job_q74/duckdb:duckdb 62101653 / 62455716 / -0.6% 85417531 / 85963494 / -0.6% 0.73 / 0.73 / +0.1%
job_q75/duckdb:duckdb 54663820 / 54671441 / -0.0% 78067885 / 76916692 / +1.5% 0.70 / 0.71 / -1.5%
job_q76/duckdb:duckdb 22923352 / 23722520 / -3.4% 44042386 / 41442537 / +6.3% 0.52 / 0.57 / -9.1%
job_q77/duckdb:duckdb 21333240 / 21852540 / -2.4% 35214423 / 35624663 / -1.2% 0.61 / 0.61 / -1.2%
job_q78/duckdb:duckdb 23848181 / 24207794 / -1.5% 42407567 / 42292678 / +0.3% 0.56 / 0.57 / -1.8%
job_q79/duckdb:duckdb 62215715 / 62916238 / -1.1% 80302127 / 81199978 / -1.1% 0.77 / 0.77 / -0.0%
job_q80/duckdb:duckdb 45890816 / 46901063 / -2.2% 63684805 / 63739102 / -0.1% 0.72 / 0.74 / -2.1%
job_q81/duckdb:duckdb 102197046 / 102524986 / -0.3% 122146427 / 120988878 / +1.0% 0.84 / 0.85 / -1.3%
job_q82/duckdb:duckdb 143703540 / 143163680 / +0.4% 162216068 / 160627516 / +1.0% 0.89 / 0.89 / -0.6%
job_q83/duckdb:duckdb 47638057 / 48013596 / -0.8% 63790765 / 63024623 / +1.2% 0.75 / 0.76 / -2.0%
job_q84/duckdb:duckdb 26576552 / 26448404 / +0.5% 41365885 / 41914368 / -1.3% 0.64 / 0.63 / +1.8%
job_q85/duckdb:duckdb 49438622 / 49440880 / -0.0% 64930530 / 65549521 / -0.9% 0.76 / 0.75 / +0.9%
job_q86/duckdb:duckdb 54130572 / 54333558 / -0.4% 80727008 / 79682198 / +1.3% 0.67 / 0.68 / -1.7%
job_q87/duckdb:duckdb 32493510 / 33835240 / -4.0% 59200434 / 53968631 / +9.7% 0.55 / 0.63 / -12.5%
job_q88/duckdb:duckdb 48550578 / 48311512 / +0.5% 77043940 / 76997032 / +0.1% 0.63 / 0.63 / +0.4%
job_q89/duckdb:duckdb 25633408 / 25923015 / -1.1% 49216966 / 48158905 / +2.2% 0.52 / 0.54 / -3.2%
job_q90/duckdb:duckdb 59212964 / 59355318 / -0.2% 86054302 / 85766033 / +0.3% 0.69 / 0.69 / -0.6%
job_q91/duckdb:duckdb 55159544 / 54202558 / +1.8% 83572479 / 83848287 / -0.3% 0.66 / 0.65 / +2.1%
job_q92/duckdb:duckdb 34481986 / 34501532 / -0.1% 59845772 / 61345741 / -2.4% 0.58 / 0.56 / +2.4%
job_q93/duckdb:duckdb 79642319 / 80067060 / -0.5% 108748082 / 107893780 / +0.8% 0.73 / 0.74 / -1.3%
job_q94/duckdb:duckdb 21371358 / 21988228 / -2.8% 36575448 / 38126570 / -4.1% 0.58 / 0.58 / +1.3%
job_q95/duckdb:duckdb 20451366 / 20755668 / -1.5% 34521687 / 36867034 / -6.4% 0.59 / 0.56 / +5.2%
job_q96/duckdb:duckdb 21149582 / 22451806 / -5.8% 39090229 / 37560657 / +4.1% 0.54 / 0.60 / -9.5%
job_q97/duckdb:duckdb 88173313 / 86902478 / +1.5% 104862941 / 104790727 / +0.1% 0.84 / 0.83 / +1.4%
job_q98/duckdb:duckdb 45633281 / 45989155 / -0.8% 63327617 / 63374529 / -0.1% 0.72 / 0.73 / -0.7%
job_q99/duckdb:duckdb 77982589 / 77539460 / +0.6% 97772867 / 98087893 / -0.3% 0.80 / 0.79 / +0.9%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.985x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.994x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20963058 / 21435576 / -2.2% 38008110 / 39030788 / -2.6% 0.55 / 0.55 / +0.4%
tpcds_q02/datafusion:vortex-file-compressed 43567467 / 44321528 / -1.7% 65162524 / 64840499 / +0.5% 0.67 / 0.68 / -2.2%
tpcds_q03/datafusion:vortex-file-compressed 11064805 / 11101562 / -0.3% 27758458 / 28483505 / -2.5% 0.40 / 0.39 / +2.3%
tpcds_q04/datafusion:vortex-file-compressed 86728037 / 87530922 / -0.9% 119810056 / 118799544 / +0.9% 0.72 / 0.74 / -1.8%
tpcds_q05/datafusion:vortex-file-compressed 56480871 / 56789593 / -0.5% 82492239 / 79243069 / +4.1% 0.68 / 0.72 / -4.5%
tpcds_q06/datafusion:vortex-file-compressed 22731620 / 22795391 / -0.3% 43703806 / 43844323 / -0.3% 0.52 / 0.52 / +0.0%
tpcds_q07/datafusion:vortex-file-compressed 29177043 / 29419452 / -0.8% 49868401 / 49462495 / +0.8% 0.59 / 0.59 / -1.6%
tpcds_q08/datafusion:vortex-file-compressed 24823792 / 24948514 / -0.5% 43176159 / 44016483 / -1.9% 0.57 / 0.57 / +1.4%
tpcds_q09/datafusion:vortex-file-compressed 20790591 / 20482256 / +1.5% 37235200 / 38059529 / -2.2% 0.56 / 0.54 / +3.8%
tpcds_q10/datafusion:vortex-file-compressed 26881356 / 26975000 / -0.3% 48186517 / 50252066 / -4.1% 0.56 / 0.54 / +3.9%
tpcds_q11/datafusion:vortex-file-compressed 52197723 / 53293042 / -2.1% 82316691 / 85800363 / -4.1% 0.63 / 0.62 / +2.1%
tpcds_q12/datafusion:vortex-file-compressed 14772500 / 15269672 / -3.3% 30326763 / 32788205 / -7.5% 0.49 / 0.47 / +4.6%
tpcds_q13/datafusion:vortex-file-compressed 31667788 / 31234190 / +1.4% 55240173 / 57788622 / -4.4% 0.57 / 0.54 / +6.1%
tpcds_q14/datafusion:vortex-file-compressed 488613976 / 487924870 / +0.1% 543158245 / 547884917 / -0.9% 0.90 / 0.89 / +1.0%
tpcds_q15/datafusion:vortex-file-compressed 12368426 / 12399262 / -0.2% 32076800 / 33366724 / -3.9% 0.39 / 0.37 / +3.8%
tpcds_q16/datafusion:vortex-file-compressed 18526020 / 18082488 / +2.5% 37810512 / 39543817 / -4.4% 0.49 / 0.46 / +7.1%
tpcds_q17/datafusion:vortex-file-compressed 50936095 / 55027498 / -7.4% 78425503 / 69271397 / +13.2% 🔴 0.65 / 0.79 / -18.2%
tpcds_q18/datafusion:vortex-file-compressed 62823748 / 64136102 / -2.0% 85225635 / 87913952 / -3.1% 0.74 / 0.73 / +1.0%
tpcds_q19/datafusion:vortex-file-compressed 16751728 / 16697482 / +0.3% 37305407 / 39300021 / -5.1% 0.45 / 0.42 / +5.7%
tpcds_q20/datafusion:vortex-file-compressed 16462528 / 16094282 / +2.3% 34304003 / 35233598 / -2.6% 0.48 / 0.46 / +5.1%
tpcds_q21/datafusion:vortex-file-compressed 16499642 / 16229758 / +1.7% 39184690 / 38348599 / +2.2% 0.42 / 0.42 / -0.5%
tpcds_q22/datafusion:vortex-file-compressed 49474564 / 49680336 / -0.4% 71088603 / 73275771 / -3.0% 0.70 / 0.68 / +2.6%
tpcds_q23/datafusion:vortex-file-compressed 69326634 / 70076106 / -1.1% 96554732 / 100463279 / -3.9% 0.72 / 0.70 / +2.9%
tpcds_q24/datafusion:vortex-file-compressed 64674482 / 64718344 / -0.1% 86289689 / 88569720 / -2.6% 0.75 / 0.73 / +2.6%
tpcds_q25/datafusion:vortex-file-compressed 47293568 / 43897674 / +7.7% 66835437 / 76438646 / -12.6% 🟢 0.71 / 0.57 / +23.2%
tpcds_q26/datafusion:vortex-file-compressed 26169574 / 26173396 / -0.0% 46957723 / 48655475 / -3.5% 0.56 / 0.54 / +3.6%
tpcds_q27/datafusion:vortex-file-compressed 56599564 / 59801462 / -5.4% 80221091 / 80541831 / -0.4% 0.71 / 0.74 / -5.0%
tpcds_q28/datafusion:vortex-file-compressed 24530048 / 24821664 / -1.2% 43260286 / 40859411 / +5.9% 0.57 / 0.61 / -6.7%
tpcds_q29/datafusion:vortex-file-compressed 53415434 / 52833387 / +1.1% 78876292 / 67949781 / +16.1% 🔴 0.68 / 0.78 / -12.9%
tpcds_q30/datafusion:vortex-file-compressed 26588978 / 26371047 / +0.8% 44087563 / 44565694 / -1.1% 0.60 / 0.59 / +1.9%
tpcds_q31/datafusion:vortex-file-compressed 58523910 / 59005755 / -0.8% 84041172 / 85701344 / -1.9% 0.70 / 0.69 / +1.1%
tpcds_q32/datafusion:vortex-file-compressed 12349669 / 12383069 / -0.3% 28899094 / 30709183 / -5.9% 0.43 / 0.40 / +6.0%
tpcds_q33/datafusion:vortex-file-compressed 27292738 / 27592278 / -1.1% 47948822 / 51390898 / -6.7% 0.57 / 0.54 / +6.0%
tpcds_q34/datafusion:vortex-file-compressed 17453307 / 17347858 / +0.6% 37713597 / 38312810 / -1.6% 0.46 / 0.45 / +2.2%
tpcds_q35/datafusion:vortex-file-compressed 30417602 / 31092478 / -2.2% 53958116 / 53781847 / +0.3% 0.56 / 0.58 / -2.5%
tpcds_q36/datafusion:vortex-file-compressed 47634632 / 47296636 / +0.7% 68768213 / 71276166 / -3.5% 0.69 / 0.66 / +4.4%
tpcds_q37/datafusion:vortex-file-compressed 11860198 / 11804677 / +0.5% 31315280 / 33168800 / -5.6% 0.38 / 0.36 / +6.4%
tpcds_q38/datafusion:vortex-file-compressed 25355200 / 25294106 / +0.2% 47228090 / 47942062 / -1.5% 0.54 / 0.53 / +1.8%
tpcds_q39/datafusion:vortex-file-compressed 64665568 / 64533545 / +0.2% 89634579 / 89433396 / +0.2% 0.72 / 0.72 / -0.0%
tpcds_q40/datafusion:vortex-file-compressed 23467820 / 23071143 / +1.7% 42753254 / 45932954 / -6.9% 0.55 / 0.50 / +9.3%
tpcds_q41/datafusion:vortex-file-compressed 20669566 / 20733250 / -0.3% 32531621 / 33341949 / -2.4% 0.64 / 0.62 / +2.2%
tpcds_q42/datafusion:vortex-file-compressed 10847442 / 11045210 / -1.8% 26545594 / 28142604 / -5.7% 0.41 / 0.39 / +4.1%
tpcds_q43/datafusion:vortex-file-compressed 12481170 / 12534744 / -0.4% 32181564 / 34071845 / -5.5% 0.39 / 0.37 / +5.4%
tpcds_q44/datafusion:vortex-file-compressed 28739685 / 28793451 / -0.2% 51384501 / 53365503 / -3.7% 0.56 / 0.54 / +3.7%
tpcds_q45/datafusion:vortex-file-compressed 16273749 / 16008959 / +1.7% 33480158 / 35846107 / -6.6% 0.49 / 0.45 / +8.8%
tpcds_q46/datafusion:vortex-file-compressed 23527046 / 23018390 / +2.2% 47469889 / 48653049 / -2.4% 0.50 / 0.47 / +4.8%
tpcds_q47/datafusion:vortex-file-compressed 74855370 / 74871846 / -0.0% 103312358 / 105173771 / -1.8% 0.72 / 0.71 / +1.8%
tpcds_q48/datafusion:vortex-file-compressed 29185864 / 29367064 / -0.6% 49006652 / 52581237 / -6.8% 0.60 / 0.56 / +6.6%
tpcds_q49/datafusion:vortex-file-compressed 57887259 / 57989192 / -0.2% 83658713 / 83843343 / -0.2% 0.69 / 0.69 / +0.0%
tpcds_q50/datafusion:vortex-file-compressed 30264628 / 30003057 / +0.9% 50417314 / 51340694 / -1.8% 0.60 / 0.58 / +2.7%
tpcds_q51/datafusion:vortex-file-compressed 66216350 / 66108254 / +0.2% 86086677 / 89277824 / -3.6% 0.77 / 0.74 / +3.9%
tpcds_q52/datafusion:vortex-file-compressed 11313254 / 11944956 / -5.3% 27456965 / 27810829 / -1.3% 0.41 / 0.43 / -4.1%
tpcds_q53/datafusion:vortex-file-compressed 17646928 / 17745132 / -0.6% 37957141 / 38863048 / -2.3% 0.46 / 0.46 / +1.8%
tpcds_q54/datafusion:vortex-file-compressed 31583541 / 31803540 / -0.7% 54130799 / 55045084 / -1.7% 0.58 / 0.58 / +1.0%
tpcds_q55/datafusion:vortex-file-compressed 10890588 / 10990346 / -0.9% 28048517 / 26378496 / +6.3% 0.39 / 0.42 / -6.8%
tpcds_q56/datafusion:vortex-file-compressed 26368752 / 26532865 / -0.6% 45861856 / 49521939 / -7.4% 0.57 / 0.54 / +7.3%
tpcds_q57/datafusion:vortex-file-compressed 61720664 / 62703262 / -1.6% 86248920 / 87634339 / -1.6% 0.72 / 0.72 / +0.0%
tpcds_q58/datafusion:vortex-file-compressed 38657364 / 38602859 / +0.1% 61318128 / 63174053 / -2.9% 0.63 / 0.61 / +3.2%
tpcds_q59/datafusion:vortex-file-compressed 30291184 / 29771950 / +1.7% 53318479 / 54831718 / -2.8% 0.57 / 0.54 / +4.6%
tpcds_q60/datafusion:vortex-file-compressed 26024873 / 26569209 / -2.0% 46675798 / 47811161 / -2.4% 0.56 / 0.56 / +0.3%
tpcds_q61/datafusion:vortex-file-compressed 21356360 / 21386949 / -0.1% 43161214 / 45639226 / -5.4% 0.49 / 0.47 / +5.6%
tpcds_q62/datafusion:vortex-file-compressed 16282712 / 16544576 / -1.6% 33688761 / 35557052 / -5.3% 0.48 / 0.47 / +3.9%
tpcds_q63/datafusion:vortex-file-compressed 17592722 / 17538004 / +0.3% 37924568 / 39858977 / -4.9% 0.46 / 0.44 / +5.4%
tpcds_q64/datafusion:vortex-file-compressed 210478806 / 212087556 / -0.8% 246432778 / 248367165 / -0.8% 0.85 / 0.85 / +0.0%
tpcds_q65/datafusion:vortex-file-compressed 72697076 / 72545932 / +0.2% 94557405 / 97757963 / -3.3% 0.77 / 0.74 / +3.6%
tpcds_q66/datafusion:vortex-file-compressed 50111132 / 51116092 / -2.0% 73577493 / 74064982 / -0.7% 0.68 / 0.69 / -1.3%
tpcds_q67/datafusion:vortex-file-compressed 50684464 / 50433134 / +0.5% 82373180 / 83124247 / -0.9% 0.62 / 0.61 / +1.4%
tpcds_q68/datafusion:vortex-file-compressed 22795764 / 22622334 / +0.8% 45947343 / 49170862 / -6.6% 0.50 / 0.46 / +7.8%
tpcds_q69/datafusion:vortex-file-compressed 26134121 / 25944613 / +0.7% 46957993 / 47606652 / -1.4% 0.56 / 0.54 / +2.1%
tpcds_q70/datafusion:vortex-file-compressed 71171068 / 70918592 / +0.4% 93598734 / 94154931 / -0.6% 0.76 / 0.75 / +1.0%
tpcds_q71/datafusion:vortex-file-compressed 18916016 / 17795102 / +6.3% 38298778 / 40546062 / -5.5% 0.49 / 0.44 / +12.5%
tpcds_q72/datafusion:vortex-file-compressed 347984147 / 349332490 / -0.4% 407023037 / 419201886 / -2.9% 0.85 / 0.83 / +2.6%
tpcds_q73/datafusion:vortex-file-compressed 16172730 / 16341988 / -1.0% 36134517 / 38119230 / -5.2% 0.45 / 0.43 / +4.4%
tpcds_q74/datafusion:vortex-file-compressed 40219446 / 40285274 / -0.2% 68853440 / 68552562 / +0.4% 0.58 / 0.59 / -0.6%
tpcds_q75/datafusion:vortex-file-compressed 134064970 / 132421868 / +1.2% 167184432 / 166873584 / +0.2% 0.80 / 0.79 / +1.1%
tpcds_q76/datafusion:vortex-file-compressed 28954338 / 29908462 / -3.2% 48430721 / 47240746 / +2.5% 0.60 / 0.63 / -5.6%
tpcds_q77/datafusion:vortex-file-compressed 44875153 / 45081920 / -0.5% 64733514 / 64989680 / -0.4% 0.69 / 0.69 / -0.1%
tpcds_q78/datafusion:vortex-file-compressed 64146336 / 63671576 / +0.7% 93585494 / 94996980 / -1.5% 0.69 / 0.67 / +2.3%
tpcds_q79/datafusion:vortex-file-compressed 20008368 / 19509320 / +2.6% 42332208 / 43465492 / -2.6% 0.47 / 0.45 / +5.3%
tpcds_q80/datafusion:vortex-file-compressed 73156544 / 72407218 / +1.0% 99427211 / 101191121 / -1.7% 0.74 / 0.72 / +2.8%
tpcds_q81/datafusion:vortex-file-compressed 26422734 / 26774176 / -1.3% 43620248 / 44735744 / -2.5% 0.61 / 0.60 / +1.2%
tpcds_q82/datafusion:vortex-file-compressed 12245021 / 11449353 / +6.9% 33942348 / 34422533 / -1.4% 0.36 / 0.33 / +8.5%
tpcds_q83/datafusion:vortex-file-compressed 33713521 / 32907293 / +2.4% 49129805 / 50555407 / -2.8% 0.69 / 0.65 / +5.4%
tpcds_q84/datafusion:vortex-file-compressed 10462818 / 10400319 / +0.6% 25953490 / 26552517 / -2.3% 0.40 / 0.39 / +2.9%
tpcds_q85/datafusion:vortex-file-compressed 53093600 / 53201306 / -0.2% 78344274 / 78935793 / -0.7% 0.68 / 0.67 / +0.6%
tpcds_q86/datafusion:vortex-file-compressed 15726500 / 16126399 / -2.5% 32888550 / 33790607 / -2.7% 0.48 / 0.48 / +0.2%
tpcds_q87/datafusion:vortex-file-compressed 26101441 / 25499982 / +2.4% 48165768 / 49251650 / -2.2% 0.54 / 0.52 / +4.7%
tpcds_q88/datafusion:vortex-file-compressed 31952669 / 31977950 / -0.1% 53921601 / 50728174 / +6.3% 0.59 / 0.63 / -6.0%
tpcds_q89/datafusion:vortex-file-compressed 21323812 / 21212569 / +0.5% 40777214 / 43585244 / -6.4% 0.52 / 0.49 / +7.4%
tpcds_q90/datafusion:vortex-file-compressed 9824311 / 10088066 / -2.6% 24221255 / 25395960 / -4.6% 0.41 / 0.40 / +2.1%
tpcds_q91/datafusion:vortex-file-compressed 15509568 / 15989946 / -3.0% 34347733 / 38232814 / -10.2% 🟢 0.45 / 0.42 / +8.0%
tpcds_q92/datafusion:vortex-file-compressed 12944008 / 12915948 / +0.2% 28029845 / 28491061 / -1.6% 0.46 / 0.45 / +1.9%
tpcds_q93/datafusion:vortex-file-compressed 20708163 / 20349840 / +1.8% 40756756 / 41528814 / -1.9% 0.51 / 0.49 / +3.7%
tpcds_q94/datafusion:vortex-file-compressed 18342348 / 18401196 / -0.3% 36497386 / 38393719 / -4.9% 0.50 / 0.48 / +4.9%
tpcds_q95/datafusion:vortex-file-compressed 41844913 / 41771340 / +0.2% 62918303 / 63290862 / -0.6% 0.67 / 0.66 / +0.8%
tpcds_q96/datafusion:vortex-file-compressed 7659471 / 7462967 / +2.6% 24474551 / 27595414 / -11.3% 🟢 0.31 / 0.27 / +15.7%
tpcds_q97/datafusion:vortex-file-compressed 17273563 / 16801238 / +2.8% 36253919 / 39181580 / -7.5% 0.48 / 0.43 / +11.1%
tpcds_q98/datafusion:vortex-file-compressed 16579559 / 16207834 / +2.3% 35888877 / 38092385 / -5.8% 0.46 / 0.43 / +8.6%
tpcds_q99/datafusion:vortex-file-compressed 16007694 / 15936954 / +0.4% 34569331 / 35243504 / -1.9% 0.46 / 0.45 / +2.4%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21117748 / 21184421 / -0.3% 38774024 / 40639348 / -4.6% 0.54 / 0.52 / +4.5%
tpcds_q02/datafusion:vortex-compact 44597984 / 44155422 / +1.0% 65999297 / 66620877 / -0.9% 0.68 / 0.66 / +2.0%
tpcds_q03/datafusion:vortex-compact 11650670 / 11422584 / +2.0% 31543619 / 30682082 / +2.8% 0.37 / 0.37 / -0.8%
tpcds_q04/datafusion:vortex-compact 92113702 / 93472730 / -1.5% 123439969 / 125172465 / -1.4% 0.75 / 0.75 / -0.1%
tpcds_q05/datafusion:vortex-compact 57118426 / 56965221 / +0.3% 79681725 / 78980634 / +0.9% 0.72 / 0.72 / -0.6%
tpcds_q06/datafusion:vortex-compact 23710918 / 23469892 / +1.0% 44612169 / 47119195 / -5.3% 0.53 / 0.50 / +6.7%
tpcds_q07/datafusion:vortex-compact 31286162 / 31910462 / -2.0% 53201397 / 51739362 / +2.8% 0.59 / 0.62 / -4.7%
tpcds_q08/datafusion:vortex-compact 27382466 / 27589500 / -0.8% 47135388 / 49451733 / -4.7% 0.58 / 0.56 / +4.1%
tpcds_q09/datafusion:vortex-compact 23744219 / 24377756 / -2.6% 41188142 / 41889279 / -1.7% 0.58 / 0.58 / -0.9%
tpcds_q10/datafusion:vortex-compact 30856749 / 30253676 / +2.0% 50903111 / 52955673 / -3.9% 0.61 / 0.57 / +6.1%
tpcds_q11/datafusion:vortex-compact 56888340 / 58283896 / -2.4% 83657286 / 85068982 / -1.7% 0.68 / 0.69 / -0.7%
tpcds_q12/datafusion:vortex-compact 18513827 / 18449310 / +0.3% 36828345 / 37649514 / -2.2% 0.50 / 0.49 / +2.6%
tpcds_q13/datafusion:vortex-compact 47991551 / 48412409 / -0.9% 66041535 / 69749760 / -5.3% 0.73 / 0.69 / +4.7%
tpcds_q14/datafusion:vortex-compact 635917338 / 631354992 / +0.7% 694553166 / 695569182 / -0.1% 0.92 / 0.91 / +0.9%
tpcds_q15/datafusion:vortex-compact 14017698 / 14112310 / -0.7% 34052241 / 34561265 / -1.5% 0.41 / 0.41 / +0.8%
tpcds_q16/datafusion:vortex-compact 19459920 / 19346456 / +0.6% 40329478 / 38975211 / +3.5% 0.48 / 0.50 / -2.8%
tpcds_q17/datafusion:vortex-compact 53528495 / 58164524 / -8.0% 72428011 / 83063026 / -12.8% 🟢 0.74 / 0.70 / +5.5%
tpcds_q18/datafusion:vortex-compact 61141283 / 60726392 / +0.7% 81792987 / 82064521 / -0.3% 0.75 / 0.74 / +1.0%
tpcds_q19/datafusion:vortex-compact 19232601 / 19203518 / +0.2% 40936426 / 41951309 / -2.4% 0.47 / 0.46 / +2.6%
tpcds_q20/datafusion:vortex-compact 20182442 / 19697268 / +2.5% 40539651 / 41074234 / -1.3% 0.50 / 0.48 / +3.8%
tpcds_q21/datafusion:vortex-compact 18252296 / 17935368 / +1.8% 40243913 / 43913955 / -8.4% 0.45 / 0.41 / +11.0%
tpcds_q22/datafusion:vortex-compact 49973450 / 50347916 / -0.7% 72833980 / 76038648 / -4.2% 0.69 / 0.66 / +3.6%
tpcds_q23/datafusion:vortex-compact 72161079 / 73409860 / -1.7% 100005750 / 95706778 / +4.5% 0.72 / 0.77 / -5.9%
tpcds_q24/datafusion:vortex-compact 70891400 / 71903166 / -1.4% 92654731 / 94089897 / -1.5% 0.77 / 0.76 / +0.1%
tpcds_q25/datafusion:vortex-compact 51749089 / 51802952 / -0.1% 70775127 / 83924002 / -15.7% 🟢 0.73 / 0.62 / +18.5%
tpcds_q26/datafusion:vortex-compact 27696895 / 28121214 / -1.5% 46536412 / 47791684 / -2.6% 0.60 / 0.59 / +1.1%
tpcds_q27/datafusion:vortex-compact 56546614 / 57330784 / -1.4% 78390543 / 85120658 / -7.9% 0.72 / 0.67 / +7.1%
tpcds_q28/datafusion:vortex-compact 29115654 / 29553096 / -1.5% 48635989 / 48441636 / +0.4% 0.60 / 0.61 / -1.9%
tpcds_q29/datafusion:vortex-compact 56331026 / 56405264 / -0.1% 70634314 / 80037947 / -11.7% 🟢 0.80 / 0.70 / +13.2%
tpcds_q30/datafusion:vortex-compact 28350950 / 28321802 / +0.1% 45550394 / 47709246 / -4.5% 0.62 / 0.59 / +4.8%
tpcds_q31/datafusion:vortex-compact 60762533 / 61550249 / -1.3% 87899956 / 90553089 / -2.9% 0.69 / 0.68 / +1.7%
tpcds_q32/datafusion:vortex-compact 13798361 / 13619760 / +1.3% 31956189 / 33788817 / -5.4% 0.43 / 0.40 / +7.1%
tpcds_q33/datafusion:vortex-compact 27979693 / 28100890 / -0.4% 54955717 / 53665316 / +2.4% 0.51 / 0.52 / -2.8%
tpcds_q34/datafusion:vortex-compact 18956030 / 18732658 / +1.2% 39284715 / 40231357 / -2.4% 0.48 / 0.47 / +3.6%
tpcds_q35/datafusion:vortex-compact 34321809 / 33931548 / +1.2% 57231958 / 57822727 / -1.0% 0.60 / 0.59 / +2.2%
tpcds_q36/datafusion:vortex-compact 49194415 / 49025280 / +0.3% 76212130 / 74005428 / +3.0% 0.65 / 0.66 / -2.6%
tpcds_q37/datafusion:vortex-compact 14451752 / 14957889 / -3.4% 37687268 / 38230457 / -1.4% 0.38 / 0.39 / -2.0%
tpcds_q38/datafusion:vortex-compact 26708266 / 26724360 / -0.1% 48035227 / 48508956 / -1.0% 0.56 / 0.55 / +0.9%
tpcds_q39/datafusion:vortex-compact 66684494 / 66306147 / +0.6% 88789694 / 89158404 / -0.4% 0.75 / 0.74 / +1.0%
tpcds_q40/datafusion:vortex-compact 24318028 / 24091346 / +0.9% 45548147 / 47168497 / -3.4% 0.53 / 0.51 / +4.5%
tpcds_q41/datafusion:vortex-compact 21306476 / 20996948 / +1.5% 36197069 / 36017938 / +0.5% 0.59 / 0.58 / +1.0%
tpcds_q42/datafusion:vortex-compact 11012863 / 10984471 / +0.3% 29863425 / 31192426 / -4.3% 0.37 / 0.35 / +4.7%
tpcds_q43/datafusion:vortex-compact 13053904 / 13057430 / -0.0% 30861420 / 32833674 / -6.0% 0.42 / 0.40 / +6.4%
tpcds_q44/datafusion:vortex-compact 29116806 / 29876778 / -2.5% 50315626 / 50964782 / -1.3% 0.58 / 0.59 / -1.3%
tpcds_q45/datafusion:vortex-compact 18300250 / 17745000 / +3.1% 38225757 / 38307511 / -0.2% 0.48 / 0.46 / +3.3%
tpcds_q46/datafusion:vortex-compact 24409644 / 24620343 / -0.9% 46150453 / 46389920 / -0.5% 0.53 / 0.53 / -0.3%
tpcds_q47/datafusion:vortex-compact 79639989 / 78006444 / +2.1% 108836005 / 111980176 / -2.8% 0.73 / 0.70 / +5.0%
tpcds_q48/datafusion:vortex-compact 43731840 / 43913748 / -0.4% 62320682 / 66076268 / -5.7% 0.70 / 0.66 / +5.6%
tpcds_q49/datafusion:vortex-compact 59724143 / 59405177 / +0.5% 84370398 / 84831664 / -0.5% 0.71 / 0.70 / +1.1%
tpcds_q50/datafusion:vortex-compact 31443936 / 32350284 / -2.8% 51085060 / 52676516 / -3.0% 0.62 / 0.61 / +0.2%
tpcds_q51/datafusion:vortex-compact 66736116 / 66168072 / +0.9% 85960247 / 86038919 / -0.1% 0.78 / 0.77 / +1.0%
tpcds_q52/datafusion:vortex-compact 11549429 / 11666344 / -1.0% 30246951 / 30976664 / -2.4% 0.38 / 0.38 / +1.4%
tpcds_q53/datafusion:vortex-compact 20421505 / 20758104 / -1.6% 42815938 / 42701907 / +0.3% 0.48 / 0.49 / -1.9%
tpcds_q54/datafusion:vortex-compact 33923482 / 34207254 / -0.8% 58832702 / 61928583 / -5.0% 0.58 / 0.55 / +4.4%
tpcds_q55/datafusion:vortex-compact 11509656 / 11196514 / +2.8% 31107392 / 30520959 / +1.9% 0.37 / 0.37 / +0.9%
tpcds_q56/datafusion:vortex-compact 26264950 / 26697355 / -1.6% 47904330 / 50252226 / -4.7% 0.55 / 0.53 / +3.2%
tpcds_q57/datafusion:vortex-compact 66030095 / 66083426 / -0.1% 93214062 / 92777348 / +0.5% 0.71 / 0.71 / -0.5%
tpcds_q58/datafusion:vortex-compact 41546476 / 41997263 / -1.1% 67761510 / 70599023 / -4.0% 0.61 / 0.59 / +3.1%
tpcds_q59/datafusion:vortex-compact 31829704 / 32079565 / -0.8% 54706854 / 56363680 / -2.9% 0.58 / 0.57 / +2.2%
tpcds_q60/datafusion:vortex-compact 25475389 / 25995132 / -2.0% 48278245 / 50492360 / -4.4% 0.53 / 0.51 / +2.5%
tpcds_q61/datafusion:vortex-compact 22888298 / 22779915 / +0.5% 42772833 / 44992664 / -4.9% 0.54 / 0.51 / +5.7%
tpcds_q62/datafusion:vortex-compact 16446766 / 16546152 / -0.6% 34752745 / 35230695 / -1.4% 0.47 / 0.47 / +0.8%
tpcds_q63/datafusion:vortex-compact 20444870 / 20460686 / -0.1% 43481848 / 42108812 / +3.3% 0.47 / 0.49 / -3.2%
tpcds_q64/datafusion:vortex-compact 302363910 / 300137785 / +0.7% 334428697 / 339411887 / -1.5% 0.90 / 0.88 / +2.2%
tpcds_q65/datafusion:vortex-compact 75059623 / 76824446 / -2.3% 99852727 / 100588494 / -0.7% 0.75 / 0.76 / -1.6%
tpcds_q66/datafusion:vortex-compact 50582717 / 50454634 / +0.3% 73115804 / 73829847 / -1.0% 0.69 / 0.68 / +1.2%
tpcds_q67/datafusion:vortex-compact 51812264 / 52176486 / -0.7% 84747816 / 86037219 / -1.5% 0.61 / 0.61 / +0.8%
tpcds_q68/datafusion:vortex-compact 25272168 / 24928513 / +1.4% 48057596 / 48247262 / -0.4% 0.53 / 0.52 / +1.8%
tpcds_q69/datafusion:vortex-compact 30020053 / 29717083 / +1.0% 49504961 / 51441696 / -3.8% 0.61 / 0.58 / +5.0%
tpcds_q70/datafusion:vortex-compact 73755605 / 72734170 / +1.4% 95955241 / 93279212 / +2.9% 0.77 / 0.78 / -1.4%
tpcds_q71/datafusion:vortex-compact 19638322 / 18914068 / +3.8% 39617871 / 40809819 / -2.9% 0.50 / 0.46 / +7.0%
tpcds_q72/datafusion:vortex-compact 351751933 / 357828086 / -1.7% 383526347 / 386812474 / -0.8% 0.92 / 0.93 / -0.9%
tpcds_q73/datafusion:vortex-compact 17630436 / 17750934 / -0.7% 38246149 / 39287678 / -2.7% 0.46 / 0.45 / +2.0%
tpcds_q74/datafusion:vortex-compact 41433336 / 42222805 / -1.9% 69272184 / 70873448 / -2.3% 0.60 / 0.60 / +0.4%
tpcds_q75/datafusion:vortex-compact 138227176 / 138085442 / +0.1% 169135963 / 165941572 / +1.9% 0.82 / 0.83 / -1.8%
tpcds_q76/datafusion:vortex-compact 29906832 / 29916751 / -0.0% 48848690 / 49541382 / -1.4% 0.61 / 0.60 / +1.4%
tpcds_q77/datafusion:vortex-compact 45611585 / 46505654 / -1.9% 67357633 / 66396189 / +1.4% 0.68 / 0.70 / -3.3%
tpcds_q78/datafusion:vortex-compact 66327821 / 66612056 / -0.4% 90129188 / 90852596 / -0.8% 0.74 / 0.73 / +0.4%
tpcds_q79/datafusion:vortex-compact 20961472 / 22182975 / -5.5% 40663484 / 42284951 / -3.8% 0.52 / 0.52 / -1.7%
tpcds_q80/datafusion:vortex-compact 73494893 / 73573006 / -0.1% 101939459 / 104174531 / -2.1% 0.72 / 0.71 / +2.1%
tpcds_q81/datafusion:vortex-compact 27503374 / 26819246 / +2.6% 44481714 / 44763089 / -0.6% 0.62 / 0.60 / +3.2%
tpcds_q82/datafusion:vortex-compact 13681780 / 13888452 / -1.5% 36828714 / 37457069 / -1.7% 0.37 / 0.37 / +0.2%
tpcds_q83/datafusion:vortex-compact 33735431 / 33166150 / +1.7% 55156402 / 55916848 / -1.4% 0.61 / 0.59 / +3.1%
tpcds_q84/datafusion:vortex-compact 11158106 / 11041561 / +1.1% 25933914 / 27318564 / -5.1% 0.43 / 0.40 / +6.5%
tpcds_q85/datafusion:vortex-compact 94957094 / 95552008 / -0.6% 120293450 / 120718999 / -0.4% 0.79 / 0.79 / -0.3%
tpcds_q86/datafusion:vortex-compact 15574420 / 15514347 / +0.4% 34460432 / 34286719 / +0.5% 0.45 / 0.45 / -0.1%
tpcds_q87/datafusion:vortex-compact 26102001 / 26768958 / -2.5% 48251541 / 49582200 / -2.7% 0.54 / 0.54 / +0.2%
tpcds_q88/datafusion:vortex-compact 36109916 / 37212926 / -3.0% 59992907 / 58478449 / +2.6% 0.60 / 0.64 / -5.4%
tpcds_q89/datafusion:vortex-compact 23189866 / 22993286 / +0.9% 46450570 / 46085589 / +0.8% 0.50 / 0.50 / +0.1%
tpcds_q90/datafusion:vortex-compact 10728250 / 10391594 / +3.2% 26373443 / 26339963 / +0.1% 0.41 / 0.39 / +3.1%
tpcds_q91/datafusion:vortex-compact 24484750 / 24873202 / -1.6% 44419698 / 45171371 / -1.7% 0.55 / 0.55 / +0.1%
tpcds_q92/datafusion:vortex-compact 14024696 / 14148513 / -0.9% 30099646 / 30374422 / -0.9% 0.47 / 0.47 / +0.0%
tpcds_q93/datafusion:vortex-compact 20750625 / 20614146 / +0.7% 39550957 / 41242321 / -4.1% 0.52 / 0.50 / +5.0%
tpcds_q94/datafusion:vortex-compact 19292968 / 19658978 / -1.9% 38952250 / 37910537 / +2.7% 0.50 / 0.52 / -4.5%
tpcds_q95/datafusion:vortex-compact 43315132 / 42915962 / +0.9% 62328886 / 65117525 / -4.3% 0.69 / 0.66 / +5.4%
tpcds_q96/datafusion:vortex-compact 8627469 / 8661228 / -0.4% 27091032 / 27433128 / -1.2% 0.32 / 0.32 / +0.9%
tpcds_q97/datafusion:vortex-compact 17493940 / 17751884 / -1.5% 37102154 / 37871126 / -2.0% 0.47 / 0.47 / +0.6%
tpcds_q98/datafusion:vortex-compact 20523811 / 20419312 / +0.5% 40597881 / 43214425 / -6.1% 0.51 / 0.47 / +7.0%
tpcds_q99/datafusion:vortex-compact 16276070 / 16709557 / -2.6% 34711942 / 36427295 / -4.7% 0.47 / 0.46 / +2.2%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42121926 / 43262880 / -2.6% 59997502 / 61443004 / -2.4% 0.70 / 0.70 / -0.3%
tpcds_q02/datafusion:parquet 54578932 / 55466569 / -1.6% 69793142 / 69508065 / +0.4% 0.78 / 0.80 / -2.0%
tpcds_q03/datafusion:parquet 18964461 / 19001818 / -0.2% 30659546 / 30997581 / -1.1% 0.62 / 0.61 / +0.9%
tpcds_q04/datafusion:parquet 178042159 / 179490333 / -0.8% 203852454 / 207863817 / -1.9% 0.87 / 0.86 / +1.1%
tpcds_q05/datafusion:parquet 68024307 / 66794228 / +1.8% 88521786 / 86747363 / +2.0% 0.77 / 0.77 / -0.2%
tpcds_q06/datafusion:parquet 33938940 / 34136260 / -0.6% 46693161 / 48983061 / -4.7% 0.73 / 0.70 / +4.3%
tpcds_q07/datafusion:parquet 47205519 / 46910186 / +0.6% 64609370 / 63930829 / +1.1% 0.73 / 0.73 / -0.4%
tpcds_q08/datafusion:parquet 31681138 / 31557059 / +0.4% 48283146 / 50393348 / -4.2% 0.66 / 0.63 / +4.8%
tpcds_q09/datafusion:parquet 34302669 / 31579125 / +8.6% 44273496 / 37166226 / +19.1% 🔴 0.77 / 0.85 / -8.8%
tpcds_q10/datafusion:parquet 43913161 / 45551698 / -3.6% 58640328 / 59071262 / -0.7% 0.75 / 0.77 / -2.9%
tpcds_q11/datafusion:parquet 96518008 / 97218905 / -0.7% 118059128 / 116279216 / +1.5% 0.82 / 0.84 / -2.2%
tpcds_q12/datafusion:parquet 23696602 / 23754508 / -0.2% 36022877 / 34783096 / +3.6% 0.66 / 0.68 / -3.7%
tpcds_q13/datafusion:parquet 46945906 / 46716067 / +0.5% 66269772 / 69073565 / -4.1% 0.71 / 0.68 / +4.7%
tpcds_q14/datafusion:parquet 531556935 / 534315260 / -0.5% 589540229 / 575827208 / +2.4% 0.90 / 0.93 / -2.8%
tpcds_q15/datafusion:parquet 23633028 / 23488119 / +0.6% 37484852 / 38849783 / -3.5% 0.63 / 0.60 / +4.3%
tpcds_q16/datafusion:parquet 36346274 / 37172506 / -2.2% 50966887 / 50005869 / +1.9% 0.71 / 0.74 / -4.1%
tpcds_q17/datafusion:parquet 73528512 / 75297216 / -2.3% 97933806 / 96491839 / +1.5% 0.75 / 0.78 / -3.8%
tpcds_q18/datafusion:parquet 67786084 / 70097720 / -3.3% 87604047 / 87588884 / +0.0% 0.77 / 0.80 / -3.3%
tpcds_q19/datafusion:parquet 29403782 / 29219541 / +0.6% 42051700 / 42977883 / -2.2% 0.70 / 0.68 / +2.8%
tpcds_q20/datafusion:parquet 24883071 / 25343036 / -1.8% 38528539 / 36333476 / +6.0% 0.65 / 0.70 / -7.4%
tpcds_q21/datafusion:parquet 20141100 / 20229807 / -0.4% 31581610 / 32007250 / -1.3% 0.64 / 0.63 / +0.9%
tpcds_q22/datafusion:parquet 77047967 / 77601897 / -0.7% 88348996 / 88832665 / -0.5% 0.87 / 0.87 / -0.2%
tpcds_q23/datafusion:parquet 92209470 / 92657326 / -0.5% 114212393 / 114621595 / -0.4% 0.81 / 0.81 / -0.1%
tpcds_q24/datafusion:parquet 89938481 / 90128372 / -0.2% 113648749 / 113478718 / +0.1% 0.79 / 0.79 / -0.4%
tpcds_q25/datafusion:parquet 79708183 / 79941330 / -0.3% 97195980 / 101030536 / -3.8% 0.82 / 0.79 / +3.6%
tpcds_q26/datafusion:parquet 44120331 / 42753600 / +3.2% 61041065 / 61363571 / -0.5% 0.72 / 0.70 / +3.7%
tpcds_q27/datafusion:parquet 75952972 / 74684898 / +1.7% 99182581 / 94481860 / +5.0% 0.77 / 0.79 / -3.1%
tpcds_q28/datafusion:parquet 28377060 / 28427123 / -0.2% 42613231 / 42745920 / -0.3% 0.67 / 0.67 / +0.1%
tpcds_q29/datafusion:parquet 74117071 / 75212346 / -1.5% 95247001 / 100294182 / -5.0% 0.78 / 0.75 / +3.8%
tpcds_q30/datafusion:parquet 45307641 / 44949978 / +0.8% 57716354 / 57865219 / -0.3% 0.79 / 0.78 / +1.1%
tpcds_q31/datafusion:parquet 82072158 / 79523678 / +3.2% 98326993 / 98885967 / -0.6% 0.83 / 0.80 / +3.8%
tpcds_q32/datafusion:parquet 26930398 / 26167936 / +2.9% 39714931 / 40505737 / -2.0% 0.68 / 0.65 / +5.0%
tpcds_q33/datafusion:parquet 38468350 / 36928394 / +4.2% 52239966 / 54441939 / -4.0% 0.74 / 0.68 / +8.6%
tpcds_q34/datafusion:parquet 24138059 / 24340323 / -0.8% 35758788 / 36057135 / -0.8% 0.68 / 0.68 / -0.0%
tpcds_q35/datafusion:parquet 50340286 / 50190233 / +0.3% 66057065 / 63786997 / +3.6% 0.76 / 0.79 / -3.1%
tpcds_q36/datafusion:parquet 51968557 / 52782648 / -1.5% 72674254 / 74171263 / -2.0% 0.72 / 0.71 / +0.5%
tpcds_q37/datafusion:parquet 21058383 / 21559690 / -2.3% 32723773 / 35755398 / -8.5% 0.64 / 0.60 / +6.7%
tpcds_q38/datafusion:parquet 44587070 / 45473860 / -2.0% 61983246 / 63454628 / -2.3% 0.72 / 0.72 / +0.4%
tpcds_q39/datafusion:parquet 68687656 / 68196552 / +0.7% 84731033 / 84655096 / +0.1% 0.81 / 0.81 / +0.6%
tpcds_q40/datafusion:parquet 30248106 / 31630454 / -4.4% 49869901 / 50152356 / -0.6% 0.61 / 0.63 / -3.8%
tpcds_q41/datafusion:parquet 20242720 / 19712190 / +2.7% 31826427 / 31270813 / +1.8% 0.64 / 0.63 / +0.9%
tpcds_q42/datafusion:parquet 18046446 / 18210634 / -0.9% 29160823 / 29360978 / -0.7% 0.62 / 0.62 / -0.2%
tpcds_q43/datafusion:parquet 19168018 / 19389890 / -1.1% 32924418 / 32800395 / +0.4% 0.58 / 0.59 / -1.5%
tpcds_q44/datafusion:parquet 35115319 / 34987582 / +0.4% 50805395 / 50758986 / +0.1% 0.69 / 0.69 / +0.3%
tpcds_q45/datafusion:parquet 27841436 / 28044916 / -0.7% 39221915 / 41164628 / -4.7% 0.71 / 0.68 / +4.2%
tpcds_q46/datafusion:parquet 29094082 / 28768864 / +1.1% 45438622 / 45623018 / -0.4% 0.64 / 0.63 / +1.5%
tpcds_q47/datafusion:parquet 97860944 / 97409959 / +0.5% 117703827 / 119943424 / -1.9% 0.83 / 0.81 / +2.4%
tpcds_q48/datafusion:parquet 42049169 / 42618384 / -1.3% 58200402 / 60907791 / -4.4% 0.72 / 0.70 / +3.3%
tpcds_q49/datafusion:parquet 70950282 / 72241688 / -1.8% 90618628 / 93484265 / -3.1% 0.78 / 0.77 / +1.3%
tpcds_q50/datafusion:parquet 47541462 / 48069792 / -1.1% 65172120 / 65817662 / -1.0% 0.73 / 0.73 / -0.1%
tpcds_q51/datafusion:parquet 75079755 / 75441023 / -0.5% 95568565 / 94661070 / +1.0% 0.79 / 0.80 / -1.4%
tpcds_q52/datafusion:parquet 18665902 / 18434569 / +1.3% 30084068 / 32459317 / -7.3% 0.62 / 0.57 / +9.2%
tpcds_q53/datafusion:parquet 22305246 / 22732570 / -1.9% 38907027 / 38864236 / +0.1% 0.57 / 0.58 / -2.0%
tpcds_q54/datafusion:parquet 53030538 / 53503783 / -0.9% 66943995 / 68815790 / -2.7% 0.79 / 0.78 / +1.9%
tpcds_q55/datafusion:parquet 18065562 / 18124534 / -0.3% 29191389 / 30122788 / -3.1% 0.62 / 0.60 / +2.9%
tpcds_q56/datafusion:parquet 40710500 / 41135366 / -1.0% 54532017 / 58757429 / -7.2% 0.75 / 0.70 / +6.6%
tpcds_q57/datafusion:parquet 101145486 / 101714310 / -0.6% 122616623 / 120463935 / +1.8% 0.82 / 0.84 / -2.3%
tpcds_q58/datafusion:parquet 66314795 / 65322414 / +1.5% 81282435 / 84441537 / -3.7% 0.82 / 0.77 / +5.5%
tpcds_q59/datafusion:parquet 48982100 / 46919476 / +4.4% 63542301 / 66843603 / -4.9% 0.77 / 0.70 / +9.8%
tpcds_q60/datafusion:parquet 40041945 / 41722858 / -4.0% 55920279 / 58967558 / -5.2% 0.72 / 0.71 / +1.2%
tpcds_q61/datafusion:parquet 36628283 / 37273926 / -1.7% 52542136 / 51454526 / +2.1% 0.70 / 0.72 / -3.8%
tpcds_q62/datafusion:parquet 25386526 / 25175652 / +0.8% 38084782 / 37569528 / +1.4% 0.67 / 0.67 / -0.5%
tpcds_q63/datafusion:parquet 22385878 / 22002160 / +1.7% 37995827 / 38818983 / -2.1% 0.59 / 0.57 / +3.9%
tpcds_q64/datafusion:parquet 286170500 / 286726613 / -0.2% 323688259 / 328067577 / -1.3% 0.88 / 0.87 / +1.2%
tpcds_q65/datafusion:parquet 125831073 / 122569732 / +2.7% 138182952 / 143307312 / -3.6% 0.91 / 0.86 / +6.5%
tpcds_q66/datafusion:parquet 59522774 / 61169416 / -2.7% 75544682 / 77505066 / -2.5% 0.79 / 0.79 / -0.2%
tpcds_q67/datafusion:parquet 68514365 / 68944932 / -0.6% 92435425 / 93719379 / -1.4% 0.74 / 0.74 / +0.8%
tpcds_q68/datafusion:parquet 28804645 / 29161633 / -1.2% 46971164 / 49712235 / -5.5% 0.61 / 0.59 / +4.5%
tpcds_q69/datafusion:parquet 43412457 / 44020691 / -1.4% 59016457 / 58198802 / +1.4% 0.74 / 0.76 / -2.7%
tpcds_q70/datafusion:parquet 80100037 / 80604155 / -0.6% 96832356 / 99987733 / -3.2% 0.83 / 0.81 / +2.6%
tpcds_q71/datafusion:parquet 25610433 / 25575734 / +0.1% 39877749 / 35963353 / +10.9% 🔴 0.64 / 0.71 / -9.7%
tpcds_q72/datafusion:parquet 521280798 / 521267912 / +0.0% 539941642 / 548793964 / -1.6% 0.97 / 0.95 / +1.6%
tpcds_q73/datafusion:parquet 23606544 / 23757516 / -0.6% 36031938 / 36642328 / -1.7% 0.66 / 0.65 / +1.0%
tpcds_q74/datafusion:parquet 69022138 / 69820618 / -1.1% 88124401 / 89316907 / -1.3% 0.78 / 0.78 / +0.2%
tpcds_q75/datafusion:parquet 152449202 / 150374732 / +1.4% 177898051 / 176310856 / +0.9% 0.86 / 0.85 / +0.5%
tpcds_q76/datafusion:parquet 33029109 / 33348200 / -1.0% 47332338 / 47707993 / -0.8% 0.70 / 0.70 / -0.2%
tpcds_q77/datafusion:parquet 57481694 / 56921570 / +1.0% 73470558 / 74758519 / -1.7% 0.78 / 0.76 / +2.8%
tpcds_q78/datafusion:parquet 83504852 / 87193339 / -4.2% 118577805 / 118045006 / +0.5% 0.70 / 0.74 / -4.7%
tpcds_q79/datafusion:parquet 27172508 / 27072294 / +0.4% 41206014 / 42000744 / -1.9% 0.66 / 0.64 / +2.3%
tpcds_q80/datafusion:parquet 80802126 / 81593641 / -1.0% 107885575 / 113357289 / -4.8% 0.75 / 0.72 / +4.1%
tpcds_q81/datafusion:parquet 38231514 / 35695127 / +7.1% 51580086 / 51081390 / +1.0% 0.74 / 0.70 / +6.1%
tpcds_q82/datafusion:parquet 22950038 / 22977330 / -0.1% 34523118 / 37015454 / -6.7% 0.66 / 0.62 / +7.1%
tpcds_q83/datafusion:parquet 58910036 / 59134714 / -0.4% 76985709 / 80359385 / -4.2% 0.77 / 0.74 / +4.0%
tpcds_q84/datafusion:parquet 26758638 / 27375248 / -2.3% 39482760 / 40067486 / -1.5% 0.68 / 0.68 / -0.8%
tpcds_q85/datafusion:parquet 79781609 / 80082206 / -0.4% 103854437 / 105130837 / -1.2% 0.77 / 0.76 / +0.8%
tpcds_q86/datafusion:parquet 20772686 / 20931228 / -0.8% 32779080 / 32970532 / -0.6% 0.63 / 0.63 / -0.2%
tpcds_q87/datafusion:parquet 44832433 / 44729130 / +0.2% 60617619 / 62969237 / -3.7% 0.74 / 0.71 / +4.1%
tpcds_q88/datafusion:parquet 37989456 / 37475068 / +1.4% 50082823 / 52727274 / -5.0% 0.76 / 0.71 / +6.7%
tpcds_q89/datafusion:parquet 26046193 / 25904324 / +0.5% 40479914 / 40872407 / -1.0% 0.64 / 0.63 / +1.5%
tpcds_q90/datafusion:parquet 15764034 / 15146494 / +4.1% 25394129 / 27403471 / -7.3% 0.62 / 0.55 / +12.3%
tpcds_q91/datafusion:parquet 32867992 / 32837202 / +0.1% 45376263 / 48450730 / -6.3% 0.72 / 0.68 / +6.9%
tpcds_q92/datafusion:parquet 26906960 / 27032061 / -0.5% 40068755 / 40985250 / -2.2% 0.67 / 0.66 / +1.8%
tpcds_q93/datafusion:parquet 26932241 / 27315347 / -1.4% 45649118 / 47790306 / -4.5% 0.59 / 0.57 / +3.2%
tpcds_q94/datafusion:parquet 35399936 / 35307494 / +0.3% 48503862 / 48386439 / +0.2% 0.73 / 0.73 / +0.0%
tpcds_q95/datafusion:parquet 63310545 / 65642486 / -3.6% 74470662 / 79262306 / -6.0% 0.85 / 0.83 / +2.7%
tpcds_q96/datafusion:parquet 13027924 / 13060741 / -0.3% 24369372 / 24411935 / -0.2% 0.53 / 0.54 / -0.1%
tpcds_q97/datafusion:parquet 35807784 / 35585149 / +0.6% 52049212 / 51601504 / +0.9% 0.69 / 0.69 / -0.2%
tpcds_q98/datafusion:parquet 24587867 / 24804856 / -0.9% 38556860 / 38390047 / +0.4% 0.64 / 0.65 / -1.3%
tpcds_q99/datafusion:parquet 29695919 / 29567288 / +0.4% 42262826 / 43123955 / -2.0% 0.70 / 0.69 / +2.5%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16242304 / 16169342 / +0.5% 24876212 / 25208430 / -1.3% 0.65 / 0.64 / +1.8%
tpcds_q02/duckdb:vortex-file-compressed 16578360 / 15338946 / +8.1% 22251030 / 22114287 / +0.6% 0.75 / 0.69 / +7.4%
tpcds_q03/duckdb:vortex-file-compressed 7138235 / 7084288 / +0.8% 15328767 / 15590177 / -1.7% 0.47 / 0.45 / +2.5%
tpcds_q04/duckdb:vortex-file-compressed 58729462 / 58755574 / -0.0% 70741386 / 69967658 / +1.1% 0.83 / 0.84 / -1.1%
tpcds_q05/duckdb:vortex-file-compressed 22917246 / 22827103 / +0.4% 32875728 / 32776288 / +0.3% 0.70 / 0.70 / +0.1%
tpcds_q06/duckdb:vortex-file-compressed 24580044 / 24391356 / +0.8% 38294774 / 38675325 / -1.0% 0.64 / 0.63 / +1.8%
tpcds_q07/duckdb:vortex-file-compressed 22467918 / 22421853 / +0.2% 35126863 / 34875492 / +0.7% 0.64 / 0.64 / -0.5%
tpcds_q08/duckdb:vortex-file-compressed 17500754 / 17316400 / +1.1% 25807491 / 25185043 / +2.5% 0.68 / 0.69 / -1.4%
tpcds_q09/duckdb:vortex-file-compressed 18921784 / 19286754 / -1.9% 28666850 / 29080705 / -1.4% 0.66 / 0.66 / -0.5%
tpcds_q10/duckdb:vortex-file-compressed 27903240 / 27437153 / +1.7% 40555235 / 41348031 / -1.9% 0.69 / 0.66 / +3.7%
tpcds_q11/duckdb:vortex-file-compressed 36620062 / 36255809 / +1.0% 46213852 / 45872034 / +0.7% 0.79 / 0.79 / +0.3%
tpcds_q12/duckdb:vortex-file-compressed 10044757 / 9713546 / +3.4% 16123763 / 17000759 / -5.2% 0.62 / 0.57 / +9.0%
tpcds_q13/duckdb:vortex-file-compressed 20991923 / 20895933 / +0.5% 33865310 / 33419129 / +1.3% 0.62 / 0.63 / -0.9%
tpcds_q14/duckdb:vortex-file-compressed 55490424 / 54494102 / +1.8% 64778559 / 64976647 / -0.3% 0.86 / 0.84 / +2.1%
tpcds_q15/duckdb:vortex-file-compressed 11315675 / 11278428 / +0.3% 17912428 / 18820652 / -4.8% 0.63 / 0.60 / +5.4%
tpcds_q16/duckdb:vortex-file-compressed 24795754 / 24964616 / -0.7% 34464745 / 35371894 / -2.6% 0.72 / 0.71 / +1.9%
tpcds_q17/duckdb:vortex-file-compressed 20751200 / 20689066 / +0.3% 32365222 / 35045357 / -7.6% 0.64 / 0.59 / +8.6%
tpcds_q18/duckdb:vortex-file-compressed 32555204 / 32805276 / -0.8% 44167349 / 44149412 / +0.0% 0.74 / 0.74 / -0.8%
tpcds_q19/duckdb:vortex-file-compressed 20717375 / 20731910 / -0.1% 28782249 / 30316877 / -5.1% 0.72 / 0.68 / +5.3%
tpcds_q20/duckdb:vortex-file-compressed 10764088 / 10753443 / +0.1% 17447032 / 17677959 / -1.3% 0.62 / 0.61 / +1.4%
tpcds_q21/duckdb:vortex-file-compressed 9007446 / 9179946 / -1.9% 21701494 / 22148041 / -2.0% 0.42 / 0.41 / +0.1%
tpcds_q22/duckdb:vortex-file-compressed 17762992 / 17575656 / +1.1% 29535255 / 29876207 / -1.1% 0.60 / 0.59 / +2.2%
tpcds_q23/duckdb:vortex-file-compressed 37517918 / 37443472 / +0.2% 49506836 / 49317324 / +0.4% 0.76 / 0.76 / -0.2%
tpcds_q24/duckdb:vortex-file-compressed 26860562 / 26580850 / +1.1% 37976263 / 36126869 / +5.1% 0.71 / 0.74 / -3.9%
tpcds_q25/duckdb:vortex-file-compressed 19468908 / 19429214 / +0.2% 31244268 / 32964470 / -5.2% 0.62 / 0.59 / +5.7%
tpcds_q26/duckdb:vortex-file-compressed 21823700 / 21891717 / -0.3% 33338689 / 32603722 / +2.3% 0.65 / 0.67 / -2.5%
tpcds_q27/duckdb:vortex-file-compressed 25051836 / 25304204 / -1.0% 36975819 / 37324427 / -0.9% 0.68 / 0.68 / -0.1%
tpcds_q28/duckdb:vortex-file-compressed 15582870 / 14996504 / +3.9% 25832958 / 26109033 / -1.1% 0.60 / 0.57 / +5.0%
tpcds_q29/duckdb:vortex-file-compressed 19392292 / 19177100 / +1.1% 29956338 / 30536665 / -1.9% 0.65 / 0.63 / +3.1%
tpcds_q30/duckdb:vortex-file-compressed 18727703 / 18460207 / +1.4% 26840483 / 27043070 / -0.7% 0.70 / 0.68 / +2.2%
tpcds_q31/duckdb:vortex-file-compressed 17786976 / 17818756 / -0.2% 26376372 / 26677232 / -1.1% 0.67 / 0.67 / +1.0%
tpcds_q32/duckdb:vortex-file-compressed 10566333 / 10362424 / +2.0% 17900901 / 18105696 / -1.1% 0.59 / 0.57 / +3.1%
tpcds_q33/duckdb:vortex-file-compressed 18014594 / 17966371 / +0.3% 27653095 / 27599692 / +0.2% 0.65 / 0.65 / +0.1%
tpcds_q34/duckdb:vortex-file-compressed 13170670 / 13128796 / +0.3% 22103595 / 22858650 / -3.3% 0.60 / 0.57 / +3.7%
tpcds_q35/duckdb:vortex-file-compressed 31417201 / 31269010 / +0.5% 43788643 / 44678214 / -2.0% 0.72 / 0.70 / +2.5%
tpcds_q36/duckdb:vortex-file-compressed 14060859 / 14085537 / -0.2% 23500264 / 24807162 / -5.3% 0.60 / 0.57 / +5.4%
tpcds_q37/duckdb:vortex-file-compressed 9424680 / 9320010 / +1.1% 22926822 / 23646716 / -3.0% 0.41 / 0.39 / +4.3%
tpcds_q38/duckdb:vortex-file-compressed 24498804 / 24207898 / +1.2% 32028754 / 32072936 / -0.1% 0.76 / 0.75 / +1.3%
tpcds_q39/duckdb:vortex-file-compressed 18470454 / 18430229 / +0.2% 31288692 / 31465684 / -0.6% 0.59 / 0.59 / +0.8%
tpcds_q40/duckdb:vortex-file-compressed 11158904 / 11409282 / -2.2% 18732533 / 19968765 / -6.2% 0.60 / 0.57 / +4.3%
tpcds_q41/duckdb:vortex-file-compressed 18828074 / 18586944 / +1.3% 25693095 / 25642397 / +0.2% 0.73 / 0.72 / +1.1%
tpcds_q42/duckdb:vortex-file-compressed 7135952 / 7196755 / -0.8% 16036281 / 16063079 / -0.2% 0.44 / 0.45 / -0.7%
tpcds_q43/duckdb:vortex-file-compressed 9593826 / 9744822 / -1.5% 18285007 / 19129573 / -4.4% 0.52 / 0.51 / +3.0%
tpcds_q44/duckdb:vortex-file-compressed 12547158 / 12552535 / -0.0% 23628916 / 24405633 / -3.2% 0.53 / 0.51 / +3.2%
tpcds_q45/duckdb:vortex-file-compressed 23778636 / 23463276 / +1.3% 30011177 / 30968745 / -3.1% 0.79 / 0.76 / +4.6%
tpcds_q46/duckdb:vortex-file-compressed 31945028 / 31704814 / +0.8% 43420101 / 44141192 / -1.6% 0.74 / 0.72 / +2.4%
tpcds_q47/duckdb:vortex-file-compressed 31227142 / 31385866 / -0.5% 40473014 / 40884651 / -1.0% 0.77 / 0.77 / +0.5%
tpcds_q48/duckdb:vortex-file-compressed 23575570 / 23584018 / -0.0% 35880535 / 37649937 / -4.7% 0.66 / 0.63 / +4.9%
tpcds_q49/duckdb:vortex-file-compressed 18832636 / 18968821 / -0.7% 29867049 / 31099505 / -4.0% 0.63 / 0.61 / +3.4%
tpcds_q50/duckdb:vortex-file-compressed 15583616 / 15388752 / +1.3% 25584646 / 26202052 / -2.4% 0.61 / 0.59 / +3.7%
tpcds_q51/duckdb:vortex-file-compressed 48855444 / 49238492 / -0.8% 77237012 / 57723709 / +33.8% 🔴 0.63 / 0.85 / -25.8%
tpcds_q52/duckdb:vortex-file-compressed 7190844 / 7115234 / +1.1% 15336289 / 16459360 / -6.8% 0.47 / 0.43 / +8.5%
tpcds_q53/duckdb:vortex-file-compressed 11602445 / 11441682 / +1.4% 21083919 / 20787272 / +1.4% 0.55 / 0.55 / -0.0%
tpcds_q54/duckdb:vortex-file-compressed 19813068 / 19832604 / -0.1% 30180798 / 30129691 / +0.2% 0.66 / 0.66 / -0.3%
tpcds_q55/duckdb:vortex-file-compressed 6936754 / 6916646 / +0.3% 15679540 / 16403867 / -4.4% 0.44 / 0.42 / +4.9%
tpcds_q56/duckdb:vortex-file-compressed 18003771 / 17805310 / +1.1% 28234361 / 28664130 / -1.5% 0.64 / 0.62 / +2.7%
tpcds_q57/duckdb:vortex-file-compressed 25885496 / 25698682 / +0.7% 32636846 / 34593745 / -5.7% 0.79 / 0.74 / +6.8%
tpcds_q58/duckdb:vortex-file-compressed 20533778 / 20427094 / +0.5% 31125858 / 30107683 / +3.4% 0.66 / 0.68 / -2.8%
tpcds_q59/duckdb:vortex-file-compressed 19936460 / 20652475 / -3.5% 26829624 / 26893488 / -0.2% 0.74 / 0.77 / -3.2%
tpcds_q60/duckdb:vortex-file-compressed 18611659 / 18082500 / +2.9% 28456427 / 29589916 / -3.8% 0.65 / 0.61 / +7.0%
tpcds_q61/duckdb:vortex-file-compressed 19812738 / 19712827 / +0.5% 30236788 / 31032914 / -2.6% 0.66 / 0.64 / +3.2%
tpcds_q62/duckdb:vortex-file-compressed 11016921 / 11062814 / -0.4% 17814205 / 17758704 / +0.3% 0.62 / 0.62 / -0.7%
tpcds_q63/duckdb:vortex-file-compressed 11054310 / 10941693 / +1.0% 20057274 / 20523279 / -2.3% 0.55 / 0.53 / +3.4%
tpcds_q64/duckdb:vortex-file-compressed 53789558 / 53161808 / +1.2% 67692371 / 70533910 / -4.0% 0.79 / 0.75 / +5.4%
tpcds_q65/duckdb:vortex-file-compressed 13281874 / 13174190 / +0.8% 22820024 / 23510720 / -2.9% 0.58 / 0.56 / +3.9%
tpcds_q66/duckdb:vortex-file-compressed 31238680 / 31463970 / -0.7% 39189148 / 38455329 / +1.9% 0.80 / 0.82 / -2.6%
tpcds_q67/duckdb:vortex-file-compressed 55659762 / 55352475 / +0.6% 65119172 / 66004547 / -1.3% 0.85 / 0.84 / +1.9%
tpcds_q68/duckdb:vortex-file-compressed 23076926 / 23024228 / +0.2% 35504889 / 36882898 / -3.7% 0.65 / 0.62 / +4.1%
tpcds_q69/duckdb:vortex-file-compressed 22885137 / 22948086 / -0.3% 37043082 / 36702695 / +0.9% 0.62 / 0.63 / -1.2%
tpcds_q70/duckdb:vortex-file-compressed 14937772 / 14815990 / +0.8% 25540025 / 26665021 / -4.2% 0.58 / 0.56 / +5.3%
tpcds_q71/duckdb:vortex-file-compressed 13379648 / 12964736 / +3.2% 22881540 / 23695731 / -3.4% 0.58 / 0.55 / +6.9%
tpcds_q72/duckdb:vortex-file-compressed 43234542 / 43524993 / -0.7% 55897408 / 56377605 / -0.9% 0.77 / 0.77 / +0.2%
tpcds_q73/duckdb:vortex-file-compressed 12022110 / 11831730 / +1.6% 19915048 / 20916476 / -4.8% 0.60 / 0.57 / +6.7%
tpcds_q74/duckdb:vortex-file-compressed 31187750 / 31153992 / +0.1% 40711523 / 41881880 / -2.8% 0.77 / 0.74 / +3.0%
tpcds_q75/duckdb:vortex-file-compressed 37791412 / 37261669 / +1.4% 49094514 / 49857253 / -1.5% 0.77 / 0.75 / +3.0%
tpcds_q76/duckdb:vortex-file-compressed 12793540 / 12740596 / +0.4% 22581710 / 22428813 / +0.7% 0.57 / 0.57 / -0.3%
tpcds_q77/duckdb:vortex-file-compressed 20900129 / 20466060 / +2.1% 30973657 / 31856156 / -2.8% 0.67 / 0.64 / +5.0%
tpcds_q78/duckdb:vortex-file-compressed 42766898 / 42951164 / -0.4% 52510878 / 53354482 / -1.6% 0.81 / 0.81 / +1.2%
tpcds_q79/duckdb:vortex-file-compressed 17432028 / 17308212 / +0.7% 28345495 / 28082620 / +0.9% 0.61 / 0.62 / -0.2%
tpcds_q80/duckdb:vortex-file-compressed 29748284 / 30136798 / -1.3% 42414535 / 43487319 / -2.5% 0.70 / 0.69 / +1.2%
tpcds_q81/duckdb:vortex-file-compressed 21592908 / 21102550 / +2.3% 30267357 / 30055170 / +0.7% 0.71 / 0.70 / +1.6%
tpcds_q82/duckdb:vortex-file-compressed 9644653 / 9375598 / +2.9% 24674172 / 24298530 / +1.5% 0.39 / 0.39 / +1.3%
tpcds_q83/duckdb:vortex-file-compressed 17533230 / 17358732 / +1.0% 25157538 / 24778694 / +1.5% 0.70 / 0.70 / -0.5%
tpcds_q84/duckdb:vortex-file-compressed 15434471 / 15539078 / -0.7% 22808267 / 23176870 / -1.6% 0.68 / 0.67 / +0.9%
tpcds_q85/duckdb:vortex-file-compressed 25963398 / 25997080 / -0.1% 37307446 / 38423722 / -2.9% 0.70 / 0.68 / +2.9%
tpcds_q86/duckdb:vortex-file-compressed 9713145 / 9732614 / -0.2% 16352343 / 16584900 / -1.4% 0.59 / 0.59 / +1.2%
tpcds_q87/duckdb:vortex-file-compressed 25988246 / 25700454 / +1.1% 33520604 / 33855587 / -1.0% 0.78 / 0.76 / +2.1%
tpcds_q88/duckdb:vortex-file-compressed 30482337 / 30539418 / -0.2% 38347283 / 38434278 / -0.2% 0.79 / 0.79 / +0.0%
tpcds_q89/duckdb:vortex-file-compressed 12098964 / 12189744 / -0.7% 21063249 / 21970792 / -4.1% 0.57 / 0.55 / +3.5%
tpcds_q90/duckdb:vortex-file-compressed 8077959 / 8282225 / -2.5% 15997073 / 15517107 / +3.1% 0.50 / 0.53 / -5.4%
tpcds_q91/duckdb:vortex-file-compressed 15165766 / 14939499 / +1.5% 24270878 / 23719433 / +2.3% 0.62 / 0.63 / -0.8%
tpcds_q92/duckdb:vortex-file-compressed 10474539 / 10395304 / +0.8% 18123689 / 18272730 / -0.8% 0.58 / 0.57 / +1.6%
tpcds_q93/duckdb:vortex-file-compressed 10466840 / 10438622 / +0.3% 22935575 / 24140011 / -5.0% 0.46 / 0.43 / +5.5%
tpcds_q94/duckdb:vortex-file-compressed 22282056 / 22563438 / -1.2% 31443009 / 32523457 / -3.3% 0.71 / 0.69 / +2.1%
tpcds_q95/duckdb:vortex-file-compressed 61193631 / 60977057 / +0.4% 67410011 / 68521944 / -1.6% 0.91 / 0.89 / +2.0%
tpcds_q96/duckdb:vortex-file-compressed 6943631 / 6762112 / +2.7% 15003960 / 15369703 / -2.4% 0.46 / 0.44 / +5.2%
tpcds_q97/duckdb:vortex-file-compressed 23644420 / 23002487 / +2.8% 32915961 / 33048446 / -0.4% 0.72 / 0.70 / +3.2%
tpcds_q98/duckdb:vortex-file-compressed 11266776 / 10971908 / +2.7% 19397371 / 20297967 / -4.4% 0.58 / 0.54 / +7.5%
tpcds_q99/duckdb:vortex-file-compressed 14541816 / 14404802 / +1.0% 22135844 / 23102509 / -4.2% 0.66 / 0.62 / +5.4%
duckdb / vortex-compact / ns (1.008x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17722448 / 17511935 / +1.2% 26204469 / 25998491 / +0.8% 0.68 / 0.67 / +0.4%
tpcds_q02/duckdb:vortex-compact 19149116 / 18057614 / +6.0% 24471084 / 24516246 / -0.2% 0.78 / 0.74 / +6.2%
tpcds_q03/duckdb:vortex-compact 8414192 / 8383152 / +0.4% 17075661 / 17063719 / +0.1% 0.49 / 0.49 / +0.3%
tpcds_q04/duckdb:vortex-compact 63314656 / 63055864 / +0.4% 75395386 / 73889802 / +2.0% 0.84 / 0.85 / -1.6%
tpcds_q05/duckdb:vortex-compact 25022472 / 24716598 / +1.2% 33782736 / 34437471 / -1.9% 0.74 / 0.72 / +3.2%
tpcds_q06/duckdb:vortex-compact 25972352 / 26346880 / -1.4% 39678970 / 39913304 / -0.6% 0.65 / 0.66 / -0.8%
tpcds_q07/duckdb:vortex-compact 27130576 / 27087722 / +0.2% 37841902 / 38530411 / -1.8% 0.72 / 0.70 / +2.0%
tpcds_q08/duckdb:vortex-compact 22221978 / 22104746 / +0.5% 29598860 / 30436177 / -2.8% 0.75 / 0.73 / +3.4%
tpcds_q09/duckdb:vortex-compact 21952715 / 21749036 / +0.9% 31228764 / 31450668 / -0.7% 0.70 / 0.69 / +1.7%
tpcds_q10/duckdb:vortex-compact 32108758 / 32021015 / +0.3% 44486038 / 44579589 / -0.2% 0.72 / 0.72 / +0.5%
tpcds_q11/duckdb:vortex-compact 38215502 / 38079187 / +0.4% 47092350 / 46915963 / +0.4% 0.81 / 0.81 / -0.0%
tpcds_q12/duckdb:vortex-compact 12501211 / 12428016 / +0.6% 18908010 / 19180011 / -1.4% 0.66 / 0.65 / +2.0%
tpcds_q13/duckdb:vortex-compact 37005022 / 36875474 / +0.4% 47670419 / 48764258 / -2.2% 0.78 / 0.76 / +2.7%
tpcds_q14/duckdb:vortex-compact 59845966 / 59406952 / +0.7% 69495326 / 66858851 / +3.9% 0.86 / 0.89 / -3.1%
tpcds_q15/duckdb:vortex-compact 14840328 / 14885534 / -0.3% 22301162 / 22144963 / +0.7% 0.67 / 0.67 / -1.0%
tpcds_q16/duckdb:vortex-compact 27739258 / 26188802 / +5.9% 36279941 / 36275840 / +0.0% 0.76 / 0.72 / +5.9%
tpcds_q17/duckdb:vortex-compact 24450694 / 24231360 / +0.9% 36112152 / 35816055 / +0.8% 0.68 / 0.68 / +0.1%
tpcds_q18/duckdb:vortex-compact 38414322 / 37534554 / +2.3% 49804129 / 48955710 / +1.7% 0.77 / 0.77 / +0.6%
tpcds_q19/duckdb:vortex-compact 27110496 / 28238953 / -4.0% 33090188 / 32508675 / +1.8% 0.82 / 0.87 / -5.7%
tpcds_q20/duckdb:vortex-compact 13383710 / 13075834 / +2.4% 19996142 / 19820628 / +0.9% 0.67 / 0.66 / +1.5%
tpcds_q21/duckdb:vortex-compact 11260122 / 11110775 / +1.3% 22978130 / 23315045 / -1.4% 0.49 / 0.48 / +2.8%
tpcds_q22/duckdb:vortex-compact 21675544 / 19184526 / +13.0% 🔴 32173282 / 32353122 / -0.6% 0.67 / 0.59 / +13.6%
tpcds_q23/duckdb:vortex-compact 42058076 / 42244417 / -0.4% 52556032 / 54949638 / -4.4% 0.80 / 0.77 / +4.1%
tpcds_q24/duckdb:vortex-compact 28113119 / 28417243 / -1.1% 37108910 / 37712029 / -1.6% 0.76 / 0.75 / +0.5%
tpcds_q25/duckdb:vortex-compact 23667962 / 23267483 / +1.7% 35010864 / 37241026 / -6.0% 0.68 / 0.62 / +8.2%
tpcds_q26/duckdb:vortex-compact 26967773 / 26962371 / +0.0% 38071337 / 38282112 / -0.6% 0.71 / 0.70 / +0.6%
tpcds_q27/duckdb:vortex-compact 30036593 / 29930534 / +0.4% 40555256 / 40149136 / +1.0% 0.74 / 0.75 / -0.7%
tpcds_q28/duckdb:vortex-compact 21973832 / 22836964 / -3.8% 30268448 / 35147017 / -13.9% 🟢 0.73 / 0.65 / +11.7%
tpcds_q29/duckdb:vortex-compact 22886886 / 22654750 / +1.0% 34015603 / 34655119 / -1.8% 0.67 / 0.65 / +2.9%
tpcds_q30/duckdb:vortex-compact 22092857 / 21816104 / +1.3% 30528455 / 31412926 / -2.8% 0.72 / 0.69 / +4.2%
tpcds_q31/duckdb:vortex-compact 21377266 / 21313838 / +0.3% 28116618 / 28888497 / -2.7% 0.76 / 0.74 / +3.1%
tpcds_q32/duckdb:vortex-compact 11316186 / 10828416 / +4.5% 19354531 / 19303602 / +0.3% 0.58 / 0.56 / +4.2%
tpcds_q33/duckdb:vortex-compact 19785168 / 20650402 / -4.2% 30097601 / 30576808 / -1.6% 0.66 / 0.68 / -2.7%
tpcds_q34/duckdb:vortex-compact 14408004 / 14228178 / +1.3% 24381621 / 24503965 / -0.5% 0.59 / 0.58 / +1.8%
tpcds_q35/duckdb:vortex-compact 34910020 / 34478817 / +1.3% 46728535 / 47282588 / -1.2% 0.75 / 0.73 / +2.5%
tpcds_q36/duckdb:vortex-compact 16075957 / 16030368 / +0.3% 25078434 / 25333109 / -1.0% 0.64 / 0.63 / +1.3%
tpcds_q37/duckdb:vortex-compact 13255882 / 13647254 / -2.9% 26540523 / 26524942 / +0.1% 0.50 / 0.51 / -2.9%
tpcds_q38/duckdb:vortex-compact 25353530 / 25563343 / -0.8% 33696174 / 32425003 / +3.9% 0.75 / 0.79 / -4.6%
tpcds_q39/duckdb:vortex-compact 19819290 / 19398240 / +2.2% 32571805 / 32645616 / -0.2% 0.61 / 0.59 / +2.4%
tpcds_q40/duckdb:vortex-compact 12582561 / 12278739 / +2.5% 22155864 / 22644512 / -2.2% 0.57 / 0.54 / +4.7%
tpcds_q41/duckdb:vortex-compact 20555188 / 20629730 / -0.4% 28075751 / 27610285 / +1.7% 0.73 / 0.75 / -2.0%
tpcds_q42/duckdb:vortex-compact 8285894 / 8145402 / +1.7% 16808322 / 16612669 / +1.2% 0.49 / 0.49 / +0.5%
tpcds_q43/duckdb:vortex-compact 11197111 / 10679080 / +4.9% 20399847 / 19854689 / +2.7% 0.55 / 0.54 / +2.0%
tpcds_q44/duckdb:vortex-compact 15434098 / 15736478 / -1.9% 26789545 / 26475007 / +1.2% 0.58 / 0.59 / -3.1%
tpcds_q45/duckdb:vortex-compact 26753243 / 26058076 / +2.7% 32612413 / 32693138 / -0.2% 0.82 / 0.80 / +2.9%
tpcds_q46/duckdb:vortex-compact 33304418 / 33138170 / +0.5% 44499929 / 44238181 / +0.6% 0.75 / 0.75 / -0.1%
tpcds_q47/duckdb:vortex-compact 33290472 / 34049759 / -2.2% 41632307 / 42028725 / -0.9% 0.80 / 0.81 / -1.3%
tpcds_q48/duckdb:vortex-compact 38231505 / 37957389 / +0.7% 50259339 / 49157528 / +2.2% 0.76 / 0.77 / -1.5%
tpcds_q49/duckdb:vortex-compact 22565254 / 22837884 / -1.2% 32260518 / 32799306 / -1.6% 0.70 / 0.70 / +0.5%
tpcds_q50/duckdb:vortex-compact 17611670 / 17649854 / -0.2% 26399535 / 25954620 / +1.7% 0.67 / 0.68 / -1.9%
tpcds_q51/duckdb:vortex-compact 50634390 / 49695859 / +1.9% 77810918 / 59060338 / +31.7% 🔴 0.65 / 0.84 / -22.7%
tpcds_q52/duckdb:vortex-compact 8531608 / 8622482 / -1.1% 16691860 / 17171006 / -2.8% 0.51 / 0.50 / +1.8%
tpcds_q53/duckdb:vortex-compact 13964484 / 13852917 / +0.8% 23138636 / 23337731 / -0.9% 0.60 / 0.59 / +1.7%
tpcds_q54/duckdb:vortex-compact 21200940 / 21558374 / -1.7% 30857995 / 31580273 / -2.3% 0.69 / 0.68 / +0.6%
tpcds_q55/duckdb:vortex-compact 8294230 / 8291013 / +0.0% 16245558 / 16461679 / -1.3% 0.51 / 0.50 / +1.4%
tpcds_q56/duckdb:vortex-compact 20597352 / 21029240 / -2.1% 29323462 / 31493676 / -6.9% 0.70 / 0.67 / +5.2%
tpcds_q57/duckdb:vortex-compact 26988493 / 27138500 / -0.6% 35512355 / 35458094 / +0.2% 0.76 / 0.77 / -0.7%
tpcds_q58/duckdb:vortex-compact 21643457 / 21805578 / -0.7% 31307396 / 31729560 / -1.3% 0.69 / 0.69 / +0.6%
tpcds_q59/duckdb:vortex-compact 23141274 / 20670929 / +12.0% 🔴 28604720 / 28242061 / +1.3% 0.81 / 0.73 / +10.5%
tpcds_q60/duckdb:vortex-compact 21867380 / 20476868 / +6.8% 30601030 / 31570476 / -3.1% 0.71 / 0.65 / +10.2%
tpcds_q61/duckdb:vortex-compact 22310892 / 22124086 / +0.8% 31522935 / 32163161 / -2.0% 0.71 / 0.69 / +2.9%
tpcds_q62/duckdb:vortex-compact 12596630 / 12325174 / +2.2% 19192432 / 18997264 / +1.0% 0.66 / 0.65 / +1.2%
tpcds_q63/duckdb:vortex-compact 13089169 / 12957016 / +1.0% 22432533 / 22152869 / +1.3% 0.58 / 0.58 / -0.2%
tpcds_q64/duckdb:vortex-compact 64455358 / 63151214 / +2.1% 76874946 / 76662178 / +0.3% 0.84 / 0.82 / +1.8%
tpcds_q65/duckdb:vortex-compact 14759991 / 14626572 / +0.9% 24655156 / 23914537 / +3.1% 0.60 / 0.61 / -2.1%
tpcds_q66/duckdb:vortex-compact 34025777 / 34744314 / -2.1% 40447344 / 40545801 / -0.2% 0.84 / 0.86 / -1.8%
tpcds_q67/duckdb:vortex-compact 63590490 / 57398867 / +10.8% 🔴 67592404 / 66285188 / +2.0% 0.94 / 0.87 / +8.6%
tpcds_q68/duckdb:vortex-compact 24544320 / 24464782 / +0.3% 35580789 / 37354649 / -4.7% 0.69 / 0.65 / +5.3%
tpcds_q69/duckdb:vortex-compact 28864884 / 28577266 / +1.0% 43441510 / 42888450 / +1.3% 0.66 / 0.67 / -0.3%
tpcds_q70/duckdb:vortex-compact 16178438 / 16328174 / -0.9% 27111268 / 26873767 / +0.9% 0.60 / 0.61 / -1.8%
tpcds_q71/duckdb:vortex-compact 14413676 / 15330756 / -6.0% 25487787 / 25287833 / +0.8% 0.57 / 0.61 / -6.7%
tpcds_q72/duckdb:vortex-compact 48429187 / 48434154 / -0.0% 60448909 / 60331800 / +0.2% 0.80 / 0.80 / -0.2%
tpcds_q73/duckdb:vortex-compact 13510200 / 13493672 / +0.1% 23458690 / 22850310 / +2.7% 0.58 / 0.59 / -2.5%
tpcds_q74/duckdb:vortex-compact 32653158 / 32665949 / -0.0% 42168278 / 42501058 / -0.8% 0.77 / 0.77 / +0.7%
tpcds_q75/duckdb:vortex-compact 39752024 / 39202231 / +1.4% 51613136 / 52378244 / -1.5% 0.77 / 0.75 / +2.9%
tpcds_q76/duckdb:vortex-compact 14113268 / 13928753 / +1.3% 22611673 / 22977764 / -1.6% 0.62 / 0.61 / +3.0%
tpcds_q77/duckdb:vortex-compact 24987890 / 23973028 / +4.2% 32216555 / 33228551 / -3.0% 0.78 / 0.72 / +7.5%
tpcds_q78/duckdb:vortex-compact 45915925 / 45957193 / -0.1% 55067096 / 54607312 / +0.8% 0.83 / 0.84 / -0.9%
tpcds_q79/duckdb:vortex-compact 18601302 / 18198833 / +2.2% 28839779 / 29341098 / -1.7% 0.64 / 0.62 / +4.0%
tpcds_q80/duckdb:vortex-compact 32580328 / 32117260 / +1.4% 44387358 / 44130665 / +0.6% 0.73 / 0.73 / +0.9%
tpcds_q81/duckdb:vortex-compact 23213133 / 23099420 / +0.5% 32037385 / 31760335 / +0.9% 0.72 / 0.73 / -0.4%
tpcds_q82/duckdb:vortex-compact 12322466 / 13061040 / -5.7% 25726771 / 26166303 / -1.7% 0.48 / 0.50 / -4.0%
tpcds_q83/duckdb:vortex-compact 18911194 / 18624308 / +1.5% 26366696 / 25594511 / +3.0% 0.72 / 0.73 / -1.4%
tpcds_q84/duckdb:vortex-compact 17730558 / 17456156 / +1.6% 23931898 / 23621036 / +1.3% 0.74 / 0.74 / +0.3%
tpcds_q85/duckdb:vortex-compact 40888712 / 40330004 / +1.4% 53031942 / 52358765 / +1.3% 0.77 / 0.77 / +0.1%
tpcds_q86/duckdb:vortex-compact 11078401 / 11229841 / -1.3% 17034487 / 16809469 / +1.3% 0.65 / 0.67 / -2.7%
tpcds_q87/duckdb:vortex-compact 26964772 / 26871697 / +0.3% 35024903 / 34351982 / +2.0% 0.77 / 0.78 / -1.6%
tpcds_q88/duckdb:vortex-compact 32538772 / 32179672 / +1.1% 39613898 / 39329328 / +0.7% 0.82 / 0.82 / +0.4%
tpcds_q89/duckdb:vortex-compact 14195452 / 14158622 / +0.3% 22850731 / 22961535 / -0.5% 0.62 / 0.62 / +0.7%
tpcds_q90/duckdb:vortex-compact 8522866 / 8644394 / -1.4% 16308879 / 15837888 / +3.0% 0.52 / 0.55 / -4.3%
tpcds_q91/duckdb:vortex-compact 24514999 / 24198948 / +1.3% 32480818 / 32786009 / -0.9% 0.75 / 0.74 / +2.3%
tpcds_q92/duckdb:vortex-compact 11574636 / 11403016 / +1.5% 18892309 / 18223760 / +3.7% 0.61 / 0.63 / -2.1%
tpcds_q93/duckdb:vortex-compact 12709314 / 12602970 / +0.8% 23860608 / 25475807 / -6.3% 0.53 / 0.49 / +7.7%
tpcds_q94/duckdb:vortex-compact 23892246 / 23679468 / +0.9% 33766094 / 33699135 / +0.2% 0.71 / 0.70 / +0.7%
tpcds_q95/duckdb:vortex-compact 63007495 / 63001879 / +0.0% 70743444 / 70922733 / -0.3% 0.89 / 0.89 / +0.3%
tpcds_q96/duckdb:vortex-compact 8670095 / 8595802 / +0.9% 17100822 / 17386645 / -1.6% 0.51 / 0.49 / +2.6%
tpcds_q97/duckdb:vortex-compact 23859390 / 24111506 / -1.0% 32836979 / 32424871 / +1.3% 0.73 / 0.74 / -2.3%
tpcds_q98/duckdb:vortex-compact 13988898 / 14019556 / -0.2% 21898211 / 22126886 / -1.0% 0.64 / 0.63 / +0.8%
tpcds_q99/duckdb:vortex-compact 15654627 / 15892443 / -1.5% 23406283 / 23451604 / -0.2% 0.67 / 0.68 / -1.3%
duckdb / parquet / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23821297 / 23875990 / -0.2% 31121048 / 30690657 / +1.4% 0.77 / 0.78 / -1.6%
tpcds_q02/duckdb:parquet 17855056 / 17830638 / +0.1% 23804999 / 23594154 / +0.9% 0.75 / 0.76 / -0.7%
tpcds_q03/duckdb:parquet 9754510 / 9624885 / +1.3% 15425779 / 15680781 / -1.6% 0.63 / 0.61 / +3.0%
tpcds_q04/duckdb:parquet 118225903 / 117029078 / +1.0% 126589914 / 124805952 / +1.4% 0.93 / 0.94 / -0.4%
tpcds_q05/duckdb:parquet 28484870 / 28114532 / +1.3% 32598876 / 32741720 / -0.4% 0.87 / 0.86 / +1.8%
tpcds_q06/duckdb:parquet 26258392 / 26125904 / +0.5% 35610103 / 35436766 / +0.5% 0.74 / 0.74 / +0.0%
tpcds_q07/duckdb:parquet 30872323 / 30509041 / +1.2% 38513765 / 38720924 / -0.5% 0.80 / 0.79 / +1.7%
tpcds_q08/duckdb:parquet 19816884 / 19547584 / +1.4% 26117765 / 26881172 / -2.8% 0.76 / 0.73 / +4.3%
tpcds_q09/duckdb:parquet 26907702 / 26897573 / +0.0% 29902148 / 30262998 / -1.2% 0.90 / 0.89 / +1.2%
tpcds_q10/duckdb:parquet 32508929 / 32589904 / -0.2% 39881643 / 40317078 / -1.1% 0.82 / 0.81 / +0.8%
tpcds_q11/duckdb:parquet 68604790 / 68396797 / +0.3% 74366800 / 75534898 / -1.5% 0.92 / 0.91 / +1.9%
tpcds_q12/duckdb:parquet 14079100 / 13955978 / +0.9% 18986038 / 18979540 / +0.0% 0.74 / 0.74 / +0.8%
tpcds_q13/duckdb:parquet 30616482 / 31492976 / -2.8% 38817890 / 39492167 / -1.7% 0.79 / 0.80 / -1.1%
tpcds_q14/duckdb:parquet 65938992 / 63540059 / +3.8% 68304735 / 68989762 / -1.0% 0.97 / 0.92 / +4.8%
tpcds_q15/duckdb:parquet 16579680 / 16434482 / +0.9% 22332580 / 22124842 / +0.9% 0.74 / 0.74 / -0.1%
tpcds_q16/duckdb:parquet 30129526 / 29795274 / +1.1% 37527570 / 37332013 / +0.5% 0.80 / 0.80 / +0.6%
tpcds_q17/duckdb:parquet 34381316 / 34412850 / -0.1% 39842956 / 39664339 / +0.5% 0.86 / 0.87 / -0.5%
tpcds_q18/duckdb:parquet 47281068 / 46867120 / +0.9% 54408553 / 55810128 / -2.5% 0.87 / 0.84 / +3.5%
tpcds_q19/duckdb:parquet 18696926 / 18871432 / -0.9% 25193508 / 25800818 / -2.4% 0.74 / 0.73 / +1.5%
tpcds_q20/duckdb:parquet 15041170 / 14715175 / +2.2% 19549316 / 19695300 / -0.7% 0.77 / 0.75 / +3.0%
tpcds_q21/duckdb:parquet 10565741 / 10361658 / +2.0% 16472372 / 16997453 / -3.1% 0.64 / 0.61 / +5.2%
tpcds_q22/duckdb:parquet 20844922 / 20666466 / +0.9% 26473920 / 26671376 / -0.7% 0.79 / 0.77 / +1.6%
tpcds_q23/duckdb:parquet 42609458 / 42809180 / -0.5% 47774382 / 47373874 / +0.8% 0.89 / 0.90 / -1.3%
tpcds_q24/duckdb:parquet 30183372 / 29968554 / +0.7% 36396845 / 36582615 / -0.5% 0.83 / 0.82 / +1.2%
tpcds_q25/duckdb:parquet 30538066 / 30280431 / +0.9% 37134223 / 36976737 / +0.4% 0.82 / 0.82 / +0.4%
tpcds_q26/duckdb:parquet 28795408 / 29027580 / -0.8% 34494855 / 35776386 / -3.6% 0.83 / 0.81 / +2.9%
tpcds_q27/duckdb:parquet 35880204 / 35510845 / +1.0% 42017356 / 41097616 / +2.2% 0.85 / 0.86 / -1.2%
tpcds_q28/duckdb:parquet 26530348 / 25595369 / +3.7% 33092875 / 32981301 / +0.3% 0.80 / 0.78 / +3.3%
tpcds_q29/duckdb:parquet 33669000 / 31916319 / +5.5% 38986226 / 39919283 / -2.3% 0.86 / 0.80 / +8.0%
tpcds_q30/duckdb:parquet 35427041 / 35511442 / -0.2% 44184774 / 43947107 / +0.5% 0.80 / 0.81 / -0.8%
tpcds_q31/duckdb:parquet 35559418 / 35354595 / +0.6% 42684624 / 42623541 / +0.1% 0.83 / 0.83 / +0.4%
tpcds_q32/duckdb:parquet 14228641 / 14144246 / +0.6% 20602021 / 20626947 / -0.1% 0.69 / 0.69 / +0.7%
tpcds_q33/duckdb:parquet 24647338 / 25283028 / -2.5% 28553315 / 29569864 / -3.4% 0.86 / 0.86 / +1.0%
tpcds_q34/duckdb:parquet 16935532 / 16942378 / -0.0% 24070026 / 24528241 / -1.9% 0.70 / 0.69 / +1.9%
tpcds_q35/duckdb:parquet 35436982 / 35000030 / +1.2% 43413968 / 44207664 / -1.8% 0.82 / 0.79 / +3.1%
tpcds_q36/duckdb:parquet 40236431 / 40559701 / -0.8% 47263147 / 47121578 / +0.3% 0.85 / 0.86 / -1.1%
tpcds_q37/duckdb:parquet 12747704 / 12660513 / +0.7% 19179091 / 19490315 / -1.6% 0.66 / 0.65 / +2.3%
tpcds_q38/duckdb:parquet 29809766 / 29228756 / +2.0% 34372469 / 33638737 / +2.2% 0.87 / 0.87 / -0.2%
tpcds_q39/duckdb:parquet 23440460 / 23163212 / +1.2% 29627893 / 28950669 / +2.3% 0.79 / 0.80 / -1.1%
tpcds_q40/duckdb:parquet 15910510 / 15793230 / +0.7% 21117602 / 21320256 / -1.0% 0.75 / 0.74 / +1.7%
tpcds_q41/duckdb:parquet 11881328 / 11827414 / +0.5% 18041182 / 18082162 / -0.2% 0.66 / 0.65 / +0.7%
tpcds_q42/duckdb:parquet 9558196 / 9455187 / +1.1% 15613710 / 15384508 / +1.5% 0.61 / 0.61 / -0.4%
tpcds_q43/duckdb:parquet 11958348 / 11943178 / +0.1% 18263599 / 17728117 / +3.0% 0.65 / 0.67 / -2.8%
tpcds_q44/duckdb:parquet 20961622 / 20445730 / +2.5% 27016217 / 27789057 / -2.8% 0.78 / 0.74 / +5.5%
tpcds_q45/duckdb:parquet 21013776 / 20833422 / +0.9% 27787780 / 27468079 / +1.2% 0.76 / 0.76 / -0.3%
tpcds_q46/duckdb:parquet 36689826 / 37595644 / -2.4% 43134804 / 43119195 / +0.0% 0.85 / 0.87 / -2.4%
tpcds_q47/duckdb:parquet 34564336 / 34197560 / +1.1% 41622221 / 41529035 / +0.2% 0.83 / 0.82 / +0.8%
tpcds_q48/duckdb:parquet 31892218 / 29317374 / +8.8% 36722090 / 36670563 / +0.1% 0.87 / 0.80 / +8.6%
tpcds_q49/duckdb:parquet 30193189 / 31255177 / -3.4% 35706184 / 37136019 / -3.9% 0.85 / 0.84 / +0.5%
tpcds_q50/duckdb:parquet 19347464 / 19027424 / +1.7% 25797571 / 25742358 / +0.2% 0.75 / 0.74 / +1.5%
tpcds_q51/duckdb:parquet 52818128 / 51861426 / +1.8% 78216342 / 60743436 / +28.8% 🔴 0.68 / 0.85 / -20.9%
tpcds_q52/duckdb:parquet 9769600 / 9505386 / +2.8% 15487127 / 15417931 / +0.4% 0.63 / 0.62 / +2.3%
tpcds_q53/duckdb:parquet 13765096 / 14116643 / -2.5% 20690163 / 20696494 / -0.0% 0.67 / 0.68 / -2.5%
tpcds_q54/duckdb:parquet 24902106 / 24678396 / +0.9% 31931867 / 31607606 / +1.0% 0.78 / 0.78 / -0.1%
tpcds_q55/duckdb:parquet 9482190 / 9252440 / +2.5% 15297855 / 14959770 / +2.3% 0.62 / 0.62 / +0.2%
tpcds_q56/duckdb:parquet 24905198 / 26697486 / -6.7% 30385850 / 30010367 / +1.3% 0.82 / 0.89 / -7.9%
tpcds_q57/duckdb:parquet 30707321 / 30571226 / +0.4% 35973081 / 36257834 / -0.8% 0.85 / 0.84 / +1.2%
tpcds_q58/duckdb:parquet 23906418 / 24521324 / -2.5% 29821395 / 29687432 / +0.5% 0.80 / 0.83 / -2.9%
tpcds_q59/duckdb:parquet 22609606 / 22773204 / -0.7% 29118918 / 29071070 / +0.2% 0.78 / 0.78 / -0.9%
tpcds_q60/duckdb:parquet 26322722 / 26948120 / -2.3% 31828827 / 31802349 / +0.1% 0.83 / 0.85 / -2.4%
tpcds_q61/duckdb:parquet 24731294 / 24404129 / +1.3% 28653016 / 29016152 / -1.3% 0.86 / 0.84 / +2.6%
tpcds_q62/duckdb:parquet 12741591 / 12643279 / +0.8% 17949283 / 17863261 / +0.5% 0.71 / 0.71 / +0.3%
tpcds_q63/duckdb:parquet 13316290 / 13157104 / +1.2% 20119006 / 19985437 / +0.7% 0.66 / 0.66 / +0.5%
tpcds_q64/duckdb:parquet 70533366 / 70306159 / +0.3% 78783620 / 80252696 / -1.8% 0.90 / 0.88 / +2.2%
tpcds_q65/duckdb:parquet 20408730 / 20294472 / +0.6% 25620200 / 26007397 / -1.5% 0.80 / 0.78 / +2.1%
tpcds_q66/duckdb:parquet 33046318 / 33094321 / -0.1% 37756704 / 38291520 / -1.4% 0.88 / 0.86 / +1.3%
tpcds_q67/duckdb:parquet 61218831 / 60964048 / +0.4% 68610546 / 67623325 / +1.5% 0.89 / 0.90 / -1.0%
tpcds_q68/duckdb:parquet 30063125 / 29371478 / +2.4% 36225825 / 36057140 / +0.5% 0.83 / 0.81 / +1.9%
tpcds_q69/duckdb:parquet 25787645 / 26245926 / -1.7% 33979610 / 34353236 / -1.1% 0.76 / 0.76 / -0.7%
tpcds_q70/duckdb:parquet 19134552 / 19195662 / -0.3% 26904226 / 28053689 / -4.1% 0.71 / 0.68 / +3.9%
tpcds_q71/duckdb:parquet 16861650 / 17035380 / -1.0% 23504417 / 23780716 / -1.2% 0.72 / 0.72 / +0.1%
tpcds_q72/duckdb:parquet 53272854 / 53447254 / -0.3% 59012958 / 58332784 / +1.2% 0.90 / 0.92 / -1.5%
tpcds_q73/duckdb:parquet 17276562 / 14697034 / +17.6% 🔴 21792813 / 21311765 / +2.3% 0.79 / 0.69 / +15.0%
tpcds_q74/duckdb:parquet 84911684 / 84255212 / +0.8% 90381846 / 90867973 / -0.5% 0.94 / 0.93 / +1.3%
tpcds_q75/duckdb:parquet 44369332 / 43777298 / +1.4% 49442633 / 49847417 / -0.8% 0.90 / 0.88 / +2.2%
tpcds_q76/duckdb:parquet 18349456 / 18132114 / +1.2% 22472022 / 24691506 / -9.0% 0.82 / 0.73 / +11.2%
tpcds_q77/duckdb:parquet 25015585 / 26448262 / -5.4% 30493968 / 31086693 / -1.9% 0.82 / 0.85 / -3.6%
tpcds_q78/duckdb:parquet 78519068 / 78342442 / +0.2% 85904448 / 85352718 / +0.6% 0.91 / 0.92 / -0.4%
tpcds_q79/duckdb:parquet 24125352 / 22752484 / +6.0% 28435218 / 28368467 / +0.2% 0.85 / 0.80 / +5.8%
tpcds_q80/duckdb:parquet 35719708 / 36531370 / -2.2% 43598892 / 43519675 / +0.2% 0.82 / 0.84 / -2.4%
tpcds_q81/duckdb:parquet 36143464 / 36143485 / -0.0% 44701578 / 44009061 / +1.6% 0.81 / 0.82 / -1.5%
tpcds_q82/duckdb:parquet 13499076 / 13491462 / +0.1% 20111317 / 20310941 / -1.0% 0.67 / 0.66 / +1.0%
tpcds_q83/duckdb:parquet 20009424 / 19820038 / +1.0% 24576937 / 24500033 / +0.3% 0.81 / 0.81 / +0.6%
tpcds_q84/duckdb:parquet 22911574 / 22982384 / -0.3% 28690135 / 29014702 / -1.1% 0.80 / 0.79 / +0.8%
tpcds_q85/duckdb:parquet 32682132 / 32077638 / +1.9% 39446796 / 39812867 / -0.9% 0.83 / 0.81 / +2.8%
tpcds_q86/duckdb:parquet 11795548 / 11724141 / +0.6% 16917460 / 16466085 / +2.7% 0.70 / 0.71 / -2.1%
tpcds_q87/duckdb:parquet 31441564 / 31031883 / +1.3% 35297245 / 35591156 / -0.8% 0.89 / 0.87 / +2.2%
tpcds_q88/duckdb:parquet 38325156 / 38225984 / +0.3% 42886303 / 41356685 / +3.7% 0.89 / 0.92 / -3.3%
tpcds_q89/duckdb:parquet 14230207 / 14103356 / +0.9% 21228585 / 21254023 / -0.1% 0.67 / 0.66 / +1.0%
tpcds_q90/duckdb:parquet 9914609 / 10037900 / -1.2% 15439541 / 15058764 / +2.5% 0.64 / 0.67 / -3.7%
tpcds_q91/duckdb:parquet 21028294 / 20798093 / +1.1% 28261204 / 28144969 / +0.4% 0.74 / 0.74 / +0.7%
tpcds_q92/duckdb:parquet 15572780 / 15499016 / +0.5% 21948117 / 22107509 / -0.7% 0.71 / 0.70 / +1.2%
tpcds_q93/duckdb:parquet 14264894 / 14066582 / +1.4% 20366145 / 20321456 / +0.2% 0.70 / 0.69 / +1.2%
tpcds_q94/duckdb:parquet 25377382 / 25184628 / +0.8% 32505990 / 32433561 / +0.2% 0.78 / 0.78 / +0.5%
tpcds_q95/duckdb:parquet 43841116 / 43273119 / +1.3% 50383569 / 49923266 / +0.9% 0.87 / 0.87 / +0.4%
tpcds_q96/duckdb:parquet 8175172 / 8180218 / -0.1% 13939289 / 13634824 / +2.2% 0.59 / 0.60 / -2.2%
tpcds_q97/duckdb:parquet 27630674 / 27229076 / +1.5% 34342669 / 34183465 / +0.5% 0.80 / 0.80 / +1.0%
tpcds_q98/duckdb:parquet 16533979 / 16316068 / +1.3% 22672403 / 22656832 / +0.1% 0.73 / 0.72 / +1.3%
tpcds_q99/duckdb:parquet 18671580 / 18717105 / -0.2% 24676128 / 24563262 / +0.5% 0.76 / 0.76 / -0.7%
duckdb / duckdb / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15571198 / 15350359 / +1.4% 24779370 / 24894542 / -0.5% 0.63 / 0.62 / +1.9%
tpcds_q02/duckdb:duckdb 12298960 / 12362365 / -0.5% 18515305 / 19679615 / -5.9% 0.66 / 0.63 / +5.7%
tpcds_q03/duckdb:duckdb 4927654 / 4961490 / -0.7% 10923935 / 12828540 / -14.8% 🟢 0.45 / 0.39 / +16.6%
tpcds_q04/duckdb:duckdb 49071072 / 48495860 / +1.2% 54647436 / 55659310 / -1.8% 0.90 / 0.87 / +3.1%
tpcds_q05/duckdb:duckdb 15685516 / 15597286 / +0.6% 21934701 / 22325425 / -1.8% 0.72 / 0.70 / +2.4%
tpcds_q06/duckdb:duckdb 17963445 / 17855006 / +0.6% 28387123 / 29022027 / -2.2% 0.63 / 0.62 / +2.9%
tpcds_q07/duckdb:duckdb 21502591 / 21101450 / +1.9% 30332029 / 31376498 / -3.3% 0.71 / 0.67 / +5.4%
tpcds_q08/duckdb:duckdb 18980370 / 18709176 / +1.4% 28263659 / 28638258 / -1.3% 0.67 / 0.65 / +2.8%
tpcds_q09/duckdb:duckdb 8515554 / 8486446 / +0.3% 13240941 / 13973162 / -5.2% 0.64 / 0.61 / +5.9%
tpcds_q10/duckdb:duckdb 17929421 / 17749321 / +1.0% 27311088 / 28439206 / -4.0% 0.66 / 0.62 / +5.2%
tpcds_q11/duckdb:duckdb 42159742 / 41750607 / +1.0% 49294457 / 50220279 / -1.8% 0.86 / 0.83 / +2.9%
tpcds_q12/duckdb:duckdb 9206516 / 9166058 / +0.4% 16070112 / 17100711 / -6.0% 0.57 / 0.54 / +6.9%
tpcds_q13/duckdb:duckdb 20309130 / 20009938 / +1.5% 31336737 / 33501544 / -6.5% 0.65 / 0.60 / +8.5%
tpcds_q14/duckdb:duckdb 39892904 / 39695657 / +0.5% 44785593 / 45993512 / -2.6% 0.89 / 0.86 / +3.2%
tpcds_q15/duckdb:duckdb 8411482 / 8249376 / +2.0% 13882814 / 13982261 / -0.7% 0.61 / 0.59 / +2.7%
tpcds_q16/duckdb:duckdb 12252332 / 12333280 / -0.7% 21327444 / 21574748 / -1.1% 0.57 / 0.57 / +0.5%
tpcds_q17/duckdb:duckdb 17645062 / 17560342 / +0.5% 27447594 / 29704321 / -7.6% 0.64 / 0.59 / +8.7%
tpcds_q18/duckdb:duckdb 32323948 / 31986284 / +1.1% 44932433 / 45885412 / -2.1% 0.72 / 0.70 / +3.2%
tpcds_q19/duckdb:duckdb 10505740 / 10324960 / +1.8% 20042092 / 20222261 / -0.9% 0.52 / 0.51 / +2.7%
tpcds_q20/duckdb:duckdb 9583253 / 9614636 / -0.3% 16603398 / 17119469 / -3.0% 0.58 / 0.56 / +2.8%
tpcds_q21/duckdb:duckdb 6101772 / 6099690 / +0.0% 11003634 / 11548007 / -4.7% 0.55 / 0.53 / +5.0%
tpcds_q22/duckdb:duckdb 18083212 / 17336360 / +4.3% 23012218 / 22883897 / +0.6% 0.79 / 0.76 / +3.7%
tpcds_q23/duckdb:duckdb 27006418 / 26673573 / +1.2% 35025957 / 35193044 / -0.5% 0.77 / 0.76 / +1.7%
tpcds_q24/duckdb:duckdb 15676686 / 15575714 / +0.6% 28590603 / 30090135 / -5.0% 0.55 / 0.52 / +5.9%
tpcds_q25/duckdb:duckdb 13820073 / 13726348 / +0.7% 25182055 / 26674290 / -5.6% 0.55 / 0.51 / +6.6%
tpcds_q26/duckdb:duckdb 18338217 / 18163540 / +1.0% 26545801 / 27475760 / -3.4% 0.69 / 0.66 / +4.5%
tpcds_q27/duckdb:duckdb 23209725 / 23254286 / -0.2% 33906398 / 35311108 / -4.0% 0.68 / 0.66 / +3.9%
tpcds_q28/duckdb:duckdb 11848668 / 11813964 / +0.3% 18430917 / 18142557 / +1.6% 0.64 / 0.65 / -1.3%
tpcds_q29/duckdb:duckdb 13919664 / 13912284 / +0.1% 24367822 / 26977064 / -9.7% 0.57 / 0.52 / +10.8%
tpcds_q30/duckdb:duckdb 17817652 / 17389000 / +2.5% 29552553 / 29632063 / -0.3% 0.60 / 0.59 / +2.7%
tpcds_q31/duckdb:duckdb 30252096 / 30245808 / +0.0% 37918495 / 39155579 / -3.2% 0.80 / 0.77 / +3.3%
tpcds_q32/duckdb:duckdb 5364053 / 5258344 / +2.0% 12667311 / 13627269 / -7.0% 0.42 / 0.39 / +9.7%
tpcds_q33/duckdb:duckdb 8988490 / 9042882 / -0.6% 15574520 / 16780079 / -7.2% 0.58 / 0.54 / +7.1%
tpcds_q34/duckdb:duckdb 10367416 / 10362160 / +0.1% 18740163 / 20217436 / -7.3% 0.55 / 0.51 / +7.9%
tpcds_q35/duckdb:duckdb 24353181 / 24085865 / +1.1% 34002366 / 33457024 / +1.6% 0.72 / 0.72 / -0.5%
tpcds_q36/duckdb:duckdb 12856677 / 12760294 / +0.8% 21797590 / 22307269 / -2.3% 0.59 / 0.57 / +3.1%
tpcds_q37/duckdb:duckdb 5303248 / 5266958 / +0.7% 13176777 / 13924779 / -5.4% 0.40 / 0.38 / +6.4%
tpcds_q38/duckdb:duckdb 22829374 / 22553598 / +1.2% 28234131 / 29989080 / -5.9% 0.81 / 0.75 / +7.5%
tpcds_q39/duckdb:duckdb 19383840 / 19113282 / +1.4% 24722880 / 24629567 / +0.4% 0.78 / 0.78 / +1.0%
tpcds_q40/duckdb:duckdb 8375798 / 8447038 / -0.8% 15915296 / 16351175 / -2.7% 0.53 / 0.52 / +1.9%
tpcds_q41/duckdb:duckdb 10084045 / 10142795 / -0.6% 16698841 / 16914776 / -1.3% 0.60 / 0.60 / +0.7%
tpcds_q42/duckdb:duckdb 4991371 / 4829098 / +3.4% 11645082 / 12577393 / -7.4% 0.43 / 0.38 / +11.6%
tpcds_q43/duckdb:duckdb 7518160 / 7447767 / +0.9% 14707849 / 16253156 / -9.5% 0.51 / 0.46 / +11.6%
tpcds_q44/duckdb:duckdb 9135474 / 9188908 / -0.6% 17604853 / 18845617 / -6.6% 0.52 / 0.49 / +6.4%
tpcds_q45/duckdb:duckdb 13417234 / 13347630 / +0.5% 21673338 / 23027766 / -5.9% 0.62 / 0.58 / +6.8%
tpcds_q46/duckdb:duckdb 24995191 / 24975324 / +0.1% 34926219 / 35767501 / -2.4% 0.72 / 0.70 / +2.5%
tpcds_q47/duckdb:duckdb 33998960 / 33253162 / +2.2% 41435303 / 42179959 / -1.8% 0.82 / 0.79 / +4.1%
tpcds_q48/duckdb:duckdb 27331652 / 27095434 / +0.9% 36389090 / 38155438 / -4.6% 0.75 / 0.71 / +5.8%
tpcds_q49/duckdb:duckdb 14694740 / 14577068 / +0.8% 23834225 / 25670712 / -7.2% 0.62 / 0.57 / +8.6%
tpcds_q50/duckdb:duckdb 9910772 / 10002410 / -0.9% 16929025 / 19892734 / -14.9% 🟢 0.59 / 0.50 / +16.4%
tpcds_q51/duckdb:duckdb 46227279 / 46833370 / -1.3% 71290995 / 54920344 / +29.8% 🔴 0.65 / 0.85 / -24.0%
tpcds_q52/duckdb:duckdb 5202459 / 5062181 / +2.8% 11432339 / 11873971 / -3.7% 0.46 / 0.43 / +6.7%
tpcds_q53/duckdb:duckdb 9684822 / 9326850 / +3.8% 16773772 / 17644354 / -4.9% 0.58 / 0.53 / +9.2%
tpcds_q54/duckdb:duckdb 11795652 / 11679731 / +1.0% 21062674 / 21959678 / -4.1% 0.56 / 0.53 / +5.3%
tpcds_q55/duckdb:duckdb 4871688 / 4783506 / +1.8% 11381360 / 13059756 / -12.9% 🟢 0.43 / 0.37 / +16.9%
tpcds_q56/duckdb:duckdb 10300074 / 10079265 / +2.2% 17332989 / 17449643 / -0.7% 0.59 / 0.58 / +2.9%
tpcds_q57/duckdb:duckdb 27878528 / 27779067 / +0.4% 34860093 / 35116791 / -0.7% 0.80 / 0.79 / +1.1%
tpcds_q58/duckdb:duckdb 10664921 / 10818726 / -1.4% 17346227 / 17663563 / -1.8% 0.61 / 0.61 / +0.4%
tpcds_q59/duckdb:duckdb 17013775 / 16812064 / +1.2% 23796358 / 24106312 / -1.3% 0.71 / 0.70 / +2.5%
tpcds_q60/duckdb:duckdb 11092780 / 10850264 / +2.2% 17485280 / 17989147 / -2.8% 0.63 / 0.60 / +5.2%
tpcds_q61/duckdb:duckdb 10059722 / 10074701 / -0.1% 18199668 / 18700498 / -2.7% 0.55 / 0.54 / +2.6%
tpcds_q62/duckdb:duckdb 8285278 / 8398250 / -1.3% 14822635 / 15182008 / -2.4% 0.56 / 0.55 / +1.0%
tpcds_q63/duckdb:duckdb 9449317 / 8654640 / +9.2% 16984568 / 17549013 / -3.2% 0.56 / 0.49 / +12.8%
tpcds_q64/duckdb:duckdb 37671543 / 38356864 / -1.8% 53827891 / 57771105 / -6.8% 0.70 / 0.66 / +5.4%
tpcds_q65/duckdb:duckdb 9699676 / 9616894 / +0.9% 18310772 / 18742519 / -2.3% 0.53 / 0.51 / +3.2%
tpcds_q66/duckdb:duckdb 24518180 / 24152200 / +1.5% 31553365 / 32519518 / -3.0% 0.78 / 0.74 / +4.6%
tpcds_q67/duckdb:duckdb 55755771 / 55016899 / +1.3% 65565741 / 65682666 / -0.2% 0.85 / 0.84 / +1.5%
tpcds_q68/duckdb:duckdb 15708616 / 15782258 / -0.5% 25472748 / 27824447 / -8.5% 0.62 / 0.57 / +8.7%
tpcds_q69/duckdb:duckdb 15231273 / 15122742 / +0.7% 24289673 / 24698502 / -1.7% 0.63 / 0.61 / +2.4%
tpcds_q70/duckdb:duckdb 10171861 / 10036592 / +1.3% 19704580 / 19989345 / -1.4% 0.52 / 0.50 / +2.8%
tpcds_q71/duckdb:duckdb 7952524 / 7985044 / -0.4% 14840696 / 15723202 / -5.6% 0.54 / 0.51 / +5.5%
tpcds_q72/duckdb:duckdb 36312762 / 35756096 / +1.6% 45731736 / 46953721 / -2.6% 0.79 / 0.76 / +4.3%
tpcds_q73/duckdb:duckdb 7904285 / 8012366 / -1.3% 16133370 / 16955473 / -4.8% 0.49 / 0.47 / +3.7%
tpcds_q74/duckdb:duckdb 36296360 / 35978774 / +0.9% 44569210 / 44030831 / +1.2% 0.81 / 0.82 / -0.3%
tpcds_q75/duckdb:duckdb 30057711 / 29690946 / +1.2% 40180228 / 41094510 / -2.2% 0.75 / 0.72 / +3.5%
tpcds_q76/duckdb:duckdb 8150258 / 8150365 / -0.0% 15393283 / 16464257 / -6.5% 0.53 / 0.50 / +7.0%
tpcds_q77/duckdb:duckdb 10529390 / 10470596 / +0.6% 19183540 / 20447456 / -6.2% 0.55 / 0.51 / +7.2%
tpcds_q78/duckdb:duckdb 65228132 / 64226504 / +1.6% 73790540 / 73545077 / +0.3% 0.88 / 0.87 / +1.2%
tpcds_q79/duckdb:duckdb 12225762 / 11913621 / +2.6% 21050986 / 21661333 / -2.8% 0.58 / 0.55 / +5.6%
tpcds_q80/duckdb:duckdb 16900052 / 16916514 / -0.1% 28841179 / 29774926 / -3.1% 0.59 / 0.57 / +3.1%
tpcds_q81/duckdb:duckdb 25358006 / 25138386 / +0.9% 37884947 / 36979713 / +2.4% 0.67 / 0.68 / -1.5%
tpcds_q82/duckdb:duckdb 5803706 / 5702524 / +1.8% 13916619 / 14459919 / -3.8% 0.42 / 0.39 / +5.7%
tpcds_q83/duckdb:duckdb 9032522 / 8972770 / +0.7% 14879508 / 15043339 / -1.1% 0.61 / 0.60 / +1.8%
tpcds_q84/duckdb:duckdb 9312138 / 9147730 / +1.8% 16947868 / 17990470 / -5.8% 0.55 / 0.51 / +8.1%
tpcds_q85/duckdb:duckdb 21484134 / 21036750 / +2.1% 34667947 / 36043721 / -3.8% 0.62 / 0.58 / +6.2%
tpcds_q86/duckdb:duckdb 8618674 / 8447442 / +2.0% 14748903 / 15226184 / -3.1% 0.58 / 0.55 / +5.3%
tpcds_q87/duckdb:duckdb 24868195 / 24433944 / +1.8% 30805018 / 31489145 / -2.2% 0.81 / 0.78 / +4.0%
tpcds_q88/duckdb:duckdb 18908555 / 18741041 / +0.9% 24195800 / 25355232 / -4.6% 0.78 / 0.74 / +5.7%
tpcds_q89/duckdb:duckdb 10242774 / 10286206 / -0.4% 17568498 / 18484933 / -5.0% 0.58 / 0.56 / +4.8%
tpcds_q90/duckdb:duckdb 4915614 / 4928332 / -0.3% 10230228 / 10472884 / -2.3% 0.48 / 0.47 / +2.1%
tpcds_q91/duckdb:duckdb 8662762 / 8606158 / +0.7% 17882623 / 18776260 / -4.8% 0.48 / 0.46 / +5.7%
tpcds_q92/duckdb:duckdb 6752914 / 6795760 / -0.6% 14286625 / 15503545 / -7.8% 0.47 / 0.44 / +7.8%
tpcds_q93/duckdb:duckdb 6947338 / 6960819 / -0.2% 13754756 / 14530718 / -5.3% 0.51 / 0.48 / +5.4%
tpcds_q94/duckdb:duckdb 11733288 / 11729450 / +0.0% 22177509 / 23233925 / -4.5% 0.53 / 0.50 / +4.8%
tpcds_q95/duckdb:duckdb 35237472 / 35353862 / -0.3% 43866614 / 44733531 / -1.9% 0.80 / 0.79 / +1.6%
tpcds_q96/duckdb:duckdb 3855003 / 3781186 / +2.0% 8986614 / 9389631 / -4.3% 0.43 / 0.40 / +6.5%
tpcds_q97/duckdb:duckdb 21513842 / 21680601 / -0.8% 27255007 / 27752895 / -1.8% 0.79 / 0.78 / +1.0%
tpcds_q98/duckdb:duckdb 10810481 / 10515682 / +2.8% 18746543 / 18808659 / -0.3% 0.58 / 0.56 / +3.1%
tpcds_q99/duckdb:duckdb 12960416 / 12946371 / +0.1% 19727769 / 20021840 / -1.5% 0.66 / 0.65 / +1.6%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.5%
Engines: DataFusion No clear signal (-4.3%, environment too noisy confidence) · DuckDB No clear signal (+9.7%, environment too noisy confidence)
Vortex (geomean): hot 1.056x ➖ · cold 1.079x ➖
Parquet (geomean): hot 1.030x ➖ · cold 0.993x ➖
Shifts: Parquet (control) +3.0% · Median polish +4.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 4↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 249203369 / 214062378 / +16.4% 780429941 / 697989137 / +11.8% 0.32 / 0.31 / +4.1%
tpch_q02/datafusion:vortex-file-compressed 301902616 / 326651369 / -7.6% 647864001 / 706258308 / -8.3% 0.47 / 0.46 / +0.8%
tpch_q03/datafusion:vortex-file-compressed 365866370 / 358167580 / +2.1% 1000326499 / 1048033396 / -4.6% 0.37 / 0.34 / +7.0%
tpch_q04/datafusion:vortex-file-compressed 208821534 / 192438548 / +8.5% 426205199 / 428446377 / -0.5% 0.49 / 0.45 / +9.1%
tpch_q05/datafusion:vortex-file-compressed 400097229 / 386374259 / +3.6% 638851157 / 632178721 / +1.1% 0.63 / 0.61 / +2.5%
tpch_q06/datafusion:vortex-file-compressed 165560374 / 133512442 / +24.0% 327992654 / 335854620 / -2.3% 0.50 / 0.40 / +27.0%
tpch_q07/datafusion:vortex-file-compressed 461046511 / 404659597 / +13.9% 636017073 / 603849342 / +5.3% 0.72 / 0.67 / +8.2%
tpch_q08/datafusion:vortex-file-compressed 533399203 / 472418670 / +12.9% 880902906 / 590101164 / +49.3% 🔴 0.61 / 0.80 / -24.4%
tpch_q09/datafusion:vortex-file-compressed 288417583 / 433741084 / -33.5% 🟢 523302668 / 1393296458 / -62.4% 🟢 0.55 / 0.31 / +77.0%
tpch_q10/datafusion:vortex-file-compressed 431499778 / 368459232 / +17.1% 588304909 / 637309910 / -7.7% 0.73 / 0.58 / +26.9%
tpch_q11/datafusion:vortex-file-compressed 290700617 / 286290653 / +1.5% 429729798 / 549144032 / -21.7% 0.68 / 0.52 / +29.8%
tpch_q12/datafusion:vortex-file-compressed 239464633 / 413224815 / -42.0% 🟢 462444381 / 414177274 / +11.7% 0.52 / 1.00 / -48.1%
tpch_q13/datafusion:vortex-file-compressed 139905368 / 136082970 / +2.8% 408236708 / 346974873 / +17.7% 0.34 / 0.39 / -12.6%
tpch_q14/datafusion:vortex-file-compressed 179582306 / 281551747 / -36.2% 🟢 720498203 / 501861124 / +43.6% 🔴 0.25 / 0.56 / -55.6%
tpch_q15/datafusion:vortex-file-compressed 304829686 / 394317975 / -22.7% 547024136 / 628860139 / -13.0% 0.56 / 0.63 / -11.1%
tpch_q16/datafusion:vortex-file-compressed 144485697 / 128963366 / +12.0% 284134254 / 259097622 / +9.7% 0.51 / 0.50 / +2.2%
tpch_q17/datafusion:vortex-file-compressed 250013898 / 465782302 / -46.3% 🟢 506255723 / 477032686 / +6.1% 0.49 / 0.98 / -49.4%
tpch_q18/datafusion:vortex-file-compressed 286479270 / 375388437 / -23.7% 475533828 / 500485627 / -5.0% 0.60 / 0.75 / -19.7%
tpch_q19/datafusion:vortex-file-compressed 283422923 / 241285450 / +17.5% 418554653 / 477617755 / -12.4% 0.68 / 0.51 / +34.0%
tpch_q20/datafusion:vortex-file-compressed 424488464 / 286242670 / +48.3% 🔴 606798200 / 495407118 / +22.5% 0.70 / 0.58 / +21.1%
tpch_q21/datafusion:vortex-file-compressed 790929586 / 501187575 / +57.8% 🔴 1060414205 / 746230713 / +42.1% 🔴 0.75 / 0.67 / +11.1%
tpch_q22/datafusion:vortex-file-compressed 250980350 / 174683570 / +43.7% 🔴 426805580 / 397125713 / +7.5% 0.59 / 0.44 / +33.7%
datafusion / vortex-compact / ns (1.095x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 255921724 / 240739434 / +6.3% 646627302 / 801829021 / -19.4% 0.40 / 0.30 / +31.8%
tpch_q02/datafusion:vortex-compact 637304441 / 305208480 / +108.8% 🔴 1059643981 / 654263620 / +62.0% 🔴 0.60 / 0.47 / +28.9%
tpch_q03/datafusion:vortex-compact 344833068 / 317639198 / +8.6% 773170469 / 647823763 / +19.3% 0.45 / 0.49 / -9.0%
tpch_q04/datafusion:vortex-compact 169775203 / 173980406 / -2.4% 366909029 / 391116035 / -6.2% 0.46 / 0.44 / +4.0%
tpch_q05/datafusion:vortex-compact 445038557 / 339504875 / +31.1% 🔴 634053809 / 521747341 / +21.5% 0.70 / 0.65 / +7.9%
tpch_q06/datafusion:vortex-compact 242656217 / 149607616 / +62.2% 🔴 469258664 / 519674748 / -9.7% 0.52 / 0.29 / +79.6%
tpch_q07/datafusion:vortex-compact 418210543 / 402384693 / +3.9% 698091611 / 548128273 / +27.4% 0.60 / 0.73 / -18.4%
tpch_q08/datafusion:vortex-compact 398119511 / 408521831 / -2.5% 630423240 / 628117761 / +0.4% 0.63 / 0.65 / -2.9%
tpch_q09/datafusion:vortex-compact 429002653 / 333988405 / +28.4% 535528410 / 473199543 / +13.2% 0.80 / 0.71 / +13.5%
tpch_q10/datafusion:vortex-compact 368666279 / 294212081 / +25.3% 607854268 / 588199932 / +3.3% 0.61 / 0.50 / +21.3%
tpch_q11/datafusion:vortex-compact 273981105 / 266955795 / +2.6% 536281367 / 451306982 / +18.8% 0.51 / 0.59 / -13.6%
tpch_q12/datafusion:vortex-compact 170553249 / 188926576 / -9.7% 352358630 / 346188667 / +1.8% 0.48 / 0.55 / -11.3%
tpch_q13/datafusion:vortex-compact 129688119 / 175344346 / -26.0% 301599116 / 310273376 / -2.8% 0.43 / 0.57 / -23.9%
tpch_q14/datafusion:vortex-compact 189901069 / 175897270 / +8.0% 323290268 / 353965492 / -8.7% 0.59 / 0.50 / +18.2%
tpch_q15/datafusion:vortex-compact 326254035 / 332254297 / -1.8% 510463566 / 580545967 / -12.1% 0.64 / 0.57 / +11.7%
tpch_q16/datafusion:vortex-compact 137893701 / 128437852 / +7.4% 318042612 / 286764818 / +10.9% 0.43 / 0.45 / -3.2%
tpch_q17/datafusion:vortex-compact 274955550 / 680029629 / -59.6% 🟢 468673032 / 757428001 / -38.1% 🟢 0.59 / 0.90 / -34.7%
tpch_q18/datafusion:vortex-compact 533114798 / 229926569 / +131.9% 🔴 930164431 / 396821401 / +134.4% 🔴 0.57 / 0.58 / -1.1%
tpch_q19/datafusion:vortex-compact 258361210 / 232791887 / +11.0% 422564264 / 409431066 / +3.2% 0.61 / 0.57 / +7.5%
tpch_q20/datafusion:vortex-compact 271418767 / 263798527 / +2.9% 517008651 / 680672754 / -24.0% 0.52 / 0.39 / +35.5%
tpch_q21/datafusion:vortex-compact 509276528 / 568870595 / -10.5% 919505787 / 1078527691 / -14.7% 0.55 / 0.53 / +5.0%
tpch_q22/datafusion:vortex-compact 195410821 / 160156366 / +22.0% 437650734 / 336770598 / +30.0% 0.45 / 0.48 / -6.1%
datafusion / parquet / ns (1.089x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 175037255 / 161418348 / +8.4% 569841104 / 473529890 / +20.3% 0.31 / 0.34 / -9.9%
tpch_q02/datafusion:parquet 288920561 / 277990233 / +3.9% 576807477 / 542261249 / +6.4% 0.50 / 0.51 / -2.3%
tpch_q03/datafusion:parquet 284813651 / 283481853 / +0.5% 741082619 / 771801376 / -4.0% 0.38 / 0.37 / +4.6%
tpch_q04/datafusion:parquet 140752303 / 156632083 / -10.1% 326778103 / 422171786 / -22.6% 0.43 / 0.37 / +16.1%
tpch_q05/datafusion:parquet 377690321 / 394661447 / -4.3% 531105120 / 680970229 / -22.0% 0.71 / 0.58 / +22.7%
tpch_q06/datafusion:parquet 135017708 / 111262001 / +21.4% 248536868 / 220196216 / +12.9% 0.54 / 0.51 / +7.5%
tpch_q07/datafusion:parquet 362739223 / 340180862 / +6.6% 479260789 / 523840368 / -8.5% 0.76 / 0.65 / +16.5%
tpch_q08/datafusion:parquet 475451105 / 604325117 / -21.3% 525481936 / 540781205 / -2.8% 0.90 / 1.12 / -19.0%
tpch_q09/datafusion:parquet 406455192 / 391913821 / +3.7% 621796674 / 516537017 / +20.4% 0.65 / 0.76 / -13.8%
tpch_q10/datafusion:parquet 317337587 / 332361605 / -4.5% 461630251 / 406570094 / +13.5% 0.69 / 0.82 / -15.9%
tpch_q11/datafusion:parquet 255238707 / 251608320 / +1.4% 346872460 / 380335998 / -8.8% 0.74 / 0.66 / +11.2%
tpch_q12/datafusion:parquet 233608059 / 161248564 / +44.9% 🔴 317008838 / 279245338 / +13.5% 0.74 / 0.58 / +27.6%
tpch_q13/datafusion:parquet 277652283 / 275477431 / +0.8% 401763693 / 439942941 / -8.7% 0.69 / 0.63 / +10.4%
tpch_q14/datafusion:parquet 198539865 / 151789436 / +30.8% 🔴 309967847 / 289403825 / +7.1% 0.64 / 0.52 / +22.1%
tpch_q15/datafusion:parquet 372184224 / 296056029 / +25.7% 518859165 / 444220245 / +16.8% 0.72 / 0.67 / +7.6%
tpch_q16/datafusion:parquet 103939820 / 131526320 / -21.0% 207348095 / 256681897 / -19.2% 0.50 / 0.51 / -2.2%
tpch_q17/datafusion:parquet 405168798 / 275279811 / +47.2% 🔴 489247407 / 419144996 / +16.7% 0.83 / 0.66 / +26.1%
tpch_q18/datafusion:parquet 401305789 / 339354236 / +18.3% 574749889 / 468199088 / +22.8% 0.70 / 0.72 / -3.7%
tpch_q19/datafusion:parquet 193493118 / 155597832 / +24.4% 338250230 / 266599270 / +26.9% 0.57 / 0.58 / -2.0%
tpch_q20/datafusion:parquet 374252836 / 273131490 / +37.0% 🔴 467154933 / 495519612 / -5.7% 0.80 / 0.55 / +45.3%
tpch_q21/datafusion:parquet 452125353 / 447503535 / +1.0% 504203143 / 641428318 / -21.4% 0.90 / 0.70 / +28.5%
tpch_q22/datafusion:parquet 183081828 / 159675939 / +14.7% 309921673 / 336239018 / -7.8% 0.59 / 0.47 / +24.4%
duckdb / vortex-file-compressed / ns (1.186x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 277013580 / 253707580 / +9.2% 365646141 / 307831970 / +18.8% 0.76 / 0.82 / -8.1%
tpch_q02/duckdb:vortex-file-compressed 753868980 / 398951818 / +89.0% 🔴 836030457 / 512348044 / +63.2% 🔴 0.90 / 0.78 / +15.8%
tpch_q03/duckdb:vortex-file-compressed 402717783 / 410573883 / -1.9% 431642271 / 503390359 / -14.3% 0.93 / 0.82 / +14.4%
tpch_q04/duckdb:vortex-file-compressed 289750995 / 274032430 / +5.7% 520695344 / 287787889 / +80.9% 🔴 0.56 / 0.95 / -41.6%
tpch_q05/duckdb:vortex-file-compressed 675640506 / 613535571 / +10.1% 630196580 / 649325695 / -2.9% 1.07 / 0.94 / +13.5%
tpch_q06/duckdb:vortex-file-compressed 186543137 / 175537456 / +6.3% 258718930 / 234324614 / +10.4% 0.72 / 0.75 / -3.8%
tpch_q07/duckdb:vortex-file-compressed 480112387 / 399506323 / +20.2% 522681520 / 503924594 / +3.7% 0.92 / 0.79 / +15.9%
tpch_q08/duckdb:vortex-file-compressed 619663804 / 600164964 / +3.2% 677721930 / 675406223 / +0.3% 0.91 / 0.89 / +2.9%
tpch_q09/duckdb:vortex-file-compressed 726910537 / 391311357 / +85.8% 🔴 755079628 / 438705996 / +72.1% 🔴 0.96 / 0.89 / +7.9%
tpch_q10/duckdb:vortex-file-compressed 1043513086 / 538536803 / +93.8% 🔴 902935464 / 637250729 / +41.7% 🔴 1.16 / 0.85 / +36.8%
tpch_q11/duckdb:vortex-file-compressed 317999224 / 292159181 / +8.8% 309436595 / 305286046 / +1.4% 1.03 / 0.96 / +7.4%
tpch_q12/duckdb:vortex-file-compressed 340068937 / 245867678 / +38.3% 🔴 321775561 / 268653600 / +19.8% 1.06 / 0.92 / +15.5%
tpch_q13/duckdb:vortex-file-compressed 281653521 / 230815842 / +22.0% 557662163 / 266381620 / +109.3% 🔴 0.51 / 0.87 / -41.7%
tpch_q14/duckdb:vortex-file-compressed 294815095 / 248445946 / +18.7% 338529266 / 326166513 / +3.8% 0.87 / 0.76 / +14.3%
tpch_q15/duckdb:vortex-file-compressed 304119911 / 328066207 / -7.3% 276028459 / 261828542 / +5.4% 1.10 / 1.25 / -12.1%
tpch_q16/duckdb:vortex-file-compressed 204428104 / 228890444 / -10.7% 280342126 / 267606704 / +4.8% 0.73 / 0.86 / -14.7%
tpch_q17/duckdb:vortex-file-compressed 405584979 / 355002106 / +14.2% 416948391 / 337842430 / +23.4% 0.97 / 1.05 / -7.4%
tpch_q18/duckdb:vortex-file-compressed 457123735 / 355194988 / +28.7% 391135523 / 385862283 / +1.4% 1.17 / 0.92 / +27.0%
tpch_q19/duckdb:vortex-file-compressed 346239405 / 281030299 / +23.2% 358084240 / 330652412 / +8.3% 0.97 / 0.85 / +13.8%
tpch_q20/duckdb:vortex-file-compressed 393024500 / 342379636 / +14.8% 497444408 / 425476833 / +16.9% 0.79 / 0.80 / -1.8%
tpch_q21/duckdb:vortex-file-compressed 636024914 / 694298391 / -8.4% 651295078 / 748493441 / -13.0% 0.98 / 0.93 / +5.3%
tpch_q22/duckdb:vortex-file-compressed 271869440 / 244826372 / +11.0% 307194213 / 255482955 / +20.2% 0.89 / 0.96 / -7.6%
duckdb / vortex-compact / ns (0.964x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 259265418 / 260672895 / -0.5% 396050180 / 231548088 / +71.0% 🔴 0.65 / 1.13 / -41.9%
tpch_q02/duckdb:vortex-compact 406502445 / 1304688981 / -68.8% 🟢 526712857 / 456198751 / +15.5% 0.77 / 2.86 / -73.0%
tpch_q03/duckdb:vortex-compact 404902064 / 367446815 / +10.2% 465286255 / 422295496 / +10.2% 0.87 / 0.87 / +0.0%
tpch_q04/duckdb:vortex-compact 229173288 / 328903072 / -30.3% 🟢 331494485 / 315723972 / +5.0% 0.69 / 1.04 / -33.6%
tpch_q05/duckdb:vortex-compact 905702079 / 592124939 / +53.0% 🔴 683552073 / 615421582 / +11.1% 1.32 / 0.96 / +37.7%
tpch_q06/duckdb:vortex-compact 204688238 / 308416881 / -33.6% 🟢 221322353 / 203551157 / +8.7% 0.92 / 1.52 / -39.0%
tpch_q07/duckdb:vortex-compact 421144219 / 386876801 / +8.9% 507023745 / 433792744 / +16.9% 0.83 / 0.89 / -6.9%
tpch_q08/duckdb:vortex-compact 667776121 / 573034505 / +16.5% 600967589 / 669451004 / -10.2% 1.11 / 0.86 / +29.8%
tpch_q09/duckdb:vortex-compact 604573178 / 510003218 / +18.5% 468986854 / 449893283 / +4.2% 1.29 / 1.13 / +13.7%
tpch_q10/duckdb:vortex-compact 495743744 / 491381549 / +0.9% 510873473 / 510557296 / +0.1% 0.97 / 0.96 / +0.8%
tpch_q11/duckdb:vortex-compact 322253500 / 313309073 / +2.9% 363725225 / 378713644 / -4.0% 0.89 / 0.83 / +7.1%
tpch_q12/duckdb:vortex-compact 211116190 / 224246323 / -5.9% 283125136 / 267474788 / +5.9% 0.75 / 0.84 / -11.1%
tpch_q13/duckdb:vortex-compact 210629660 / 180252613 / +16.9% 299693478 / 225012718 / +33.2% 🔴 0.70 / 0.80 / -12.3%
tpch_q14/duckdb:vortex-compact 305807851 / 229358599 / +33.3% 🔴 312622540 / 312605130 / +0.0% 0.98 / 0.73 / +33.3%
tpch_q15/duckdb:vortex-compact 253315854 / 247421176 / +2.4% 326275764 / 257494507 / +26.7% 0.78 / 0.96 / -19.2%
tpch_q16/duckdb:vortex-compact 229543314 / 208885942 / +9.9% 329429386 / 245777959 / +34.0% 🔴 0.70 / 0.85 / -18.0%
tpch_q17/duckdb:vortex-compact 369164305 / 399654769 / -7.6% 500704272 / 498415101 / +0.5% 0.74 / 0.80 / -8.1%
tpch_q18/duckdb:vortex-compact 492423724 / 524909271 / -6.2% 410124420 / 809664918 / -49.3% 🟢 1.20 / 0.65 / +85.2%
tpch_q19/duckdb:vortex-compact 309402162 / 433412804 / -28.6% 344826605 / 396496935 / -13.0% 0.90 / 1.09 / -17.9%
tpch_q20/duckdb:vortex-compact 383128880 / 428129795 / -10.5% 485309984 / 370031339 / +31.2% 🔴 0.79 / 1.16 / -31.8%
tpch_q21/duckdb:vortex-compact 555849382 / 636364284 / -12.7% 602744197 / 625948850 / -3.7% 0.92 / 1.02 / -9.3%
tpch_q22/duckdb:vortex-compact 363055991 / 242187240 / +49.9% 🔴 352826324 / 263485568 / +33.9% 🔴 1.03 / 0.92 / +11.9%
duckdb / parquet / ns (0.975x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 193271356 / 196688198 / -1.7% 310262584 / 310663773 / -0.1% 0.62 / 0.63 / -1.6%
tpch_q02/duckdb:parquet 476455580 / 479772702 / -0.7% 488945926 / 446594083 / +9.5% 0.97 / 1.07 / -9.3%
tpch_q03/duckdb:parquet 454874027 / 374105489 / +21.6% 680542813 / 486362997 / +39.9% 🔴 0.67 / 0.77 / -13.1%
tpch_q04/duckdb:parquet 316913209 / 301045687 / +5.3% 402707804 / 332572600 / +21.1% 0.79 / 0.91 / -13.1%
tpch_q05/duckdb:parquet 571459401 / 570210211 / +0.2% 635921942 / 591932303 / +7.4% 0.90 / 0.96 / -6.7%
tpch_q06/duckdb:parquet 189488270 / 152024108 / +24.6% 185567023 / 174343147 / +6.4% 1.02 / 0.87 / +17.1%
tpch_q07/duckdb:parquet 486073448 / 502857846 / -3.3% 452590243 / 459891049 / -1.6% 1.07 / 1.09 / -1.8%
tpch_q08/duckdb:parquet 824051466 / 648941516 / +27.0% 906569424 / 1025807604 / -11.6% 0.91 / 0.63 / +43.7%
tpch_q09/duckdb:parquet 563597997 / 589817836 / -4.4% 616347826 / 690765324 / -10.8% 0.91 / 0.85 / +7.1%
tpch_q10/duckdb:parquet 581867833 / 543994515 / +7.0% 614520408 / 587550058 / +4.6% 0.95 / 0.93 / +2.3%
tpch_q11/duckdb:parquet 304158099 / 269270218 / +13.0% 340564592 / 283845319 / +20.0% 0.89 / 0.95 / -5.9%
tpch_q12/duckdb:parquet 244829926 / 243551995 / +0.5% 276759908 / 299829290 / -7.7% 0.88 / 0.81 / +8.9%
tpch_q13/duckdb:parquet 395875091 / 416988264 / -5.1% 510329485 / 584737043 / -12.7% 0.78 / 0.71 / +8.8%
tpch_q14/duckdb:parquet 223181466 / 479369908 / -53.4% 🟢 355076671 / 537814138 / -34.0% 🟢 0.63 / 0.89 / -29.5%
tpch_q15/duckdb:parquet 199763870 / 244479016 / -18.3% 199560207 / 249971149 / -20.2% 1.00 / 0.98 / +2.4%
tpch_q16/duckdb:parquet 289092497 / 312327760 / -7.4% 298925041 / 325182209 / -8.1% 0.97 / 0.96 / +0.7%
tpch_q17/duckdb:parquet 280088335 / 288325318 / -2.9% 452142062 / 383341707 / +17.9% 0.62 / 0.75 / -17.6%
tpch_q18/duckdb:parquet 387969924 / 370142586 / +4.8% 398375211 / 421925890 / -5.6% 0.97 / 0.88 / +11.0%
tpch_q19/duckdb:parquet 295798115 / 304853891 / -3.0% 302634791 / 379028695 / -20.2% 0.98 / 0.80 / +21.5%
tpch_q20/duckdb:parquet 460817368 / 490597699 / -6.1% 503438423 / 498278534 / +1.0% 0.92 / 0.98 / -7.0%
tpch_q21/duckdb:parquet 467215527 / 506062801 / -7.7% 516764082 / 584393896 / -11.6% 0.90 / 0.87 / +4.4%
tpch_q22/duckdb:parquet 300560780 / 332755987 / -9.7% 321899992 / 346115390 / -7.0% 0.93 / 0.96 / -2.9%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.022x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 130576642 / 130152720 / +0.3% 512691611 / 507517153 / +1.0% 0.25 / 0.26 / -0.7%
vortex_q01/datafusion:vortex-file-compressed 123433001 / 123115389 / +0.3% 290613448 / 281190831 / +3.4% 0.42 / 0.44 / -3.0%
vortex_q02/datafusion:vortex-file-compressed 139476781 / 139308063 / +0.1% 290241786 / 265586481 / +9.3% 0.48 / 0.52 / -8.4%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 135133435 / 135484418 / -0.3% 1160517183 / 1138668444 / +1.9% 0.12 / 0.12 / -2.1%
vortex_q01/datafusion:parquet 70786555 / 68515252 / +3.3% 120058671 / 122600763 / -2.1% 0.59 / 0.56 / +5.5%
vortex_q02/datafusion:parquet 290647965 / 289468164 / +0.4% 672154002 / 673521738 / -0.2% 0.43 / 0.43 / +0.6%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 187639582 / 190730251 / -1.6% 921495489 / 941611872 / -2.1% 0.20 / 0.20 / +0.5%
vortex_q01/duckdb:vortex-file-compressed 91375680 / 90583161 / +0.9% 328290172 / 338097604 / -2.9% 0.28 / 0.27 / +3.9%
vortex_q02/duckdb:vortex-file-compressed 178090552 / 177786336 / +0.2% 496461626 / 472154249 / +5.1% 0.36 / 0.38 / -4.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 279762974 / 279622080 / +0.1% 763939558 / 801670103 / -4.7% 0.37 / 0.35 / +5.0%
vortex_q01/duckdb:parquet 163912037 / 163534033 / +0.2% 173845765 / 174102252 / -0.1% 0.94 / 0.94 / +0.4%
vortex_q02/duckdb:parquet 345659457 / 344765994 / +0.3% 608865104 / 616047015 / -1.2% 0.57 / 0.56 / +1.4%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 496169fc vs base 22e02f18
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.3%
Engines: DataFusion No clear signal (-5.9%, environment too noisy confidence) · DuckDB No clear signal (-10.6%, environment too noisy confidence)
Vortex (geomean): hot 1.027x ➖ · cold 1.030x ➖
Parquet (geomean): hot 1.120x ➖ · cold 1.077x ➖
Shifts: Parquet (control) +12.0% · Median polish +2.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.053x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 347237248 / 333513387 / +4.1% 1106067093 / 1025716256 / +7.8% 0.31 / 0.33 / -3.4%
tpch_q02/datafusion:vortex-file-compressed 782998818 / 482250482 / +62.4% 🔴 1272048734 / 1035828863 / +22.8% 0.62 / 0.47 / +32.2%
tpch_q03/datafusion:vortex-file-compressed 615753513 / 817757364 / -24.7% 1681385063 / 1466280592 / +14.7% 0.37 / 0.56 / -34.3%
tpch_q04/datafusion:vortex-file-compressed 484734503 / 481699045 / +0.6% 602508756 / 682999410 / -11.8% 0.80 / 0.71 / +14.1%
tpch_q05/datafusion:vortex-file-compressed 694398222 / 714721874 / -2.8% 891660483 / 944125358 / -5.6% 0.78 / 0.76 / +2.9%
tpch_q06/datafusion:vortex-file-compressed 267062854 / 251002949 / +6.4% 459751583 / 485132457 / -5.2% 0.58 / 0.52 / +12.3%
tpch_q07/datafusion:vortex-file-compressed 682186545 / 634026797 / +7.6% 1145476932 / 924022229 / +24.0% 0.60 / 0.69 / -13.2%
tpch_q08/datafusion:vortex-file-compressed 930928516 / 892011483 / +4.4% 1144586791 / 1280789694 / -10.6% 0.81 / 0.70 / +16.8%
tpch_q09/datafusion:vortex-file-compressed 1172819521 / 1118666862 / +4.8% 1314720118 / 1114355164 / +18.0% 0.89 / 1.00 / -11.1%
tpch_q10/datafusion:vortex-file-compressed 645123499 / 1101068812 / -41.4% 🟢 1009340730 / 1456699047 / -30.7% 🟢 0.64 / 0.76 / -15.4%
tpch_q11/datafusion:vortex-file-compressed 394277453 / 375083618 / +5.1% 628507870 / 604618005 / +4.0% 0.63 / 0.62 / +1.1%
tpch_q12/datafusion:vortex-file-compressed 399849397 / 379697187 / +5.3% 553221024 / 621952489 / -11.1% 0.72 / 0.61 / +18.4%
tpch_q13/datafusion:vortex-file-compressed 310661876 / 329822191 / -5.8% 598740140 / 595581769 / +0.5% 0.52 / 0.55 / -6.3%
tpch_q14/datafusion:vortex-file-compressed 413522691 / 348577273 / +18.6% 548727681 / 570813856 / -3.9% 0.75 / 0.61 / +23.4%
tpch_q15/datafusion:vortex-file-compressed 545453982 / 619392719 / -11.9% 775190832 / 978829318 / -20.8% 0.70 / 0.63 / +11.2%
tpch_q16/datafusion:vortex-file-compressed 385651463 / 251465382 / +53.4% 🔴 511227396 / 470174598 / +8.7% 0.75 / 0.53 / +41.0%
tpch_q17/datafusion:vortex-file-compressed 917490470 / 1013629945 / -9.5% 1085798576 / 1020611441 / +6.4% 0.84 / 0.99 / -14.9%
tpch_q18/datafusion:vortex-file-compressed 954945387 / 1170076678 / -18.4% 989118752 / 1153312709 / -14.2% 0.97 / 1.01 / -4.8%
tpch_q19/datafusion:vortex-file-compressed 483203069 / 441957322 / +9.3% 572030818 / 567646044 / +0.8% 0.84 / 0.78 / +8.5%
tpch_q20/datafusion:vortex-file-compressed 647349782 / 621995787 / +4.1% 967365870 / 925737984 / +4.5% 0.67 / 0.67 / -0.4%
tpch_q21/datafusion:vortex-file-compressed 1073955396 / 1064894465 / +0.9% 1173366389 / 1219605452 / -3.8% 0.92 / 0.87 / +4.8%
tpch_q22/datafusion:vortex-file-compressed 731219325 / 304566322 / +140.1% 🔴 639402818 / 781135654 / -18.1% 1.14 / 0.39 / +193.3%
datafusion / vortex-compact / ns (0.984x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 337729796 / 334429617 / +1.0% 921178200 / 883855097 / +4.2% 0.37 / 0.38 / -3.1%
tpch_q02/datafusion:vortex-compact 544205049 / 517341210 / +5.2% 1034651829 / 1068411426 / -3.2% 0.53 / 0.48 / +8.6%
tpch_q03/datafusion:vortex-compact 547431411 / 599492928 / -8.7% 1609778241 / 1152440584 / +39.7% 🔴 0.34 / 0.52 / -34.6%
tpch_q04/datafusion:vortex-compact 400803394 / 408563808 / -1.9% 541022489 / 573915044 / -5.7% 0.74 / 0.71 / +4.1%
tpch_q05/datafusion:vortex-compact 676809301 / 959371468 / -29.5% 1076195307 / 893125451 / +20.5% 0.63 / 1.07 / -41.5%
tpch_q06/datafusion:vortex-compact 231616049 / 439331698 / -47.3% 🟢 379905185 / 558456313 / -32.0% 🟢 0.61 / 0.79 / -22.5%
tpch_q07/datafusion:vortex-compact 647771156 / 699854084 / -7.4% 887824004 / 853091756 / +4.1% 0.73 / 0.82 / -11.1%
tpch_q08/datafusion:vortex-compact 929264005 / 1062894173 / -12.6% 1302809814 / 1248087000 / +4.4% 0.71 / 0.85 / -16.2%
tpch_q09/datafusion:vortex-compact 738266681 / 2089604524 / -64.7% 🟢 1128488550 / 1084752607 / +4.0% 0.65 / 1.93 / -66.0%
tpch_q10/datafusion:vortex-compact 1310532917 / 552259553 / +137.3% 🔴 1403935077 / 749002428 / +87.4% 🔴 0.93 / 0.74 / +26.6%
tpch_q11/datafusion:vortex-compact 815539766 / 568767948 / +43.4% 🔴 1281611223 / 752292502 / +70.4% 🔴 0.64 / 0.76 / -15.8%
tpch_q12/datafusion:vortex-compact 328128957 / 281655202 / +16.5% 503548916 / 477114022 / +5.5% 0.65 / 0.59 / +10.4%
tpch_q13/datafusion:vortex-compact 373328268 / 330833502 / +12.8% 593924673 / 556628808 / +6.7% 0.63 / 0.59 / +5.8%
tpch_q14/datafusion:vortex-compact 645492806 / 400555099 / +61.1% 🔴 696370717 / 633522286 / +9.9% 0.93 / 0.63 / +46.6%
tpch_q15/datafusion:vortex-compact 568762367 / 606729376 / -6.3% 1040978020 / 699450493 / +48.8% 🔴 0.55 / 0.87 / -37.0%
tpch_q16/datafusion:vortex-compact 337064433 / 272852978 / +23.5% 753525606 / 416490013 / +80.9% 🔴 0.45 / 0.66 / -31.7%
tpch_q17/datafusion:vortex-compact 791549374 / 817847473 / -3.2% 1015719250 / 1043538917 / -2.7% 0.78 / 0.78 / -0.6%
tpch_q18/datafusion:vortex-compact 749713583 / 865770074 / -13.4% 786966729 / 831031736 / -5.3% 0.95 / 1.04 / -8.6%
tpch_q19/datafusion:vortex-compact 412452840 / 456068662 / -9.6% 520249531 / 552456604 / -5.8% 0.79 / 0.83 / -4.0%
tpch_q20/datafusion:vortex-compact 594496385 / 542338290 / +9.6% 835565629 / 687530186 / +21.5% 0.71 / 0.79 / -9.8%
tpch_q21/datafusion:vortex-compact 983931750 / 912818565 / +7.8% 947021508 / 1013092270 / -6.5% 1.04 / 0.90 / +15.3%
tpch_q22/datafusion:vortex-compact 303699531 / 330103667 / -8.0% 677453867 / 627613414 / +7.9% 0.45 / 0.53 / -14.8%
datafusion / parquet / ns (1.081x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 270994639 / 220699019 / +22.8% 703748029 / 605825180 / +16.2% 0.39 / 0.36 / +5.7%
tpch_q02/datafusion:parquet 448646593 / 534372429 / -16.0% 1087974495 / 947596971 / +14.8% 0.41 / 0.56 / -26.9%
tpch_q03/datafusion:parquet 545465727 / 793411290 / -31.3% 🟢 1009368040 / 1106252670 / -8.8% 0.54 / 0.72 / -24.7%
tpch_q04/datafusion:parquet 304481794 / 221646742 / +37.4% 🔴 744243495 / 484192612 / +53.7% 🔴 0.41 / 0.46 / -10.6%
tpch_q05/datafusion:parquet 619728219 / 593452786 / +4.4% 994628347 / 865610160 / +14.9% 0.62 / 0.69 / -9.1%
tpch_q06/datafusion:parquet 291049989 / 181551200 / +60.3% 🔴 425963530 / 490633532 / -13.2% 0.68 / 0.37 / +84.7%
tpch_q07/datafusion:parquet 639237726 / 586503625 / +9.0% 761677457 / 781018703 / -2.5% 0.84 / 0.75 / +11.8%
tpch_q08/datafusion:parquet 880270211 / 774555682 / +13.6% 958652781 / 993904543 / -3.5% 0.92 / 0.78 / +17.8%
tpch_q09/datafusion:parquet 1734770945 / 869400122 / +99.5% 🔴 2576113770 / 1126046623 / +128.8% 🔴 0.67 / 0.77 / -12.8%
tpch_q10/datafusion:parquet 1113896440 / 1781625107 / -37.5% 🟢 1518470679 / 1388622265 / +9.4% 0.73 / 1.28 / -42.8%
tpch_q11/datafusion:parquet 398382105 / 370623847 / +7.5% 601217539 / 680176133 / -11.6% 0.66 / 0.54 / +21.6%
tpch_q12/datafusion:parquet 395146958 / 392586655 / +0.7% 539030752 / 575845420 / -6.4% 0.73 / 0.68 / +7.5%
tpch_q13/datafusion:parquet 425221016 / 423508162 / +0.4% 799290336 / 768022715 / +4.1% 0.53 / 0.55 / -3.5%
tpch_q14/datafusion:parquet 412367483 / 345033430 / +19.5% 692314132 / 623666399 / +11.0% 0.60 / 0.55 / +7.7%
tpch_q15/datafusion:parquet 670386533 / 871504870 / -23.1% 1060737645 / 1418804945 / -25.2% 0.63 / 0.61 / +2.9%
tpch_q16/datafusion:parquet 230390611 / 266162224 / -13.4% 465852214 / 550982671 / -15.5% 0.49 / 0.48 / +2.4%
tpch_q17/datafusion:parquet 695555566 / 789489251 / -11.9% 828359953 / 886260719 / -6.5% 0.84 / 0.89 / -5.7%
tpch_q18/datafusion:parquet 1053698667 / 530410060 / +98.7% 🔴 1276365565 / 720790124 / +77.1% 🔴 0.83 / 0.74 / +12.2%
tpch_q19/datafusion:parquet 551541789 / 452098246 / +22.0% 616391566 / 625029737 / -1.4% 0.89 / 0.72 / +23.7%
tpch_q20/datafusion:parquet 697340853 / 676114095 / +3.1% 928930722 / 826588662 / +12.4% 0.75 / 0.82 / -8.2%
tpch_q21/datafusion:parquet 991253514 / 1068836657 / -7.3% 924251797 / 1281245845 / -27.9% 1.07 / 0.83 / +28.6%
tpch_q22/datafusion:parquet 490993419 / 393076507 / +24.9% 763019821 / 648903600 / +17.6% 0.64 / 0.61 / +6.2%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1039640882 / 995340248 / +4.5% 1730951700 / 1364390515 / +26.9% 0.60 / 0.73 / -17.7%
tpch_q02/duckdb:vortex-file-compressed 504402286 / 547207049 / -7.8% 677655670 / 724084623 / -6.4% 0.74 / 0.76 / -1.5%
tpch_q03/duckdb:vortex-file-compressed 1313322137 / 1332219709 / -1.4% 1729261318 / 1650424201 / +4.8% 0.76 / 0.81 / -5.9%
tpch_q04/duckdb:vortex-file-compressed 1027020950 / 1008740232 / +1.8% 1262567966 / 1231542416 / +2.5% 0.81 / 0.82 / -0.7%
tpch_q05/duckdb:vortex-file-compressed 1952992393 / 1077935335 / +81.2% 🔴 1918209262 / 1350079137 / +42.1% 🔴 1.02 / 0.80 / +27.5%
tpch_q06/duckdb:vortex-file-compressed 854743829 / 801242981 / +6.7% 998116118 / 942233437 / +5.9% 0.86 / 0.85 / +0.7%
tpch_q07/duckdb:vortex-file-compressed 1367863289 / 1329629257 / +2.9% 1465537744 / 1449822267 / +1.1% 0.93 / 0.92 / +1.8%
tpch_q08/duckdb:vortex-file-compressed 1256555679 / 1225229731 / +2.6% 1390596034 / 1556292724 / -10.6% 0.90 / 0.79 / +14.8%
tpch_q09/duckdb:vortex-file-compressed 1430667800 / 1488990100 / -3.9% 1749074360 / 1729030861 / +1.2% 0.82 / 0.86 / -5.0%
tpch_q10/duckdb:vortex-file-compressed 1627133406 / 1966726800 / -17.3% 1613104207 / 1926642396 / -16.3% 1.01 / 1.02 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 436351895 / 383310896 / +13.8% 561682510 / 434949547 / +29.1% 0.78 / 0.88 / -11.8%
tpch_q12/duckdb:vortex-file-compressed 1173183331 / 1045572616 / +12.2% 1610214152 / 1220474856 / +31.9% 🔴 0.73 / 0.86 / -15.0%
tpch_q13/duckdb:vortex-file-compressed 830340979 / 792071086 / +4.8% 1302968833 / 1213539925 / +7.4% 0.64 / 0.65 / -2.4%
tpch_q14/duckdb:vortex-file-compressed 1094763413 / 993642726 / +10.2% 1440105889 / 1201498877 / +19.9% 0.76 / 0.83 / -8.1%
tpch_q15/duckdb:vortex-file-compressed 920251041 / 971417337 / -5.3% 1071940894 / 1045422024 / +2.5% 0.86 / 0.93 / -7.6%
tpch_q16/duckdb:vortex-file-compressed 297872988 / 348776797 / -14.6% 362894951 / 603685815 / -39.9% 🟢 0.82 / 0.58 / +42.1%
tpch_q17/duckdb:vortex-file-compressed 1099309229 / 1458301884 / -24.6% 1239601513 / 1354684408 / -8.5% 0.89 / 1.08 / -17.6%
tpch_q18/duckdb:vortex-file-compressed 1186290942 / 1290630971 / -8.1% 1457883280 / 1392715423 / +4.7% 0.81 / 0.93 / -12.2%
tpch_q19/duckdb:vortex-file-compressed 1127680733 / 1069896411 / +5.4% 1189506096 / 1264785727 / -6.0% 0.95 / 0.85 / +12.1%
tpch_q20/duckdb:vortex-file-compressed 1317591110 / 1115215642 / +18.1% 1679168744 / 1263537202 / +32.9% 🔴 0.78 / 0.88 / -11.1%
tpch_q21/duckdb:vortex-file-compressed 2519647125 / 2482204175 / +1.5% 2568829990 / 2588796009 / -0.8% 0.98 / 0.96 / +2.3%
tpch_q22/duckdb:vortex-file-compressed 399362143 / 385640806 / +3.6% 517061305 / 540726322 / -4.4% 0.77 / 0.71 / +8.3%
duckdb / vortex-compact / ns (1.049x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 984807911 / 914188535 / +7.7% 1407447588 / 1525546840 / -7.7% 0.70 / 0.60 / +16.8%
tpch_q02/duckdb:vortex-compact 584563993 / 556931396 / +5.0% 747688206 / 670345102 / +11.5% 0.78 / 0.83 / -5.9%
tpch_q03/duckdb:vortex-compact 1285296350 / 1196988305 / +7.4% 1902091022 / 1712958647 / +11.0% 0.68 / 0.70 / -3.3%
tpch_q04/duckdb:vortex-compact 874646293 / 850140383 / +2.9% 1178230655 / 1528382692 / -22.9% 0.74 / 0.56 / +33.5%
tpch_q05/duckdb:vortex-compact 1101609655 / 1156331506 / -4.7% 1452869078 / 1413996592 / +2.7% 0.76 / 0.82 / -7.3%
tpch_q06/duckdb:vortex-compact 913763681 / 805529186 / +13.4% 1021178296 / 970634954 / +5.2% 0.89 / 0.83 / +7.8%
tpch_q07/duckdb:vortex-compact 1133286658 / 1134350550 / -0.1% 1302188883 / 1392945314 / -6.5% 0.87 / 0.81 / +6.9%
tpch_q08/duckdb:vortex-compact 1578173833 / 1168886734 / +35.0% 🔴 1798096965 / 1496973144 / +20.1% 0.88 / 0.78 / +12.4%
tpch_q09/duckdb:vortex-compact 1332064042 / 1282132397 / +3.9% 1621232913 / 1620366278 / +0.1% 0.82 / 0.79 / +3.8%
tpch_q10/duckdb:vortex-compact 2314824592 / 1635883440 / +41.5% 🔴 1723215837 / 1603582252 / +7.5% 1.34 / 1.02 / +31.7%
tpch_q11/duckdb:vortex-compact 357831529 / 420967586 / -15.0% 507107768 / 553701159 / -8.4% 0.71 / 0.76 / -7.2%
tpch_q12/duckdb:vortex-compact 916291211 / 855380304 / +7.1% 1073796187 / 1081152247 / -0.7% 0.85 / 0.79 / +7.9%
tpch_q13/duckdb:vortex-compact 750099783 / 821711149 / -8.7% 1111848205 / 1104447679 / +0.7% 0.67 / 0.74 / -9.3%
tpch_q14/duckdb:vortex-compact 965780292 / 924518747 / +4.5% 1076992832 / 1110385531 / -3.0% 0.90 / 0.83 / +7.7%
tpch_q15/duckdb:vortex-compact 864162462 / 855560038 / +1.0% 1078513680 / 1013192692 / +6.4% 0.80 / 0.84 / -5.1%
tpch_q16/duckdb:vortex-compact 305580937 / 297919733 / +2.6% 376216635 / 511025565 / -26.4% 0.81 / 0.58 / +39.3%
tpch_q17/duckdb:vortex-compact 1021334056 / 993572531 / +2.8% 1074695395 / 1135095679 / -5.3% 0.95 / 0.88 / +8.6%
tpch_q18/duckdb:vortex-compact 1033831365 / 1021338274 / +1.2% 1255637694 / 1297782008 / -3.2% 0.82 / 0.79 / +4.6%
tpch_q19/duckdb:vortex-compact 1268448452 / 1010508742 / +25.5% 1286696709 / 1175923073 / +9.4% 0.99 / 0.86 / +14.7%
tpch_q20/duckdb:vortex-compact 1045498302 / 1171485031 / -10.8% 1199794198 / 1394910260 / -14.0% 0.87 / 0.84 / +3.8%
tpch_q21/duckdb:vortex-compact 2887866624 / 2907075288 / -0.7% 3250208060 / 2953683892 / +10.0% 0.89 / 0.98 / -9.7%
tpch_q22/duckdb:vortex-compact 425478757 / 414058998 / +2.8% 585888345 / 679782529 / -13.8% 0.73 / 0.61 / +19.2%
duckdb / parquet / ns (1.160x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 488037174 / 299095792 / +63.2% 🔴 545807313 / 383785025 / +42.2% 🔴 0.89 / 0.78 / +14.7%
tpch_q02/duckdb:parquet 618371369 / 597947297 / +3.4% 930204050 / 919508895 / +1.2% 0.66 / 0.65 / +2.2%
tpch_q03/duckdb:parquet 719324446 / 592983038 / +21.3% 1110009608 / 844856138 / +31.4% 🔴 0.65 / 0.70 / -7.7%
tpch_q04/duckdb:parquet 489259653 / 399583069 / +22.4% 677901163 / 618778522 / +9.6% 0.72 / 0.65 / +11.8%
tpch_q05/duckdb:parquet 870810280 / 791578652 / +10.0% 1042046051 / 921321600 / +13.1% 0.84 / 0.86 / -2.7%
tpch_q06/duckdb:parquet 339514752 / 269570896 / +25.9% 309307545 / 259108533 / +19.4% 1.10 / 1.04 / +5.5%
tpch_q07/duckdb:parquet 898104205 / 941267536 / -4.6% 1047235152 / 891845870 / +17.4% 0.86 / 1.06 / -18.7%
tpch_q08/duckdb:parquet 1094229787 / 1108806752 / -1.3% 1128342403 / 1045216660 / +8.0% 0.97 / 1.06 / -8.6%
tpch_q09/duckdb:parquet 1020785768 / 1037505751 / -1.6% 1259315820 / 1832877102 / -31.3% 🟢 0.81 / 0.57 / +43.2%
tpch_q10/duckdb:parquet 879189421 / 799921512 / +9.9% 984554515 / 900402063 / +9.3% 0.89 / 0.89 / +0.5%
tpch_q11/duckdb:parquet 343148021 / 356698196 / -3.8% 404508129 / 416131501 / -2.8% 0.85 / 0.86 / -1.0%
tpch_q12/duckdb:parquet 474382121 / 441230704 / +7.5% 557225114 / 609716250 / -8.6% 0.85 / 0.72 / +17.6%
tpch_q13/duckdb:parquet 590051408 / 578221948 / +2.0% 846908077 / 767798570 / +10.3% 0.70 / 0.75 / -7.5%
tpch_q14/duckdb:parquet 638320291 / 403899456 / +58.0% 🔴 767333455 / 400776361 / +91.5% 🔴 0.83 / 1.01 / -17.5%
tpch_q15/duckdb:parquet 508051785 / 342191513 / +48.5% 🔴 365307849 / 404964992 / -9.8% 1.39 / 0.84 / +64.6%
tpch_q16/duckdb:parquet 436306189 / 322461997 / +35.3% 🔴 448149560 / 364570195 / +22.9% 0.97 / 0.88 / +10.1%
tpch_q17/duckdb:parquet 581590935 / 402466095 / +44.5% 🔴 624529196 / 941304589 / -33.7% 🟢 0.93 / 0.43 / +117.8%
tpch_q18/duckdb:parquet 550995770 / 506857545 / +8.7% 689556797 / 568722920 / +21.2% 0.80 / 0.89 / -10.3%
tpch_q19/duckdb:parquet 624677574 / 616282966 / +1.4% 655487808 / 692437365 / -5.3% 0.95 / 0.89 / +7.1%
tpch_q20/duckdb:parquet 977522431 / 896790836 / +9.0% 934274351 / 761490817 / +22.7% 1.05 / 1.18 / -11.2%
tpch_q21/duckdb:parquet 812105374 / 720791668 / +12.7% 829652038 / 672807100 / +23.3% 0.98 / 1.07 / -8.6%
tpch_q22/duckdb:parquet 576947064 / 513098741 / +12.4% 644899688 / 637867778 / +1.1% 0.89 / 0.80 / +11.2%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants