Skip to content

ci: upload sampled vx file trees from SQL benchmarks - #11444

Merged
joseph-isaacs merged 6 commits into
developfrom
ji/confident-faraday-j8jagi
Nov 13, 2026
Merged

joseph-isaacs merged 6 commits into
developfrom
ji/confident-faraday-j8jagi

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Summary

The SQL benchmarks write Vortex files that we never look inside. This PR adds one artifact per run containing vx file stats and layout trees for a sample of each dataset's files, so you can see which encodings and layouts a PR produced on real data.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
joseph-isaacs and others added 3 commits November 13, 2026 13:41
After each local SQL benchmark run, dump `vx inspect` and
`vx tree layout --verbose` for a sample of the dataset's Vortex files
and upload them as an artifact kept for 5 days.

The sample, per Vortex format directory, is one file of every table
(partitions such as lineitem_0001 share a table) plus a fixed number of
further partitions drawn without replacement, weighted by file size.
The draw is seeded with the commit so reruns inspect the same files.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Cover the names every vortex-bench generator writes: split TPC-H, TPC-DS
and nested TPC-H parts, the three ClickBench layouts, and the single-file
datasets, including TPC-DS tables that share a prefix.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the ji/confident-faraday-j8jagi branch from 777ee25 to e903cc5 Compare November 13, 2026 13:42
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 224e135 clickbench-nvme 1 Explore Profiling Data
🟢 Done 224e135 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 224e135 fineweb 1 Explore Profiling Data
🟢 Done 224e135 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 224e135 polarsignals 1 Explore Profiling Data
🟢 Done 224e135 tpch-s3 1 Explore Profiling Data
🟢 Done 224e135 tpch-nvme 1 Explore Profiling Data
🟢 Done 224e135 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 224e1354 vs base 64808453
Vortex (geomean): hot 1.007x ➖ · cold 0.942x ➖


datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80732014 / 80151198 / +0.7% 119081391 / 125682074 / -5.3% 0.68 / 0.64 / +6.3%
polarsignals_q01/datafusion:vortex-file-compressed 89672319 / 88634744 / +1.2% 143810034 / 147204217 / -2.3% 0.62 / 0.60 / +3.6%
polarsignals_q02/datafusion:vortex-file-compressed 12723690 / 13013602 / -2.2% 40325719 / 41811303 / -3.6% 0.32 / 0.31 / +1.4%
polarsignals_q03/datafusion:vortex-file-compressed 91123605 / 90449142 / +0.7% 149281252 / 206107738 / -27.6% 🟢 0.61 / 0.44 / +39.1%
polarsignals_q04/datafusion:vortex-file-compressed 9322196 / 9221628 / +1.1% 37089525 / 39509013 / -6.1% 0.25 / 0.23 / +7.7%
polarsignals_q05/datafusion:vortex-file-compressed 11588338 / 11528684 / +0.5% 39870452 / 43338177 / -8.0% 0.29 / 0.27 / +9.3%
polarsignals_q06/datafusion:vortex-file-compressed 23067630 / 22979293 / +0.4% 52088379 / 52031319 / +0.1% 0.44 / 0.44 / +0.3%
polarsignals_q07/datafusion:vortex-file-compressed 10822431 / 10312294 / +4.9% 39160676 / 39786521 / -1.6% 0.28 / 0.26 / +6.6%
polarsignals_q08/datafusion:vortex-file-compressed 133824036 / 134783892 / -0.7% 190163067 / 191743412 / -0.8% 0.70 / 0.70 / +0.1%
polarsignals_q09/datafusion:vortex-file-compressed 9993466 / 9929858 / +0.6% 34798925 / 38143161 / -8.8% 0.29 / 0.26 / +10.3%
polarsignals_q10/datafusion:vortex-file-compressed 12991779 / 13127331 / -1.0% 47715177 / 48815456 / -2.3% 0.27 / 0.27 / +1.2%
polarsignals_q11/datafusion:vortex-file-compressed 15975656 / 15903416 / +0.5% 45036045 / 46237224 / -2.6% 0.35 / 0.34 / +3.1%
polarsignals_q12/datafusion:vortex-file-compressed 16674261 / 16158840 / +3.2% 43751064 / 45009338 / -2.8% 0.38 / 0.36 / +6.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+3.7%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 1.020x ➖ · cold 1.042x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.031x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.033x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6033055 / 5985445 / +0.8% 20364015 / 19153616 / +6.3% 0.30 / 0.31 / -5.2%
fineweb_q01/datafusion:vortex-file-compressed 10531308 / 8498534 / +23.9% 🔴 36741680 / 41026113 / -10.4% 🟢 0.29 / 0.21 / +38.4%
fineweb_q02/datafusion:vortex-file-compressed 11380075 / 11571138 / -1.7% 41737226 / 40668793 / +2.6% 0.27 / 0.28 / -4.2%
fineweb_q03/datafusion:vortex-file-compressed 17629069 / 17409038 / +1.3% 108700193 / 106697049 / +1.9% 0.16 / 0.16 / -0.6%
fineweb_q04/datafusion:vortex-file-compressed 66445156 / 64512260 / +3.0% 141716719 / 136733638 / +3.6% 0.47 / 0.47 / -0.6%
fineweb_q05/datafusion:vortex-file-compressed 63073724 / 62841706 / +0.4% 144595295 / 138665906 / +4.3% 0.44 / 0.45 / -3.7%
fineweb_q06/datafusion:vortex-file-compressed 16633969 / 16536322 / +0.6% 106868243 / 97371676 / +9.8% 0.16 / 0.17 / -8.3%
fineweb_q07/datafusion:vortex-file-compressed 16667860 / 17570418 / -5.1% 105441052 / 97388552 / +8.3% 0.16 / 0.18 / -12.4%
fineweb_q08/datafusion:vortex-file-compressed 11726090 / 10713922 / +9.4% 28349061 / 27264730 / +4.0% 0.41 / 0.39 / +5.3%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9369026 / 9261317 / +1.2% 31884598 / 34396651 / -7.3% 0.29 / 0.27 / +9.1%
fineweb_q01/datafusion:parquet 75601800 / 75391012 / +0.3% 162384952 / 145192269 / +11.8% 🔴 0.47 / 0.52 / -10.3%
fineweb_q02/datafusion:parquet 74700513 / 74523088 / +0.2% 150185654 / 144233337 / +4.1% 0.50 / 0.52 / -3.7%
fineweb_q03/datafusion:parquet 75344996 / 73737818 / +2.2% 153423796 / 146570587 / +4.7% 0.49 / 0.50 / -2.4%
fineweb_q04/datafusion:parquet 82711532 / 82143270 / +0.7% 145460820 / 138634498 / +4.9% 0.57 / 0.59 / -4.0%
fineweb_q05/datafusion:parquet 81393576 / 82092049 / -0.9% 151613764 / 144905880 / +4.6% 0.54 / 0.57 / -5.2%
fineweb_q06/datafusion:parquet 75068655 / 77193364 / -2.8% 152492211 / 152039848 / +0.3% 0.49 / 0.51 / -3.0%
fineweb_q07/datafusion:parquet 73541845 / 74125138 / -0.8% 153453482 / 151378457 / +1.4% 0.48 / 0.49 / -2.1%
fineweb_q08/datafusion:parquet 72434386 / 75020578 / -3.4% 159885490 / 142565591 / +12.1% 🔴 0.45 / 0.53 / -13.9%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2100602 / 2095650 / +0.2% 7180321 / 8010165 / -10.4% 🟢 0.29 / 0.26 / +11.8%
fineweb_q01/duckdb:vortex-file-compressed 8804408 / 8104238 / +8.6% 26323931 / 25484255 / +3.3% 0.33 / 0.32 / +5.2%
fineweb_q02/duckdb:vortex-file-compressed 10618622 / 10479842 / +1.3% 29625799 / 30039717 / -1.4% 0.36 / 0.35 / +2.7%
fineweb_q03/duckdb:vortex-file-compressed 17536262 / 17637774 / -0.6% 97188413 / 87016938 / +11.7% 🔴 0.18 / 0.20 / -11.0%
fineweb_q04/duckdb:vortex-file-compressed 70427308 / 68892491 / +2.2% 119220257 / 109673916 / +8.7% 0.59 / 0.63 / -6.0%
fineweb_q05/duckdb:vortex-file-compressed 67730968 / 67854090 / -0.2% 121311039 / 108951583 / +11.3% 🔴 0.56 / 0.62 / -10.4%
fineweb_q06/duckdb:vortex-file-compressed 18250194 / 18585628 / -1.8% 98311069 / 87670646 / +12.1% 🔴 0.19 / 0.21 / -12.4%
fineweb_q07/duckdb:vortex-file-compressed 19570678 / 19379656 / +1.0% 97204300 / 86651286 / +12.2% 🔴 0.20 / 0.22 / -10.0%
fineweb_q08/duckdb:vortex-file-compressed 4672252 / 4890195 / -4.5% 11767573 / 11576056 / +1.7% 0.40 / 0.42 / -6.0%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23783733 / 23389677 / +1.7% 28622900 / 27777637 / +3.0% 0.83 / 0.84 / -1.3%
fineweb_q01/duckdb:parquet 56521249 / 52797178 / +7.1% 73021415 / 71516649 / +2.1% 0.77 / 0.74 / +4.8%
fineweb_q02/duckdb:parquet 58239438 / 56824412 / +2.5% 79564369 / 78926470 / +0.8% 0.73 / 0.72 / +1.7%
fineweb_q03/duckdb:parquet 119229727 / 116886785 / +2.0% 179813082 / 175902762 / +2.2% 0.66 / 0.66 / -0.2%
fineweb_q04/duckdb:parquet 160271652 / 161380272 / -0.7% 207844587 / 205973312 / +0.9% 0.77 / 0.78 / -1.6%
fineweb_q05/duckdb:parquet 155000702 / 161141572 / -3.8% 198602436 / 198003672 / +0.3% 0.78 / 0.81 / -4.1%
fineweb_q06/duckdb:parquet 87894176 / 87763020 / +0.1% 147407273 / 150316251 / -1.9% 0.60 / 0.58 / +2.1%
fineweb_q07/duckdb:parquet 90883676 / 90026940 / +1.0% 148395658 / 137368758 / +8.0% 0.61 / 0.66 / -6.5%
fineweb_q08/duckdb:parquet 28852776 / 28034633 / +2.9% 31141774 / 29583831 / +5.3% 0.93 / 0.95 / -2.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.013x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15625091 / 15404548 / +1.4% 46152039 / 42652838 / +8.2% 0.34 / 0.36 / -6.3%
tpch_q02/datafusion:vortex-file-compressed 17221133 / 17392146 / -1.0% 37465810 / 38277508 / -2.1% 0.46 / 0.45 / +1.2%
tpch_q03/datafusion:vortex-file-compressed 19411418 / 19560854 / -0.8% 46923269 / 43147698 / +8.8% 0.41 / 0.45 / -8.7%
tpch_q04/datafusion:vortex-file-compressed 10645372 / 10634795 / +0.1% 35206672 / 34374175 / +2.4% 0.30 / 0.31 / -2.3%
tpch_q05/datafusion:vortex-file-compressed 37518325 / 37621821 / -0.3% 67713981 / 64803242 / +4.5% 0.55 / 0.58 / -4.6%
tpch_q06/datafusion:vortex-file-compressed 4364728 / 4510021 / -3.2% 27497726 / 25517329 / +7.8% 0.16 / 0.18 / -10.2%
tpch_q07/datafusion:vortex-file-compressed 52764415 / 52432755 / +0.6% 80026282 / 81940179 / -2.3% 0.66 / 0.64 / +3.0%
tpch_q08/datafusion:vortex-file-compressed 51783647 / 52057898 / -0.5% 86628581 / 86529179 / +0.1% 0.60 / 0.60 / -0.6%
tpch_q09/datafusion:vortex-file-compressed 47359775 / 47702454 / -0.7% 81059162 / 82625171 / -1.9% 0.58 / 0.58 / +1.2%
tpch_q10/datafusion:vortex-file-compressed 17402969 / 17515961 / -0.6% 50534013 / 50979714 / -0.9% 0.34 / 0.34 / +0.2%
tpch_q11/datafusion:vortex-file-compressed 14579069 / 14373184 / +1.4% 35025571 / 34698749 / +0.9% 0.42 / 0.41 / +0.5%
tpch_q12/datafusion:vortex-file-compressed 18791597 / 18649775 / +0.8% 48010614 / 43796328 / +9.6% 0.39 / 0.43 / -8.1%
tpch_q13/datafusion:vortex-file-compressed 19154472 / 19315075 / -0.8% 42620059 / 42370688 / +0.6% 0.45 / 0.46 / -1.4%
tpch_q14/datafusion:vortex-file-compressed 14263661 / 14306965 / -0.3% 41601973 / 37792718 / +10.1% 🔴 0.34 / 0.38 / -9.4%
tpch_q15/datafusion:vortex-file-compressed 18614285 / 18275394 / +1.9% 46921107 / 45895999 / +2.2% 0.40 / 0.40 / -0.4%
tpch_q16/datafusion:vortex-file-compressed 17958796 / 18548388 / -3.2% 40845939 / 39759952 / +2.7% 0.44 / 0.47 / -5.8%
tpch_q17/datafusion:vortex-file-compressed 28739488 / 29327393 / -2.0% 60972035 / 59179715 / +3.0% 0.47 / 0.50 / -4.9%
tpch_q18/datafusion:vortex-file-compressed 36305031 / 36390140 / -0.2% 61184615 / 61433170 / -0.4% 0.59 / 0.59 / +0.2%
tpch_q19/datafusion:vortex-file-compressed 9721842 / 9724836 / -0.0% 38712122 / 39043058 / -0.8% 0.25 / 0.25 / +0.8%
tpch_q20/datafusion:vortex-file-compressed 20632135 / 20571043 / +0.3% 52194016 / 46477273 / +12.3% 🔴 0.40 / 0.44 / -10.7%
tpch_q21/datafusion:vortex-file-compressed 35476173 / 35202578 / +0.8% 67306225 / 63776720 / +5.5% 0.53 / 0.55 / -4.5%
tpch_q22/datafusion:vortex-file-compressed 10879670 / 10741757 / +1.3% 32617536 / 31106485 / +4.9% 0.33 / 0.35 / -3.4%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71261189 / 71274566 / -0.0% 90156797 / 88235738 / +2.2% 0.79 / 0.81 / -2.1%
tpch_q02/datafusion:parquet 76053472 / 76391827 / -0.4% 93102315 / 92593653 / +0.5% 0.82 / 0.83 / -1.0%
tpch_q03/datafusion:parquet 81092070 / 81970359 / -1.1% 106256852 / 103434330 / +2.7% 0.76 / 0.79 / -3.7%
tpch_q04/datafusion:parquet 39649008 / 39468312 / +0.5% 59273888 / 59025188 / +0.4% 0.67 / 0.67 / +0.0%
tpch_q05/datafusion:parquet 110207762 / 110194580 / +0.0% 137204811 / 136668607 / +0.4% 0.80 / 0.81 / -0.4%
tpch_q06/datafusion:parquet 31290146 / 31204193 / +0.3% 48931902 / 48822016 / +0.2% 0.64 / 0.64 / +0.1%
tpch_q07/datafusion:parquet 112172000 / 112510419 / -0.3% 138785381 / 138500796 / +0.2% 0.81 / 0.81 / -0.5%
tpch_q08/datafusion:parquet 116957079 / 117162508 / -0.2% 146469317 / 145725055 / +0.5% 0.80 / 0.80 / -0.7%
tpch_q09/datafusion:parquet 137406409 / 137571085 / -0.1% 167874298 / 166582651 / +0.8% 0.82 / 0.83 / -0.9%
tpch_q10/datafusion:parquet 103476454 / 103866094 / -0.4% 131937401 / 127917330 / +3.1% 0.78 / 0.81 / -3.4%
tpch_q11/datafusion:parquet 61062611 / 62331716 / -2.0% 83571832 / 81917732 / +2.0% 0.73 / 0.76 / -4.0%
tpch_q12/datafusion:parquet 62934120 / 63261634 / -0.5% 84813863 / 85047967 / -0.3% 0.74 / 0.74 / -0.2%
tpch_q13/datafusion:parquet 143369230 / 143400849 / -0.0% 163984121 / 163383952 / +0.4% 0.87 / 0.88 / -0.4%
tpch_q14/datafusion:parquet 47535210 / 47796624 / -0.5% 71709197 / 70349236 / +1.9% 0.66 / 0.68 / -2.4%
tpch_q15/datafusion:parquet 73821929 / 73890766 / -0.1% 94892676 / 95143882 / -0.3% 0.78 / 0.78 / +0.2%
tpch_q16/datafusion:parquet 43390578 / 44069053 / -1.5% 62859165 / 60438215 / +4.0% 0.69 / 0.73 / -5.3%
tpch_q17/datafusion:parquet 123072057 / 122536560 / +0.4% 147945327 / 146959663 / +0.7% 0.83 / 0.83 / -0.2%
tpch_q18/datafusion:parquet 120989585 / 120748858 / +0.2% 144571439 / 142928481 / +1.1% 0.84 / 0.84 / -0.9%
tpch_q19/datafusion:parquet 57562852 / 56840748 / +1.3% 85162894 / 82237708 / +3.6% 0.68 / 0.69 / -2.2%
tpch_q20/datafusion:parquet 78768519 / 78489537 / +0.4% 103879073 / 99557442 / +4.3% 0.76 / 0.79 / -3.8%
tpch_q21/datafusion:parquet 112992917 / 113510212 / -0.5% 138677650 / 137518221 / +0.8% 0.81 / 0.83 / -1.3%
tpch_q22/datafusion:parquet 51329631 / 51604631 / -0.5% 69539414 / 66554724 / +4.5% 0.74 / 0.78 / -4.8%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8642072 / 9435939 / -8.4% 20543020 / 18809866 / +9.2% 0.42 / 0.50 / -16.1%
tpch_q02/duckdb:vortex-file-compressed 14999116 / 15067243 / -0.5% 25366043 / 25306408 / +0.2% 0.59 / 0.60 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 18618042 / 18315312 / +1.7% 34327266 / 34750844 / -1.2% 0.54 / 0.53 / +2.9%
tpch_q04/duckdb:vortex-file-compressed 12274694 / 12097081 / +1.5% 25901473 / 26496052 / -2.2% 0.47 / 0.46 / +3.8%
tpch_q05/duckdb:vortex-file-compressed 20048088 / 19985413 / +0.3% 35534810 / 35904646 / -1.0% 0.56 / 0.56 / +1.4%
tpch_q06/duckdb:vortex-file-compressed 4604749 / 4397852 / +4.7% 14267073 / 13568609 / +5.1% 0.32 / 0.32 / -0.4%
tpch_q07/duckdb:vortex-file-compressed 23987393 / 23943998 / +0.2% 39767670 / 40184861 / -1.0% 0.60 / 0.60 / +1.2%
tpch_q08/duckdb:vortex-file-compressed 21240947 / 20943820 / +1.4% 36327063 / 37457996 / -3.0% 0.58 / 0.56 / +4.6%
tpch_q09/duckdb:vortex-file-compressed 22980766 / 22076214 / +4.1% 38264768 / 39099623 / -2.1% 0.60 / 0.56 / +6.4%
tpch_q10/duckdb:vortex-file-compressed 27433663 / 27737212 / -1.1% 43957722 / 45175825 / -2.7% 0.62 / 0.61 / +1.6%
tpch_q11/duckdb:vortex-file-compressed 8214007 / 8106750 / +1.3% 17223141 / 17176487 / +0.3% 0.48 / 0.47 / +1.0%
tpch_q12/duckdb:vortex-file-compressed 14517750 / 14630851 / -0.8% 25699586 / 28009952 / -8.2% 0.56 / 0.52 / +8.1%
tpch_q13/duckdb:vortex-file-compressed 19268209 / 19394384 / -0.7% 31896877 / 30559109 / +4.4% 0.60 / 0.63 / -4.8%
tpch_q14/duckdb:vortex-file-compressed 11197627 / 11277748 / -0.7% 24219534 / 23773446 / +1.9% 0.46 / 0.47 / -2.5%
tpch_q15/duckdb:vortex-file-compressed 8256592 / 8425298 / -2.0% 19445086 / 20537004 / -5.3% 0.42 / 0.41 / +3.5%
tpch_q16/duckdb:vortex-file-compressed 16345186 / 16332893 / +0.1% 22822040 / 22957328 / -0.6% 0.72 / 0.71 / +0.7%
tpch_q17/duckdb:vortex-file-compressed 12713768 / 12551348 / +1.3% 28026609 / 28659139 / -2.2% 0.45 / 0.44 / +3.6%
tpch_q18/duckdb:vortex-file-compressed 24402844 / 24276422 / +0.5% 34590719 / 35811784 / -3.4% 0.71 / 0.68 / +4.1%
tpch_q19/duckdb:vortex-file-compressed 11445713 / 11357985 / +0.8% 26323800 / 25649287 / +2.6% 0.43 / 0.44 / -1.8%
tpch_q20/duckdb:vortex-file-compressed 14327168 / 14219279 / +0.8% 31679771 / 31418587 / +0.8% 0.45 / 0.45 / -0.1%
tpch_q21/duckdb:vortex-file-compressed 48324918 / 48785315 / -0.9% 65137186 / 66252929 / -1.7% 0.74 / 0.74 / +0.8%
tpch_q22/duckdb:vortex-file-compressed 16685075 / 16600840 / +0.5% 26404882 / 26838510 / -1.6% 0.63 / 0.62 / +2.2%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47515605 / 47698261 / -0.4% 54415031 / 54621975 / -0.4% 0.87 / 0.87 / -0.0%
tpch_q02/duckdb:parquet 48260760 / 48333312 / -0.2% 55243731 / 55766447 / -0.9% 0.87 / 0.87 / +0.8%
tpch_q03/duckdb:parquet 59940195 / 60135310 / -0.3% 69070991 / 68829841 / +0.4% 0.87 / 0.87 / -0.7%
tpch_q04/duckdb:parquet 34632627 / 34719941 / -0.3% 43061420 / 43013386 / +0.1% 0.80 / 0.81 / -0.4%
tpch_q05/duckdb:parquet 67045176 / 67074826 / -0.0% 76850495 / 78118023 / -1.6% 0.87 / 0.86 / +1.6%
tpch_q06/duckdb:parquet 21525476 / 21690206 / -0.8% 27626903 / 27653446 / -0.1% 0.78 / 0.78 / -0.7%
tpch_q07/duckdb:parquet 63533857 / 63638572 / -0.2% 73607702 / 73454296 / +0.2% 0.86 / 0.87 / -0.4%
tpch_q08/duckdb:parquet 75651068 / 75769695 / -0.2% 86226626 / 86648157 / -0.5% 0.88 / 0.87 / +0.3%
tpch_q09/duckdb:parquet 107349214 / 107662028 / -0.3% 119138495 / 119936779 / -0.7% 0.90 / 0.90 / +0.4%
tpch_q10/duckdb:parquet 105637393 / 105839733 / -0.2% 117503675 / 118234336 / -0.6% 0.90 / 0.90 / +0.4%
tpch_q11/duckdb:parquet 29452528 / 29316205 / +0.5% 34802565 / 34936123 / -0.4% 0.85 / 0.84 / +0.9%
tpch_q12/duckdb:parquet 37150164 / 36862965 / +0.8% 44425561 / 44307485 / +0.3% 0.84 / 0.83 / +0.5%
tpch_q13/duckdb:parquet 175102247 / 174493519 / +0.3% 180503485 / 180829717 / -0.2% 0.97 / 0.96 / +0.5%
tpch_q14/duckdb:parquet 42276225 / 42192727 / +0.2% 51027937 / 50974934 / +0.1% 0.83 / 0.83 / +0.1%
tpch_q15/duckdb:parquet 32546652 / 32612862 / -0.2% 41684134 / 41120739 / +1.4% 0.78 / 0.79 / -1.6%
tpch_q16/duckdb:parquet 46513909 / 46888172 / -0.8% 52099300 / 52208490 / -0.2% 0.89 / 0.90 / -0.6%
tpch_q17/duckdb:parquet 47786065 / 47952875 / -0.3% 57295643 / 57149842 / +0.3% 0.83 / 0.84 / -0.6%
tpch_q18/duckdb:parquet 73617708 / 74228495 / -0.8% 80755194 / 80054973 / +0.9% 0.91 / 0.93 / -1.7%
tpch_q19/duckdb:parquet 48413460 / 49688691 / -2.6% 60831101 / 58868433 / +3.3% 0.80 / 0.84 / -5.7%
tpch_q20/duckdb:parquet 63447276 / 63481403 / -0.1% 74228152 / 74207766 / +0.0% 0.85 / 0.86 / -0.1%
tpch_q21/duckdb:parquet 106479708 / 106592474 / -0.1% 116606250 / 115519712 / +0.9% 0.91 / 0.92 / -1.0%
tpch_q22/duckdb:parquet 50483563 / 50416042 / +0.1% 58981959 / 58812862 / +0.3% 0.86 / 0.86 / -0.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91087268 / 91842335 / -0.8% 153333487 / 153716425 / -0.2% 0.59 / 0.60 / -0.6%
tpch_q02/datafusion:vortex-file-compressed 64412398 / 65026629 / -0.9% 97857346 / 95487647 / +2.5% 0.66 / 0.68 / -3.3%
tpch_q03/datafusion:vortex-file-compressed 62632218 / 63153061 / -0.8% 122451598 / 124566444 / -1.7% 0.51 / 0.51 / +0.9%
tpch_q04/datafusion:vortex-file-compressed 34355128 / 33884066 / +1.4% 72036445 / 71863341 / +0.2% 0.48 / 0.47 / +1.1%
tpch_q05/datafusion:vortex-file-compressed 118475036 / 118972735 / -0.4% 192324053 / 177425002 / +8.4% 0.62 / 0.67 / -8.1%
tpch_q06/datafusion:vortex-file-compressed 9256026 / 9551072 / -3.1% 56308961 / 55201335 / +2.0% 0.16 / 0.17 / -5.0%
tpch_q07/datafusion:vortex-file-compressed 96377678 / 96638878 / -0.3% 153391948 / 164883110 / -7.0% 0.63 / 0.59 / +7.2%
tpch_q08/datafusion:vortex-file-compressed 144074182 / 144630521 / -0.4% 264327203 / 213228501 / +24.0% 🔴 0.55 / 0.68 / -19.6%
tpch_q09/datafusion:vortex-file-compressed 185006583 / 185911194 / -0.5% 316837886 / 266393828 / +18.9% 🔴 0.58 / 0.70 / -16.3%
tpch_q10/datafusion:vortex-file-compressed 69594809 / 70523772 / -1.3% 133913541 / 133955265 / -0.0% 0.52 / 0.53 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 45453018 / 45504924 / -0.1% 69557700 / 70219947 / -0.9% 0.65 / 0.65 / +0.8%
tpch_q12/datafusion:vortex-file-compressed 36070907 / 36132483 / -0.2% 81113390 / 80853664 / +0.3% 0.44 / 0.45 / -0.5%
tpch_q13/datafusion:vortex-file-compressed 50599500 / 49677499 / +1.9% 81449131 / 81071536 / +0.5% 0.62 / 0.61 / +1.4%
tpch_q14/datafusion:vortex-file-compressed 20323650 / 20840427 / -2.5% 85563682 / 87484129 / -2.2% 0.24 / 0.24 / -0.3%
tpch_q15/datafusion:vortex-file-compressed 32449032 / 32990887 / -1.6% 92737800 / 91658221 / +1.2% 0.35 / 0.36 / -2.8%
tpch_q16/datafusion:vortex-file-compressed 36989223 / 36450417 / +1.5% 65847048 / 66994481 / -1.7% 0.56 / 0.54 / +3.2%
tpch_q17/datafusion:vortex-file-compressed 176230246 / 179168427 / -1.6% 224357617 / 231004897 / -2.9% 0.79 / 0.78 / +1.3%
tpch_q18/datafusion:vortex-file-compressed 205556843 / 208854688 / -1.6% 276169692 / 270434360 / +2.1% 0.74 / 0.77 / -3.6%
tpch_q19/datafusion:vortex-file-compressed 28355460 / 27436278 / +3.4% 83672699 / 80256543 / +4.3% 0.34 / 0.34 / -0.9%
tpch_q20/datafusion:vortex-file-compressed 59839066 / 60584636 / -1.2% 114105448 / 113779951 / +0.3% 0.52 / 0.53 / -1.5%
tpch_q21/datafusion:vortex-file-compressed 180613428 / 181544706 / -0.5% 234026062 / 238929947 / -2.1% 0.77 / 0.76 / +1.6%
tpch_q22/datafusion:vortex-file-compressed 24995008 / 25622876 / -2.5% 52025066 / 53594727 / -2.9% 0.48 / 0.48 / +0.5%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87362074 / 87405800 / -0.1% 123972980 / 124638672 / -0.5% 0.70 / 0.70 / +0.5%
tpch_q02/datafusion:parquet 173250983 / 172465451 / +0.5% 198481545 / 202597955 / -2.0% 0.87 / 0.85 / +2.5%
tpch_q03/datafusion:parquet 134809147 / 134728458 / +0.1% 183452160 / 183462869 / -0.0% 0.73 / 0.73 / +0.1%
tpch_q04/datafusion:parquet 56831597 / 56277229 / +1.0% 88536717 / 90214521 / -1.9% 0.64 / 0.62 / +2.9%
tpch_q05/datafusion:parquet 166395630 / 168325732 / -1.1% 221598956 / 222155755 / -0.3% 0.75 / 0.76 / -0.9%
tpch_q06/datafusion:parquet 36054212 / 36485825 / -1.2% 74839065 / 75060623 / -0.3% 0.48 / 0.49 / -0.9%
tpch_q07/datafusion:parquet 217209683 / 215241217 / +0.9% 283022624 / 271310582 / +4.3% 0.77 / 0.79 / -3.3%
tpch_q08/datafusion:parquet 216822338 / 217006507 / -0.1% 282617873 / 282649931 / -0.0% 0.77 / 0.77 / -0.1%
tpch_q09/datafusion:parquet 309539656 / 308912169 / +0.2% 380885276 / 376615714 / +1.1% 0.81 / 0.82 / -0.9%
tpch_q10/datafusion:parquet 312374783 / 312067282 / +0.1% 367608338 / 369477627 / -0.5% 0.85 / 0.84 / +0.6%
tpch_q11/datafusion:parquet 127215673 / 126847909 / +0.3% 150864038 / 150878780 / -0.0% 0.84 / 0.84 / +0.3%
tpch_q12/datafusion:parquet 82167024 / 82036773 / +0.2% 118467219 / 116979721 / +1.3% 0.69 / 0.70 / -1.1%
tpch_q13/datafusion:parquet 211196827 / 210681253 / +0.2% 240856690 / 240622916 / +0.1% 0.88 / 0.88 / +0.1%
tpch_q14/datafusion:parquet 86271797 / 85201736 / +1.3% 185766700 / 187735247 / -1.0% 0.46 / 0.45 / +2.3%
tpch_q15/datafusion:parquet 105843661 / 106750251 / -0.8% 154443907 / 155219431 / -0.5% 0.69 / 0.69 / -0.4%
tpch_q16/datafusion:parquet 95921390 / 96269388 / -0.4% 127724049 / 118688661 / +7.6% 0.75 / 0.81 / -7.4%
tpch_q17/datafusion:parquet 213847822 / 214480401 / -0.3% 258284252 / 259331757 / -0.4% 0.83 / 0.83 / +0.1%
tpch_q18/datafusion:parquet 268017225 / 268723017 / -0.3% 310832904 / 316946606 / -1.9% 0.86 / 0.85 / +1.7%
tpch_q19/datafusion:parquet 108469519 / 108265953 / +0.2% 162676203 / 165478424 / -1.7% 0.67 / 0.65 / +1.9%
tpch_q20/datafusion:parquet 185914982 / 185210052 / +0.4% 246373139 / 247277500 / -0.4% 0.75 / 0.75 / +0.7%
tpch_q21/datafusion:parquet 241620450 / 245201943 / -1.5% 304586525 / 307074278 / -0.8% 0.79 / 0.80 / -0.7%
tpch_q22/datafusion:parquet 149529525 / 150005944 / -0.3% 174712707 / 176443849 / -1.0% 0.86 / 0.85 / +0.7%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32225571 / 32251704 / -0.1% 71079687 / 69153970 / +2.8% 0.45 / 0.47 / -2.8%
tpch_q02/duckdb:vortex-file-compressed 28484113 / 28909312 / -1.5% 42457675 / 43582573 / -2.6% 0.67 / 0.66 / +1.1%
tpch_q03/duckdb:vortex-file-compressed 51812927 / 51402442 / +0.8% 100455001 / 103389371 / -2.8% 0.52 / 0.50 / +3.7%
tpch_q04/duckdb:vortex-file-compressed 51262410 / 51762710 / -1.0% 90460838 / 92577835 / -2.3% 0.57 / 0.56 / +1.4%
tpch_q05/duckdb:vortex-file-compressed 67566696 / 69457495 / -2.7% 110006120 / 109500482 / +0.5% 0.61 / 0.63 / -3.2%
tpch_q06/duckdb:vortex-file-compressed 15065593 / 14900939 / +1.1% 49727682 / 49682131 / +0.1% 0.30 / 0.30 / +1.0%
tpch_q07/duckdb:vortex-file-compressed 54195933 / 54544092 / -0.6% 104906324 / 106643884 / -1.6% 0.52 / 0.51 / +1.0%
tpch_q08/duckdb:vortex-file-compressed 85125689 / 84993514 / +0.2% 129911636 / 132299262 / -1.8% 0.66 / 0.64 / +2.0%
tpch_q09/duckdb:vortex-file-compressed 103129079 / 101205886 / +1.9% 152658441 / 158473857 / -3.7% 0.68 / 0.64 / +5.8%
tpch_q10/duckdb:vortex-file-compressed 96170481 / 95563305 / +0.6% 148267269 / 154004292 / -3.7% 0.65 / 0.62 / +4.5%
tpch_q11/duckdb:vortex-file-compressed 13368069 / 12842129 / +4.1% 27814541 / 28014330 / -0.7% 0.48 / 0.46 / +4.8%
tpch_q12/duckdb:vortex-file-compressed 44525482 / 45117080 / -1.3% 82038040 / 84523081 / -2.9% 0.54 / 0.53 / +1.7%
tpch_q13/duckdb:vortex-file-compressed 72225236 / 70672009 / +2.2% 99616434 / 98725240 / +0.9% 0.73 / 0.72 / +1.3%
tpch_q14/duckdb:vortex-file-compressed 27672819 / 27767452 / -0.3% 73448302 / 71915268 / +2.1% 0.38 / 0.39 / -2.4%
tpch_q15/duckdb:vortex-file-compressed 23561857 / 23725208 / -0.7% 61661485 / 63356327 / -2.7% 0.38 / 0.37 / +2.0%
tpch_q16/duckdb:vortex-file-compressed 48874240 / 49016468 / -0.3% 57305777 / 57914482 / -1.1% 0.85 / 0.85 / +0.8%
tpch_q17/duckdb:vortex-file-compressed 34970146 / 35547768 / -1.6% 66826521 / 66685687 / +0.2% 0.52 / 0.53 / -1.8%
tpch_q18/duckdb:vortex-file-compressed 105601637 / 105784888 / -0.2% 121507451 / 120405979 / +0.9% 0.87 / 0.88 / -1.1%
tpch_q19/duckdb:vortex-file-compressed 26753231 / 26875811 / -0.5% 75387894 / 72837846 / +3.5% 0.35 / 0.37 / -3.8%
tpch_q20/duckdb:vortex-file-compressed 40707405 / 41196046 / -1.2% 91155881 / 92113901 / -1.0% 0.45 / 0.45 / -0.1%
tpch_q21/duckdb:vortex-file-compressed 94407193 / 94262995 / +0.2% 146619925 / 151375901 / -3.1% 0.64 / 0.62 / +3.4%
tpch_q22/duckdb:vortex-file-compressed 32740610 / 32997604 / -0.8% 48119922 / 48698572 / -1.2% 0.68 / 0.68 / +0.4%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67668467 / 67623322 / +0.1% 85979665 / 87632213 / -1.9% 0.79 / 0.77 / +2.0%
tpch_q02/duckdb:parquet 86634900 / 87325629 / -0.8% 96313618 / 98085918 / -1.8% 0.90 / 0.89 / +1.0%
tpch_q03/duckdb:parquet 108614439 / 111044674 / -2.2% 140963612 / 142264345 / -0.9% 0.77 / 0.78 / -1.3%
tpch_q04/duckdb:parquet 76811404 / 76270893 / +0.7% 97759792 / 97986939 / -0.2% 0.79 / 0.78 / +0.9%
tpch_q05/duckdb:parquet 122088759 / 123102862 / -0.8% 155776414 / 158199755 / -1.5% 0.78 / 0.78 / +0.7%
tpch_q06/duckdb:parquet 35600965 / 34877337 / +2.1% 56296875 / 57062619 / -1.3% 0.63 / 0.61 / +3.5%
tpch_q07/duckdb:parquet 116841385 / 117542539 / -0.6% 154207720 / 154596729 / -0.3% 0.76 / 0.76 / -0.3%
tpch_q08/duckdb:parquet 147758880 / 147008544 / +0.5% 192120085 / 187395401 / +2.5% 0.77 / 0.78 / -2.0%
tpch_q09/duckdb:parquet 236999384 / 237232312 / -0.1% 276365196 / 277586494 / -0.4% 0.86 / 0.85 / +0.3%
tpch_q10/duckdb:parquet 313538728 / 313048354 / +0.2% 338322749 / 337998688 / +0.1% 0.93 / 0.93 / +0.1%
tpch_q11/duckdb:parquet 43510009 / 43555760 / -0.1% 50329526 / 51127462 / -1.6% 0.86 / 0.85 / +1.5%
tpch_q12/duckdb:parquet 70852728 / 70607081 / +0.3% 90381662 / 89431918 / +1.1% 0.78 / 0.79 / -0.7%
tpch_q13/duckdb:parquet 291675473 / 291764690 / -0.0% 304978881 / 309269508 / -1.4% 0.96 / 0.94 / +1.4%
tpch_q14/duckdb:parquet 101224250 / 100951247 / +0.3% 134051456 / 134059126 / -0.0% 0.76 / 0.75 / +0.3%
tpch_q15/duckdb:parquet 57564565 / 57944980 / -0.7% 82723207 / 87619779 / -5.6% 0.70 / 0.66 / +5.2%
tpch_q16/duckdb:parquet 99533635 / 99623104 / -0.1% 106127590 / 106717340 / -0.6% 0.94 / 0.93 / +0.5%
tpch_q17/duckdb:parquet 81737016 / 81527631 / +0.3% 109114692 / 116876479 / -6.6% 0.75 / 0.70 / +7.4%
tpch_q18/duckdb:parquet 154041280 / 156152046 / -1.4% 179109651 / 177975443 / +0.6% 0.86 / 0.88 / -2.0%
tpch_q19/duckdb:parquet 97120559 / 97339169 / -0.2% 124435552 / 127894637 / -2.7% 0.78 / 0.76 / +2.5%
tpch_q20/duckdb:parquet 146609710 / 146603561 / +0.0% 182068012 / 183747501 / -0.9% 0.81 / 0.80 / +0.9%
tpch_q21/duckdb:parquet 255597977 / 250423696 / +2.1% 269937601 / 277022922 / -2.6% 0.95 / 0.90 / +4.7%
tpch_q22/duckdb:parquet 167981280 / 168018688 / -0.0% 179984566 / 180618979 / -0.4% 0.93 / 0.93 / +0.3%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21475079 / 21449004 / +0.1% 41074326 / 42498684 / -3.4% 0.52 / 0.50 / +3.6%
tpcds_q02/datafusion:vortex-file-compressed 43281284 / 42738788 / +1.3% 63847204 / 63955906 / -0.2% 0.68 / 0.67 / +1.4%
tpcds_q03/datafusion:vortex-file-compressed 11506846 / 11929812 / -3.5% 29914051 / 28666779 / +4.4% 0.38 / 0.42 / -7.6%
tpcds_q04/datafusion:vortex-file-compressed 81196704 / 80382178 / +1.0% 112064669 / 114582340 / -2.2% 0.72 / 0.70 / +3.3%
tpcds_q05/datafusion:vortex-file-compressed 56294471 / 57220050 / -1.6% 78815175 / 77864537 / +1.2% 0.71 / 0.73 / -2.8%
tpcds_q06/datafusion:vortex-file-compressed 21581174 / 21933751 / -1.6% 41885526 / 42085565 / -0.5% 0.52 / 0.52 / -1.1%
tpcds_q07/datafusion:vortex-file-compressed 26451636 / 26766862 / -1.2% 48884060 / 49927427 / -2.1% 0.54 / 0.54 / +0.9%
tpcds_q08/datafusion:vortex-file-compressed 25488901 / 25864988 / -1.5% 45377197 / 45745693 / -0.8% 0.56 / 0.57 / -0.7%
tpcds_q09/datafusion:vortex-file-compressed 19514716 / 19975436 / -2.3% 37363769 / 37448450 / -0.2% 0.52 / 0.53 / -2.1%
tpcds_q10/datafusion:vortex-file-compressed 30794326 / 29269160 / +5.2% 50435769 / 50954544 / -1.0% 0.61 / 0.57 / +6.3%
tpcds_q11/datafusion:vortex-file-compressed 50070661 / 49830590 / +0.5% 75782557 / 80030495 / -5.3% 0.66 / 0.62 / +6.1%
tpcds_q12/datafusion:vortex-file-compressed 15175266 / 15474688 / -1.9% 33878542 / 33407488 / +1.4% 0.45 / 0.46 / -3.3%
tpcds_q13/datafusion:vortex-file-compressed 30588166 / 32749398 / -6.6% 56584622 / 56392965 / +0.3% 0.54 / 0.58 / -6.9%
tpcds_q14/datafusion:vortex-file-compressed 490184764 / 490004930 / +0.0% 547992601 / 546335491 / +0.3% 0.89 / 0.90 / -0.3%
tpcds_q15/datafusion:vortex-file-compressed 12629469 / 12768877 / -1.1% 32572911 / 31438184 / +3.6% 0.39 / 0.41 / -4.5%
tpcds_q16/datafusion:vortex-file-compressed 19416735 / 18981875 / +2.3% 38639115 / 38519538 / +0.3% 0.50 / 0.49 / +2.0%
tpcds_q17/datafusion:vortex-file-compressed 52756690 / 52389490 / +0.7% 76745048 / 74438869 / +3.1% 0.69 / 0.70 / -2.3%
tpcds_q18/datafusion:vortex-file-compressed 63646928 / 54475018 / +16.8% 🔴 68749688 / 72615185 / -5.3% 0.93 / 0.75 / +23.4%
tpcds_q19/datafusion:vortex-file-compressed 16949015 / 17395646 / -2.6% 41781061 / 41778842 / +0.0% 0.41 / 0.42 / -2.6%
tpcds_q20/datafusion:vortex-file-compressed 16373935 / 16574804 / -1.2% 35043936 / 34835360 / +0.6% 0.47 / 0.48 / -1.8%
tpcds_q21/datafusion:vortex-file-compressed 14711612 / 14967152 / -1.7% 33860798 / 34090252 / -0.7% 0.43 / 0.44 / -1.0%
tpcds_q22/datafusion:vortex-file-compressed 49678811 / 49803606 / -0.3% 71540023 / 72395029 / -1.2% 0.69 / 0.69 / +0.9%
tpcds_q23/datafusion:vortex-file-compressed 71102380 / 72311890 / -1.7% 99503582 / 103071785 / -3.5% 0.71 / 0.70 / +1.9%
tpcds_q24/datafusion:vortex-file-compressed 63403803 / 64058281 / -1.0% 85244205 / 86930470 / -1.9% 0.74 / 0.74 / +0.9%
tpcds_q25/datafusion:vortex-file-compressed 45996226 / 44760488 / +2.8% 69316514 / 71283849 / -2.8% 0.66 / 0.63 / +5.7%
tpcds_q26/datafusion:vortex-file-compressed 25579844 / 26627942 / -3.9% 44814272 / 46348751 / -3.3% 0.57 / 0.57 / -0.6%
tpcds_q27/datafusion:vortex-file-compressed 55900380 / 56419937 / -0.9% 76979644 / 74135277 / +3.8% 0.73 / 0.76 / -4.6%
tpcds_q28/datafusion:vortex-file-compressed 18444768 / 18817866 / -2.0% 38484256 / 38735697 / -0.6% 0.48 / 0.49 / -1.3%
tpcds_q29/datafusion:vortex-file-compressed 50898928 / 48357027 / +5.3% 80844019 / 74173927 / +9.0% 0.63 / 0.65 / -3.4%
tpcds_q30/datafusion:vortex-file-compressed 27319976 / 27686742 / -1.3% 45765721 / 48468787 / -5.6% 0.60 / 0.57 / +4.5%
tpcds_q31/datafusion:vortex-file-compressed 62691733 / 62990009 / -0.5% 89793694 / 91175904 / -1.5% 0.70 / 0.69 / +1.1%
tpcds_q32/datafusion:vortex-file-compressed 12662101 / 12714930 / -0.4% 29090024 / 30232909 / -3.8% 0.44 / 0.42 / +3.5%
tpcds_q33/datafusion:vortex-file-compressed 27676842 / 28100685 / -1.5% 51446975 / 56000482 / -8.1% 0.54 / 0.50 / +7.2%
tpcds_q34/datafusion:vortex-file-compressed 17422520 / 17688358 / -1.5% 37526815 / 39087432 / -4.0% 0.46 / 0.45 / +2.6%
tpcds_q35/datafusion:vortex-file-compressed 30831558 / 31187080 / -1.1% 54563808 / 58451747 / -6.7% 0.57 / 0.53 / +5.9%
tpcds_q36/datafusion:vortex-file-compressed 46562741 / 46986574 / -0.9% 65890258 / 69673332 / -5.4% 0.71 / 0.67 / +4.8%
tpcds_q37/datafusion:vortex-file-compressed 12157396 / 12104225 / +0.4% 33570351 / 36334974 / -7.6% 0.36 / 0.33 / +8.7%
tpcds_q38/datafusion:vortex-file-compressed 26612502 / 26040116 / +2.2% 49196449 / 49435317 / -0.5% 0.54 / 0.53 / +2.7%
tpcds_q39/datafusion:vortex-file-compressed 65531674 / 63590843 / +3.1% 87300973 / 87528038 / -0.3% 0.75 / 0.73 / +3.3%
tpcds_q40/datafusion:vortex-file-compressed 23095186 / 23146031 / -0.2% 39916537 / 42456392 / -6.0% 0.58 / 0.55 / +6.1%
tpcds_q41/datafusion:vortex-file-compressed 20009966 / 19857088 / +0.8% 32603712 / 32585196 / +0.1% 0.61 / 0.61 / +0.7%
tpcds_q42/datafusion:vortex-file-compressed 11151224 / 11634661 / -4.2% 28143524 / 29260028 / -3.8% 0.40 / 0.40 / -0.4%
tpcds_q43/datafusion:vortex-file-compressed 13369818 / 13256147 / +0.9% 33698187 / 34503816 / -2.3% 0.40 / 0.38 / +3.3%
tpcds_q44/datafusion:vortex-file-compressed 27397676 / 27701670 / -1.1% 52224399 / 50164040 / +4.1% 0.52 / 0.55 / -5.0%
tpcds_q45/datafusion:vortex-file-compressed 17627594 / 17058599 / +3.3% 36664140 / 36753518 / -0.2% 0.48 / 0.46 / +3.6%
tpcds_q46/datafusion:vortex-file-compressed 23794550 / 23504132 / +1.2% 47466151 / 49629158 / -4.4% 0.50 / 0.47 / +5.8%
tpcds_q47/datafusion:vortex-file-compressed 74956264 / 74149150 / +1.1% 107828063 / 107162604 / +0.6% 0.70 / 0.69 / +0.5%
tpcds_q48/datafusion:vortex-file-compressed 28565392 / 28482035 / +0.3% 52238272 / 52245270 / -0.0% 0.55 / 0.55 / +0.3%
tpcds_q49/datafusion:vortex-file-compressed 56813215 / 55647761 / +2.1% 79791883 / 85460631 / -6.6% 0.71 / 0.65 / +9.3%
tpcds_q50/datafusion:vortex-file-compressed 30693464 / 32380240 / -5.2% 52653357 / 53066138 / -0.8% 0.58 / 0.61 / -4.5%
tpcds_q51/datafusion:vortex-file-compressed 66339872 / 66827490 / -0.7% 89802852 / 91545180 / -1.9% 0.74 / 0.73 / +1.2%
tpcds_q52/datafusion:vortex-file-compressed 11707697 / 11805344 / -0.8% 30445581 / 29482820 / +3.3% 0.38 / 0.40 / -4.0%
tpcds_q53/datafusion:vortex-file-compressed 17918413 / 18332840 / -2.3% 41177669 / 40855988 / +0.8% 0.44 / 0.45 / -3.0%
tpcds_q54/datafusion:vortex-file-compressed 31922446 / 31777460 / +0.5% 54556683 / 55566235 / -1.8% 0.59 / 0.57 / +2.3%
tpcds_q55/datafusion:vortex-file-compressed 11449005 / 11386898 / +0.5% 28303739 / 26708425 / +6.0% 0.40 / 0.43 / -5.1%
tpcds_q56/datafusion:vortex-file-compressed 26788163 / 26545850 / +0.9% 47899210 / 49268989 / -2.8% 0.56 / 0.54 / +3.8%
tpcds_q57/datafusion:vortex-file-compressed 62019856 / 62359600 / -0.5% 88776914 / 89946998 / -1.3% 0.70 / 0.69 / +0.8%
tpcds_q58/datafusion:vortex-file-compressed 40553148 / 40872440 / -0.8% 67736379 / 66900849 / +1.2% 0.60 / 0.61 / -2.0%
tpcds_q59/datafusion:vortex-file-compressed 27476505 / 27517764 / -0.1% 53358159 / 53978809 / -1.1% 0.51 / 0.51 / +1.0%
tpcds_q60/datafusion:vortex-file-compressed 27168898 / 26400983 / +2.9% 48915100 / 48792663 / +0.3% 0.56 / 0.54 / +2.7%
tpcds_q61/datafusion:vortex-file-compressed 20718804 / 20675778 / +0.2% 42862499 / 41297673 / +3.8% 0.48 / 0.50 / -3.5%
tpcds_q62/datafusion:vortex-file-compressed 16687085 / 16558694 / +0.8% 35529084 / 34571284 / +2.8% 0.47 / 0.48 / -1.9%
tpcds_q63/datafusion:vortex-file-compressed 17872009 / 18181666 / -1.7% 38813546 / 41196266 / -5.8% 0.46 / 0.44 / +4.3%
tpcds_q64/datafusion:vortex-file-compressed 188216821 / 191351242 / -1.6% 228375379 / 227870948 / +0.2% 0.82 / 0.84 / -1.9%
tpcds_q65/datafusion:vortex-file-compressed 73239130 / 72715048 / +0.7% 95310219 / 98443447 / -3.2% 0.77 / 0.74 / +4.0%
tpcds_q66/datafusion:vortex-file-compressed 49734812 / 49627487 / +0.2% 71715223 / 71294454 / +0.6% 0.69 / 0.70 / -0.4%
tpcds_q67/datafusion:vortex-file-compressed 51597628 / 50575306 / +2.0% 84332760 / 85291554 / -1.1% 0.61 / 0.59 / +3.2%
tpcds_q68/datafusion:vortex-file-compressed 22769360 / 22905012 / -0.6% 45080935 / 45973809 / -1.9% 0.51 / 0.50 / +1.4%
tpcds_q69/datafusion:vortex-file-compressed 28071698 / 26831008 / +4.6% 49321862 / 49375979 / -0.1% 0.57 / 0.54 / +4.7%
tpcds_q70/datafusion:vortex-file-compressed 72697498 / 73082920 / -0.5% 96748310 / 96067912 / +0.7% 0.75 / 0.76 / -1.2%
tpcds_q71/datafusion:vortex-file-compressed 18149939 / 18202877 / -0.3% 40659994 / 40816818 / -0.4% 0.45 / 0.45 / +0.1%
tpcds_q72/datafusion:vortex-file-compressed 286471845 / 270582635 / +5.9% 279495962 / 278041133 / +0.5% 1.02 / 0.97 / +5.3%
tpcds_q73/datafusion:vortex-file-compressed 16041663 / 16408834 / -2.2% 36164180 / 37227767 / -2.9% 0.44 / 0.44 / +0.6%
tpcds_q74/datafusion:vortex-file-compressed 40946984 / 40891589 / +0.1% 68636004 / 68950722 / -0.5% 0.60 / 0.59 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed 137694090 / 136933056 / +0.6% 166534039 / 176672529 / -5.7% 0.83 / 0.78 / +6.7%
tpcds_q76/datafusion:vortex-file-compressed 29184780 / 29306602 / -0.4% 50639100 / 50817896 / -0.4% 0.58 / 0.58 / -0.1%
tpcds_q77/datafusion:vortex-file-compressed 44800985 / 45161332 / -0.8% 67534786 / 68031847 / -0.7% 0.66 / 0.66 / -0.1%
tpcds_q78/datafusion:vortex-file-compressed 60799382 / 61222074 / -0.7% 88862190 / 91279920 / -2.6% 0.68 / 0.67 / +2.0%
tpcds_q79/datafusion:vortex-file-compressed 19684086 / 20280174 / -2.9% 43824460 / 42197009 / +3.9% 0.45 / 0.48 / -6.5%
tpcds_q80/datafusion:vortex-file-compressed 69647620 / 68873983 / +1.1% 93426699 / 94109171 / -0.7% 0.75 / 0.73 / +1.9%
tpcds_q81/datafusion:vortex-file-compressed 27689094 / 28066564 / -1.3% 47270449 / 47284348 / -0.0% 0.59 / 0.59 / -1.3%
tpcds_q82/datafusion:vortex-file-compressed 12360451 / 12397074 / -0.3% 36798761 / 36379399 / +1.2% 0.34 / 0.34 / -1.4%
tpcds_q83/datafusion:vortex-file-compressed 34811828 / 34666817 / +0.4% 54994074 / 55140265 / -0.3% 0.63 / 0.63 / +0.7%
tpcds_q84/datafusion:vortex-file-compressed 10327998 / 10589235 / -2.5% 27344944 / 27651300 / -1.1% 0.38 / 0.38 / -1.4%
tpcds_q85/datafusion:vortex-file-compressed 52295916 / 52379096 / -0.2% 78334793 / 78218823 / +0.1% 0.67 / 0.67 / -0.3%
tpcds_q86/datafusion:vortex-file-compressed 16611817 / 16156348 / +2.8% 36628747 / 35681131 / +2.7% 0.45 / 0.45 / +0.2%
tpcds_q87/datafusion:vortex-file-compressed 26739556 / 26219597 / +2.0% 51234078 / 50423190 / +1.6% 0.52 / 0.52 / +0.4%
tpcds_q88/datafusion:vortex-file-compressed 31601069 / 31364419 / +0.8% 53292469 / 51472799 / +3.5% 0.59 / 0.61 / -2.7%
tpcds_q89/datafusion:vortex-file-compressed 21698652 / 21216648 / +2.3% 43520670 / 44141371 / -1.4% 0.50 / 0.48 / +3.7%
tpcds_q90/datafusion:vortex-file-compressed 10616285 / 10590750 / +0.2% 26451131 / 26186255 / +1.0% 0.40 / 0.40 / -0.8%
tpcds_q91/datafusion:vortex-file-compressed 15313717 / 15873791 / -3.5% 37843785 / 37530117 / +0.8% 0.40 / 0.42 / -4.3%
tpcds_q92/datafusion:vortex-file-compressed 13428190 / 13095928 / +2.5% 30723137 / 31897473 / -3.7% 0.44 / 0.41 / +6.5%
tpcds_q93/datafusion:vortex-file-compressed 20237216 / 20461675 / -1.1% 41394341 / 38338479 / +8.0% 0.49 / 0.53 / -8.4%
tpcds_q94/datafusion:vortex-file-compressed 18326650 / 18455948 / -0.7% 38610052 / 37333633 / +3.4% 0.47 / 0.49 / -4.0%
tpcds_q95/datafusion:vortex-file-compressed 41797967 / 42141119 / -0.8% 62860715 / 62101264 / +1.2% 0.66 / 0.68 / -2.0%
tpcds_q96/datafusion:vortex-file-compressed 7601290 / 7941012 / -4.3% 25042291 / 23393537 / +7.0% 0.30 / 0.34 / -10.6%
tpcds_q97/datafusion:vortex-file-compressed 17657360 / 17546132 / +0.6% 39576725 / 40760025 / -2.9% 0.45 / 0.43 / +3.6%
tpcds_q98/datafusion:vortex-file-compressed 15920348 / 15784005 / +0.9% 35037586 / 34322373 / +2.1% 0.45 / 0.46 / -1.2%
tpcds_q99/datafusion:vortex-file-compressed 16180479 / 16132910 / +0.3% 34288518 / 34094422 / +0.6% 0.47 / 0.47 / -0.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42186632 / 41934641 / +0.6% 61448109 / 62940275 / -2.4% 0.69 / 0.67 / +3.0%
tpcds_q02/datafusion:parquet 54590180 / 54199292 / +0.7% 70528043 / 71443108 / -1.3% 0.77 / 0.76 / +2.0%
tpcds_q03/datafusion:parquet 19203298 / 18829179 / +2.0% 30280605 / 31099736 / -2.6% 0.63 / 0.61 / +4.7%
tpcds_q04/datafusion:parquet 178244838 / 177862064 / +0.2% 203584482 / 203486177 / +0.0% 0.88 / 0.87 / +0.2%
tpcds_q05/datafusion:parquet 66412692 / 67740948 / -2.0% 91122339 / 90107180 / +1.1% 0.73 / 0.75 / -3.1%
tpcds_q06/datafusion:parquet 33534408 / 34361484 / -2.4% 48200144 / 51149315 / -5.8% 0.70 / 0.67 / +3.6%
tpcds_q07/datafusion:parquet 46848121 / 46846304 / +0.0% 64474866 / 67154149 / -4.0% 0.73 / 0.70 / +4.2%
tpcds_q08/datafusion:parquet 31059892 / 31423518 / -1.2% 48468483 / 47678301 / +1.7% 0.64 / 0.66 / -2.8%
tpcds_q09/datafusion:parquet 32728698 / 32478880 / +0.8% 43565509 / 44248215 / -1.5% 0.75 / 0.73 / +2.3%
tpcds_q10/datafusion:parquet 42826078 / 44548093 / -3.9% 61484441 / 57251390 / +7.4% 0.70 / 0.78 / -10.5%
tpcds_q11/datafusion:parquet 95460986 / 97946912 / -2.5% 120878535 / 121218036 / -0.3% 0.79 / 0.81 / -2.3%
tpcds_q12/datafusion:parquet 23979839 / 23550060 / +1.8% 35825126 / 36929462 / -3.0% 0.67 / 0.64 / +5.0%
tpcds_q13/datafusion:parquet 45580548 / 45294244 / +0.6% 68698968 / 67069448 / +2.4% 0.66 / 0.68 / -1.8%
tpcds_q14/datafusion:parquet 532391012 / 531374890 / +0.2% 582736911 / 585568185 / -0.5% 0.91 / 0.91 / +0.7%
tpcds_q15/datafusion:parquet 24066308 / 23402312 / +2.8% 38296945 / 40214599 / -4.8% 0.63 / 0.58 / +8.0%
tpcds_q16/datafusion:parquet 36767844 / 36637342 / +0.4% 50733459 / 51066956 / -0.7% 0.72 / 0.72 / +1.0%
tpcds_q17/datafusion:parquet 73310756 / 74474544 / -1.6% 97954505 / 98329954 / -0.4% 0.75 / 0.76 / -1.2%
tpcds_q18/datafusion:parquet 67419289 / 69610683 / -3.1% 90160476 / 88806689 / +1.5% 0.75 / 0.78 / -4.6%
tpcds_q19/datafusion:parquet 29414252 / 29277994 / +0.5% 42372524 / 44382161 / -4.5% 0.69 / 0.66 / +5.2%
tpcds_q20/datafusion:parquet 25214210 / 24893586 / +1.3% 36860096 / 37794574 / -2.5% 0.68 / 0.66 / +3.9%
tpcds_q21/datafusion:parquet 20120317 / 20169398 / -0.2% 33207599 / 35031277 / -5.2% 0.61 / 0.58 / +5.2%
tpcds_q22/datafusion:parquet 77658946 / 77429776 / +0.3% 89869167 / 91781240 / -2.1% 0.86 / 0.84 / +2.4%
tpcds_q23/datafusion:parquet 92327890 / 91259834 / +1.2% 114655557 / 119150612 / -3.8% 0.81 / 0.77 / +5.1%
tpcds_q24/datafusion:parquet 89388493 / 89902664 / -0.6% 114990420 / 115437521 / -0.4% 0.78 / 0.78 / -0.2%
tpcds_q25/datafusion:parquet 80947578 / 79214470 / +2.2% 101038042 / 98849383 / +2.2% 0.80 / 0.80 / -0.0%
tpcds_q26/datafusion:parquet 43715054 / 42902962 / +1.9% 57823906 / 62061401 / -6.8% 0.76 / 0.69 / +9.4%
tpcds_q27/datafusion:parquet 74380356 / 78739678 / -5.5% 99483885 / 97462203 / +2.1% 0.75 / 0.81 / -7.5%
tpcds_q28/datafusion:parquet 28396876 / 28557796 / -0.6% 41297145 / 45573823 / -9.4% 0.69 / 0.63 / +9.7%
tpcds_q29/datafusion:parquet 75466782 / 74400790 / +1.4% 97283319 / 99987626 / -2.7% 0.78 / 0.74 / +4.3%
tpcds_q30/datafusion:parquet 42292456 / 43679683 / -3.2% 56168581 / 62074216 / -9.5% 0.75 / 0.70 / +7.0%
tpcds_q31/datafusion:parquet 78444046 / 82633347 / -5.1% 93459741 / 101659070 / -8.1% 0.84 / 0.81 / +3.3%
tpcds_q32/datafusion:parquet 26259251 / 26231688 / +0.1% 40406866 / 41134481 / -1.8% 0.65 / 0.64 / +1.9%
tpcds_q33/datafusion:parquet 38335368 / 37063050 / +3.4% 54821123 / 54536844 / +0.5% 0.70 / 0.68 / +2.9%
tpcds_q34/datafusion:parquet 24091557 / 23939049 / +0.6% 35192417 / 37229360 / -5.5% 0.68 / 0.64 / +6.5%
tpcds_q35/datafusion:parquet 50089886 / 49786038 / +0.6% 63866220 / 63718958 / +0.2% 0.78 / 0.78 / +0.4%
tpcds_q36/datafusion:parquet 51596562 / 53258567 / -3.1% 71985810 / 71855645 / +0.2% 0.72 / 0.74 / -3.3%
tpcds_q37/datafusion:parquet 21329424 / 21580606 / -1.2% 34353742 / 36748733 / -6.5% 0.62 / 0.59 / +5.7%
tpcds_q38/datafusion:parquet 44596264 / 44649130 / -0.1% 60114294 / 64816610 / -7.3% 0.74 / 0.69 / +7.7%
tpcds_q39/datafusion:parquet 68143112 / 68131247 / +0.0% 84966783 / 86331106 / -1.6% 0.80 / 0.79 / +1.6%
tpcds_q40/datafusion:parquet 30979298 / 30335482 / +2.1% 50947475 / 51683983 / -1.4% 0.61 / 0.59 / +3.6%
tpcds_q41/datafusion:parquet 19911404 / 19602344 / +1.6% 31848593 / 32017842 / -0.5% 0.63 / 0.61 / +2.1%
tpcds_q42/datafusion:parquet 18083505 / 18278492 / -1.1% 29884959 / 30319528 / -1.4% 0.61 / 0.60 / +0.4%
tpcds_q43/datafusion:parquet 19225968 / 19504236 / -1.4% 32683524 / 33000985 / -1.0% 0.59 / 0.59 / -0.5%
tpcds_q44/datafusion:parquet 36307592 / 35785336 / +1.5% 48630352 / 51263405 / -5.1% 0.75 / 0.70 / +7.0%
tpcds_q45/datafusion:parquet 27544144 / 28084930 / -1.9% 41108260 / 41460552 / -0.8% 0.67 / 0.68 / -1.1%
tpcds_q46/datafusion:parquet 28780826 / 28929198 / -0.5% 45503723 / 45583700 / -0.2% 0.63 / 0.63 / -0.3%
tpcds_q47/datafusion:parquet 97309632 / 98276346 / -1.0% 119901543 / 120887976 / -0.8% 0.81 / 0.81 / -0.2%
tpcds_q48/datafusion:parquet 41891105 / 41522119 / +0.9% 62384859 / 59033188 / +5.7% 0.67 / 0.70 / -4.5%
tpcds_q49/datafusion:parquet 71506769 / 71826388 / -0.4% 92502850 / 94752933 / -2.4% 0.77 / 0.76 / +2.0%
tpcds_q50/datafusion:parquet 46998454 / 46382150 / +1.3% 66409983 / 69761702 / -4.8% 0.71 / 0.66 / +6.4%
tpcds_q51/datafusion:parquet 74734844 / 74983710 / -0.3% 93554084 / 94366271 / -0.9% 0.80 / 0.79 / +0.5%
tpcds_q52/datafusion:parquet 18262650 / 18475504 / -1.2% 31054968 / 30424943 / +2.1% 0.59 / 0.61 / -3.2%
tpcds_q53/datafusion:parquet 22827138 / 21993897 / +3.8% 39108888 / 39222491 / -0.3% 0.58 / 0.56 / +4.1%
tpcds_q54/datafusion:parquet 53217579 / 53067003 / +0.3% 68623062 / 68471352 / +0.2% 0.78 / 0.78 / +0.1%
tpcds_q55/datafusion:parquet 17950985 / 18264418 / -1.7% 29563606 / 30935383 / -4.4% 0.61 / 0.59 / +2.8%
tpcds_q56/datafusion:parquet 40660837 / 41223383 / -1.4% 53956862 / 53962201 / -0.0% 0.75 / 0.76 / -1.4%
tpcds_q57/datafusion:parquet 100468058 / 101425854 / -0.9% 113127079 / 117484513 / -3.7% 0.89 / 0.86 / +2.9%
tpcds_q58/datafusion:parquet 65190921 / 65431608 / -0.4% 83492310 / 82952017 / +0.7% 0.78 / 0.79 / -1.0%
tpcds_q59/datafusion:parquet 47543453 / 46711870 / +1.8% 65744558 / 62937696 / +4.5% 0.72 / 0.74 / -2.6%
tpcds_q60/datafusion:parquet 39611132 / 41167501 / -3.8% 56402603 / 53341109 / +5.7% 0.70 / 0.77 / -9.0%
tpcds_q61/datafusion:parquet 36094574 / 34981678 / +3.2% 52253158 / 50442547 / +3.6% 0.69 / 0.69 / -0.4%
tpcds_q62/datafusion:parquet 24994899 / 24903140 / +0.4% 38871781 / 38481086 / +1.0% 0.64 / 0.65 / -0.6%
tpcds_q63/datafusion:parquet 22184281 / 21782786 / +1.8% 37907952 / 39692051 / -4.5% 0.59 / 0.55 / +6.6%
tpcds_q64/datafusion:parquet 284064684 / 287308187 / -1.1% 324239742 / 324339106 / -0.0% 0.88 / 0.89 / -1.1%
tpcds_q65/datafusion:parquet 121635910 / 120536482 / +0.9% 139227836 / 141857851 / -1.9% 0.87 / 0.85 / +2.8%
tpcds_q66/datafusion:parquet 59621122 / 60186930 / -0.9% 76090348 / 75885526 / +0.3% 0.78 / 0.79 / -1.2%
tpcds_q67/datafusion:parquet 68349507 / 68585032 / -0.3% 94360667 / 95821566 / -1.5% 0.72 / 0.72 / +1.2%
tpcds_q68/datafusion:parquet 28898921 / 28771694 / +0.4% 47495342 / 48992140 / -3.1% 0.61 / 0.59 / +3.6%
tpcds_q69/datafusion:parquet 44499358 / 42987038 / +3.5% 56408597 / 59339488 / -4.9% 0.79 / 0.72 / +8.9%
tpcds_q70/datafusion:parquet 80010378 / 80702666 / -0.9% 98524883 / 98395868 / +0.1% 0.81 / 0.82 / -1.0%
tpcds_q71/datafusion:parquet 25272867 / 26357412 / -4.1% 39651097 / 40662998 / -2.5% 0.64 / 0.65 / -1.7%
tpcds_q72/datafusion:parquet 520573794 / 515469642 / +1.0% 547311469 / 548320267 / -0.2% 0.95 / 0.94 / +1.2%
tpcds_q73/datafusion:parquet 23912000 / 23911079 / +0.0% 36204947 / 37711874 / -4.0% 0.66 / 0.63 / +4.2%
tpcds_q74/datafusion:parquet 70014573 / 68736513 / +1.9% 91506357 / 87904932 / +4.1% 0.77 / 0.78 / -2.1%
tpcds_q75/datafusion:parquet 151999580 / 152432366 / -0.3% 174344390 / 181806746 / -4.1% 0.87 / 0.84 / +4.0%
tpcds_q76/datafusion:parquet 32903147 / 33103139 / -0.6% 46709119 / 47082402 / -0.8% 0.70 / 0.70 / +0.2%
tpcds_q77/datafusion:parquet 55966168 / 56932614 / -1.7% 74188151 / 77954260 / -4.8% 0.75 / 0.73 / +3.3%
tpcds_q78/datafusion:parquet 85951764 / 85631185 / +0.4% 120549169 / 118462226 / +1.8% 0.71 / 0.72 / -1.4%
tpcds_q79/datafusion:parquet 26450629 / 26535574 / -0.3% 42381063 / 44201567 / -4.1% 0.62 / 0.60 / +4.0%
tpcds_q80/datafusion:parquet 79696030 / 80415402 / -0.9% 111223494 / 110583053 / +0.6% 0.72 / 0.73 / -1.5%
tpcds_q81/datafusion:parquet 38957762 / 38944306 / +0.0% 49863790 / 50474181 / -1.2% 0.78 / 0.77 / +1.3%
tpcds_q82/datafusion:parquet 22958438 / 22418096 / +2.4% 36682483 / 36232964 / +1.2% 0.63 / 0.62 / +1.2%
tpcds_q83/datafusion:parquet 59527653 / 59108821 / +0.7% 74864205 / 75660356 / -1.1% 0.80 / 0.78 / +1.8%
tpcds_q84/datafusion:parquet 25635432 / 26684250 / -3.9% 41218094 / 41453347 / -0.6% 0.62 / 0.64 / -3.4%
tpcds_q85/datafusion:parquet 80321269 / 80162231 / +0.2% 104111772 / 103700921 / +0.4% 0.77 / 0.77 / -0.2%
tpcds_q86/datafusion:parquet 20886570 / 20695666 / +0.9% 33844380 / 33472984 / +1.1% 0.62 / 0.62 / -0.2%
tpcds_q87/datafusion:parquet 44493412 / 44677312 / -0.4% 59502762 / 58664162 / +1.4% 0.75 / 0.76 / -1.8%
tpcds_q88/datafusion:parquet 37361176 / 37097696 / +0.7% 49793220 / 49853056 / -0.1% 0.75 / 0.74 / +0.8%
tpcds_q89/datafusion:parquet 25514657 / 25910608 / -1.5% 42007118 / 42618747 / -1.4% 0.61 / 0.61 / -0.1%
tpcds_q90/datafusion:parquet 15473364 / 15769406 / -1.9% 28608349 / 29399972 / -2.7% 0.54 / 0.54 / +0.8%
tpcds_q91/datafusion:parquet 31827270 / 32633648 / -2.5% 46047744 / 48180870 / -4.4% 0.69 / 0.68 / +2.0%
tpcds_q92/datafusion:parquet 26315561 / 26515896 / -0.8% 41510367 / 41341709 / +0.4% 0.63 / 0.64 / -1.2%
tpcds_q93/datafusion:parquet 26973848 / 27531030 / -2.0% 47664254 / 47468285 / +0.4% 0.57 / 0.58 / -2.4%
tpcds_q94/datafusion:parquet 35512495 / 34980072 / +1.5% 49575047 / 50063009 / -1.0% 0.72 / 0.70 / +2.5%
tpcds_q95/datafusion:parquet 64608751 / 64070348 / +0.8% 77833028 / 79328390 / -1.9% 0.83 / 0.81 / +2.8%
tpcds_q96/datafusion:parquet 12734751 / 12819981 / -0.7% 25312032 / 24687730 / +2.5% 0.50 / 0.52 / -3.1%
tpcds_q97/datafusion:parquet 35603771 / 34563396 / +3.0% 51772197 / 51932431 / -0.3% 0.69 / 0.67 / +3.3%
tpcds_q98/datafusion:parquet 24270679 / 24491682 / -0.9% 38734893 / 39124259 / -1.0% 0.63 / 0.63 / +0.1%
tpcds_q99/datafusion:parquet 29837378 / 29767726 / +0.2% 42830359 / 42905800 / -0.2% 0.70 / 0.69 / +0.4%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15847212 / 16280605 / -2.7% 24647463 / 25355059 / -2.8% 0.64 / 0.64 / +0.1%
tpcds_q02/duckdb:vortex-file-compressed 18785029 / 17816070 / +5.4% 22765840 / 24783072 / -8.1% 0.83 / 0.72 / +14.8%
tpcds_q03/duckdb:vortex-file-compressed 7069384 / 7049213 / +0.3% 16444025 / 16660554 / -1.3% 0.43 / 0.42 / +1.6%
tpcds_q04/duckdb:vortex-file-compressed 58878174 / 58341647 / +0.9% 71238353 / 72505688 / -1.7% 0.83 / 0.80 / +2.7%
tpcds_q05/duckdb:vortex-file-compressed 22672353 / 23257678 / -2.5% 32578488 / 32782333 / -0.6% 0.70 / 0.71 / -1.9%
tpcds_q06/duckdb:vortex-file-compressed 24009418 / 24142587 / -0.6% 39274642 / 39379849 / -0.3% 0.61 / 0.61 / -0.3%
tpcds_q07/duckdb:vortex-file-compressed 22116477 / 22277980 / -0.7% 34053571 / 35748885 / -4.7% 0.65 / 0.62 / +4.2%
tpcds_q08/duckdb:vortex-file-compressed 17195777 / 17321541 / -0.7% 25258575 / 25589170 / -1.3% 0.68 / 0.68 / +0.6%
tpcds_q09/duckdb:vortex-file-compressed 19071940 / 19158518 / -0.5% 29427290 / 30063595 / -2.1% 0.65 / 0.64 / +1.7%
tpcds_q10/duckdb:vortex-file-compressed 27777180 / 27840512 / -0.2% 40587637 / 41908476 / -3.2% 0.68 / 0.66 / +3.0%
tpcds_q11/duckdb:vortex-file-compressed 36229586 / 35801609 / +1.2% 45583804 / 45566363 / +0.0% 0.79 / 0.79 / +1.2%
tpcds_q12/duckdb:vortex-file-compressed 10249236 / 10348776 / -1.0% 17427280 / 16979304 / +2.6% 0.59 / 0.61 / -3.5%
tpcds_q13/duckdb:vortex-file-compressed 20049549 / 19506848 / +2.8% 33327670 / 34253318 / -2.7% 0.60 / 0.57 / +5.6%
tpcds_q14/duckdb:vortex-file-compressed 54769132 / 54580905 / +0.3% 68031240 / 65827298 / +3.3% 0.81 / 0.83 / -2.9%
tpcds_q15/duckdb:vortex-file-compressed 11189905 / 11261424 / -0.6% 18403326 / 17913819 / +2.7% 0.61 / 0.63 / -3.3%
tpcds_q16/duckdb:vortex-file-compressed 24436766 / 24416186 / +0.1% 35295911 / 35773144 / -1.3% 0.69 / 0.68 / +1.4%
tpcds_q17/duckdb:vortex-file-compressed 20290262 / 20162202 / +0.6% 32549135 / 31675244 / +2.8% 0.62 / 0.64 / -2.1%
tpcds_q18/duckdb:vortex-file-compressed 32179097 / 32025276 / +0.5% 42632827 / 42413959 / +0.5% 0.75 / 0.76 / -0.0%
tpcds_q19/duckdb:vortex-file-compressed 20531360 / 20453884 / +0.4% 29533228 / 29003169 / +1.8% 0.70 / 0.71 / -1.4%
tpcds_q20/duckdb:vortex-file-compressed 11001104 / 10971338 / +0.3% 17761307 / 17766266 / -0.0% 0.62 / 0.62 / +0.3%
tpcds_q21/duckdb:vortex-file-compressed 10554498 / 10162788 / +3.9% 24496885 / 22733869 / +7.8% 0.43 / 0.45 / -3.6%
tpcds_q22/duckdb:vortex-file-compressed 17867348 / 18540464 / -3.6% 30880435 / 31006366 / -0.4% 0.58 / 0.60 / -3.2%
tpcds_q23/duckdb:vortex-file-compressed 37066564 / 37021247 / +0.1% 49665602 / 48880567 / +1.6% 0.75 / 0.76 / -1.5%
tpcds_q24/duckdb:vortex-file-compressed 26579078 / 26513250 / +0.2% 38398429 / 38813844 / -1.1% 0.69 / 0.68 / +1.3%
tpcds_q25/duckdb:vortex-file-compressed 19166560 / 19058916 / +0.6% 32553889 / 31360765 / +3.8% 0.59 / 0.61 / -3.1%
tpcds_q26/duckdb:vortex-file-compressed 21890218 / 22068404 / -0.8% 32521592 / 33068431 / -1.7% 0.67 / 0.67 / +0.9%
tpcds_q27/duckdb:vortex-file-compressed 24826804 / 24765314 / +0.2% 36956593 / 37788034 / -2.2% 0.67 / 0.66 / +2.5%
tpcds_q28/duckdb:vortex-file-compressed 15271304 / 15262860 / +0.1% 26526145 / 26294087 / +0.9% 0.58 / 0.58 / -0.8%
tpcds_q29/duckdb:vortex-file-compressed 18800642 / 18734154 / +0.4% 30786368 / 31534111 / -2.4% 0.61 / 0.59 / +2.8%
tpcds_q30/duckdb:vortex-file-compressed 18408650 / 18259288 / +0.8% 27125349 / 28484119 / -4.8% 0.68 / 0.64 / +5.9%
tpcds_q31/duckdb:vortex-file-compressed 17920168 / 17869242 / +0.3% 26600626 / 26018319 / +2.2% 0.67 / 0.69 / -1.9%
tpcds_q32/duckdb:vortex-file-compressed 10300374 / 10445140 / -1.4% 18804295 / 18389816 / +2.3% 0.55 / 0.57 / -3.6%
tpcds_q33/duckdb:vortex-file-compressed 18213693 / 17732877 / +2.7% 28413528 / 28363600 / +0.2% 0.64 / 0.63 / +2.5%
tpcds_q34/duckdb:vortex-file-compressed 12896256 / 12818871 / +0.6% 23083913 / 22421085 / +3.0% 0.56 / 0.57 / -2.3%
tpcds_q35/duckdb:vortex-file-compressed 30989314 / 31030149 / -0.1% 45404513 / 44094491 / +3.0% 0.68 / 0.70 / -3.0%
tpcds_q36/duckdb:vortex-file-compressed 13951714 / 14096882 / -1.0% 24425331 / 24229993 / +0.8% 0.57 / 0.58 / -1.8%
tpcds_q37/duckdb:vortex-file-compressed 9878456 / 9844538 / +0.3% 27126451 / 25401145 / +6.8% 0.36 / 0.39 / -6.0%
tpcds_q38/duckdb:vortex-file-compressed 24197818 / 24299488 / -0.4% 31083476 / 31853582 / -2.4% 0.78 / 0.76 / +2.0%
tpcds_q39/duckdb:vortex-file-compressed 18948387 / 19609497 / -3.4% 33618182 / 32479064 / +3.5% 0.56 / 0.60 / -6.6%
tpcds_q40/duckdb:vortex-file-compressed 11236771 / 11232802 / +0.0% 20148234 / 19691550 / +2.3% 0.56 / 0.57 / -2.2%
tpcds_q41/duckdb:vortex-file-compressed 17303664 / 17309274 / -0.0% 23688324 / 23931086 / -1.0% 0.73 / 0.72 / +1.0%
tpcds_q42/duckdb:vortex-file-compressed 6931488 / 6793297 / +2.0% 16138258 / 15555415 / +3.7% 0.43 / 0.44 / -1.7%
tpcds_q43/duckdb:vortex-file-compressed 10740898 / 9675598 / +11.0% 🔴 18829594 / 18839730 / -0.1% 0.57 / 0.51 / +11.1%
tpcds_q44/duckdb:vortex-file-compressed 12755538 / 12784414 / -0.2% 25305344 / 25134090 / +0.7% 0.50 / 0.51 / -0.9%
tpcds_q45/duckdb:vortex-file-compressed 23679924 / 23883250 / -0.9% 30617915 / 31026335 / -1.3% 0.77 / 0.77 / +0.5%
tpcds_q46/duckdb:vortex-file-compressed 31602880 / 31434921 / +0.5% 43166029 / 43487662 / -0.7% 0.73 / 0.72 / +1.3%
tpcds_q47/duckdb:vortex-file-compressed 30903908 / 30632259 / +0.9% 41216524 / 41501393 / -0.7% 0.75 / 0.74 / +1.6%
tpcds_q48/duckdb:vortex-file-compressed 22436496 / 22592041 / -0.7% 36114357 / 37222108 / -3.0% 0.62 / 0.61 / +2.4%
tpcds_q49/duckdb:vortex-file-compressed 18613585 / 18322068 / +1.6% 30859646 / 30928449 / -0.2% 0.60 / 0.59 / +1.8%
tpcds_q50/duckdb:vortex-file-compressed 14931490 / 14983409 / -0.3% 25866527 / 27340423 / -5.4% 0.58 / 0.55 / +5.3%
tpcds_q51/duckdb:vortex-file-compressed 49052200 / 49161851 / -0.2% 77562927 / 59729306 / +29.9% 🔴 0.63 / 0.82 / -23.2%
tpcds_q52/duckdb:vortex-file-compressed 7064967 / 6981268 / +1.2% 16264230 / 16278010 / -0.1% 0.43 / 0.43 / +1.3%
tpcds_q53/duckdb:vortex-file-compressed 11290448 / 11267339 / +0.2% 20871375 / 20062956 / +4.0% 0.54 / 0.56 / -3.7%
tpcds_q54/duckdb:vortex-file-compressed 19616742 / 19994896 / -1.9% 30804433 / 30179635 / +2.1% 0.64 / 0.66 / -3.9%
tpcds_q55/duckdb:vortex-file-compressed 6825506 / 6788880 / +0.5% 15958196 / 16101703 / -0.9% 0.43 / 0.42 / +1.4%
tpcds_q56/duckdb:vortex-file-compressed 17701539 / 18701545 / -5.3% 28543986 / 28711583 / -0.6% 0.62 / 0.65 / -4.8%
tpcds_q57/duckdb:vortex-file-compressed 25563760 / 25353327 / +0.8% 33705156 / 34687673 / -2.8% 0.76 / 0.73 / +3.8%
tpcds_q58/duckdb:vortex-file-compressed 20426994 / 20479752 / -0.3% 30738800 / 31186599 / -1.4% 0.66 / 0.66 / +1.2%
tpcds_q59/duckdb:vortex-file-compressed 19438022 / 19427672 / +0.1% 26176916 / 26843091 / -2.5% 0.74 / 0.72 / +2.6%
tpcds_q60/duckdb:vortex-file-compressed 18934862 / 18599638 / +1.8% 28235693 / 28582098 / -1.2% 0.67 / 0.65 / +3.1%
tpcds_q61/duckdb:vortex-file-compressed 19849334 / 19998388 / -0.7% 31415711 / 31444142 / -0.1% 0.63 / 0.64 / -0.7%
tpcds_q62/duckdb:vortex-file-compressed 11319912 / 11367574 / -0.4% 18439667 / 18982693 / -2.9% 0.61 / 0.60 / +2.5%
tpcds_q63/duckdb:vortex-file-compressed 11019962 / 10912253 / +1.0% 19800245 / 19057101 / +3.9% 0.56 / 0.57 / -2.8%
tpcds_q64/duckdb:vortex-file-compressed 52291466 / 51939750 / +0.7% 69130732 / 69493781 / -0.5% 0.76 / 0.75 / +1.2%
tpcds_q65/duckdb:vortex-file-compressed 12914172 / 12758646 / +1.2% 23930436 / 23117906 / +3.5% 0.54 / 0.55 / -2.2%
tpcds_q66/duckdb:vortex-file-compressed 31547328 / 32662078 / -3.4% 38767125 / 39475687 / -1.8% 0.81 / 0.83 / -1.6%
tpcds_q67/duckdb:vortex-file-compressed 55143754 / 55260231 / -0.2% 66433335 / 64955234 / +2.3% 0.83 / 0.85 / -2.4%
tpcds_q68/duckdb:vortex-file-compressed 22792120 / 22924902 / -0.6% 36439240 / 35192342 / +3.5% 0.63 / 0.65 / -4.0%
tpcds_q69/duckdb:vortex-file-compressed 22872746 / 22809916 / +0.3% 37329221 / 36355878 / +2.7% 0.61 / 0.63 / -2.3%
tpcds_q70/duckdb:vortex-file-compressed 14646174 / 14551981 / +0.6% 26181514 / 26014801 / +0.6% 0.56 / 0.56 / +0.0%
tpcds_q71/duckdb:vortex-file-compressed 13752117 / 14445859 / -4.8% 23791466 / 23531827 / +1.1% 0.58 / 0.61 / -5.8%
tpcds_q72/duckdb:vortex-file-compressed 43347574 / 43625218 / -0.6% 56109538 / 57180932 / -1.9% 0.77 / 0.76 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed 11912068 / 12052644 / -1.2% 20772837 / 21109572 / -1.6% 0.57 / 0.57 / +0.4%
tpcds_q74/duckdb:vortex-file-compressed 31200912 / 31226532 / -0.1% 40389620 / 40885399 / -1.2% 0.77 / 0.76 / +1.1%
tpcds_q75/duckdb:vortex-file-compressed 37271270 / 37198383 / +0.2% 48711749 / 50976831 / -4.4% 0.77 / 0.73 / +4.9%
tpcds_q76/duckdb:vortex-file-compressed 12655240 / 12702059 / -0.4% 22988814 / 23488092 / -2.1% 0.55 / 0.54 / +1.8%
tpcds_q77/duckdb:vortex-file-compressed 20769189 / 20600114 / +0.8% 32245939 / 32203719 / +0.1% 0.64 / 0.64 / +0.7%
tpcds_q78/duckdb:vortex-file-compressed 43465764 / 43699523 / -0.5% 53254183 / 55583815 / -4.2% 0.82 / 0.79 / +3.8%
tpcds_q79/duckdb:vortex-file-compressed 17053477 / 17125770 / -0.4% 28446727 / 28074737 / +1.3% 0.60 / 0.61 / -1.7%
tpcds_q80/duckdb:vortex-file-compressed 29578000 / 29958771 / -1.3% 45280470 / 43980835 / +3.0% 0.65 / 0.68 / -4.1%
tpcds_q81/duckdb:vortex-file-compressed 21305068 / 21427182 / -0.6% 31271981 / 30407988 / +2.8% 0.68 / 0.70 / -3.3%
tpcds_q82/duckdb:vortex-file-compressed 9974662 / 10053465 / -0.8% 27202716 / 26668887 / +2.0% 0.37 / 0.38 / -2.7%
tpcds_q83/duckdb:vortex-file-compressed 17469380 / 17412324 / +0.3% 24746842 / 24259016 / +2.0% 0.71 / 0.72 / -1.7%
tpcds_q84/duckdb:vortex-file-compressed 15818690 / 15727843 / +0.6% 23235734 / 23338055 / -0.4% 0.68 / 0.67 / +1.0%
tpcds_q85/duckdb:vortex-file-compressed 25079038 / 25230302 / -0.6% 37829681 / 37087133 / +2.0% 0.66 / 0.68 / -2.6%
tpcds_q86/duckdb:vortex-file-compressed 10176824 / 10234004 / -0.6% 16891852 / 17849359 / -5.4% 0.60 / 0.57 / +5.1%
tpcds_q87/duckdb:vortex-file-compressed 25915820 / 25929686 / -0.1% 33487179 / 33661664 / -0.5% 0.77 / 0.77 / +0.5%
tpcds_q88/duckdb:vortex-file-compressed 29876627 / 30511148 / -2.1% 39971298 / 39720459 / +0.6% 0.75 / 0.77 / -2.7%
tpcds_q89/duckdb:vortex-file-compressed 11869038 / 11779673 / +0.8% 21556169 / 20919048 / +3.0% 0.55 / 0.56 / -2.2%
tpcds_q90/duckdb:vortex-file-compressed 7823714 / 7861846 / -0.5% 15064330 / 14704391 / +2.4% 0.52 / 0.53 / -2.9%
tpcds_q91/duckdb:vortex-file-compressed 14669743 / 14562214 / +0.7% 24347079 / 24569202 / -0.9% 0.60 / 0.59 / +1.7%
tpcds_q92/duckdb:vortex-file-compressed 10814010 / 10651178 / +1.5% 19001280 / 19962494 / -4.8% 0.57 / 0.53 / +6.7%
tpcds_q93/duckdb:vortex-file-compressed 10018500 / 10134612 / -1.1% 24081938 / 23834289 / +1.0% 0.42 / 0.43 / -2.2%
tpcds_q94/duckdb:vortex-file-compressed 21923526 / 22128457 / -0.9% 32206213 / 33222700 / -3.1% 0.68 / 0.67 / +2.2%
tpcds_q95/duckdb:vortex-file-compressed 60749122 / 60736772 / +0.0% 69814085 / 69948171 / -0.2% 0.87 / 0.87 / +0.2%
tpcds_q96/duckdb:vortex-file-compressed 6737184 / 6396328 / +5.3% 17679663 / 15985008 / +10.6% 🔴 0.38 / 0.40 / -4.8%
tpcds_q97/duckdb:vortex-file-compressed 23275080 / 23222665 / +0.2% 32065126 / 32515988 / -1.4% 0.73 / 0.71 / +1.6%
tpcds_q98/duckdb:vortex-file-compressed 11390887 / 11195368 / +1.7% 19502593 / 19219492 / +1.5% 0.58 / 0.58 / +0.3%
tpcds_q99/duckdb:vortex-file-compressed 14656106 / 14643890 / +0.1% 22686022 / 22992975 / -1.3% 0.65 / 0.64 / +1.4%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23860252 / 23993272 / -0.6% 30704596 / 31017328 / -1.0% 0.78 / 0.77 / +0.5%
tpcds_q02/duckdb:parquet 17807882 / 17861354 / -0.3% 23961622 / 24242419 / -1.2% 0.74 / 0.74 / +0.9%
tpcds_q03/duckdb:parquet 9766936 / 9919218 / -1.5% 15664445 / 15696933 / -0.2% 0.62 / 0.63 / -1.3%
tpcds_q04/duckdb:parquet 117201539 / 117164704 / +0.0% 125373354 / 125870653 / -0.4% 0.93 / 0.93 / +0.4%
tpcds_q05/duckdb:parquet 28269297 / 28098910 / +0.6% 32863937 / 32770980 / +0.3% 0.86 / 0.86 / +0.3%
tpcds_q06/duckdb:parquet 26286479 / 26372178 / -0.3% 35387415 / 35350798 / +0.1% 0.74 / 0.75 / -0.4%
tpcds_q07/duckdb:parquet 31173000 / 32355026 / -3.7% 38867557 / 38463680 / +1.1% 0.80 / 0.84 / -4.7%
tpcds_q08/duckdb:parquet 19790418 / 19589864 / +1.0% 24921981 / 24838798 / +0.3% 0.79 / 0.79 / +0.7%
tpcds_q09/duckdb:parquet 27310856 / 26428399 / +3.3% 30010509 / 30897711 / -2.9% 0.91 / 0.86 / +6.4%
tpcds_q10/duckdb:parquet 32246958 / 32777236 / -1.6% 40355512 / 40044825 / +0.8% 0.80 / 0.82 / -2.4%
tpcds_q11/duckdb:parquet 68576704 / 68476230 / +0.1% 76135802 / 77053057 / -1.2% 0.90 / 0.89 / +1.4%
tpcds_q12/duckdb:parquet 13898864 / 13954478 / -0.4% 19535911 / 19186897 / +1.8% 0.71 / 0.73 / -2.2%
tpcds_q13/duckdb:parquet 31347641 / 30140124 / +4.0% 39884752 / 38873556 / +2.6% 0.79 / 0.78 / +1.4%
tpcds_q14/duckdb:parquet 63104897 / 64838960 / -2.7% 67642110 / 68125173 / -0.7% 0.93 / 0.95 / -2.0%
tpcds_q15/duckdb:parquet 16625266 / 16594544 / +0.2% 22554904 / 22749329 / -0.9% 0.74 / 0.73 / +1.0%
tpcds_q16/duckdb:parquet 29981670 / 30013369 / -0.1% 37097409 / 37217539 / -0.3% 0.81 / 0.81 / +0.2%
tpcds_q17/duckdb:parquet 34568744 / 34188894 / +1.1% 40262221 / 39765057 / +1.3% 0.86 / 0.86 / -0.1%
tpcds_q18/duckdb:parquet 46793642 / 46911602 / -0.3% 54318033 / 54812213 / -0.9% 0.86 / 0.86 / +0.7%
tpcds_q19/duckdb:parquet 19360326 / 18671098 / +3.7% 25632268 / 25495520 / +0.5% 0.76 / 0.73 / +3.1%
tpcds_q20/duckdb:parquet 14853148 / 14848960 / +0.0% 19489853 / 19579488 / -0.5% 0.76 / 0.76 / +0.5%
tpcds_q21/duckdb:parquet 10639468 / 10638532 / +0.0% 16356135 / 17128157 / -4.5% 0.65 / 0.62 / +4.7%
tpcds_q22/duckdb:parquet 20331654 / 20588084 / -1.2% 26166691 / 26745923 / -2.2% 0.78 / 0.77 / +0.9%
tpcds_q23/duckdb:parquet 41718185 / 43212620 / -3.5% 49088346 / 47185122 / +4.0% 0.85 / 0.92 / -7.2%
tpcds_q24/duckdb:parquet 30295160 / 30165460 / +0.4% 36426093 / 36866227 / -1.2% 0.83 / 0.82 / +1.6%
tpcds_q25/duckdb:parquet 30369799 / 30384990 / -0.0% 36843845 / 37377516 / -1.4% 0.82 / 0.81 / +1.4%
tpcds_q26/duckdb:parquet 28956000 / 28800104 / +0.5% 35050124 / 35437625 / -1.1% 0.83 / 0.81 / +1.7%
tpcds_q27/duckdb:parquet 35332406 / 35225814 / +0.3% 41472557 / 41479754 / -0.0% 0.85 / 0.85 / +0.3%
tpcds_q28/duckdb:parquet 25629432 / 25653510 / -0.1% 37260916 / 35318212 / +5.5% 0.69 / 0.73 / -5.3%
tpcds_q29/duckdb:parquet 32341962 / 31881220 / +1.4% 39147464 / 39329360 / -0.5% 0.83 / 0.81 / +1.9%
tpcds_q30/duckdb:parquet 35293332 / 35145400 / +0.4% 44245771 / 44275655 / -0.1% 0.80 / 0.79 / +0.5%
tpcds_q31/duckdb:parquet 36760210 / 35547370 / +3.4% 43443723 / 42788337 / +1.5% 0.85 / 0.83 / +1.9%
tpcds_q32/duckdb:parquet 14176015 / 14172346 / +0.0% 20550945 / 20737007 / -0.9% 0.69 / 0.68 / +0.9%
tpcds_q33/duckdb:parquet 23614616 / 24292464 / -2.8% 28993523 / 28817430 / +0.6% 0.81 / 0.84 / -3.4%
tpcds_q34/duckdb:parquet 17086934 / 17150278 / -0.4% 24407845 / 24314514 / +0.4% 0.70 / 0.71 / -0.8%
tpcds_q35/duckdb:parquet 34695549 / 34927944 / -0.7% 43428513 / 44136639 / -1.6% 0.80 / 0.79 / +1.0%
tpcds_q36/duckdb:parquet 40812050 / 40823224 / -0.0% 46804119 / 47345235 / -1.1% 0.87 / 0.86 / +1.1%
tpcds_q37/duckdb:parquet 12654142 / 12630832 / +0.2% 19840939 / 19701366 / +0.7% 0.64 / 0.64 / -0.5%
tpcds_q38/duckdb:parquet 29665991 / 29601931 / +0.2% 33728635 / 33705405 / +0.1% 0.88 / 0.88 / +0.1%
tpcds_q39/duckdb:parquet 23092001 / 23152192 / -0.3% 29911363 / 29376123 / +1.8% 0.77 / 0.79 / -2.0%
tpcds_q40/duckdb:parquet 15798200 / 15926147 / -0.8% 21251800 / 21791675 / -2.5% 0.74 / 0.73 / +1.7%
tpcds_q41/duckdb:parquet 11751260 / 11949064 / -1.7% 17688898 / 17501169 / +1.1% 0.66 / 0.68 / -2.7%
tpcds_q42/duckdb:parquet 9497570 / 9514996 / -0.2% 15335004 / 16233916 / -5.5% 0.62 / 0.59 / +5.7%
tpcds_q43/duckdb:parquet 12513306 / 11963960 / +4.6% 21460825 / 17776247 / +20.7% 🔴 0.58 / 0.67 / -13.4%
tpcds_q44/duckdb:parquet 21098168 / 22807810 / -7.5% 26447905 / 26645358 / -0.7% 0.80 / 0.86 / -6.8%
tpcds_q45/duckdb:parquet 20802058 / 20698650 / +0.5% 28245863 / 27592389 / +2.4% 0.74 / 0.75 / -1.8%
tpcds_q46/duckdb:parquet 35207002 / 35201466 / +0.0% 42990686 / 43536320 / -1.3% 0.82 / 0.81 / +1.3%
tpcds_q47/duckdb:parquet 34155664 / 34156556 / -0.0% 41115790 / 40893691 / +0.5% 0.83 / 0.84 / -0.5%
tpcds_q48/duckdb:parquet 30038828 / 29263563 / +2.6% 36602866 / 36405734 / +0.5% 0.82 / 0.80 / +2.1%
tpcds_q49/duckdb:parquet 28914249 / 29513960 / -2.0% 36121397 / 36055889 / +0.2% 0.80 / 0.82 / -2.2%
tpcds_q50/duckdb:parquet 19361273 / 19558272 / -1.0% 25624885 / 25398288 / +0.9% 0.76 / 0.77 / -1.9%
tpcds_q51/duckdb:parquet 51859122 / 52612432 / -1.4% 77707992 / 58747627 / +32.3% 🔴 0.67 / 0.90 / -25.5%
tpcds_q52/duckdb:parquet 9676154 / 9571456 / +1.1% 15403660 / 15601463 / -1.3% 0.63 / 0.61 / +2.4%
tpcds_q53/duckdb:parquet 13716098 / 13785832 / -0.5% 21505096 / 20933496 / +2.7% 0.64 / 0.66 / -3.2%
tpcds_q54/duckdb:parquet 24892404 / 24718568 / +0.7% 32448192 / 32061188 / +1.2% 0.77 / 0.77 / -0.5%
tpcds_q55/duckdb:parquet 9390404 / 9375315 / +0.2% 15385790 / 15249725 / +0.9% 0.61 / 0.61 / -0.7%
tpcds_q56/duckdb:parquet 26147600 / 26705728 / -2.1% 31045676 / 30756753 / +0.9% 0.84 / 0.87 / -3.0%
tpcds_q57/duckdb:parquet 30520070 / 30356678 / +0.5% 35921053 / 36154758 / -0.6% 0.85 / 0.84 / +1.2%
tpcds_q58/duckdb:parquet 24517020 / 24284922 / +1.0% 29872361 / 29284348 / +2.0% 0.82 / 0.83 / -1.0%
tpcds_q59/duckdb:parquet 22683924 / 22677524 / +0.0% 28780991 / 28585952 / +0.7% 0.79 / 0.79 / -0.6%
tpcds_q60/duckdb:parquet 26659656 / 27712731 / -3.8% 32303454 / 31835413 / +1.5% 0.83 / 0.87 / -5.2%
tpcds_q61/duckdb:parquet 24938545 / 25052707 / -0.5% 29131119 / 29145260 / -0.0% 0.86 / 0.86 / -0.4%
tpcds_q62/duckdb:parquet 12784455 / 12905044 / -0.9% 17729086 / 17919170 / -1.1% 0.72 / 0.72 / +0.1%
tpcds_q63/duckdb:parquet 13351563 / 13141136 / +1.6% 20085997 / 19852484 / +1.2% 0.66 / 0.66 / +0.4%
tpcds_q64/duckdb:parquet 69772294 / 70393644 / -0.9% 81842568 / 81582676 / +0.3% 0.85 / 0.86 / -1.2%
tpcds_q65/duckdb:parquet 20136306 / 19438016 / +3.6% 25501498 / 25679395 / -0.7% 0.79 / 0.76 / +4.3%
tpcds_q66/duckdb:parquet 33227955 / 33221336 / +0.0% 38563963 / 38205776 / +0.9% 0.86 / 0.87 / -0.9%
tpcds_q67/duckdb:parquet 62217310 / 60653521 / +2.6% 66990792 / 67471860 / -0.7% 0.93 / 0.90 / +3.3%
tpcds_q68/duckdb:parquet 28298068 / 28175192 / +0.4% 36396232 / 36063564 / +0.9% 0.78 / 0.78 / -0.5%
tpcds_q69/duckdb:parquet 25779921 / 25677424 / +0.4% 34375608 / 34599666 / -0.6% 0.75 / 0.74 / +1.1%
tpcds_q70/duckdb:parquet 19272658 / 19139774 / +0.7% 26817850 / 26912424 / -0.4% 0.72 / 0.71 / +1.0%
tpcds_q71/duckdb:parquet 17790184 / 18331078 / -3.0% 24162530 / 23937136 / +0.9% 0.74 / 0.77 / -3.9%
tpcds_q72/duckdb:parquet 52658968 / 52868966 / -0.4% 59281909 / 59733187 / -0.8% 0.89 / 0.89 / +0.4%
tpcds_q73/duckdb:parquet 14628712 / 16023036 / -8.7% 21492960 / 21564827 / -0.3% 0.68 / 0.74 / -8.4%
tpcds_q74/duckdb:parquet 83492778 / 84438536 / -1.1% 91942298 / 91285738 / +0.7% 0.91 / 0.92 / -1.8%
tpcds_q75/duckdb:parquet 44347976 / 44406848 / -0.1% 49752363 / 49680412 / +0.1% 0.89 / 0.89 / -0.3%
tpcds_q76/duckdb:parquet 19394514 / 19344888 / +0.3% 23836112 / 23464548 / +1.6% 0.81 / 0.82 / -1.3%
tpcds_q77/duckdb:parquet 26980070 / 25811932 / +4.5% 32439629 / 30967118 / +4.8% 0.83 / 0.83 / -0.2%
tpcds_q78/duckdb:parquet 78066565 / 78615622 / -0.7% 82368460 / 85001453 / -3.1% 0.95 / 0.92 / +2.5%
tpcds_q79/duckdb:parquet 21213612 / 22566732 / -6.0% 28861128 / 28603184 / +0.9% 0.74 / 0.79 / -6.8%
tpcds_q80/duckdb:parquet 35744747 / 37629026 / -5.0% 43606725 / 43268386 / +0.8% 0.82 / 0.87 / -5.7%
tpcds_q81/duckdb:parquet 36192672 / 36103182 / +0.2% 44301832 / 44988648 / -1.5% 0.82 / 0.80 / +1.8%
tpcds_q82/duckdb:parquet 13172978 / 13249048 / -0.6% 20751538 / 20359866 / +1.9% 0.63 / 0.65 / -2.5%
tpcds_q83/duckdb:parquet 19985581 / 20198756 / -1.1% 24958604 / 24684116 / +1.1% 0.80 / 0.82 / -2.1%
tpcds_q84/duckdb:parquet 22946611 / 22813764 / +0.6% 28620729 / 28477344 / +0.5% 0.80 / 0.80 / +0.1%
tpcds_q85/duckdb:parquet 31862864 / 32186971 / -1.0% 38806444 / 39252382 / -1.1% 0.82 / 0.82 / +0.1%
tpcds_q86/duckdb:parquet 11727400 / 11815521 / -0.7% 16973978 / 17190846 / -1.3% 0.69 / 0.69 / +0.5%
tpcds_q87/duckdb:parquet 31044445 / 31093874 / -0.2% 35265860 / 35194619 / +0.2% 0.88 / 0.88 / -0.4%
tpcds_q88/duckdb:parquet 38069384 / 39066738 / -2.6% 43563382 / 43127450 / +1.0% 0.87 / 0.91 / -3.5%
tpcds_q89/duckdb:parquet 14181912 / 15426974 / -8.1% 21575064 / 21303473 / +1.3% 0.66 / 0.72 / -9.2%
tpcds_q90/duckdb:parquet 9968024 / 9985410 / -0.2% 15420227 / 15219231 / +1.3% 0.65 / 0.66 / -1.5%
tpcds_q91/duckdb:parquet 20763967 / 20948609 / -0.9% 28170131 / 28241071 / -0.3% 0.74 / 0.74 / -0.6%
tpcds_q92/duckdb:parquet 15676780 / 15571232 / +0.7% 22047076 / 22227599 / -0.8% 0.71 / 0.70 / +1.5%
tpcds_q93/duckdb:parquet 14107834 / 14026861 / +0.6% 20260876 / 20371462 / -0.5% 0.70 / 0.69 / +1.1%
tpcds_q94/duckdb:parquet 25357536 / 25258316 / +0.4% 32660235 / 32663861 / -0.0% 0.78 / 0.77 / +0.4%
tpcds_q95/duckdb:parquet 43587066 / 43656083 / -0.2% 49748625 / 48981323 / +1.6% 0.88 / 0.89 / -1.7%
tpcds_q96/duckdb:parquet 8225304 / 8623489 / -4.6% 13741965 / 13692950 / +0.4% 0.60 / 0.63 / -5.0%
tpcds_q97/duckdb:parquet 27388548 / 27436296 / -0.2% 34002650 / 33943266 / +0.2% 0.81 / 0.81 / -0.3%
tpcds_q98/duckdb:parquet 16373040 / 16341622 / +0.2% 22927472 / 23050864 / -0.5% 0.71 / 0.71 / +0.7%
tpcds_q99/duckdb:parquet 18631372 / 18685366 / -0.3% 24855357 / 24749146 / +0.4% 0.75 / 0.75 / -0.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1243070 / 1205442 / +3.1% 22764822 / 24033622 / -5.3% 0.05 / 0.05 / +8.9%
clickbench_q01/datafusion:vortex-file-compressed 5717494 / 5740966 / -0.4% 31806480 / 30794703 / +3.3% 0.18 / 0.19 / -3.6%
clickbench_q02/datafusion:vortex-file-compressed 11068083 / 10924060 / +1.3% 48145967 / 45684096 / +5.4% 0.23 / 0.24 / -3.9%
clickbench_q03/datafusion:vortex-file-compressed 13234782 / 13028278 / +1.6% 52901270 / 57904251 / -8.6% 0.25 / 0.22 / +11.2%
clickbench_q04/datafusion:vortex-file-compressed 58597518 / 60313872 / -2.8% 105751691 / 104937907 / +0.8% 0.55 / 0.57 / -3.6%
clickbench_q05/datafusion:vortex-file-compressed 77635800 / 80929260 / -4.1% 132922155 / 133758736 / -0.6% 0.58 / 0.61 / -3.5%
clickbench_q06/datafusion:vortex-file-compressed 1245521 / 1223508 / +1.8% 24016821 / 23965392 / +0.2% 0.05 / 0.05 / +1.6%
clickbench_q07/datafusion:vortex-file-compressed 9795041 / 9235059 / +6.1% 34552768 / 34406312 / +0.4% 0.28 / 0.27 / +5.6%
clickbench_q08/datafusion:vortex-file-compressed 79476345 / 77215909 / +2.9% 127102055 / 131567487 / -3.4% 0.63 / 0.59 / +6.5%
clickbench_q09/datafusion:vortex-file-compressed 173840414 / 167007727 / +4.1% 223009170 / 217156366 / +2.7% 0.78 / 0.77 / +1.4%
clickbench_q10/datafusion:vortex-file-compressed 22693600 / 22926567 / -1.0% 69081396 / 69812214 / -1.0% 0.33 / 0.33 / +0.0%
clickbench_q11/datafusion:vortex-file-compressed 24016674 / 24194012 / -0.7% 69682610 / 69444504 / +0.3% 0.34 / 0.35 / -1.1%
clickbench_q12/datafusion:vortex-file-compressed 74057208 / 75191520 / -1.5% 125833553 / 130558787 / -3.6% 0.59 / 0.58 / +2.2%
clickbench_q13/datafusion:vortex-file-compressed 116519184 / 115821656 / +0.6% 187371684 / 195540587 / -4.2% 0.62 / 0.59 / +5.0%
clickbench_q14/datafusion:vortex-file-compressed 74886220 / 77734208 / -3.7% 127222206 / 129058377 / -1.4% 0.59 / 0.60 / -2.3%
clickbench_q15/datafusion:vortex-file-compressed 63641420 / 64569630 / -1.4% 102224391 / 107153727 / -4.6% 0.62 / 0.60 / +3.3%
clickbench_q16/datafusion:vortex-file-compressed 154464993 / 155106756 / -0.4% 215447431 / 219191643 / -1.7% 0.72 / 0.71 / +1.3%
clickbench_q17/datafusion:vortex-file-compressed 153026520 / 155443082 / -1.6% 223581076 / 224189499 / -0.3% 0.68 / 0.69 / -1.3%
clickbench_q18/datafusion:vortex-file-compressed 290286754 / 290995542 / -0.2% 387189258 / 387405582 / -0.1% 0.75 / 0.75 / -0.2%
clickbench_q19/datafusion:vortex-file-compressed 7489144 / 7228089 / +3.6% 46491507 / 46390786 / +0.2% 0.16 / 0.16 / +3.4%
clickbench_q20/datafusion:vortex-file-compressed 72090282 / 69802694 / +3.3% 247094317 / 245434110 / +0.7% 0.29 / 0.28 / +2.6%
clickbench_q21/datafusion:vortex-file-compressed 77190710 / 79092060 / -2.4% 286147634 / 287742626 / -0.6% 0.27 / 0.27 / -1.9%
clickbench_q22/datafusion:vortex-file-compressed 89853616 / 89842660 / +0.0% 388675892 / 396389606 / -1.9% 0.23 / 0.23 / +2.0%
clickbench_q23/datafusion:vortex-file-compressed 75007093 / 93277478 / -19.6% 🟢 375987428 / 389793978 / -3.5% 0.20 / 0.24 / -16.6%
clickbench_q24/datafusion:vortex-file-compressed 8410336 / 8836552 / -4.8% 69209687 / 66571649 / +4.0% 0.12 / 0.13 / -8.5%
clickbench_q25/datafusion:vortex-file-compressed 18024263 / 18356787 / -1.8% 64187363 / 66043074 / -2.8% 0.28 / 0.28 / +1.0%
clickbench_q26/datafusion:vortex-file-compressed 15718352 / 13562380 / +15.9% 🔴 67806070 / 67661539 / +0.2% 0.23 / 0.20 / +15.6%
clickbench_q27/datafusion:vortex-file-compressed 98921096 / 98735396 / +0.2% 254953899 / 252590794 / +0.9% 0.39 / 0.39 / -0.7%
clickbench_q28/datafusion:vortex-file-compressed 566730536 / 553255376 / +2.4% 640503368 / 641859241 / -0.2% 0.88 / 0.86 / +2.7%
clickbench_q29/datafusion:vortex-file-compressed 24220998 / 24471186 / -1.0% 57755682 / 55410613 / +4.2% 0.42 / 0.44 / -5.0%
clickbench_q30/datafusion:vortex-file-compressed 55917574 / 55465638 / +0.8% 114752216 / 110909330 / +3.5% 0.49 / 0.50 / -2.6%
clickbench_q31/datafusion:vortex-file-compressed 64746506 / 65167067 / -0.6% 163121052 / 159193184 / +2.5% 0.40 / 0.41 / -3.0%
clickbench_q32/datafusion:vortex-file-compressed 288483372 / 296240456 / -2.6% 395188901 / 391716019 / +0.9% 0.73 / 0.76 / -3.5%
clickbench_q33/datafusion:vortex-file-compressed 322629569 / 320018382 / +0.8% 425762355 / 432789411 / -1.6% 0.76 / 0.74 / +2.5%
clickbench_q34/datafusion:vortex-file-compressed 316611828 / 323206142 / -2.0% 435025477 / 433809545 / +0.3% 0.73 / 0.75 / -2.3%
clickbench_q35/datafusion:vortex-file-compressed 57629957 / 58108322 / -0.8% 95436502 / 97786209 / -2.4% 0.60 / 0.59 / +1.6%
clickbench_q36/datafusion:vortex-file-compressed 37658766 / 37637351 / +0.1% 68895678 / 69699612 / -1.2% 0.55 / 0.54 / +1.2%
clickbench_q37/datafusion:vortex-file-compressed 20115486 / 20600294 / -2.4% 48620738 / 49573254 / -1.9% 0.41 / 0.42 / -0.4%
clickbench_q38/datafusion:vortex-file-compressed 12745350 / 12772438 / -0.2% 42911916 / 42951958 / -0.1% 0.30 / 0.30 / -0.1%
clickbench_q39/datafusion:vortex-file-compressed 78306382 / 78715417 / -0.5% 113857875 / 114533734 / -0.6% 0.69 / 0.69 / +0.1%
clickbench_q40/datafusion:vortex-file-compressed 10148120 / 10134752 / +0.1% 37456852 / 37757783 / -0.8% 0.27 / 0.27 / +0.9%
clickbench_q41/datafusion:vortex-file-compressed 9799390 / 9528984 / +2.8% 37923317 / 36674023 / +3.4% 0.26 / 0.26 / -0.6%
clickbench_q42/datafusion:vortex-file-compressed 9760122 / 9542299 / +2.3% 36591293 / 37506019 / -2.4% 0.27 / 0.25 / +4.8%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1264390 / 1246046 / +1.5% 49506426 / 50131230 / -1.2% 0.03 / 0.02 / +2.8%
clickbench_q01/datafusion:parquet 16272753 / 15767376 / +3.2% 69305156 / 68808395 / +0.7% 0.23 / 0.23 / +2.5%
clickbench_q02/datafusion:parquet 18841030 / 18739867 / +0.5% 79918909 / 83019430 / -3.7% 0.24 / 0.23 / +4.4%
clickbench_q03/datafusion:parquet 16963689 / 17357276 / -2.3% 80143700 / 80555139 / -0.5% 0.21 / 0.22 / -1.8%
clickbench_q04/datafusion:parquet 64141168 / 62656713 / +2.4% 123963160 / 126706752 / -2.2% 0.52 / 0.49 / +4.6%
clickbench_q05/datafusion:parquet 87907870 / 89497932 / -1.8% 156333521 / 157265209 / -0.6% 0.56 / 0.57 / -1.2%
clickbench_q06/datafusion:parquet 1270032 / 1244010 / +2.1% 50105649 / 52918851 / -5.3% 0.03 / 0.02 / +7.8%
clickbench_q07/datafusion:parquet 16873370 / 17085624 / -1.2% 67850702 / 68539860 / -1.0% 0.25 / 0.25 / -0.2%
clickbench_q08/datafusion:parquet 83714600 / 85350156 / -1.9% 163044374 / 161697929 / +0.8% 0.51 / 0.53 / -2.7%
clickbench_q09/datafusion:parquet 190915994 / 188404076 / +1.3% 259827973 / 274612439 / -5.4% 0.73 / 0.69 / +7.1%
clickbench_q10/datafusion:parquet 36238713 / 36543710 / -0.8% 100456955 / 103102926 / -2.6% 0.36 / 0.35 / +1.8%
clickbench_q11/datafusion:parquet 42601892 / 43537004 / -2.1% 109492509 / 112986511 / -3.1% 0.39 / 0.39 / +1.0%
clickbench_q12/datafusion:parquet 96131190 / 97077529 / -1.0% 163211595 / 165683892 / -1.5% 0.59 / 0.59 / +0.5%
clickbench_q13/datafusion:parquet 146566664 / 148119973 / -1.0% 227801856 / 233362615 / -2.4% 0.64 / 0.63 / +1.4%
clickbench_q14/datafusion:parquet 101072232 / 101442931 / -0.4% 172759239 / 176742262 / -2.3% 0.59 / 0.57 / +1.9%
clickbench_q15/datafusion:parquet 71396154 / 72117185 / -1.0% 131967681 / 131536454 / +0.3% 0.54 / 0.55 / -1.3%
clickbench_q16/datafusion:parquet 155700500 / 157730510 / -1.3% 235312630 / 241916871 / -2.7% 0.66 / 0.65 / +1.5%
clickbench_q17/datafusion:parquet 156781346 / 156840059 / -0.0% 236352403 / 236653137 / -0.1% 0.66 / 0.66 / +0.1%
clickbench_q18/datafusion:parquet 311908812 / 310236411 / +0.5% 418574498 / 430377164 / -2.7% 0.75 / 0.72 / +3.4%
clickbench_q19/datafusion:parquet 18685692 / 18807833 / -0.6% 75996108 / 78707141 / -3.4% 0.25 / 0.24 / +2.9%
clickbench_q20/datafusion:parquet 179750932 / 180601676 / -0.5% 278148360 / 298533503 / -6.8% 0.65 / 0.60 / +6.8%
clickbench_q21/datafusion:parquet 174154031 / 172253270 / +1.1% 299916990 / 317303212 / -5.5% 0.58 / 0.54 / +7.0%
clickbench_q22/datafusion:parquet 258337530 / 262444127 / -1.6% 431887488 / 454986639 / -5.1% 0.60 / 0.58 / +3.7%
clickbench_q23/datafusion:parquet 1007584783 / 1014661149 / -0.7% 1191046785 / 1225152723 / -2.8% 0.85 / 0.83 / +2.1%
clickbench_q24/datafusion:parquet 30141156 / 30254725 / -0.4% 89633240 / 91151860 / -1.7% 0.34 / 0.33 / +1.3%
clickbench_q25/datafusion:parquet 36150622 / 36966308 / -2.2% 102805251 / 105359861 / -2.4% 0.35 / 0.35 / +0.2%
clickbench_q26/datafusion:parquet 29933037 / 30948017 / -3.3% 90755138 / 94481297 / -3.9% 0.33 / 0.33 / +0.7%
clickbench_q27/datafusion:parquet 191839046 / 192646707 / -0.4% 288698606 / 299333952 / -3.6% 0.66 / 0.64 / +3.2%
clickbench_q28/datafusion:parquet 615058445 / 618927318 / -0.6% 698893736 / 717314384 / -2.6% 0.88 / 0.86 / +2.0%
clickbench_q29/datafusion:parquet 29242478 / 28925726 / +1.1% 89723569 / 91399903 / -1.8% 0.33 / 0.32 / +3.0%
clickbench_q30/datafusion:parquet 90179590 / 89819964 / +0.4% 174075214 / 179502744 / -3.0% 0.52 / 0.50 / +3.5%
clickbench_q31/datafusion:parquet 101191160 / 103561028 / -2.3% 198688127 / 200218899 / -0.8% 0.51 / 0.52 / -1.5%
clickbench_q32/datafusion:parquet 305405338 / 310066655 / -1.5% 431359983 / 431021282 / +0.1% 0.71 / 0.72 / -1.6%
clickbench_q33/datafusion:parquet 377760544 / 377996374 / -0.1% 477358119 / 477985171 / -0.1% 0.79 / 0.79 / +0.1%
clickbench_q34/datafusion:parquet 375984316 / 377686588 / -0.5% 478347842 / 476260952 / +0.4% 0.79 / 0.79 / -0.9%
clickbench_q35/datafusion:parquet 65886203 / 64690851 / +1.8% 124166988 / 124106845 / +0.0% 0.53 / 0.52 / +1.8%
clickbench_q36/datafusion:parquet 73812040 / 74441223 / -0.8% 135353385 / 138311114 / -2.1% 0.55 / 0.54 / +1.3%
clickbench_q37/datafusion:parquet 35404143 / 35465304 / -0.2% 91689341 / 93152754 / -1.6% 0.39 / 0.38 / +1.4%
clickbench_q38/datafusion:parquet 47821113 / 48095980 / -0.6% 109473730 / 110095318 / -0.6% 0.44 / 0.44 / -0.0%
clickbench_q39/datafusion:parquet 143742688 / 144183540 / -0.3% 209748848 / 213071035 / -1.6% 0.69 / 0.68 / +1.3%
clickbench_q40/datafusion:parquet 19754058 / 20014066 / -1.3% 77697077 / 79052120 / -1.7% 0.25 / 0.25 / +0.4%
clickbench_q41/datafusion:parquet 18725480 / 18973698 / -1.3% 76660277 / 77475719 / -1.1% 0.24 / 0.24 / -0.3%
clickbench_q42/datafusion:parquet 19066394 / 19114188 / -0.3% 74330563 / 76031986 / -2.2% 0.26 / 0.25 / +2.0%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2219610 / 2212350 / +0.3% 26789332 / 26393071 / +1.5% 0.08 / 0.08 / -1.2%
clickbench_q01/duckdb:vortex-file-compressed 7523050 / 6918460 / +8.7% 27080949 / 26239654 / +3.2% 0.28 / 0.26 / +5.4%
clickbench_q02/duckdb:vortex-file-compressed 9255332 / 9004158 / +2.8% 35860704 / 36309269 / -1.2% 0.26 / 0.25 / +4.1%
clickbench_q03/duckdb:vortex-file-compressed 13792079 / 14086318 / -2.1% 48889568 / 48189747 / +1.5% 0.28 / 0.29 / -3.5%
clickbench_q04/duckdb:vortex-file-compressed 56690164 / 55951486 / +1.3% 91218641 / 87283466 / +4.5% 0.62 / 0.64 / -3.1%
clickbench_q05/duckdb:vortex-file-compressed 64111550 / 63666944 / +0.7% 93458844 / 95414488 / -2.0% 0.69 / 0.67 / +2.8%
clickbench_q06/duckdb:vortex-file-compressed 2617170 / 2783147 / -6.0% 31720211 / 31521362 / +0.6% 0.08 / 0.09 / -6.6%
clickbench_q07/duckdb:vortex-file-compressed 9473726 / 8956197 / +5.8% 31322663 / 30564599 / +2.5% 0.30 / 0.29 / +3.2%
clickbench_q08/duckdb:vortex-file-compressed 69537076 / 68362946 / +1.7% 107268036 / 100838700 / +6.4% 0.65 / 0.68 / -4.4%
clickbench_q09/duckdb:vortex-file-compressed 92984454 / 91570648 / +1.5% 125433671 / 127268581 / -1.4% 0.74 / 0.72 / +3.0%
clickbench_q10/duckdb:vortex-file-compressed 27001932 / 27717154 / -2.6% 69413735 / 71498527 / -2.9% 0.39 / 0.39 / +0.3%
clickbench_q11/duckdb:vortex-file-compressed 29810602 / 29901358 / -0.3% 74968458 / 74304868 / +0.9% 0.40 / 0.40 / -1.2%
clickbench_q12/duckdb:vortex-file-compressed 68556286 / 69114800 / -0.8% 101979939 / 102111558 / -0.1% 0.67 / 0.68 / -0.7%
clickbench_q13/duckdb:vortex-file-compressed 117018536 / 116289753 / +0.6% 167321721 / 163591203 / +2.3% 0.70 / 0.71 / -1.6%
clickbench_q14/duckdb:vortex-file-compressed 72464606 / 73174946 / -1.0% 101878120 / 102708335 / -0.8% 0.71 / 0.71 / -0.2%
clickbench_q15/duckdb:vortex-file-compressed 77102164 / 76153072 / +1.2% 107357209 / 109697615 / -2.1% 0.72 / 0.69 / +3.5%
clickbench_q16/duckdb:vortex-file-compressed 135242700 / 133305134 / +1.5% 171455702 / 168727742 / +1.6% 0.79 / 0.79 / -0.2%
clickbench_q17/duckdb:vortex-file-compressed 136872614 / 138295928 / -1.0% 168984355 / 170612064 / -1.0% 0.81 / 0.81 / -0.1%
clickbench_q18/duckdb:vortex-file-compressed 256987193 / 257391645 / -0.2% 295490697 / 309145583 / -4.4% 0.87 / 0.83 / +4.5%
clickbench_q19/duckdb:vortex-file-compressed 8882858 / 8938558 / -0.6% 35423266 / 39486581 / -10.3% 🟢 0.25 / 0.23 / +10.8%
clickbench_q20/duckdb:vortex-file-compressed 68580994 / 66740800 / +2.8% 166996048 / 169679875 / -1.6% 0.41 / 0.39 / +4.4%
clickbench_q21/duckdb:vortex-file-compressed 72952398 / 72912849 / +0.1% 186038155 / 181442280 / +2.5% 0.39 / 0.40 / -2.4%
clickbench_q22/duckdb:vortex-file-compressed 108342254 / 109339446 / -0.9% 307902236 / 300739456 / +2.4% 0.35 / 0.36 / -3.2%
clickbench_q23/duckdb:vortex-file-compressed 59180138 / 62617782 / -5.5% 154928772 / 180009444 / -13.9% 🟢 0.38 / 0.35 / +9.8%
clickbench_q24/duckdb:vortex-file-compressed 17015913 / 17182999 / -1.0% 44737648 / 46151811 / -3.1% 0.38 / 0.37 / +2.2%
clickbench_q25/duckdb:vortex-file-compressed 18075915 / 18205744 / -0.7% 53979041 / 54002551 / -0.0% 0.33 / 0.34 / -0.7%
clickbench_q26/duckdb:vortex-file-compressed 13638570 / 13451064 / +1.4% 47410758 / 41678053 / +13.8% 🔴 0.29 / 0.32 / -10.9%
clickbench_q27/duckdb:vortex-file-compressed 49708036 / 49662274 / +0.1% 174266656 / 175559857 / -0.7% 0.29 / 0.28 / +0.8%
clickbench_q28/duckdb:vortex-file-compressed 510822350 / 513511095 / -0.5% 561439165 / 564175941 / -0.5% 0.91 / 0.91 / -0.0%
clickbench_q29/duckdb:vortex-file-compressed 17278690 / 17118262 / +0.9% 44239181 / 44120063 / +0.3% 0.39 / 0.39 / +0.7%
clickbench_q30/duckdb:vortex-file-compressed 59926056 / 59068172 / +1.5% 113041937 / 109122885 / +3.6% 0.53 / 0.54 / -2.1%
clickbench_q31/duckdb:vortex-file-compressed 109708152 / 109230581 / +0.4% 177620426 / 200959107 / -11.6% 🟢 0.62 / 0.54 / +13.6%
clickbench_q32/duckdb:vortex-file-compressed 356131362 / 360460050 / -1.2% 395269386 / 396777993 / -0.4% 0.90 / 0.91 / -0.8%
clickbench_q33/duckdb:vortex-file-compressed 338752234 / 348787022 / -2.9% 396171453 / 405778028 / -2.4% 0.86 / 0.86 / -0.5%
clickbench_q34/duckdb:vortex-file-compressed 353788607 / 355305662 / -0.4% 410910651 / 406879093 / +1.0% 0.86 / 0.87 / -1.4%
clickbench_q35/duckdb:vortex-file-compressed 57885160 / 56719274 / +2.1% 90634498 / 88857347 / +2.0% 0.64 / 0.64 / +0.1%
clickbench_q36/duckdb:vortex-file-compressed 11267094 / 10985779 / +2.6% 33572031 / 35843290 / -6.3% 0.34 / 0.31 / +9.5%
clickbench_q37/duckdb:vortex-file-compressed 7701034 / 7566981 / +1.8% 28768128 / 28269206 / +1.8% 0.27 / 0.27 / +0.0%
clickbench_q38/duckdb:vortex-file-compressed 8128510 / 7947630 / +2.3% 29911158 / 28750032 / +4.0% 0.27 / 0.28 / -1.7%
clickbench_q39/duckdb:vortex-file-compressed 17804694 / 17981140 / -1.0% 45086160 / 42826923 / +5.3% 0.39 / 0.42 / -5.9%
clickbench_q40/duckdb:vortex-file-compressed 6849932 / 6890977 / -0.6% 29622008 / 29225575 / +1.4% 0.23 / 0.24 / -1.9%
clickbench_q41/duckdb:vortex-file-compressed 7757447 / 7790208 / -0.4% 29450880 / 30478113 / -3.4% 0.26 / 0.26 / +3.1%
clickbench_q42/duckdb:vortex-file-compressed 6974321 / 6995600 / -0.3% 28629510 / 30237471 / -5.3% 0.24 / 0.23 / +5.3%
duckdb / parquet / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9429894 / 9857317 / -4.3% 14370927 / 14205151 / +1.2% 0.66 / 0.69 / -5.4%
clickbench_q01/duckdb:parquet 15131172 / 15650171 / -3.3% 20453876 / 20819349 / -1.8% 0.74 / 0.75 / -1.6%
clickbench_q02/duckdb:parquet 21977798 / 22032852 / -0.2% 30869097 / 31793623 / -2.9% 0.71 / 0.69 / +2.7%
clickbench_q03/duckdb:parquet 22656751 / 22927784 / -1.2% 34980577 / 33551819 / +4.3% 0.65 / 0.68 / -5.2%
clickbench_q04/duckdb:parquet 61044536 / 61636388 / -1.0% 71561014 / 70878232 / +1.0% 0.85 / 0.87 / -1.9%
clickbench_q05/duckdb:parquet 82078050 / 82139203 / -0.1% 96845359 / 95838628 / +1.1% 0.85 / 0.86 / -1.1%
clickbench_q06/duckdb:parquet 20360996 / 20436438 / -0.4% 28677123 / 28145562 / +1.9% 0.71 / 0.73 / -2.2%
clickbench_q07/duckdb:parquet 17350907 / 17320495 / +0.2% 23461112 / 24886394 / -5.7% 0.74 / 0.70 / +6.3%
clickbench_q08/duckdb:parquet 76608552 / 75314716 / +1.7% 90847941 / 89903694 / +1.1% 0.84 / 0.84 / +0.7%
clickbench_q09/duckdb:parquet 101983109 / 102220371 / -0.2% 123908335 / 119484306 / +3.7% 0.82 / 0.86 / -3.8%
clickbench_q10/duckdb:parquet 41194433 / 41195936 / -0.0% 56111508 / 61280512 / -8.4% 0.73 / 0.67 / +9.2%
clickbench_q11/duckdb:parquet 47504540 / 46529677 / +2.1% 61009718 / 58998376 / +3.4% 0.78 / 0.79 / -1.3%
clickbench_q12/duckdb:parquet 92186078 / 92844469 / -0.7% 103096963 / 104846844 / -1.7% 0.89 / 0.89 / +1.0%
clickbench_q13/duckdb:parquet 150315155 / 149283603 / +0.7% 166675004 / 164805034 / +1.1% 0.90 / 0.91 / -0.4%
clickbench_q14/duckdb:parquet 101276729 / 100719424 / +0.6% 115819372 / 117219177 / -1.2% 0.87 / 0.86 / +1.8%
clickbench_q15/duckdb:parquet 86004886 / 86305514 / -0.3% 99003279 / 98759774 / +0.2% 0.87 / 0.87 / -0.6%
clickbench_q16/duckdb:parquet 164097601 / 160014286 / +2.6% 174945052 / 178484364 / -2.0% 0.94 / 0.90 / +4.6%
clickbench_q17/duckdb:parquet 164735544 / 163673269 / +0.6% 180471663 / 177502784 / +1.7% 0.91 / 0.92 / -1.0%
clickbench_q18/duckdb:parquet 287949624 / 294403882 / -2.2% 324088684 / 315383921 / +2.8% 0.89 / 0.93 / -4.8%
clickbench_q19/duckdb:parquet 19926634 / 19936563 / -0.0% 26511695 / 25548039 / +3.8% 0.75 / 0.78 / -3.7%
clickbench_q20/duckdb:parquet 190824668 / 181878499 / +4.9% 227857003 / 229691149 / -0.8% 0.84 / 0.79 / +5.8%
clickbench_q21/duckdb:parquet 216499324 / 221884634 / -2.4% 269768185 / 269901992 / -0.0% 0.80 / 0.82 / -2.4%
clickbench_q22/duckdb:parquet 306585394 / 306819235 / -0.1% 356771046 / 356415829 / +0.1% 0.86 / 0.86 / -0.2%
clickbench_q23/duckdb:parquet 177268345 / 174333042 / +1.7% 230024685 / 225395310 / +2.1% 0.77 / 0.77 / -0.4%
clickbench_q24/duckdb:parquet 30095812 / 30141928 / -0.2% 43095119 / 49470561 / -12.9% 🟢 0.70 / 0.61 / +14.6%
clickbench_q25/duckdb:parquet 42311273 / 41807831 / +1.2% 56945334 / 58393577 / -2.5% 0.74 / 0.72 / +3.8%
clickbench_q26/duckdb:parquet 33106716 / 30812815 / +7.4% 43311461 / 46182806 / -6.2% 0.76 / 0.67 / +14.6%
clickbench_q27/duckdb:parquet 188917138 / 192827278 / -2.0% 220627230 / 226556492 / -2.6% 0.86 / 0.85 / +0.6%
clickbench_q28/duckdb:parquet 951949696 / 960256302 / -0.9% 983508649 / 943922858 / +4.2% 0.97 / 1.02 / -4.9%
clickbench_q29/duckdb:parquet 23367112 / 24440537 / -4.4% 29973995 / 29834400 / +0.5% 0.78 / 0.82 / -4.8%
clickbench_q30/duckdb:parquet 106600042 / 106314368 / +0.3% 124567090 / 128049532 / -2.7% 0.86 / 0.83 / +3.1%
clickbench_q31/duckdb:parquet 157934560 / 136442760 / +15.8% 🔴 173769202 / 175202352 / -0.8% 0.91 / 0.78 / +16.7%
clickbench_q32/duckdb:parquet 389005260 / 385766438 / +0.8% 414772732 / 409693420 / +1.2% 0.94 / 0.94 / -0.4%
clickbench_q33/duckdb:parquet 474139867 / 488028422 / -2.8% 461461074 / 460471666 / +0.2% 1.03 / 1.06 / -3.1%
clickbench_q34/duckdb:parquet 467416101 / 478714945 / -2.4% 458700210 / 470091089 / -2.4% 1.02 / 1.02 / +0.1%
clickbench_q35/duckdb:parquet 61628856 / 61521912 / +0.2% 74668966 / 74193854 / +0.6% 0.83 / 0.83 / -0.5%
clickbench_q36/duckdb:parquet 30446575 / 30217710 / +0.8% 36014112 / 36445267 / -1.2% 0.85 / 0.83 / +2.0%
clickbench_q37/duckdb:parquet 22993968 / 23187430 / -0.8% 29478825 / 32526256 / -9.4% 0.78 / 0.71 / +9.4%
clickbench_q38/duckdb:parquet 23735759 / 23323322 / +1.8% 30123968 / 31240002 / -3.6% 0.79 / 0.75 / +5.5%
clickbench_q39/duckdb:parquet 52741957 / 52945178 / -0.4% 60803659 / 60405421 / +0.7% 0.87 / 0.88 / -1.0%
clickbench_q40/duckdb:parquet 14761584 / 14810682 / -0.3% 19686310 / 20069534 / -1.9% 0.75 / 0.74 / +1.6%
clickbench_q41/duckdb:parquet 15384977 / 16133318 / -4.6% 20315537 / 21226535 / -4.3% 0.76 / 0.76 / -0.4%
clickbench_q42/duckdb:parquet 14273662 / 14186854 / +0.6% 20566376 / 21296298 / -3.4% 0.69 / 0.67 / +4.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 224e1354 vs base 64808453
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+7.6%, environment too noisy confidence) · DuckDB No clear signal (-5.8%, environment too noisy confidence)
Vortex (geomean): hot 0.979x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.972x ➖ · cold 1.019x ➖
Shifts: Parquet (control) -2.8% · Median polish -1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 202456307 / 227886930 / -11.2% 629884059 / 738528554 / -14.7% 0.32 / 0.31 / +4.2%
tpch_q02/datafusion:vortex-file-compressed 324740326 / 326160569 / -0.4% 662912484 / 610470982 / +8.6% 0.49 / 0.53 / -8.3%
tpch_q03/datafusion:vortex-file-compressed 318797416 / 338971452 / -6.0% 963119257 / 840149789 / +14.6% 0.33 / 0.40 / -18.0%
tpch_q04/datafusion:vortex-file-compressed 167475491 / 207332329 / -19.2% 457146317 / 418543479 / +9.2% 0.37 / 0.50 / -26.0%
tpch_q05/datafusion:vortex-file-compressed 355170689 / 356242789 / -0.3% 680397073 / 557042154 / +22.1% 0.52 / 0.64 / -18.4%
tpch_q06/datafusion:vortex-file-compressed 136810258 / 130088496 / +5.2% 268179464 / 296818218 / -9.6% 0.51 / 0.44 / +16.4%
tpch_q07/datafusion:vortex-file-compressed 423672375 / 428773948 / -1.2% 598938379 / 706284430 / -15.2% 0.71 / 0.61 / +16.5%
tpch_q08/datafusion:vortex-file-compressed 407669653 / 433061689 / -5.9% 578757739 / 589435939 / -1.8% 0.70 / 0.73 / -4.1%
tpch_q09/datafusion:vortex-file-compressed 552193784 / 321388366 / +71.8% 🔴 508351274 / 784562651 / -35.2% 🟢 1.09 / 0.41 / +165.2%
tpch_q10/datafusion:vortex-file-compressed 401151994 / 435538504 / -7.9% 544781459 / 496113175 / +9.8% 0.74 / 0.88 / -16.1%
tpch_q11/datafusion:vortex-file-compressed 294833168 / 322521718 / -8.6% 411504679 / 469932247 / -12.4% 0.72 / 0.69 / +4.4%
tpch_q12/datafusion:vortex-file-compressed 220613556 / 212258638 / +3.9% 402581832 / 456167189 / -11.7% 0.55 / 0.47 / +17.8%
tpch_q13/datafusion:vortex-file-compressed 116523975 / 106627628 / +9.3% 326272191 / 313370942 / +4.1% 0.36 / 0.34 / +5.0%
tpch_q14/datafusion:vortex-file-compressed 189816902 / 185915963 / +2.1% 335317863 / 326856054 / +2.6% 0.57 / 0.57 / -0.5%
tpch_q15/datafusion:vortex-file-compressed 302102334 / 296496443 / +1.9% 697796029 / 514541025 / +35.6% 🔴 0.43 / 0.58 / -24.9%
tpch_q16/datafusion:vortex-file-compressed 154894163 / 133336808 / +16.2% 311900167 / 300081536 / +3.9% 0.50 / 0.44 / +11.8%
tpch_q17/datafusion:vortex-file-compressed 253881360 / 250546621 / +1.3% 460085299 / 429136323 / +7.2% 0.55 / 0.58 / -5.5%
tpch_q18/datafusion:vortex-file-compressed 224246155 / 240195189 / -6.6% 409033795 / 466717813 / -12.4% 0.55 / 0.51 / +6.5%
tpch_q19/datafusion:vortex-file-compressed 227996082 / 223332398 / +2.1% 426534345 / 401054585 / +6.4% 0.53 / 0.56 / -4.0%
tpch_q20/datafusion:vortex-file-compressed 268671070 / 253455178 / +6.0% 567030868 / 420951180 / +34.7% 🔴 0.47 / 0.60 / -21.3%
tpch_q21/datafusion:vortex-file-compressed 418092523 / 438838999 / -4.7% 645259560 / 732828785 / -11.9% 0.65 / 0.60 / +8.2%
tpch_q22/datafusion:vortex-file-compressed 172445101 / 157796575 / +9.3% 382556510 / 378470521 / +1.1% 0.45 / 0.42 / +8.1%
datafusion / parquet / ns (0.943x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 147473002 / 160893639 / -8.3% 474438645 / 477656305 / -0.7% 0.31 / 0.34 / -7.7%
tpch_q02/datafusion:parquet 274583126 / 283224545 / -3.1% 551237934 / 518342864 / +6.3% 0.50 / 0.55 / -8.8%
tpch_q03/datafusion:parquet 225905433 / 240972716 / -6.3% 639817908 / 642874880 / -0.5% 0.35 / 0.37 / -5.8%
tpch_q04/datafusion:parquet 147956212 / 290591746 / -49.1% 🟢 299318421 / 390782032 / -23.4% 0.49 / 0.74 / -33.5%
tpch_q05/datafusion:parquet 335347957 / 331069979 / +1.3% 500310230 / 498026437 / +0.5% 0.67 / 0.66 / +0.8%
tpch_q06/datafusion:parquet 106300464 / 108799011 / -2.3% 239400572 / 245916825 / -2.6% 0.44 / 0.44 / +0.4%
tpch_q07/datafusion:parquet 325031635 / 326678397 / -0.5% 543703202 / 449002978 / +21.1% 0.60 / 0.73 / -17.8%
tpch_q08/datafusion:parquet 383472407 / 398421423 / -3.8% 487965747 / 498590910 / -2.1% 0.79 / 0.80 / -1.7%
tpch_q09/datafusion:parquet 376396126 / 372817746 / +1.0% 512962378 / 519672148 / -1.3% 0.73 / 0.72 / +2.3%
tpch_q10/datafusion:parquet 295845916 / 290771087 / +1.7% 495518073 / 438077597 / +13.1% 0.60 / 0.66 / -10.0%
tpch_q11/datafusion:parquet 256184311 / 248573335 / +3.1% 354929492 / 386545032 / -8.2% 0.72 / 0.64 / +12.2%
tpch_q12/datafusion:parquet 157362274 / 158312075 / -0.6% 292635584 / 283576009 / +3.2% 0.54 / 0.56 / -3.7%
tpch_q13/datafusion:parquet 274920342 / 271934092 / +1.1% 428010853 / 454802346 / -5.9% 0.64 / 0.60 / +7.4%
tpch_q14/datafusion:parquet 153018654 / 156701057 / -2.3% 295905501 / 242600586 / +22.0% 0.52 / 0.65 / -19.9%
tpch_q15/datafusion:parquet 301462673 / 321289289 / -6.2% 571302820 / 463365168 / +23.3% 0.53 / 0.69 / -23.9%
tpch_q16/datafusion:parquet 93303891 / 102064398 / -8.6% 218582974 / 214176376 / +2.1% 0.43 / 0.48 / -10.4%
tpch_q17/datafusion:parquet 292690601 / 269963531 / +8.4% 455957433 / 384737839 / +18.5% 0.64 / 0.70 / -8.5%
tpch_q18/datafusion:parquet 303137266 / 315368072 / -3.9% 450073904 / 438983449 / +2.5% 0.67 / 0.72 / -6.2%
tpch_q19/datafusion:parquet 158609712 / 165415410 / -4.1% 329941971 / 305066336 / +8.2% 0.48 / 0.54 / -11.3%
tpch_q20/datafusion:parquet 228160077 / 269297459 / -15.3% 417811626 / 410205409 / +1.9% 0.55 / 0.66 / -16.8%
tpch_q21/datafusion:parquet 287693212 / 284891803 / +1.0% 566086389 / 448342791 / +26.3% 0.51 / 0.64 / -20.0%
tpch_q22/datafusion:parquet 140851846 / 156165651 / -9.8% 293058178 / 306092476 / -4.3% 0.48 / 0.51 / -5.8%
duckdb / vortex-file-compressed / ns (0.944x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 258053808 / 242576933 / +6.4% 285155778 / 248191398 / +14.9% 0.90 / 0.98 / -7.4%
tpch_q02/duckdb:vortex-file-compressed 394850266 / 399746901 / -1.2% 451620436 / 432574115 / +4.4% 0.87 / 0.92 / -5.4%
tpch_q03/duckdb:vortex-file-compressed 400316970 / 408139921 / -1.9% 407761812 / 445279875 / -8.4% 0.98 / 0.92 / +7.1%
tpch_q04/duckdb:vortex-file-compressed 323647972 / 300287133 / +7.8% 319750364 / 265471776 / +20.4% 1.01 / 1.13 / -10.5%
tpch_q05/duckdb:vortex-file-compressed 497122329 / 498871469 / -0.4% 588802003 / 598179582 / -1.6% 0.84 / 0.83 / +1.2%
tpch_q06/duckdb:vortex-file-compressed 191181765 / 147640908 / +29.5% 221577482 / 185412460 / +19.5% 0.86 / 0.80 / +8.4%
tpch_q07/duckdb:vortex-file-compressed 419316697 / 464160734 / -9.7% 478520187 / 499509474 / -4.2% 0.88 / 0.93 / -5.7%
tpch_q08/duckdb:vortex-file-compressed 589067027 / 603655169 / -2.4% 661678234 / 654992607 / +1.0% 0.89 / 0.92 / -3.4%
tpch_q09/duckdb:vortex-file-compressed 383823176 / 429862616 / -10.7% 426423719 / 463513032 / -8.0% 0.90 / 0.93 / -2.9%
tpch_q10/duckdb:vortex-file-compressed 500805079 / 556081010 / -9.9% 570199273 / 588793346 / -3.2% 0.88 / 0.94 / -7.0%
tpch_q11/duckdb:vortex-file-compressed 284119924 / 316860152 / -10.3% 295417755 / 309339752 / -4.5% 0.96 / 1.02 / -6.1%
tpch_q12/duckdb:vortex-file-compressed 241774422 / 260103561 / -7.0% 325381830 / 370870281 / -12.3% 0.74 / 0.70 / +5.9%
tpch_q13/duckdb:vortex-file-compressed 223146871 / 258887318 / -13.8% 275133283 / 205261457 / +34.0% 🔴 0.81 / 1.26 / -35.7%
tpch_q14/duckdb:vortex-file-compressed 225588293 / 220303505 / +2.4% 295365348 / 272140647 / +8.5% 0.76 / 0.81 / -5.7%
tpch_q15/duckdb:vortex-file-compressed 236076492 / 242509441 / -2.7% 261171188 / 280983375 / -7.1% 0.90 / 0.86 / +4.7%
tpch_q16/duckdb:vortex-file-compressed 200724258 / 212419567 / -5.5% 248552443 / 274668578 / -9.5% 0.81 / 0.77 / +4.4%
tpch_q17/duckdb:vortex-file-compressed 271836536 / 268487617 / +1.2% 358564057 / 320891586 / +11.7% 0.76 / 0.84 / -9.4%
tpch_q18/duckdb:vortex-file-compressed 353823412 / 336988542 / +5.0% 399533886 / 397837732 / +0.4% 0.89 / 0.85 / +4.5%
tpch_q19/duckdb:vortex-file-compressed 325652102 / 610735610 / -46.7% 🟢 321569322 / 339255633 / -5.2% 1.01 / 1.80 / -43.7%
tpch_q20/duckdb:vortex-file-compressed 316454900 / 429572715 / -26.3% 424477684 / 431952232 / -1.7% 0.75 / 0.99 / -25.0%
tpch_q21/duckdb:vortex-file-compressed 583856321 / 578033785 / +1.0% 673455195 / 970857916 / -30.6% 🟢 0.87 / 0.60 / +45.6%
tpch_q22/duckdb:vortex-file-compressed 233659805 / 242071604 / -3.5% 298141548 / 305429431 / -2.4% 0.78 / 0.79 / -1.1%
duckdb / parquet / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 187381571 / 190713046 / -1.7% 227460876 / 197906009 / +14.9% 0.82 / 0.96 / -14.5%
tpch_q02/duckdb:parquet 439924340 / 446758763 / -1.5% 488472495 / 459769284 / +6.2% 0.90 / 0.97 / -7.3%
tpch_q03/duckdb:parquet 323971459 / 354133080 / -8.5% 440801220 / 375826133 / +17.3% 0.73 / 0.94 / -22.0%
tpch_q04/duckdb:parquet 255498911 / 249123959 / +2.6% 313052893 / 293716436 / +6.6% 0.82 / 0.85 / -3.8%
tpch_q05/duckdb:parquet 496683956 / 532981089 / -6.8% 582898622 / 643402723 / -9.4% 0.85 / 0.83 / +2.9%
tpch_q06/duckdb:parquet 161837110 / 349026244 / -53.6% 🟢 162444998 / 315233105 / -48.5% 🟢 1.00 / 1.11 / -10.0%
tpch_q07/duckdb:parquet 395116407 / 423386232 / -6.7% 437363447 / 461722193 / -5.3% 0.90 / 0.92 / -1.5%
tpch_q08/duckdb:parquet 600111851 / 554469756 / +8.2% 666507027 / 643357467 / +3.6% 0.90 / 0.86 / +4.5%
tpch_q09/duckdb:parquet 559533359 / 543951388 / +2.9% 571911255 / 596356255 / -4.1% 0.98 / 0.91 / +7.3%
tpch_q10/duckdb:parquet 613882815 / 544369504 / +12.8% 934028789 / 585943370 / +59.4% 🔴 0.66 / 0.93 / -29.3%
tpch_q11/duckdb:parquet 297118520 / 305296856 / -2.7% 301458815 / 289924264 / +4.0% 0.99 / 1.05 / -6.4%
tpch_q12/duckdb:parquet 219623228 / 228638503 / -3.9% 255252711 / 269427709 / -5.3% 0.86 / 0.85 / +1.4%
tpch_q13/duckdb:parquet 390740162 / 355878945 / +9.8% 440059203 / 502732834 / -12.5% 0.89 / 0.71 / +25.4%
tpch_q14/duckdb:parquet 242168608 / 253263272 / -4.4% 296332996 / 348389252 / -14.9% 0.82 / 0.73 / +12.4%
tpch_q15/duckdb:parquet 200007302 / 204745510 / -2.3% 217222818 / 269302806 / -19.3% 0.92 / 0.76 / +21.1%
tpch_q16/duckdb:parquet 273984506 / 266729619 / +2.7% 302705919 / 275134499 / +10.0% 0.91 / 0.97 / -6.6%
tpch_q17/duckdb:parquet 322266743 / 256545030 / +25.6% 443604900 / 294925434 / +50.4% 🔴 0.73 / 0.87 / -16.5%
tpch_q18/duckdb:parquet 580285627 / 331587754 / +75.0% 🔴 401008615 / 320878845 / +25.0% 1.45 / 1.03 / +40.0%
tpch_q19/duckdb:parquet 263136273 / 243894413 / +7.9% 291854097 / 347315464 / -16.0% 0.90 / 0.70 / +28.4%
tpch_q20/duckdb:parquet 442445396 / 452122499 / -2.1% 452929739 / 496751656 / -8.8% 0.98 / 0.91 / +7.3%
tpch_q21/duckdb:parquet 439436427 / 443206537 / -0.9% 518106133 / 452624014 / +14.5% 0.85 / 0.98 / -13.4%
tpch_q22/duckdb:parquet 292328307 / 291858097 / +0.2% 289783448 / 333194595 / -13.0% 1.01 / 0.88 / +15.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 224e1354 vs base d81bd4ce
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.018x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35915098 / 35687064 / +0.6% 62505720 / 59727902 / +4.7% 0.57 / 0.60 / -3.8%
tpcds_q02/datafusion:vortex-file-compressed 49912179 / 51071520 / -2.3% 72838988 / 73866370 / -1.4% 0.69 / 0.69 / -0.9%
tpcds_q03/datafusion:vortex-file-compressed 20221584 / 20122918 / +0.5% 48575255 / 45522240 / +6.7% 0.42 / 0.44 / -5.8%
tpcds_q04/datafusion:vortex-file-compressed 293985710 / 294488276 / -0.2% 349878625 / 348826657 / +0.3% 0.84 / 0.84 / -0.5%
tpcds_q05/datafusion:vortex-file-compressed 71652805 / 72186978 / -0.7% 102569256 / 98074801 / +4.6% 0.70 / 0.74 / -5.1%
tpcds_q06/datafusion:vortex-file-compressed 42412100 / 42034562 / +0.9% 67844775 / 71314146 / -4.9% 0.63 / 0.59 / +6.1%
tpcds_q07/datafusion:vortex-file-compressed 42216546 / 41936610 / +0.7% 79076109 / 81598206 / -3.1% 0.53 / 0.51 / +3.9%
tpcds_q08/datafusion:vortex-file-compressed 28594045 / 29293898 / -2.4% 57658458 / 54786660 / +5.2% 0.50 / 0.53 / -7.3%
tpcds_q09/datafusion:vortex-file-compressed 43373357 / 43492521 / -0.3% 78253601 / 75585378 / +3.5% 0.55 / 0.58 / -3.7%
tpcds_q10/datafusion:vortex-file-compressed 38449452 / 37575747 / +2.3% 63035748 / 65187408 / -3.3% 0.61 / 0.58 / +5.8%
tpcds_q11/datafusion:vortex-file-compressed 174036761 / 174078024 / -0.0% 217795753 / 212796053 / +2.3% 0.80 / 0.82 / -2.3%
tpcds_q12/datafusion:vortex-file-compressed 18054068 / 17602241 / +2.6% 36743897 / 36804611 / -0.2% 0.49 / 0.48 / +2.7%
tpcds_q13/datafusion:vortex-file-compressed 38480480 / 37777492 / +1.9% 81063647 / 82427050 / -1.7% 0.47 / 0.46 / +3.6%
tpcds_q14/datafusion:vortex-file-compressed 236097212 / 234215656 / +0.8% 278578808 / 269416137 / +3.4% 0.85 / 0.87 / -2.5%
tpcds_q15/datafusion:vortex-file-compressed 40619520 / 40700370 / -0.2% 60609503 / 59132696 / +2.5% 0.67 / 0.69 / -2.6%
tpcds_q16/datafusion:vortex-file-compressed 23888550 / 24140928 / -1.0% 41508470 / 41799402 / -0.7% 0.58 / 0.58 / -0.4%
tpcds_q17/datafusion:vortex-file-compressed 64140400 / 64613948 / -0.7% 97980471 / 96825489 / +1.2% 0.65 / 0.67 / -1.9%
tpcds_q18/datafusion:vortex-file-compressed 68740504 / 68135038 / +0.9% 97121522 / 96678626 / +0.5% 0.71 / 0.70 / +0.4%
tpcds_q19/datafusion:vortex-file-compressed 21966662 / 23065796 / -4.8% 54636351 / 53499164 / +2.1% 0.40 / 0.43 / -6.7%
tpcds_q20/datafusion:vortex-file-compressed 22960804 / 23434874 / -2.0% 39655468 / 39490521 / +0.4% 0.58 / 0.59 / -2.4%
tpcds_q21/datafusion:vortex-file-compressed 47488154 / 46991756 / +1.1% 64414296 / 77561336 / -17.0% 🟢 0.74 / 0.61 / +21.7%
tpcds_q22/datafusion:vortex-file-compressed 436697228 / 436213066 / +0.1% 463219309 / 456238601 / +1.5% 0.94 / 0.96 / -1.4%
tpcds_q23/datafusion:vortex-file-compressed 296210250 / 295445526 / +0.3% 347959071 / 350238393 / -0.7% 0.85 / 0.84 / +0.9%
tpcds_q24/datafusion:vortex-file-compressed 122056199 / 118209681 / +3.3% 151566427 / 163532003 / -7.3% 0.81 / 0.72 / +11.4%
tpcds_q25/datafusion:vortex-file-compressed 63276766 / 58404091 / +8.3% 93291744 / 100148037 / -6.8% 0.68 / 0.58 / +16.3%
tpcds_q26/datafusion:vortex-file-compressed 36515547 / 37624965 / -2.9% 60737434 / 59590326 / +1.9% 0.60 / 0.63 / -4.8%
tpcds_q27/datafusion:vortex-file-compressed 70159918 / 71638275 / -2.1% 105131139 / 105343615 / -0.2% 0.67 / 0.68 / -1.9%
tpcds_q28/datafusion:vortex-file-compressed 42917825 / 42371952 / +1.3% 80401256 / 87727130 / -8.4% 0.53 / 0.48 / +10.5%
tpcds_q29/datafusion:vortex-file-compressed 66509576 / 66811756 / -0.5% 103284167 / 102564955 / +0.7% 0.64 / 0.65 / -1.1%
tpcds_q30/datafusion:vortex-file-compressed 52274888 / 51119143 / +2.3% 80437051 / 75743723 / +6.2% 0.65 / 0.67 / -3.7%
tpcds_q31/datafusion:vortex-file-compressed 199470509 / 200218175 / -0.4% 230419721 / 233152597 / -1.2% 0.87 / 0.86 / +0.8%
tpcds_q32/datafusion:vortex-file-compressed 14975789 / 15152590 / -1.2% 30859814 / 31036644 / -0.6% 0.49 / 0.49 / -0.6%
tpcds_q33/datafusion:vortex-file-compressed 33817855 / 33166894 / +2.0% 68228027 / 66312007 / +2.9% 0.50 / 0.50 / -0.9%
tpcds_q34/datafusion:vortex-file-compressed 40514472 / 40800963 / -0.7% 67440252 / 69572930 / -3.1% 0.60 / 0.59 / +2.4%
tpcds_q35/datafusion:vortex-file-compressed 92647833 / 92953752 / -0.3% 121634885 / 118717623 / +2.5% 0.76 / 0.78 / -2.7%
tpcds_q36/datafusion:vortex-file-compressed 66028476 / 66188984 / -0.2% 100804306 / 100548488 / +0.3% 0.66 / 0.66 / -0.5%
tpcds_q37/datafusion:vortex-file-compressed 23163836 / 28659362 / -19.2% 🟢 42369304 / 39142184 / +8.2% 0.55 / 0.73 / -25.3%
tpcds_q38/datafusion:vortex-file-compressed 80150213 / 79029305 / +1.4% 109125103 / 106760595 / +2.2% 0.73 / 0.74 / -0.8%
tpcds_q39/datafusion:vortex-file-compressed 887521903 / 884718834 / +0.3% 900020394 / 908976999 / -1.0% 0.99 / 0.97 / +1.3%
tpcds_q40/datafusion:vortex-file-compressed 28333540 / 28530688 / -0.7% 51510760 / 48600430 / +6.0% 0.55 / 0.59 / -6.3%
tpcds_q41/datafusion:vortex-file-compressed 19048456 / 19016106 / +0.2% 30332300 / 31973918 / -5.1% 0.63 / 0.59 / +5.6%
tpcds_q42/datafusion:vortex-file-compressed 13660178 / 14446512 / -5.4% 38643707 / 37086223 / +4.2% 0.35 / 0.39 / -9.3%
tpcds_q43/datafusion:vortex-file-compressed 17391868 / 17062690 / +1.9% 40457333 / 37710185 / +7.3% 0.43 / 0.45 / -5.0%
tpcds_q44/datafusion:vortex-file-compressed 42698856 / 43352470 / -1.5% 75204988 / 72038897 / +4.4% 0.57 / 0.60 / -5.7%
tpcds_q45/datafusion:vortex-file-compressed 43507826 / 44364085 / -1.9% 65607789 / 59556323 / +10.2% 🔴 0.66 / 0.74 / -11.0%
tpcds_q46/datafusion:vortex-file-compressed 71448371 / 70145033 / +1.9% 101841229 / 104029608 / -2.1% 0.70 / 0.67 / +4.0%
tpcds_q47/datafusion:vortex-file-compressed 175544136 / 173539465 / +1.2% 220897296 / 216035492 / +2.3% 0.79 / 0.80 / -1.1%
tpcds_q48/datafusion:vortex-file-compressed 35527606 / 35623834 / -0.3% 71043057 / 70644306 / +0.6% 0.50 / 0.50 / -0.8%
tpcds_q49/datafusion:vortex-file-compressed 78211190 / 77255316 / +1.2% 117567134 / 116737222 / +0.7% 0.67 / 0.66 / +0.5%
tpcds_q50/datafusion:vortex-file-compressed 56362864 / 55980736 / +0.7% 83714824 / 86230008 / -2.9% 0.67 / 0.65 / +3.7%
tpcds_q51/datafusion:vortex-file-compressed 245363803 / 247038673 / -0.7% 277750981 / 280421401 / -1.0% 0.88 / 0.88 / +0.3%
tpcds_q52/datafusion:vortex-file-compressed 14188743 / 14714848 / -3.6% 39610565 / 38389598 / +3.2% 0.36 / 0.38 / -6.5%
tpcds_q53/datafusion:vortex-file-compressed 22434262 / 22346742 / +0.4% 53676343 / 49846122 / +7.7% 0.42 / 0.45 / -6.8%
tpcds_q54/datafusion:vortex-file-compressed 60206040 / 57426460 / +4.8% 91890274 / 92580497 / -0.7% 0.66 / 0.62 / +5.6%
tpcds_q55/datafusion:vortex-file-compressed 14125684 / 13973340 / +1.1% 37809412 / 38808883 / -2.6% 0.37 / 0.36 / +3.8%
tpcds_q56/datafusion:vortex-file-compressed 33154600 / 33761524 / -1.8% 64194484 / 63265036 / +1.5% 0.52 / 0.53 / -3.2%
tpcds_q57/datafusion:vortex-file-compressed 130594810 / 131113802 / -0.4% 161266013 / 161410678 / -0.1% 0.81 / 0.81 / -0.3%
tpcds_q58/datafusion:vortex-file-compressed 48303531 / 48391922 / -0.2% 85209319 / 84580372 / +0.7% 0.57 / 0.57 / -0.9%
tpcds_q59/datafusion:vortex-file-compressed 54285658 / 55056536 / -1.4% 80477635 / 81170032 / -0.9% 0.67 / 0.68 / -0.6%
tpcds_q60/datafusion:vortex-file-compressed 34256179 / 34937748 / -2.0% 64138594 / 63120098 / +1.6% 0.53 / 0.55 / -3.5%
tpcds_q61/datafusion:vortex-file-compressed 46907730 / 45353798 / +3.4% 72594656 / 72493548 / +0.1% 0.65 / 0.63 / +3.3%
tpcds_q62/datafusion:vortex-file-compressed 19224158 / 18948984 / +1.5% 41359428 / 40635590 / +1.8% 0.46 / 0.47 / -0.3%
tpcds_q63/datafusion:vortex-file-compressed 22672818 / 22886570 / -0.9% 51460100 / 51245739 / +0.4% 0.44 / 0.45 / -1.3%
tpcds_q64/datafusion:vortex-file-compressed 335944661 / 331770842 / +1.3% 408120449 / 405661127 / +0.6% 0.82 / 0.82 / +0.6%
tpcds_q65/datafusion:vortex-file-compressed 75387586 / 74188341 / +1.6% 111179927 / 106874319 / +4.0% 0.68 / 0.69 / -2.3%
tpcds_q66/datafusion:vortex-file-compressed 52446502 / 51726748 / +1.4% 75793053 / 75217399 / +0.8% 0.69 / 0.69 / +0.6%
tpcds_q67/datafusion:vortex-file-compressed 422085168 / 425404384 / -0.8% 504952351 / 518487417 / -2.6% 0.84 / 0.82 / +1.9%
tpcds_q68/datafusion:vortex-file-compressed 66475648 / 67065476 / -0.9% 102519130 / 99957636 / +2.6% 0.65 / 0.67 / -3.4%
tpcds_q69/datafusion:vortex-file-compressed 35708050 / 36411572 / -1.9% 60648572 / 61245093 / -1.0% 0.59 / 0.59 / -1.0%
tpcds_q70/datafusion:vortex-file-compressed 194149324 / 195234258 / -0.6% 226719263 / 223353634 / +1.5% 0.86 / 0.87 / -2.0%
tpcds_q71/datafusion:vortex-file-compressed 25501368 / 24846620 / +2.6% 59916170 / 57873035 / +3.5% 0.43 / 0.43 / -0.9%
tpcds_q72/datafusion:vortex-file-compressed 1568792668 / 1613070819 / -2.7% 1638887789 / 1672817704 / -2.0% 0.96 / 0.96 / -0.7%
tpcds_q73/datafusion:vortex-file-compressed 37356436 / 37798150 / -1.2% 65906303 / 63097488 / +4.5% 0.57 / 0.60 / -5.4%
tpcds_q74/datafusion:vortex-file-compressed 134475780 / 134609600 / -0.1% 172407610 / 169107950 / +2.0% 0.78 / 0.80 / -2.0%
tpcds_q75/datafusion:vortex-file-compressed 154879992 / 157283038 / -1.5% 202034064 / 199539779 / +1.3% 0.77 / 0.79 / -2.7%
tpcds_q76/datafusion:vortex-file-compressed 33847728 / 34141944 / -0.9% 77705383 / 76790189 / +1.2% 0.44 / 0.44 / -2.0%
tpcds_q77/datafusion:vortex-file-compressed 53707762 / 54578544 / -1.6% 89773157 / 87907886 / +2.1% 0.60 / 0.62 / -3.6%
tpcds_q78/datafusion:vortex-file-compressed 141092970 / 139945221 / +0.8% 192135638 / 191111158 / +0.5% 0.73 / 0.73 / +0.3%
tpcds_q79/datafusion:vortex-file-compressed 53957416 / 54551104 / -1.1% 84270214 / 83695427 / +0.7% 0.64 / 0.65 / -1.8%
tpcds_q80/datafusion:vortex-file-compressed 80696490 / 81251883 / -0.7% 126047194 / 126092347 / -0.0% 0.64 / 0.64 / -0.6%
tpcds_q81/datafusion:vortex-file-compressed 56139924 / 57217203 / -1.9% 82587554 / 83290839 / -0.8% 0.68 / 0.69 / -1.0%
tpcds_q82/datafusion:vortex-file-compressed 29832454 / 29527786 / +1.0% 45835824 / 46344112 / -1.1% 0.65 / 0.64 / +2.2%
tpcds_q83/datafusion:vortex-file-compressed 42138440 / 42234106 / -0.2% 65961764 / 65316165 / +1.0% 0.64 / 0.65 / -1.2%
tpcds_q84/datafusion:vortex-file-compressed 12831743 / 12318387 / +4.2% 30520381 / 31461444 / -3.0% 0.42 / 0.39 / +7.4%
tpcds_q85/datafusion:vortex-file-compressed 60300592 / 60351388 / -0.1% 88587730 / 89165946 / -0.6% 0.68 / 0.68 / +0.6%
tpcds_q86/datafusion:vortex-file-compressed 18504797 / 18635084 / -0.7% 40326026 / 40794939 / -1.1% 0.46 / 0.46 / +0.5%
tpcds_q87/datafusion:vortex-file-compressed 78468433 / 77726270 / +1.0% 111729637 / 106793331 / +4.6% 0.70 / 0.73 / -3.5%
tpcds_q88/datafusion:vortex-file-compressed 53559932 / 54134854 / -1.1% 90194127 / 91920123 / -1.9% 0.59 / 0.59 / +0.8%
tpcds_q89/datafusion:vortex-file-compressed 26897318 / 27705445 / -2.9% 56112195 / 52989044 / +5.9% 0.48 / 0.52 / -8.3%
tpcds_q90/datafusion:vortex-file-compressed 12706754 / 12876262 / -1.3% 29620746 / 31193191 / -5.0% 0.43 / 0.41 / +3.9%
tpcds_q91/datafusion:vortex-file-compressed 19261008 / 19841934 / -2.9% 42289798 / 40517298 / +4.4% 0.46 / 0.49 / -7.0%
tpcds_q92/datafusion:vortex-file-compressed 15574394 / 15586140 / -0.1% 35447926 / 35022452 / +1.2% 0.44 / 0.45 / -1.3%
tpcds_q93/datafusion:vortex-file-compressed 55221198 / 54479092 / +1.4% 90811639 / 91110634 / -0.3% 0.61 / 0.60 / +1.7%
tpcds_q94/datafusion:vortex-file-compressed 21586316 / 21721248 / -0.6% 45043164 / 43008447 / +4.7% 0.48 / 0.51 / -5.1%
tpcds_q95/datafusion:vortex-file-compressed 97594976 / 96025348 / +1.6% 120889746 / 125556657 / -3.7% 0.81 / 0.76 / +5.6%
tpcds_q96/datafusion:vortex-file-compressed 11329076 / 11669502 / -2.9% 29817963 / 29013229 / +2.8% 0.38 / 0.40 / -5.5%
tpcds_q97/datafusion:vortex-file-compressed 39884665 / 39740562 / +0.4% 65601212 / 64433312 / +1.8% 0.61 / 0.62 / -1.4%
tpcds_q98/datafusion:vortex-file-compressed 20648013 / 20279683 / +1.8% 47436578 / 49580667 / -4.3% 0.44 / 0.41 / +6.4%
tpcds_q99/datafusion:vortex-file-compressed 29355152 / 28990486 / +1.3% 48076845 / 46237709 / +4.0% 0.61 / 0.63 / -2.6%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59539631 / 59467470 / +0.1% 81959706 / 78629990 / +4.2% 0.73 / 0.76 / -3.9%
tpcds_q02/datafusion:parquet 68852164 / 68841136 / +0.0% 92302147 / 92247774 / +0.1% 0.75 / 0.75 / -0.0%
tpcds_q03/datafusion:parquet 29094076 / 28412717 / +2.4% 51539808 / 51484914 / +0.1% 0.56 / 0.55 / +2.3%
tpcds_q04/datafusion:parquet 644380792 / 642280600 / +0.3% 714860568 / 713442164 / +0.2% 0.90 / 0.90 / +0.1%
tpcds_q05/datafusion:parquet 80821424 / 80587203 / +0.3% 111516764 / 114099796 / -2.3% 0.72 / 0.71 / +2.6%
tpcds_q06/datafusion:parquet 90755206 / 91299202 / -0.6% 117904465 / 111123421 / +6.1% 0.77 / 0.82 / -6.3%
tpcds_q07/datafusion:parquet 101405512 / 100516129 / +0.9% 138390146 / 140439595 / -1.5% 0.73 / 0.72 / +2.4%
tpcds_q08/datafusion:parquet 49409664 / 47906314 / +3.1% 71300310 / 77683939 / -8.2% 0.69 / 0.62 / +12.4%
tpcds_q09/datafusion:parquet 78076130 / 75858005 / +2.9% 105197727 / 103150303 / +2.0% 0.74 / 0.74 / +0.9%
tpcds_q10/datafusion:parquet 58231141 / 59911058 / -2.8% 78713741 / 85891230 / -8.4% 0.74 / 0.70 / +6.1%
tpcds_q11/datafusion:parquet 415601352 / 410249982 / +1.3% 454397300 / 453298906 / +0.2% 0.91 / 0.91 / +1.1%
tpcds_q12/datafusion:parquet 39741938 / 40180548 / -1.1% 59207938 / 57554919 / +2.9% 0.67 / 0.70 / -3.9%
tpcds_q13/datafusion:parquet 85203063 / 84877392 / +0.4% 137425060 / 129583250 / +6.1% 0.62 / 0.66 / -5.3%
tpcds_q14/datafusion:parquet 376685630 / 390641226 / -3.6% 416602794 / 422522225 / -1.4% 0.90 / 0.92 / -2.2%
tpcds_q15/datafusion:parquet 50801932 / 51004075 / -0.4% 73308658 / 70096169 / +4.6% 0.69 / 0.73 / -4.8%
tpcds_q16/datafusion:parquet 45606630 / 45319756 / +0.6% 66492848 / 62344760 / +6.7% 0.69 / 0.73 / -5.6%
tpcds_q17/datafusion:parquet 135899874 / 140124091 / -3.0% 174464472 / 173293414 / +0.7% 0.78 / 0.81 / -3.7%
tpcds_q18/datafusion:parquet 109570400 / 110049167 / -0.4% 147621693 / 141644863 / +4.2% 0.74 / 0.78 / -4.5%
tpcds_q19/datafusion:parquet 47822928 / 47382432 / +0.9% 78985541 / 74454407 / +6.1% 0.61 / 0.64 / -4.9%
tpcds_q20/datafusion:parquet 41722218 / 41140804 / +1.4% 55805532 / 53422774 / +4.5% 0.75 / 0.77 / -2.9%
tpcds_q21/datafusion:parquet 60753374 / 60585280 / +0.3% 75246367 / 72359261 / +4.0% 0.81 / 0.84 / -3.6%
tpcds_q22/datafusion:parquet 463748536 / 464956066 / -0.3% 478879574 / 480116418 / -0.3% 0.97 / 0.97 / -0.0%
tpcds_q23/datafusion:parquet 367696778 / 362030230 / +1.6% 409422853 / 423236940 / -3.3% 0.90 / 0.86 / +5.0%
tpcds_q24/datafusion:parquet 242214156 / 238522424 / +1.5% 282854246 / 280988941 / +0.7% 0.86 / 0.85 / +0.9%
tpcds_q25/datafusion:parquet 145967660 / 145856299 / +0.1% 190499099 / 180939258 / +5.3% 0.77 / 0.81 / -4.9%
tpcds_q26/datafusion:parquet 54239839 / 54371764 / -0.2% 80405504 / 78855738 / +2.0% 0.67 / 0.69 / -2.2%
tpcds_q27/datafusion:parquet 211130247 / 208670172 / +1.2% 232371762 / 244008894 / -4.8% 0.91 / 0.86 / +6.2%
tpcds_q28/datafusion:parquet 87864056 / 88438947 / -0.7% 120937241 / 115489704 / +4.7% 0.73 / 0.77 / -5.1%
tpcds_q29/datafusion:parquet 142792404 / 143202262 / -0.3% 177970053 / 175795941 / +1.2% 0.80 / 0.81 / -1.5%
tpcds_q30/datafusion:parquet 98062333 / 99031156 / -1.0% 121379013 / 119707182 / +1.4% 0.81 / 0.83 / -2.3%
tpcds_q31/datafusion:parquet 319177436 / 318865238 / +0.1% 347977011 / 342248409 / +1.7% 0.92 / 0.93 / -1.5%
tpcds_q32/datafusion:parquet 29698145 / 29268206 / +1.5% 44413112 / 43049951 / +3.2% 0.67 / 0.68 / -1.6%
tpcds_q33/datafusion:parquet 52028036 / 54279188 / -4.1% 78800281 / 73291711 / +7.5% 0.66 / 0.74 / -10.8%
tpcds_q34/datafusion:parquet 63882808 / 62880984 / +1.6% 84946756 / 85677254 / -0.9% 0.75 / 0.73 / +2.5%
tpcds_q35/datafusion:parquet 124525756 / 124024507 / +0.4% 151243854 / 152510309 / -0.8% 0.82 / 0.81 / +1.2%
tpcds_q36/datafusion:parquet 97899028 / 96065436 / +1.9% 132331216 / 130472892 / +1.4% 0.74 / 0.74 / +0.5%
tpcds_q37/datafusion:parquet 49412937 / 50326967 / -1.8% 64647273 / 62106792 / +4.1% 0.76 / 0.81 / -5.7%
tpcds_q38/datafusion:parquet 122966946 / 121809162 / +1.0% 144715357 / 148143097 / -2.3% 0.85 / 0.82 / +3.3%
tpcds_q39/datafusion:parquet 847617155 / 850365260 / -0.3% 861965129 / 858244795 / +0.4% 0.98 / 0.99 / -0.8%
tpcds_q40/datafusion:parquet 34547178 / 34460206 / +0.3% 56501002 / 55082629 / +2.6% 0.61 / 0.63 / -2.3%
tpcds_q41/datafusion:parquet 31724318 / 32074791 / -1.1% 42913945 / 42604832 / +0.7% 0.74 / 0.75 / -1.8%
tpcds_q42/datafusion:parquet 25931762 / 26668796 / -2.8% 47034850 / 44471155 / +5.8% 0.55 / 0.60 / -8.1%
tpcds_q43/datafusion:parquet 27354413 / 27798290 / -1.6% 49365886 / 48667153 / +1.4% 0.55 / 0.57 / -3.0%
tpcds_q44/datafusion:parquet 65738758 / 66005414 / -0.4% 91572512 / 85489645 / +7.1% 0.72 / 0.77 / -7.0%
tpcds_q45/datafusion:parquet 64507694 / 66367192 / -2.8% 88327817 / 87700095 / +0.7% 0.73 / 0.76 / -3.5%
tpcds_q46/datafusion:parquet 106354121 / 108262468 / -1.8% 150058409 / 147281576 / +1.9% 0.71 / 0.74 / -3.6%
tpcds_q47/datafusion:parquet 236502966 / 235616338 / +0.4% 278458408 / 274771942 / +1.3% 0.85 / 0.86 / -1.0%
tpcds_q48/datafusion:parquet 79264406 / 79003310 / +0.3% 106019878 / 104369134 / +1.6% 0.75 / 0.76 / -1.2%
tpcds_q49/datafusion:parquet 113752170 / 117557337 / -3.2% 162113496 / 168445239 / -3.8% 0.70 / 0.70 / +0.5%
tpcds_q50/datafusion:parquet 91698802 / 91455979 / +0.3% 120989807 / 121449330 / -0.4% 0.76 / 0.75 / +0.6%
tpcds_q51/datafusion:parquet 256860880 / 257462208 / -0.2% 281929507 / 275612309 / +2.3% 0.91 / 0.93 / -2.5%
tpcds_q52/datafusion:parquet 27152914 / 26582131 / +2.1% 46849848 / 46713825 / +0.3% 0.58 / 0.57 / +1.9%
tpcds_q53/datafusion:parquet 37421412 / 35857856 / +4.4% 62009148 / 60285453 / +2.9% 0.60 / 0.59 / +1.5%
tpcds_q54/datafusion:parquet 85552785 / 84979193 / +0.7% 107733153 / 106622915 / +1.0% 0.79 / 0.80 / -0.4%
tpcds_q55/datafusion:parquet 26484395 / 25716791 / +3.0% 47467581 / 47255907 / +0.4% 0.56 / 0.54 / +2.5%
tpcds_q56/datafusion:parquet 52675001 / 52634930 / +0.1% 75481461 / 72550483 / +4.0% 0.70 / 0.73 / -3.8%
tpcds_q57/datafusion:parquet 170208260 / 171481192 / -0.7% 191831389 / 193556759 / -0.9% 0.89 / 0.89 / +0.2%
tpcds_q58/datafusion:parquet 96936312 / 97417717 / -0.5% 126419145 / 116545953 / +8.5% 0.77 / 0.84 / -8.3%
tpcds_q59/datafusion:parquet 103721454 / 105187850 / -1.4% 131342895 / 128553486 / +2.2% 0.79 / 0.82 / -3.5%
tpcds_q60/datafusion:parquet 54534869 / 53716710 / +1.5% 75250715 / 72468178 / +3.8% 0.72 / 0.74 / -2.2%
tpcds_q61/datafusion:parquet 78359889 / 74726424 / +4.9% 102078926 / 100897235 / +1.2% 0.77 / 0.74 / +3.6%
tpcds_q62/datafusion:parquet 27533125 / 27394960 / +0.5% 45112536 / 44704350 / +0.9% 0.61 / 0.61 / -0.4%
tpcds_q63/datafusion:parquet 36852250 / 36109236 / +2.1% 57883203 / 58190337 / -0.5% 0.64 / 0.62 / +2.6%
tpcds_q64/datafusion:parquet 661658144 / 658028547 / +0.6% 747227227 / 727112413 / +2.8% 0.89 / 0.90 / -2.2%
tpcds_q65/datafusion:parquet 102190610 / 100883629 / +1.3% 133086780 / 133391313 / -0.2% 0.77 / 0.76 / +1.5%
tpcds_q66/datafusion:parquet 76400518 / 77524761 / -1.5% 104129610 / 104064088 / +0.1% 0.73 / 0.74 / -1.5%
tpcds_q67/datafusion:parquet 436554205 / 432898548 / +0.8% 497197073 / 500774321 / -0.7% 0.88 / 0.86 / +1.6%
tpcds_q68/datafusion:parquet 109787641 / 107972369 / +1.7% 160296998 / 153393827 / +4.5% 0.68 / 0.70 / -2.7%
tpcds_q69/datafusion:parquet 58795778 / 59031088 / -0.4% 75749782 / 81368763 / -6.9% 0.78 / 0.73 / +7.0%
tpcds_q70/datafusion:parquet 210735488 / 211356872 / -0.3% 243833581 / 243628971 / +0.1% 0.86 / 0.87 / -0.4%
tpcds_q71/datafusion:parquet 38665733 / 39988372 / -3.3% 63801940 / 63580905 / +0.3% 0.61 / 0.63 / -3.6%
tpcds_q72/datafusion:parquet 1762939254 / 1766291258 / -0.2% 1972155971 / 1717685799 / +14.8% 🔴 0.89 / 1.03 / -13.1%
tpcds_q73/datafusion:parquet 62202106 / 62604856 / -0.6% 88034851 / 85382876 / +3.1% 0.71 / 0.73 / -3.6%
tpcds_q74/datafusion:parquet 293871397 / 293543952 / +0.1% 324220876 / 333014708 / -2.6% 0.91 / 0.88 / +2.8%
tpcds_q75/datafusion:parquet 195143511 / 195570109 / -0.2% 238289677 / 227532670 / +4.7% 0.82 / 0.86 / -4.7%
tpcds_q76/datafusion:parquet 48992263 / 50790492 / -3.5% 80513022 / 80279383 / +0.3% 0.61 / 0.63 / -3.8%
tpcds_q77/datafusion:parquet 72667558 / 71696114 / +1.4% 100754413 / 102466534 / -1.7% 0.72 / 0.70 / +3.1%
tpcds_q78/datafusion:parquet 211449806 / 210078458 / +0.7% 268674995 / 262635746 / +2.3% 0.79 / 0.80 / -1.6%
tpcds_q79/datafusion:parquet 78045362 / 78772706 / -0.9% 113173758 / 113848428 / -0.6% 0.69 / 0.69 / -0.3%
tpcds_q80/datafusion:parquet 145935082 / 143215239 / +1.9% 186740612 / 198385628 / -5.9% 0.78 / 0.72 / +8.3%
tpcds_q81/datafusion:parquet 108382682 / 108666647 / -0.3% 129211102 / 126675306 / +2.0% 0.84 / 0.86 / -2.2%
tpcds_q82/datafusion:parquet 54458974 / 54589676 / -0.2% 73315793 / 72577165 / +1.0% 0.74 / 0.75 / -1.2%
tpcds_q83/datafusion:parquet 66395451 / 66004765 / +0.6% 82875558 / 80766410 / +2.6% 0.80 / 0.82 / -2.0%
tpcds_q84/datafusion:parquet 36046756 / 35067368 / +2.8% 50205290 / 49217980 / +2.0% 0.72 / 0.71 / +0.8%
tpcds_q85/datafusion:parquet 105358533 / 106118258 / -0.7% 132485989 / 126965208 / +4.3% 0.80 / 0.84 / -4.9%
tpcds_q86/datafusion:parquet 21904948 / 21856744 / +0.2% 39729467 / 38801034 / +2.4% 0.55 / 0.56 / -2.1%
tpcds_q87/datafusion:parquet 120460828 / 121427887 / -0.8% 144525425 / 146352765 / -1.2% 0.83 / 0.83 / +0.5%
tpcds_q88/datafusion:parquet 86584658 / 85112720 / +1.7% 107378700 / 111247316 / -3.5% 0.81 / 0.77 / +5.4%
tpcds_q89/datafusion:parquet 39053360 / 38253917 / +2.1% 61394753 / 64696968 / -5.1% 0.64 / 0.59 / +7.6%
tpcds_q90/datafusion:parquet 17649307 / 17095194 / +3.2% 35575562 / 32500458 / +9.5% 0.50 / 0.53 / -5.7%
tpcds_q91/datafusion:parquet 43267523 / 41649029 / +3.9% 59201977 / 57973405 / +2.1% 0.73 / 0.72 / +1.7%
tpcds_q92/datafusion:parquet 28659188 / 28701521 / -0.1% 46885483 / 45914012 / +2.1% 0.61 / 0.63 / -2.2%
tpcds_q93/datafusion:parquet 63191400 / 61105564 / +3.4% 92628441 / 86368626 / +7.2% 0.68 / 0.71 / -3.6%
tpcds_q94/datafusion:parquet 38168026 / 38133748 / +0.1% 60701554 / 57944474 / +4.8% 0.63 / 0.66 / -4.5%
tpcds_q95/datafusion:parquet 128611874 / 129222804 / -0.5% 149044404 / 153739120 / -3.1% 0.86 / 0.84 / +2.7%
tpcds_q96/datafusion:parquet 20402765 / 21737938 / -6.1% 37419904 / 38315607 / -2.3% 0.55 / 0.57 / -3.9%
tpcds_q97/datafusion:parquet 54925300 / 54900939 / +0.0% 78802862 / 80044710 / -1.6% 0.70 / 0.69 / +1.6%
tpcds_q98/datafusion:parquet 61243804 / 62068014 / -1.3% 86228264 / 84935164 / +1.5% 0.71 / 0.73 / -2.8%
tpcds_q99/datafusion:parquet 42752534 / 42547334 / +0.5% 57945140 / 57947364 / -0.0% 0.74 / 0.73 / +0.5%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 33151268 / 32666622 / +1.5% 45289732 / 44442032 / +1.9% 0.73 / 0.74 / -0.4%
tpcds_q02/duckdb:vortex-file-compressed 30015833 / 31019078 / -3.2% 42728036 / 42210494 / +1.2% 0.70 / 0.73 / -4.4%
tpcds_q03/duckdb:vortex-file-compressed 13687906 / 13791742 / -0.8% 30824897 / 29378226 / +4.9% 0.44 / 0.47 / -5.4%
tpcds_q04/duckdb:vortex-file-compressed 129788574 / 129471634 / +0.2% 156481872 / 151903616 / +3.0% 0.83 / 0.85 / -2.7%
tpcds_q05/duckdb:vortex-file-compressed 54127020 / 54650877 / -1.0% 82633764 / 73147246 / +13.0% 🔴 0.66 / 0.75 / -12.3%
tpcds_q06/duckdb:vortex-file-compressed 58557528 / 58713689 / -0.3% 78269794 / 75959131 / +3.0% 0.75 / 0.77 / -3.2%
tpcds_q07/duckdb:vortex-file-compressed 30446420 / 30579528 / -0.4% 53973867 / 52049505 / +3.7% 0.56 / 0.59 / -4.0%
tpcds_q08/duckdb:vortex-file-compressed 30910822 / 30914874 / -0.0% 41258438 / 40665146 / +1.5% 0.75 / 0.76 / -1.5%
tpcds_q09/duckdb:vortex-file-compressed 56528209 / 56913068 / -0.7% 79406081 / 74998255 / +5.9% 0.71 / 0.76 / -6.2%
tpcds_q10/duckdb:vortex-file-compressed 39646429 / 39635552 / +0.0% 58393410 / 57816076 / +1.0% 0.68 / 0.69 / -1.0%
tpcds_q11/duckdb:vortex-file-compressed 95661104 / 95253860 / +0.4% 114924275 / 113706380 / +1.1% 0.83 / 0.84 / -0.6%
tpcds_q12/duckdb:vortex-file-compressed 18183261 / 17712503 / +2.7% 30314092 / 29984002 / +1.1% 0.60 / 0.59 / +1.5%
tpcds_q13/duckdb:vortex-file-compressed 38811260 / 37991460 / +2.2% 71912346 / 69301429 / +3.8% 0.54 / 0.55 / -1.6%
tpcds_q14/duckdb:vortex-file-compressed 119267584 / 121384720 / -1.7% 133845712 / 134734274 / -0.7% 0.89 / 0.90 / -1.1%
tpcds_q15/duckdb:vortex-file-compressed 58514122 / 61299576 / -4.5% 74013898 / 72388428 / +2.2% 0.79 / 0.85 / -6.6%
tpcds_q16/duckdb:vortex-file-compressed 34803314 / 34690472 / +0.3% 53392851 / 52266117 / +2.2% 0.65 / 0.66 / -1.8%
tpcds_q17/duckdb:vortex-file-compressed 57588966 / 57332318 / +0.4% 79547151 / 79066911 / +0.6% 0.72 / 0.73 / -0.2%
tpcds_q18/duckdb:vortex-file-compressed 82734514 / 82923020 / -0.2% 102038504 / 101023706 / +1.0% 0.81 / 0.82 / -1.2%
tpcds_q19/duckdb:vortex-file-compressed 44744616 / 43597316 / +2.6% 63362102 / 62263780 / +1.8% 0.71 / 0.70 / +0.9%
tpcds_q20/duckdb:vortex-file-compressed 22360278 / 22262395 / +0.4% 34693829 / 35610939 / -2.6% 0.64 / 0.63 / +3.1%
tpcds_q21/duckdb:vortex-file-compressed 35598712 / 34748561 / +2.4% 68954366 / 61670816 / +11.8% 🔴 0.52 / 0.56 / -8.4%
tpcds_q22/duckdb:vortex-file-compressed 156908174 / 161348692 / -2.8% 177163784 / 172593381 / +2.6% 0.89 / 0.93 / -5.3%
tpcds_q23/duckdb:vortex-file-compressed 183708858 / 183560942 / +0.1% 203318115 / 197879336 / +2.7% 0.90 / 0.93 / -2.6%
tpcds_q24/duckdb:vortex-file-compressed 52393294 / 52262054 / +0.3% 77426485 / 70571615 / +9.7% 0.68 / 0.74 / -8.6%
tpcds_q25/duckdb:vortex-file-compressed 53272987 / 52927888 / +0.7% 76131903 / 72882457 / +4.5% 0.70 / 0.73 / -3.6%
tpcds_q26/duckdb:vortex-file-compressed 26717022 / 26933009 / -0.8% 43705380 / 40955560 / +6.7% 0.61 / 0.66 / -7.0%
tpcds_q27/duckdb:vortex-file-compressed 31616800 / 32187006 / -1.8% 57011041 / 51949183 / +9.7% 0.55 / 0.62 / -10.5%
tpcds_q28/duckdb:vortex-file-compressed 42339925 / 42552663 / -0.5% 65226222 / 61657569 / +5.8% 0.65 / 0.69 / -5.9%
tpcds_q29/duckdb:vortex-file-compressed 51662316 / 52233606 / -1.1% 75287383 / 71810623 / +4.8% 0.69 / 0.73 / -5.7%
tpcds_q30/duckdb:vortex-file-compressed 37980474 / 38885226 / -2.3% 52083581 / 50464856 / +3.2% 0.73 / 0.77 / -5.4%
tpcds_q31/duckdb:vortex-file-compressed 37896888 / 38098196 / -0.5% 52544292 / 53564287 / -1.9% 0.72 / 0.71 / +1.4%
tpcds_q32/duckdb:vortex-file-compressed 14271002 / 13744550 / +3.8% 29937788 / 29352103 / +2.0% 0.48 / 0.47 / +1.8%
tpcds_q33/duckdb:vortex-file-compressed 34849345 / 34677902 / +0.5% 56876758 / 56234127 / +1.1% 0.61 / 0.62 / -0.6%
tpcds_q34/duckdb:vortex-file-compressed 22904680 / 22969670 / -0.3% 39607355 / 38109259 / +3.9% 0.58 / 0.60 / -4.1%
tpcds_q35/duckdb:vortex-file-compressed 67171322 / 67973400 / -1.2% 87413886 / 87774818 / -0.4% 0.77 / 0.77 / -0.8%
tpcds_q36/duckdb:vortex-file-compressed 29116726 / 29798050 / -2.3% 48238862 / 50744981 / -4.9% 0.60 / 0.59 / +2.8%
tpcds_q37/duckdb:vortex-file-compressed 27716434 / 27056984 / +2.4% 74277141 / 63501341 / +17.0% 🔴 0.37 / 0.43 / -12.4%
tpcds_q38/duckdb:vortex-file-compressed 59286328 / 65418466 / -9.4% 81664722 / 79214533 / +3.1% 0.73 / 0.83 / -12.1%
tpcds_q39/duckdb:vortex-file-compressed 58259878 / 59507598 / -2.1% 90461863 / 85059050 / +6.4% 0.64 / 0.70 / -7.9%
tpcds_q40/duckdb:vortex-file-compressed 19173054 / 18871024 / +1.6% 34940763 / 33673544 / +3.8% 0.55 / 0.56 / -2.1%
tpcds_q41/duckdb:vortex-file-compressed 19648758 / 19805286 / -0.8% 26453686 / 29362971 / -9.9% 0.74 / 0.67 / +10.1%
tpcds_q42/duckdb:vortex-file-compressed 14931026 / 13899774 / +7.4% 30904303 / 29210586 / +5.8% 0.48 / 0.48 / +1.5%
tpcds_q43/duckdb:vortex-file-compressed 20198786 / 19246490 / +4.9% 31509256 / 32560191 / -3.2% 0.64 / 0.59 / +8.4%
tpcds_q44/duckdb:vortex-file-compressed 28329610 / 28025286 / +1.1% 48938987 / 48655091 / +0.6% 0.58 / 0.58 / +0.5%
tpcds_q45/duckdb:vortex-file-compressed 46833275 / 47072534 / -0.5% 59880090 / 59554822 / +0.5% 0.78 / 0.79 / -1.0%
tpcds_q46/duckdb:vortex-file-compressed 50814774 / 50438530 / +0.7% 76091454 / 74694605 / +1.9% 0.67 / 0.68 / -1.1%
tpcds_q47/duckdb:vortex-file-compressed 80865771 / 80023928 / +1.1% 95217291 / 94571206 / +0.7% 0.85 / 0.85 / +0.4%
tpcds_q48/duckdb:vortex-file-compressed 53769386 / 54686811 / -1.7% 80489721 / 74230374 / +8.4% 0.67 / 0.74 / -9.3%
tpcds_q49/duckdb:vortex-file-compressed 37527580 / 37594846 / -0.2% 78009111 / 74467492 / +4.8% 0.48 / 0.50 / -4.7%
tpcds_q50/duckdb:vortex-file-compressed 32298791 / 32781100 / -1.5% 56230176 / 53162237 / +5.8% 0.57 / 0.62 / -6.8%
tpcds_q51/duckdb:vortex-file-compressed 207525780 / 203964206 / +1.7% 222945979 / 219753980 / +1.5% 0.93 / 0.93 / +0.3%
tpcds_q52/duckdb:vortex-file-compressed 14619946 / 14677496 / -0.4% 31540483 / 31526862 / +0.0% 0.46 / 0.47 / -0.4%
tpcds_q53/duckdb:vortex-file-compressed 22496007 / 22186665 / +1.4% 37618623 / 37074470 / +1.5% 0.60 / 0.60 / -0.1%
tpcds_q54/duckdb:vortex-file-compressed 44567677 / 44656646 / -0.2% 66082285 / 64461201 / +2.5% 0.67 / 0.69 / -2.6%
tpcds_q55/duckdb:vortex-file-compressed 14452847 / 14576306 / -0.8% 31199003 / 29207984 / +6.8% 0.46 / 0.50 / -7.2%
tpcds_q56/duckdb:vortex-file-compressed 34182304 / 33782552 / +1.2% 55335565 / 55297615 / +0.1% 0.62 / 0.61 / +1.1%
tpcds_q57/duckdb:vortex-file-compressed 69947844 / 65424170 / +6.9% 75644705 / 78631941 / -3.8% 0.92 / 0.83 / +11.1%
tpcds_q58/duckdb:vortex-file-compressed 37807498 / 38898298 / -2.8% 59576225 / 55844701 / +6.7% 0.63 / 0.70 / -8.9%
tpcds_q59/duckdb:vortex-file-compressed 54938802 / 53884934 / +2.0% 62488705 / 64106634 / -2.5% 0.88 / 0.84 / +4.6%
tpcds_q60/duckdb:vortex-file-compressed 36424002 / 35946234 / +1.3% 59530406 / 56917888 / +4.6% 0.61 / 0.63 / -3.1%
tpcds_q61/duckdb:vortex-file-compressed 34712280 / 35361596 / -1.8% 55562919 / 54931615 / +1.1% 0.62 / 0.64 / -3.0%
tpcds_q62/duckdb:vortex-file-compressed 15487208 / 15642241 / -1.0% 27237647 / 26437775 / +3.0% 0.57 / 0.59 / -3.9%
tpcds_q63/duckdb:vortex-file-compressed 21578024 / 21535454 / +0.2% 38054438 / 37891582 / +0.4% 0.57 / 0.57 / -0.2%
tpcds_q64/duckdb:vortex-file-compressed 119807932 / 118554184 / +1.1% 150620702 / 155152310 / -2.9% 0.80 / 0.76 / +4.1%
tpcds_q65/duckdb:vortex-file-compressed 51998770 / 51795274 / +0.4% 60084464 / 58381044 / +2.9% 0.87 / 0.89 / -2.5%
tpcds_q66/duckdb:vortex-file-compressed 41460771 / 43175862 / -4.0% 57630813 / 58144026 / -0.9% 0.72 / 0.74 / -3.1%
tpcds_q67/duckdb:vortex-file-compressed 277991843 / 279697525 / -0.6% 288167044 / 286952006 / +0.4% 0.96 / 0.97 / -1.0%
tpcds_q68/duckdb:vortex-file-compressed 45850524 / 43855412 / +4.5% 71197704 / 70889380 / +0.4% 0.64 / 0.62 / +4.1%
tpcds_q69/duckdb:vortex-file-compressed 38364730 / 38928932 / -1.4% 60694890 / 58818393 / +3.2% 0.63 / 0.66 / -4.5%
tpcds_q70/duckdb:vortex-file-compressed 25401307 / 25463294 / -0.2% 42432479 / 40384021 / +5.1% 0.60 / 0.63 / -5.1%
tpcds_q71/duckdb:vortex-file-compressed 28823158 / 28420039 / +1.4% 51577015 / 50106346 / +2.9% 0.56 / 0.57 / -1.5%
tpcds_q72/duckdb:vortex-file-compressed 138964864 / 139979520 / -0.7% 165089347 / 158903169 / +3.9% 0.84 / 0.88 / -4.4%
tpcds_q73/duckdb:vortex-file-compressed 20373297 / 20585262 / -1.0% 36019407 / 34351793 / +4.9% 0.57 / 0.60 / -5.6%
tpcds_q74/duckdb:vortex-file-compressed 83221733 / 82954312 / +0.3% 97186166 / 96750254 / +0.5% 0.86 / 0.86 / -0.1%
tpcds_q75/duckdb:vortex-file-compressed 114809054 / 111812181 / +2.7% 144319683 / 134642468 / +7.2% 0.80 / 0.83 / -4.2%
tpcds_q76/duckdb:vortex-file-compressed 27669198 / 28565848 / -3.1% 58550968 / 50818005 / +15.2% 🔴 0.47 / 0.56 / -15.9%
tpcds_q77/duckdb:vortex-file-compressed 37001956 / 37119674 / -0.3% 61563326 / 58001525 / +6.1% 0.60 / 0.64 / -6.1%
tpcds_q78/duckdb:vortex-file-compressed 135863662 / 134376332 / +1.1% 160631625 / 156253992 / +2.8% 0.85 / 0.86 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 37927730 / 37226774 / +1.9% 60069458 / 64984627 / -7.6% 0.63 / 0.57 / +10.2%
tpcds_q80/duckdb:vortex-file-compressed 59564992 / 60631832 / -1.8% 92621126 / 87730396 / +5.6% 0.64 / 0.69 / -6.9%
tpcds_q81/duckdb:vortex-file-compressed 57293558 / 56945055 / +0.6% 71519626 / 69412304 / +3.0% 0.80 / 0.82 / -2.4%
tpcds_q82/duckdb:vortex-file-compressed 28842962 / 29310453 / -1.6% 76564247 / 66476381 / +15.2% 🔴 0.38 / 0.44 / -14.6%
tpcds_q83/duckdb:vortex-file-compressed 21936161 / 22220825 / -1.3% 31963293 / 31287098 / +2.2% 0.69 / 0.71 / -3.4%
tpcds_q84/duckdb:vortex-file-compressed 13686598 / 13235808 / +3.4% 23528748 / 23242568 / +1.2% 0.58 / 0.57 / +2.1%
tpcds_q85/duckdb:vortex-file-compressed 36832094 / 36925374 / -0.3% 54414033 / 51546008 / +5.6% 0.68 / 0.72 / -5.5%
tpcds_q86/duckdb:vortex-file-compressed 17259087 / 17513178 / -1.5% 28557517 / 27253205 / +4.8% 0.60 / 0.64 / -6.0%
tpcds_q87/duckdb:vortex-file-compressed 78979712 / 77864842 / +1.4% 85009796 / 89463261 / -5.0% 0.93 / 0.87 / +6.7%
tpcds_q88/duckdb:vortex-file-compressed 37973038 / 38263800 / -0.8% 47903139 / 48154818 / -0.5% 0.79 / 0.79 / -0.2%
tpcds_q89/duckdb:vortex-file-compressed 24726964 / 24642745 / +0.3% 40498409 / 39097340 / +3.6% 0.61 / 0.63 / -3.1%
tpcds_q90/duckdb:vortex-file-compressed 10067034 / 9989277 / +0.8% 19843929 / 19596667 / +1.3% 0.51 / 0.51 / -0.5%
tpcds_q91/duckdb:vortex-file-compressed 19658118 / 19631830 / +0.1% 30450798 / 28502784 / +6.8% 0.65 / 0.69 / -6.3%
tpcds_q92/duckdb:vortex-file-compressed 14301577 / 13669336 / +4.6% 29122081 / 27546971 / +5.7% 0.49 / 0.50 / -1.0%
tpcds_q93/duckdb:vortex-file-compressed 25736714 / 25614763 / +0.5% 51740913 / 48903940 / +5.8% 0.50 / 0.52 / -5.0%
tpcds_q94/duckdb:vortex-file-compressed 32442280 / 32556908 / -0.4% 47485430 / 46308520 / +2.5% 0.68 / 0.70 / -2.8%
tpcds_q95/duckdb:vortex-file-compressed 97270560 / 94847437 / +2.6% 125761588 / 106019934 / +18.6% 🔴 0.77 / 0.89 / -13.5%
tpcds_q96/duckdb:vortex-file-compressed 12109452 / 11913750 / +1.6% 25321114 / 24940175 / +1.5% 0.48 / 0.48 / +0.1%
tpcds_q97/duckdb:vortex-file-compressed 61479508 / 61212860 / +0.4% 79340420 / 78071460 / +1.6% 0.77 / 0.78 / -1.2%
tpcds_q98/duckdb:vortex-file-compressed 26880917 / 27621885 / -2.7% 46221068 / 43376439 / +6.6% 0.58 / 0.64 / -8.7%
tpcds_q99/duckdb:vortex-file-compressed 23185854 / 22726621 / +2.0% 34869999 / 35480133 / -1.7% 0.66 / 0.64 / +3.8%
duckdb / parquet / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41444260 / 41754509 / -0.7% 50189931 / 49716420 / +1.0% 0.83 / 0.84 / -1.7%
tpcds_q02/duckdb:parquet 40273620 / 39320498 / +2.4% 46338524 / 48014421 / -3.5% 0.87 / 0.82 / +6.1%
tpcds_q03/duckdb:parquet 24862445 / 25927457 / -4.1% 35249365 / 36544174 / -3.5% 0.71 / 0.71 / -0.6%
tpcds_q04/duckdb:parquet 205778666 / 204404258 / +0.7% 223783279 / 225527266 / -0.8% 0.92 / 0.91 / +1.5%
tpcds_q05/duckdb:parquet 69023340 / 69257976 / -0.3% 82831652 / 85239338 / -2.8% 0.83 / 0.81 / +2.6%
tpcds_q06/duckdb:parquet 73933202 / 75009952 / -1.4% 88603615 / 86459760 / +2.5% 0.83 / 0.87 / -3.8%
tpcds_q07/duckdb:parquet 61091355 / 61347346 / -0.4% 75330163 / 78900270 / -4.5% 0.81 / 0.78 / +4.3%
tpcds_q08/duckdb:parquet 39106890 / 39528259 / -1.1% 45858959 / 47045239 / -2.5% 0.85 / 0.84 / +1.5%
tpcds_q09/duckdb:parquet 85782705 / 85242190 / +0.6% 98634912 / 99107059 / -0.5% 0.87 / 0.86 / +1.1%
tpcds_q10/duckdb:parquet 52296034 / 51215596 / +2.1% 61542463 / 60545042 / +1.6% 0.85 / 0.85 / +0.5%
tpcds_q11/duckdb:parquet 158109044 / 157115754 / +0.6% 166058141 / 167096251 / -0.6% 0.95 / 0.94 / +1.3%
tpcds_q12/duckdb:parquet 40632560 / 40352013 / +0.7% 46953925 / 47141692 / -0.4% 0.87 / 0.86 / +1.1%
tpcds_q13/duckdb:parquet 70717095 / 70020372 / +1.0% 87611914 / 85638270 / +2.3% 0.81 / 0.82 / -1.3%
tpcds_q14/duckdb:parquet 189863601 / 184880045 / +2.7% 195976536 / 198443193 / -1.2% 0.97 / 0.93 / +4.0%
tpcds_q15/duckdb:parquet 61135385 / 60771048 / +0.6% 69109730 / 67619690 / +2.2% 0.88 / 0.90 / -1.6%
tpcds_q16/duckdb:parquet 38252902 / 37994630 / +0.7% 46226539 / 45727616 / +1.1% 0.83 / 0.83 / -0.4%
tpcds_q17/duckdb:parquet 83672040 / 83160258 / +0.6% 90823102 / 89114981 / +1.9% 0.92 / 0.93 / -1.3%
tpcds_q18/duckdb:parquet 88255342 / 87879957 / +0.4% 98347792 / 95836133 / +2.6% 0.90 / 0.92 / -2.1%
tpcds_q19/duckdb:parquet 48630202 / 47515380 / +2.3% 58237987 / 61000663 / -4.5% 0.84 / 0.78 / +7.2%
tpcds_q20/duckdb:parquet 42402986 / 43268675 / -2.0% 48734918 / 53319914 / -8.6% 0.87 / 0.81 / +7.2%
tpcds_q21/duckdb:parquet 23981564 / 23792717 / +0.8% 28812262 / 30200345 / -4.6% 0.83 / 0.79 / +5.6%
tpcds_q22/duckdb:parquet 163867209 / 166859429 / -1.8% 166863583 / 164973195 / +1.1% 0.98 / 1.01 / -2.9%
tpcds_q23/duckdb:parquet 185461193 / 185062354 / +0.2% 190590810 / 194317115 / -1.9% 0.97 / 0.95 / +2.2%
tpcds_q24/duckdb:parquet 71913804 / 73795194 / -2.5% 84115429 / 81539892 / +3.2% 0.85 / 0.91 / -5.5%
tpcds_q25/duckdb:parquet 50785252 / 50609986 / +0.3% 61132690 / 59253909 / +3.2% 0.83 / 0.85 / -2.7%
tpcds_q26/duckdb:parquet 44399060 / 42341269 / +4.9% 52837681 / 50367988 / +4.9% 0.84 / 0.84 / -0.0%
tpcds_q27/duckdb:parquet 56591028 / 59273806 / -4.5% 72003796 / 74915572 / -3.9% 0.79 / 0.79 / -0.7%
tpcds_q28/duckdb:parquet 97122511 / 92538077 / +5.0% 115691093 / 108311955 / +6.8% 0.84 / 0.85 / -1.7%
tpcds_q29/duckdb:parquet 84920032 / 85143526 / -0.3% 100023578 / 97322888 / +2.8% 0.85 / 0.87 / -3.0%
tpcds_q30/duckdb:parquet 72460104 / 71883182 / +0.8% 80756144 / 79235601 / +1.9% 0.90 / 0.91 / -1.1%
tpcds_q31/duckdb:parquet 99087997 / 98352300 / +0.7% 110696841 / 110050281 / +0.6% 0.90 / 0.89 / +0.2%
tpcds_q32/duckdb:parquet 18169582 / 18136707 / +0.2% 26355550 / 25667997 / +2.7% 0.69 / 0.71 / -2.4%
tpcds_q33/duckdb:parquet 61876200 / 63106814 / -2.0% 73381371 / 75700594 / -3.1% 0.84 / 0.83 / +1.1%
tpcds_q34/duckdb:parquet 33237236 / 33253224 / -0.0% 39429501 / 39802094 / -0.9% 0.84 / 0.84 / +0.9%
tpcds_q35/duckdb:parquet 76687409 / 75987730 / +0.9% 85694274 / 90314190 / -5.1% 0.89 / 0.84 / +6.4%
tpcds_q36/duckdb:parquet 99091381 / 96353316 / +2.8% 116259206 / 111385494 / +4.4% 0.85 / 0.87 / -1.5%
tpcds_q37/duckdb:parquet 41369678 / 42209048 / -2.0% 46830796 / 47786871 / -2.0% 0.88 / 0.88 / +0.0%
tpcds_q38/duckdb:parquet 75755301 / 77958424 / -2.8% 81375083 / 85349165 / -4.7% 0.93 / 0.91 / +1.9%
tpcds_q39/duckdb:parquet 62060334 / 61486491 / +0.9% 68041280 / 68395844 / -0.5% 0.91 / 0.90 / +1.5%
tpcds_q40/duckdb:parquet 28134726 / 28074760 / +0.2% 35265544 / 35471051 / -0.6% 0.80 / 0.79 / +0.8%
tpcds_q41/duckdb:parquet 20532685 / 20300412 / +1.1% 26195396 / 27039573 / -3.1% 0.78 / 0.75 / +4.4%
tpcds_q42/duckdb:parquet 27384915 / 25832600 / +6.0% 36633248 / 37396731 / -2.0% 0.75 / 0.69 / +8.2%
tpcds_q43/duckdb:parquet 26614084 / 27833256 / -4.4% 33371817 / 37569548 / -11.2% 🟢 0.80 / 0.74 / +7.6%
tpcds_q44/duckdb:parquet 61003090 / 61917711 / -1.5% 76798499 / 76056446 / +1.0% 0.79 / 0.81 / -2.4%
tpcds_q45/duckdb:parquet 61237838 / 60935476 / +0.5% 68472705 / 66445419 / +3.1% 0.89 / 0.92 / -2.5%
tpcds_q46/duckdb:parquet 70389088 / 74233802 / -5.2% 87273698 / 85326401 / +2.3% 0.81 / 0.87 / -7.3%
tpcds_q47/duckdb:parquet 89792976 / 91376278 / -1.7% 103669709 / 100561337 / +3.1% 0.87 / 0.91 / -4.7%
tpcds_q48/duckdb:parquet 68281948 / 65415782 / +4.4% 79045078 / 77089178 / +2.5% 0.86 / 0.85 / +1.8%
tpcds_q49/duckdb:parquet 68553393 / 68736560 / -0.3% 88342140 / 88271949 / +0.1% 0.78 / 0.78 / -0.3%
tpcds_q50/duckdb:parquet 45193710 / 44405659 / +1.8% 55854012 / 50047873 / +11.6% 🔴 0.81 / 0.89 / -8.8%
tpcds_q51/duckdb:parquet 217752262 / 215203352 / +1.2% 224168194 / 225668772 / -0.7% 0.97 / 0.95 / +1.9%
tpcds_q52/duckdb:parquet 26651168 / 26929999 / -1.0% 36383869 / 37851845 / -3.9% 0.73 / 0.71 / +3.0%
tpcds_q53/duckdb:parquet 34459166 / 35085957 / -1.8% 46115251 / 45697835 / +0.9% 0.75 / 0.77 / -2.7%
tpcds_q54/duckdb:parquet 55349364 / 55066050 / +0.5% 63399418 / 62823873 / +0.9% 0.87 / 0.88 / -0.4%
tpcds_q55/duckdb:parquet 26942700 / 27167385 / -0.8% 37304823 / 36846878 / +1.2% 0.72 / 0.74 / -2.0%
tpcds_q56/duckdb:parquet 68355394 / 69810094 / -2.1% 82709223 / 78191395 / +5.8% 0.83 / 0.89 / -7.4%
tpcds_q57/duckdb:parquet 68343503 / 67924052 / +0.6% 75290530 / 75378836 / -0.1% 0.91 / 0.90 / +0.7%
tpcds_q58/duckdb:parquet 55934582 / 55636208 / +0.5% 67762621 / 67771566 / -0.0% 0.83 / 0.82 / +0.5%
tpcds_q59/duckdb:parquet 61464728 / 60888385 / +0.9% 69131722 / 69281606 / -0.2% 0.89 / 0.88 / +1.2%
tpcds_q60/duckdb:parquet 82721552 / 82995592 / -0.3% 94753663 / 93609037 / +1.2% 0.87 / 0.89 / -1.5%
tpcds_q61/duckdb:parquet 81341693 / 79843582 / +1.9% 90559882 / 96209480 / -5.9% 0.90 / 0.83 / +8.2%
tpcds_q62/duckdb:parquet 20088094 / 22427732 / -10.4% 🟢 29306015 / 26553261 / +10.4% 🔴 0.69 / 0.84 / -18.8%
tpcds_q63/duckdb:parquet 34431480 / 32945599 / +4.5% 45340536 / 44810985 / +1.2% 0.76 / 0.74 / +3.3%
tpcds_q64/duckdb:parquet 134659138 / 137730810 / -2.2% 148946370 / 162467301 / -8.3% 0.90 / 0.85 / +6.6%
tpcds_q65/duckdb:parquet 89041840 / 90841106 / -2.0% 106767710 / 98758923 / +8.1% 0.83 / 0.92 / -9.3%
tpcds_q66/duckdb:parquet 46988261 / 46229679 / +1.6% 53381376 / 52011770 / +2.6% 0.88 / 0.89 / -1.0%
tpcds_q67/duckdb:parquet 296496791 / 296484754 / +0.0% 299262215 / 300794460 / -0.5% 0.99 / 0.99 / +0.5%
tpcds_q68/duckdb:parquet 61044810 / 62271290 / -2.0% 75388845 / 79884988 / -5.6% 0.81 / 0.78 / +3.9%
tpcds_q69/duckdb:parquet 65546786 / 66823133 / -1.9% 77292336 / 75751375 / +2.0% 0.85 / 0.88 / -3.9%
tpcds_q70/duckdb:parquet 41825114 / 43502914 / -3.9% 52556098 / 51876494 / +1.3% 0.80 / 0.84 / -5.1%
tpcds_q71/duckdb:parquet 41374578 / 40235578 / +2.8% 58501969 / 53331431 / +9.7% 0.71 / 0.75 / -6.3%
tpcds_q72/duckdb:parquet 173839138 / 171234634 / +1.5% 185975984 / 185887233 / +0.0% 0.93 / 0.92 / +1.5%
tpcds_q73/duckdb:parquet 28314409 / 28539550 / -0.8% 35949664 / 38525179 / -6.7% 0.79 / 0.74 / +6.3%
tpcds_q74/duckdb:parquet 217054990 / 214701141 / +1.1% 221621749 / 226612264 / -2.2% 0.98 / 0.95 / +3.4%
tpcds_q75/duckdb:parquet 133102854 / 136513298 / -2.5% 155111923 / 144305040 / +7.5% 0.86 / 0.95 / -9.3%
tpcds_q76/duckdb:parquet 51327056 / 52107498 / -1.5% 66615304 / 66393995 / +0.3% 0.77 / 0.78 / -1.8%
tpcds_q77/duckdb:parquet 56230975 / 53680122 / +4.8% 70571451 / 68802211 / +2.6% 0.80 / 0.78 / +2.1%
tpcds_q78/duckdb:parquet 153602800 / 146481247 / +4.9% 159253536 / 173928138 / -8.4% 0.96 / 0.84 / +14.5%
tpcds_q79/duckdb:parquet 53291194 / 52912912 / +0.7% 65252232 / 69766888 / -6.5% 0.82 / 0.76 / +7.7%
tpcds_q80/duckdb:parquet 83398081 / 84091399 / -0.8% 106562288 / 101467325 / +5.0% 0.78 / 0.83 / -5.6%
tpcds_q81/duckdb:parquet 97906069 / 96942804 / +1.0% 105565346 / 105070620 / +0.5% 0.93 / 0.92 / +0.5%
tpcds_q82/duckdb:parquet 45729921 / 46487240 / -1.6% 53101305 / 53044060 / +0.1% 0.86 / 0.88 / -1.7%
tpcds_q83/duckdb:parquet 27988286 / 28126860 / -0.5% 33198776 / 33556853 / -1.1% 0.84 / 0.84 / +0.6%
tpcds_q84/duckdb:parquet 23005710 / 22718850 / +1.3% 29766010 / 28854283 / +3.2% 0.77 / 0.79 / -1.8%
tpcds_q85/duckdb:parquet 51769162 / 51569898 / +0.4% 61950556 / 60972055 / +1.6% 0.84 / 0.85 / -1.2%
tpcds_q86/duckdb:parquet 25197716 / 25653376 / -1.8% 32237021 / 32290498 / -0.2% 0.78 / 0.79 / -1.6%
tpcds_q87/duckdb:parquet 88122350 / 86041585 / +2.4% 91642711 / 96073615 / -4.6% 0.96 / 0.90 / +7.4%
tpcds_q88/duckdb:parquet 105091250 / 104156077 / +0.9% 108653312 / 113708809 / -4.4% 0.97 / 0.92 / +5.6%
tpcds_q89/duckdb:parquet 36945573 / 37221714 / -0.7% 47897105 / 52543843 / -8.8% 0.77 / 0.71 / +8.9%
tpcds_q90/duckdb:parquet 15595394 / 15320644 / +1.8% 21189563 / 19638004 / +7.9% 0.74 / 0.78 / -5.7%
tpcds_q91/duckdb:parquet 25648264 / 25533825 / +0.4% 32984497 / 32629028 / +1.1% 0.78 / 0.78 / -0.6%
tpcds_q92/duckdb:parquet 23275120 / 22457040 / +3.6% 29374194 / 29600706 / -0.8% 0.79 / 0.76 / +4.4%
tpcds_q93/duckdb:parquet 36220720 / 36522483 / -0.8% 45767189 / 49556338 / -7.6% 0.79 / 0.74 / +7.4%
tpcds_q94/duckdb:parquet 38687342 / 38221661 / +1.2% 46306862 / 47915670 / -3.4% 0.84 / 0.80 / +4.7%
tpcds_q95/duckdb:parquet 82536800 / 80753512 / +2.2% 86039887 / 88826826 / -3.1% 0.96 / 0.91 / +5.5%
tpcds_q96/duckdb:parquet 17147060 / 17701885 / -3.1% 22821403 / 22852748 / -0.1% 0.75 / 0.77 / -3.0%
tpcds_q97/duckdb:parquet 74561380 / 72195042 / +3.3% 85254916 / 85867593 / -0.7% 0.87 / 0.84 / +4.0%
tpcds_q98/duckdb:parquet 53923592 / 54526654 / -1.1% 68661801 / 67784295 / +1.3% 0.79 / 0.80 / -2.4%
tpcds_q99/duckdb:parquet 24145730 / 25590772 / -5.6% 33146716 / 32382010 / +2.4% 0.73 / 0.79 / -7.8%

joseph-isaacs and others added 3 commits November 13, 2026 13:50
Each SQL bench job uploads its own file-trees artifact. A final job now
merges them into a single file-trees-<preset> zip, one directory per
job, and deletes the per-job artifacts.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Dump every file of a format directory first, then keep one file of every
table and add size-weighted partitions while their actual dumps fit in a
line budget (--max-lines, default 20000), instead of drawing a fixed
number of files. The manifest lists every file with its line count and
whether its dump was kept. The dump step gets a 20-minute timeout so a
large dataset cannot hold up the benchmark job.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Measured on the pr preset, a dumped tree line costs ~11 bytes zipped and
a dataset's trees grow by 6-19 lines per MB of Vortex data. 200,000 lines
(~2 MB zipped) keeps every file of the SF1 and SF10 datasets and samples
about 89 of ClickBench's 100 files and the SF100 datasets.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAYg7oWmiWHug452hr
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 13, 2026 14:01
@joseph-isaacs
joseph-isaacs merged commit 7f07d78 into develop Nov 13, 2026
78 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/confident-faraday-j8jagi branch November 13, 2026 14:02
joseph-isaacs added a commit that referenced this pull request Nov 13, 2026
develop (#11443, #11444) made "Capture file sizes" append file-size records to
results.ingest.jsonl, which "Fetch baseline" reads, and added the sampled file
tree dump and upload. The benchmark job now runs the capture alongside the
dump, then the tree upload alongside the baseline fetch, so the fetch still
sees the file-size records.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants