Skip to content

duckdb: report distinct count based on min/max - #11130

Merged
myrrc merged 2 commits into
developfrom
myrrc/duckdb-ndv-hack
Nov 3, 2026
Merged

myrrc merged 2 commits into
developfrom
myrrc/duckdb-ndv-hack

Conversation

@myrrc

@myrrc myrrc commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

DuckDB's JOIN planner overstates cardinality for table functions which push down
filters (duckdb/duckdb#28099). Hack this until upstream
PR is merged by reporting distinct count as MAX - MIN + 1 based on min/max
statistics.

@myrrc myrrc added changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage labels Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 3, 2026
@myrrc myrrc added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 3, 2026
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@codspeed

ghost commented Nov 3, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 10.83%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 1 improved benchmark
✅ 2306 untouched benchmarks
⏩ 38 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Walltime lt_i64_nullable_avx512 8.2 µs 7.4 µs +10.83%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-ndv-hack (d0193a4) with develop (246a397)

Open in CodSpeed

Footnotes

  1. 38 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@myrrc
myrrc force-pushed the myrrc/duckdb-ndv-hack branch from 768e129 to 0d976c5 Compare November 3, 2026 12:01
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 3, 2026
@github-actions

ghost commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done d0193a4 vortex-queries 1 Explore Profiling Data
🟢 Done d0193a4 clickbench-nvme 1 Explore Profiling Data
🟢 Done d0193a4 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done d0193a4 tpch-s3-10 1 Explore Profiling Data
🟢 Done d0193a4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done d0193a4 job-nvme 1 Explore Profiling Data
🟢 Done d0193a4 fineweb-s3 1 Explore Profiling Data
🟢 Done d0193a4 appian-nvme 1 Explore Profiling Data
🟢 Done d0193a4 fineweb 1 Explore Profiling Data
🟢 Done d0193a4 polarsignals 1 Explore Profiling Data
🟢 Done d0193a4 tpch-nvme 1 Explore Profiling Data
🟢 Done d0193a4 tpcds-nvme 1 Explore Profiling Data
🟢 Done d0193a4 tpch-s3 1 Explore Profiling Data
🟢 Done d0193a4 statpopgen 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress d0193a4 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR d0193a40 vs base 246a397e
Vortex (geomean): hot 0.989x ➖ · cold 1.023x ➖


datafusion / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44317678 / 44174877 / +0.3% 86876299 / 83381591 / +4.2% 0.51 / 0.53 / -3.7%
polarsignals_q01/datafusion:vortex-file-compressed 53189710 / 59498684 / -10.6% 🟢 113226409 / 113392846 / -0.1% 0.47 / 0.52 / -10.5%
polarsignals_q02/datafusion:vortex-file-compressed 12012880 / 11978216 / +0.3% 49729356 / 49588551 / +0.3% 0.24 / 0.24 / +0.0%
polarsignals_q03/datafusion:vortex-file-compressed 53309130 / 54233533 / -1.7% 116913293 / 112439358 / +4.0% 0.46 / 0.48 / -5.5%
polarsignals_q04/datafusion:vortex-file-compressed 8942730 / 9157702 / -2.3% 40446978 / 40279396 / +0.4% 0.22 / 0.23 / -2.8%
polarsignals_q05/datafusion:vortex-file-compressed 11628378 / 11581688 / +0.4% 44714183 / 44512288 / +0.5% 0.26 / 0.26 / -0.1%
polarsignals_q06/datafusion:vortex-file-compressed 22887269 / 23169506 / -1.2% 55358386 / 52769004 / +4.9% 0.41 / 0.44 / -5.8%
polarsignals_q07/datafusion:vortex-file-compressed 10540759 / 10570672 / -0.3% 42642205 / 41644590 / +2.4% 0.25 / 0.25 / -2.6%
polarsignals_q08/datafusion:vortex-file-compressed 97768746 / 97258934 / +0.5% 158238446 / 150877578 / +4.9% 0.62 / 0.64 / -4.2%
polarsignals_q09/datafusion:vortex-file-compressed 10204861 / 9737686 / +4.8% 40027888 / 39267571 / +1.9% 0.25 / 0.25 / +2.8%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.936x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.974x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.028x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6077526 / 6024191 / +0.9% 18813552 / 21309376 / -11.7% 🟢 0.32 / 0.28 / +14.3%
fineweb_q01/datafusion:vortex-file-compressed 9873795 / 9747476 / +1.3% 37110580 / 42020755 / -11.7% 🟢 0.27 / 0.23 / +14.7%
fineweb_q02/datafusion:vortex-file-compressed 11681904 / 11618604 / +0.5% 37127957 / 41766392 / -11.1% 🟢 0.31 / 0.28 / +13.1%
fineweb_q03/datafusion:vortex-file-compressed 17437690 / 17329895 / +0.6% 100367094 / 108086646 / -7.1% 0.17 / 0.16 / +8.4%
fineweb_q04/datafusion:vortex-file-compressed 69692796 / 65737414 / +6.0% 135503368 / 145352776 / -6.8% 0.51 / 0.45 / +13.7%
fineweb_q05/datafusion:vortex-file-compressed 61680096 / 61795532 / -0.2% 136382987 / 137019662 / -0.5% 0.45 / 0.45 / +0.3%
fineweb_q06/datafusion:vortex-file-compressed 17531350 / 18066823 / -3.0% 99371281 / 104665880 / -5.1% 0.18 / 0.17 / +2.2%
fineweb_q07/datafusion:vortex-file-compressed 18831946 / 18844782 / -0.1% 97185741 / 103604493 / -6.2% 0.19 / 0.18 / +6.5%
fineweb_q08/datafusion:vortex-file-compressed 8994049 / 7447691 / +20.8% 🔴 25228614 / 30345802 / -16.9% 🟢 0.36 / 0.25 / +45.3%
datafusion / vortex-compact / ns (0.991x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6151370 / 6258444 / -1.7% 18461411 / 19552748 / -5.6% 0.33 / 0.32 / +4.1%
fineweb_q01/datafusion:vortex-compact 102061404 / 102092550 / -0.0% 135251919 / 138381924 / -2.3% 0.75 / 0.74 / +2.3%
fineweb_q02/datafusion:vortex-compact 102870712 / 103417214 / -0.5% 135753901 / 139136467 / -2.4% 0.76 / 0.74 / +2.0%
fineweb_q03/datafusion:vortex-compact 176684432 / 179778118 / -1.7% 253728523 / 256250033 / -1.0% 0.70 / 0.70 / -0.7%
fineweb_q04/datafusion:vortex-compact 191150450 / 203269753 / -6.0% 257560757 / 263784816 / -2.4% 0.74 / 0.77 / -3.7%
fineweb_q05/datafusion:vortex-compact 180204394 / 179753922 / +0.3% 249824617 / 258053969 / -3.2% 0.72 / 0.70 / +3.6%
fineweb_q06/datafusion:vortex-compact 118650395 / 136385981 / -13.0% 🟢 191454098 / 197565118 / -3.1% 0.62 / 0.69 / -10.2%
fineweb_q07/datafusion:vortex-compact 120902142 / 121955704 / -0.9% 200559703 / 251649593 / -20.3% 🟢 0.60 / 0.48 / +24.4%
fineweb_q08/datafusion:vortex-compact 10528838 / 8916744 / +18.1% 🔴 23689113 / 26593637 / -10.9% 🟢 0.44 / 0.34 / +32.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9439385 / 9347190 / +1.0% 32892506 / 33061275 / -0.5% 0.29 / 0.28 / +1.5%
fineweb_q01/datafusion:parquet 74810762 / 74932425 / -0.2% 148273709 / 150742572 / -1.6% 0.50 / 0.50 / +1.5%
fineweb_q02/datafusion:parquet 75138554 / 74583498 / +0.7% 149147366 / 163418319 / -8.7% 0.50 / 0.46 / +10.4%
fineweb_q03/datafusion:parquet 74263434 / 73245926 / +1.4% 139689684 / 146136322 / -4.4% 0.53 / 0.50 / +6.1%
fineweb_q04/datafusion:parquet 81677486 / 81855403 / -0.2% 141915243 / 149348852 / -5.0% 0.58 / 0.55 / +5.0%
fineweb_q05/datafusion:parquet 80181848 / 79554145 / +0.8% 144910878 / 154855107 / -6.4% 0.55 / 0.51 / +7.7%
fineweb_q06/datafusion:parquet 75362407 / 75032262 / +0.4% 144915132 / 149137469 / -2.8% 0.52 / 0.50 / +3.4%
fineweb_q07/datafusion:parquet 73753834 / 73707845 / +0.1% 147679322 / 147218019 / +0.3% 0.50 / 0.50 / -0.3%
fineweb_q08/datafusion:parquet 72494953 / 73897006 / -1.9% 142290653 / 148685620 / -4.3% 0.51 / 0.50 / +2.5%
duckdb / vortex-file-compressed / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2072962 / 2054080 / +0.9% 7297346 / 8030872 / -9.1% 0.28 / 0.26 / +11.1%
fineweb_q01/duckdb:vortex-file-compressed 7958854 / 8039040 / -1.0% 25863193 / 27088970 / -4.5% 0.31 / 0.30 / +3.7%
fineweb_q02/duckdb:vortex-file-compressed 9233518 / 9083977 / +1.6% 26967752 / 31774590 / -15.1% 🟢 0.34 / 0.29 / +19.8%
fineweb_q03/duckdb:vortex-file-compressed 19197296 / 19157832 / +0.2% 87035507 / 98793352 / -11.9% 🟢 0.22 / 0.19 / +13.7%
fineweb_q04/duckdb:vortex-file-compressed 65708824 / 65255572 / +0.7% 101844668 / 112260318 / -9.3% 0.65 / 0.58 / +11.0%
fineweb_q05/duckdb:vortex-file-compressed 64906360 / 65341412 / -0.7% 100724464 / 108297733 / -7.0% 0.64 / 0.60 / +6.8%
fineweb_q06/duckdb:vortex-file-compressed 18281021 / 18257114 / +0.1% 87215357 / 91068935 / -4.2% 0.21 / 0.20 / +4.6%
fineweb_q07/duckdb:vortex-file-compressed 17256546 / 17490810 / -1.3% 86226794 / 91425750 / -5.7% 0.20 / 0.19 / +4.6%
fineweb_q08/duckdb:vortex-file-compressed 4307446 / 4946861 / -12.9% 🟢 13067391 / 13182286 / -0.9% 0.33 / 0.38 / -12.2%
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2370154 / 2231304 / +6.2% 7284334 / 8250580 / -11.7% 🟢 0.33 / 0.27 / +20.3%
fineweb_q01/duckdb:vortex-compact 38581260 / 38978628 / -1.0% 56831777 / 57125269 / -0.5% 0.68 / 0.68 / -0.5%
fineweb_q02/duckdb:vortex-compact 39316890 / 39552318 / -0.6% 56843458 / 59594716 / -4.6% 0.69 / 0.66 / +4.2%
fineweb_q03/duckdb:vortex-compact 150787002 / 151130680 / -0.2% 181240794 / 183420049 / -1.2% 0.83 / 0.82 / +1.0%
fineweb_q04/duckdb:vortex-compact 159208538 / 167320752 / -4.8% 195144777 / 195431810 / -0.1% 0.82 / 0.86 / -4.7%
fineweb_q05/duckdb:vortex-compact 152157472 / 151102574 / +0.7% 187858243 / 187177533 / +0.4% 0.81 / 0.81 / +0.3%
fineweb_q06/duckdb:vortex-compact 83572058 / 82037974 / +1.9% 123182830 / 122621126 / +0.5% 0.68 / 0.67 / +1.4%
fineweb_q07/duckdb:vortex-compact 83792140 / 84276077 / -0.6% 124354066 / 125415038 / -0.8% 0.67 / 0.67 / +0.3%
fineweb_q08/duckdb:vortex-compact 4604176 / 4366362 / +5.4% 10018481 / 11087850 / -9.6% 0.46 / 0.39 / +16.7%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23238594 / 23445777 / -0.9% 27239313 / 28195844 / -3.4% 0.85 / 0.83 / +2.6%
fineweb_q01/duckdb:parquet 52022372 / 53982162 / -3.6% 68534888 / 71997604 / -4.8% 0.76 / 0.75 / +1.2%
fineweb_q02/duckdb:parquet 58159930 / 57294482 / +1.5% 77557902 / 77346633 / +0.3% 0.75 / 0.74 / +1.2%
fineweb_q03/duckdb:parquet 118231044 / 117275600 / +0.8% 171686364 / 177695815 / -3.4% 0.69 / 0.66 / +4.3%
fineweb_q04/duckdb:parquet 159837645 / 162362744 / -1.6% 196771949 / 207889629 / -5.3% 0.81 / 0.78 / +4.0%
fineweb_q05/duckdb:parquet 158469332 / 154398161 / +2.6% 200073611 / 198729928 / +0.7% 0.79 / 0.78 / +1.9%
fineweb_q06/duckdb:parquet 87004028 / 87783252 / -0.9% 147627422 / 145322183 / +1.6% 0.59 / 0.60 / -2.4%
fineweb_q07/duckdb:parquet 90687160 / 91502205 / -0.9% 144710763 / 144300475 / +0.3% 0.63 / 0.63 / -1.2%
fineweb_q08/duckdb:parquet 28317839 / 29233083 / -3.1% 30443772 / 29945779 / +1.7% 0.93 / 0.98 / -4.7%

@myrrc myrrc changed the title duckdb: report distinctcount based on min/max duckdb: report distinct count based on min/max Nov 3, 2026
@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-2.0%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.975x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 182375160 / 199557165 / -8.6% 545163133 / 646780894 / -15.7% 🟢 0.33 / 0.31 / +8.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10498169 / 9815442 / +7.0% 54081448 / 56605890 / -4.5% 0.19 / 0.17 / +11.9%
clickbench-sorted_q26/datafusion:vortex-file-compressed 10538634 / 11339855 / -7.1% 59232785 / 58653441 / +1.0% 0.18 / 0.19 / -8.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22361172 / 22964880 / -2.6% 74441874 / 75200564 / -1.0% 0.30 / 0.31 / -1.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18068934 / 18157292 / -0.5% 61660325 / 61613917 / +0.1% 0.29 / 0.29 / -0.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed 13462614 / 12945350 / +4.0% 58046274 / 66100077 / -12.2% 🟢 0.23 / 0.20 / +18.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed 37509508 / 38478272 / -2.5% 98228610 / 99674733 / -1.5% 0.38 / 0.39 / -1.1%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11532540 / 11278472 / +2.3% 42179235 / 45254119 / -6.8% 0.27 / 0.25 / +9.7%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11217475 / 10685330 / +5.0% 43821105 / 44597867 / -1.7% 0.26 / 0.24 / +6.8%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9363006 / 9679677 / -3.3% 38428974 / 37632245 / +2.1% 0.24 / 0.26 / -5.3%
datafusion / parquet / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 745425156 / 740287878 / +0.7% 938544197 / 962958388 / -2.5% 0.79 / 0.77 / +3.3%
clickbench-sorted_q24/datafusion:parquet 9074994 / 8654056 / +4.9% 73067630 / 73579879 / -0.7% 0.12 / 0.12 / +5.6%
clickbench-sorted_q26/datafusion:parquet 9460640 / 8731386 / +8.4% 72958225 / 71732218 / +1.7% 0.13 / 0.12 / +6.5%
clickbench-sorted_q36/datafusion:parquet 89657126 / 90271656 / -0.7% 163934681 / 171739257 / -4.5% 0.55 / 0.53 / +4.0%
clickbench-sorted_q37/datafusion:parquet 61198737 / 61193726 / +0.0% 125526412 / 127548246 / -1.6% 0.49 / 0.48 / +1.6%
clickbench-sorted_q38/datafusion:parquet 83331566 / 84087350 / -0.9% 156196302 / 161320032 / -3.2% 0.53 / 0.52 / +2.4%
clickbench-sorted_q39/datafusion:parquet 152585379 / 152622568 / -0.0% 225047701 / 230348649 / -2.3% 0.68 / 0.66 / +2.3%
clickbench-sorted_q40/datafusion:parquet 41965041 / 42125780 / -0.4% 109866798 / 116694893 / -5.9% 0.38 / 0.36 / +5.8%
clickbench-sorted_q41/datafusion:parquet 39638758 / 39745184 / -0.3% 107078932 / 111614399 / -4.1% 0.37 / 0.36 / +4.0%
clickbench-sorted_q42/datafusion:parquet 25098366 / 24822025 / +1.1% 83684737 / 84550577 / -1.0% 0.30 / 0.29 / +2.2%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 35390310 / 35307854 / +0.2% 72743126 / 61025449 / +19.2% 🔴 0.49 / 0.58 / -15.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 9642001 / 9581024 / +0.6% 30098222 / 28167212 / +6.9% 0.32 / 0.34 / -5.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 9110240 / 8533593 / +6.8% 28206931 / 31341584 / -10.0% 🟢 0.32 / 0.27 / +18.6%
clickbench-sorted_q36/duckdb:vortex-file-compressed 21904720 / 21963714 / -0.3% 51381968 / 50056723 / +2.6% 0.43 / 0.44 / -2.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 17868608 / 17590032 / +1.6% 45038978 / 44111684 / +2.1% 0.40 / 0.40 / -0.5%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18045194 / 18378252 / -1.8% 49652563 / 51287726 / -3.2% 0.36 / 0.36 / +1.4%
clickbench-sorted_q39/duckdb:vortex-file-compressed 42471814 / 42528882 / -0.1% 83416233 / 83861791 / -0.5% 0.51 / 0.51 / +0.4%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10651810 / 10821010 / -1.6% 36027210 / 35532856 / +1.4% 0.30 / 0.30 / -2.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11981994 / 11848850 / +1.1% 37409084 / 37192810 / +0.6% 0.32 / 0.32 / +0.5%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8952253 / 8991263 / -0.4% 29962912 / 29736821 / +0.8% 0.30 / 0.30 / -1.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 143798660 / 142973198 / +0.6% 179303227 / 181945116 / -1.5% 0.80 / 0.79 / +2.1%
clickbench-sorted_q24/duckdb:parquet 15752804 / 15678574 / +0.5% 17299799 / 17746158 / -2.5% 0.91 / 0.88 / +3.1%
clickbench-sorted_q26/duckdb:parquet 16043698 / 15393960 / +4.2% 19222417 / 20138904 / -4.6% 0.83 / 0.76 / +9.2%
clickbench-sorted_q36/duckdb:parquet 46752377 / 46433962 / +0.7% 61777384 / 63834262 / -3.2% 0.76 / 0.73 / +4.0%
clickbench-sorted_q37/duckdb:parquet 35577079 / 37747860 / -5.8% 44716127 / 44335188 / +0.9% 0.80 / 0.85 / -6.6%
clickbench-sorted_q38/duckdb:parquet 42565369 / 41868890 / +1.7% 52108425 / 61621378 / -15.4% 🟢 0.82 / 0.68 / +20.2%
clickbench-sorted_q39/duckdb:parquet 75776070 / 73945420 / +2.5% 83388810 / 87907425 / -5.1% 0.91 / 0.84 / +8.0%
clickbench-sorted_q40/duckdb:parquet 22906710 / 22336020 / +2.6% 28999913 / 29886142 / -3.0% 0.79 / 0.75 / +5.7%
clickbench-sorted_q41/duckdb:parquet 22651006 / 23703372 / -4.4% 30513283 / 27995090 / +9.0% 0.74 / 0.85 / -12.3%
clickbench-sorted_q42/duckdb:parquet 16856000 / 16987058 / -0.8% 22068291 / 21942300 / +0.6% 0.76 / 0.77 / -1.3%
duckdb / duckdb / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 70343959 / 72293296 / -2.7% 123976556 / 120225657 / +3.1% 0.57 / 0.60 / -5.6%
clickbench-sorted_q24/duckdb:duckdb 23857822 / 23088810 / +3.3% 30338011 / 29405933 / +3.2% 0.79 / 0.79 / +0.2%
clickbench-sorted_q26/duckdb:duckdb 23530520 / 24310494 / -3.2% 30372895 / 31247411 / -2.8% 0.77 / 0.78 / -0.4%
clickbench-sorted_q36/duckdb:duckdb 38504446 / 38184646 / +0.8% 74610689 / 71732922 / +4.0% 0.52 / 0.53 / -3.1%
clickbench-sorted_q37/duckdb:duckdb 38104380 / 36179846 / +5.3% 75125447 / 72829133 / +3.2% 0.51 / 0.50 / +2.1%
clickbench-sorted_q38/duckdb:duckdb 30208306 / 29882274 / +1.1% 65483247 / 66667942 / -1.8% 0.46 / 0.45 / +2.9%
clickbench-sorted_q39/duckdb:duckdb 54126234 / 53519234 / +1.1% 109443128 / 108022234 / +1.3% 0.49 / 0.50 / -0.2%
clickbench-sorted_q40/duckdb:duckdb 21508270 / 21949190 / -2.0% 45596861 / 46568134 / -2.1% 0.47 / 0.47 / +0.1%
clickbench-sorted_q41/duckdb:duckdb 21224606 / 20775591 / +2.2% 39166401 / 39770604 / -1.5% 0.54 / 0.52 / +3.7%
clickbench-sorted_q42/duckdb:duckdb 17013371 / 17011982 / +0.0% 28148471 / 28623461 / -1.7% 0.60 / 0.59 / +1.7%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15664673 / 16263915 / -3.7% 43607562 / 44263199 / -1.5% 0.36 / 0.37 / -2.2%
tpch_q02/datafusion:vortex-file-compressed 16624822 / 16894974 / -1.6% 35962023 / 36611616 / -1.8% 0.46 / 0.46 / +0.2%
tpch_q03/datafusion:vortex-file-compressed 19407689 / 19527766 / -0.6% 46835488 / 49847443 / -6.0% 0.41 / 0.39 / +5.8%
tpch_q04/datafusion:vortex-file-compressed 10623392 / 10188611 / +4.3% 36209328 / 35817404 / +1.1% 0.29 / 0.28 / +3.1%
tpch_q05/datafusion:vortex-file-compressed 37370491 / 37541382 / -0.5% 69132254 / 67849249 / +1.9% 0.54 / 0.55 / -2.3%
tpch_q06/datafusion:vortex-file-compressed 6086198 / 5955274 / +2.2% 28547236 / 28481717 / +0.2% 0.21 / 0.21 / +2.0%
tpch_q07/datafusion:vortex-file-compressed 50919668 / 51398304 / -0.9% 82576064 / 82045194 / +0.6% 0.62 / 0.63 / -1.6%
tpch_q08/datafusion:vortex-file-compressed 51054244 / 51875388 / -1.6% 83171430 / 80701452 / +3.1% 0.61 / 0.64 / -4.5%
tpch_q09/datafusion:vortex-file-compressed 50200854 / 47995869 / +4.6% 76551495 / 80826300 / -5.3% 0.66 / 0.59 / +10.4%
tpch_q10/datafusion:vortex-file-compressed 17285944 / 17741482 / -2.6% 53806030 / 53082340 / +1.4% 0.32 / 0.33 / -3.9%
tpch_q11/datafusion:vortex-file-compressed 14164556 / 14031627 / +0.9% 34519308 / 33512469 / +3.0% 0.41 / 0.42 / -2.0%
tpch_q12/datafusion:vortex-file-compressed 18303694 / 18328359 / -0.1% 45060591 / 45157861 / -0.2% 0.41 / 0.41 / +0.1%
tpch_q13/datafusion:vortex-file-compressed 19218583 / 19616934 / -2.0% 42776865 / 38185157 / +12.0% 🔴 0.45 / 0.51 / -12.5%
tpch_q14/datafusion:vortex-file-compressed 14331048 / 14594152 / -1.8% 38973321 / 39735581 / -1.9% 0.37 / 0.37 / +0.1%
tpch_q15/datafusion:vortex-file-compressed 18635657 / 18763971 / -0.7% 46852923 / 43533246 / +7.6% 0.40 / 0.43 / -7.7%
tpch_q16/datafusion:vortex-file-compressed 18350155 / 18234276 / +0.6% 39960165 / 37635522 / +6.2% 0.46 / 0.48 / -5.2%
tpch_q17/datafusion:vortex-file-compressed 27995909 / 28378421 / -1.3% 60969760 / 61847418 / -1.4% 0.46 / 0.46 / +0.1%
tpch_q18/datafusion:vortex-file-compressed 35545380 / 35305543 / +0.7% 59017200 / 61599150 / -4.2% 0.60 / 0.57 / +5.1%
tpch_q19/datafusion:vortex-file-compressed 11517157 / 11827307 / -2.6% 39235273 / 35891404 / +9.3% 0.29 / 0.33 / -10.9%
tpch_q20/datafusion:vortex-file-compressed 20337422 / 20441467 / -0.5% 44345054 / 46957425 / -5.6% 0.46 / 0.44 / +5.4%
tpch_q21/datafusion:vortex-file-compressed 38959268 / 38735030 / +0.6% 71665527 / 69895942 / +2.5% 0.54 / 0.55 / -1.9%
tpch_q22/datafusion:vortex-file-compressed 10859369 / 10820078 / +0.4% 30342523 / 29933093 / +1.4% 0.36 / 0.36 / -1.0%
datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16839259 / 16556346 / +1.7% 42886387 / 44081939 / -2.7% 0.39 / 0.38 / +4.5%
tpch_q02/datafusion:vortex-compact 18276417 / 18006215 / +1.5% 36855201 / 37362683 / -1.4% 0.50 / 0.48 / +2.9%
tpch_q03/datafusion:vortex-compact 19974974 / 20280995 / -1.5% 45800479 / 43439071 / +5.4% 0.44 / 0.47 / -6.6%
tpch_q04/datafusion:vortex-compact 11576674 / 11215686 / +3.2% 29829730 / 32731992 / -8.9% 0.39 / 0.34 / +13.3%
tpch_q05/datafusion:vortex-compact 37614554 / 37165357 / +1.2% 62884196 / 63001300 / -0.2% 0.60 / 0.59 / +1.4%
tpch_q06/datafusion:vortex-compact 6738104 / 6577600 / +2.4% 27490904 / 27082506 / +1.5% 0.25 / 0.24 / +0.9%
tpch_q07/datafusion:vortex-compact 52562399 / 52397865 / +0.3% 79996050 / 78623450 / +1.7% 0.66 / 0.67 / -1.4%
tpch_q08/datafusion:vortex-compact 51367895 / 52809857 / -2.7% 79986729 / 76049831 / +5.2% 0.64 / 0.69 / -7.5%
tpch_q09/datafusion:vortex-compact 47935195 / 47585496 / +0.7% 77279746 / 78454761 / -1.5% 0.62 / 0.61 / +2.3%
tpch_q10/datafusion:vortex-compact 18995603 / 19184360 / -1.0% 47930621 / 47724123 / +0.4% 0.40 / 0.40 / -1.4%
tpch_q11/datafusion:vortex-compact 14405377 / 14617682 / -1.5% 33062441 / 33501448 / -1.3% 0.44 / 0.44 / -0.1%
tpch_q12/datafusion:vortex-compact 19819613 / 19951087 / -0.7% 42994979 / 42402902 / +1.4% 0.46 / 0.47 / -2.0%
tpch_q13/datafusion:vortex-compact 21107055 / 19603489 / +7.7% 38562524 / 39716709 / -2.9% 0.55 / 0.49 / +10.9%
tpch_q14/datafusion:vortex-compact 15418637 / 15457750 / -0.3% 39259593 / 39753230 / -1.2% 0.39 / 0.39 / +1.0%
tpch_q15/datafusion:vortex-compact 20502563 / 20364141 / +0.7% 44135255 / 44827397 / -1.5% 0.46 / 0.45 / +2.3%
tpch_q16/datafusion:vortex-compact 18685762 / 18664806 / +0.1% 37849384 / 38833373 / -2.5% 0.49 / 0.48 / +2.7%
tpch_q17/datafusion:vortex-compact 29193095 / 28435817 / +2.7% 58542125 / 60185612 / -2.7% 0.50 / 0.47 / +5.5%
tpch_q18/datafusion:vortex-compact 35457961 / 35685949 / -0.6% 56500513 / 58322644 / -3.1% 0.63 / 0.61 / +2.6%
tpch_q19/datafusion:vortex-compact 13354646 / 13642513 / -2.1% 40435056 / 41038425 / -1.5% 0.33 / 0.33 / -0.6%
tpch_q20/datafusion:vortex-compact 21092852 / 21024112 / +0.3% 45175270 / 46874173 / -3.6% 0.47 / 0.45 / +4.1%
tpch_q21/datafusion:vortex-compact 40782269 / 40661410 / +0.3% 69013799 / 69060197 / -0.1% 0.59 / 0.59 / +0.4%
tpch_q22/datafusion:vortex-compact 11199021 / 11149811 / +0.4% 30143778 / 30999620 / -2.8% 0.37 / 0.36 / +3.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71720367 / 71895679 / -0.2% 90702793 / 90101832 / +0.7% 0.79 / 0.80 / -0.9%
tpch_q02/datafusion:parquet 76594531 / 76098843 / +0.7% 96101737 / 90855700 / +5.8% 0.80 / 0.84 / -4.8%
tpch_q03/datafusion:parquet 82056107 / 81802859 / +0.3% 104989567 / 104624570 / +0.3% 0.78 / 0.78 / -0.0%
tpch_q04/datafusion:parquet 39380393 / 39443450 / -0.2% 59970270 / 56105007 / +6.9% 0.66 / 0.70 / -6.6%
tpch_q05/datafusion:parquet 110443650 / 110243073 / +0.2% 137605474 / 137233632 / +0.3% 0.80 / 0.80 / -0.1%
tpch_q06/datafusion:parquet 31283393 / 31285870 / -0.0% 49899685 / 48958203 / +1.9% 0.63 / 0.64 / -1.9%
tpch_q07/datafusion:parquet 112798732 / 112628638 / +0.2% 140248629 / 140164965 / +0.1% 0.80 / 0.80 / +0.1%
tpch_q08/datafusion:parquet 117019790 / 117365432 / -0.3% 142808950 / 144858333 / -1.4% 0.82 / 0.81 / +1.1%
tpch_q09/datafusion:parquet 137344230 / 137648335 / -0.2% 166909483 / 165675523 / +0.7% 0.82 / 0.83 / -1.0%
tpch_q10/datafusion:parquet 103482349 / 104232599 / -0.7% 128282817 / 131557659 / -2.5% 0.81 / 0.79 / +1.8%
tpch_q11/datafusion:parquet 61639889 / 61117621 / +0.9% 82902575 / 83469534 / -0.7% 0.74 / 0.73 / +1.5%
tpch_q12/datafusion:parquet 63900703 / 63935260 / -0.1% 85124136 / 85713684 / -0.7% 0.75 / 0.75 / +0.6%
tpch_q13/datafusion:parquet 143667966 / 143039529 / +0.4% 163058779 / 163205266 / -0.1% 0.88 / 0.88 / +0.5%
tpch_q14/datafusion:parquet 47735601 / 47461665 / +0.6% 70634862 / 70523444 / +0.2% 0.68 / 0.67 / +0.4%
tpch_q15/datafusion:parquet 73626528 / 73406392 / +0.3% 93328144 / 92742867 / +0.6% 0.79 / 0.79 / -0.3%
tpch_q16/datafusion:parquet 43920984 / 43563928 / +0.8% 62074932 / 63270122 / -1.9% 0.71 / 0.69 / +2.8%
tpch_q17/datafusion:parquet 123430892 / 123301020 / +0.1% 146685290 / 147211074 / -0.4% 0.84 / 0.84 / +0.5%
tpch_q18/datafusion:parquet 121222465 / 121046192 / +0.1% 140378407 / 142737474 / -1.7% 0.86 / 0.85 / +1.8%
tpch_q19/datafusion:parquet 56682846 / 57598916 / -1.6% 83592312 / 84233107 / -0.8% 0.68 / 0.68 / -0.8%
tpch_q20/datafusion:parquet 78237283 / 77933849 / +0.4% 104443170 / 103206085 / +1.2% 0.75 / 0.76 / -0.8%
tpch_q21/datafusion:parquet 113533575 / 113408807 / +0.1% 137943124 / 138663269 / -0.5% 0.82 / 0.82 / +0.6%
tpch_q22/datafusion:parquet 51246162 / 52165988 / -1.8% 70524964 / 67936274 / +3.8% 0.73 / 0.77 / -5.4%
duckdb / vortex-file-compressed / ns (1.014x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8658385 / 9761332 / -11.3% 🟢 18710262 / 18912466 / -1.1% 0.46 / 0.52 / -10.3%
tpch_q02/duckdb:vortex-file-compressed 15118923 / 15133618 / -0.1% 24651909 / 25240568 / -2.3% 0.61 / 0.60 / +2.3%
tpch_q03/duckdb:vortex-file-compressed 18738490 / 18478693 / +1.4% 34343007 / 35420760 / -3.0% 0.55 / 0.52 / +4.6%
tpch_q04/duckdb:vortex-file-compressed 12277702 / 12526559 / -2.0% 26660260 / 26797289 / -0.5% 0.46 / 0.47 / -1.5%
tpch_q05/duckdb:vortex-file-compressed 20273355 / 19984330 / +1.4% 37061356 / 35135251 / +5.5% 0.55 / 0.57 / -3.8%
tpch_q06/duckdb:vortex-file-compressed 4832185 / 4707229 / +2.7% 15039687 / 14897236 / +1.0% 0.32 / 0.32 / +1.7%
tpch_q07/duckdb:vortex-file-compressed 23985653 / 24433501 / -1.8% 40527527 / 40669053 / -0.3% 0.59 / 0.60 / -1.5%
tpch_q08/duckdb:vortex-file-compressed 21427668 / 21158117 / +1.3% 38692947 / 37360088 / +3.6% 0.55 / 0.57 / -2.2%
tpch_q09/duckdb:vortex-file-compressed 21982910 / 21780886 / +0.9% 39136783 / 39377115 / -0.6% 0.56 / 0.55 / +1.5%
tpch_q10/duckdb:vortex-file-compressed 26970829 / 23061494 / +17.0% 🔴 43413278 / 40021706 / +8.5% 0.62 / 0.58 / +7.8%
tpch_q11/duckdb:vortex-file-compressed 7995781 / 8190706 / -2.4% 17283717 / 17311375 / -0.2% 0.46 / 0.47 / -2.2%
tpch_q12/duckdb:vortex-file-compressed 14542436 / 14552453 / -0.1% 26958317 / 27518794 / -2.0% 0.54 / 0.53 / +2.0%
tpch_q13/duckdb:vortex-file-compressed 19597978 / 19645042 / -0.2% 32488076 / 32940206 / -1.4% 0.60 / 0.60 / +1.1%
tpch_q14/duckdb:vortex-file-compressed 11298406 / 11380023 / -0.7% 23599782 / 24837163 / -5.0% 0.48 / 0.46 / +4.5%
tpch_q15/duckdb:vortex-file-compressed 8775198 / 8545626 / +2.7% 20704502 / 20629863 / +0.4% 0.42 / 0.41 / +2.3%
tpch_q16/duckdb:vortex-file-compressed 16542072 / 16616443 / -0.4% 23646515 / 22882070 / +3.3% 0.70 / 0.73 / -3.7%
tpch_q17/duckdb:vortex-file-compressed 12577308 / 12625912 / -0.4% 26997316 / 26443070 / +2.1% 0.47 / 0.48 / -2.4%
tpch_q18/duckdb:vortex-file-compressed 24105365 / 24532908 / -1.7% 33749719 / 34479790 / -2.1% 0.71 / 0.71 / +0.4%
tpch_q19/duckdb:vortex-file-compressed 12148474 / 12047148 / +0.8% 26485477 / 25716209 / +3.0% 0.46 / 0.47 / -2.1%
tpch_q20/duckdb:vortex-file-compressed 14239206 / 14345954 / -0.7% 31940520 / 30444524 / +4.9% 0.45 / 0.47 / -5.4%
tpch_q21/duckdb:vortex-file-compressed 49234766 / 37122052 / +32.6% 🔴 64107413 / 57121904 / +12.2% 🔴 0.77 / 0.65 / +18.2%
tpch_q22/duckdb:vortex-file-compressed 16514521 / 16816566 / -1.8% 27350261 / 25979595 / +5.3% 0.60 / 0.65 / -6.7%
duckdb / vortex-compact / ns (1.024x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 11320648 / 11066451 / +2.3% 20121518 / 23639783 / -14.9% 🟢 0.56 / 0.47 / +20.2%
tpch_q02/duckdb:vortex-compact 18370655 / 18430229 / -0.3% 26906760 / 26843794 / +0.2% 0.68 / 0.69 / -0.6%
tpch_q03/duckdb:vortex-compact 19867124 / 20592004 / -3.5% 34317661 / 35785524 / -4.1% 0.58 / 0.58 / +0.6%
tpch_q04/duckdb:vortex-compact 12966926 / 13062317 / -0.7% 25860562 / 25971457 / -0.4% 0.50 / 0.50 / -0.3%
tpch_q05/duckdb:vortex-compact 21017153 / 21022671 / -0.0% 35699842 / 35939419 / -0.7% 0.59 / 0.58 / +0.6%
tpch_q06/duckdb:vortex-compact 5384744 / 5323590 / +1.1% 14558704 / 15131454 / -3.8% 0.37 / 0.35 / +5.1%
tpch_q07/duckdb:vortex-compact 25446258 / 25274767 / +0.7% 39800826 / 41150071 / -3.3% 0.64 / 0.61 / +4.1%
tpch_q08/duckdb:vortex-compact 22489462 / 21872745 / +2.8% 39615887 / 37877001 / +4.6% 0.57 / 0.58 / -1.7%
tpch_q09/duckdb:vortex-compact 23909676 / 23568541 / +1.4% 39679399 / 40361568 / -1.7% 0.60 / 0.58 / +3.2%
tpch_q10/duckdb:vortex-compact 30802351 / 25995457 / +18.5% 🔴 45533845 / 42159039 / +8.0% 0.68 / 0.62 / +9.7%
tpch_q11/duckdb:vortex-compact 8747503 / 8663384 / +1.0% 17872467 / 17705209 / +0.9% 0.49 / 0.49 / +0.0%
tpch_q12/duckdb:vortex-compact 17614281 / 17538414 / +0.4% 27046057 / 28629270 / -5.5% 0.65 / 0.61 / +6.3%
tpch_q13/duckdb:vortex-compact 19994010 / 20066808 / -0.4% 32999564 / 31682238 / +4.2% 0.61 / 0.63 / -4.3%
tpch_q14/duckdb:vortex-compact 12562850 / 12536295 / +0.2% 26613427 / 26849355 / -0.9% 0.47 / 0.47 / +1.1%
tpch_q15/duckdb:vortex-compact 9858002 / 9658595 / +2.1% 22770471 / 22977507 / -0.9% 0.43 / 0.42 / +3.0%
tpch_q16/duckdb:vortex-compact 17226093 / 17329645 / -0.6% 22996579 / 22991274 / +0.0% 0.75 / 0.75 / -0.6%
tpch_q17/duckdb:vortex-compact 13718575 / 13354417 / +2.7% 28593558 / 27354910 / +4.5% 0.48 / 0.49 / -1.7%
tpch_q18/duckdb:vortex-compact 24560546 / 24650665 / -0.4% 33856847 / 34395552 / -1.6% 0.73 / 0.72 / +1.2%
tpch_q19/duckdb:vortex-compact 15182908 / 15276078 / -0.6% 30419835 / 28825175 / +5.5% 0.50 / 0.53 / -5.8%
tpch_q20/duckdb:vortex-compact 17213880 / 17050461 / +1.0% 32100555 / 32697589 / -1.8% 0.54 / 0.52 / +2.8%
tpch_q21/duckdb:vortex-compact 49962609 / 38435765 / +30.0% 🔴 64108999 / 55332301 / +15.9% 🔴 0.78 / 0.69 / +12.2%
tpch_q22/duckdb:vortex-compact 19401523 / 19566815 / -0.8% 29213145 / 28561764 / +2.3% 0.66 / 0.69 / -3.1%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47571038 / 47858045 / -0.6% 54394658 / 54404459 / -0.0% 0.87 / 0.88 / -0.6%
tpch_q02/duckdb:parquet 48145682 / 48336474 / -0.4% 54896852 / 55353685 / -0.8% 0.88 / 0.87 / +0.4%
tpch_q03/duckdb:parquet 60018008 / 60227192 / -0.3% 68747555 / 68349323 / +0.6% 0.87 / 0.88 / -0.9%
tpch_q04/duckdb:parquet 34661810 / 34720265 / -0.2% 43188511 / 43310065 / -0.3% 0.80 / 0.80 / +0.1%
tpch_q05/duckdb:parquet 67108753 / 67254941 / -0.2% 76904112 / 77626992 / -0.9% 0.87 / 0.87 / +0.7%
tpch_q06/duckdb:parquet 21763508 / 21944900 / -0.8% 26977283 / 27248080 / -1.0% 0.81 / 0.81 / +0.2%
tpch_q07/duckdb:parquet 63906387 / 63950143 / -0.1% 74139703 / 73664982 / +0.6% 0.86 / 0.87 / -0.7%
tpch_q08/duckdb:parquet 75765564 / 75776774 / -0.0% 86321075 / 86626463 / -0.4% 0.88 / 0.87 / +0.3%
tpch_q09/duckdb:parquet 107563791 / 107707033 / -0.1% 119499267 / 119514067 / -0.0% 0.90 / 0.90 / -0.1%
tpch_q10/duckdb:parquet 105431037 / 105854709 / -0.4% 117040531 / 118365462 / -1.1% 0.90 / 0.89 / +0.7%
tpch_q11/duckdb:parquet 29393787 / 29396110 / -0.0% 34560808 / 34577937 / -0.0% 0.85 / 0.85 / +0.0%
tpch_q12/duckdb:parquet 37185185 / 37190745 / -0.0% 44217715 / 44080916 / +0.3% 0.84 / 0.84 / -0.3%
tpch_q13/duckdb:parquet 174450082 / 174943548 / -0.3% 181066560 / 181832631 / -0.4% 0.96 / 0.96 / +0.1%
tpch_q14/duckdb:parquet 42261778 / 42368298 / -0.3% 50451025 / 51640657 / -2.3% 0.84 / 0.82 / +2.1%
tpch_q15/duckdb:parquet 32502523 / 32604664 / -0.3% 41244624 / 41186217 / +0.1% 0.79 / 0.79 / -0.5%
tpch_q16/duckdb:parquet 46844774 / 47438886 / -1.3% 51905126 / 52839714 / -1.8% 0.90 / 0.90 / +0.5%
tpch_q17/duckdb:parquet 47813356 / 47948653 / -0.3% 56829696 / 56916284 / -0.2% 0.84 / 0.84 / -0.1%
tpch_q18/duckdb:parquet 73747690 / 74218067 / -0.6% 80822105 / 81836806 / -1.2% 0.91 / 0.91 / +0.6%
tpch_q19/duckdb:parquet 48717091 / 47859814 / +1.8% 55001657 / 54599501 / +0.7% 0.89 / 0.88 / +1.0%
tpch_q20/duckdb:parquet 63375063 / 63470737 / -0.2% 73488533 / 74451035 / -1.3% 0.86 / 0.85 / +1.2%
tpch_q21/duckdb:parquet 106284926 / 106811631 / -0.5% 114882648 / 115756341 / -0.8% 0.93 / 0.92 / +0.3%
tpch_q22/duckdb:parquet 50332280 / 50510487 / -0.4% 58466816 / 58832593 / -0.6% 0.86 / 0.86 / +0.3%
duckdb / duckdb / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6222710 / 6271635 / -0.8% 14407140 / 14433941 / -0.2% 0.43 / 0.43 / -0.6%
tpch_q02/duckdb:duckdb 8779001 / 8712230 / +0.8% 16647297 / 17047838 / -2.3% 0.53 / 0.51 / +3.2%
tpch_q03/duckdb:duckdb 15448313 / 15558338 / -0.7% 25332059 / 25434360 / -0.4% 0.61 / 0.61 / -0.3%
tpch_q04/duckdb:duckdb 11328913 / 11466349 / -1.2% 22065238 / 21560861 / +2.3% 0.51 / 0.53 / -3.5%
tpch_q05/duckdb:duckdb 15538646 / 15542263 / -0.0% 26594426 / 27353972 / -2.8% 0.58 / 0.57 / +2.8%
tpch_q06/duckdb:duckdb 3178573 / 3253934 / -2.3% 9862232 / 10086886 / -2.2% 0.32 / 0.32 / -0.1%
tpch_q07/duckdb:duckdb 18342287 / 18255917 / +0.5% 28767183 / 28359965 / +1.4% 0.64 / 0.64 / -0.9%
tpch_q08/duckdb:duckdb 17161906 / 17217488 / -0.3% 29414551 / 29877176 / -1.5% 0.58 / 0.58 / +1.2%
tpch_q09/duckdb:duckdb 23730322 / 24003625 / -1.1% 36976876 / 37428521 / -1.2% 0.64 / 0.64 / +0.1%
tpch_q10/duckdb:duckdb 29605231 / 29802190 / -0.7% 42917491 / 43241351 / -0.7% 0.69 / 0.69 / +0.1%
tpch_q11/duckdb:duckdb 5786960 / 5740346 / +0.8% 12512795 / 11971889 / +4.5% 0.46 / 0.48 / -3.5%
tpch_q12/duckdb:duckdb 10624430 / 10671210 / -0.4% 20358016 / 20500442 / -0.7% 0.52 / 0.52 / +0.3%
tpch_q13/duckdb:duckdb 31954868 / 32348602 / -1.2% 40200015 / 41037512 / -2.0% 0.79 / 0.79 / +0.8%
tpch_q14/duckdb:duckdb 12366931 / 12533913 / -1.3% 20965444 / 22017391 / -4.8% 0.59 / 0.57 / +3.6%
tpch_q15/duckdb:duckdb 6826556 / 7046984 / -3.1% 16250364 / 16374775 / -0.8% 0.42 / 0.43 / -2.4%
tpch_q16/duckdb:duckdb 18853130 / 19091758 / -1.2% 25163478 / 25193527 / -0.1% 0.75 / 0.76 / -1.1%
tpch_q17/duckdb:duckdb 8457582 / 8591125 / -1.6% 17500148 / 17915949 / -2.3% 0.48 / 0.48 / +0.8%
tpch_q18/duckdb:duckdb 18343913 / 18356486 / -0.1% 25504228 / 25740638 / -0.9% 0.72 / 0.71 / +0.9%
tpch_q19/duckdb:duckdb 12780519 / 12847812 / -0.5% 22046822 / 21385813 / +3.1% 0.58 / 0.60 / -3.5%
tpch_q20/duckdb:duckdb 14237700 / 14516951 / -1.9% 26743880 / 27640637 / -3.2% 0.53 / 0.53 / +1.4%
tpch_q21/duckdb:duckdb 21596817 / 21935131 / -1.5% 31943058 / 32368950 / -1.3% 0.68 / 0.68 / -0.2%
tpch_q22/duckdb:duckdb 23125227 / 23376221 / -1.1% 31916100 / 32029875 / -0.4% 0.72 / 0.73 / -0.7%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+2.9%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -1.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1794789 / 1770837 / +1.4% 6289426 / 6776393 / -7.2% 0.29 / 0.26 / +9.2%
statpopgen_q01/datafusion:vortex-file-compressed 4224624 / 4548948 / -7.1% 11505358 / 10713607 / +7.4% 0.37 / 0.42 / -13.5%
statpopgen_q02/datafusion:vortex-file-compressed 38590003 / 38810281 / -0.6% 64119981 / 65010880 / -1.4% 0.60 / 0.60 / +0.8%
statpopgen_q03/datafusion:vortex-file-compressed 115363367 / 115519366 / -0.1% 154824406 / 155399627 / -0.4% 0.75 / 0.74 / +0.2%
statpopgen_q04/datafusion:vortex-file-compressed 115947232 / 117953536 / -1.7% 154538183 / 156921873 / -1.5% 0.75 / 0.75 / -0.2%
statpopgen_q05/datafusion:vortex-file-compressed 73967978 / 71260271 / +3.8% 115460567 / 109045051 / +5.9% 0.64 / 0.65 / -2.0%
statpopgen_q06/datafusion:vortex-file-compressed 193929184 / 194512510 / -0.3% 232188400 / 234772790 / -1.1% 0.84 / 0.83 / +0.8%
statpopgen_q07/datafusion:vortex-file-compressed 278423925 / 280168124 / -0.6% 312902339 / 317367341 / -1.4% 0.89 / 0.88 / +0.8%
statpopgen_q08/datafusion:vortex-file-compressed 283963692 / 281704325 / +0.8% 320948339 / 314403014 / +2.1% 0.88 / 0.90 / -1.3%
statpopgen_q09/datafusion:vortex-file-compressed 96935103 / 97506504 / -0.6% 132371248 / 131580794 / +0.6% 0.73 / 0.74 / -1.2%
statpopgen_q10/datafusion:vortex-file-compressed 254812590 / 257689786 / -1.1% 298248116 / 299304212 / -0.4% 0.85 / 0.86 / -0.8%
datafusion / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1787902 / 1784724 / +0.2% 6230413 / 6507176 / -4.3% 0.29 / 0.27 / +4.6%
statpopgen_q01/datafusion:vortex-compact 3976846 / 3927064 / +1.3% 12042504 / 13056302 / -7.8% 0.33 / 0.30 / +9.8%
statpopgen_q02/datafusion:vortex-compact 43907053 / 43061480 / +2.0% 65252289 / 65895124 / -1.0% 0.67 / 0.65 / +3.0%
statpopgen_q03/datafusion:vortex-compact 119504758 / 117692507 / +1.5% 153301272 / 153237258 / +0.0% 0.78 / 0.77 / +1.5%
statpopgen_q04/datafusion:vortex-compact 120120894 / 119119406 / +0.8% 154455543 / 152216126 / +1.5% 0.78 / 0.78 / -0.6%
statpopgen_q05/datafusion:vortex-compact 72912032 / 72544302 / +0.5% 104410180 / 110190284 / -5.2% 0.70 / 0.66 / +6.1%
statpopgen_q06/datafusion:vortex-compact 199703092 / 197163452 / +1.3% 228118943 / 233671026 / -2.4% 0.88 / 0.84 / +3.8%
statpopgen_q07/datafusion:vortex-compact 353204416 / 350008178 / +0.9% 373680813 / 376882666 / -0.8% 0.95 / 0.93 / +1.8%
statpopgen_q08/datafusion:vortex-compact 359241904 / 356019508 / +0.9% 381179457 / 381830154 / -0.2% 0.94 / 0.93 / +1.1%
statpopgen_q09/datafusion:vortex-compact 100162519 / 100552702 / -0.4% 131047940 / 132338425 / -1.0% 0.76 / 0.76 / +0.6%
statpopgen_q10/datafusion:vortex-compact 257355016 / 256071112 / +0.5% 299614554 / 298779372 / +0.3% 0.86 / 0.86 / +0.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1923898 / 1927292 / -0.2% 88058191 / 90265390 / -2.4% 0.02 / 0.02 / +2.3%
statpopgen_q01/datafusion:parquet 164960876 / 165451156 / -0.3% 174496364 / 173281973 / +0.7% 0.95 / 0.95 / -1.0%
statpopgen_q02/datafusion:parquet 286620375 / 288792864 / -0.8% 421568329 / 407523314 / +3.4% 0.68 / 0.71 / -4.1%
statpopgen_q03/datafusion:parquet 380096687 / 397818226 / -4.5% 487356120 / 532897383 / -8.5% 0.78 / 0.75 / +4.5%
statpopgen_q04/datafusion:parquet 385540538 / 390233710 / -1.2% 522639345 / 541868033 / -3.5% 0.74 / 0.72 / +2.4%
statpopgen_q05/datafusion:parquet 316292693 / 310159434 / +2.0% 460699338 / 460798695 / -0.0% 0.69 / 0.67 / +2.0%
statpopgen_q06/datafusion:parquet 494138288 / 474081220 / +4.2% 643573905 / 610751013 / +5.4% 0.77 / 0.78 / -1.1%
statpopgen_q07/datafusion:parquet 422684698 / 425498841 / -0.7% 562557949 / 545001466 / +3.2% 0.75 / 0.78 / -3.8%
statpopgen_q08/datafusion:parquet 426442320 / 424981068 / +0.3% 550113641 / 549000617 / +0.2% 0.78 / 0.77 / +0.1%
statpopgen_q09/datafusion:parquet 355504996 / 358937466 / -1.0% 490217332 / 490689882 / -0.1% 0.73 / 0.73 / -0.9%
statpopgen_q10/datafusion:parquet 533657239 / 544953132 / -2.1% 677906974 / 702608062 / -3.5% 0.79 / 0.78 / +1.5%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 13050457 / 12976336 / +0.6% 15082120 / 15119659 / -0.2% 0.87 / 0.86 / +0.8%
statpopgen_q01/duckdb:vortex-file-compressed 13916330 / 13799847 / +0.8% 17829356 / 17685699 / +0.8% 0.78 / 0.78 / +0.0%
statpopgen_q02/duckdb:vortex-file-compressed 142763940 / 144731724 / -1.4% 158637581 / 160688864 / -1.3% 0.90 / 0.90 / -0.1%
statpopgen_q03/duckdb:vortex-file-compressed 344845726 / 335335958 / +2.8% 363041855 / 351905319 / +3.2% 0.95 / 0.95 / -0.3%
statpopgen_q04/duckdb:vortex-file-compressed 338074495 / 337764365 / +0.1% 360874582 / 348268586 / +3.6% 0.94 / 0.97 / -3.4%
statpopgen_q05/duckdb:vortex-file-compressed 98139705 / 97240415 / +0.9% 117168790 / 124180394 / -5.6% 0.84 / 0.78 / +7.0%
statpopgen_q06/duckdb:vortex-file-compressed 227481792 / 226866295 / +0.3% 247091400 / 247045691 / +0.0% 0.92 / 0.92 / +0.3%
statpopgen_q07/duckdb:vortex-file-compressed 142549058 / 139556716 / +2.1% 163770833 / 160262893 / +2.2% 0.87 / 0.87 / -0.0%
statpopgen_q08/duckdb:vortex-file-compressed 148464051 / 147994164 / +0.3% 172664159 / 173968969 / -0.8% 0.86 / 0.85 / +1.1%
statpopgen_q09/duckdb:vortex-file-compressed 302987528 / 294376246 / +2.9% 319735372 / 317845988 / +0.6% 0.95 / 0.93 / +2.3%
statpopgen_q10/duckdb:vortex-file-compressed 772281749 / 817656824 / -5.5% 784949745 / 848946085 / -7.5% 0.98 / 0.96 / +2.2%
duckdb / vortex-compact / ns (1.018x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 13150793 / 12918194 / +1.8% 15028821 / 15062132 / -0.2% 0.88 / 0.86 / +2.0%
statpopgen_q01/duckdb:vortex-compact 14019938 / 13908329 / +0.8% 18050868 / 17971236 / +0.4% 0.78 / 0.77 / +0.4%
statpopgen_q02/duckdb:vortex-compact 125209760 / 123768383 / +1.2% 158480512 / 164432702 / -3.6% 0.79 / 0.75 / +5.0%
statpopgen_q03/duckdb:vortex-compact 310049471 / 319709598 / -3.0% 348361823 / 346304119 / +0.6% 0.89 / 0.92 / -3.6%
statpopgen_q04/duckdb:vortex-compact 295390460 / 296959542 / -0.5% 352761688 / 361982634 / -2.5% 0.84 / 0.82 / +2.1%
statpopgen_q05/duckdb:vortex-compact 98788654 / 98373847 / +0.4% 122036327 / 121195773 / +0.7% 0.81 / 0.81 / -0.3%
statpopgen_q06/duckdb:vortex-compact 232204240 / 230119148 / +0.9% 250963209 / 250238246 / +0.3% 0.93 / 0.92 / +0.6%
statpopgen_q07/duckdb:vortex-compact 203329348 / 198899492 / +2.2% 214485912 / 220863181 / -2.9% 0.95 / 0.90 / +5.3%
statpopgen_q08/duckdb:vortex-compact 212736446 / 211817035 / +0.4% 230846966 / 223760272 / +3.2% 0.92 / 0.95 / -2.6%
statpopgen_q09/duckdb:vortex-compact 252962206 / 247141622 / +2.4% 305715626 / 306099215 / -0.1% 0.83 / 0.81 / +2.5%
statpopgen_q10/duckdb:vortex-compact 799685973 / 702462330 / +13.8% 🔴 830720043 / 791152772 / +5.0% 0.96 / 0.89 / +8.4%
duckdb / parquet / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 236896876 / 246590108 / -3.9% 236100773 / 245563934 / -3.9% 1.00 / 1.00 / -0.1%
statpopgen_q01/duckdb:parquet 296500461 / 303279160 / -2.2% 297528119 / 307920551 / -3.4% 1.00 / 0.98 / +1.2%
statpopgen_q02/duckdb:parquet 559120898 / 577042472 / -3.1% 558126112 / 581156909 / -4.0% 1.00 / 0.99 / +0.9%
statpopgen_q03/duckdb:parquet 805109306 / 741464424 / +8.6% 834666551 / 787445938 / +6.0% 0.96 / 0.94 / +2.4%
statpopgen_q04/duckdb:parquet 723128888 / 771316250 / -6.2% 808430481 / 808604372 / -0.0% 0.89 / 0.95 / -6.2%
statpopgen_q05/duckdb:parquet 526933609 / 556427115 / -5.3% 560293129 / 590727580 / -5.2% 0.94 / 0.94 / -0.2%
statpopgen_q06/duckdb:parquet 622816962 / 626632784 / -0.6% 674291335 / 685979396 / -1.7% 0.92 / 0.91 / +1.1%
statpopgen_q07/duckdb:parquet 558280030 / 562233131 / -0.7% 556271584 / 569005981 / -2.2% 1.00 / 0.99 / +1.6%
statpopgen_q08/duckdb:parquet 560440716 / 567293976 / -1.2% 563395061 / 563953741 / -0.1% 0.99 / 1.01 / -1.1%
statpopgen_q09/duckdb:parquet 748807783 / 758483879 / -1.3% 813133684 / 779194371 / +4.4% 0.92 / 0.97 / -5.4%
statpopgen_q10/duckdb:parquet 1000119349 / 1032606078 / -3.1% 1128623291 / 1149347579 / -1.8% 0.89 / 0.90 / -1.4%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.5%
Engines: DataFusion No clear signal (-4.4%, environment too noisy confidence) · DuckDB No clear signal (+12.1%, environment too noisy confidence)
Vortex (geomean): hot 1.105x ➖ · cold 1.104x ➖
Parquet (geomean): hot 1.068x ➖ · cold 1.041x ➖
Shifts: Parquet (control) +6.8% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.160x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 30038706 / 49770682 / -39.6% 🟢 110604272 / 142006702 / -22.1% 0.27 / 0.35 / -22.5%
fineweb_q01/datafusion:vortex-file-compressed 393284301 / 286344634 / +37.3% 🔴 665492155 / 540707708 / +23.1% 0.59 / 0.53 / +11.6%
fineweb_q02/datafusion:vortex-file-compressed 463226340 / 233318976 / +98.5% 🔴 616738855 / 414061024 / +48.9% 🔴 0.75 / 0.56 / +33.3%
fineweb_q03/datafusion:vortex-file-compressed 538499432 / 421554280 / +27.7% 577792464 / 471317614 / +22.6% 0.93 / 0.89 / +4.2%
fineweb_q04/datafusion:vortex-file-compressed 811484184 / 411517264 / +97.2% 🔴 691629215 / 447719293 / +54.5% 🔴 1.17 / 0.92 / +27.7%
fineweb_q05/datafusion:vortex-file-compressed 404474754 / 437974236 / -7.6% 414932915 / 468159848 / -11.4% 0.97 / 0.94 / +4.2%
fineweb_q06/datafusion:vortex-file-compressed 501017397 / 596337368 / -16.0% 526676602 / 601611818 / -12.5% 0.95 / 0.99 / -4.0%
fineweb_q07/datafusion:vortex-file-compressed 615088095 / 503004956 / +22.3% 832671700 / 474065874 / +75.6% 🔴 0.74 / 1.06 / -30.4%
fineweb_q08/datafusion:vortex-file-compressed 157750931 / 162587451 / -3.0% 157857647 / 200154555 / -21.1% 1.00 / 0.81 / +23.0%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 35396172 / 38499540 / -8.1% 129148567 / 142155614 / -9.1% 0.27 / 0.27 / +1.2%
fineweb_q01/datafusion:vortex-compact 337760800 / 324532878 / +4.1% 772721321 / 614971135 / +25.7% 0.44 / 0.53 / -17.2%
fineweb_q02/datafusion:vortex-compact 336185472 / 345885747 / -2.8% 471322731 / 461152623 / +2.2% 0.71 / 0.75 / -4.9%
fineweb_q03/datafusion:vortex-compact 506857378 / 472606472 / +7.2% 584240827 / 527315162 / +10.8% 0.87 / 0.90 / -3.2%
fineweb_q04/datafusion:vortex-compact 505471501 / 501433800 / +0.8% 534109933 / 508534214 / +5.0% 0.95 / 0.99 / -4.0%
fineweb_q05/datafusion:vortex-compact 653465433 / 583684648 / +12.0% 568858968 / 662048488 / -14.1% 1.15 / 0.88 / +30.3%
fineweb_q06/datafusion:vortex-compact 637434860 / 545936172 / +16.8% 535857378 / 569313528 / -5.9% 1.19 / 0.96 / +24.0%
fineweb_q07/datafusion:vortex-compact 566525223 / 534277506 / +6.0% 708503881 / 559196842 / +26.7% 0.80 / 0.96 / -16.3%
fineweb_q08/datafusion:vortex-compact 211034088 / 286237322 / -26.3% 287194609 / 179116644 / +60.3% 🔴 0.73 / 1.60 / -54.0%
datafusion / parquet / ns (1.129x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 545838562 / 470393602 / +16.0% 903865600 / 743265448 / +21.6% 0.60 / 0.63 / -4.6%
fineweb_q01/datafusion:parquet 763699947 / 748969966 / +2.0% 733386311 / 760209492 / -3.5% 1.04 / 0.99 / +5.7%
fineweb_q02/datafusion:parquet 894736378 / 746936730 / +19.8% 923006691 / 833467234 / +10.7% 0.97 / 0.90 / +8.2%
fineweb_q03/datafusion:parquet 764374013 / 691936772 / +10.5% 727235462 / 662307300 / +9.8% 1.05 / 1.04 / +0.6%
fineweb_q04/datafusion:parquet 884545010 / 746758994 / +18.5% 716393087 / 877447718 / -18.4% 1.23 / 0.85 / +45.1%
fineweb_q05/datafusion:parquet 983444942 / 661384262 / +48.7% 🔴 880579501 / 654003578 / +34.6% 🔴 1.12 / 1.01 / +10.4%
fineweb_q06/datafusion:parquet 737029555 / 742173091 / -0.7% 657212008 / 665151944 / -1.2% 1.12 / 1.12 / +0.5%
fineweb_q07/datafusion:parquet 978638194 / 726258784 / +34.8% 🔴 917789872 / 629231810 / +45.9% 🔴 1.07 / 1.15 / -7.6%
fineweb_q08/datafusion:parquet 778255338 / 966369068 / -19.5% 827326540 / 1217173931 / -32.0% 🟢 0.94 / 0.79 / +18.5%
duckdb / vortex-file-compressed / ns (1.126x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 74580754 / 68621954 / +8.7% 111166984 / 115396804 / -3.7% 0.67 / 0.59 / +12.8%
fineweb_q01/duckdb:vortex-file-compressed 520722636 / 277125335 / +87.9% 🔴 462850935 / 341131718 / +35.7% 🔴 1.13 / 0.81 / +38.5%
fineweb_q02/duckdb:vortex-file-compressed 521453991 / 384910180 / +35.5% 🔴 839098414 / 369944538 / +126.8% 🔴 0.62 / 1.04 / -40.3%
fineweb_q03/duckdb:vortex-file-compressed 927203426 / 925899450 / +0.1% 1008241813 / 1002130349 / +0.6% 0.92 / 0.92 / -0.5%
fineweb_q04/duckdb:vortex-file-compressed 897459236 / 852867540 / +5.2% 1012682878 / 943887751 / +7.3% 0.89 / 0.90 / -1.9%
fineweb_q05/duckdb:vortex-file-compressed 934363656 / 911947458 / +2.5% 1052685999 / 978704830 / +7.6% 0.89 / 0.93 / -4.7%
fineweb_q06/duckdb:vortex-file-compressed 893412359 / 962346966 / -7.2% 982925844 / 1120297347 / -12.3% 0.91 / 0.86 / +5.8%
fineweb_q07/duckdb:vortex-file-compressed 876974352 / 878541666 / -0.2% 925585585 / 985079395 / -6.0% 0.95 / 0.89 / +6.2%
fineweb_q08/duckdb:vortex-file-compressed 202048032 / 192605950 / +4.9% 244345123 / 216401790 / +12.9% 0.83 / 0.89 / -7.1%
duckdb / vortex-compact / ns (1.138x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 77332146 / 70740148 / +9.3% 81131184 / 108158481 / -25.0% 0.95 / 0.65 / +45.7%
fineweb_q01/duckdb:vortex-compact 697634001 / 291989262 / +138.9% 🔴 594845741 / 363405666 / +63.7% 🔴 1.17 / 0.80 / +46.0%
fineweb_q02/duckdb:vortex-compact 336162552 / 330250582 / +1.8% 354359179 / 391640842 / -9.5% 0.95 / 0.84 / +12.5%
fineweb_q03/duckdb:vortex-compact 871605728 / 857276824 / +1.7% 944964947 / 908035178 / +4.1% 0.92 / 0.94 / -2.3%
fineweb_q04/duckdb:vortex-compact 850616789 / 875456987 / -2.8% 956288553 / 918188390 / +4.1% 0.89 / 0.95 / -6.7%
fineweb_q05/duckdb:vortex-compact 837972704 / 851161282 / -1.5% 903429117 / 971435836 / -7.0% 0.93 / 0.88 / +5.9%
fineweb_q06/duckdb:vortex-compact 886399701 / 839251905 / +5.6% 885159433 / 908369320 / -2.6% 1.00 / 0.92 / +8.4%
fineweb_q07/duckdb:vortex-compact 823165708 / 817450670 / +0.7% 935413878 / 893881632 / +4.6% 0.88 / 0.91 / -3.8%
fineweb_q08/duckdb:vortex-compact 239199945 / 205409962 / +16.5% 265906320 / 181664961 / +46.4% 🔴 0.90 / 1.13 / -20.4%
duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 322703460 / 275333796 / +17.2% 385136205 / 349500817 / +10.2% 0.84 / 0.79 / +6.4%
fineweb_q01/duckdb:parquet 533927644 / 540125760 / -1.1% 531880338 / 630266584 / -15.6% 1.00 / 0.86 / +17.1%
fineweb_q02/duckdb:parquet 522154482 / 577213674 / -9.5% 545951949 / 666662463 / -18.1% 0.96 / 0.87 / +10.5%
fineweb_q03/duckdb:parquet 742205570 / 851160334 / -12.8% 848863494 / 805303365 / +5.4% 0.87 / 1.06 / -17.3%
fineweb_q04/duckdb:parquet 837574015 / 798647769 / +4.9% 829107763 / 888372464 / -6.7% 1.01 / 0.90 / +12.4%
fineweb_q05/duckdb:parquet 811896853 / 757199644 / +7.2% 1230359026 / 831900269 / +47.9% 🔴 0.66 / 0.91 / -27.5%
fineweb_q06/duckdb:parquet 723152916 / 743339400 / -2.7% 780054762 / 818977503 / -4.8% 0.93 / 0.91 / +2.1%
fineweb_q07/duckdb:parquet 743092785 / 716438934 / +3.7% 766789097 / 650727858 / +17.8% 0.97 / 1.10 / -12.0%
fineweb_q08/duckdb:parquet 327987402 / 311322156 / +5.4% 402311877 / 375715861 / +7.1% 0.82 / 0.83 / -1.6%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93171818 / 92421374 / +0.8% 153327361 / 147337644 / +4.1% 0.61 / 0.63 / -3.1%
tpch_q02/datafusion:vortex-file-compressed 64071082 / 65027104 / -1.5% 95948753 / 94796662 / +1.2% 0.67 / 0.69 / -2.7%
tpch_q03/datafusion:vortex-file-compressed 64744738 / 63028520 / +2.7% 119068758 / 120349559 / -1.1% 0.54 / 0.52 / +3.8%
tpch_q04/datafusion:vortex-file-compressed 34092300 / 33815475 / +0.8% 71061839 / 69506239 / +2.2% 0.48 / 0.49 / -1.4%
tpch_q05/datafusion:vortex-file-compressed 117084167 / 117313380 / -0.2% 175919436 / 176710106 / -0.4% 0.67 / 0.66 / +0.3%
tpch_q06/datafusion:vortex-file-compressed 10292397 / 10725012 / -4.0% 58563136 / 57362676 / +2.1% 0.18 / 0.19 / -6.0%
tpch_q07/datafusion:vortex-file-compressed 134146408 / 134275774 / -0.1% 200015888 / 209952759 / -4.7% 0.67 / 0.64 / +4.9%
tpch_q08/datafusion:vortex-file-compressed 142681752 / 142650106 / +0.0% 221644770 / 221708280 / -0.0% 0.64 / 0.64 / +0.1%
tpch_q09/datafusion:vortex-file-compressed 183249559 / 184132835 / -0.5% 267373482 / 257568148 / +3.8% 0.69 / 0.71 / -4.1%
tpch_q10/datafusion:vortex-file-compressed 69933866 / 69455539 / +0.7% 134425458 / 134716861 / -0.2% 0.52 / 0.52 / +0.9%
tpch_q11/datafusion:vortex-file-compressed 43109399 / 43143661 / -0.1% 66333991 / 67640381 / -1.9% 0.65 / 0.64 / +1.9%
tpch_q12/datafusion:vortex-file-compressed 35157847 / 35061881 / +0.3% 81431351 / 85227270 / -4.5% 0.43 / 0.41 / +4.9%
tpch_q13/datafusion:vortex-file-compressed 48230048 / 48574220 / -0.7% 79559680 / 87462734 / -9.0% 0.61 / 0.56 / +9.2%
tpch_q14/datafusion:vortex-file-compressed 21519398 / 21632584 / -0.5% 91797652 / 86011756 / +6.7% 0.23 / 0.25 / -6.8%
tpch_q15/datafusion:vortex-file-compressed 33994942 / 33883815 / +0.3% 89747964 / 91939519 / -2.4% 0.38 / 0.37 / +2.8%
tpch_q16/datafusion:vortex-file-compressed 36775257 / 37360931 / -1.6% 63775749 / 67235326 / -5.1% 0.58 / 0.56 / +3.8%
tpch_q17/datafusion:vortex-file-compressed 177698366 / 179258740 / -0.9% 257922294 / 225548853 / +14.4% 🔴 0.69 / 0.79 / -13.3%
tpch_q18/datafusion:vortex-file-compressed 206179568 / 208064713 / -0.9% 274132110 / 265841334 / +3.1% 0.75 / 0.78 / -3.9%
tpch_q19/datafusion:vortex-file-compressed 30770081 / 30852811 / -0.3% 86839577 / 90459069 / -4.0% 0.35 / 0.34 / +3.9%
tpch_q20/datafusion:vortex-file-compressed 60889116 / 60119739 / +1.3% 123121429 / 116242771 / +5.9% 0.49 / 0.52 / -4.4%
tpch_q21/datafusion:vortex-file-compressed 178663083 / 179920903 / -0.7% 239159261 / 236016105 / +1.3% 0.75 / 0.76 / -2.0%
tpch_q22/datafusion:vortex-file-compressed 25383097 / 24937759 / +1.8% 53977740 / 53553354 / +0.8% 0.47 / 0.47 / +1.0%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 102460661 / 100903560 / +1.5% 153286232 / 152885961 / +0.3% 0.67 / 0.66 / +1.3%
tpch_q02/datafusion:vortex-compact 65111079 / 64773919 / +0.5% 92898523 / 93820242 / -1.0% 0.70 / 0.69 / +1.5%
tpch_q03/datafusion:vortex-compact 67990281 / 68125941 / -0.2% 111481425 / 112800789 / -1.2% 0.61 / 0.60 / +1.0%
tpch_q04/datafusion:vortex-compact 38535490 / 38239397 / +0.8% 69403223 / 66317741 / +4.7% 0.56 / 0.58 / -3.7%
tpch_q05/datafusion:vortex-compact 118417950 / 119346122 / -0.8% 172871727 / 175120726 / -1.3% 0.69 / 0.68 / +0.5%
tpch_q06/datafusion:vortex-compact 15324763 / 15204810 / +0.8% 51628418 / 50198812 / +2.8% 0.30 / 0.30 / -2.0%
tpch_q07/datafusion:vortex-compact 139633896 / 140892077 / -0.9% 197970824 / 195688984 / +1.2% 0.71 / 0.72 / -2.0%
tpch_q08/datafusion:vortex-compact 146723352 / 143984715 / +1.9% 213931040 / 300742606 / -28.9% 🟢 0.69 / 0.48 / +43.3%
tpch_q09/datafusion:vortex-compact 183418679 / 185307076 / -1.0% 263209686 / 274877360 / -4.2% 0.70 / 0.67 / +3.4%
tpch_q10/datafusion:vortex-compact 79135829 / 78237265 / +1.1% 123847679 / 127489474 / -2.9% 0.64 / 0.61 / +4.1%
tpch_q11/datafusion:vortex-compact 43705884 / 44393065 / -1.5% 65838531 / 68984435 / -4.6% 0.66 / 0.64 / +3.2%
tpch_q12/datafusion:vortex-compact 47400696 / 48623180 / -2.5% 78789113 / 76682288 / +2.7% 0.60 / 0.63 / -5.1%
tpch_q13/datafusion:vortex-compact 57884082 / 56800187 / +1.9% 85561868 / 86868965 / -1.5% 0.68 / 0.65 / +3.5%
tpch_q14/datafusion:vortex-compact 26028359 / 26223062 / -0.7% 85449954 / 86385919 / -1.1% 0.30 / 0.30 / +0.3%
tpch_q15/datafusion:vortex-compact 46687120 / 46785575 / -0.2% 100774845 / 97169764 / +3.7% 0.46 / 0.48 / -3.8%
tpch_q16/datafusion:vortex-compact 38005005 / 40339771 / -5.8% 66017849 / 64632254 / +2.1% 0.58 / 0.62 / -7.8%
tpch_q17/datafusion:vortex-compact 177733084 / 174514176 / +1.8% 224011474 / 219252920 / +2.2% 0.79 / 0.80 / -0.3%
tpch_q18/datafusion:vortex-compact 206355591 / 203022616 / +1.6% 269913584 / 269708117 / +0.1% 0.76 / 0.75 / +1.6%
tpch_q19/datafusion:vortex-compact 34877953 / 37104886 / -6.0% 80058546 / 84758259 / -5.5% 0.44 / 0.44 / -0.5%
tpch_q20/datafusion:vortex-compact 65760088 / 65564240 / +0.3% 115226401 / 112924833 / +2.0% 0.57 / 0.58 / -1.7%
tpch_q21/datafusion:vortex-compact 187229941 / 186064067 / +0.6% 241613222 / 244456675 / -1.2% 0.77 / 0.76 / +1.8%
tpch_q22/datafusion:vortex-compact 26387019 / 26225898 / +0.6% 54283424 / 54343104 / -0.1% 0.49 / 0.48 / +0.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87689959 / 87372046 / +0.4% 127896730 / 127117134 / +0.6% 0.69 / 0.69 / -0.2%
tpch_q02/datafusion:parquet 174796698 / 173541457 / +0.7% 199463602 / 200787531 / -0.7% 0.88 / 0.86 / +1.4%
tpch_q03/datafusion:parquet 134732681 / 135400852 / -0.5% 184533174 / 177515979 / +4.0% 0.73 / 0.76 / -4.3%
tpch_q04/datafusion:parquet 57299010 / 57301728 / -0.0% 93480622 / 90634805 / +3.1% 0.61 / 0.63 / -3.0%
tpch_q05/datafusion:parquet 168087575 / 167450726 / +0.4% 222573540 / 216918602 / +2.6% 0.76 / 0.77 / -2.2%
tpch_q06/datafusion:parquet 36380212 / 36759711 / -1.0% 78359868 / 73377160 / +6.8% 0.46 / 0.50 / -7.3%
tpch_q07/datafusion:parquet 214813294 / 217452485 / -1.2% 273665861 / 278757728 / -1.8% 0.78 / 0.78 / +0.6%
tpch_q08/datafusion:parquet 218213107 / 217547432 / +0.3% 292847813 / 281050041 / +4.2% 0.75 / 0.77 / -3.7%
tpch_q09/datafusion:parquet 309236982 / 309992739 / -0.2% 377674476 / 377617099 / +0.0% 0.82 / 0.82 / -0.3%
tpch_q10/datafusion:parquet 311330499 / 312607055 / -0.4% 375364551 / 374635413 / +0.2% 0.83 / 0.83 / -0.6%
tpch_q11/datafusion:parquet 127299767 / 126904955 / +0.3% 151180621 / 152092729 / -0.6% 0.84 / 0.83 / +0.9%
tpch_q12/datafusion:parquet 83089331 / 82490217 / +0.7% 121656061 / 119609598 / +1.7% 0.68 / 0.69 / -1.0%
tpch_q13/datafusion:parquet 210799524 / 210792627 / +0.0% 242495805 / 238505978 / +1.7% 0.87 / 0.88 / -1.6%
tpch_q14/datafusion:parquet 86083944 / 86178289 / -0.1% 190050627 / 190854700 / -0.4% 0.45 / 0.45 / +0.3%
tpch_q15/datafusion:parquet 106468791 / 106397081 / +0.1% 158425718 / 152062782 / +4.2% 0.67 / 0.70 / -4.0%
tpch_q16/datafusion:parquet 96504394 / 95891635 / +0.6% 124955497 / 122835240 / +1.7% 0.77 / 0.78 / -1.1%
tpch_q17/datafusion:parquet 215690464 / 215828919 / -0.1% 265138390 / 258232254 / +2.7% 0.81 / 0.84 / -2.7%
tpch_q18/datafusion:parquet 270247742 / 267911042 / +0.9% 311789096 / 315891179 / -1.3% 0.87 / 0.85 / +2.2%
tpch_q19/datafusion:parquet 108300226 / 108165843 / +0.1% 163361321 / 161949085 / +0.9% 0.66 / 0.67 / -0.7%
tpch_q20/datafusion:parquet 185934295 / 185545816 / +0.2% 248404792 / 247539770 / +0.3% 0.75 / 0.75 / -0.1%
tpch_q21/datafusion:parquet 243432803 / 244526968 / -0.4% 313356206 / 313261935 / +0.0% 0.78 / 0.78 / -0.5%
tpch_q22/datafusion:parquet 150320584 / 150249864 / +0.0% 174823276 / 175023324 / -0.1% 0.86 / 0.86 / +0.2%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33621663 / 33717250 / -0.3% 68542587 / 72546071 / -5.5% 0.49 / 0.46 / +5.5%
tpch_q02/duckdb:vortex-file-compressed 28467805 / 28535483 / -0.2% 43957821 / 42812168 / +2.7% 0.65 / 0.67 / -2.8%
tpch_q03/duckdb:vortex-file-compressed 53239257 / 52395190 / +1.6% 106339802 / 107856916 / -1.4% 0.50 / 0.49 / +3.1%
tpch_q04/duckdb:vortex-file-compressed 51965560 / 51642374 / +0.6% 89541883 / 90715191 / -1.3% 0.58 / 0.57 / +1.9%
tpch_q05/duckdb:vortex-file-compressed 68694064 / 68284064 / +0.6% 111966106 / 112287453 / -0.3% 0.61 / 0.61 / +0.9%
tpch_q06/duckdb:vortex-file-compressed 15491155 / 15523980 / -0.2% 52264138 / 54001994 / -3.2% 0.30 / 0.29 / +3.1%
tpch_q07/duckdb:vortex-file-compressed 56061735 / 56289317 / -0.4% 109896923 / 109517607 / +0.3% 0.51 / 0.51 / -0.7%
tpch_q08/duckdb:vortex-file-compressed 86217669 / 87993665 / -2.0% 132889797 / 136034326 / -2.3% 0.65 / 0.65 / +0.3%
tpch_q09/duckdb:vortex-file-compressed 103597367 / 104478542 / -0.8% 153046142 / 160545830 / -4.7% 0.68 / 0.65 / +4.0%
tpch_q10/duckdb:vortex-file-compressed 96090577 / 96530974 / -0.5% 146233895 / 149480239 / -2.2% 0.66 / 0.65 / +1.8%
tpch_q11/duckdb:vortex-file-compressed 13630305 / 13271624 / +2.7% 29513181 / 28437282 / +3.8% 0.46 / 0.47 / -1.0%
tpch_q12/duckdb:vortex-file-compressed 45537030 / 44829286 / +1.6% 82793982 / 82101250 / +0.8% 0.55 / 0.55 / +0.7%
tpch_q13/duckdb:vortex-file-compressed 71051220 / 73482635 / -3.3% 101201241 / 100644151 / +0.6% 0.70 / 0.73 / -3.8%
tpch_q14/duckdb:vortex-file-compressed 28503571 / 28597524 / -0.3% 73302889 / 75301257 / -2.7% 0.39 / 0.38 / +2.4%
tpch_q15/duckdb:vortex-file-compressed 25056769 / 24850425 / +0.8% 62923555 / 64680737 / -2.7% 0.40 / 0.38 / +3.6%
tpch_q16/duckdb:vortex-file-compressed 49065376 / 48665139 / +0.8% 59560703 / 57917111 / +2.8% 0.82 / 0.84 / -2.0%
tpch_q17/duckdb:vortex-file-compressed 35674189 / 35017407 / +1.9% 66069456 / 68787564 / -4.0% 0.54 / 0.51 / +6.1%
tpch_q18/duckdb:vortex-file-compressed 110868621 / 101349193 / +9.4% 126481081 / 121104468 / +4.4% 0.88 / 0.84 / +4.7%
tpch_q19/duckdb:vortex-file-compressed 27257281 / 27586274 / -1.2% 76288233 / 75468750 / +1.1% 0.36 / 0.37 / -2.3%
tpch_q20/duckdb:vortex-file-compressed 42346780 / 42028653 / +0.8% 93149749 / 94143242 / -1.1% 0.45 / 0.45 / +1.8%
tpch_q21/duckdb:vortex-file-compressed 94441586 / 92926669 / +1.6% 150510313 / 149459387 / +0.7% 0.63 / 0.62 / +0.9%
tpch_q22/duckdb:vortex-file-compressed 33106734 / 32967821 / +0.4% 48867279 / 50673568 / -3.6% 0.68 / 0.65 / +4.1%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 48224924 / 46447487 / +3.8% 75231222 / 73475379 / +2.4% 0.64 / 0.63 / +1.4%
tpch_q02/duckdb:vortex-compact 31618616 / 31500982 / +0.4% 43582382 / 46530261 / -6.3% 0.73 / 0.68 / +7.2%
tpch_q03/duckdb:vortex-compact 58399847 / 58910383 / -0.9% 97670305 / 96514063 / +1.2% 0.60 / 0.61 / -2.0%
tpch_q04/duckdb:vortex-compact 54292717 / 54171075 / +0.2% 82267725 / 78984024 / +4.2% 0.66 / 0.69 / -3.8%
tpch_q05/duckdb:vortex-compact 72362084 / 72150580 / +0.3% 104096593 / 106434657 / -2.2% 0.70 / 0.68 / +2.5%
tpch_q06/duckdb:vortex-compact 20018569 / 20123675 / -0.5% 51842079 / 51791971 / +0.1% 0.39 / 0.39 / -0.6%
tpch_q07/duckdb:vortex-compact 63353328 / 64005439 / -1.0% 106455009 / 106658467 / -0.2% 0.60 / 0.60 / -0.8%
tpch_q08/duckdb:vortex-compact 87698304 / 90918133 / -3.5% 124502255 / 128748862 / -3.3% 0.70 / 0.71 / -0.3%
tpch_q09/duckdb:vortex-compact 109696215 / 108747499 / +0.9% 152001598 / 156962981 / -3.2% 0.72 / 0.69 / +4.2%
tpch_q10/duckdb:vortex-compact 105481139 / 105556808 / -0.1% 144813179 / 142470610 / +1.6% 0.73 / 0.74 / -1.7%
tpch_q11/duckdb:vortex-compact 14192244 / 14450412 / -1.8% 29881039 / 28709211 / +4.1% 0.47 / 0.50 / -5.6%
tpch_q12/duckdb:vortex-compact 59993498 / 58544323 / +2.5% 79897553 / 82048007 / -2.6% 0.75 / 0.71 / +5.2%
tpch_q13/duckdb:vortex-compact 77481204 / 77467786 / +0.0% 103267553 / 100689811 / +2.6% 0.75 / 0.77 / -2.5%
tpch_q14/duckdb:vortex-compact 32918603 / 33622354 / -2.1% 69937139 / 71232261 / -1.8% 0.47 / 0.47 / -0.3%
tpch_q15/duckdb:vortex-compact 31316561 / 31084308 / +0.7% 64653497 / 65896816 / -1.9% 0.48 / 0.47 / +2.7%
tpch_q16/duckdb:vortex-compact 50943786 / 49768599 / +2.4% 59325831 / 60826376 / -2.5% 0.86 / 0.82 / +5.0%
tpch_q17/duckdb:vortex-compact 37136995 / 37371923 / -0.6% 65484710 / 66052701 / -0.9% 0.57 / 0.57 / +0.2%
tpch_q18/duckdb:vortex-compact 107565695 / 112741719 / -4.6% 122191138 / 119558512 / +2.2% 0.88 / 0.94 / -6.6%
tpch_q19/duckdb:vortex-compact 34913734 / 35432506 / -1.5% 77634565 / 75600000 / +2.7% 0.45 / 0.47 / -4.0%
tpch_q20/duckdb:vortex-compact 51891519 / 51695126 / +0.4% 94641393 / 96163493 / -1.6% 0.55 / 0.54 / +2.0%
tpch_q21/duckdb:vortex-compact 104467449 / 106269840 / -1.7% 146890097 / 146328582 / +0.4% 0.71 / 0.73 / -2.1%
tpch_q22/duckdb:vortex-compact 36196385 / 35452546 / +2.1% 50681326 / 52396466 / -3.3% 0.71 / 0.68 / +5.6%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67372347 / 68059780 / -1.0% 91009523 / 89550266 / +1.6% 0.74 / 0.76 / -2.6%
tpch_q02/duckdb:parquet 87285581 / 87335480 / -0.1% 98815981 / 97718209 / +1.1% 0.88 / 0.89 / -1.2%
tpch_q03/duckdb:parquet 109433198 / 110511015 / -1.0% 143075978 / 142463897 / +0.4% 0.76 / 0.78 / -1.4%
tpch_q04/duckdb:parquet 76677764 / 76502436 / +0.2% 97925577 / 99440715 / -1.5% 0.78 / 0.77 / +1.8%
tpch_q05/duckdb:parquet 122855431 / 124172926 / -1.1% 157447870 / 157124433 / +0.2% 0.78 / 0.79 / -1.3%
tpch_q06/duckdb:parquet 35027970 / 35619223 / -1.7% 61816186 / 66005123 / -6.3% 0.57 / 0.54 / +5.0%
tpch_q07/duckdb:parquet 115409448 / 117398526 / -1.7% 154203602 / 154106673 / +0.1% 0.75 / 0.76 / -1.8%
tpch_q08/duckdb:parquet 148456104 / 147136506 / +0.9% 191699163 / 191273949 / +0.2% 0.77 / 0.77 / +0.7%
tpch_q09/duckdb:parquet 237508028 / 236712079 / +0.3% 282872825 / 283406742 / -0.2% 0.84 / 0.84 / +0.5%
tpch_q10/duckdb:parquet 314315859 / 314185931 / +0.0% 339252854 / 343372079 / -1.2% 0.93 / 0.92 / +1.3%
tpch_q11/duckdb:parquet 43506926 / 43742423 / -0.5% 50777123 / 50965528 / -0.4% 0.86 / 0.86 / -0.2%
tpch_q12/duckdb:parquet 70626610 / 71137236 / -0.7% 91897905 / 91779500 / +0.1% 0.77 / 0.78 / -0.8%
tpch_q13/duckdb:parquet 292902247 / 293366910 / -0.2% 306439556 / 308621731 / -0.7% 0.96 / 0.95 / +0.6%
tpch_q14/duckdb:parquet 101822520 / 102273386 / -0.4% 138674113 / 141851063 / -2.2% 0.73 / 0.72 / +1.8%
tpch_q15/duckdb:parquet 57621461 / 57070305 / +1.0% 89196945 / 86533692 / +3.1% 0.65 / 0.66 / -2.0%
tpch_q16/duckdb:parquet 100626048 / 100916878 / -0.3% 108100922 / 107993358 / +0.1% 0.93 / 0.93 / -0.4%
tpch_q17/duckdb:parquet 81239061 / 82884448 / -2.0% 112159629 / 124989202 / -10.3% 🟢 0.72 / 0.66 / +9.2%
tpch_q18/duckdb:parquet 162054699 / 157350187 / +3.0% 180424632 / 174516370 / +3.4% 0.90 / 0.90 / -0.4%
tpch_q19/duckdb:parquet 97371214 / 98221882 / -0.9% 129342505 / 134004453 / -3.5% 0.75 / 0.73 / +2.7%
tpch_q20/duckdb:parquet 147535444 / 147378796 / +0.1% 184120397 / 187264562 / -1.7% 0.80 / 0.79 / +1.8%
tpch_q21/duckdb:parquet 254819510 / 251811968 / +1.2% 274486861 / 275521800 / -0.4% 0.93 / 0.91 / +1.6%
tpch_q22/duckdb:parquet 168136839 / 168385842 / -0.1% 180281759 / 180610188 / -0.2% 0.93 / 0.93 / +0.0%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 23673644 / 23805503 / -0.6% 54549115 / 54225297 / +0.6% 0.43 / 0.44 / -1.1%
tpch_q02/duckdb:duckdb 20784799 / 20993320 / -1.0% 33234863 / 33424040 / -0.6% 0.63 / 0.63 / -0.4%
tpch_q03/duckdb:duckdb 45570810 / 45479532 / +0.2% 76989262 / 77177143 / -0.2% 0.59 / 0.59 / +0.4%
tpch_q04/duckdb:duckdb 56111926 / 55748639 / +0.7% 80500572 / 81635121 / -1.4% 0.70 / 0.68 / +2.1%
tpch_q05/duckdb:duckdb 59622211 / 59884829 / -0.4% 92736398 / 94362400 / -1.7% 0.64 / 0.63 / +1.3%
tpch_q06/duckdb:duckdb 14354811 / 14219938 / +0.9% 46124611 / 44561493 / +3.5% 0.31 / 0.32 / -2.5%
tpch_q07/duckdb:duckdb 43766713 / 43263387 / +1.2% 78974595 / 81693207 / -3.3% 0.55 / 0.53 / +4.6%
tpch_q08/duckdb:duckdb 65532690 / 65688157 / -0.2% 106154516 / 105864922 / +0.3% 0.62 / 0.62 / -0.5%
tpch_q09/duckdb:duckdb 76747424 / 77003470 / -0.3% 114890866 / 112650495 / +2.0% 0.67 / 0.68 / -2.3%
tpch_q10/duckdb:duckdb 92378230 / 91737926 / +0.7% 124234655 / 121606458 / +2.2% 0.74 / 0.75 / -1.4%
tpch_q11/duckdb:duckdb 9829256 / 9909076 / -0.8% 17948348 / 18003914 / -0.3% 0.55 / 0.55 / -0.5%
tpch_q12/duckdb:duckdb 39636115 / 39576120 / +0.2% 68096225 / 69526221 / -2.1% 0.58 / 0.57 / +2.3%
tpch_q13/duckdb:duckdb 101036200 / 102425921 / -1.4% 116802073 / 117238550 / -0.4% 0.87 / 0.87 / -1.0%
tpch_q14/duckdb:duckdb 32612359 / 32352230 / +0.8% 69554264 / 68550460 / +1.5% 0.47 / 0.47 / -0.7%
tpch_q15/duckdb:duckdb 24667822 / 24879871 / -0.9% 58027396 / 57291029 / +1.3% 0.43 / 0.43 / -2.1%
tpch_q16/duckdb:duckdb 44986581 / 45053863 / -0.1% 51132696 / 52231452 / -2.1% 0.88 / 0.86 / +2.0%
tpch_q17/duckdb:duckdb 25926335 / 26286083 / -1.4% 58539879 / 58691419 / -0.3% 0.44 / 0.45 / -1.1%
tpch_q18/duckdb:duckdb 71708456 / 71110315 / +0.8% 93226146 / 93715276 / -0.5% 0.77 / 0.76 / +1.4%
tpch_q19/duckdb:duckdb 29416818 / 29698700 / -0.9% 65215819 / 69022075 / -5.5% 0.45 / 0.43 / +4.8%
tpch_q20/duckdb:duckdb 37695097 / 38213309 / -1.4% 82042571 / 81465939 / +0.7% 0.46 / 0.47 / -2.0%
tpch_q21/duckdb:duckdb 63471175 / 63926054 / -0.7% 93882351 / 92434496 / +1.6% 0.68 / 0.69 / -2.2%
tpch_q22/duckdb:duckdb 35930766 / 35907570 / +0.1% 45929918 / 47329188 / -3.0% 0.78 / 0.76 / +3.1%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 52075902 / 52842902 / -1.5% 72669980 / 76190366 / -4.6% 0.72 / 0.69 / +3.3%
appian_q02/datafusion:vortex-file-compressed 226766685 / 224993740 / +0.8% 270738453 / 267817342 / +1.1% 0.84 / 0.84 / -0.3%
appian_q03/datafusion:vortex-file-compressed 141154218 / 141349329 / -0.1% 190880946 / 185407371 / +3.0% 0.74 / 0.76 / -3.0%
appian_q04/datafusion:vortex-file-compressed 9637187849 / 9605551967 / +0.3% 9655557904 / 9690208015 / -0.4% 1.00 / 0.99 / +0.7%
appian_q05/datafusion:vortex-file-compressed 132072883 / 134186000 / -1.6% 165799538 / 163975095 / +1.1% 0.80 / 0.82 / -2.7%
appian_q06/datafusion:vortex-file-compressed 139493584 / 138748700 / +0.5% 164706544 / 171604443 / -4.0% 0.85 / 0.81 / +4.7%
appian_q07/datafusion:vortex-file-compressed 154865300 / 154980937 / -0.1% 190678767 / 193651237 / -1.5% 0.81 / 0.80 / +1.5%
appian_q08/datafusion:vortex-file-compressed 518944840 / 522715483 / -0.7% 587509657 / 586663801 / +0.1% 0.88 / 0.89 / -0.9%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71960491 / 71437970 / +0.7% 92256551 / 94881418 / -2.8% 0.78 / 0.75 / +3.6%
appian_q02/datafusion:parquet 289885485 / 289928685 / -0.0% 332389334 / 322450708 / +3.1% 0.87 / 0.90 / -3.0%
appian_q03/datafusion:parquet 185104768 / 184341246 / +0.4% 232108798 / 226248515 / +2.6% 0.80 / 0.81 / -2.1%
appian_q04/datafusion:parquet 9690735983 / 9669499152 / +0.2% 9737502821 / 9779976185 / -0.4% 1.00 / 0.99 / +0.7%
appian_q05/datafusion:parquet 192183089 / 192479511 / -0.2% 221817586 / 221017652 / +0.4% 0.87 / 0.87 / -0.5%
appian_q06/datafusion:parquet 164615167 / 165234459 / -0.4% 188659595 / 189740071 / -0.6% 0.87 / 0.87 / +0.2%
appian_q07/datafusion:parquet 205045380 / 203659490 / +0.7% 241564970 / 239905673 / +0.7% 0.85 / 0.85 / -0.0%
appian_q08/datafusion:parquet 628368233 / 631013695 / -0.4% 685270414 / 679211488 / +0.9% 0.92 / 0.93 / -1.3%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 83330539 / 82548425 / +0.9% 98727048 / 96108900 / +2.7% 0.84 / 0.86 / -1.7%
appian_q02/duckdb:vortex-file-compressed 230275941 / 238040950 / -3.3% 253948019 / 256131960 / -0.9% 0.91 / 0.93 / -2.4%
appian_q03/duckdb:vortex-file-compressed 113679036 / 113072230 / +0.5% 131575499 / 132153421 / -0.4% 0.86 / 0.86 / +1.0%
appian_q04/duckdb:vortex-file-compressed 609004041 / 595098241 / +2.3% 629557619 / 663148965 / -5.1% 0.97 / 0.90 / +7.8%
appian_q05/duckdb:vortex-file-compressed 117567436 / 118573789 / -0.8% 131135487 / 131625165 / -0.4% 0.90 / 0.90 / -0.5%
appian_q06/duckdb:vortex-file-compressed 200077437 / 196611951 / +1.8% 204163061 / 203498716 / +0.3% 0.98 / 0.97 / +1.4%
appian_q07/duckdb:vortex-file-compressed 117910995 / 117057369 / +0.7% 129928753 / 130375595 / -0.3% 0.91 / 0.90 / +1.1%
appian_q08/duckdb:vortex-file-compressed 338043863 / 336226357 / +0.5% 349317315 / 341426855 / +2.3% 0.97 / 0.98 / -1.7%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 94218286 / 92897944 / +1.4% 99164824 / 100100156 / -0.9% 0.95 / 0.93 / +2.4%
appian_q02/duckdb:parquet 241274363 / 242648434 / -0.6% 246840208 / 244839826 / +0.8% 0.98 / 0.99 / -1.4%
appian_q03/duckdb:parquet 130518772 / 130326540 / +0.1% 139961639 / 139525196 / +0.3% 0.93 / 0.93 / -0.2%
appian_q04/duckdb:parquet 485385359 / 486935746 / -0.3% 490411185 / 497213149 / -1.4% 0.99 / 0.98 / +1.1%
appian_q05/duckdb:parquet 130271954 / 128569712 / +1.3% 142291235 / 141684286 / +0.4% 0.92 / 0.91 / +0.9%
appian_q06/duckdb:parquet 113861334 / 113933626 / -0.1% 120313165 / 117139691 / +2.7% 0.95 / 0.97 / -2.7%
appian_q07/duckdb:parquet 106644818 / 108594311 / -1.8% 119268697 / 120463227 / -1.0% 0.89 / 0.90 / -0.8%
appian_q08/duckdb:parquet 351862853 / 359427679 / -2.1% 353536370 / 345846760 / +2.2% 1.00 / 1.04 / -4.2%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 78351682 / 78532459 / -0.2% 92013742 / 92820726 / -0.9% 0.85 / 0.85 / +0.6%
appian_q02/duckdb:duckdb 210727892 / 210273416 / +0.2% 223610378 / 225575141 / -0.9% 0.94 / 0.93 / +1.1%
appian_q03/duckdb:duckdb 83885796 / 83678518 / +0.2% 91678367 / 92382590 / -0.8% 0.92 / 0.91 / +1.0%
appian_q04/duckdb:duckdb 550272439 / 545967539 / +0.8% 554716918 / 532391077 / +4.2% 0.99 / 1.03 / -3.3%
appian_q05/duckdb:duckdb 106294011 / 106686706 / -0.4% 120902991 / 120907157 / -0.0% 0.88 / 0.88 / -0.4%
appian_q06/duckdb:duckdb 189096285 / 188445355 / +0.3% 204600606 / 195881576 / +4.5% 0.92 / 0.96 / -3.9%
appian_q07/duckdb:duckdb 86961851 / 87953957 / -1.1% 99915325 / 100102846 / -0.2% 0.87 / 0.88 / -0.9%
appian_q08/duckdb:duckdb 310669846 / 315829207 / -1.6% 321625913 / 318534634 / +1.0% 0.97 / 0.99 / -2.6%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.006x ➖, 11↑ 11↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 14948618 / 14595841 / +2.4% 30176482 / 30669036 / -1.6% 0.50 / 0.48 / +4.1%
job_q02/duckdb:vortex-file-compressed 25393380 / 25486581 / -0.4% 39676419 / 38157510 / +4.0% 0.64 / 0.67 / -4.2%
job_q03/duckdb:vortex-file-compressed 15930368 / 16093917 / -1.0% 30309367 / 30617188 / -1.0% 0.53 / 0.53 / -0.0%
job_q04/duckdb:vortex-file-compressed 27983084 / 27809126 / +0.6% 41847751 / 41635712 / +0.5% 0.67 / 0.67 / +0.1%
job_q05/duckdb:vortex-file-compressed 19779404 / 19640083 / +0.7% 37616502 / 36506452 / +3.0% 0.53 / 0.54 / -2.3%
job_q06/duckdb:vortex-file-compressed 16287758 / 15856750 / +2.7% 32792874 / 33393929 / -1.8% 0.50 / 0.47 / +4.6%
job_q07/duckdb:vortex-file-compressed 9658363 / 9722188 / -0.7% 25170662 / 26055596 / -3.4% 0.38 / 0.37 / +2.8%
job_q08/duckdb:vortex-file-compressed 21783838 / 22261406 / -2.1% 38260733 / 39821212 / -3.9% 0.57 / 0.56 / +1.8%
job_q09/duckdb:vortex-file-compressed 67932711 / 27411514 / +147.8% 🔴 97821092 / 62754010 / +55.9% 🔴 0.69 / 0.44 / +59.0%
job_q10/duckdb:vortex-file-compressed 43730956 / 25923798 / +68.7% 🔴 75692817 / 60696646 / +24.7% 🔴 0.58 / 0.43 / +35.3%
job_q100/duckdb:vortex-file-compressed 40551692 / 41380004 / -2.0% 76425390 / 80131383 / -4.6% 0.53 / 0.52 / +2.8%
job_q101/duckdb:vortex-file-compressed 38363828 / 39792391 / -3.6% 76738644 / 79382548 / -3.3% 0.50 / 0.50 / -0.3%
job_q102/duckdb:vortex-file-compressed 72141406 / 74137051 / -2.7% 112884627 / 115130164 / -2.0% 0.64 / 0.64 / -0.8%
job_q103/duckdb:vortex-file-compressed 50847916 / 50323044 / +1.0% 87097219 / 90441944 / -3.7% 0.58 / 0.56 / +4.9%
job_q104/duckdb:vortex-file-compressed 38830849 / 38955274 / -0.3% 76053847 / 75465013 / +0.8% 0.51 / 0.52 / -1.1%
job_q105/duckdb:vortex-file-compressed 70095090 / 70315230 / -0.3% 105927497 / 105574194 / +0.3% 0.66 / 0.67 / -0.6%
job_q106/duckdb:vortex-file-compressed 63297280 / 47884272 / +32.2% 🔴 99223936 / 83567312 / +18.7% 🔴 0.64 / 0.57 / +11.3%
job_q107/duckdb:vortex-file-compressed 43924064 / 45095478 / -2.6% 85400806 / 86020703 / -0.7% 0.51 / 0.52 / -1.9%
job_q108/duckdb:vortex-file-compressed 64090267 / 48471958 / +32.2% 🔴 102317733 / 86966677 / +17.7% 🔴 0.63 / 0.56 / +12.4%
job_q109/duckdb:vortex-file-compressed 10925893 / 11119089 / -1.7% 23584160 / 23585278 / -0.0% 0.46 / 0.47 / -1.7%
job_q11/duckdb:vortex-file-compressed 38243464 / 28727842 / +33.1% 🔴 70772303 / 63569390 / +11.3% 🔴 0.54 / 0.45 / +19.6%
job_q110/duckdb:vortex-file-compressed 17578094 / 17703756 / -0.7% 31056313 / 31062641 / -0.0% 0.57 / 0.57 / -0.7%
job_q111/duckdb:vortex-file-compressed 28738122 / 27955864 / +2.8% 46669263 / 45138329 / +3.4% 0.62 / 0.62 / -0.6%
job_q112/duckdb:vortex-file-compressed 28230516 / 28190204 / +0.1% 46718923 / 45637260 / +2.4% 0.60 / 0.62 / -2.2%
job_q113/duckdb:vortex-file-compressed 31526940 / 32787233 / -3.8% 52264210 / 51446637 / +1.6% 0.60 / 0.64 / -5.3%
job_q12/duckdb:vortex-file-compressed 38785828 / 44006524 / -11.9% 🟢 55673853 / 61348335 / -9.2% 0.70 / 0.72 / -2.9%
job_q13/duckdb:vortex-file-compressed 13975686 / 15665526 / -10.8% 🟢 29863530 / 33540141 / -11.0% 🟢 0.47 / 0.47 / +0.2%
job_q14/duckdb:vortex-file-compressed 48257635 / 58753166 / -17.9% 🟢 66062865 / 74852945 / -11.7% 🟢 0.73 / 0.78 / -6.9%
job_q15/duckdb:vortex-file-compressed 25476526 / 25689182 / -0.8% 57204215 / 55456783 / +3.2% 0.45 / 0.46 / -3.9%
job_q16/duckdb:vortex-file-compressed 24358618 / 24451276 / -0.4% 59934277 / 56128797 / +6.8% 0.41 / 0.44 / -6.7%
job_q17/duckdb:vortex-file-compressed 35025549 / 35317562 / -0.8% 66669514 / 68181531 / -2.2% 0.53 / 0.52 / +1.4%
job_q18/duckdb:vortex-file-compressed 38126718 / 39356620 / -3.1% 55429780 / 55464720 / -0.1% 0.69 / 0.71 / -3.1%
job_q19/duckdb:vortex-file-compressed 18577104 / 18506449 / +0.4% 42588806 / 41213802 / +3.3% 0.44 / 0.45 / -2.9%
job_q20/duckdb:vortex-file-compressed 18773932 / 17952676 / +4.6% 41784930 / 43224352 / -3.3% 0.45 / 0.42 / +8.2%
job_q21/duckdb:vortex-file-compressed 37718951 / 34428737 / +9.6% 64916469 / 59400633 / +9.3% 0.58 / 0.58 / +0.2%
job_q22/duckdb:vortex-file-compressed 29692215 / 26710742 / +11.2% 🔴 54729025 / 51250417 / +6.8% 0.54 / 0.52 / +4.1%
job_q23/duckdb:vortex-file-compressed 67369672 / 62807087 / +7.3% 96824980 / 91335463 / +6.0% 0.70 / 0.69 / +1.2%
job_q24/duckdb:vortex-file-compressed 41794134 / 41119502 / +1.6% 72523349 / 71399322 / +1.6% 0.58 / 0.58 / +0.1%
job_q25/duckdb:vortex-file-compressed 34862029 / 35472798 / -1.7% 64383342 / 64208017 / +0.3% 0.54 / 0.55 / -2.0%
job_q26/duckdb:vortex-file-compressed 86943762 / 86942440 / +0.0% 121437076 / 122891895 / -1.2% 0.72 / 0.71 / +1.2%
job_q27/duckdb:vortex-file-compressed 28222694 / 27941638 / +1.0% 55185695 / 55442725 / -0.5% 0.51 / 0.50 / +1.5%
job_q28/duckdb:vortex-file-compressed 23098482 / 23452934 / -1.5% 51555493 / 50300363 / +2.5% 0.45 / 0.47 / -3.9%
job_q29/duckdb:vortex-file-compressed 84856563 / 84532800 / +0.4% 103778959 / 106682380 / -2.7% 0.82 / 0.79 / +3.2%
job_q30/duckdb:vortex-file-compressed 68094330 / 68798020 / -1.0% 85621114 / 84440320 / +1.4% 0.80 / 0.81 / -2.4%
job_q31/duckdb:vortex-file-compressed 59800492 / 60339943 / -0.9% 94752926 / 96052576 / -1.4% 0.63 / 0.63 / +0.5%
job_q32/duckdb:vortex-file-compressed 47903720 / 47608469 / +0.6% 83480612 / 81430998 / +2.5% 0.57 / 0.58 / -1.9%
job_q33/duckdb:vortex-file-compressed 61990842 / 61590013 / +0.7% 89690609 / 89680151 / +0.0% 0.69 / 0.69 / +0.6%
job_q34/duckdb:vortex-file-compressed 125829317 / 126244332 / -0.3% 154048908 / 154151261 / -0.1% 0.82 / 0.82 / -0.3%
job_q35/duckdb:vortex-file-compressed 26593146 / 26735290 / -0.5% 52403346 / 53834200 / -2.7% 0.51 / 0.50 / +2.2%
job_q36/duckdb:vortex-file-compressed 20787006 / 20907638 / -0.6% 46718295 / 47636445 / -1.9% 0.44 / 0.44 / +1.4%
job_q37/duckdb:vortex-file-compressed 50451042 / 50523206 / -0.1% 83686670 / 83924932 / -0.3% 0.60 / 0.60 / +0.1%
job_q38/duckdb:vortex-file-compressed 18287122 / 18334548 / -0.3% 35835210 / 34805316 / +3.0% 0.51 / 0.53 / -3.1%
job_q39/duckdb:vortex-file-compressed 15746710 / 15685550 / +0.4% 32365169 / 32415007 / -0.2% 0.49 / 0.48 / +0.5%
job_q40/duckdb:vortex-file-compressed 95785508 / 94958357 / +0.9% 114351939 / 115095019 / -0.6% 0.84 / 0.83 / +1.5%
job_q41/duckdb:vortex-file-compressed 262308155 / 265947108 / -1.4% 284446532 / 284365782 / +0.0% 0.92 / 0.94 / -1.4%
job_q42/duckdb:vortex-file-compressed 30735748 / 33070129 / -7.1% 51492058 / 50558432 / +1.8% 0.60 / 0.65 / -8.7%
job_q43/duckdb:vortex-file-compressed 17095421 / 21350583 / -19.9% 🟢 35959114 / 39911519 / -9.9% 0.48 / 0.53 / -11.1%
job_q44/duckdb:vortex-file-compressed 46685223 / 46120119 / +1.2% 71053027 / 63767341 / +11.4% 🔴 0.66 / 0.72 / -9.2%
job_q45/duckdb:vortex-file-compressed 68009996 / 69164639 / -1.7% 87206472 / 89400638 / -2.5% 0.78 / 0.77 / +0.8%
job_q46/duckdb:vortex-file-compressed 22156769 / 26025234 / -14.9% 🟢 41206352 / 42113137 / -2.2% 0.54 / 0.62 / -13.0%
job_q47/duckdb:vortex-file-compressed 18429866 / 21812062 / -15.5% 🟢 37289349 / 39996609 / -6.8% 0.49 / 0.55 / -9.4%
job_q48/duckdb:vortex-file-compressed 73343456 / 73757072 / -0.6% 89332287 / 93829087 / -4.8% 0.82 / 0.79 / +4.4%
job_q49/duckdb:vortex-file-compressed 51360765 / 42304178 / +21.4% 🔴 71357984 / 61043226 / +16.9% 🔴 0.72 / 0.69 / +3.9%
job_q50/duckdb:vortex-file-compressed 36947324 / 36935994 / +0.0% 54239228 / 56369163 / -3.8% 0.68 / 0.66 / +4.0%
job_q51/duckdb:vortex-file-compressed 56864453 / 64310115 / -11.6% 🟢 76414106 / 83575245 / -8.6% 0.74 / 0.77 / -3.3%
job_q52/duckdb:vortex-file-compressed 48261496 / 47297569 / +2.0% 71091267 / 73520407 / -3.3% 0.68 / 0.64 / +5.5%
job_q53/duckdb:vortex-file-compressed 44759151 / 44357456 / +0.9% 69426965 / 72528107 / -4.3% 0.64 / 0.61 / +5.4%
job_q54/duckdb:vortex-file-compressed 57291360 / 57058987 / +0.4% 81546443 / 82736705 / -1.4% 0.70 / 0.69 / +1.9%
job_q55/duckdb:vortex-file-compressed 56707586 / 56872881 / -0.3% 80992861 / 79555060 / +1.8% 0.70 / 0.71 / -2.1%
job_q56/duckdb:vortex-file-compressed 36203038 / 35877648 / +0.9% 65172652 / 65835855 / -1.0% 0.56 / 0.54 / +1.9%
job_q57/duckdb:vortex-file-compressed 82769884 / 83991080 / -1.5% 106818224 / 104887925 / +1.8% 0.77 / 0.80 / -3.2%
job_q58/duckdb:vortex-file-compressed 66835720 / 66577688 / +0.4% 94000188 / 95864379 / -1.9% 0.71 / 0.69 / +2.4%
job_q59/duckdb:vortex-file-compressed 61492565 / 63114573 / -2.6% 88710088 / 93179901 / -4.8% 0.69 / 0.68 / +2.3%
job_q60/duckdb:vortex-file-compressed 41003278 / 41318014 / -0.8% 65436430 / 67249304 / -2.7% 0.63 / 0.61 / +2.0%
job_q61/duckdb:vortex-file-compressed 33220908 / 32484344 / +2.3% 61949913 / 62022528 / -0.1% 0.54 / 0.52 / +2.4%
job_q62/duckdb:vortex-file-compressed 31397538 / 31082832 / +1.0% 59315010 / 60769448 / -2.4% 0.53 / 0.51 / +3.5%
job_q63/duckdb:vortex-file-compressed 34658364 / 34411666 / +0.7% 61534597 / 65056462 / -5.4% 0.56 / 0.53 / +6.5%
job_q64/duckdb:vortex-file-compressed 57678676 / 57760036 / -0.1% 85298663 / 87006929 / -2.0% 0.68 / 0.66 / +1.9%
job_q65/duckdb:vortex-file-compressed 49189304 / 48545826 / +1.3% 75617138 / 76379073 / -1.0% 0.65 / 0.64 / +2.3%
job_q66/duckdb:vortex-file-compressed 48132490 / 36000034 / +33.7% 🔴 80513582 / 70235401 / +14.6% 🔴 0.60 / 0.51 / +16.6%
job_q67/duckdb:vortex-file-compressed 35007748 / 38670865 / -9.5% 68477278 / 70446135 / -2.8% 0.51 / 0.55 / -6.9%
job_q68/duckdb:vortex-file-compressed 54697290 / 47194698 / +15.9% 🔴 89148722 / 77685481 / +14.8% 🔴 0.61 / 0.61 / +1.0%
job_q69/duckdb:vortex-file-compressed 74723368 / 74015689 / +1.0% 108962456 / 107942718 / +0.9% 0.69 / 0.69 / +0.0%
job_q70/duckdb:vortex-file-compressed 42781428 / 42099830 / +1.6% 78437339 / 78507859 / -0.1% 0.55 / 0.54 / +1.7%
job_q71/duckdb:vortex-file-compressed 67045332 / 65684325 / +2.1% 99859752 / 102915236 / -3.0% 0.67 / 0.64 / +5.2%
job_q72/duckdb:vortex-file-compressed 140587310 / 139564448 / +0.7% 168761988 / 170637083 / -1.1% 0.83 / 0.82 / +1.9%
job_q73/duckdb:vortex-file-compressed 80497638 / 79914618 / +0.7% 121847337 / 123961775 / -1.7% 0.66 / 0.64 / +2.5%
job_q74/duckdb:vortex-file-compressed 67137119 / 71833124 / -6.5% 107809993 / 115865618 / -7.0% 0.62 / 0.62 / +0.4%
job_q75/duckdb:vortex-file-compressed 65044796 / 64828579 / +0.3% 103574401 / 110287747 / -6.1% 0.63 / 0.59 / +6.8%
job_q76/duckdb:vortex-file-compressed 26302803 / 25911617 / +1.5% 50992938 / 50607276 / +0.8% 0.52 / 0.51 / +0.7%
job_q77/duckdb:vortex-file-compressed 26139384 / 25415022 / +2.9% 50344567 / 52654622 / -4.4% 0.52 / 0.48 / +7.6%
job_q78/duckdb:vortex-file-compressed 27166814 / 27102664 / +0.2% 51633117 / 53885894 / -4.2% 0.53 / 0.50 / +4.6%
job_q79/duckdb:vortex-file-compressed 60630298 / 74734594 / -18.9% 🟢 83092649 / 98733201 / -15.8% 🟢 0.73 / 0.76 / -3.6%
job_q80/duckdb:vortex-file-compressed 46916256 / 51296240 / -8.5% 71116557 / 77256185 / -7.9% 0.66 / 0.66 / -0.6%
job_q81/duckdb:vortex-file-compressed 90709547 / 161803052 / -43.9% 🟢 114666393 / 189648772 / -39.5% 🟢 0.79 / 0.85 / -7.3%
job_q82/duckdb:vortex-file-compressed 137242376 / 302972871 / -54.7% 🟢 160804000 / 327195874 / -50.9% 🟢 0.85 / 0.93 / -7.8%
job_q83/duckdb:vortex-file-compressed 40265097 / 39770054 / +1.2% 63004206 / 65918478 / -4.4% 0.64 / 0.60 / +5.9%
job_q84/duckdb:vortex-file-compressed 38309692 / 38385163 / -0.2% 62144751 / 62515699 / -0.6% 0.62 / 0.61 / +0.4%
job_q85/duckdb:vortex-file-compressed 45251145 / 45242714 / +0.0% 69324710 / 70584439 / -1.8% 0.65 / 0.64 / +1.8%
job_q86/duckdb:vortex-file-compressed 63336190 / 63642094 / -0.5% 104143360 / 103128531 / +1.0% 0.61 / 0.62 / -1.5%
job_q87/duckdb:vortex-file-compressed 59664930 / 58067467 / +2.8% 96014838 / 97175474 / -1.2% 0.62 / 0.60 / +4.0%
job_q88/duckdb:vortex-file-compressed 58544720 / 47029933 / +24.5% 🔴 95782487 / 83580453 / +14.6% 🔴 0.61 / 0.56 / +8.6%
job_q89/duckdb:vortex-file-compressed 46985786 / 29770264 / +57.8% 🔴 82413398 / 63894776 / +29.0% 🔴 0.57 / 0.47 / +22.4%
job_q90/duckdb:vortex-file-compressed 69620500 / 68747328 / +1.3% 105980282 / 108770081 / -2.6% 0.66 / 0.63 / +3.9%
job_q91/duckdb:vortex-file-compressed 60479392 / 62053249 / -2.5% 103206949 / 108159548 / -4.6% 0.59 / 0.57 / +2.1%
job_q92/duckdb:vortex-file-compressed 43815506 / 44178287 / -0.8% 82732116 / 85400954 / -3.1% 0.53 / 0.52 / +2.4%
job_q93/duckdb:vortex-file-compressed 68534584 / 68701113 / -0.2% 106958463 / 109114742 / -2.0% 0.64 / 0.63 / +1.8%
job_q94/duckdb:vortex-file-compressed 26571210 / 26095386 / +1.8% 52870481 / 49782031 / +6.2% 0.50 / 0.52 / -4.1%
job_q95/duckdb:vortex-file-compressed 25544802 / 25132370 / +1.6% 47391873 / 48891607 / -3.1% 0.54 / 0.51 / +4.9%
job_q96/duckdb:vortex-file-compressed 28619620 / 27324909 / +4.7% 50704450 / 51653919 / -1.8% 0.56 / 0.53 / +6.7%
job_q97/duckdb:vortex-file-compressed 84436344 / 94585932 / -10.7% 🟢 122313694 / 135655524 / -9.8% 0.69 / 0.70 / -1.0%
job_q98/duckdb:vortex-file-compressed 56379546 / 57117791 / -1.3% 98641754 / 100477511 / -1.8% 0.57 / 0.57 / +0.5%
job_q99/duckdb:vortex-file-compressed 79474431 / 86788128 / -8.4% 117873738 / 127797730 / -7.8% 0.67 / 0.68 / -0.7%
duckdb / parquet / ns (1.001x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 60666356 / 60441104 / +0.4% 70436201 / 66162063 / +6.5% 0.86 / 0.91 / -5.7%
job_q02/duckdb:parquet 150645830 / 148429297 / +1.5% 165850860 / 164258334 / +1.0% 0.91 / 0.90 / +0.5%
job_q03/duckdb:parquet 90132444 / 90166248 / -0.0% 99551240 / 99083874 / +0.5% 0.91 / 0.91 / -0.5%
job_q04/duckdb:parquet 169025212 / 168776749 / +0.1% 181356564 / 180520685 / +0.5% 0.93 / 0.93 / -0.3%
job_q05/duckdb:parquet 76734335 / 76733043 / +0.0% 86966566 / 87712040 / -0.8% 0.88 / 0.87 / +0.9%
job_q06/duckdb:parquet 73465518 / 73435902 / +0.0% 84122069 / 83417253 / +0.8% 0.87 / 0.88 / -0.8%
job_q07/duckdb:parquet 31535550 / 31362095 / +0.6% 41137612 / 41997183 / -2.0% 0.77 / 0.75 / +2.7%
job_q08/duckdb:parquet 93380822 / 93764471 / -0.4% 104503100 / 105790321 / -1.2% 0.89 / 0.89 / +0.8%
job_q09/duckdb:parquet 294093180 / 291923686 / +0.7% 320498234 / 313278980 / +2.3% 0.92 / 0.93 / -1.5%
job_q10/duckdb:parquet 233786630 / 232266460 / +0.7% 259453594 / 256593632 / +1.1% 0.90 / 0.91 / -0.5%
job_q100/duckdb:parquet 219748119 / 222884294 / -1.4% 264996465 / 274660092 / -3.5% 0.83 / 0.81 / +2.2%
job_q101/duckdb:parquet 225016698 / 221803226 / +1.4% 255809004 / 259171851 / -1.3% 0.88 / 0.86 / +2.8%
job_q102/duckdb:parquet 265619926 / 264248709 / +0.5% 287813911 / 302516629 / -4.9% 0.92 / 0.87 / +5.7%
job_q103/duckdb:parquet 200176601 / 194266072 / +3.0% 289192821 / 225393517 / +28.3% 🔴 0.69 / 0.86 / -19.7%
job_q104/duckdb:parquet 173560881 / 165010722 / +5.2% 225392331 / 205816847 / +9.5% 0.77 / 0.80 / -4.0%
job_q105/duckdb:parquet 205278744 / 208558482 / -1.6% 350019831 / 240581990 / +45.5% 🔴 0.59 / 0.87 / -32.3%
job_q106/duckdb:parquet 218728768 / 246167452 / -11.1% 🟢 253285224 / 246053253 / +2.9% 0.86 / 1.00 / -13.7%
job_q107/duckdb:parquet 186297879 / 193457736 / -3.7% 222211620 / 226514775 / -1.9% 0.84 / 0.85 / -1.8%
job_q108/duckdb:parquet 226888058 / 233134414 / -2.7% 270863579 / 267476850 / +1.3% 0.84 / 0.87 / -3.9%
job_q109/duckdb:parquet 30177412 / 30252738 / -0.2% 37427419 / 36593901 / +2.3% 0.81 / 0.83 / -2.5%
job_q11/duckdb:parquet 321949556 / 328419682 / -2.0% 345909358 / 351225695 / -1.5% 0.93 / 0.94 / -0.5%
job_q110/duckdb:parquet 78484821 / 78462460 / +0.0% 86833688 / 86128012 / +0.8% 0.90 / 0.91 / -0.8%
job_q111/duckdb:parquet 109208769 / 109247604 / -0.0% 119676244 / 119073856 / +0.5% 0.91 / 0.92 / -0.5%
job_q112/duckdb:parquet 105893626 / 106773330 / -0.8% 115968377 / 116169994 / -0.2% 0.91 / 0.92 / -0.7%
job_q113/duckdb:parquet 117650766 / 117338080 / +0.3% 126446607 / 127533463 / -0.9% 0.93 / 0.92 / +1.1%
job_q12/duckdb:parquet 107275569 / 108228690 / -0.9% 118110698 / 117293879 / +0.7% 0.91 / 0.92 / -1.6%
job_q13/duckdb:parquet 60172498 / 60349096 / -0.3% 70256746 / 68922443 / +1.9% 0.86 / 0.88 / -2.2%
job_q14/duckdb:parquet 124883057 / 126013304 / -0.9% 134394849 / 135790900 / -1.0% 0.93 / 0.93 / +0.1%
job_q15/duckdb:parquet 362913088 / 364243892 / -0.4% 382673179 / 380084832 / +0.7% 0.95 / 0.96 / -1.0%
job_q16/duckdb:parquet 314898696 / 315209548 / -0.1% 206691972 / 334972588 / -38.3% 🟢 1.52 / 0.94 / +61.9%
job_q17/duckdb:parquet 335893077 / 331996137 / +1.2% 342777065 / 342429575 / +0.1% 0.98 / 0.97 / +1.1%
job_q18/duckdb:parquet 85295668 / 86123485 / -1.0% 98547585 / 100049577 / -1.5% 0.87 / 0.86 / +0.5%
job_q19/duckdb:parquet 72754096 / 73348832 / -0.8% 83093212 / 84720562 / -1.9% 0.88 / 0.87 / +1.1%
job_q20/duckdb:parquet 72207697 / 71928641 / +0.4% 84372198 / 83335994 / +1.2% 0.86 / 0.86 / -0.8%
job_q21/duckdb:parquet 116145968 / 117473609 / -1.1% 130786749 / 135169175 / -3.2% 0.89 / 0.87 / +2.2%
job_q22/duckdb:parquet 109635948 / 111315009 / -1.5% 125856654 / 127957488 / -1.6% 0.87 / 0.87 / +0.1%
job_q23/duckdb:parquet 198561350 / 199169274 / -0.3% 216242919 / 222854655 / -3.0% 0.92 / 0.89 / +2.7%
job_q24/duckdb:parquet 164451760 / 164739564 / -0.2% 188216356 / 184746632 / +1.9% 0.87 / 0.89 / -2.0%
job_q25/duckdb:parquet 132674564 / 133109909 / -0.3% 155030062 / 153483269 / +1.0% 0.86 / 0.87 / -1.3%
job_q26/duckdb:parquet 323792606 / 322742248 / +0.3% 348042057 / 346554148 / +0.4% 0.93 / 0.93 / -0.1%
job_q27/duckdb:parquet 133900872 / 133411202 / +0.4% 149893982 / 151924612 / -1.3% 0.89 / 0.88 / +1.7%
job_q28/duckdb:parquet 146048816 / 144943910 / +0.8% 161059033 / 159996625 / +0.7% 0.91 / 0.91 / +0.1%
job_q29/duckdb:parquet 389994516 / 389971202 / +0.0% 407023249 / 407874680 / -0.2% 0.96 / 0.96 / +0.2%
job_q30/duckdb:parquet 205876302 / 204901089 / +0.5% 218305365 / 217602028 / +0.3% 0.94 / 0.94 / +0.2%
job_q31/duckdb:parquet 313091184 / 312866736 / +0.1% 334262457 / 332985539 / +0.4% 0.94 / 0.94 / -0.3%
job_q32/duckdb:parquet 270039164 / 274398996 / -1.6% 290148897 / 289602355 / +0.2% 0.93 / 0.95 / -1.8%
job_q33/duckdb:parquet 269347682 / 262297320 / +2.7% 280189328 / 282138353 / -0.7% 0.96 / 0.93 / +3.4%
job_q34/duckdb:parquet 417012548 / 415702618 / +0.3% 443758654 / 442063748 / +0.4% 0.94 / 0.94 / -0.1%
job_q35/duckdb:parquet 141813974 / 142853110 / -0.7% 159856078 / 158629062 / +0.8% 0.89 / 0.90 / -1.5%
job_q36/duckdb:parquet 86085994 / 85811400 / +0.3% 102346884 / 101279463 / +1.1% 0.84 / 0.85 / -0.7%
job_q37/duckdb:parquet 247734840 / 249462490 / -0.7% 269651184 / 272216145 / -0.9% 0.92 / 0.92 / +0.3%
job_q38/duckdb:parquet 66174750 / 65237188 / +1.4% 76387989 / 77644464 / -1.6% 0.87 / 0.84 / +3.1%
job_q39/duckdb:parquet 62867567 / 64950966 / -3.2% 70917310 / 72549904 / -2.3% 0.89 / 0.90 / -1.0%
job_q40/duckdb:parquet 81002308 / 81183564 / -0.2% 91061679 / 91929886 / -0.9% 0.89 / 0.88 / +0.7%
job_q41/duckdb:parquet 91119184 / 92572447 / -1.6% 106153799 / 102473118 / +3.6% 0.86 / 0.90 / -5.0%
job_q42/duckdb:parquet 147717494 / 144265320 / +2.4% 248406211 / 161628521 / +53.7% 🔴 0.59 / 0.89 / -33.4%
job_q43/duckdb:parquet 53604080 / 56053240 / -4.4% 70253512 / 68324114 / +2.8% 0.76 / 0.82 / -7.0%
job_q44/duckdb:parquet 202339360 / 178593516 / +13.3% 🔴 192252103 / 207983101 / -7.6% 1.05 / 0.86 / +22.6%
job_q45/duckdb:parquet 177468722 / 178039670 / -0.3% 188815988 / 193116615 / -2.2% 0.94 / 0.92 / +1.9%
job_q46/duckdb:parquet 112967418 / 113304326 / -0.3% 126881388 / 127482602 / -0.5% 0.89 / 0.89 / +0.2%
job_q47/duckdb:parquet 92612146 / 92210164 / +0.4% 104509426 / 104434452 / +0.1% 0.89 / 0.88 / +0.4%
job_q48/duckdb:parquet 172902044 / 172819076 / +0.0% 183809192 / 186187525 / -1.3% 0.94 / 0.93 / +1.3%
job_q49/duckdb:parquet 175076912 / 161906492 / +8.1% 241511378 / 198561691 / +21.6% 🔴 0.72 / 0.82 / -11.1%
job_q50/duckdb:parquet 143127416 / 141481136 / +1.2% 174699134 / 164760613 / +6.0% 0.82 / 0.86 / -4.6%
job_q51/duckdb:parquet 191646530 / 185677762 / +3.2% 212390447 / 225532072 / -5.8% 0.90 / 0.82 / +9.6%
job_q52/duckdb:parquet 180354095 / 185524634 / -2.8% 204750220 / 197603247 / +3.6% 0.88 / 0.94 / -6.2%
job_q53/duckdb:parquet 182361908 / 164688514 / +10.7% 🔴 199205956 / 215379346 / -7.5% 0.92 / 0.76 / +19.7%
job_q54/duckdb:parquet 177948460 / 175509480 / +1.4% 194997697 / 189539349 / +2.9% 0.91 / 0.93 / -1.4%
job_q55/duckdb:parquet 174798972 / 174601590 / +0.1% 189313321 / 189204631 / +0.1% 0.92 / 0.92 / +0.1%
job_q56/duckdb:parquet 155750330 / 155429044 / +0.2% 181138147 / 181490706 / -0.2% 0.86 / 0.86 / +0.4%
job_q57/duckdb:parquet 205109498 / 206751936 / -0.8% 229461804 / 228984137 / +0.2% 0.89 / 0.90 / -1.0%
job_q58/duckdb:parquet 240175880 / 240364758 / -0.1% 265587123 / 267065108 / -0.6% 0.90 / 0.90 / +0.5%
job_q59/duckdb:parquet 226659283 / 226643026 / +0.0% 250853004 / 251592166 / -0.3% 0.90 / 0.90 / +0.3%
job_q60/duckdb:parquet 93714434 / 93598639 / +0.1% 112368863 / 112752285 / -0.3% 0.83 / 0.83 / +0.5%
job_q61/duckdb:parquet 75767606 / 76583892 / -1.1% 92482073 / 92675603 / -0.2% 0.82 / 0.83 / -0.9%
job_q62/duckdb:parquet 73583384 / 73641116 / -0.1% 89673343 / 91181561 / -1.7% 0.82 / 0.81 / +1.6%
job_q63/duckdb:parquet 90448178 / 90857998 / -0.5% 108608685 / 108885695 / -0.3% 0.83 / 0.83 / -0.2%
job_q64/duckdb:parquet 160558691 / 159615446 / +0.6% 184576591 / 184629990 / -0.0% 0.87 / 0.86 / +0.6%
job_q65/duckdb:parquet 111851440 / 111862213 / -0.0% 128872152 / 128653667 / +0.2% 0.87 / 0.87 / -0.2%
job_q66/duckdb:parquet 186957160 / 186743197 / +0.1% 213605579 / 215119605 / -0.7% 0.88 / 0.87 / +0.8%
job_q67/duckdb:parquet 171989073 / 177324892 / -3.0% 247826014 / 175655798 / +41.1% 🔴 0.69 / 1.01 / -31.3%
job_q68/duckdb:parquet 188753546 / 192556254 / -2.0% 209220838 / 207205109 / +1.0% 0.90 / 0.93 / -2.9%
job_q69/duckdb:parquet 306055502 / 302739466 / +1.1% 331065032 / 327573824 / +1.1% 0.92 / 0.92 / +0.0%
job_q70/duckdb:parquet 236068872 / 231212411 / +2.1% 260879595 / 254462355 / +2.5% 0.90 / 0.91 / -0.4%
job_q71/duckdb:parquet 204688868 / 200144460 / +2.3% 228681913 / 221281722 / +3.3% 0.90 / 0.90 / -1.0%
job_q72/duckdb:parquet 291957706 / 291631354 / +0.1% 308307989 / 309406566 / -0.4% 0.95 / 0.94 / +0.5%
job_q73/duckdb:parquet 196661221 / 196498750 / +0.1% 218144475 / 223703550 / -2.5% 0.90 / 0.88 / +2.6%
job_q74/duckdb:parquet 195782158 / 194169050 / +0.8% 220592405 / 222222732 / -0.7% 0.89 / 0.87 / +1.6%
job_q75/duckdb:parquet 226392870 / 225960036 / +0.2% 249739146 / 249875632 / -0.1% 0.91 / 0.90 / +0.2%
job_q76/duckdb:parquet 131663898 / 141914366 / -7.2% 162435167 / 150145704 / +8.2% 0.81 / 0.95 / -14.2%
job_q77/duckdb:parquet 126895176 / 126347606 / +0.4% 152648652 / 163633704 / -6.7% 0.83 / 0.77 / +7.7%
job_q78/duckdb:parquet 127047546 / 143184809 / -11.3% 🟢 177868029 / 152508926 / +16.6% 🔴 0.71 / 0.94 / -23.9%
job_q79/duckdb:parquet 272855042 / 274304924 / -0.5% 286652922 / 295908745 / -3.1% 0.95 / 0.93 / +2.7%
job_q80/duckdb:parquet 247655890 / 237593387 / +4.2% 263820855 / 326357783 / -19.2% 🟢 0.94 / 0.73 / +28.9%
job_q81/duckdb:parquet 356821033 / 380256872 / -6.2% 411337238 / 388514581 / +5.9% 0.87 / 0.98 / -11.4%
job_q82/duckdb:parquet 274009112 / 289839947 / -5.5% 303607410 / 491164301 / -38.2% 🟢 0.90 / 0.59 / +52.9%
job_q83/duckdb:parquet 131907960 / 134219495 / -1.7% 143409742 / 157746799 / -9.1% 0.92 / 0.85 / +8.1%
job_q84/duckdb:parquet 125673721 / 122312579 / +2.7% 146656699 / 146062021 / +0.4% 0.86 / 0.84 / +2.3%
job_q85/duckdb:parquet 151527534 / 145423225 / +4.2% 182109096 / 159297207 / +14.3% 🔴 0.83 / 0.91 / -8.9%
job_q86/duckdb:parquet 231415472 / 227087808 / +1.9% 256397141 / 262391638 / -2.3% 0.90 / 0.87 / +4.3%
job_q87/duckdb:parquet 206785204 / 197314200 / +4.8% 233109753 / 227908925 / +2.3% 0.89 / 0.87 / +2.5%
job_q88/duckdb:parquet 209141884 / 202506236 / +3.3% 230633581 / 239215347 / -3.6% 0.91 / 0.85 / +7.1%
job_q89/duckdb:parquet 166697218 / 167035348 / -0.2% 216424636 / 199566591 / +8.4% 0.77 / 0.84 / -8.0%
job_q90/duckdb:parquet 252815350 / 224978681 / +12.4% 🔴 272979955 / 264941705 / +3.0% 0.93 / 0.85 / +9.1%
job_q91/duckdb:parquet 257567522 / 257192032 / +0.1% 288346774 / 285814096 / +0.9% 0.89 / 0.90 / -0.7%
job_q92/duckdb:parquet 199787458 / 199472064 / +0.2% 227243612 / 229063326 / -0.8% 0.88 / 0.87 / +1.0%
job_q93/duckdb:parquet 241078504 / 243235290 / -0.9% 270859174 / 272611849 / -0.6% 0.89 / 0.89 / -0.2%
job_q94/duckdb:parquet 141045938 / 139329088 / +1.2% 158161228 / 168780712 / -6.3% 0.89 / 0.83 / +8.0%
job_q95/duckdb:parquet 132286602 / 123827505 / +6.8% 160720357 / 147761789 / +8.8% 0.82 / 0.84 / -1.8%
job_q96/duckdb:parquet 142857894 / 142641142 / +0.2% 162753376 / 158602981 / +2.6% 0.88 / 0.90 / -2.4%
job_q97/duckdb:parquet 255077398 / 268787600 / -5.1% 274565156 / 281695374 / -2.5% 0.93 / 0.95 / -2.6%
job_q98/duckdb:parquet 195483468 / 196394201 / -0.5% 251116989 / 256930679 / -2.3% 0.78 / 0.76 / +1.8%
job_q99/duckdb:parquet 250567306 / 252316014 / -0.7% 315964196 / 278060601 / +13.6% 🔴 0.79 / 0.91 / -12.6%
duckdb / duckdb / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7742936 / 7706778 / +0.5% 17143347 / 16681739 / +2.8% 0.45 / 0.46 / -2.2%
job_q02/duckdb:duckdb 5717786 / 5789773 / -1.2% 13683632 / 13268460 / +3.1% 0.42 / 0.44 / -4.2%
job_q03/duckdb:duckdb 6186780 / 6288369 / -1.6% 14714094 / 14034939 / +4.8% 0.42 / 0.45 / -6.2%
job_q04/duckdb:duckdb 5796721 / 5743090 / +0.9% 13561831 / 13218790 / +2.6% 0.43 / 0.43 / -1.6%
job_q05/duckdb:duckdb 14311394 / 14387468 / -0.5% 25439016 / 24930278 / +2.0% 0.56 / 0.58 / -2.5%
job_q06/duckdb:duckdb 14077622 / 14076405 / +0.0% 25831491 / 24730572 / +4.5% 0.54 / 0.57 / -4.3%
job_q07/duckdb:duckdb 10934530 / 10968616 / -0.3% 19683779 / 19763343 / -0.4% 0.56 / 0.55 / +0.1%
job_q08/duckdb:duckdb 16483178 / 16551097 / -0.4% 27102753 / 26820007 / +1.1% 0.61 / 0.62 / -1.4%
job_q09/duckdb:duckdb 63846890 / 62738294 / +1.8% 88878437 / 98088854 / -9.4% 0.72 / 0.64 / +12.3%
job_q10/duckdb:duckdb 41643956 / 41086070 / +1.4% 72161879 / 73269610 / -1.5% 0.58 / 0.56 / +2.9%
job_q100/duckdb:duckdb 24049164 / 24566916 / -2.1% 43102148 / 43744134 / -1.5% 0.56 / 0.56 / -0.6%
job_q101/duckdb:duckdb 25259005 / 25630604 / -1.4% 47007353 / 48991092 / -4.0% 0.54 / 0.52 / +2.7%
job_q102/duckdb:duckdb 45237064 / 44329049 / +2.0% 76146469 / 68530175 / +11.1% 🔴 0.59 / 0.65 / -8.2%
job_q103/duckdb:duckdb 53119246 / 53475550 / -0.7% 86282088 / 82967814 / +4.0% 0.62 / 0.64 / -4.5%
job_q104/duckdb:duckdb 46379724 / 47181588 / -1.7% 71373116 / 72045286 / -0.9% 0.65 / 0.65 / -0.8%
job_q105/duckdb:duckdb 73400928 / 74862312 / -2.0% 103921937 / 103888696 / +0.0% 0.71 / 0.72 / -2.0%
job_q106/duckdb:duckdb 63562178 / 64771908 / -1.9% 93173202 / 93740743 / -0.6% 0.68 / 0.69 / -1.3%
job_q107/duckdb:duckdb 59132271 / 58620389 / +0.9% 87747431 / 88425045 / -0.8% 0.67 / 0.66 / +1.7%
job_q108/duckdb:duckdb 75636058 / 75266764 / +0.5% 106206165 / 108083987 / -1.7% 0.71 / 0.70 / +2.3%
job_q109/duckdb:duckdb 7172522 / 7339053 / -2.3% 15927323 / 15454318 / +3.1% 0.45 / 0.47 / -5.2%
job_q11/duckdb:duckdb 47457595 / 47958790 / -1.0% 82483256 / 85631312 / -3.7% 0.58 / 0.56 / +2.7%
job_q110/duckdb:duckdb 13691584 / 13952354 / -1.9% 23380580 / 23266526 / +0.5% 0.59 / 0.60 / -2.3%
job_q111/duckdb:duckdb 16622879 / 16680287 / -0.3% 28249999 / 27190112 / +3.9% 0.59 / 0.61 / -4.1%
job_q112/duckdb:duckdb 22154662 / 22131646 / +0.1% 35427701 / 34262530 / +3.4% 0.63 / 0.65 / -3.2%
job_q113/duckdb:duckdb 18565096 / 18710222 / -0.8% 30792865 / 30590955 / +0.7% 0.60 / 0.61 / -1.4%
job_q12/duckdb:duckdb 27424724 / 27926558 / -1.8% 38363064 / 37411266 / +2.5% 0.71 / 0.75 / -4.2%
job_q13/duckdb:duckdb 10224491 / 10148654 / +0.7% 18358372 / 19120986 / -4.0% 0.56 / 0.53 / +4.9%
job_q14/duckdb:duckdb 34898488 / 35392994 / -1.4% 46637747 / 45646143 / +2.2% 0.75 / 0.78 / -3.5%
job_q15/duckdb:duckdb 55003903 / 55654750 / -1.2% 87249434 / 87902879 / -0.7% 0.63 / 0.63 / -0.4%
job_q16/duckdb:duckdb 46728179 / 45617041 / +2.4% 74481950 / 74437398 / +0.1% 0.63 / 0.61 / +2.4%
job_q17/duckdb:duckdb 53469460 / 54016253 / -1.0% 85930011 / 85685544 / +0.3% 0.62 / 0.63 / -1.3%
job_q18/duckdb:duckdb 20906636 / 23424274 / -10.7% 🟢 42445659 / 43791919 / -3.1% 0.49 / 0.53 / -7.9%
job_q19/duckdb:duckdb 12235283 / 12067484 / +1.4% 19978692 / 20445824 / -2.3% 0.61 / 0.59 / +3.8%
job_q20/duckdb:duckdb 15423280 / 15361860 / +0.4% 33620674 / 33268667 / +1.1% 0.46 / 0.46 / -0.7%
job_q21/duckdb:duckdb 22259033 / 22596320 / -1.5% 34331349 / 32549921 / +5.5% 0.65 / 0.69 / -6.6%
job_q22/duckdb:duckdb 21417448 / 21831198 / -1.9% 42207019 / 41878914 / +0.8% 0.51 / 0.52 / -2.7%
job_q23/duckdb:duckdb 40509701 / 40360366 / +0.4% 57842880 / 57899944 / -0.1% 0.70 / 0.70 / +0.5%
job_q24/duckdb:duckdb 17112636 / 16640686 / +2.8% 34627484 / 33406428 / +3.7% 0.49 / 0.50 / -0.8%
job_q25/duckdb:duckdb 15353336 / 15603724 / -1.6% 28785608 / 28017738 / +2.7% 0.53 / 0.56 / -4.2%
job_q26/duckdb:duckdb 78267414 / 78492264 / -0.3% 127372501 / 127190674 / +0.1% 0.61 / 0.62 / -0.4%
job_q27/duckdb:duckdb 26500166 / 25956164 / +2.1% 43050676 / 43120693 / -0.2% 0.62 / 0.60 / +2.3%
job_q28/duckdb:duckdb 25466892 / 25860526 / -1.5% 41637670 / 42151167 / -1.2% 0.61 / 0.61 / -0.3%
job_q29/duckdb:duckdb 86141768 / 86411954 / -0.3% 99234472 / 98508198 / +0.7% 0.87 / 0.88 / -1.0%
job_q30/duckdb:duckdb 57222058 / 56183616 / +1.8% 69323054 / 70504545 / -1.7% 0.83 / 0.80 / +3.6%
job_q31/duckdb:duckdb 67409052 / 67483294 / -0.1% 88888012 / 90153174 / -1.4% 0.76 / 0.75 / +1.3%
job_q32/duckdb:duckdb 47492866 / 47434042 / +0.1% 71057547 / 70821596 / +0.3% 0.67 / 0.67 / -0.2%
job_q33/duckdb:duckdb 56506520 / 57063583 / -1.0% 77834721 / 78220221 / -0.5% 0.73 / 0.73 / -0.5%
job_q34/duckdb:duckdb 93570954 / 94401102 / -0.9% 112907153 / 111513275 / +1.2% 0.83 / 0.85 / -2.1%
job_q35/duckdb:duckdb 22368896 / 21948832 / +1.9% 40777918 / 41138169 / -0.9% 0.55 / 0.53 / +2.8%
job_q36/duckdb:duckdb 16128122 / 15447545 / +4.4% 32488810 / 32569856 / -0.2% 0.50 / 0.47 / +4.7%
job_q37/duckdb:duckdb 52379875 / 51934867 / +0.9% 76717361 / 75074395 / +2.2% 0.68 / 0.69 / -1.3%
job_q38/duckdb:duckdb 18210070 / 18822586 / -3.3% 33235363 / 31364648 / +6.0% 0.55 / 0.60 / -8.7%
job_q39/duckdb:duckdb 13881203 / 14044862 / -1.2% 25936968 / 26047069 / -0.4% 0.54 / 0.54 / -0.7%
job_q40/duckdb:duckdb 25893976 / 25384735 / +2.0% 38759367 / 37624243 / +3.0% 0.67 / 0.67 / -1.0%
job_q41/duckdb:duckdb 40756726 / 40625104 / +0.3% 52537420 / 50305460 / +4.4% 0.78 / 0.81 / -3.9%
job_q42/duckdb:duckdb 20617901 / 20395397 / +1.1% 31837965 / 30551830 / +4.2% 0.65 / 0.67 / -3.0%
job_q43/duckdb:duckdb 24508321 / 23959013 / +2.3% 36951754 / 36366884 / +1.6% 0.66 / 0.66 / +0.7%
job_q44/duckdb:duckdb 28879217 / 29368112 / -1.7% 41221855 / 40503310 / +1.8% 0.70 / 0.73 / -3.4%
job_q45/duckdb:duckdb 22293316 / 22260752 / +0.1% 36212250 / 35022579 / +3.4% 0.62 / 0.64 / -3.1%
job_q46/duckdb:duckdb 34371580 / 34613348 / -0.7% 47146240 / 46358765 / +1.7% 0.73 / 0.75 / -2.4%
job_q47/duckdb:duckdb 32461602 / 32344129 / +0.4% 44726296 / 44007339 / +1.6% 0.73 / 0.73 / -1.3%
job_q48/duckdb:duckdb 58700276 / 58568431 / +0.2% 72065988 / 71204627 / +1.2% 0.81 / 0.82 / -1.0%
job_q49/duckdb:duckdb 53098375 / 52731721 / +0.7% 67769940 / 67442416 / +0.5% 0.78 / 0.78 / +0.2%
job_q50/duckdb:duckdb 27410540 / 27315354 / +0.3% 39232154 / 38631054 / +1.6% 0.70 / 0.71 / -1.2%
job_q51/duckdb:duckdb 39475604 / 39216580 / +0.7% 51756647 / 53131256 / -2.6% 0.76 / 0.74 / +3.3%
job_q52/duckdb:duckdb 35250866 / 34912086 / +1.0% 51388575 / 50975843 / +0.8% 0.69 / 0.68 / +0.2%
job_q53/duckdb:duckdb 22027876 / 22164123 / -0.6% 36959254 / 37434899 / -1.3% 0.60 / 0.59 / +0.7%
job_q54/duckdb:duckdb 60186149 / 60121783 / +0.1% 75422960 / 74388575 / +1.4% 0.80 / 0.81 / -1.3%
job_q55/duckdb:duckdb 66992247 / 66744126 / +0.4% 83602987 / 83273723 / +0.4% 0.80 / 0.80 / -0.0%
job_q56/duckdb:duckdb 25034795 / 24886424 / +0.6% 46674544 / 47914503 / -2.6% 0.54 / 0.52 / +3.3%
job_q57/duckdb:duckdb 112781014 / 112215300 / +0.5% 132977898 / 134222264 / -0.9% 0.85 / 0.84 / +1.4%
job_q58/duckdb:duckdb 45028997 / 45523932 / -1.1% 66702522 / 66984540 / -0.4% 0.68 / 0.68 / -0.7%
job_q59/duckdb:duckdb 42334798 / 42359234 / -0.1% 66853986 / 64292988 / +4.0% 0.63 / 0.66 / -3.9%
job_q60/duckdb:duckdb 47539526 / 47524596 / +0.0% 65570573 / 66220359 / -1.0% 0.73 / 0.72 / +1.0%
job_q61/duckdb:duckdb 54643504 / 55307234 / -1.2% 72123868 / 72925723 / -1.1% 0.76 / 0.76 / -0.1%
job_q62/duckdb:duckdb 53036152 / 53106184 / -0.1% 70004731 / 69853207 / +0.2% 0.76 / 0.76 / -0.3%
job_q63/duckdb:duckdb 58979139 / 58932776 / +0.1% 75982293 / 77244972 / -1.6% 0.78 / 0.76 / +1.7%
job_q64/duckdb:duckdb 46672038 / 46116920 / +1.2% 66051034 / 66098609 / -0.1% 0.71 / 0.70 / +1.3%
job_q65/duckdb:duckdb 73429363 / 75617778 / -2.9% 90906971 / 90151646 / +0.8% 0.81 / 0.84 / -3.7%
job_q66/duckdb:duckdb 53682180 / 55405150 / -3.1% 81925446 / 83355985 / -1.7% 0.66 / 0.66 / -1.4%
job_q67/duckdb:duckdb 24486834 / 24329342 / +0.6% 47998723 / 47980726 / +0.0% 0.51 / 0.51 / +0.6%
job_q68/duckdb:duckdb 53731588 / 53384100 / +0.7% 78523308 / 76303362 / +2.9% 0.68 / 0.70 / -2.2%
job_q69/duckdb:duckdb 77816072 / 76185245 / +2.1% 97236380 / 99680202 / -2.5% 0.80 / 0.76 / +4.7%
job_q70/duckdb:duckdb 47344284 / 46997581 / +0.7% 66372683 / 67272731 / -1.3% 0.71 / 0.70 / +2.1%
job_q71/duckdb:duckdb 80516802 / 80994689 / -0.6% 99919018 / 103981026 / -3.9% 0.81 / 0.78 / +3.5%
job_q72/duckdb:duckdb 110879042 / 110785134 / +0.1% 127949025 / 130046372 / -1.6% 0.87 / 0.85 / +1.7%
job_q73/duckdb:duckdb 64722954 / 64850271 / -0.2% 87771309 / 85739413 / +2.4% 0.74 / 0.76 / -2.5%
job_q74/duckdb:duckdb 61847001 / 61977750 / -0.2% 85076968 / 86536682 / -1.7% 0.73 / 0.72 / +1.5%
job_q75/duckdb:duckdb 54760186 / 54995948 / -0.4% 77795229 / 77134936 / +0.9% 0.70 / 0.71 / -1.3%
job_q76/duckdb:duckdb 23663793 / 24643650 / -4.0% 44082104 / 42504097 / +3.7% 0.54 / 0.58 / -7.4%
job_q77/duckdb:duckdb 22313635 / 21901377 / +1.9% 37178830 / 36706441 / +1.3% 0.60 / 0.60 / +0.6%
job_q78/duckdb:duckdb 24805750 / 24263133 / +2.2% 43182852 / 42402086 / +1.8% 0.57 / 0.57 / +0.4%
job_q79/duckdb:duckdb 62466294 / 62933990 / -0.7% 80365843 / 80012381 / +0.4% 0.78 / 0.79 / -1.2%
job_q80/duckdb:duckdb 46451004 / 46628476 / -0.4% 63359880 / 63562952 / -0.3% 0.73 / 0.73 / -0.1%
job_q81/duckdb:duckdb 102702108 / 102548904 / +0.1% 120897098 / 121450536 / -0.5% 0.85 / 0.84 / +0.6%
job_q82/duckdb:duckdb 144256156 / 144230006 / +0.0% 161234965 / 162260973 / -0.6% 0.89 / 0.89 / +0.7%
job_q83/duckdb:duckdb 48780681 / 48719751 / +0.1% 69037909 / 63620364 / +8.5% 0.71 / 0.77 / -7.7%
job_q84/duckdb:duckdb 26434436 / 26266770 / +0.6% 45760915 / 39992642 / +14.4% 🔴 0.58 / 0.66 / -12.0%
job_q85/duckdb:duckdb 50092202 / 49948624 / +0.3% 65149398 / 66169295 / -1.5% 0.77 / 0.75 / +1.9%
job_q86/duckdb:duckdb 54697172 / 54383419 / +0.6% 80101738 / 78689373 / +1.8% 0.68 / 0.69 / -1.2%
job_q87/duckdb:duckdb 32488922 / 32962605 / -1.4% 61227769 / 52962112 / +15.6% 🔴 0.53 / 0.62 / -14.7%
job_q88/duckdb:duckdb 48669798 / 48351066 / +0.7% 76661767 / 78863642 / -2.8% 0.63 / 0.61 / +3.6%
job_q89/duckdb:duckdb 25604171 / 25529591 / +0.3% 47747653 / 48005144 / -0.5% 0.54 / 0.53 / +0.8%
job_q90/duckdb:duckdb 59549348 / 59160114 / +0.7% 86673263 / 85681407 / +1.2% 0.69 / 0.69 / -0.5%
job_q91/duckdb:duckdb 54122420 / 54472708 / -0.6% 84634121 / 84253937 / +0.5% 0.64 / 0.65 / -1.1%
job_q92/duckdb:duckdb 34420648 / 34624884 / -0.6% 60808488 / 60563854 / +0.4% 0.57 / 0.57 / -1.0%
job_q93/duckdb:duckdb 78946110 / 78800750 / +0.2% 107770963 / 109180497 / -1.3% 0.73 / 0.72 / +1.5%
job_q94/duckdb:duckdb 22267324 / 23104090 / -3.6% 38118205 / 37670011 / +1.2% 0.58 / 0.61 / -4.8%
job_q95/duckdb:duckdb 20138160 / 21686470 / -7.1% 35290706 / 35978285 / -1.9% 0.57 / 0.60 / -5.3%
job_q96/duckdb:duckdb 22052236 / 22218348 / -0.7% 38664280 / 39006881 / -0.9% 0.57 / 0.57 / +0.1%
job_q97/duckdb:duckdb 85295851 / 87313616 / -2.3% 102389731 / 105263178 / -2.7% 0.83 / 0.83 / +0.4%
job_q98/duckdb:duckdb 45158904 / 45727915 / -1.2% 61796162 / 63727994 / -3.0% 0.73 / 0.72 / +1.8%
job_q99/duckdb:duckdb 76971428 / 77498097 / -0.7% 95910661 / 95512810 / +0.4% 0.80 / 0.81 / -1.1%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241728 / 1223583 / +1.5% 22231818 / 22393554 / -0.7% 0.06 / 0.05 / +2.2%
clickbench_q01/datafusion:vortex-file-compressed 6045216 / 6046842 / -0.0% 35853437 / 29592395 / +21.2% 🔴 0.17 / 0.20 / -17.5%
clickbench_q02/datafusion:vortex-file-compressed 10614114 / 10531240 / +0.8% 45645717 / 46036487 / -0.8% 0.23 / 0.23 / +1.6%
clickbench_q03/datafusion:vortex-file-compressed 12639754 / 12387916 / +2.0% 58257127 / 56727916 / +2.7% 0.22 / 0.22 / -0.6%
clickbench_q04/datafusion:vortex-file-compressed 57303231 / 58081216 / -1.3% 104181131 / 103589636 / +0.6% 0.55 / 0.56 / -1.9%
clickbench_q05/datafusion:vortex-file-compressed 77341508 / 79014320 / -2.1% 126452360 / 128484768 / -1.6% 0.61 / 0.61 / -0.5%
clickbench_q06/datafusion:vortex-file-compressed 1249554 / 1263943 / -1.1% 21851760 / 22422362 / -2.5% 0.06 / 0.06 / +1.4%
clickbench_q07/datafusion:vortex-file-compressed 9623737 / 9508768 / +1.2% 33224106 / 33881448 / -1.9% 0.29 / 0.28 / +3.2%
clickbench_q08/datafusion:vortex-file-compressed 80947780 / 79137674 / +2.3% 125086939 / 128803436 / -2.9% 0.65 / 0.61 / +5.3%
clickbench_q09/datafusion:vortex-file-compressed 169967016 / 173755480 / -2.2% 220998997 / 207375596 / +6.6% 0.77 / 0.84 / -8.2%
clickbench_q10/datafusion:vortex-file-compressed 22634372 / 23479735 / -3.6% 70313242 / 69620750 / +1.0% 0.32 / 0.34 / -4.5%
clickbench_q11/datafusion:vortex-file-compressed 25297312 / 26005739 / -2.7% 72392470 / 70384896 / +2.9% 0.35 / 0.37 / -5.4%
clickbench_q12/datafusion:vortex-file-compressed 74168768 / 75527217 / -1.8% 126373251 / 123896189 / +2.0% 0.59 / 0.61 / -3.7%
clickbench_q13/datafusion:vortex-file-compressed 116239266 / 115900178 / +0.3% 191691820 / 187353692 / +2.3% 0.61 / 0.62 / -2.0%
clickbench_q14/datafusion:vortex-file-compressed 76290999 / 75510882 / +1.0% 132620806 / 125936863 / +5.3% 0.58 / 0.60 / -4.1%
clickbench_q15/datafusion:vortex-file-compressed 63880699 / 63030918 / +1.3% 105723708 / 100187136 / +5.5% 0.60 / 0.63 / -4.0%
clickbench_q16/datafusion:vortex-file-compressed 154324284 / 155538995 / -0.8% 213878271 / 217221220 / -1.5% 0.72 / 0.72 / +0.8%
clickbench_q17/datafusion:vortex-file-compressed 155511940 / 155207311 / +0.2% 229124613 / 226552616 / +1.1% 0.68 / 0.69 / -0.9%
clickbench_q18/datafusion:vortex-file-compressed 300470745 / 294130736 / +2.2% 387993447 / 390830976 / -0.7% 0.77 / 0.75 / +2.9%
clickbench_q19/datafusion:vortex-file-compressed 7865032 / 8303792 / -5.3% 48803132 / 48242070 / +1.2% 0.16 / 0.17 / -6.4%
clickbench_q20/datafusion:vortex-file-compressed 66699464 / 71745774 / -7.0% 244345144 / 248435282 / -1.6% 0.27 / 0.29 / -5.5%
clickbench_q21/datafusion:vortex-file-compressed 78909119 / 79455405 / -0.7% 295877698 / 288506255 / +2.6% 0.27 / 0.28 / -3.2%
clickbench_q22/datafusion:vortex-file-compressed 91628794 / 91696814 / -0.1% 395657798 / 390845073 / +1.2% 0.23 / 0.23 / -1.3%
clickbench_q23/datafusion:vortex-file-compressed 195449073 / 183993637 / +6.2% 546749667 / 539539151 / +1.3% 0.36 / 0.34 / +4.8%
clickbench_q24/datafusion:vortex-file-compressed 15130496 / 15307686 / -1.2% 72307674 / 70032970 / +3.2% 0.21 / 0.22 / -4.3%
clickbench_q25/datafusion:vortex-file-compressed 19170938 / 19863486 / -3.5% 64185253 / 62923085 / +2.0% 0.30 / 0.32 / -5.4%
clickbench_q26/datafusion:vortex-file-compressed 16558074 / 16533236 / +0.2% 71388092 / 70743668 / +0.9% 0.23 / 0.23 / -0.8%
clickbench_q27/datafusion:vortex-file-compressed 101138797 / 101740724 / -0.6% 258664833 / 251569553 / +2.8% 0.39 / 0.40 / -3.3%
clickbench_q28/datafusion:vortex-file-compressed 562326680 / 562333160 / -0.0% 660929862 / 643537242 / +2.7% 0.85 / 0.87 / -2.6%
clickbench_q29/datafusion:vortex-file-compressed 24283555 / 24245137 / +0.2% 56877300 / 53670057 / +6.0% 0.43 / 0.45 / -5.5%
clickbench_q30/datafusion:vortex-file-compressed 57919478 / 57397381 / +0.9% 114177481 / 112998342 / +1.0% 0.51 / 0.51 / -0.1%
clickbench_q31/datafusion:vortex-file-compressed 67706962 / 65356445 / +3.6% 157067708 / 163081172 / -3.7% 0.43 / 0.40 / +7.6%
clickbench_q32/datafusion:vortex-file-compressed 287108382 / 290282297 / -1.1% 384631351 / 393223115 / -2.2% 0.75 / 0.74 / +1.1%
clickbench_q33/datafusion:vortex-file-compressed 320707698 / 324626808 / -1.2% 435398277 / 432328318 / +0.7% 0.74 / 0.75 / -1.9%
clickbench_q34/datafusion:vortex-file-compressed 322005786 / 324894899 / -0.9% 444150516 / 444404496 / -0.1% 0.72 / 0.73 / -0.8%
clickbench_q35/datafusion:vortex-file-compressed 58085546 / 56027504 / +3.7% 88861758 / 93654723 / -5.1% 0.65 / 0.60 / +9.3%
clickbench_q36/datafusion:vortex-file-compressed 37671314 / 37622886 / +0.1% 67475800 / 67872658 / -0.6% 0.56 / 0.55 / +0.7%
clickbench_q37/datafusion:vortex-file-compressed 21350680 / 21259280 / +0.4% 47565146 / 47424626 / +0.3% 0.45 / 0.45 / +0.1%
clickbench_q38/datafusion:vortex-file-compressed 12924611 / 13259514 / -2.5% 41956931 / 41723747 / +0.6% 0.31 / 0.32 / -3.1%
clickbench_q39/datafusion:vortex-file-compressed 78928452 / 78839799 / +0.1% 112662292 / 111367852 / +1.2% 0.70 / 0.71 / -1.0%
clickbench_q40/datafusion:vortex-file-compressed 10709614 / 10378568 / +3.2% 37327911 / 36528657 / +2.2% 0.29 / 0.28 / +1.0%
clickbench_q41/datafusion:vortex-file-compressed 10245262 / 9976754 / +2.7% 34829773 / 34471787 / +1.0% 0.29 / 0.29 / +1.6%
clickbench_q42/datafusion:vortex-file-compressed 10062434 / 10423952 / -3.5% 35153848 / 35196628 / -0.1% 0.29 / 0.30 / -3.4%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1247330 / 1245842 / +0.1% 51036829 / 49718186 / +2.7% 0.02 / 0.03 / -2.5%
clickbench_q01/datafusion:parquet 16366454 / 15975198 / +2.4% 71603715 / 66883453 / +7.1% 0.23 / 0.24 / -4.3%
clickbench_q02/datafusion:parquet 18659308 / 19024956 / -1.9% 79612443 / 81292366 / -2.1% 0.23 / 0.23 / +0.1%
clickbench_q03/datafusion:parquet 17330263 / 17560503 / -1.3% 79371223 / 79048536 / +0.4% 0.22 / 0.22 / -1.7%
clickbench_q04/datafusion:parquet 63334636 / 62657254 / +1.1% 124424493 / 129056405 / -3.6% 0.51 / 0.49 / +4.8%
clickbench_q05/datafusion:parquet 89648057 / 89388218 / +0.3% 157823725 / 157935497 / -0.1% 0.57 / 0.57 / +0.4%
clickbench_q06/datafusion:parquet 1280335 / 1247492 / +2.6% 49993912 / 49860473 / +0.3% 0.03 / 0.03 / +2.4%
clickbench_q07/datafusion:parquet 16928062 / 16844414 / +0.5% 67894872 / 67110170 / +1.2% 0.25 / 0.25 / -0.7%
clickbench_q08/datafusion:parquet 84818789 / 85805378 / -1.1% 166994347 / 160618520 / +4.0% 0.51 / 0.53 / -4.9%
clickbench_q09/datafusion:parquet 191955788 / 187483740 / +2.4% 273810924 / 273970246 / -0.1% 0.70 / 0.68 / +2.4%
clickbench_q10/datafusion:parquet 35655570 / 35933968 / -0.8% 100371483 / 99356253 / +1.0% 0.36 / 0.36 / -1.8%
clickbench_q11/datafusion:parquet 43184306 / 42619872 / +1.3% 113469134 / 107756386 / +5.3% 0.38 / 0.40 / -3.8%
clickbench_q12/datafusion:parquet 96312804 / 96266114 / +0.0% 163087617 / 162038776 / +0.6% 0.59 / 0.59 / -0.6%
clickbench_q13/datafusion:parquet 147918748 / 146539911 / +0.9% 231529353 / 227411999 / +1.8% 0.64 / 0.64 / -0.9%
clickbench_q14/datafusion:parquet 102377354 / 102721975 / -0.3% 174605769 / 174323102 / +0.2% 0.59 / 0.59 / -0.5%
clickbench_q15/datafusion:parquet 75219414 / 72072821 / +4.4% 132916054 / 130369029 / +2.0% 0.57 / 0.55 / +2.4%
clickbench_q16/datafusion:parquet 157079345 / 155655536 / +0.9% 239177968 / 242072681 / -1.2% 0.66 / 0.64 / +2.1%
clickbench_q17/datafusion:parquet 156031608 / 156748302 / -0.5% 234506676 / 234690281 / -0.1% 0.67 / 0.67 / -0.4%
clickbench_q18/datafusion:parquet 311709950 / 311937038 / -0.1% 421145630 / 429885360 / -2.0% 0.74 / 0.73 / +2.0%
clickbench_q19/datafusion:parquet 18996474 / 18985055 / +0.1% 77959347 / 76428879 / +2.0% 0.24 / 0.25 / -1.9%
clickbench_q20/datafusion:parquet 180179667 / 178201950 / +1.1% 295082170 / 277984119 / +6.2% 0.61 / 0.64 / -4.7%
clickbench_q21/datafusion:parquet 174625943 / 174353110 / +0.2% 313438064 / 298763106 / +4.9% 0.56 / 0.58 / -4.5%
clickbench_q22/datafusion:parquet 260520919 / 264644574 / -1.6% 453199441 / 427231380 / +6.1% 0.57 / 0.62 / -7.2%
clickbench_q23/datafusion:parquet 1016366756 / 1015310230 / +0.1% 1183724070 / 1186767292 / -0.3% 0.86 / 0.86 / +0.4%
clickbench_q24/datafusion:parquet 30432208 / 30461840 / -0.1% 90962739 / 89550560 / +1.6% 0.33 / 0.34 / -1.6%
clickbench_q25/datafusion:parquet 37011540 / 36461936 / +1.5% 103839332 / 103796692 / +0.0% 0.36 / 0.35 / +1.5%
clickbench_q26/datafusion:parquet 30821502 / 30640387 / +0.6% 91709913 / 89946311 / +2.0% 0.34 / 0.34 / -1.3%
clickbench_q27/datafusion:parquet 192884897 / 192726410 / +0.1% 296892021 / 288972174 / +2.7% 0.65 / 0.67 / -2.6%
clickbench_q28/datafusion:parquet 623141537 / 621473269 / +0.3% 707883524 / 715604342 / -1.1% 0.88 / 0.87 / +1.4%
clickbench_q29/datafusion:parquet 29117890 / 28657065 / +1.6% 91010111 / 90415523 / +0.7% 0.32 / 0.32 / +0.9%
clickbench_q30/datafusion:parquet 90326326 / 91351340 / -1.1% 174336831 / 172111509 / +1.3% 0.52 / 0.53 / -2.4%
clickbench_q31/datafusion:parquet 102804000 / 102634058 / +0.2% 199551487 / 198577852 / +0.5% 0.52 / 0.52 / -0.3%
clickbench_q32/datafusion:parquet 307464644 / 311819602 / -1.4% 428723203 / 434802281 / -1.4% 0.72 / 0.72 / +0.0%
clickbench_q33/datafusion:parquet 381329216 / 380089808 / +0.3% 477777084 / 473796518 / +0.8% 0.80 / 0.80 / -0.5%
clickbench_q34/datafusion:parquet 378462444 / 376914011 / +0.4% 480239086 / 477819866 / +0.5% 0.79 / 0.79 / -0.1%
clickbench_q35/datafusion:parquet 64720839 / 65520001 / -1.2% 123046918 / 122720394 / +0.3% 0.53 / 0.53 / -1.5%
clickbench_q36/datafusion:parquet 73912149 / 73697400 / +0.3% 137133018 / 136472185 / +0.5% 0.54 / 0.54 / -0.2%
clickbench_q37/datafusion:parquet 35491059 / 35543201 / -0.1% 90321101 / 91265731 / -1.0% 0.39 / 0.39 / +0.9%
clickbench_q38/datafusion:parquet 48012658 / 48184051 / -0.4% 107914801 / 110190286 / -2.1% 0.44 / 0.44 / +1.7%
clickbench_q39/datafusion:parquet 144396767 / 143896086 / +0.3% 210906147 / 213345420 / -1.1% 0.68 / 0.67 / +1.5%
clickbench_q40/datafusion:parquet 19850961 / 20053370 / -1.0% 76644943 / 78117633 / -1.9% 0.26 / 0.26 / +0.9%
clickbench_q41/datafusion:parquet 18980243 / 18881718 / +0.5% 76262168 / 76285755 / -0.0% 0.25 / 0.25 / +0.6%
clickbench_q42/datafusion:parquet 19266018 / 19347004 / -0.4% 74247732 / 74154859 / +0.1% 0.26 / 0.26 / -0.5%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2195152 / 2237106 / -1.9% 26518845 / 25307876 / +4.8% 0.08 / 0.09 / -6.4%
clickbench_q01/duckdb:vortex-file-compressed 7482319 / 7655398 / -2.3% 29623278 / 30911132 / -4.2% 0.25 / 0.25 / +2.0%
clickbench_q02/duckdb:vortex-file-compressed 9083107 / 9039239 / +0.5% 35391554 / 38103656 / -7.1% 0.26 / 0.24 / +8.2%
clickbench_q03/duckdb:vortex-file-compressed 13829705 / 14038454 / -1.5% 52469937 / 51361504 / +2.2% 0.26 / 0.27 / -3.6%
clickbench_q04/duckdb:vortex-file-compressed 56087518 / 55959632 / +0.2% 88674265 / 90702001 / -2.2% 0.63 / 0.62 / +2.5%
clickbench_q05/duckdb:vortex-file-compressed 63943170 / 63897903 / +0.1% 93338692 / 96923586 / -3.7% 0.69 / 0.66 / +3.9%
clickbench_q06/duckdb:vortex-file-compressed 2611134 / 2644494 / -1.3% 30091469 / 29217110 / +3.0% 0.09 / 0.09 / -4.1%
clickbench_q07/duckdb:vortex-file-compressed 9490220 / 9511088 / -0.2% 32351292 / 30810489 / +5.0% 0.29 / 0.31 / -5.0%
clickbench_q08/duckdb:vortex-file-compressed 70240864 / 69255778 / +1.4% 108371117 / 107914279 / +0.4% 0.65 / 0.64 / +1.0%
clickbench_q09/duckdb:vortex-file-compressed 92288490 / 92548142 / -0.3% 127354580 / 128409391 / -0.8% 0.72 / 0.72 / +0.5%
clickbench_q10/duckdb:vortex-file-compressed 28114650 / 27689274 / +1.5% 72254242 / 72148281 / +0.1% 0.39 / 0.38 / +1.4%
clickbench_q11/duckdb:vortex-file-compressed 30828522 / 30540370 / +0.9% 74890748 / 79204582 / -5.4% 0.41 / 0.39 / +6.8%
clickbench_q12/duckdb:vortex-file-compressed 72779272 / 69892491 / +4.1% 101379783 / 100654921 / +0.7% 0.72 / 0.69 / +3.4%
clickbench_q13/duckdb:vortex-file-compressed 123735294 / 127172012 / -2.7% 170348999 / 169732824 / +0.4% 0.73 / 0.75 / -3.1%
clickbench_q14/duckdb:vortex-file-compressed 74644295 / 74951316 / -0.4% 108194270 / 108241821 / -0.0% 0.69 / 0.69 / -0.4%
clickbench_q15/duckdb:vortex-file-compressed 76587427 / 75857344 / +1.0% 111030847 / 109421143 / +1.5% 0.69 / 0.69 / -0.5%
clickbench_q16/duckdb:vortex-file-compressed 136630229 / 133718120 / +2.2% 172773741 / 172972559 / -0.1% 0.79 / 0.77 / +2.3%
clickbench_q17/duckdb:vortex-file-compressed 142753370 / 139145834 / +2.6% 172591968 / 176256527 / -2.1% 0.83 / 0.79 / +4.8%
clickbench_q18/duckdb:vortex-file-compressed 255880526 / 261284120 / -2.1% 306521896 / 305972300 / +0.2% 0.83 / 0.85 / -2.2%
clickbench_q19/duckdb:vortex-file-compressed 9609784 / 9433455 / +1.9% 38693632 / 38621943 / +0.2% 0.25 / 0.24 / +1.7%
clickbench_q20/duckdb:vortex-file-compressed 67577142 / 67552078 / +0.0% 173606776 / 169737178 / +2.3% 0.39 / 0.40 / -2.2%
clickbench_q21/duckdb:vortex-file-compressed 86189122 / 85506677 / +0.8% 194127768 / 194027861 / +0.1% 0.44 / 0.44 / +0.7%
clickbench_q22/duckdb:vortex-file-compressed 175024717 / 176474637 / -0.8% 351962750 / 345523729 / +1.9% 0.50 / 0.51 / -2.6%
clickbench_q23/duckdb:vortex-file-compressed 41501576 / 41929978 / -1.0% 88891769 / 90293247 / -1.6% 0.47 / 0.46 / +0.5%
clickbench_q24/duckdb:vortex-file-compressed 14370067 / 14160536 / +1.5% 36389152 / 39660096 / -8.2% 0.39 / 0.36 / +10.6%
clickbench_q25/duckdb:vortex-file-compressed 19249558 / 19419968 / -0.9% 53468750 / 54403251 / -1.7% 0.36 / 0.36 / +0.9%
clickbench_q26/duckdb:vortex-file-compressed 11365272 / 11388071 / -0.2% 35615005 / 39205981 / -9.2% 0.32 / 0.29 / +9.9%
clickbench_q27/duckdb:vortex-file-compressed 54688263 / 55108350 / -0.8% 179193341 / 180380940 / -0.7% 0.31 / 0.31 / -0.1%
clickbench_q28/duckdb:vortex-file-compressed 510428554 / 516077988 / -1.1% 566082851 / 559514013 / +1.2% 0.90 / 0.92 / -2.2%
clickbench_q29/duckdb:vortex-file-compressed 16532374 / 16801554 / -1.6% 39589945 / 43120020 / -8.2% 0.42 / 0.39 / +7.2%
clickbench_q30/duckdb:vortex-file-compressed 60522088 / 60694336 / -0.3% 110834133 / 112438538 / -1.4% 0.55 / 0.54 / +1.2%
clickbench_q31/duckdb:vortex-file-compressed 110818856 / 110928932 / -0.1% 199447667 / 200481515 / -0.5% 0.56 / 0.55 / +0.4%
clickbench_q32/duckdb:vortex-file-compressed 382517980 / 376905062 / +1.5% 404884534 / 411978991 / -1.7% 0.94 / 0.91 / +3.3%
clickbench_q33/duckdb:vortex-file-compressed 346901221 / 346800168 / +0.0% 418784426 / 400039829 / +4.7% 0.83 / 0.87 / -4.4%
clickbench_q34/duckdb:vortex-file-compressed 351667643 / 358757820 / -2.0% 412267188 / 415394371 / -0.8% 0.85 / 0.86 / -1.2%
clickbench_q35/duckdb:vortex-file-compressed 58443570 / 57165394 / +2.2% 87421207 / 89565873 / -2.4% 0.67 / 0.64 / +4.7%
clickbench_q36/duckdb:vortex-file-compressed 11679968 / 11736720 / -0.5% 32299963 / 31701737 / +1.9% 0.36 / 0.37 / -2.3%
clickbench_q37/duckdb:vortex-file-compressed 8260738 / 8307028 / -0.6% 27360662 / 28390029 / -3.6% 0.30 / 0.29 / +3.2%
clickbench_q38/duckdb:vortex-file-compressed 8750260 / 9089105 / -3.7% 30032874 / 28411635 / +5.7% 0.29 / 0.32 / -8.9%
clickbench_q39/duckdb:vortex-file-compressed 19198232 / 18985566 / +1.1% 41230133 / 41519995 / -0.7% 0.47 / 0.46 / +1.8%
clickbench_q40/duckdb:vortex-file-compressed 7474516 / 7541189 / -0.9% 29179485 / 26930257 / +8.4% 0.26 / 0.28 / -8.5%
clickbench_q41/duckdb:vortex-file-compressed 8523222 / 8447401 / +0.9% 30426493 / 30600085 / -0.6% 0.28 / 0.28 / +1.5%
clickbench_q42/duckdb:vortex-file-compressed 7587519 / 7460622 / +1.7% 30998927 / 28688927 / +8.1% 0.24 / 0.26 / -5.9%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9283260 / 9718106 / -4.5% 14571282 / 14404944 / +1.2% 0.64 / 0.67 / -5.6%
clickbench_q01/duckdb:parquet 15036008 / 15834801 / -5.0% 20694960 / 20779530 / -0.4% 0.73 / 0.76 / -4.7%
clickbench_q02/duckdb:parquet 22564014 / 22998262 / -1.9% 31655842 / 30933941 / +2.3% 0.71 / 0.74 / -4.1%
clickbench_q03/duckdb:parquet 23421802 / 22952789 / +2.0% 34174777 / 36373798 / -6.0% 0.69 / 0.63 / +8.6%
clickbench_q04/duckdb:parquet 61129516 / 61553110 / -0.7% 72873579 / 78571229 / -7.3% 0.84 / 0.78 / +7.1%
clickbench_q05/duckdb:parquet 86452260 / 82357820 / +5.0% 99714715 / 96778532 / +3.0% 0.87 / 0.85 / +1.9%
clickbench_q06/duckdb:parquet 20710636 / 20631596 / +0.4% 30570309 / 27932745 / +9.4% 0.68 / 0.74 / -8.3%
clickbench_q07/duckdb:parquet 17452847 / 17411882 / +0.2% 26112440 / 23086324 / +13.1% 🔴 0.67 / 0.75 / -11.4%
clickbench_q08/duckdb:parquet 75656051 / 74193970 / +2.0% 86793128 / 88499093 / -1.9% 0.87 / 0.84 / +4.0%
clickbench_q09/duckdb:parquet 103852150 / 102344946 / +1.5% 120218262 / 118287242 / +1.6% 0.86 / 0.87 / -0.2%
clickbench_q10/duckdb:parquet 41517541 / 41585957 / -0.2% 54810351 / 53914290 / +1.7% 0.76 / 0.77 / -1.8%
clickbench_q11/duckdb:parquet 47507147 / 46376690 / +2.4% 62255280 / 62469950 / -0.3% 0.76 / 0.74 / +2.8%
clickbench_q12/duckdb:parquet 93011772 / 93246466 / -0.3% 110413626 / 106709132 / +3.5% 0.84 / 0.87 / -3.6%
clickbench_q13/duckdb:parquet 151352118 / 151353115 / -0.0% 172565473 / 168774480 / +2.2% 0.88 / 0.90 / -2.2%
clickbench_q14/duckdb:parquet 101574128 / 101132109 / +0.4% 116728718 / 121484338 / -3.9% 0.87 / 0.83 / +4.5%
clickbench_q15/duckdb:parquet 86882723 / 87152113 / -0.3% 105667471 / 99157583 / +6.6% 0.82 / 0.88 / -6.5%
clickbench_q16/duckdb:parquet 162880520 / 161518198 / +0.8% 179353280 / 177677559 / +0.9% 0.91 / 0.91 / -0.1%
clickbench_q17/duckdb:parquet 166302038 / 163501751 / +1.7% 181729402 / 179044078 / +1.5% 0.92 / 0.91 / +0.2%
clickbench_q18/duckdb:parquet 289935920 / 297760434 / -2.6% 320055023 / 317638716 / +0.8% 0.91 / 0.94 / -3.4%
clickbench_q19/duckdb:parquet 19939182 / 20044906 / -0.5% 26790807 / 26219883 / +2.2% 0.74 / 0.76 / -2.6%
clickbench_q20/duckdb:parquet 183987327 / 190656931 / -3.5% 230921396 / 223372775 / +3.4% 0.80 / 0.85 / -6.7%
clickbench_q21/duckdb:parquet 223604410 / 221775748 / +0.8% 270086724 / 270636772 / -0.2% 0.83 / 0.82 / +1.0%
clickbench_q22/duckdb:parquet 308629298 / 316494844 / -2.5% 360991209 / 356496439 / +1.3% 0.85 / 0.89 / -3.7%
clickbench_q23/duckdb:parquet 173664613 / 172903391 / +0.4% 251268911 / 233746562 / +7.5% 0.69 / 0.74 / -6.6%
clickbench_q24/duckdb:parquet 30877006 / 30525626 / +1.2% 39078331 / 44919682 / -13.0% 🟢 0.79 / 0.68 / +16.3%
clickbench_q25/duckdb:parquet 43168080 / 43279324 / -0.3% 57017818 / 55176174 / +3.3% 0.76 / 0.78 / -3.5%
clickbench_q26/duckdb:parquet 30694540 / 29909380 / +2.6% 44088445 / 47593911 / -7.4% 0.70 / 0.63 / +10.8%
clickbench_q27/duckdb:parquet 190211982 / 190317469 / -0.1% 235563092 / 230460935 / +2.2% 0.81 / 0.83 / -2.2%
clickbench_q28/duckdb:parquet 965806076 / 966912630 / -0.1% 947036949 / 939906810 / +0.8% 1.02 / 1.03 / -0.9%
clickbench_q29/duckdb:parquet 24534808 / 23708308 / +3.5% 30765980 / 31487776 / -2.3% 0.80 / 0.75 / +5.9%
clickbench_q30/duckdb:parquet 105427793 / 107434616 / -1.9% 124878508 / 126651318 / -1.4% 0.84 / 0.85 / -0.5%
clickbench_q31/duckdb:parquet 159357889 / 146264200 / +9.0% 174987900 / 172955499 / +1.2% 0.91 / 0.85 / +7.7%
clickbench_q32/duckdb:parquet 388491481 / 392919146 / -1.1% 412256593 / 417034375 / -1.1% 0.94 / 0.94 / +0.0%
clickbench_q33/duckdb:parquet 473312066 / 489452036 / -3.3% 438387777 / 442277693 / -0.9% 1.08 / 1.11 / -2.4%
clickbench_q34/duckdb:parquet 476109054 / 466236417 / +2.1% 459796643 / 469010681 / -2.0% 1.04 / 0.99 / +4.2%
clickbench_q35/duckdb:parquet 61901480 / 61471326 / +0.7% 69234666 / 75534239 / -8.3% 0.89 / 0.81 / +9.9%
clickbench_q36/duckdb:parquet 30552220 / 30715884 / -0.5% 36022946 / 36664389 / -1.7% 0.85 / 0.84 / +1.2%
clickbench_q37/duckdb:parquet 23291454 / 23465799 / -0.7% 30438763 / 29463089 / +3.3% 0.77 / 0.80 / -3.9%
clickbench_q38/duckdb:parquet 23395602 / 23803284 / -1.7% 29736237 / 30067802 / -1.1% 0.79 / 0.79 / -0.6%
clickbench_q39/duckdb:parquet 52722502 / 53454965 / -1.4% 59443794 / 60267957 / -1.4% 0.89 / 0.89 / -0.0%
clickbench_q40/duckdb:parquet 14491778 / 14620130 / -0.9% 22747777 / 20417625 / +11.4% 🔴 0.64 / 0.72 / -11.0%
clickbench_q41/duckdb:parquet 15828848 / 15522580 / +2.0% 19826057 / 20561068 / -3.6% 0.80 / 0.75 / +5.8%
clickbench_q42/duckdb:parquet 13798425 / 14508395 / -4.9% 20065018 / 21329381 / -5.9% 0.69 / 0.68 / +1.1%
duckdb / duckdb / ns (1.004x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11277241 / 11372586 / -0.8% 14094533 / 14034919 / +0.4% 0.80 / 0.81 / -1.3%
clickbench_q01/duckdb:duckdb 26285353 / 26769822 / -1.8% 44972857 / 46543727 / -3.4% 0.58 / 0.58 / +1.6%
clickbench_q02/duckdb:duckdb 22716677 / 22788563 / -0.3% 50400575 / 51379504 / -1.9% 0.45 / 0.44 / +1.6%
clickbench_q03/duckdb:duckdb 21314194 / 21332977 / -0.1% 46021528 / 46979298 / -2.0% 0.46 / 0.45 / +2.0%
clickbench_q04/duckdb:duckdb 75175132 / 74111458 / +1.4% 100686991 / 98965330 / +1.7% 0.75 / 0.75 / -0.3%
clickbench_q05/duckdb:duckdb 79532284 / 80206366 / -0.8% 103825183 / 105322912 / -1.4% 0.77 / 0.76 / +0.6%
clickbench_q06/duckdb:duckdb 21656540 / 21500606 / +0.7% 30753501 / 30752850 / +0.0% 0.70 / 0.70 / +0.7%
clickbench_q07/duckdb:duckdb 17684296 / 17543636 / +0.8% 36208931 / 36190639 / +0.1% 0.49 / 0.48 / +0.8%
clickbench_q08/duckdb:duckdb 88503990 / 86588476 / +2.2% 119161115 / 118531034 / +0.5% 0.74 / 0.73 / +1.7%
clickbench_q09/duckdb:duckdb 98318040 / 97118146 / +1.2% 139174204 / 138858753 / +0.2% 0.71 / 0.70 / +1.0%
clickbench_q10/duckdb:duckdb 53010162 / 52193274 / +1.6% 90301254 / 90149953 / +0.2% 0.59 / 0.58 / +1.4%
clickbench_q11/duckdb:duckdb 56714670 / 55856278 / +1.5% 99993469 / 97049178 / +3.0% 0.57 / 0.58 / -1.5%
clickbench_q12/duckdb:duckdb 82038003 / 81898000 / +0.2% 109049920 / 106283169 / +2.6% 0.75 / 0.77 / -2.4%
clickbench_q13/duckdb:duckdb 149709202 / 145740899 / +2.7% 181669339 / 183905149 / -1.2% 0.82 / 0.79 / +4.0%
clickbench_q14/duckdb:duckdb 91898807 / 93287238 / -1.5% 116979021 / 118762701 / -1.5% 0.79 / 0.79 / +0.0%
clickbench_q15/duckdb:duckdb 83681552 / 82513386 / +1.4% 106777075 / 106748372 / +0.0% 0.78 / 0.77 / +1.4%
clickbench_q16/duckdb:duckdb 168514184 / 172925660 / -2.6% 190417527 / 192623542 / -1.1% 0.88 / 0.90 / -1.4%
clickbench_q17/duckdb:duckdb 154141548 / 155806730 / -1.1% 184757815 / 191888243 / -3.7% 0.83 / 0.81 / +2.7%
clickbench_q18/duckdb:duckdb 302623713 / 304984286 / -0.8% 357834699 / 356600301 / +0.3% 0.85 / 0.86 / -1.1%
clickbench_q19/duckdb:duckdb 17786346 / 17784426 / +0.0% 37221257 / 33771073 / +10.2% 🔴 0.48 / 0.53 / -9.3%
clickbench_q20/duckdb:duckdb 192757444 / 186415120 / +3.4% 476646438 / 472683366 / +0.8% 0.40 / 0.39 / +2.5%
clickbench_q21/duckdb:duckdb 174144646 / 170521278 / +2.1% 467642119 / 462411565 / +1.1% 0.37 / 0.37 / +1.0%
clickbench_q22/duckdb:duckdb 188184062 / 216613882 / -13.1% 🟢 483606962 / 457855262 / +5.6% 0.39 / 0.47 / -17.8%
clickbench_q23/duckdb:duckdb 68365808 / 69797978 / -2.1% 151685183 / 147356175 / +2.9% 0.45 / 0.47 / -4.8%
clickbench_q24/duckdb:duckdb 30630245 / 30466238 / +0.5% 45901748 / 47573856 / -3.5% 0.67 / 0.64 / +4.2%
clickbench_q25/duckdb:duckdb 41330975 / 40873174 / +1.1% 74643432 / 76249016 / -2.1% 0.55 / 0.54 / +3.3%
clickbench_q26/duckdb:duckdb 31275407 / 30794396 / +1.6% 48014272 / 48827256 / -1.7% 0.65 / 0.63 / +3.3%
clickbench_q27/duckdb:duckdb 161423725 / 154013706 / +4.8% 437110350 / 412828492 / +5.9% 0.37 / 0.37 / -1.0%
clickbench_q28/duckdb:duckdb 848353961 / 852966240 / -0.5% 908878687 / 933073880 / -2.6% 0.93 / 0.91 / +2.1%
clickbench_q29/duckdb:duckdb 27492666 / 27460904 / +0.1% 45495532 / 46275120 / -1.7% 0.60 / 0.59 / +1.8%
clickbench_q30/duckdb:duckdb 101261033 / 101120300 / +0.1% 169080426 / 166287016 / +1.7% 0.60 / 0.61 / -1.5%
clickbench_q31/duckdb:duckdb 164297827 / 171293704 / -4.1% 245188998 / 244499014 / +0.3% 0.67 / 0.70 / -4.4%
clickbench_q32/duckdb:duckdb 476548741 / 468681177 / +1.7% 499873060 / 490752489 / +1.9% 0.95 / 0.96 / -0.2%
clickbench_q33/duckdb:duckdb 482400900 / 438400974 / +10.0% 🔴 603753654 / 595932066 / +1.3% 0.80 / 0.74 / +8.6%
clickbench_q34/duckdb:duckdb 474126801 / 444858506 / +6.6% 623687805 / 617767616 / +1.0% 0.76 / 0.72 / +5.6%
clickbench_q35/duckdb:duckdb 75704532 / 74776466 / +1.2% 96353905 / 94645139 / +1.8% 0.79 / 0.79 / -0.6%
clickbench_q36/duckdb:duckdb 32074766 / 31927428 / +0.5% 47326802 / 48915582 / -3.2% 0.68 / 0.65 / +3.8%
clickbench_q37/duckdb:duckdb 16940632 / 17120342 / -1.0% 28339793 / 28964403 / -2.2% 0.60 / 0.59 / +1.1%
clickbench_q38/duckdb:duckdb 19537417 / 18752755 / +4.2% 37417719 / 36134756 / +3.6% 0.52 / 0.52 / +0.6%
clickbench_q39/duckdb:duckdb 55254603 / 54388438 / +1.6% 80958807 / 79240531 / +2.2% 0.68 / 0.69 / -0.6%
clickbench_q40/duckdb:duckdb 16184316 / 16351105 / -1.0% 31321458 / 30698904 / +2.0% 0.52 / 0.53 / -3.0%
clickbench_q41/duckdb:duckdb 15949954 / 15980965 / -0.2% 28127542 / 29250462 / -3.8% 0.57 / 0.55 / +3.8%
clickbench_q42/duckdb:duckdb 16019018 / 16269247 / -1.5% 27966623 / 29905837 / -6.5% 0.57 / 0.54 / +5.3%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20632284 / 21075930 / -2.1% 38242419 / 38638247 / -1.0% 0.54 / 0.55 / -1.1%
tpcds_q02/datafusion:vortex-file-compressed 43888006 / 44337330 / -1.0% 65335213 / 64322678 / +1.6% 0.67 / 0.69 / -2.5%
tpcds_q03/datafusion:vortex-file-compressed 11072680 / 11162676 / -0.8% 26760247 / 27874319 / -4.0% 0.41 / 0.40 / +3.3%
tpcds_q04/datafusion:vortex-file-compressed 87237473 / 86734277 / +0.6% 117647634 / 118451152 / -0.7% 0.74 / 0.73 / +1.3%
tpcds_q05/datafusion:vortex-file-compressed 56275614 / 56827797 / -1.0% 76476542 / 76114099 / +0.5% 0.74 / 0.75 / -1.4%
tpcds_q06/datafusion:vortex-file-compressed 22610014 / 22692446 / -0.4% 42560444 / 42045614 / +1.2% 0.53 / 0.54 / -1.6%
tpcds_q07/datafusion:vortex-file-compressed 29332798 / 28756891 / +2.0% 50160896 / 50270298 / -0.2% 0.58 / 0.57 / +2.2%
tpcds_q08/datafusion:vortex-file-compressed 24736505 / 24565008 / +0.7% 44904478 / 44075611 / +1.9% 0.55 / 0.56 / -1.2%
tpcds_q09/datafusion:vortex-file-compressed 20389279 / 21207415 / -3.9% 37527722 / 35851284 / +4.7% 0.54 / 0.59 / -8.2%
tpcds_q10/datafusion:vortex-file-compressed 27303122 / 27171788 / +0.5% 48764499 / 48716984 / +0.1% 0.56 / 0.56 / +0.4%
tpcds_q11/datafusion:vortex-file-compressed 52250610 / 52909560 / -1.2% 81120190 / 79987379 / +1.4% 0.64 / 0.66 / -2.6%
tpcds_q12/datafusion:vortex-file-compressed 14588270 / 14883221 / -2.0% 31842211 / 31358319 / +1.5% 0.46 / 0.47 / -3.5%
tpcds_q13/datafusion:vortex-file-compressed 31283669 / 31185554 / +0.3% 55593107 / 56269502 / -1.2% 0.56 / 0.55 / +1.5%
tpcds_q14/datafusion:vortex-file-compressed 485301650 / 489067088 / -0.8% 540044176 / 543494011 / -0.6% 0.90 / 0.90 / -0.1%
tpcds_q15/datafusion:vortex-file-compressed 12466269 / 12361730 / +0.8% 33435311 / 32624708 / +2.5% 0.37 / 0.38 / -1.6%
tpcds_q16/datafusion:vortex-file-compressed 18393482 / 18767600 / -2.0% 37917528 / 37497209 / +1.1% 0.49 / 0.50 / -3.1%
tpcds_q17/datafusion:vortex-file-compressed 53901902 / 54689321 / -1.4% 67247184 / 71444295 / -5.9% 0.80 / 0.77 / +4.7%
tpcds_q18/datafusion:vortex-file-compressed 62322446 / 62745430 / -0.7% 86301701 / 84923290 / +1.6% 0.72 / 0.74 / -2.3%
tpcds_q19/datafusion:vortex-file-compressed 16610506 / 16953830 / -2.0% 37895536 / 38328755 / -1.1% 0.44 / 0.44 / -0.9%
tpcds_q20/datafusion:vortex-file-compressed 16084586 / 15971812 / +0.7% 36258346 / 36958911 / -1.9% 0.44 / 0.43 / +2.7%
tpcds_q21/datafusion:vortex-file-compressed 16401356 / 16341850 / +0.4% 38744937 / 37152728 / +4.3% 0.42 / 0.44 / -3.8%
tpcds_q22/datafusion:vortex-file-compressed 49294430 / 49281792 / +0.0% 73895411 / 72884478 / +1.4% 0.67 / 0.68 / -1.3%
tpcds_q23/datafusion:vortex-file-compressed 70148492 / 70660138 / -0.7% 96336979 / 98187087 / -1.9% 0.73 / 0.72 / +1.2%
tpcds_q24/datafusion:vortex-file-compressed 64571122 / 64849742 / -0.4% 86442566 / 85912267 / +0.6% 0.75 / 0.75 / -1.0%
tpcds_q25/datafusion:vortex-file-compressed 44838320 / 48102446 / -6.8% 65966359 / 73606543 / -10.4% 🟢 0.68 / 0.65 / +4.0%
tpcds_q26/datafusion:vortex-file-compressed 25403439 / 25675571 / -1.1% 47073259 / 46144233 / +2.0% 0.54 / 0.56 / -3.0%
tpcds_q27/datafusion:vortex-file-compressed 59386332 / 57037719 / +4.1% 81773838 / 79256017 / +3.2% 0.73 / 0.72 / +0.9%
tpcds_q28/datafusion:vortex-file-compressed 24079454 / 24421590 / -1.4% 38735682 / 41637022 / -7.0% 0.62 / 0.59 / +6.0%
tpcds_q29/datafusion:vortex-file-compressed 49656920 / 53192800 / -6.6% 67279128 / 75657345 / -11.1% 🟢 0.74 / 0.70 / +5.0%
tpcds_q30/datafusion:vortex-file-compressed 25893842 / 25828708 / +0.3% 44016433 / 43291925 / +1.7% 0.59 / 0.60 / -1.4%
tpcds_q31/datafusion:vortex-file-compressed 58736876 / 58867606 / -0.2% 83559303 / 83455412 / +0.1% 0.70 / 0.71 / -0.3%
tpcds_q32/datafusion:vortex-file-compressed 12522112 / 12386412 / +1.1% 29731892 / 28927311 / +2.8% 0.42 / 0.43 / -1.6%
tpcds_q33/datafusion:vortex-file-compressed 28094924 / 27251526 / +3.1% 50119651 / 48738507 / +2.8% 0.56 / 0.56 / +0.3%
tpcds_q34/datafusion:vortex-file-compressed 17515805 / 17480834 / +0.2% 36041592 / 34421823 / +4.7% 0.49 / 0.51 / -4.3%
tpcds_q35/datafusion:vortex-file-compressed 30269444 / 30075320 / +0.6% 52751320 / 53053102 / -0.6% 0.57 / 0.57 / +1.2%
tpcds_q36/datafusion:vortex-file-compressed 46880135 / 46675208 / +0.4% 68812892 / 69079110 / -0.4% 0.68 / 0.68 / +0.8%
tpcds_q37/datafusion:vortex-file-compressed 11843254 / 11904318 / -0.5% 32072710 / 33415021 / -4.0% 0.37 / 0.36 / +3.7%
tpcds_q38/datafusion:vortex-file-compressed 25847727 / 25706742 / +0.5% 47544681 / 46753111 / +1.7% 0.54 / 0.55 / -1.1%
tpcds_q39/datafusion:vortex-file-compressed 65587337 / 64869784 / +1.1% 88080736 / 89570934 / -1.7% 0.74 / 0.72 / +2.8%
tpcds_q40/datafusion:vortex-file-compressed 23028786 / 23325174 / -1.3% 43566776 / 42047023 / +3.6% 0.53 / 0.55 / -4.7%
tpcds_q41/datafusion:vortex-file-compressed 20514964 / 20342688 / +0.8% 32536197 / 31695807 / +2.7% 0.63 / 0.64 / -1.8%
tpcds_q42/datafusion:vortex-file-compressed 10919083 / 10755524 / +1.5% 26481068 / 26462137 / +0.1% 0.41 / 0.41 / +1.4%
tpcds_q43/datafusion:vortex-file-compressed 12305472 / 12549322 / -1.9% 30497922 / 31280405 / -2.5% 0.40 / 0.40 / +0.6%
tpcds_q44/datafusion:vortex-file-compressed 29314792 / 28515654 / +2.8% 53557564 / 50995861 / +5.0% 0.55 / 0.56 / -2.1%
tpcds_q45/datafusion:vortex-file-compressed 16195328 / 16298120 / -0.6% 34099607 / 33457337 / +1.9% 0.47 / 0.49 / -2.5%
tpcds_q46/datafusion:vortex-file-compressed 23265948 / 23229427 / +0.2% 46989616 / 44755548 / +5.0% 0.50 / 0.52 / -4.6%
tpcds_q47/datafusion:vortex-file-compressed 74501831 / 74695810 / -0.3% 106314009 / 101833669 / +4.4% 0.70 / 0.73 / -4.5%
tpcds_q48/datafusion:vortex-file-compressed 28936670 / 28485442 / +1.6% 51162364 / 50825432 / +0.7% 0.57 / 0.56 / +0.9%
tpcds_q49/datafusion:vortex-file-compressed 62097540 / 56616678 / +9.7% 80354520 / 79193807 / +1.5% 0.77 / 0.71 / +8.1%
tpcds_q50/datafusion:vortex-file-compressed 29686824 / 30225275 / -1.8% 52574715 / 51542216 / +2.0% 0.56 / 0.59 / -3.7%
tpcds_q51/datafusion:vortex-file-compressed 66002534 / 66238316 / -0.4% 85950625 / 85961923 / -0.0% 0.77 / 0.77 / -0.3%
tpcds_q52/datafusion:vortex-file-compressed 11394232 / 11173757 / +2.0% 26960495 / 26707892 / +0.9% 0.42 / 0.42 / +1.0%
tpcds_q53/datafusion:vortex-file-compressed 17598306 / 17815272 / -1.2% 37368389 / 38592794 / -3.2% 0.47 / 0.46 / +2.0%
tpcds_q54/datafusion:vortex-file-compressed 31397452 / 31294044 / +0.3% 52401646 / 54411096 / -3.7% 0.60 / 0.58 / +4.2%
tpcds_q55/datafusion:vortex-file-compressed 10741630 / 10977064 / -2.1% 27339221 / 26445815 / +3.4% 0.39 / 0.42 / -5.3%
tpcds_q56/datafusion:vortex-file-compressed 26479651 / 26267608 / +0.8% 46693313 / 47242232 / -1.2% 0.57 / 0.56 / +2.0%
tpcds_q57/datafusion:vortex-file-compressed 61564482 / 61853212 / -0.5% 87236781 / 86088207 / +1.3% 0.71 / 0.72 / -1.8%
tpcds_q58/datafusion:vortex-file-compressed 38191848 / 38380444 / -0.5% 62387263 / 63376054 / -1.6% 0.61 / 0.61 / +1.1%
tpcds_q59/datafusion:vortex-file-compressed 29531216 / 29424571 / +0.4% 52909780 / 53366384 / -0.9% 0.56 / 0.55 / +1.2%
tpcds_q60/datafusion:vortex-file-compressed 26182420 / 25428852 / +3.0% 47796890 / 46248957 / +3.3% 0.55 / 0.55 / -0.4%
tpcds_q61/datafusion:vortex-file-compressed 21274736 / 21069785 / +1.0% 42729835 / 42650322 / +0.2% 0.50 / 0.49 / +0.8%
tpcds_q62/datafusion:vortex-file-compressed 16292059 / 16464280 / -1.0% 34828861 / 34481569 / +1.0% 0.47 / 0.48 / -2.0%
tpcds_q63/datafusion:vortex-file-compressed 17900236 / 17537600 / +2.1% 38657945 / 37514994 / +3.0% 0.46 / 0.47 / -0.9%
tpcds_q64/datafusion:vortex-file-compressed 210647837 / 209658176 / +0.5% 250119913 / 244014821 / +2.5% 0.84 / 0.86 / -2.0%
tpcds_q65/datafusion:vortex-file-compressed 72902640 / 71931186 / +1.4% 92287360 / 93293623 / -1.1% 0.79 / 0.77 / +2.5%
tpcds_q66/datafusion:vortex-file-compressed 49883855 / 50314022 / -0.9% 72545658 / 73443461 / -1.2% 0.69 / 0.69 / +0.4%
tpcds_q67/datafusion:vortex-file-compressed 50855428 / 50809885 / +0.1% 81523073 / 80439935 / +1.3% 0.62 / 0.63 / -1.2%
tpcds_q68/datafusion:vortex-file-compressed 22953480 / 22935066 / +0.1% 46932271 / 46212376 / +1.6% 0.49 / 0.50 / -1.5%
tpcds_q69/datafusion:vortex-file-compressed 25368318 / 25957220 / -2.3% 47225048 / 48199065 / -2.0% 0.54 / 0.54 / -0.3%
tpcds_q70/datafusion:vortex-file-compressed 71246662 / 70921686 / +0.5% 93996927 / 91526378 / +2.7% 0.76 / 0.77 / -2.2%
tpcds_q71/datafusion:vortex-file-compressed 19175616 / 19479654 / -1.6% 38963511 / 39385822 / -1.1% 0.49 / 0.49 / -0.5%
tpcds_q72/datafusion:vortex-file-compressed 347453478 / 349635619 / -0.6% 401949420 / 390053124 / +3.0% 0.86 / 0.90 / -3.6%
tpcds_q73/datafusion:vortex-file-compressed 16245076 / 16370256 / -0.8% 35528220 / 35825318 / -0.8% 0.46 / 0.46 / +0.1%
tpcds_q74/datafusion:vortex-file-compressed 39942583 / 40729710 / -1.9% 66345115 / 66101755 / +0.4% 0.60 / 0.62 / -2.3%
tpcds_q75/datafusion:vortex-file-compressed 136302932 / 133231577 / +2.3% 164893481 / 159508865 / +3.4% 0.83 / 0.84 / -1.0%
tpcds_q76/datafusion:vortex-file-compressed 29727478 / 29878010 / -0.5% 47683932 / 49131830 / -2.9% 0.62 / 0.61 / +2.5%
tpcds_q77/datafusion:vortex-file-compressed 44462190 / 44794824 / -0.7% 65770264 / 68725579 / -4.3% 0.68 / 0.65 / +3.7%
tpcds_q78/datafusion:vortex-file-compressed 64048507 / 64149016 / -0.2% 92339988 / 91826652 / +0.6% 0.69 / 0.70 / -0.7%
tpcds_q79/datafusion:vortex-file-compressed 19954734 / 19747138 / +1.1% 39329464 / 41330856 / -4.8% 0.51 / 0.48 / +6.2%
tpcds_q80/datafusion:vortex-file-compressed 73131080 / 73516756 / -0.5% 101101499 / 103399339 / -2.2% 0.72 / 0.71 / +1.7%
tpcds_q81/datafusion:vortex-file-compressed 26474132 / 26433507 / +0.2% 44221474 / 44049315 / +0.4% 0.60 / 0.60 / -0.2%
tpcds_q82/datafusion:vortex-file-compressed 11978360 / 12061347 / -0.7% 33143924 / 33334269 / -0.6% 0.36 / 0.36 / -0.1%
tpcds_q83/datafusion:vortex-file-compressed 33102694 / 32437804 / +2.0% 52209211 / 52048289 / +0.3% 0.63 / 0.62 / +1.7%
tpcds_q84/datafusion:vortex-file-compressed 10194411 / 10107068 / +0.9% 25918949 / 25586667 / +1.3% 0.39 / 0.40 / -0.4%
tpcds_q85/datafusion:vortex-file-compressed 53021628 / 53327322 / -0.6% 80497943 / 79919547 / +0.7% 0.66 / 0.67 / -1.3%
tpcds_q86/datafusion:vortex-file-compressed 15923330 / 15658314 / +1.7% 32901762 / 32167556 / +2.3% 0.48 / 0.49 / -0.6%
tpcds_q87/datafusion:vortex-file-compressed 26014856 / 26232334 / -0.8% 48104606 / 48269535 / -0.3% 0.54 / 0.54 / -0.5%
tpcds_q88/datafusion:vortex-file-compressed 31516082 / 31404654 / +0.4% 51976222 / 50217706 / +3.5% 0.61 / 0.63 / -3.0%
tpcds_q89/datafusion:vortex-file-compressed 21032642 / 20857143 / +0.8% 42046959 / 40998842 / +2.6% 0.50 / 0.51 / -1.7%
tpcds_q90/datafusion:vortex-file-compressed 9870345 / 9857710 / +0.1% 24309550 / 24004775 / +1.3% 0.41 / 0.41 / -1.1%
tpcds_q91/datafusion:vortex-file-compressed 17193014 / 16590985 / +3.6% 35776482 / 36406808 / -1.7% 0.48 / 0.46 / +5.5%
tpcds_q92/datafusion:vortex-file-compressed 13008504 / 12785642 / +1.7% 28151734 / 28212901 / -0.2% 0.46 / 0.45 / +2.0%
tpcds_q93/datafusion:vortex-file-compressed 20526462 / 20514612 / +0.1% 38888892 / 39172325 / -0.7% 0.53 / 0.52 / +0.8%
tpcds_q94/datafusion:vortex-file-compressed 18444784 / 18329141 / +0.6% 36658566 / 37017769 / -1.0% 0.50 / 0.50 / +1.6%
tpcds_q95/datafusion:vortex-file-compressed 42078362 / 41892583 / +0.4% 61659796 / 60792282 / +1.4% 0.68 / 0.69 / -1.0%
tpcds_q96/datafusion:vortex-file-compressed 7525640 / 7680347 / -2.0% 23872841 / 24590568 / -2.9% 0.32 / 0.31 / +0.9%
tpcds_q97/datafusion:vortex-file-compressed 16765174 / 16976546 / -1.2% 36939077 / 36962622 / -0.1% 0.45 / 0.46 / -1.2%
tpcds_q98/datafusion:vortex-file-compressed 16578594 / 16323012 / +1.6% 36089819 / 35491744 / +1.7% 0.46 / 0.46 / -0.1%
tpcds_q99/datafusion:vortex-file-compressed 15994504 / 16055726 / -0.4% 35746871 / 34645287 / +3.2% 0.45 / 0.46 / -3.5%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21483386 / 21065032 / +2.0% 39672949 / 39528391 / +0.4% 0.54 / 0.53 / +1.6%
tpcds_q02/datafusion:vortex-compact 43703334 / 44106575 / -0.9% 65835213 / 67563123 / -2.6% 0.66 / 0.65 / +1.7%
tpcds_q03/datafusion:vortex-compact 11388760 / 11352138 / +0.3% 31075688 / 30858362 / +0.7% 0.37 / 0.37 / -0.4%
tpcds_q04/datafusion:vortex-compact 90587982 / 93166594 / -2.8% 123581495 / 122199014 / +1.1% 0.73 / 0.76 / -3.9%
tpcds_q05/datafusion:vortex-compact 56123486 / 56717756 / -1.0% 84756123 / 85335088 / -0.7% 0.66 / 0.66 / -0.4%
tpcds_q06/datafusion:vortex-compact 23621248 / 23089156 / +2.3% 45158969 / 43867644 / +2.9% 0.52 / 0.53 / -0.6%
tpcds_q07/datafusion:vortex-compact 31029035 / 31291232 / -0.8% 51592232 / 51476216 / +0.2% 0.60 / 0.61 / -1.1%
tpcds_q08/datafusion:vortex-compact 26769656 / 26413722 / +1.3% 48842540 / 48316526 / +1.1% 0.55 / 0.55 / +0.3%
tpcds_q09/datafusion:vortex-compact 23863216 / 24528260 / -2.7% 41444677 / 42574955 / -2.7% 0.58 / 0.58 / -0.1%
tpcds_q10/datafusion:vortex-compact 31335677 / 30176728 / +3.8% 51375990 / 51605838 / -0.4% 0.61 / 0.58 / +4.3%
tpcds_q11/datafusion:vortex-compact 56360068 / 56950432 / -1.0% 85620950 / 85796098 / -0.2% 0.66 / 0.66 / -0.8%
tpcds_q12/datafusion:vortex-compact 18779802 / 18451125 / +1.8% 36689262 / 36150222 / +1.5% 0.51 / 0.51 / +0.3%
tpcds_q13/datafusion:vortex-compact 47013672 / 46427449 / +1.3% 67289562 / 65869650 / +2.2% 0.70 / 0.70 / -0.9%
tpcds_q14/datafusion:vortex-compact 633629516 / 629205922 / +0.7% 688333782 / 689786202 / -0.2% 0.92 / 0.91 / +0.9%
tpcds_q15/datafusion:vortex-compact 14229310 / 13979340 / +1.8% 33287951 / 33989785 / -2.1% 0.43 / 0.41 / +3.9%
tpcds_q16/datafusion:vortex-compact 19545536 / 19383450 / +0.8% 40248406 / 40868165 / -1.5% 0.49 / 0.47 / +2.4%
tpcds_q17/datafusion:vortex-compact 57590678 / 54460970 / +5.7% 72114926 / 80233468 / -10.1% 🟢 0.80 / 0.68 / +17.7%
tpcds_q18/datafusion:vortex-compact 60871823 / 60912238 / -0.1% 80836627 / 80533098 / +0.4% 0.75 / 0.76 / -0.4%
tpcds_q19/datafusion:vortex-compact 19062502 / 18982145 / +0.4% 39453611 / 39897235 / -1.1% 0.48 / 0.48 / +1.6%
tpcds_q20/datafusion:vortex-compact 20311848 / 19994760 / +1.6% 42006508 / 40469464 / +3.8% 0.48 / 0.49 / -2.1%
tpcds_q21/datafusion:vortex-compact 17437984 / 17262348 / +1.0% 43470776 / 39857520 / +9.1% 0.40 / 0.43 / -7.4%
tpcds_q22/datafusion:vortex-compact 50188702 / 49952238 / +0.5% 73885429 / 72181764 / +2.4% 0.68 / 0.69 / -1.8%
tpcds_q23/datafusion:vortex-compact 73141082 / 71130692 / +2.8% 96318435 / 96209831 / +0.1% 0.76 / 0.74 / +2.7%
tpcds_q24/datafusion:vortex-compact 71782787 / 71083676 / +1.0% 93429375 / 93614194 / -0.2% 0.77 / 0.76 / +1.2%
tpcds_q25/datafusion:vortex-compact 52587082 / 51663785 / +1.8% 70403791 / 67327183 / +4.6% 0.75 / 0.77 / -2.7%
tpcds_q26/datafusion:vortex-compact 27947996 / 28019202 / -0.3% 47122896 / 47379954 / -0.5% 0.59 / 0.59 / +0.3%
tpcds_q27/datafusion:vortex-compact 61150764 / 57131045 / +7.0% 82253340 / 80144469 / +2.6% 0.74 / 0.71 / +4.3%
tpcds_q28/datafusion:vortex-compact 28581951 / 29717076 / -3.8% 44943864 / 46855174 / -4.1% 0.64 / 0.63 / +0.3%
tpcds_q29/datafusion:vortex-compact 52560652 / 56647284 / -7.2% 77201279 / 81465230 / -5.2% 0.68 / 0.70 / -2.1%
tpcds_q30/datafusion:vortex-compact 27907537 / 28215654 / -1.1% 45834429 / 46516021 / -1.5% 0.61 / 0.61 / +0.4%
tpcds_q31/datafusion:vortex-compact 61040996 / 60377428 / +1.1% 86725053 / 87243329 / -0.6% 0.70 / 0.69 / +1.7%
tpcds_q32/datafusion:vortex-compact 13495188 / 13557792 / -0.5% 32300346 / 32437117 / -0.4% 0.42 / 0.42 / -0.0%
tpcds_q33/datafusion:vortex-compact 28556907 / 28487620 / +0.2% 51447999 / 52408196 / -1.8% 0.56 / 0.54 / +2.1%
tpcds_q34/datafusion:vortex-compact 19055254 / 18943177 / +0.6% 37741084 / 36486059 / +3.4% 0.50 / 0.52 / -2.8%
tpcds_q35/datafusion:vortex-compact 33430022 / 33341138 / +0.3% 56287587 / 55652244 / +1.1% 0.59 / 0.60 / -0.9%
tpcds_q36/datafusion:vortex-compact 48662972 / 49103586 / -0.9% 74129030 / 72733419 / +1.9% 0.66 / 0.68 / -2.8%
tpcds_q37/datafusion:vortex-compact 14989872 / 14083669 / +6.4% 37542732 / 36166405 / +3.8% 0.40 / 0.39 / +2.5%
tpcds_q38/datafusion:vortex-compact 26125290 / 26293017 / -0.6% 47009767 / 47316183 / -0.6% 0.56 / 0.56 / +0.0%
tpcds_q39/datafusion:vortex-compact 64906060 / 65131443 / -0.3% 89002607 / 88829733 / +0.2% 0.73 / 0.73 / -0.5%
tpcds_q40/datafusion:vortex-compact 24085961 / 24154714 / -0.3% 45371329 / 46966705 / -3.4% 0.53 / 0.51 / +3.2%
tpcds_q41/datafusion:vortex-compact 20670806 / 21098098 / -2.0% 35655188 / 34590957 / +3.1% 0.58 / 0.61 / -4.9%
tpcds_q42/datafusion:vortex-compact 11173404 / 11188974 / -0.1% 30445699 / 28754606 / +5.9% 0.37 / 0.39 / -5.7%
tpcds_q43/datafusion:vortex-compact 13248556 / 12962272 / +2.2% 30490620 / 31826898 / -4.2% 0.43 / 0.41 / +6.7%
tpcds_q44/datafusion:vortex-compact 29521174 / 29471229 / +0.2% 50343867 / 51739951 / -2.7% 0.59 / 0.57 / +2.9%
tpcds_q45/datafusion:vortex-compact 17959991 / 17571444 / +2.2% 36490825 / 35375728 / +3.2% 0.49 / 0.50 / -0.9%
tpcds_q46/datafusion:vortex-compact 25040906 / 25451322 / -1.6% 48069198 / 46477638 / +3.4% 0.52 / 0.55 / -4.9%
tpcds_q47/datafusion:vortex-compact 78801517 / 78823424 / -0.0% 109973322 / 111453705 / -1.3% 0.72 / 0.71 / +1.3%
tpcds_q48/datafusion:vortex-compact 43302782 / 43576328 / -0.6% 62934699 / 62178013 / +1.2% 0.69 / 0.70 / -1.8%
tpcds_q49/datafusion:vortex-compact 58060077 / 58421963 / -0.6% 80595359 / 80237952 / +0.4% 0.72 / 0.73 / -1.1%
tpcds_q50/datafusion:vortex-compact 30948056 / 31297028 / -1.1% 51539097 / 54808123 / -6.0% 0.60 / 0.57 / +5.2%
tpcds_q51/datafusion:vortex-compact 66213204 / 66115671 / +0.1% 87593754 / 87127692 / +0.5% 0.76 / 0.76 / -0.4%
tpcds_q52/datafusion:vortex-compact 11358808 / 11293454 / +0.6% 31318315 / 31761956 / -1.4% 0.36 / 0.36 / +2.0%
tpcds_q53/datafusion:vortex-compact 20640920 / 20589704 / +0.2% 43608769 / 41554513 / +4.9% 0.47 / 0.50 / -4.5%
tpcds_q54/datafusion:vortex-compact 33756823 / 33807732 / -0.2% 58177510 / 59516756 / -2.3% 0.58 / 0.57 / +2.1%
tpcds_q55/datafusion:vortex-compact 11037140 / 11242714 / -1.8% 29646956 / 29388327 / +0.9% 0.37 / 0.38 / -2.7%
tpcds_q56/datafusion:vortex-compact 26186231 / 26338978 / -0.6% 49183087 / 47962878 / +2.5% 0.53 / 0.55 / -3.0%
tpcds_q57/datafusion:vortex-compact 66044899 / 65642928 / +0.6% 93152840 / 92976142 / +0.2% 0.71 / 0.71 / +0.4%
tpcds_q58/datafusion:vortex-compact 42027688 / 41612349 / +1.0% 67927215 / 67111218 / +1.2% 0.62 / 0.62 / -0.2%
tpcds_q59/datafusion:vortex-compact 31447730 / 32041320 / -1.9% 54007336 / 55476776 / -2.6% 0.58 / 0.58 / +0.8%
tpcds_q60/datafusion:vortex-compact 25931400 / 25987588 / -0.2% 49083193 / 48735099 / +0.7% 0.53 / 0.53 / -0.9%
tpcds_q61/datafusion:vortex-compact 22824144 / 23023150 / -0.9% 42873048 / 42211931 / +1.6% 0.53 / 0.55 / -2.4%
tpcds_q62/datafusion:vortex-compact 16702688 / 16330189 / +2.3% 34168331 / 34149090 / +0.1% 0.49 / 0.48 / +2.2%
tpcds_q63/datafusion:vortex-compact 20707866 / 20372106 / +1.6% 42338505 / 42213499 / +0.3% 0.49 / 0.48 / +1.3%
tpcds_q64/datafusion:vortex-compact 301408885 / 301045187 / +0.1% 335663241 / 339474394 / -1.1% 0.90 / 0.89 / +1.3%
tpcds_q65/datafusion:vortex-compact 75764527 / 76247412 / -0.6% 98572457 / 100053627 / -1.5% 0.77 / 0.76 / +0.9%
tpcds_q66/datafusion:vortex-compact 50674268 / 50705708 / -0.1% 72919908 / 72896474 / +0.0% 0.69 / 0.70 / -0.1%
tpcds_q67/datafusion:vortex-compact 51963742 / 52576666 / -1.2% 84541036 / 82299418 / +2.7% 0.61 / 0.64 / -3.8%
tpcds_q68/datafusion:vortex-compact 25017992 / 25729102 / -2.8% 48199872 / 49358619 / -2.3% 0.52 / 0.52 / -0.4%
tpcds_q69/datafusion:vortex-compact 28952042 / 29148155 / -0.7% 51027870 / 49690915 / +2.7% 0.57 / 0.59 / -3.3%
tpcds_q70/datafusion:vortex-compact 71746839 / 72476332 / -1.0% 94046940 / 93888480 / +0.2% 0.76 / 0.77 / -1.2%
tpcds_q71/datafusion:vortex-compact 19097712 / 18743639 / +1.9% 40323176 / 38759062 / +4.0% 0.47 / 0.48 / -2.1%
tpcds_q72/datafusion:vortex-compact 350824844 / 365083598 / -3.9% 454830398 / 416656052 / +9.2% 0.77 / 0.88 / -12.0%
tpcds_q73/datafusion:vortex-compact 18129445 / 17820040 / +1.7% 37702621 / 34980535 / +7.8% 0.48 / 0.51 / -5.6%
tpcds_q74/datafusion:vortex-compact 42288454 / 42803113 / -1.2% 67671011 / 67464503 / +0.3% 0.62 / 0.63 / -1.5%
tpcds_q75/datafusion:vortex-compact 138428270 / 141232980 / -2.0% 163552411 / 163122115 / +0.3% 0.85 / 0.87 / -2.2%
tpcds_q76/datafusion:vortex-compact 30415635 / 30095230 / +1.1% 48585122 / 48743183 / -0.3% 0.63 / 0.62 / +1.4%
tpcds_q77/datafusion:vortex-compact 45088797 / 46222802 / -2.5% 66121901 / 66361908 / -0.4% 0.68 / 0.70 / -2.1%
tpcds_q78/datafusion:vortex-compact 65639946 / 65718596 / -0.1% 92073757 / 90646224 / +1.6% 0.71 / 0.73 / -1.7%
tpcds_q79/datafusion:vortex-compact 21556986 / 21485135 / +0.3% 42402474 / 43693034 / -3.0% 0.51 / 0.49 / +3.4%
tpcds_q80/datafusion:vortex-compact 74100938 / 74646796 / -0.7% 104787568 / 101913019 / +2.8% 0.71 / 0.73 / -3.5%
tpcds_q81/datafusion:vortex-compact 26895302 / 27112440 / -0.8% 43469848 / 45014243 / -3.4% 0.62 / 0.60 / +2.7%
tpcds_q82/datafusion:vortex-compact 14700715 / 13322002 / +10.3% 🔴 34795435 / 35940901 / -3.2% 0.42 / 0.37 / +14.0%
tpcds_q83/datafusion:vortex-compact 33900542 / 33684518 / +0.6% 52282893 / 52352218 / -0.1% 0.65 / 0.64 / +0.8%
tpcds_q84/datafusion:vortex-compact 11271852 / 11058663 / +1.9% 25301075 / 26290705 / -3.8% 0.45 / 0.42 / +5.9%
tpcds_q85/datafusion:vortex-compact 95070003 / 95297857 / -0.2% 121159590 / 119817690 / +1.1% 0.78 / 0.80 / -1.3%
tpcds_q86/datafusion:vortex-compact 15928454 / 15566468 / +2.3% 33770001 / 34070678 / -0.9% 0.47 / 0.46 / +3.2%
tpcds_q87/datafusion:vortex-compact 27153800 / 26684909 / +1.8% 49054725 / 49704461 / -1.3% 0.55 / 0.54 / +3.1%
tpcds_q88/datafusion:vortex-compact 36420340 / 36404458 / +0.0% 59362647 / 57712211 / +2.9% 0.61 / 0.63 / -2.7%
tpcds_q89/datafusion:vortex-compact 22975155 / 22790094 / +0.8% 44898278 / 44887548 / +0.0% 0.51 / 0.51 / +0.8%
tpcds_q90/datafusion:vortex-compact 10576494 / 10383888 / +1.9% 25490988 / 25142570 / +1.4% 0.41 / 0.41 / +0.5%
tpcds_q91/datafusion:vortex-compact 24562990 / 24550302 / +0.1% 44604820 / 44351923 / +0.6% 0.55 / 0.55 / -0.5%
tpcds_q92/datafusion:vortex-compact 14078353 / 14195554 / -0.8% 29702451 / 31026369 / -4.3% 0.47 / 0.46 / +3.6%
tpcds_q93/datafusion:vortex-compact 20384013 / 20807580 / -2.0% 41055646 / 41498834 / -1.1% 0.50 / 0.50 / -1.0%
tpcds_q94/datafusion:vortex-compact 19506778 / 19589616 / -0.4% 38498641 / 37999003 / +1.3% 0.51 / 0.52 / -1.7%
tpcds_q95/datafusion:vortex-compact 43231349 / 43127440 / +0.2% 62363600 / 62089254 / +0.4% 0.69 / 0.69 / -0.2%
tpcds_q96/datafusion:vortex-compact 8453410 / 8699992 / -2.8% 25219343 / 26398955 / -4.5% 0.34 / 0.33 / +1.7%
tpcds_q97/datafusion:vortex-compact 17453476 / 17041594 / +2.4% 36594066 / 37575799 / -2.6% 0.48 / 0.45 / +5.2%
tpcds_q98/datafusion:vortex-compact 20492908 / 20737587 / -1.2% 42669637 / 40031203 / +6.6% 0.48 / 0.52 / -7.3%
tpcds_q99/datafusion:vortex-compact 16432300 / 16498274 / -0.4% 35212814 / 36147019 / -2.6% 0.47 / 0.46 / +2.2%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42582980 / 42790168 / -0.5% 60116756 / 57645148 / +4.3% 0.71 / 0.74 / -4.6%
tpcds_q02/datafusion:parquet 55062420 / 54765044 / +0.5% 71611663 / 70421354 / +1.7% 0.77 / 0.78 / -1.1%
tpcds_q03/datafusion:parquet 18991816 / 19097265 / -0.6% 30231977 / 30445091 / -0.7% 0.63 / 0.63 / +0.1%
tpcds_q04/datafusion:parquet 178861749 / 178887614 / -0.0% 203672055 / 202039145 / +0.8% 0.88 / 0.89 / -0.8%
tpcds_q05/datafusion:parquet 68048741 / 67878001 / +0.3% 88478878 / 89709488 / -1.4% 0.77 / 0.76 / +1.6%
tpcds_q06/datafusion:parquet 34211190 / 33778804 / +1.3% 44954688 / 45692699 / -1.6% 0.76 / 0.74 / +2.9%
tpcds_q07/datafusion:parquet 46602794 / 47393786 / -1.7% 66667147 / 65545052 / +1.7% 0.70 / 0.72 / -3.3%
tpcds_q08/datafusion:parquet 30934046 / 30786170 / +0.5% 49505328 / 43159155 / +14.7% 🔴 0.62 / 0.71 / -12.4%
tpcds_q09/datafusion:parquet 33221484 / 30591208 / +8.6% 45229175 / 42974319 / +5.2% 0.73 / 0.71 / +3.2%
tpcds_q10/datafusion:parquet 43974130 / 43909954 / +0.1% 59179549 / 58393927 / +1.3% 0.74 / 0.75 / -1.2%
tpcds_q11/datafusion:parquet 97829568 / 97359220 / +0.5% 120033338 / 119001225 / +0.9% 0.82 / 0.82 / -0.4%
tpcds_q12/datafusion:parquet 24034169 / 23515044 / +2.2% 35166931 / 34010680 / +3.4% 0.68 / 0.69 / -1.2%
tpcds_q13/datafusion:parquet 46720104 / 46313484 / +0.9% 68436950 / 68018563 / +0.6% 0.68 / 0.68 / +0.3%
tpcds_q14/datafusion:parquet 536618231 / 534683184 / +0.4% 577421708 / 582375794 / -0.9% 0.93 / 0.92 / +1.2%
tpcds_q15/datafusion:parquet 23879275 / 24175697 / -1.2% 38780321 / 36583322 / +6.0% 0.62 / 0.66 / -6.8%
tpcds_q16/datafusion:parquet 36929739 / 37052644 / -0.3% 51272723 / 49572893 / +3.4% 0.72 / 0.75 / -3.6%
tpcds_q17/datafusion:parquet 73789805 / 75207760 / -1.9% 98579295 / 98319183 / +0.3% 0.75 / 0.76 / -2.1%
tpcds_q18/datafusion:parquet 70204264 / 67278429 / +4.3% 88858450 / 89472378 / -0.7% 0.79 / 0.75 / +5.1%
tpcds_q19/datafusion:parquet 29399543 / 29426323 / -0.1% 44221300 / 42286597 / +4.6% 0.66 / 0.70 / -4.5%
tpcds_q20/datafusion:parquet 25260661 / 24728196 / +2.2% 37504168 / 35453048 / +5.8% 0.67 / 0.70 / -3.4%
tpcds_q21/datafusion:parquet 20464110 / 19988597 / +2.4% 32244300 / 33163707 / -2.8% 0.63 / 0.60 / +5.3%
tpcds_q22/datafusion:parquet 76891391 / 77207674 / -0.4% 88349839 / 87517272 / +1.0% 0.87 / 0.88 / -1.3%
tpcds_q23/datafusion:parquet 90879340 / 91103138 / -0.2% 118471406 / 115810894 / +2.3% 0.77 / 0.79 / -2.5%
tpcds_q24/datafusion:parquet 89915358 / 90312194 / -0.4% 116639996 / 114753768 / +1.6% 0.77 / 0.79 / -2.0%
tpcds_q25/datafusion:parquet 79754132 / 82183728 / -3.0% 107240210 / 101090115 / +6.1% 0.74 / 0.81 / -8.5%
tpcds_q26/datafusion:parquet 43523196 / 43975604 / -1.0% 59127214 / 60140227 / -1.7% 0.74 / 0.73 / +0.7%
tpcds_q27/datafusion:parquet 75189424 / 75256415 / -0.1% 98809476 / 96796596 / +2.1% 0.76 / 0.78 / -2.1%
tpcds_q28/datafusion:parquet 28051381 / 28282492 / -0.8% 42670980 / 40540051 / +5.3% 0.66 / 0.70 / -5.8%
tpcds_q29/datafusion:parquet 75692440 / 76327373 / -0.8% 99262220 / 95497789 / +3.9% 0.76 / 0.80 / -4.6%
tpcds_q30/datafusion:parquet 43050002 / 44172996 / -2.5% 57691535 / 56428909 / +2.2% 0.75 / 0.78 / -4.7%
tpcds_q31/datafusion:parquet 81056902 / 81059734 / -0.0% 99268565 / 97847034 / +1.5% 0.82 / 0.83 / -1.4%
tpcds_q32/datafusion:parquet 26509077 / 26106716 / +1.5% 38342456 / 38996408 / -1.7% 0.69 / 0.67 / +3.3%
tpcds_q33/datafusion:parquet 37715672 / 36632188 / +3.0% 53632791 / 51696853 / +3.7% 0.70 / 0.71 / -0.8%
tpcds_q34/datafusion:parquet 24293179 / 24283762 / +0.0% 36088048 / 35496823 / +1.7% 0.67 / 0.68 / -1.6%
tpcds_q35/datafusion:parquet 51425676 / 51092331 / +0.7% 66882890 / 63128294 / +5.9% 0.77 / 0.81 / -5.0%
tpcds_q36/datafusion:parquet 53483148 / 52133216 / +2.6% 70284725 / 73276361 / -4.1% 0.76 / 0.71 / +7.0%
tpcds_q37/datafusion:parquet 21183340 / 21186441 / -0.0% 33372650 / 32501720 / +2.7% 0.63 / 0.65 / -2.6%
tpcds_q38/datafusion:parquet 44772238 / 44473320 / +0.7% 63437730 / 60661224 / +4.6% 0.71 / 0.73 / -3.7%
tpcds_q39/datafusion:parquet 68334205 / 67893870 / +0.6% 85468561 / 85512997 / -0.1% 0.80 / 0.79 / +0.7%
tpcds_q40/datafusion:parquet 28669972 / 30116612 / -4.8% 48940901 / 50944751 / -3.9% 0.59 / 0.59 / -0.9%
tpcds_q41/datafusion:parquet 19820807 / 19875884 / -0.3% 31679463 / 30988887 / +2.2% 0.63 / 0.64 / -2.5%
tpcds_q42/datafusion:parquet 17975302 / 18263912 / -1.6% 31305878 / 31580411 / -0.9% 0.57 / 0.58 / -0.7%
tpcds_q43/datafusion:parquet 19494966 / 19328598 / +0.9% 32072523 / 32363765 / -0.9% 0.61 / 0.60 / +1.8%
tpcds_q44/datafusion:parquet 37083231 / 34729506 / +6.8% 52081246 / 49650609 / +4.9% 0.71 / 0.70 / +1.8%
tpcds_q45/datafusion:parquet 27786162 / 27674712 / +0.4% 41050937 / 40581829 / +1.2% 0.68 / 0.68 / -0.7%
tpcds_q46/datafusion:parquet 28901864 / 28849347 / +0.2% 46046420 / 44446206 / +3.6% 0.63 / 0.65 / -3.3%
tpcds_q47/datafusion:parquet 97262479 / 97767068 / -0.5% 117976923 / 116071791 / +1.6% 0.82 / 0.84 / -2.1%
tpcds_q48/datafusion:parquet 41548196 / 42223134 / -1.6% 59593019 / 58362840 / +2.1% 0.70 / 0.72 / -3.6%
tpcds_q49/datafusion:parquet 71637868 / 71584984 / +0.1% 93018846 / 93559482 / -0.6% 0.77 / 0.77 / +0.7%
tpcds_q50/datafusion:parquet 47459441 / 47188732 / +0.6% 66439629 / 65957634 / +0.7% 0.71 / 0.72 / -0.2%
tpcds_q51/datafusion:parquet 75072775 / 75687516 / -0.8% 93922697 / 93987537 / -0.1% 0.80 / 0.81 / -0.7%
tpcds_q52/datafusion:parquet 18356710 / 18477546 / -0.7% 31317561 / 30516528 / +2.6% 0.59 / 0.61 / -3.2%
tpcds_q53/datafusion:parquet 22950250 / 22069787 / +4.0% 37971909 / 37394397 / +1.5% 0.60 / 0.59 / +2.4%
tpcds_q54/datafusion:parquet 53706940 / 53068499 / +1.2% 67756219 / 66798825 / +1.4% 0.79 / 0.79 / -0.2%
tpcds_q55/datafusion:parquet 18023308 / 18177591 / -0.8% 30263500 / 29615062 / +2.2% 0.60 / 0.61 / -3.0%
tpcds_q56/datafusion:parquet 41600278 / 40536538 / +2.6% 56108237 / 51702806 / +8.5% 0.74 / 0.78 / -5.4%
tpcds_q57/datafusion:parquet 100751238 / 100992704 / -0.2% 117797918 / 119321534 / -1.3% 0.86 / 0.85 / +1.1%
tpcds_q58/datafusion:parquet 64843212 / 65003510 / -0.2% 81647691 / 81993727 / -0.4% 0.79 / 0.79 / +0.2%
tpcds_q59/datafusion:parquet 48182788 / 47142071 / +2.2% 65975120 / 64332209 / +2.6% 0.73 / 0.73 / -0.3%
tpcds_q60/datafusion:parquet 41476602 / 41143805 / +0.8% 52481034 / 56528494 / -7.2% 0.79 / 0.73 / +8.6%
tpcds_q61/datafusion:parquet 36396972 / 37070528 / -1.8% 50529486 / 50658408 / -0.3% 0.72 / 0.73 / -1.6%
tpcds_q62/datafusion:parquet 24977295 / 25299585 / -1.3% 37457545 / 37400865 / +0.2% 0.67 / 0.68 / -1.4%
tpcds_q63/datafusion:parquet 22256096 / 22137338 / +0.5% 37888490 / 37267059 / +1.7% 0.59 / 0.59 / -1.1%
tpcds_q64/datafusion:parquet 285894014 / 283491307 / +0.8% 323708543 / 324365594 / -0.2% 0.88 / 0.87 / +1.1%
tpcds_q65/datafusion:parquet 123499456 / 121796900 / +1.4% 143938590 / 140340790 / +2.6% 0.86 / 0.87 / -1.1%
tpcds_q66/datafusion:parquet 59400430 / 60159790 / -1.3% 78527983 / 74271493 / +5.7% 0.76 / 0.81 / -6.6%
tpcds_q67/datafusion:parquet 68625181 / 69200688 / -0.8% 92210935 / 92158955 / +0.1% 0.74 / 0.75 / -0.9%
tpcds_q68/datafusion:parquet 28769105 / 28638674 / +0.5% 47976997 / 47694525 / +0.6% 0.60 / 0.60 / -0.1%
tpcds_q69/datafusion:parquet 45215876 / 43345552 / +4.3% 58800845 / 54686235 / +7.5% 0.77 / 0.79 / -3.0%
tpcds_q70/datafusion:parquet 80118864 / 80271896 / -0.2% 97940198 / 100088952 / -2.1% 0.82 / 0.80 / +2.0%
tpcds_q71/datafusion:parquet 25785720 / 24373552 / +5.8% 38188687 / 38366867 / -0.5% 0.68 / 0.64 / +6.3%
tpcds_q72/datafusion:parquet 525393962 / 527329837 / -0.4% 545115112 / 560736807 / -2.8% 0.96 / 0.94 / +2.5%
tpcds_q73/datafusion:parquet 23626082 / 23675195 / -0.2% 35216610 / 35651529 / -1.2% 0.67 / 0.66 / +1.0%
tpcds_q74/datafusion:parquet 68915356 / 69750544 / -1.2% 89902077 / 88419484 / +1.7% 0.77 / 0.79 / -2.8%
tpcds_q75/datafusion:parquet 151655797 / 154280426 / -1.7% 179353653 / 175992735 / +1.9% 0.85 / 0.88 / -3.5%
tpcds_q76/datafusion:parquet 33448326 / 32552642 / +2.8% 46258394 / 46197310 / +0.1% 0.72 / 0.70 / +2.6%
tpcds_q77/datafusion:parquet 57323135 / 55912258 / +2.5% 74423742 / 75401961 / -1.3% 0.77 / 0.74 / +3.9%
tpcds_q78/datafusion:parquet 86090774 / 86298158 / -0.2% 118595340 / 119573989 / -0.8% 0.73 / 0.72 / +0.6%
tpcds_q79/datafusion:parquet 26563706 / 26941018 / -1.4% 41251719 / 41670899 / -1.0% 0.64 / 0.65 / -0.4%
tpcds_q80/datafusion:parquet 81380173 / 79571648 / +2.3% 109730914 / 107798298 / +1.8% 0.74 / 0.74 / +0.5%
tpcds_q81/datafusion:parquet 38417799 / 37708022 / +1.9% 48886707 / 49644780 / -1.5% 0.79 / 0.76 / +3.5%
tpcds_q82/datafusion:parquet 22215880 / 22862742 / -2.8% 34843850 / 35659042 / -2.3% 0.64 / 0.64 / -0.6%
tpcds_q83/datafusion:parquet 58912838 / 58728850 / +0.3% 70075819 / 73572759 / -4.8% 0.84 / 0.80 / +5.3%
tpcds_q84/datafusion:parquet 25955748 / 27588446 / -5.9% 41446081 / 37424130 / +10.7% 🔴 0.63 / 0.74 / -15.0%
tpcds_q85/datafusion:parquet 80207081 / 80037900 / +0.2% 102283262 / 103303133 / -1.0% 0.78 / 0.77 / +1.2%
tpcds_q86/datafusion:parquet 20889356 / 20803682 / +0.4% 32336448 / 32694603 / -1.1% 0.65 / 0.64 / +1.5%
tpcds_q87/datafusion:parquet 45245738 / 44953774 / +0.6% 61046281 / 58673543 / +4.0% 0.74 / 0.77 / -3.3%
tpcds_q88/datafusion:parquet 36711601 / 37194222 / -1.3% 49794825 / 51481242 / -3.3% 0.74 / 0.72 / +2.0%
tpcds_q89/datafusion:parquet 25766802 / 25767740 / -0.0% 41366447 / 40885679 / +1.2% 0.62 / 0.63 / -1.2%
tpcds_q90/datafusion:parquet 15742283 / 15051543 / +4.6% 25506692 / 27168268 / -6.1% 0.62 / 0.55 / +11.4%
tpcds_q91/datafusion:parquet 32384858 / 32426770 / -0.1% 45584326 / 45756299 / -0.4% 0.71 / 0.71 / +0.2%
tpcds_q92/datafusion:parquet 26992990 / 26788312 / +0.8% 39266948 / 39570067 / -0.8% 0.69 / 0.68 / +1.5%
tpcds_q93/datafusion:parquet 27399991 / 26826836 / +2.1% 46327370 / 45720426 / +1.3% 0.59 / 0.59 / +0.8%
tpcds_q94/datafusion:parquet 35372096 / 35612212 / -0.7% 48423323 / 47235641 / +2.5% 0.73 / 0.75 / -3.1%
tpcds_q95/datafusion:parquet 64747859 / 64407442 / +0.5% 79073267 / 79417285 / -0.4% 0.82 / 0.81 / +1.0%
tpcds_q96/datafusion:parquet 12762140 / 13109518 / -2.6% 23664536 / 25052704 / -5.5% 0.54 / 0.52 / +3.1%
tpcds_q97/datafusion:parquet 35312094 / 35212817 / +0.3% 51115613 / 51110766 / +0.0% 0.69 / 0.69 / +0.3%
tpcds_q98/datafusion:parquet 24431699 / 24928664 / -2.0% 37237418 / 36311664 / +2.5% 0.66 / 0.69 / -4.4%
tpcds_q99/datafusion:parquet 29671668 / 29956348 / -1.0% 41617745 / 41613620 / +0.0% 0.71 / 0.72 / -1.0%
duckdb / vortex-file-compressed / ns (0.998x ➖, 12↑ 11↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15973390 / 16142117 / -1.0% 24893033 / 24883739 / +0.0% 0.64 / 0.65 / -1.1%
tpcds_q02/duckdb:vortex-file-compressed 15927004 / 16709276 / -4.7% 22479544 / 22051108 / +1.9% 0.71 / 0.76 / -6.5%
tpcds_q03/duckdb:vortex-file-compressed 7054182 / 7045657 / +0.1% 16451858 / 16301596 / +0.9% 0.43 / 0.43 / -0.8%
tpcds_q04/duckdb:vortex-file-compressed 59600230 / 45758252 / +30.3% 🔴 70012338 / 56479163 / +24.0% 🔴 0.85 / 0.81 / +5.1%
tpcds_q05/duckdb:vortex-file-compressed 23039217 / 23036528 / +0.0% 32472118 / 32578849 / -0.3% 0.71 / 0.71 / +0.3%
tpcds_q06/duckdb:vortex-file-compressed 24281651 / 24423028 / -0.6% 39026499 / 38193338 / +2.2% 0.62 / 0.64 / -2.7%
tpcds_q07/duckdb:vortex-file-compressed 22541526 / 13353038 / +68.8% 🔴 33880633 / 24712568 / +37.1% 🔴 0.67 / 0.54 / +23.1%
tpcds_q08/duckdb:vortex-file-compressed 17156801 / 17520489 / -2.1% 25395016 / 25721441 / -1.3% 0.68 / 0.68 / -0.8%
tpcds_q09/duckdb:vortex-file-compressed 19236389 / 19111982 / +0.7% 30105845 / 29348465 / +2.6% 0.64 / 0.65 / -1.9%
tpcds_q10/duckdb:vortex-file-compressed 27440184 / 27612226 / -0.6% 40186062 / 40320225 / -0.3% 0.68 / 0.68 / -0.3%
tpcds_q11/duckdb:vortex-file-compressed 36297971 / 36903964 / -1.6% 45979827 / 46177346 / -0.4% 0.79 / 0.80 / -1.2%
tpcds_q12/duckdb:vortex-file-compressed 9704476 / 10200694 / -4.9% 16840770 / 17187152 / -2.0% 0.58 / 0.59 / -2.9%
tpcds_q13/duckdb:vortex-file-compressed 21299121 / 21263297 / +0.2% 31847393 / 32547269 / -2.2% 0.67 / 0.65 / +2.4%
tpcds_q14/duckdb:vortex-file-compressed 54782508 / 57809828 / -5.2% 67170486 / 68046783 / -1.3% 0.82 / 0.85 / -4.0%
tpcds_q15/duckdb:vortex-file-compressed 11238595 / 11119113 / +1.1% 18788251 / 18816176 / -0.1% 0.60 / 0.59 / +1.2%
tpcds_q16/duckdb:vortex-file-compressed 24771216 / 24266849 / +2.1% 34950494 / 34786209 / +0.5% 0.71 / 0.70 / +1.6%
tpcds_q17/duckdb:vortex-file-compressed 20726859 / 24227736 / -14.4% 🟢 32595553 / 36525117 / -10.8% 🟢 0.64 / 0.66 / -4.1%
tpcds_q18/duckdb:vortex-file-compressed 32841612 / 31509080 / +4.2% 43340714 / 41766543 / +3.8% 0.76 / 0.75 / +0.4%
tpcds_q19/duckdb:vortex-file-compressed 20841052 / 77960863 / -73.3% 🟢 29310725 / 89377861 / -67.2% 🟢 0.71 / 0.87 / -18.5%
tpcds_q20/duckdb:vortex-file-compressed 10715850 / 10971804 / -2.3% 18041384 / 17747764 / +1.7% 0.59 / 0.62 / -3.9%
tpcds_q21/duckdb:vortex-file-compressed 9143636 / 9745305 / -6.2% 21456886 / 20923879 / +2.5% 0.43 / 0.47 / -8.5%
tpcds_q22/duckdb:vortex-file-compressed 17509228 / 17585292 / -0.4% 29918931 / 29572488 / +1.2% 0.59 / 0.59 / -1.6%
tpcds_q23/duckdb:vortex-file-compressed 38368962 / 38130006 / +0.6% 50675726 / 49924896 / +1.5% 0.76 / 0.76 / -0.9%
tpcds_q24/duckdb:vortex-file-compressed 26167800 / 26574018 / -1.5% 36018160 / 36642246 / -1.7% 0.73 / 0.73 / +0.2%
tpcds_q25/duckdb:vortex-file-compressed 19727622 / 23695962 / -16.7% 🟢 31977725 / 36381968 / -12.1% 🟢 0.62 / 0.65 / -5.3%
tpcds_q26/duckdb:vortex-file-compressed 21724824 / 13100696 / +65.8% 🔴 31984927 / 21291607 / +50.2% 🔴 0.68 / 0.62 / +10.4%
tpcds_q27/duckdb:vortex-file-compressed 24947740 / 15963922 / +56.3% 🔴 36835239 / 27540444 / +33.7% 🔴 0.68 / 0.58 / +16.8%
tpcds_q28/duckdb:vortex-file-compressed 15463468 / 15588588 / -0.8% 25338398 / 26167172 / -3.2% 0.61 / 0.60 / +2.4%
tpcds_q29/duckdb:vortex-file-compressed 19275032 / 22710729 / -15.1% 🟢 31170104 / 34899355 / -10.7% 🟢 0.62 / 0.65 / -5.0%
tpcds_q30/duckdb:vortex-file-compressed 18391694 / 15872199 / +15.9% 🔴 26276531 / 24336692 / +8.0% 0.70 / 0.65 / +7.3%
tpcds_q31/duckdb:vortex-file-compressed 17928676 / 18069675 / -0.8% 26238962 / 26891648 / -2.4% 0.68 / 0.67 / +1.7%
tpcds_q32/duckdb:vortex-file-compressed 10298856 / 11623212 / -11.4% 🟢 18232607 / 20950684 / -13.0% 🟢 0.56 / 0.55 / +1.8%
tpcds_q33/duckdb:vortex-file-compressed 18214998 / 18357493 / -0.8% 29240137 / 28185569 / +3.7% 0.62 / 0.65 / -4.4%
tpcds_q34/duckdb:vortex-file-compressed 13241968 / 13014242 / +1.7% 22390049 / 23047270 / -2.9% 0.59 / 0.56 / +4.7%
tpcds_q35/duckdb:vortex-file-compressed 31235042 / 27929879 / +11.8% 🔴 44383528 / 39014716 / +13.8% 🔴 0.70 / 0.72 / -1.7%
tpcds_q36/duckdb:vortex-file-compressed 14202951 / 13908706 / +2.1% 24955798 / 23970044 / +4.1% 0.57 / 0.58 / -1.9%
tpcds_q37/duckdb:vortex-file-compressed 9394427 / 9515167 / -1.3% 24349474 / 24340830 / +0.0% 0.39 / 0.39 / -1.3%
tpcds_q38/duckdb:vortex-file-compressed 24412472 / 24300837 / +0.5% 31651127 / 32361884 / -2.2% 0.77 / 0.75 / +2.7%
tpcds_q39/duckdb:vortex-file-compressed 18867192 / 18334157 / +2.9% 32937427 / 33896858 / -2.8% 0.57 / 0.54 / +5.9%
tpcds_q40/duckdb:vortex-file-compressed 11238298 / 14107318 / -20.3% 🟢 19666855 / 20388858 / -3.5% 0.57 / 0.69 / -17.4%
tpcds_q41/duckdb:vortex-file-compressed 18828210 / 18789802 / +0.2% 25559731 / 25592058 / -0.1% 0.74 / 0.73 / +0.3%
tpcds_q42/duckdb:vortex-file-compressed 6997928 / 7115361 / -1.7% 15602558 / 16445425 / -5.1% 0.45 / 0.43 / +3.7%
tpcds_q43/duckdb:vortex-file-compressed 9664940 / 9847942 / -1.9% 18610441 / 19094789 / -2.5% 0.52 / 0.52 / +0.7%
tpcds_q44/duckdb:vortex-file-compressed 12520126 / 12546484 / -0.2% 23845144 / 24279354 / -1.8% 0.53 / 0.52 / +1.6%
tpcds_q45/duckdb:vortex-file-compressed 23956520 / 23264362 / +3.0% 30922379 / 31280867 / -1.1% 0.77 / 0.74 / +4.2%
tpcds_q46/duckdb:vortex-file-compressed 31710365 / 19680982 / +61.1% 🔴 43721439 / 27352411 / +59.8% 🔴 0.73 / 0.72 / +0.8%
tpcds_q47/duckdb:vortex-file-compressed 31179890 / 34836730 / -10.5% 🟢 40965896 / 45045037 / -9.1% 0.76 / 0.77 / -1.6%
tpcds_q48/duckdb:vortex-file-compressed 23437096 / 23197005 / +1.0% 36256256 / 36376826 / -0.3% 0.65 / 0.64 / +1.4%
tpcds_q49/duckdb:vortex-file-compressed 18923901 / 18947468 / -0.1% 30561370 / 31460092 / -2.9% 0.62 / 0.60 / +2.8%
tpcds_q50/duckdb:vortex-file-compressed 15280020 / 16868396 / -9.4% 25857533 / 27316563 / -5.3% 0.59 / 0.62 / -4.3%
tpcds_q51/duckdb:vortex-file-compressed 48767014 / 48747450 / +0.0% 77502296 / 76407317 / +1.4% 0.63 / 0.64 / -1.4%
tpcds_q52/duckdb:vortex-file-compressed 7164750 / 7223788 / -0.8% 15858379 / 16544978 / -4.1% 0.45 / 0.44 / +3.5%
tpcds_q53/duckdb:vortex-file-compressed 11515142 / 11580455 / -0.6% 21315067 / 20950001 / +1.7% 0.54 / 0.55 / -2.3%
tpcds_q54/duckdb:vortex-file-compressed 19731894 / 20288914 / -2.7% 30935944 / 30647003 / +0.9% 0.64 / 0.66 / -3.7%
tpcds_q55/duckdb:vortex-file-compressed 6817343 / 6902994 / -1.2% 15576779 / 15931120 / -2.2% 0.44 / 0.43 / +1.0%
tpcds_q56/duckdb:vortex-file-compressed 17819054 / 17960990 / -0.8% 27947425 / 27713372 / +0.8% 0.64 / 0.65 / -1.6%
tpcds_q57/duckdb:vortex-file-compressed 25742048 / 26098614 / -1.4% 33868369 / 34582639 / -2.1% 0.76 / 0.75 / +0.7%
tpcds_q58/duckdb:vortex-file-compressed 20623571 / 20331842 / +1.4% 30361540 / 30877019 / -1.7% 0.68 / 0.66 / +3.2%
tpcds_q59/duckdb:vortex-file-compressed 19696514 / 19688060 / +0.0% 26235205 / 27058532 / -3.0% 0.75 / 0.73 / +3.2%
tpcds_q60/duckdb:vortex-file-compressed 18682769 / 18617518 / +0.4% 29482743 / 29659067 / -0.6% 0.63 / 0.63 / +1.0%
tpcds_q61/duckdb:vortex-file-compressed 19645480 / 25605872 / -23.3% 🟢 30021598 / 34595872 / -13.2% 🟢 0.65 / 0.74 / -11.6%
tpcds_q62/duckdb:vortex-file-compressed 11039936 / 11685066 / -5.5% 17717456 / 18455703 / -4.0% 0.62 / 0.63 / -1.6%
tpcds_q63/duckdb:vortex-file-compressed 10968966 / 10996244 / -0.2% 19843941 / 20737428 / -4.3% 0.55 / 0.53 / +4.2%
tpcds_q64/duckdb:vortex-file-compressed 52833242 / 49381384 / +7.0% 69694954 / 66047661 / +5.5% 0.76 / 0.75 / +1.4%
tpcds_q65/duckdb:vortex-file-compressed 13120144 / 13292210 / -1.3% 23575468 / 23558633 / +0.1% 0.56 / 0.56 / -1.4%
tpcds_q66/duckdb:vortex-file-compressed 31319600 / 29707612 / +5.4% 38363073 / 35612347 / +7.7% 0.82 / 0.83 / -2.1%
tpcds_q67/duckdb:vortex-file-compressed 55180454 / 58292138 / -5.3% 65732023 / 66652555 / -1.4% 0.84 / 0.87 / -4.0%
tpcds_q68/duckdb:vortex-file-compressed 23305930 / 19064728 / +22.2% 🔴 35233957 / 27773620 / +26.9% 🔴 0.66 / 0.69 / -3.6%
tpcds_q69/duckdb:vortex-file-compressed 22946996 / 22826429 / +0.5% 37078205 / 37192445 / -0.3% 0.62 / 0.61 / +0.8%
tpcds_q70/duckdb:vortex-file-compressed 14640946 / 16314066 / -10.3% 🟢 25349211 / 27191282 / -6.8% 0.58 / 0.60 / -3.7%
tpcds_q71/duckdb:vortex-file-compressed 13064614 / 12617499 / +3.5% 23695647 / 23746617 / -0.2% 0.55 / 0.53 / +3.8%
tpcds_q72/duckdb:vortex-file-compressed 43191528 / 51945424 / -16.9% 🟢 56355944 / 62476510 / -9.8% 0.77 / 0.83 / -7.8%
tpcds_q73/duckdb:vortex-file-compressed 11985872 / 11909118 / +0.6% 21082128 / 21101470 / -0.1% 0.57 / 0.56 / +0.7%
tpcds_q74/duckdb:vortex-file-compressed 30986516 / 26041908 / +19.0% 🔴 39978255 / 34022832 / +17.5% 🔴 0.78 / 0.77 / +1.3%
tpcds_q75/duckdb:vortex-file-compressed 36852408 / 28133652 / +31.0% 🔴 50281228 / 38375865 / +31.0% 🔴 0.73 / 0.73 / -0.0%
tpcds_q76/duckdb:vortex-file-compressed 12852024 / 12764356 / +0.7% 21828701 / 22963071 / -4.9% 0.59 / 0.56 / +5.9%
tpcds_q77/duckdb:vortex-file-compressed 20479754 / 21418045 / -4.4% 31868772 / 32708962 / -2.6% 0.64 / 0.65 / -1.9%
tpcds_q78/duckdb:vortex-file-compressed 42964659 / 43337642 / -0.9% 52832024 / 53885227 / -2.0% 0.81 / 0.80 / +1.1%
tpcds_q79/duckdb:vortex-file-compressed 17187312 / 13232534 / +29.9% 🔴 27763709 / 21910779 / +26.7% 🔴 0.62 / 0.60 / +2.5%
tpcds_q80/duckdb:vortex-file-compressed 30119958 / 36847054 / -18.3% 🟢 42990550 / 49501801 / -13.2% 🟢 0.70 / 0.74 / -5.9%
tpcds_q81/duckdb:vortex-file-compressed 21206634 / 21429800 / -1.0% 30282592 / 30095533 / +0.6% 0.70 / 0.71 / -1.7%
tpcds_q82/duckdb:vortex-file-compressed 9484144 / 9708050 / -2.3% 23864337 / 25061879 / -4.8% 0.40 / 0.39 / +2.6%
tpcds_q83/duckdb:vortex-file-compressed 17383280 / 17427131 / -0.3% 24736408 / 24376519 / +1.5% 0.70 / 0.71 / -1.7%
tpcds_q84/duckdb:vortex-file-compressed 15917216 / 15770181 / +0.9% 22760296 / 23129342 / -1.6% 0.70 / 0.68 / +2.6%
tpcds_q85/duckdb:vortex-file-compressed 26230741 / 24403894 / +7.5% 37307284 / 36380296 / +2.5% 0.70 / 0.67 / +4.8%
tpcds_q86/duckdb:vortex-file-compressed 9646829 / 9717139 / -0.7% 16600572 / 15906721 / +4.4% 0.58 / 0.61 / -4.9%
tpcds_q87/duckdb:vortex-file-compressed 25801928 / 26017050 / -0.8% 33873090 / 33396290 / +1.4% 0.76 / 0.78 / -2.2%
tpcds_q88/duckdb:vortex-file-compressed 30391538 / 30324574 / +0.2% 37695698 / 38572757 / -2.3% 0.81 / 0.79 / +2.6%
tpcds_q89/duckdb:vortex-file-compressed 11765048 / 12106472 / -2.8% 20827120 / 20820791 / +0.0% 0.56 / 0.58 / -2.8%
tpcds_q90/duckdb:vortex-file-compressed 8177158 / 7989972 / +2.3% 15047977 / 15308508 / -1.7% 0.54 / 0.52 / +4.1%
tpcds_q91/duckdb:vortex-file-compressed 15271351 / 14428822 / +5.8% 24432239 / 23070665 / +5.9% 0.63 / 0.63 / -0.1%
tpcds_q92/duckdb:vortex-file-compressed 10515932 / 12093567 / -13.0% 🟢 17928707 / 20435129 / -12.3% 🟢 0.59 / 0.59 / -0.9%
tpcds_q93/duckdb:vortex-file-compressed 10539242 / 10489510 / +0.5% 22866234 / 23114016 / -1.1% 0.46 / 0.45 / +1.6%
tpcds_q94/duckdb:vortex-file-compressed 21984082 / 21924813 / +0.3% 31888059 / 32104172 / -0.7% 0.69 / 0.68 / +0.9%
tpcds_q95/duckdb:vortex-file-compressed 60740658 / 62938576 / -3.5% 69023182 / 71963612 / -4.1% 0.88 / 0.87 / +0.6%
tpcds_q96/duckdb:vortex-file-compressed 6727579 / 6838084 / -1.6% 15335580 / 14762606 / +3.9% 0.44 / 0.46 / -5.3%
tpcds_q97/duckdb:vortex-file-compressed 23225835 / 23163218 / +0.3% 31339249 / 31012754 / +1.1% 0.74 / 0.75 / -0.8%
tpcds_q98/duckdb:vortex-file-compressed 11015755 / 11360176 / -3.0% 19165363 / 19475284 / -1.6% 0.57 / 0.58 / -1.5%
tpcds_q99/duckdb:vortex-file-compressed 14494978 / 14668948 / -1.2% 22631406 / 22813440 / -0.8% 0.64 / 0.64 / -0.4%
duckdb / vortex-compact / ns (0.996x ➖, 13↑ 13↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17351070 / 17592460 / -1.4% 26130029 / 25647906 / +1.9% 0.66 / 0.69 / -3.2%
tpcds_q02/duckdb:vortex-compact 20437354 / 18443094 / +10.8% 🔴 23799469 / 23193481 / +2.6% 0.86 / 0.80 / +8.0%
tpcds_q03/duckdb:vortex-compact 8381026 / 8151990 / +2.8% 17386245 / 16990261 / +2.3% 0.48 / 0.48 / +0.5%
tpcds_q04/duckdb:vortex-compact 62859722 / 46907036 / +34.0% 🔴 74513112 / 58244739 / +27.9% 🔴 0.84 / 0.81 / +4.8%
tpcds_q05/duckdb:vortex-compact 25035076 / 25057830 / -0.1% 33711032 / 34474714 / -2.2% 0.74 / 0.73 / +2.2%
tpcds_q06/duckdb:vortex-compact 26164926 / 26268722 / -0.4% 39256512 / 40733963 / -3.6% 0.67 / 0.64 / +3.4%
tpcds_q07/duckdb:vortex-compact 27102980 / 18552592 / +46.1% 🔴 38969829 / 27678728 / +40.8% 🔴 0.70 / 0.67 / +3.8%
tpcds_q08/duckdb:vortex-compact 22445723 / 22483602 / -0.2% 30110504 / 29538404 / +1.9% 0.75 / 0.76 / -2.1%
tpcds_q09/duckdb:vortex-compact 22273672 / 22046096 / +1.0% 31700230 / 31297334 / +1.3% 0.70 / 0.70 / -0.3%
tpcds_q10/duckdb:vortex-compact 32103019 / 32481433 / -1.2% 44349154 / 45695660 / -2.9% 0.72 / 0.71 / +1.8%
tpcds_q11/duckdb:vortex-compact 38083578 / 38472070 / -1.0% 48380883 / 46926645 / +3.1% 0.79 / 0.82 / -4.0%
tpcds_q12/duckdb:vortex-compact 12494762 / 12801874 / -2.4% 19072592 / 19053981 / +0.1% 0.66 / 0.67 / -2.5%
tpcds_q13/duckdb:vortex-compact 36903685 / 37093168 / -0.5% 46871581 / 49431269 / -5.2% 0.79 / 0.75 / +4.9%
tpcds_q14/duckdb:vortex-compact 60262899 / 59464392 / +1.3% 69056638 / 68239887 / +1.2% 0.87 / 0.87 / +0.1%
tpcds_q15/duckdb:vortex-compact 14958072 / 14849327 / +0.7% 22682003 / 22240603 / +2.0% 0.66 / 0.67 / -1.2%
tpcds_q16/duckdb:vortex-compact 26599903 / 25758760 / +3.3% 36509725 / 35906523 / +1.7% 0.73 / 0.72 / +1.6%
tpcds_q17/duckdb:vortex-compact 24357536 / 28465350 / -14.4% 🟢 34696560 / 39056495 / -11.2% 🟢 0.70 / 0.73 / -3.7%
tpcds_q18/duckdb:vortex-compact 38212910 / 36093822 / +5.9% 49425697 / 45893910 / +7.7% 0.77 / 0.79 / -1.7%
tpcds_q19/duckdb:vortex-compact 24062792 / 82907672 / -71.0% 🟢 32714064 / 93632447 / -65.1% 🟢 0.74 / 0.89 / -16.9%
tpcds_q20/duckdb:vortex-compact 13250322 / 13541773 / -2.2% 19611635 / 20228940 / -3.1% 0.68 / 0.67 / +0.9%
tpcds_q21/duckdb:vortex-compact 11192954 / 12154032 / -7.9% 24253865 / 23961670 / +1.2% 0.46 / 0.51 / -9.0%
tpcds_q22/duckdb:vortex-compact 19801101 / 19331666 / +2.4% 32862737 / 31473150 / +4.4% 0.60 / 0.61 / -1.9%
tpcds_q23/duckdb:vortex-compact 41839668 / 43086214 / -2.9% 53018815 / 54789107 / -3.2% 0.79 / 0.79 / +0.3%
tpcds_q24/duckdb:vortex-compact 28795813 / 28745928 / +0.2% 37886852 / 36759696 / +3.1% 0.76 / 0.78 / -2.8%
tpcds_q25/duckdb:vortex-compact 23230761 / 27691208 / -16.1% 🟢 36371969 / 38588340 / -5.7% 0.64 / 0.72 / -11.0%
tpcds_q26/duckdb:vortex-compact 26847920 / 19657068 / +36.6% 🔴 37823094 / 25127584 / +50.5% 🔴 0.71 / 0.78 / -9.3%
tpcds_q27/duckdb:vortex-compact 29771134 / 21050398 / +41.4% 🔴 41249244 / 29389075 / +40.4% 🔴 0.72 / 0.72 / +0.8%
tpcds_q28/duckdb:vortex-compact 22696850 / 22085966 / +2.8% 31099803 / 31304642 / -0.7% 0.73 / 0.71 / +3.4%
tpcds_q29/duckdb:vortex-compact 22865042 / 27347989 / -16.4% 🟢 35038305 / 38892762 / -9.9% 0.65 / 0.70 / -7.2%
tpcds_q30/duckdb:vortex-compact 21573434 / 18230091 / +18.3% 🔴 30910029 / 26232628 / +17.8% 🔴 0.70 / 0.69 / +0.4%
tpcds_q31/duckdb:vortex-compact 21687500 / 21281698 / +1.9% 27833102 / 28399401 / -2.0% 0.78 / 0.75 / +4.0%
tpcds_q32/duckdb:vortex-compact 11114063 / 13173259 / -15.6% 🟢 18759469 / 22806710 / -17.7% 🟢 0.59 / 0.58 / +2.6%
tpcds_q33/duckdb:vortex-compact 19591979 / 21976498 / -10.9% 🟢 30184121 / 31300653 / -3.6% 0.65 / 0.70 / -7.6%
tpcds_q34/duckdb:vortex-compact 14487834 / 14676330 / -1.3% 24357282 / 24009405 / +1.4% 0.59 / 0.61 / -2.7%
tpcds_q35/duckdb:vortex-compact 35120634 / 31425044 / +11.8% 🔴 48405892 / 42739702 / +13.3% 🔴 0.73 / 0.74 / -1.3%
tpcds_q36/duckdb:vortex-compact 15738366 / 15906833 / -1.1% 25097911 / 25606265 / -2.0% 0.63 / 0.62 / +0.9%
tpcds_q37/duckdb:vortex-compact 13326374 / 13251850 / +0.6% 26165247 / 27647264 / -5.4% 0.51 / 0.48 / +6.3%
tpcds_q38/duckdb:vortex-compact 25193296 / 25595195 / -1.6% 33868949 / 33861060 / +0.0% 0.74 / 0.76 / -1.6%
tpcds_q39/duckdb:vortex-compact 20071612 / 19813657 / +1.3% 33033168 / 31265960 / +5.7% 0.61 / 0.63 / -4.1%
tpcds_q40/duckdb:vortex-compact 12523636 / 16094214 / -22.2% 🟢 24299598 / 22032735 / +10.3% 🔴 0.52 / 0.73 / -29.4%
tpcds_q41/duckdb:vortex-compact 20499648 / 20553218 / -0.3% 27940733 / 28045384 / -0.4% 0.73 / 0.73 / +0.1%
tpcds_q42/duckdb:vortex-compact 8309296 / 8165848 / +1.8% 17226551 / 16713893 / +3.1% 0.48 / 0.49 / -1.3%
tpcds_q43/duckdb:vortex-compact 11273780 / 11251244 / +0.2% 19536117 / 19862378 / -1.6% 0.58 / 0.57 / +1.9%
tpcds_q44/duckdb:vortex-compact 14987864 / 16383255 / -8.5% 26760456 / 26844633 / -0.3% 0.56 / 0.61 / -8.2%
tpcds_q45/duckdb:vortex-compact 26646112 / 26318392 / +1.2% 33749173 / 32828892 / +2.8% 0.79 / 0.80 / -1.5%
tpcds_q46/duckdb:vortex-compact 33339040 / 20153283 / +65.4% 🔴 43607868 / 28988077 / +50.4% 🔴 0.76 / 0.70 / +10.0%
tpcds_q47/duckdb:vortex-compact 38410276 / 36361353 / +5.6% 42155992 / 46514789 / -9.4% 0.91 / 0.78 / +16.6%
tpcds_q48/duckdb:vortex-compact 38418536 / 38157284 / +0.7% 49259722 / 48765247 / +1.0% 0.78 / 0.78 / -0.3%
tpcds_q49/duckdb:vortex-compact 22404738 / 23328094 / -4.0% 32924389 / 32782570 / +0.4% 0.68 / 0.71 / -4.4%
tpcds_q50/duckdb:vortex-compact 17907096 / 18787514 / -4.7% 26194088 / 27291875 / -4.0% 0.68 / 0.69 / -0.7%
tpcds_q51/duckdb:vortex-compact 50036844 / 50445311 / -0.8% 77687001 / 79442203 / -2.2% 0.64 / 0.63 / +1.4%
tpcds_q52/duckdb:vortex-compact 8624186 / 8562885 / +0.7% 16593624 / 16806798 / -1.3% 0.52 / 0.51 / +2.0%
tpcds_q53/duckdb:vortex-compact 13494162 / 13843731 / -2.5% 24040718 / 23224855 / +3.5% 0.56 / 0.60 / -5.8%
tpcds_q54/duckdb:vortex-compact 21347318 / 22068843 / -3.3% 30857348 / 31820769 / -3.0% 0.69 / 0.69 / -0.2%
tpcds_q55/duckdb:vortex-compact 8223792 / 8213940 / +0.1% 16849864 / 16728118 / +0.7% 0.49 / 0.49 / -0.6%
tpcds_q56/duckdb:vortex-compact 21030883 / 22511196 / -6.6% 31473383 / 30478007 / +3.3% 0.67 / 0.74 / -9.5%
tpcds_q57/duckdb:vortex-compact 26974984 / 27235920 / -1.0% 34885270 / 34603188 / +0.8% 0.77 / 0.79 / -1.8%
tpcds_q58/duckdb:vortex-compact 21584500 / 21767878 / -0.8% 31615943 / 31826984 / -0.7% 0.68 / 0.68 / -0.2%
tpcds_q59/duckdb:vortex-compact 22207767 / 22060026 / +0.7% 27962286 / 28645609 / -2.4% 0.79 / 0.77 / +3.1%
tpcds_q60/duckdb:vortex-compact 22091159 / 23015495 / -4.0% 32105077 / 31590032 / +1.6% 0.69 / 0.73 / -5.6%
tpcds_q61/duckdb:vortex-compact 22170448 / 27224058 / -18.6% 🟢 32756891 / 35777423 / -8.4% 0.68 / 0.76 / -11.1%
tpcds_q62/duckdb:vortex-compact 12304952 / 13104511 / -6.1% 19430106 / 20044499 / -3.1% 0.63 / 0.65 / -3.1%
tpcds_q63/duckdb:vortex-compact 13030219 / 13161703 / -1.0% 22361948 / 22500937 / -0.6% 0.58 / 0.58 / -0.4%
tpcds_q64/duckdb:vortex-compact 63679606 / 56999049 / +11.7% 🔴 78112945 / 72425493 / +7.9% 0.82 / 0.79 / +3.6%
tpcds_q65/duckdb:vortex-compact 14724322 / 14699049 / +0.2% 24399302 / 24075300 / +1.3% 0.60 / 0.61 / -1.2%
tpcds_q66/duckdb:vortex-compact 34251006 / 33877754 / +1.1% 40385889 / 36816055 / +9.7% 0.85 / 0.92 / -7.8%
tpcds_q67/duckdb:vortex-compact 63356866 / 63940313 / -0.9% 67372601 / 70112730 / -3.9% 0.94 / 0.91 / +3.1%
tpcds_q68/duckdb:vortex-compact 24640575 / 21391016 / +15.2% 🔴 37677466 / 28834876 / +30.7% 🔴 0.65 / 0.74 / -11.8%
tpcds_q69/duckdb:vortex-compact 28510272 / 28398933 / +0.4% 42677178 / 43842139 / -2.7% 0.67 / 0.65 / +3.1%
tpcds_q70/duckdb:vortex-compact 16048193 / 18621242 / -13.8% 🟢 27032949 / 30151972 / -10.3% 🟢 0.59 / 0.62 / -3.9%
tpcds_q71/duckdb:vortex-compact 16164724 / 15340353 / +5.4% 24330491 / 24642019 / -1.3% 0.66 / 0.62 / +6.7%
tpcds_q72/duckdb:vortex-compact 48853581 / 56636680 / -13.7% 🟢 60975361 / 67449710 / -9.6% 0.80 / 0.84 / -4.6%
tpcds_q73/duckdb:vortex-compact 13240228 / 13158271 / +0.6% 22849790 / 22777523 / +0.3% 0.58 / 0.58 / +0.3%
tpcds_q74/duckdb:vortex-compact 32790386 / 26670621 / +22.9% 🔴 40782844 / 34983765 / +16.6% 🔴 0.80 / 0.76 / +5.5%
tpcds_q75/duckdb:vortex-compact 39154634 / 29269344 / +33.8% 🔴 52289384 / 39691570 / +31.7% 🔴 0.75 / 0.74 / +1.5%
tpcds_q76/duckdb:vortex-compact 14396525 / 14241340 / +1.1% 23403762 / 23659180 / -1.1% 0.62 / 0.60 / +2.2%
tpcds_q77/duckdb:vortex-compact 23463010 / 23387802 / +0.3% 33119237 / 32162834 / +3.0% 0.71 / 0.73 / -2.6%
tpcds_q78/duckdb:vortex-compact 44651292 / 44865224 / -0.5% 55066776 / 55462111 / -0.7% 0.81 / 0.81 / +0.2%
tpcds_q79/duckdb:vortex-compact 18945838 / 13558504 / +39.7% 🔴 28646932 / 21613398 / +32.5% 🔴 0.66 / 0.63 / +5.4%
tpcds_q80/duckdb:vortex-compact 33151698 / 40629910 / -18.4% 🟢 44441369 / 50656074 / -12.3% 🟢 0.75 / 0.80 / -7.0%
tpcds_q81/duckdb:vortex-compact 23082594 / 24285478 / -5.0% 32116485 / 31946572 / +0.5% 0.72 / 0.76 / -5.5%
tpcds_q82/duckdb:vortex-compact 12688076 / 12941506 / -2.0% 26229736 / 27930866 / -6.1% 0.48 / 0.46 / +4.4%
tpcds_q83/duckdb:vortex-compact 18882487 / 18897939 / -0.1% 25605719 / 25675230 / -0.3% 0.74 / 0.74 / +0.2%
tpcds_q84/duckdb:vortex-compact 17545042 / 17695397 / -0.8% 23599019 / 23986719 / -1.6% 0.74 / 0.74 / +0.8%
tpcds_q85/duckdb:vortex-compact 40744142 / 38749798 / +5.1% 52815896 / 51088392 / +3.4% 0.77 / 0.76 / +1.7%
tpcds_q86/duckdb:vortex-compact 10869557 / 10914092 / -0.4% 17687686 / 17230200 / +2.7% 0.61 / 0.63 / -3.0%
tpcds_q87/duckdb:vortex-compact 26893859 / 27262352 / -1.4% 35334686 / 35878876 / -1.5% 0.76 / 0.76 / +0.2%
tpcds_q88/duckdb:vortex-compact 32301309 / 32188559 / +0.4% 38754143 / 39069557 / -0.8% 0.83 / 0.82 / +1.2%
tpcds_q89/duckdb:vortex-compact 13899546 / 16656738 / -16.6% 🟢 23063653 / 23417775 / -1.5% 0.60 / 0.71 / -15.3%
tpcds_q90/duckdb:vortex-compact 8649780 / 8567818 / +1.0% 15658572 / 15622179 / +0.2% 0.55 / 0.55 / +0.7%
tpcds_q91/duckdb:vortex-compact 24444702 / 23494604 / +4.0% 32842023 / 31222043 / +5.2% 0.74 / 0.75 / -1.1%
tpcds_q92/duckdb:vortex-compact 11553682 / 14384636 / -19.7% 🟢 18753466 / 23104676 / -18.8% 🟢 0.62 / 0.62 / -1.0%
tpcds_q93/duckdb:vortex-compact 12625110 / 12379633 / +2.0% 24875231 / 25297961 / -1.7% 0.51 / 0.49 / +3.7%
tpcds_q94/duckdb:vortex-compact 23877086 / 23966358 / -0.4% 33704226 / 32954732 / +2.3% 0.71 / 0.73 / -2.6%
tpcds_q95/duckdb:vortex-compact 62846818 / 64500668 / -2.6% 70580441 / 73670095 / -4.2% 0.89 / 0.88 / +1.7%
tpcds_q96/duckdb:vortex-compact 9138170 / 8651532 / +5.6% 16648324 / 16664542 / -0.1% 0.55 / 0.52 / +5.7%
tpcds_q97/duckdb:vortex-compact 24116553 / 23890302 / +0.9% 32887153 / 33260221 / -1.1% 0.73 / 0.72 / +2.1%
tpcds_q98/duckdb:vortex-compact 13838100 / 14157416 / -2.3% 22965248 / 22203856 / +3.4% 0.60 / 0.64 / -5.5%
tpcds_q99/duckdb:vortex-compact 15517362 / 16153922 / -3.9% 23295925 / 23304905 / -0.0% 0.67 / 0.69 / -3.9%
duckdb / parquet / ns (1.003x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23790132 / 23966969 / -0.7% 30978758 / 30829019 / +0.5% 0.77 / 0.78 / -1.2%
tpcds_q02/duckdb:parquet 17657234 / 17973470 / -1.8% 23728864 / 23889142 / -0.7% 0.74 / 0.75 / -1.1%
tpcds_q03/duckdb:parquet 9801276 / 9784454 / +0.2% 15520011 / 15698965 / -1.1% 0.63 / 0.62 / +1.3%
tpcds_q04/duckdb:parquet 117479540 / 117912489 / -0.4% 126687369 / 126089418 / +0.5% 0.93 / 0.94 / -0.8%
tpcds_q05/duckdb:parquet 28171930 / 28395371 / -0.8% 32707028 / 32582262 / +0.4% 0.86 / 0.87 / -1.2%
tpcds_q06/duckdb:parquet 26229750 / 26216986 / +0.0% 34975201 / 35588221 / -1.7% 0.75 / 0.74 / +1.8%
tpcds_q07/duckdb:parquet 32170123 / 33420428 / -3.7% 38338677 / 38430436 / -0.2% 0.84 / 0.87 / -3.5%
tpcds_q08/duckdb:parquet 19556456 / 19585998 / -0.2% 25109224 / 26172260 / -4.1% 0.78 / 0.75 / +4.1%
tpcds_q09/duckdb:parquet 26260385 / 27371152 / -4.1% 29061200 / 29649948 / -2.0% 0.90 / 0.92 / -2.1%
tpcds_q10/duckdb:parquet 32450590 / 32361482 / +0.3% 39960486 / 40184705 / -0.6% 0.81 / 0.81 / +0.8%
tpcds_q11/duckdb:parquet 68563366 / 68514487 / +0.1% 76342109 / 76389272 / -0.1% 0.90 / 0.90 / +0.1%
tpcds_q12/duckdb:parquet 14014854 / 13876876 / +1.0% 19035966 / 19186188 / -0.8% 0.74 / 0.72 / +1.8%
tpcds_q13/duckdb:parquet 32787725 / 30368470 / +8.0% 39239775 / 40187836 / -2.4% 0.84 / 0.76 / +10.6%
tpcds_q14/duckdb:parquet 64571190 / 63510142 / +1.7% 68318701 / 67941108 / +0.6% 0.95 / 0.93 / +1.1%
tpcds_q15/duckdb:parquet 16443204 / 16546332 / -0.6% 22345835 / 22895550 / -2.4% 0.74 / 0.72 / +1.8%
tpcds_q16/duckdb:parquet 29903005 / 30007520 / -0.3% 36845772 / 36406547 / +1.2% 0.81 / 0.82 / -1.5%
tpcds_q17/duckdb:parquet 34358870 / 34177397 / +0.5% 39376192 / 40441172 / -2.6% 0.87 / 0.85 / +3.2%
tpcds_q18/duckdb:parquet 47223564 / 47042055 / +0.4% 55928631 / 54456240 / +2.7% 0.84 / 0.86 / -2.3%
tpcds_q19/duckdb:parquet 19423996 / 18502952 / +5.0% 25842743 / 25759438 / +0.3% 0.75 / 0.72 / +4.6%
tpcds_q20/duckdb:parquet 14732102 / 14883558 / -1.0% 19659913 / 19539428 / +0.6% 0.75 / 0.76 / -1.6%
tpcds_q21/duckdb:parquet 10425476 / 10610768 / -1.7% 17227904 / 17113867 / +0.7% 0.61 / 0.62 / -2.4%
tpcds_q22/duckdb:parquet 20692724 / 20553610 / +0.7% 26685616 / 26725059 / -0.1% 0.78 / 0.77 / +0.8%
tpcds_q23/duckdb:parquet 45139486 / 43575614 / +3.6% 46836991 / 46598579 / +0.5% 0.96 / 0.94 / +3.1%
tpcds_q24/duckdb:parquet 30987658 / 30367457 / +2.0% 36718537 / 36478211 / +0.7% 0.84 / 0.83 / +1.4%
tpcds_q25/duckdb:parquet 30240805 / 30221780 / +0.1% 36895049 / 36937818 / -0.1% 0.82 / 0.82 / +0.2%
tpcds_q26/duckdb:parquet 28579162 / 28776880 / -0.7% 35407955 / 35302112 / +0.3% 0.81 / 0.82 / -1.0%
tpcds_q27/duckdb:parquet 34314215 / 35523786 / -3.4% 41452896 / 41611405 / -0.4% 0.83 / 0.85 / -3.0%
tpcds_q28/duckdb:parquet 26224208 / 26328432 / -0.4% 30263931 / 34309155 / -11.8% 🟢 0.87 / 0.77 / +12.9%
tpcds_q29/duckdb:parquet 31931844 / 31825925 / +0.3% 39065966 / 38870785 / +0.5% 0.82 / 0.82 / -0.2%
tpcds_q30/duckdb:parquet 35557800 / 35121615 / +1.2% 44349569 / 44712118 / -0.8% 0.80 / 0.79 / +2.1%
tpcds_q31/duckdb:parquet 35759366 / 35271778 / +1.4% 43246126 / 42481930 / +1.8% 0.83 / 0.83 / -0.4%
tpcds_q32/duckdb:parquet 14101636 / 14057028 / +0.3% 20789938 / 20598153 / +0.9% 0.68 / 0.68 / -0.6%
tpcds_q33/duckdb:parquet 23021316 / 23124152 / -0.4% 29312481 / 29167207 / +0.5% 0.79 / 0.79 / -0.9%
tpcds_q34/duckdb:parquet 17191154 / 16934344 / +1.5% 24214498 / 24303526 / -0.4% 0.71 / 0.70 / +1.9%
tpcds_q35/duckdb:parquet 35468186 / 35187535 / +0.8% 43291367 / 43708254 / -1.0% 0.82 / 0.81 / +1.8%
tpcds_q36/duckdb:parquet 40134586 / 39353736 / +2.0% 47129957 / 47971471 / -1.8% 0.85 / 0.82 / +3.8%
tpcds_q37/duckdb:parquet 12533770 / 12699916 / -1.3% 19483398 / 19775516 / -1.5% 0.64 / 0.64 / +0.2%
tpcds_q38/duckdb:parquet 29794800 / 29409083 / +1.3% 33553836 / 33644782 / -0.3% 0.89 / 0.87 / +1.6%
tpcds_q39/duckdb:parquet 23166350 / 23268776 / -0.4% 29522371 / 30173448 / -2.2% 0.78 / 0.77 / +1.8%
tpcds_q40/duckdb:parquet 15876592 / 15818668 / +0.4% 21554092 / 21350935 / +1.0% 0.74 / 0.74 / -0.6%
tpcds_q41/duckdb:parquet 11894588 / 11937368 / -0.4% 18010378 / 17654837 / +2.0% 0.66 / 0.68 / -2.3%
tpcds_q42/duckdb:parquet 9530153 / 9467242 / +0.7% 15472413 / 15390992 / +0.5% 0.62 / 0.62 / +0.1%
tpcds_q43/duckdb:parquet 11897576 / 13469714 / -11.7% 🟢 17814723 / 18054883 / -1.3% 0.67 / 0.75 / -10.5%
tpcds_q44/duckdb:parquet 20704352 / 21728390 / -4.7% 26949456 / 27212840 / -1.0% 0.77 / 0.80 / -3.8%
tpcds_q45/duckdb:parquet 20876150 / 20743408 / +0.6% 27742814 / 27840154 / -0.3% 0.75 / 0.75 / +1.0%
tpcds_q46/duckdb:parquet 37978087 / 36989149 / +2.7% 43944353 / 44071441 / -0.3% 0.86 / 0.84 / +3.0%
tpcds_q47/duckdb:parquet 34590708 / 34549854 / +0.1% 40940378 / 41188971 / -0.6% 0.84 / 0.84 / +0.7%
tpcds_q48/duckdb:parquet 30230020 / 30458733 / -0.8% 36698789 / 37126578 / -1.2% 0.82 / 0.82 / +0.4%
tpcds_q49/duckdb:parquet 30534800 / 30077962 / +1.5% 36619847 / 35486466 / +3.2% 0.83 / 0.85 / -1.6%
tpcds_q50/duckdb:parquet 19466170 / 19303932 / +0.8% 25450684 / 25663854 / -0.8% 0.76 / 0.75 / +1.7%
tpcds_q51/duckdb:parquet 51552600 / 51972089 / -0.8% 76298275 / 60028308 / +27.1% 🔴 0.68 / 0.87 / -22.0%
tpcds_q52/duckdb:parquet 10641861 / 9584687 / +11.0% 🔴 15512695 / 15536302 / -0.2% 0.69 / 0.62 / +11.2%
tpcds_q53/duckdb:parquet 14965438 / 13859535 / +8.0% 21163749 / 21051270 / +0.5% 0.71 / 0.66 / +7.4%
tpcds_q54/duckdb:parquet 24461073 / 24769012 / -1.2% 31808867 / 32317507 / -1.6% 0.77 / 0.77 / +0.3%
tpcds_q55/duckdb:parquet 9295053 / 9458322 / -1.7% 15384563 / 15628508 / -1.6% 0.60 / 0.61 / -0.2%
tpcds_q56/duckdb:parquet 26108824 / 24451846 / +6.8% 29996281 / 30263945 / -0.9% 0.87 / 0.81 / +7.7%
tpcds_q57/duckdb:parquet 30202904 / 30496694 / -1.0% 36295679 / 36082806 / +0.6% 0.83 / 0.85 / -1.5%
tpcds_q58/duckdb:parquet 23773718 / 24048685 / -1.1% 29264346 / 29574418 / -1.0% 0.81 / 0.81 / -0.1%
tpcds_q59/duckdb:parquet 22535444 / 22781209 / -1.1% 28477881 / 28822798 / -1.2% 0.79 / 0.79 / +0.1%
tpcds_q60/duckdb:parquet 27203707 / 26326926 / +3.3% 32051756 / 32439784 / -1.2% 0.85 / 0.81 / +4.6%
tpcds_q61/duckdb:parquet 24695226 / 24386621 / +1.3% 29203938 / 28840820 / +1.3% 0.85 / 0.85 / +0.0%
tpcds_q62/duckdb:parquet 12650355 / 12837852 / -1.5% 18156096 / 18021543 / +0.7% 0.70 / 0.71 / -2.2%
tpcds_q63/duckdb:parquet 13330016 / 13411461 / -0.6% 19731482 / 20165946 / -2.2% 0.68 / 0.67 / +1.6%
tpcds_q64/duckdb:parquet 69977139 / 70200230 / -0.3% 80663053 / 80412181 / +0.3% 0.87 / 0.87 / -0.6%
tpcds_q65/duckdb:parquet 19343546 / 18687231 / +3.5% 25980055 / 26192155 / -0.8% 0.74 / 0.71 / +4.4%
tpcds_q66/duckdb:parquet 33210870 / 33369771 / -0.5% 38098870 / 37725314 / +1.0% 0.87 / 0.88 / -1.5%
tpcds_q67/duckdb:parquet 61201449 / 60819089 / +0.6% 67385189 / 67228661 / +0.2% 0.91 / 0.90 / +0.4%
tpcds_q68/duckdb:parquet 31201706 / 29259984 / +6.6% 37328302 / 36839271 / +1.3% 0.84 / 0.79 / +5.2%
tpcds_q69/duckdb:parquet 25921128 / 25569940 / +1.4% 34382570 / 34423942 / -0.1% 0.75 / 0.74 / +1.5%
tpcds_q70/duckdb:parquet 19038965 / 19192084 / -0.8% 26569675 / 26739741 / -0.6% 0.72 / 0.72 / -0.2%
tpcds_q71/duckdb:parquet 16971276 / 17054927 / -0.5% 23767719 / 23954836 / -0.8% 0.71 / 0.71 / +0.3%
tpcds_q72/duckdb:parquet 52854992 / 52932942 / -0.1% 59220440 / 59845214 / -1.0% 0.89 / 0.88 / +0.9%
tpcds_q73/duckdb:parquet 14718307 / 14661652 / +0.4% 21663196 / 21893138 / -1.1% 0.68 / 0.67 / +1.5%
tpcds_q74/duckdb:parquet 84808384 / 84390668 / +0.5% 89887626 / 91452584 / -1.7% 0.94 / 0.92 / +2.2%
tpcds_q75/duckdb:parquet 45540226 / 44687585 / +1.9% 49797769 / 50609140 / -1.6% 0.91 / 0.88 / +3.6%
tpcds_q76/duckdb:parquet 18581198 / 19040094 / -2.4% 23711434 / 23607159 / +0.4% 0.78 / 0.81 / -2.8%
tpcds_q77/duckdb:parquet 25066096 / 25425972 / -1.4% 31205403 / 32155175 / -3.0% 0.80 / 0.79 / +1.6%
tpcds_q78/duckdb:parquet 77748930 / 77093010 / +0.9% 84683727 / 84250182 / +0.5% 0.92 / 0.92 / +0.3%
tpcds_q79/duckdb:parquet 22290096 / 21130690 / +5.5% 28949682 / 29307556 / -1.2% 0.77 / 0.72 / +6.8%
tpcds_q80/duckdb:parquet 35769222 / 37184819 / -3.8% 43796010 / 43847529 / -0.1% 0.82 / 0.85 / -3.7%
tpcds_q81/duckdb:parquet 36057282 / 35976995 / +0.2% 44192094 / 44333291 / -0.3% 0.82 / 0.81 / +0.5%
tpcds_q82/duckdb:parquet 13115664 / 13373336 / -1.9% 20448641 / 20170460 / +1.4% 0.64 / 0.66 / -3.3%
tpcds_q83/duckdb:parquet 20115565 / 20056018 / +0.3% 24940300 / 24832676 / +0.4% 0.81 / 0.81 / -0.1%
tpcds_q84/duckdb:parquet 22981316 / 22552006 / +1.9% 28579791 / 28863502 / -1.0% 0.80 / 0.78 / +2.9%
tpcds_q85/duckdb:parquet 32316408 / 32295063 / +0.1% 40007008 / 39757757 / +0.6% 0.81 / 0.81 / -0.6%
tpcds_q86/duckdb:parquet 11776140 / 11671840 / +0.9% 16940472 / 17041774 / -0.6% 0.70 / 0.68 / +1.5%
tpcds_q87/duckdb:parquet 31415558 / 31295030 / +0.4% 36161046 / 35573309 / +1.7% 0.87 / 0.88 / -1.2%
tpcds_q88/duckdb:parquet 38332366 / 38174937 / +0.4% 44699696 / 41231775 / +8.4% 0.86 / 0.93 / -7.4%
tpcds_q89/duckdb:parquet 14227300 / 15086220 / -5.7% 21447752 / 21158011 / +1.4% 0.66 / 0.71 / -7.0%
tpcds_q90/duckdb:parquet 9923330 / 9834406 / +0.9% 14763520 / 15371268 / -4.0% 0.67 / 0.64 / +5.1%
tpcds_q91/duckdb:parquet 21112697 / 20811260 / +1.4% 28299346 / 28789486 / -1.7% 0.75 / 0.72 / +3.2%
tpcds_q92/duckdb:parquet 15548685 / 15505942 / +0.3% 21702905 / 21884251 / -0.8% 0.72 / 0.71 / +1.1%
tpcds_q93/duckdb:parquet 14204014 / 14008072 / +1.4% 20482068 / 20243382 / +1.2% 0.69 / 0.69 / +0.2%
tpcds_q94/duckdb:parquet 25268192 / 25514996 / -1.0% 32733687 / 32909651 / -0.5% 0.77 / 0.78 / -0.4%
tpcds_q95/duckdb:parquet 43658725 / 43842982 / -0.4% 49400997 / 49538887 / -0.3% 0.88 / 0.89 / -0.1%
tpcds_q96/duckdb:parquet 8134944 / 8142782 / -0.1% 13567417 / 13576831 / -0.1% 0.60 / 0.60 / -0.0%
tpcds_q97/duckdb:parquet 27562198 / 27093344 / +1.7% 34283787 / 32358898 / +5.9% 0.80 / 0.84 / -4.0%
tpcds_q98/duckdb:parquet 16414064 / 16374839 / +0.2% 23341354 / 23141567 / +0.9% 0.70 / 0.71 / -0.6%
tpcds_q99/duckdb:parquet 18623284 / 18656013 / -0.2% 24655014 / 24696138 / -0.2% 0.76 / 0.76 / -0.0%
duckdb / duckdb / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15466480 / 15496652 / -0.2% 24539277 / 24528758 / +0.0% 0.63 / 0.63 / -0.2%
tpcds_q02/duckdb:duckdb 12287007 / 12270085 / +0.1% 19692647 / 18498378 / +6.5% 0.62 / 0.66 / -5.9%
tpcds_q03/duckdb:duckdb 5011752 / 4943369 / +1.4% 12186098 / 11936842 / +2.1% 0.41 / 0.41 / -0.7%
tpcds_q04/duckdb:duckdb 48346606 / 48380454 / -0.1% 56377253 / 57344936 / -1.7% 0.86 / 0.84 / +1.6%
tpcds_q05/duckdb:duckdb 15603876 / 15763980 / -1.0% 21784030 / 21268288 / +2.4% 0.72 / 0.74 / -3.4%
tpcds_q06/duckdb:duckdb 17620174 / 17801706 / -1.0% 28188165 / 28272080 / -0.3% 0.63 / 0.63 / -0.7%
tpcds_q07/duckdb:duckdb 21228588 / 21169842 / +0.3% 31227804 / 31445776 / -0.7% 0.68 / 0.67 / +1.0%
tpcds_q08/duckdb:duckdb 18200564 / 18862050 / -3.5% 28027070 / 29230911 / -4.1% 0.65 / 0.65 / +0.6%
tpcds_q09/duckdb:duckdb 8498512 / 8615090 / -1.4% 13484085 / 13708992 / -1.6% 0.63 / 0.63 / +0.3%
tpcds_q10/duckdb:duckdb 17975134 / 17907468 / +0.4% 28074801 / 27848593 / +0.8% 0.64 / 0.64 / -0.4%
tpcds_q11/duckdb:duckdb 41793250 / 41986241 / -0.5% 50620253 / 50766253 / -0.3% 0.83 / 0.83 / -0.2%
tpcds_q12/duckdb:duckdb 8509720 / 9008268 / -5.5% 16430978 / 16643290 / -1.3% 0.52 / 0.54 / -4.3%
tpcds_q13/duckdb:duckdb 19821174 / 19929620 / -0.5% 32881936 / 32275584 / +1.9% 0.60 / 0.62 / -2.4%
tpcds_q14/duckdb:duckdb 39656318 / 39739510 / -0.2% 44638094 / 46456019 / -3.9% 0.89 / 0.86 / +3.9%
tpcds_q15/duckdb:duckdb 7928421 / 8136087 / -2.6% 14070008 / 13812755 / +1.9% 0.56 / 0.59 / -4.3%
tpcds_q16/duckdb:duckdb 12223006 / 12186583 / +0.3% 21502563 / 21345069 / +0.7% 0.57 / 0.57 / -0.4%
tpcds_q17/duckdb:duckdb 17726345 / 17545862 / +1.0% 30100970 / 28507098 / +5.6% 0.59 / 0.62 / -4.3%
tpcds_q18/duckdb:duckdb 32300486 / 31793394 / +1.6% 45997222 / 44320194 / +3.8% 0.70 / 0.72 / -2.1%
tpcds_q19/duckdb:duckdb 10596570 / 10173571 / +4.2% 20866969 / 20916530 / -0.2% 0.51 / 0.49 / +4.4%
tpcds_q20/duckdb:duckdb 9171564 / 9717579 / -5.6% 16208369 / 16896728 / -4.1% 0.57 / 0.58 / -1.6%
tpcds_q21/duckdb:duckdb 5968295 / 6085961 / -1.9% 10861417 / 10928299 / -0.6% 0.55 / 0.56 / -1.3%
tpcds_q22/duckdb:duckdb 17500512 / 17461908 / +0.2% 23090019 / 23114764 / -0.1% 0.76 / 0.76 / +0.3%
tpcds_q23/duckdb:duckdb 26774237 / 26679083 / +0.4% 35040031 / 34226382 / +2.4% 0.76 / 0.78 / -2.0%
tpcds_q24/duckdb:duckdb 15322532 / 15469270 / -0.9% 29180626 / 30626170 / -4.7% 0.53 / 0.51 / +4.0%
tpcds_q25/duckdb:duckdb 13715064 / 13696554 / +0.1% 27040842 / 25747285 / +5.0% 0.51 / 0.53 / -4.7%
tpcds_q26/duckdb:duckdb 18136392 / 18110509 / +0.1% 27688251 / 27148896 / +2.0% 0.66 / 0.67 / -1.8%
tpcds_q27/duckdb:duckdb 23305409 / 23294114 / +0.0% 35322327 / 34947013 / +1.1% 0.66 / 0.67 / -1.0%
tpcds_q28/duckdb:duckdb 11733884 / 11886552 / -1.3% 19628659 / 17766040 / +10.5% 🔴 0.60 / 0.67 / -10.7%
tpcds_q29/duckdb:duckdb 13929094 / 13813576 / +0.8% 26166473 / 26083216 / +0.3% 0.53 / 0.53 / +0.5%
tpcds_q30/duckdb:duckdb 17430946 / 17414350 / +0.1% 29473379 / 29322635 / +0.5% 0.59 / 0.59 / -0.4%
tpcds_q31/duckdb:duckdb 29838329 / 30022476 / -0.6% 38874783 / 38882167 / -0.0% 0.77 / 0.77 / -0.6%
tpcds_q32/duckdb:duckdb 5288536 / 5268547 / +0.4% 12831714 / 12480348 / +2.8% 0.41 / 0.42 / -2.4%
tpcds_q33/duckdb:duckdb 8891224 / 8943822 / -0.6% 15563891 / 16216730 / -4.0% 0.57 / 0.55 / +3.6%
tpcds_q34/duckdb:duckdb 10362708 / 10362061 / +0.0% 20458513 / 19498924 / +4.9% 0.51 / 0.53 / -4.7%
tpcds_q35/duckdb:duckdb 24060996 / 24024337 / +0.2% 33497409 / 33563732 / -0.2% 0.72 / 0.72 / +0.4%
tpcds_q36/duckdb:duckdb 12843966 / 12622965 / +1.8% 22321602 / 22041499 / +1.3% 0.58 / 0.57 / +0.5%
tpcds_q37/duckdb:duckdb 5536062 / 5243992 / +5.6% 13805324 / 13422907 / +2.8% 0.40 / 0.39 / +2.6%
tpcds_q38/duckdb:duckdb 22665156 / 22567126 / +0.4% 28491217 / 29499634 / -3.4% 0.80 / 0.76 / +4.0%
tpcds_q39/duckdb:duckdb 19189272 / 18989797 / +1.1% 24331823 / 24177530 / +0.6% 0.79 / 0.79 / +0.4%
tpcds_q40/duckdb:duckdb 8254642 / 8374648 / -1.4% 15909256 / 16253329 / -2.1% 0.52 / 0.52 / +0.7%
tpcds_q41/duckdb:duckdb 9943537 / 9906444 / +0.4% 16439745 / 17064359 / -3.7% 0.60 / 0.58 / +4.2%
tpcds_q42/duckdb:duckdb 4732170 / 4735788 / -0.1% 11431161 / 11346775 / +0.7% 0.41 / 0.42 / -0.8%
tpcds_q43/duckdb:duckdb 7498924 / 7441409 / +0.8% 15043565 / 14438628 / +4.2% 0.50 / 0.52 / -3.3%
tpcds_q44/duckdb:duckdb 9177276 / 9221712 / -0.5% 18833231 / 18382656 / +2.5% 0.49 / 0.50 / -2.9%
tpcds_q45/duckdb:duckdb 13654543 / 13063985 / +4.5% 22552815 / 21901313 / +3.0% 0.61 / 0.60 / +1.5%
tpcds_q46/duckdb:duckdb 24756816 / 24996284 / -1.0% 35294292 / 35959743 / -1.9% 0.70 / 0.70 / +0.9%
tpcds_q47/duckdb:duckdb 33211238 / 33094222 / +0.4% 41216654 / 41839548 / -1.5% 0.81 / 0.79 / +1.9%
tpcds_q48/duckdb:duckdb 27140431 / 27042804 / +0.4% 36736841 / 36745967 / -0.0% 0.74 / 0.74 / +0.4%
tpcds_q49/duckdb:duckdb 14408828 / 14493219 / -0.6% 24548694 / 24433195 / +0.5% 0.59 / 0.59 / -1.1%
tpcds_q50/duckdb:duckdb 9882740 / 9917918 / -0.4% 18838230 / 18656105 / +1.0% 0.52 / 0.53 / -1.3%
tpcds_q51/duckdb:duckdb 46271603 / 45899882 / +0.8% 54359991 / 55005617 / -1.2% 0.85 / 0.83 / +2.0%
tpcds_q52/duckdb:duckdb 5023352 / 4983280 / +0.8% 11798089 / 11357396 / +3.9% 0.43 / 0.44 / -3.0%
tpcds_q53/duckdb:duckdb 9416550 / 9282327 / +1.4% 17847101 / 17969248 / -0.7% 0.53 / 0.52 / +2.1%
tpcds_q54/duckdb:duckdb 11780712 / 11487234 / +2.6% 21738113 / 21718186 / +0.1% 0.54 / 0.53 / +2.5%
tpcds_q55/duckdb:duckdb 4887001 / 4733728 / +3.2% 11355780 / 11193712 / +1.4% 0.43 / 0.42 / +1.8%
tpcds_q56/duckdb:duckdb 10185194 / 10093016 / +0.9% 17382142 / 17511749 / -0.7% 0.59 / 0.58 / +1.7%
tpcds_q57/duckdb:duckdb 27474865 / 27397350 / +0.3% 34968908 / 35318271 / -1.0% 0.79 / 0.78 / +1.3%
tpcds_q58/duckdb:duckdb 10862412 / 10781480 / +0.8% 17940525 / 17420330 / +3.0% 0.61 / 0.62 / -2.2%
tpcds_q59/duckdb:duckdb 16781739 / 16584926 / +1.2% 25240608 / 23476858 / +7.5% 0.66 / 0.71 / -5.9%
tpcds_q60/duckdb:duckdb 10843590 / 10570246 / +2.6% 17879722 / 17771248 / +0.6% 0.61 / 0.59 / +2.0%
tpcds_q61/duckdb:duckdb 10015032 / 9959878 / +0.6% 19254110 / 19093075 / +0.8% 0.52 / 0.52 / -0.3%
tpcds_q62/duckdb:duckdb 8236638 / 8265594 / -0.4% 15446737 / 14832519 / +4.1% 0.53 / 0.56 / -4.3%
tpcds_q63/duckdb:duckdb 8964320 / 8730358 / +2.7% 17326178 / 16996211 / +1.9% 0.52 / 0.51 / +0.7%
tpcds_q64/duckdb:duckdb 38005618 / 37933043 / +0.2% 56646222 / 57609360 / -1.7% 0.67 / 0.66 / +1.9%
tpcds_q65/duckdb:duckdb 9706402 / 9663889 / +0.4% 18630344 / 19270969 / -3.3% 0.52 / 0.50 / +3.9%
tpcds_q66/duckdb:duckdb 24355302 / 24420078 / -0.3% 32410846 / 32374172 / +0.1% 0.75 / 0.75 / -0.4%
tpcds_q67/duckdb:duckdb 55053508 / 54973892 / +0.1% 65102417 / 64799022 / +0.5% 0.85 / 0.85 / -0.3%
tpcds_q68/duckdb:duckdb 16059626 / 15477112 / +3.8% 27795351 / 26530560 / +4.8% 0.58 / 0.58 / -1.0%
tpcds_q69/duckdb:duckdb 15073702 / 15017486 / +0.4% 24201525 / 25274597 / -4.2% 0.62 / 0.59 / +4.8%
tpcds_q70/duckdb:duckdb 10045378 / 10004692 / +0.4% 20312202 / 21047358 / -3.5% 0.49 / 0.48 / +4.0%
tpcds_q71/duckdb:duckdb 7912566 / 7965522 / -0.7% 15588999 / 15071705 / +3.4% 0.51 / 0.53 / -4.0%
tpcds_q72/duckdb:duckdb 36177798 / 35957200 / +0.6% 46239536 / 47015954 / -1.7% 0.78 / 0.76 / +2.3%
tpcds_q73/duckdb:duckdb 7973006 / 7873508 / +1.3% 16927508 / 17082653 / -0.9% 0.47 / 0.46 / +2.2%
tpcds_q74/duckdb:duckdb 35678946 / 35633042 / +0.1% 44590473 / 43865013 / +1.7% 0.80 / 0.81 / -1.5%
tpcds_q75/duckdb:duckdb 29863630 / 29749871 / +0.4% 40303522 / 41263687 / -2.3% 0.74 / 0.72 / +2.8%
tpcds_q76/duckdb:duckdb 8154132 / 8080441 / +0.9% 16726596 / 16386710 / +2.1% 0.49 / 0.49 / -1.1%
tpcds_q77/duckdb:duckdb 10480065 / 10463157 / +0.2% 20111960 / 20354238 / -1.2% 0.52 / 0.51 / +1.4%
tpcds_q78/duckdb:duckdb 64063824 / 64169246 / -0.2% 74199082 / 73433837 / +1.0% 0.86 / 0.87 / -1.2%
tpcds_q79/duckdb:duckdb 12006874 / 12058600 / -0.4% 22684318 / 21573722 / +5.1% 0.53 / 0.56 / -5.3%
tpcds_q80/duckdb:duckdb 16840876 / 16865278 / -0.1% 29625975 / 29900617 / -0.9% 0.57 / 0.56 / +0.8%
tpcds_q81/duckdb:duckdb 25245342 / 25008864 / +0.9% 36903103 / 37172284 / -0.7% 0.68 / 0.67 / +1.7%
tpcds_q82/duckdb:duckdb 6100756 / 5789028 / +5.4% 14255408 / 14087438 / +1.2% 0.43 / 0.41 / +4.1%
tpcds_q83/duckdb:duckdb 8873730 / 8943636 / -0.8% 15191997 / 15087268 / +0.7% 0.58 / 0.59 / -1.5%
tpcds_q84/duckdb:duckdb 9251701 / 9130338 / +1.3% 18729364 / 18138100 / +3.3% 0.49 / 0.50 / -1.9%
tpcds_q85/duckdb:duckdb 21018799 / 20940572 / +0.4% 35097286 / 34381219 / +2.1% 0.60 / 0.61 / -1.7%
tpcds_q86/duckdb:duckdb 8530671 / 8439474 / +1.1% 14812552 / 15286334 / -3.1% 0.58 / 0.55 / +4.3%
tpcds_q87/duckdb:duckdb 24663022 / 24513146 / +0.6% 30684400 / 31122805 / -1.4% 0.80 / 0.79 / +2.0%
tpcds_q88/duckdb:duckdb 18901912 / 18754210 / +0.8% 24439214 / 24374917 / +0.3% 0.77 / 0.77 / +0.5%
tpcds_q89/duckdb:duckdb 10446326 / 10230896 / +2.1% 19052815 / 18384574 / +3.6% 0.55 / 0.56 / -1.5%
tpcds_q90/duckdb:duckdb 4910717 / 5064722 / -3.0% 10780326 / 10409783 / +3.6% 0.46 / 0.49 / -6.4%
tpcds_q91/duckdb:duckdb 8723882 / 8547317 / +2.1% 18575577 / 18902999 / -1.7% 0.47 / 0.45 / +3.9%
tpcds_q92/duckdb:duckdb 6696834 / 6674768 / +0.3% 14426023 / 14427158 / -0.0% 0.46 / 0.46 / +0.3%
tpcds_q93/duckdb:duckdb 6854570 / 6818308 / +0.5% 15051867 / 14559198 / +3.4% 0.46 / 0.47 / -2.8%
tpcds_q94/duckdb:duckdb 11662862 / 11743706 / -0.7% 23309133 / 23321698 / -0.1% 0.50 / 0.50 / -0.6%
tpcds_q95/duckdb:duckdb 35734199 / 35658992 / +0.2% 44861578 / 44486035 / +0.8% 0.80 / 0.80 / -0.6%
tpcds_q96/duckdb:duckdb 3758218 / 3897138 / -3.6% 9921857 / 9877805 / +0.4% 0.38 / 0.39 / -4.0%
tpcds_q97/duckdb:duckdb 21602608 / 21407428 / +0.9% 27668980 / 27651313 / +0.1% 0.78 / 0.77 / +0.8%
tpcds_q98/duckdb:duckdb 10172227 / 10575348 / -3.8% 18594296 / 19304934 / -3.7% 0.55 / 0.55 / -0.1%
tpcds_q99/duckdb:duckdb 12939346 / 12998202 / -0.5% 20137951 / 19803382 / +1.7% 0.64 / 0.66 / -2.1%

@myrrc
myrrc merged commit 2d128af into develop Nov 3, 2026
@myrrc
myrrc deleted the myrrc/duckdb-ndv-hack branch November 3, 2026 12:21
@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.1%
Engines: DataFusion No clear signal (+2.0%, environment too noisy confidence) · DuckDB No clear signal (-8.0%, environment too noisy confidence)
Vortex (geomean): hot 1.037x ➖ · cold 1.065x ➖
Parquet (geomean): hot 1.071x ➖ · cold 1.072x ➖
Shifts: Parquet (control) +7.1% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.114x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 245312356 / 220831264 / +11.1% 727159633 / 576458480 / +26.1% 0.34 / 0.38 / -11.9%
tpch_q02/datafusion:vortex-file-compressed 337120960 / 308669932 / +9.2% 724432131 / 674528013 / +7.4% 0.47 / 0.46 / +1.7%
tpch_q03/datafusion:vortex-file-compressed 444475209 / 347086704 / +28.1% 1063287301 / 871608881 / +22.0% 0.42 / 0.40 / +5.0%
tpch_q04/datafusion:vortex-file-compressed 284530237 / 207021749 / +37.4% 🔴 668808450 / 422384755 / +58.3% 🔴 0.43 / 0.49 / -13.2%
tpch_q05/datafusion:vortex-file-compressed 383027193 / 425586511 / -10.0% 588566305 / 613441206 / -4.1% 0.65 / 0.69 / -6.2%
tpch_q06/datafusion:vortex-file-compressed 149392015 / 141424151 / +5.6% 368126532 / 371254228 / -0.8% 0.41 / 0.38 / +6.5%
tpch_q07/datafusion:vortex-file-compressed 514680620 / 462415225 / +11.3% 693625550 / 582547518 / +19.1% 0.74 / 0.79 / -6.5%
tpch_q08/datafusion:vortex-file-compressed 601426450 / 427390773 / +40.7% 🔴 601010441 / 601931393 / -0.2% 1.00 / 0.71 / +40.9%
tpch_q09/datafusion:vortex-file-compressed 440021218 / 268529658 / +63.9% 🔴 771615612 / 473357724 / +63.0% 🔴 0.57 / 0.57 / +0.5%
tpch_q10/datafusion:vortex-file-compressed 443547701 / 348508035 / +27.3% 707675612 / 528499094 / +33.9% 🔴 0.63 / 0.66 / -5.0%
tpch_q11/datafusion:vortex-file-compressed 292451097 / 257327413 / +13.6% 448870349 / 420659524 / +6.7% 0.65 / 0.61 / +6.5%
tpch_q12/datafusion:vortex-file-compressed 462966737 / 210715328 / +119.7% 🔴 411048006 / 429074710 / -4.2% 1.13 / 0.49 / +129.3%
tpch_q13/datafusion:vortex-file-compressed 142855438 / 131309055 / +8.8% 354289368 / 370354402 / -4.3% 0.40 / 0.35 / +13.7%
tpch_q14/datafusion:vortex-file-compressed 200908501 / 211521200 / -5.0% 372345793 / 383637559 / -2.9% 0.54 / 0.55 / -2.1%
tpch_q15/datafusion:vortex-file-compressed 316082839 / 292649172 / +8.0% 631483695 / 520914480 / +21.2% 0.50 / 0.56 / -10.9%
tpch_q16/datafusion:vortex-file-compressed 141191764 / 158770515 / -11.1% 299401669 / 318188188 / -5.9% 0.47 / 0.50 / -5.5%
tpch_q17/datafusion:vortex-file-compressed 257607655 / 307709054 / -16.3% 502534771 / 454845057 / +10.5% 0.51 / 0.68 / -24.2%
tpch_q18/datafusion:vortex-file-compressed 249396743 / 590427775 / -57.8% 🟢 435168488 / 723635830 / -39.9% 🟢 0.57 / 0.82 / -29.8%
tpch_q19/datafusion:vortex-file-compressed 256220047 / 216120746 / +18.6% 386844626 / 356996489 / +8.4% 0.66 / 0.61 / +9.4%
tpch_q20/datafusion:vortex-file-compressed 365695451 / 292443661 / +25.0% 520282279 / 509890552 / +2.0% 0.70 / 0.57 / +22.6%
tpch_q21/datafusion:vortex-file-compressed 460904749 / 456400316 / +1.0% 679548777 / 730212380 / -6.9% 0.68 / 0.63 / +8.5%
tpch_q22/datafusion:vortex-file-compressed 205447706 / 167024301 / +23.0% 475622163 / 388209621 / +22.5% 0.43 / 0.43 / +0.4%
datafusion / vortex-compact / ns (1.083x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 222646732 / 225025550 / -1.1% 802976215 / 677420174 / +18.5% 0.28 / 0.33 / -16.5%
tpch_q02/datafusion:vortex-compact 295774689 / 302068995 / -2.1% 669542730 / 547609409 / +22.3% 0.44 / 0.55 / -19.9%
tpch_q03/datafusion:vortex-compact 323042585 / 312183343 / +3.5% 664126915 / 667397871 / -0.5% 0.49 / 0.47 / +4.0%
tpch_q04/datafusion:vortex-compact 178342533 / 155626318 / +14.6% 361160012 / 364294762 / -0.9% 0.49 / 0.43 / +15.6%
tpch_q05/datafusion:vortex-compact 362119233 / 518573680 / -30.2% 🟢 593874392 / 589160893 / +0.8% 0.61 / 0.88 / -30.7%
tpch_q06/datafusion:vortex-compact 157761821 / 141901196 / +11.2% 314555087 / 307964512 / +2.1% 0.50 / 0.46 / +8.8%
tpch_q07/datafusion:vortex-compact 414630889 / 474289004 / -12.6% 627151890 / 601525306 / +4.3% 0.66 / 0.79 / -16.2%
tpch_q08/datafusion:vortex-compact 442593165 / 480374797 / -7.9% 696136948 / 846667684 / -17.8% 0.64 / 0.57 / +12.1%
tpch_q09/datafusion:vortex-compact 271591303 / 466818102 / -41.8% 🟢 450349498 / 850265845 / -47.0% 🟢 0.60 / 0.55 / +9.8%
tpch_q10/datafusion:vortex-compact 359904882 / 326978294 / +10.1% 1132699512 / 505902807 / +123.9% 🔴 0.32 / 0.65 / -50.8%
tpch_q11/datafusion:vortex-compact 286890004 / 271946448 / +5.5% 460929247 / 445262117 / +3.5% 0.62 / 0.61 / +1.9%
tpch_q12/datafusion:vortex-compact 194756236 / 177814514 / +9.5% 364046802 / 611607384 / -40.5% 🟢 0.53 / 0.29 / +84.0%
tpch_q13/datafusion:vortex-compact 208269669 / 104730656 / +98.9% 🔴 383550748 / 266864422 / +43.7% 🔴 0.54 / 0.39 / +38.4%
tpch_q14/datafusion:vortex-compact 505267155 / 164703669 / +206.8% 🔴 436926847 / 438985897 / -0.5% 1.16 / 0.38 / +208.2%
tpch_q15/datafusion:vortex-compact 323969927 / 319366164 / +1.4% 571409129 / 574870317 / -0.6% 0.57 / 0.56 / +2.1%
tpch_q16/datafusion:vortex-compact 126413797 / 128986329 / -2.0% 262689353 / 299640131 / -12.3% 0.48 / 0.43 / +11.8%
tpch_q17/datafusion:vortex-compact 317796186 / 296106163 / +7.3% 534424002 / 461558578 / +15.8% 0.59 / 0.64 / -7.3%
tpch_q18/datafusion:vortex-compact 248131411 / 213977512 / +16.0% 529081255 / 431836035 / +22.5% 0.47 / 0.50 / -5.4%
tpch_q19/datafusion:vortex-compact 268924229 / 253327945 / +6.2% 393827575 / 407804545 / -3.4% 0.68 / 0.62 / +9.9%
tpch_q20/datafusion:vortex-compact 262258543 / 270854581 / -3.2% 411096952 / 424009956 / -3.0% 0.64 / 0.64 / -0.1%
tpch_q21/datafusion:vortex-compact 447724026 / 375684552 / +19.2% 659999963 / 615599818 / +7.2% 0.68 / 0.61 / +11.2%
tpch_q22/datafusion:vortex-compact 191955007 / 163669404 / +17.3% 404387112 / 354596373 / +14.0% 0.47 / 0.46 / +2.8%
datafusion / parquet / ns (1.077x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164867741 / 150351198 / +9.7% 506751192 / 460460005 / +10.1% 0.33 / 0.33 / -0.4%
tpch_q02/datafusion:parquet 292906376 / 284014916 / +3.1% 517064904 / 458008198 / +12.9% 0.57 / 0.62 / -8.6%
tpch_q03/datafusion:parquet 253174747 / 271007543 / -6.6% 781742159 / 753951884 / +3.7% 0.32 / 0.36 / -9.9%
tpch_q04/datafusion:parquet 159491010 / 133714329 / +19.3% 410414776 / 322406865 / +27.3% 0.39 / 0.41 / -6.3%
tpch_q05/datafusion:parquet 371155489 / 342356608 / +8.4% 484004286 / 468240904 / +3.4% 0.77 / 0.73 / +4.9%
tpch_q06/datafusion:parquet 155321327 / 112055911 / +38.6% 🔴 370370659 / 226141107 / +63.8% 🔴 0.42 / 0.50 / -15.4%
tpch_q07/datafusion:parquet 399099266 / 329957349 / +21.0% 583503605 / 516179984 / +13.0% 0.68 / 0.64 / +7.0%
tpch_q08/datafusion:parquet 528998055 / 432763020 / +22.2% 612930922 / 536690978 / +14.2% 0.86 / 0.81 / +7.0%
tpch_q09/datafusion:parquet 393640248 / 373806384 / +5.3% 599328470 / 539014441 / +11.2% 0.66 / 0.69 / -5.3%
tpch_q10/datafusion:parquet 311049939 / 309340609 / +0.6% 501265484 / 417479206 / +20.1% 0.62 / 0.74 / -16.3%
tpch_q11/datafusion:parquet 315366362 / 261901027 / +20.4% 423551536 / 373704730 / +13.3% 0.74 / 0.70 / +6.2%
tpch_q12/datafusion:parquet 154986724 / 162342440 / -4.5% 303782269 / 309500458 / -1.8% 0.51 / 0.52 / -2.7%
tpch_q13/datafusion:parquet 274956948 / 276376623 / -0.5% 531644655 / 436081873 / +21.9% 0.52 / 0.63 / -18.4%
tpch_q14/datafusion:parquet 198876264 / 157906152 / +25.9% 309900637 / 273555838 / +13.3% 0.64 / 0.58 / +11.2%
tpch_q15/datafusion:parquet 377318545 / 317865748 / +18.7% 504860731 / 523121657 / -3.5% 0.75 / 0.61 / +23.0%
tpch_q16/datafusion:parquet 100252117 / 111322386 / -9.9% 238755545 / 231410953 / +3.2% 0.42 / 0.48 / -12.7%
tpch_q17/datafusion:parquet 270514645 / 272274209 / -0.6% 436813791 / 526187695 / -17.0% 0.62 / 0.52 / +19.7%
tpch_q18/datafusion:parquet 327063899 / 341966792 / -4.4% 584156022 / 503106611 / +16.1% 0.56 / 0.68 / -17.6%
tpch_q19/datafusion:parquet 166727897 / 157601017 / +5.8% 297243505 / 273426259 / +8.7% 0.56 / 0.58 / -2.7%
tpch_q20/datafusion:parquet 242648332 / 235515300 / +3.0% 407755492 / 397076072 / +2.7% 0.60 / 0.59 / +0.3%
tpch_q21/datafusion:parquet 306214086 / 292874917 / +4.6% 475764233 / 463033836 / +2.7% 0.64 / 0.63 / +1.8%
tpch_q22/datafusion:parquet 165164896 / 160199804 / +3.1% 345694287 / 388871374 / -11.1% 0.48 / 0.41 / +16.0%
duckdb / vortex-file-compressed / ns (0.975x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 246852331 / 247509334 / -0.3% 314898320 / 267181463 / +17.9% 0.78 / 0.93 / -15.4%
tpch_q02/duckdb:vortex-file-compressed 424713230 / 408988212 / +3.8% 538508166 / 495524216 / +8.7% 0.79 / 0.83 / -4.4%
tpch_q03/duckdb:vortex-file-compressed 487430308 / 416179552 / +17.1% 565844147 / 484765981 / +16.7% 0.86 / 0.86 / +0.3%
tpch_q04/duckdb:vortex-file-compressed 265644790 / 273734107 / -3.0% 304867933 / 309747374 / -1.6% 0.87 / 0.88 / -1.4%
tpch_q05/duckdb:vortex-file-compressed 610465616 / 585375507 / +4.3% 641529306 / 657952067 / -2.5% 0.95 / 0.89 / +7.0%
tpch_q06/duckdb:vortex-file-compressed 208687904 / 203012163 / +2.8% 245328820 / 217053599 / +13.0% 0.85 / 0.94 / -9.1%
tpch_q07/duckdb:vortex-file-compressed 418127077 / 433499388 / -3.5% 443573039 / 491006362 / -9.7% 0.94 / 0.88 / +6.8%
tpch_q08/duckdb:vortex-file-compressed 620260479 / 856662362 / -27.6% 660827025 / 924712147 / -28.5% 0.94 / 0.93 / +1.3%
tpch_q09/duckdb:vortex-file-compressed 443953564 / 430063376 / +3.2% 579344081 / 472261724 / +22.7% 0.77 / 0.91 / -15.9%
tpch_q10/duckdb:vortex-file-compressed 553568883 / 562615415 / -1.6% 560146329 / 577179328 / -3.0% 0.99 / 0.97 / +1.4%
tpch_q11/duckdb:vortex-file-compressed 281369587 / 295453825 / -4.8% 267810671 / 295294530 / -9.3% 1.05 / 1.00 / +5.0%
tpch_q12/duckdb:vortex-file-compressed 263872419 / 281391065 / -6.2% 295555192 / 342314564 / -13.7% 0.89 / 0.82 / +8.6%
tpch_q13/duckdb:vortex-file-compressed 213190412 / 257839733 / -17.3% 210525365 / 337095202 / -37.5% 🟢 1.01 / 0.76 / +32.4%
tpch_q14/duckdb:vortex-file-compressed 231813599 / 215999117 / +7.3% 345181646 / 312373489 / +10.5% 0.67 / 0.69 / -2.9%
tpch_q15/duckdb:vortex-file-compressed 263032652 / 339636073 / -22.6% 339762958 / 292926502 / +16.0% 0.77 / 1.16 / -33.2%
tpch_q16/duckdb:vortex-file-compressed 211986565 / 210376153 / +0.8% 246673395 / 230946559 / +6.8% 0.86 / 0.91 / -5.7%
tpch_q17/duckdb:vortex-file-compressed 330566076 / 324970756 / +1.7% 336914317 / 357086182 / -5.6% 0.98 / 0.91 / +7.8%
tpch_q18/duckdb:vortex-file-compressed 549263607 / 431733303 / +27.2% 1307128626 / 402106068 / +225.1% 🔴 0.42 / 1.07 / -60.9%
tpch_q19/duckdb:vortex-file-compressed 278006869 / 303395982 / -8.4% 383915345 / 339697179 / +13.0% 0.72 / 0.89 / -18.9%
tpch_q20/duckdb:vortex-file-compressed 373588967 / 385636006 / -3.1% 518793947 / 483758671 / +7.2% 0.72 / 0.80 / -9.7%
tpch_q21/duckdb:vortex-file-compressed 591509809 / 656583605 / -9.9% 636435167 / 782358666 / -18.7% 0.93 / 0.84 / +10.7%
tpch_q22/duckdb:vortex-file-compressed 249533993 / 251855732 / -0.9% 330366731 / 334512025 / -1.2% 0.76 / 0.75 / +0.3%
duckdb / vortex-compact / ns (0.985x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 258145949 / 268636665 / -3.9% 253900617 / 271669550 / -6.5% 1.02 / 0.99 / +2.8%
tpch_q02/duckdb:vortex-compact 417943366 / 420302991 / -0.6% 564470297 / 490097916 / +15.2% 0.74 / 0.86 / -13.7%
tpch_q03/duckdb:vortex-compact 392991931 / 362835151 / +8.3% 503897402 / 405118346 / +24.4% 0.78 / 0.90 / -12.9%
tpch_q04/duckdb:vortex-compact 220432754 / 368595704 / -40.2% 🟢 285888621 / 247797682 / +15.4% 0.77 / 1.49 / -48.2%
tpch_q05/duckdb:vortex-compact 520738116 / 625132405 / -16.7% 540586460 / 772524246 / -30.0% 🟢 0.96 / 0.81 / +19.0%
tpch_q06/duckdb:vortex-compact 196012262 / 165165497 / +18.7% 357496002 / 229926640 / +55.5% 🔴 0.55 / 0.72 / -23.7%
tpch_q07/duckdb:vortex-compact 478886742 / 419329216 / +14.2% 537875375 / 450273648 / +19.5% 0.89 / 0.93 / -4.4%
tpch_q08/duckdb:vortex-compact 635415492 / 616409393 / +3.1% 682835519 / 675053193 / +1.2% 0.93 / 0.91 / +1.9%
tpch_q09/duckdb:vortex-compact 417957633 / 432768043 / -3.4% 547699883 / 505707898 / +8.3% 0.76 / 0.86 / -10.8%
tpch_q10/duckdb:vortex-compact 512342931 / 477250513 / +7.4% 736991398 / 520062109 / +41.7% 🔴 0.70 / 0.92 / -24.2%
tpch_q11/duckdb:vortex-compact 282380601 / 295339317 / -4.4% 316071757 / 314070360 / +0.6% 0.89 / 0.94 / -5.0%
tpch_q12/duckdb:vortex-compact 227300783 / 310299396 / -26.7% 238054001 / 262128057 / -9.2% 0.95 / 1.18 / -19.3%
tpch_q13/duckdb:vortex-compact 204037724 / 216369189 / -5.7% 267599650 / 300680518 / -11.0% 0.76 / 0.72 / +6.0%
tpch_q14/duckdb:vortex-compact 236323626 / 254817677 / -7.3% 358928538 / 319519141 / +12.3% 0.66 / 0.80 / -17.4%
tpch_q15/duckdb:vortex-compact 251649033 / 268965751 / -6.4% 313249343 / 263696436 / +18.8% 0.80 / 1.02 / -21.2%
tpch_q16/duckdb:vortex-compact 207808179 / 217335304 / -4.4% 242448889 / 192270118 / +26.1% 0.86 / 1.13 / -24.2%
tpch_q17/duckdb:vortex-compact 348072035 / 355821852 / -2.2% 350964566 / 405774640 / -13.5% 0.99 / 0.88 / +13.1%
tpch_q18/duckdb:vortex-compact 413505625 / 391290429 / +5.7% 602851263 / 372093787 / +62.0% 🔴 0.69 / 1.05 / -34.8%
tpch_q19/duckdb:vortex-compact 342441752 / 289548777 / +18.3% 381882164 / 314494197 / +21.4% 0.90 / 0.92 / -2.6%
tpch_q20/duckdb:vortex-compact 621983640 / 447958668 / +38.8% 🔴 583612442 / 416628845 / +40.1% 🔴 1.07 / 1.08 / -0.9%
tpch_q21/duckdb:vortex-compact 619168311 / 643345379 / -3.8% 762540918 / 751180554 / +1.5% 0.81 / 0.86 / -5.2%
tpch_q22/duckdb:vortex-compact 239179329 / 224217022 / +6.7% 299889364 / 320900676 / -6.5% 0.80 / 0.70 / +14.1%
duckdb / parquet / ns (1.065x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 210909729 / 152166910 / +38.6% 🔴 240728782 / 211204649 / +14.0% 0.88 / 0.72 / +21.6%
tpch_q02/duckdb:parquet 500009058 / 453471368 / +10.3% 485472205 / 426327264 / +13.9% 1.03 / 1.06 / -3.2%
tpch_q03/duckdb:parquet 480404822 / 358243434 / +34.1% 🔴 667148756 / 423368603 / +57.6% 🔴 0.72 / 0.85 / -14.9%
tpch_q04/duckdb:parquet 247436859 / 281717280 / -12.2% 238861894 / 332953926 / -28.3% 1.04 / 0.85 / +22.4%
tpch_q05/duckdb:parquet 559330534 / 536493872 / +4.3% 686968614 / 570606274 / +20.4% 0.81 / 0.94 / -13.4%
tpch_q06/duckdb:parquet 194947772 / 161239284 / +20.9% 201436170 / 206658661 / -2.5% 0.97 / 0.78 / +24.0%
tpch_q07/duckdb:parquet 466721290 / 436361603 / +7.0% 505534443 / 493434333 / +2.5% 0.92 / 0.88 / +4.4%
tpch_q08/duckdb:parquet 616962109 / 631844333 / -2.4% 730383425 / 652757052 / +11.9% 0.84 / 0.97 / -12.7%
tpch_q09/duckdb:parquet 591677541 / 564743109 / +4.8% 626393142 / 620443574 / +1.0% 0.94 / 0.91 / +3.8%
tpch_q10/duckdb:parquet 626813857 / 581110821 / +7.9% 669105810 / 636456873 / +5.1% 0.94 / 0.91 / +2.6%
tpch_q11/duckdb:parquet 261291462 / 285994921 / -8.6% 260787215 / 263711609 / -1.1% 1.00 / 1.08 / -7.6%
tpch_q12/duckdb:parquet 248580821 / 252866750 / -1.7% 286396876 / 291902719 / -1.9% 0.87 / 0.87 / +0.2%
tpch_q13/duckdb:parquet 365800305 / 369355879 / -1.0% 420326080 / 429176067 / -2.1% 0.87 / 0.86 / +1.1%
tpch_q14/duckdb:parquet 255387660 / 269935408 / -5.4% 300891368 / 344984516 / -12.8% 0.85 / 0.78 / +8.5%
tpch_q15/duckdb:parquet 215833783 / 212505719 / +1.6% 268309637 / 228893439 / +17.2% 0.80 / 0.93 / -13.4%
tpch_q16/duckdb:parquet 288486031 / 275747511 / +4.6% 298792369 / 327100698 / -8.7% 0.97 / 0.84 / +14.5%
tpch_q17/duckdb:parquet 306326876 / 263952606 / +16.1% 415306713 / 331901361 / +25.1% 0.74 / 0.80 / -7.3%
tpch_q18/duckdb:parquet 394088646 / 382490629 / +3.0% 390907348 / 393794532 / -0.7% 1.01 / 0.97 / +3.8%
tpch_q19/duckdb:parquet 303848227 / 266061746 / +14.2% 372960889 / 345007366 / +8.1% 0.81 / 0.77 / +5.6%
tpch_q20/duckdb:parquet 463166755 / 448150426 / +3.4% 528658566 / 480087501 / +10.1% 0.88 / 0.93 / -6.1%
tpch_q21/duckdb:parquet 511638678 / 418893862 / +22.1% 503872895 / 454759125 / +10.8% 1.02 / 0.92 / +10.2%
tpch_q22/duckdb:parquet 312008627 / 323115195 / -3.4% 331004362 / 335134028 / -1.2% 0.94 / 0.96 / -2.2%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.850x ✅
Parquet (geomean): hot 1.011x ➖ · cold 0.973x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 130420063 / 130908223 / -0.4% 513441438 / 526989245 / -2.6% 0.25 / 0.25 / +2.3%
vortex_q01/datafusion:vortex-file-compressed 122847533 / 122610173 / +0.2% 289341060 / 275585878 / +5.0% 0.42 / 0.44 / -4.6%
vortex_q02/datafusion:vortex-file-compressed 138799276 / 139411551 / -0.4% 271886223 / 267973318 / +1.5% 0.51 / 0.52 / -1.9%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 135065597 / 133527416 / +1.2% 1183894408 / 1122178452 / +5.5% 0.11 / 0.12 / -4.1%
vortex_q01/datafusion:parquet 68078662 / 68177248 / -0.1% 102985823 / 115803333 / -11.1% 🟢 0.66 / 0.59 / +12.3%
vortex_q02/datafusion:parquet 290113481 / 287733698 / +0.8% 656660285 / 668157055 / -1.7% 0.44 / 0.43 / +2.6%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 188770238 / 189980060 / -0.6% 721708294 / 932268920 / -22.6% 🟢 0.26 / 0.20 / +28.4%
vortex_q01/duckdb:vortex-file-compressed 90307852 / 90430165 / -0.1% 251722131 / 367055374 / -31.4% 🟢 0.36 / 0.25 / +45.6%
vortex_q02/duckdb:vortex-file-compressed 176198620 / 178820071 / -1.5% 344598859 / 502400356 / -31.4% 🟢 0.51 / 0.36 / +43.7%
duckdb / parquet / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 278266727 / 275152744 / +1.1% 773389136 / 854272273 / -9.5% 0.36 / 0.32 / +11.7%
vortex_q01/duckdb:parquet 163181781 / 158869549 / +2.7% 171643205 / 168535787 / +1.8% 0.95 / 0.94 / +0.9%
vortex_q02/duckdb:parquet 343681302 / 339941061 / +1.1% 615891014 / 617080839 / -0.2% 0.56 / 0.55 / +1.3%

@github-actions

ghost commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR d0193a40 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+6.7%, environment too noisy confidence) · DuckDB No clear signal (-4.5%, environment too noisy confidence)
Vortex (geomean): hot 1.053x ➖ · cold 1.031x ➖
Parquet (geomean): hot 1.043x ➖ · cold 1.076x ➖
Shifts: Parquet (control) +4.3% · Median polish +4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.213x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 344445519 / 341351523 / +0.9% 985731528 / 978090804 / +0.8% 0.35 / 0.35 / +0.1%
tpch_q02/datafusion:vortex-file-compressed 733623535 / 459281415 / +59.7% 🔴 1301125262 / 981219895 / +32.6% 🔴 0.56 / 0.47 / +20.5%
tpch_q03/datafusion:vortex-file-compressed 613021775 / 509805845 / +20.2% 1769123191 / 1218602469 / +45.2% 🔴 0.35 / 0.42 / -17.2%
tpch_q04/datafusion:vortex-file-compressed 444825885 / 440170662 / +1.1% 593775326 / 773890695 / -23.3% 0.75 / 0.57 / +31.7%
tpch_q05/datafusion:vortex-file-compressed 693132048 / 672783649 / +3.0% 972151855 / 907289409 / +7.1% 0.71 / 0.74 / -3.8%
tpch_q06/datafusion:vortex-file-compressed 875111267 / 248368672 / +252.3% 🔴 627076626 / 476792348 / +31.5% 🔴 1.40 / 0.52 / +167.9%
tpch_q07/datafusion:vortex-file-compressed 755590518 / 630576774 / +19.8% 885556464 / 959282781 / -7.7% 0.85 / 0.66 / +29.8%
tpch_q08/datafusion:vortex-file-compressed 906982057 / 857784746 / +5.7% 1224062645 / 1177166071 / +4.0% 0.74 / 0.73 / +1.7%
tpch_q09/datafusion:vortex-file-compressed 1216369255 / 952017244 / +27.8% 1170095868 / 1258125702 / -7.0% 1.04 / 0.76 / +37.4%
tpch_q10/datafusion:vortex-file-compressed 791064721 / 738351917 / +7.1% 945101894 / 946638273 / -0.2% 0.84 / 0.78 / +7.3%
tpch_q11/datafusion:vortex-file-compressed 370975634 / 367925610 / +0.8% 566957904 / 713489686 / -20.5% 0.65 / 0.52 / +26.9%
tpch_q12/datafusion:vortex-file-compressed 372415208 / 364142648 / +2.3% 576433312 / 614507442 / -6.2% 0.65 / 0.59 / +9.0%
tpch_q13/datafusion:vortex-file-compressed 325367961 / 313685856 / +3.7% 903044015 / 493178607 / +83.1% 🔴 0.36 / 0.64 / -43.4%
tpch_q14/datafusion:vortex-file-compressed 384562572 / 399103478 / -3.6% 728741481 / 707493353 / +3.0% 0.53 / 0.56 / -6.5%
tpch_q15/datafusion:vortex-file-compressed 1629666097 / 803095728 / +102.9% 🔴 1914837437 / 1031560425 / +85.6% 🔴 0.85 / 0.78 / +9.3%
tpch_q16/datafusion:vortex-file-compressed 256048002 / 242410488 / +5.6% 481978247 / 431922071 / +11.6% 0.53 / 0.56 / -5.3%
tpch_q17/datafusion:vortex-file-compressed 824873901 / 764692324 / +7.9% 913946598 / 973269670 / -6.1% 0.90 / 0.79 / +14.9%
tpch_q18/datafusion:vortex-file-compressed 927897973 / 931368899 / -0.4% 1047363744 / 950608572 / +10.2% 0.89 / 0.98 / -9.6%
tpch_q19/datafusion:vortex-file-compressed 920287220 / 448566361 / +105.2% 🔴 813189886 / 601288912 / +35.2% 🔴 1.13 / 0.75 / +51.7%
tpch_q20/datafusion:vortex-file-compressed 577614557 / 503587362 / +14.7% 903933001 / 836430662 / +8.1% 0.64 / 0.60 / +6.1%
tpch_q21/datafusion:vortex-file-compressed 1087423698 / 1045121297 / +4.0% 1256910793 / 1245747170 / +0.9% 0.87 / 0.84 / +3.1%
tpch_q22/datafusion:vortex-file-compressed 274130941 / 282874507 / -3.1% 578503989 / 591138930 / -2.1% 0.47 / 0.48 / -1.0%
datafusion / vortex-compact / ns (1.027x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 309653544 / 338199667 / -8.4% 1003292060 / 882290890 / +13.7% 0.31 / 0.38 / -19.5%
tpch_q02/datafusion:vortex-compact 539294684 / 483026357 / +11.6% 1054115291 / 990971847 / +6.4% 0.51 / 0.49 / +5.0%
tpch_q03/datafusion:vortex-compact 483352671 / 488455653 / -1.0% 1141374074 / 1126061541 / +1.4% 0.42 / 0.43 / -2.4%
tpch_q04/datafusion:vortex-compact 403077392 / 402764825 / +0.1% 535279558 / 646165033 / -17.2% 0.75 / 0.62 / +20.8%
tpch_q05/datafusion:vortex-compact 1614351055 / 697504709 / +131.4% 🔴 1746639255 / 934770256 / +86.9% 🔴 0.92 / 0.75 / +23.9%
tpch_q06/datafusion:vortex-compact 271944085 / 244400919 / +11.3% 415090821 / 486886737 / -14.7% 0.66 / 0.50 / +30.5%
tpch_q07/datafusion:vortex-compact 894489971 / 949005765 / -5.7% 992524644 / 902273215 / +10.0% 0.90 / 1.05 / -14.3%
tpch_q08/datafusion:vortex-compact 964877411 / 1193209237 / -19.1% 1119765827 / 1218392773 / -8.1% 0.86 / 0.98 / -12.0%
tpch_q09/datafusion:vortex-compact 719713898 / 920738531 / -21.8% 1066369602 / 1400395881 / -23.9% 0.67 / 0.66 / +2.7%
tpch_q10/datafusion:vortex-compact 699170193 / 811007796 / -13.8% 1041291864 / 1127609720 / -7.7% 0.67 / 0.72 / -6.6%
tpch_q11/datafusion:vortex-compact 329377318 / 379314163 / -13.2% 649165089 / 679010668 / -4.4% 0.51 / 0.56 / -9.2%
tpch_q12/datafusion:vortex-compact 448642485 / 355543679 / +26.2% 580961077 / 533409227 / +8.9% 0.77 / 0.67 / +15.9%
tpch_q13/datafusion:vortex-compact 240865802 / 247135777 / -2.5% 502243184 / 611918730 / -17.9% 0.48 / 0.40 / +18.7%
tpch_q14/datafusion:vortex-compact 276468581 / 304066697 / -9.1% 555312277 / 593311826 / -6.4% 0.50 / 0.51 / -2.9%
tpch_q15/datafusion:vortex-compact 582753857 / 509683326 / +14.3% 819498184 / 842778995 / -2.8% 0.71 / 0.60 / +17.6%
tpch_q16/datafusion:vortex-compact 280460262 / 345525379 / -18.8% 475092454 / 455712476 / +4.3% 0.59 / 0.76 / -22.1%
tpch_q17/datafusion:vortex-compact 745050380 / 723055489 / +3.0% 1007148495 / 891530921 / +13.0% 0.74 / 0.81 / -8.8%
tpch_q18/datafusion:vortex-compact 782657806 / 755377221 / +3.6% 1184430292 / 1064047335 / +11.3% 0.66 / 0.71 / -6.9%
tpch_q19/datafusion:vortex-compact 612958712 / 386059294 / +58.8% 🔴 756736901 / 592367024 / +27.7% 0.81 / 0.65 / +24.3%
tpch_q20/datafusion:vortex-compact 543634379 / 498672794 / +9.0% 839589130 / 733125596 / +14.5% 0.65 / 0.68 / -4.8%
tpch_q21/datafusion:vortex-compact 1172210648 / 1431269054 / -18.1% 1238150827 / 1272367050 / -2.7% 0.95 / 1.12 / -15.8%
tpch_q22/datafusion:vortex-compact 296028074 / 303176173 / -2.4% 616955759 / 623742371 / -1.1% 0.48 / 0.49 / -1.3%
datafusion / parquet / ns (1.045x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 254463657 / 237621193 / +7.1% 781832907 / 634385892 / +23.2% 0.33 / 0.37 / -13.1%
tpch_q02/datafusion:parquet 533645653 / 437155752 / +22.1% 991157612 / 887587296 / +11.7% 0.54 / 0.49 / +9.3%
tpch_q03/datafusion:parquet 520881317 / 483443043 / +7.7% 1044284621 / 843550608 / +23.8% 0.50 / 0.57 / -13.0%
tpch_q04/datafusion:parquet 403463942 / 342758138 / +17.7% 747855281 / 539994976 / +38.5% 🔴 0.54 / 0.63 / -15.0%
tpch_q05/datafusion:parquet 672051698 / 579903006 / +15.9% 893910753 / 771325079 / +15.9% 0.75 / 0.75 / -0.0%
tpch_q06/datafusion:parquet 206234591 / 252416563 / -18.3% 372324579 / 404378363 / -7.9% 0.55 / 0.62 / -11.3%
tpch_q07/datafusion:parquet 616836608 / 586937638 / +5.1% 864338598 / 775965861 / +11.4% 0.71 / 0.76 / -5.7%
tpch_q08/datafusion:parquet 676675109 / 975285462 / -30.6% 🟢 973961092 / 1195835356 / -18.6% 0.69 / 0.82 / -14.8%
tpch_q09/datafusion:parquet 1243074812 / 869002047 / +43.0% 🔴 1553722604 / 1335556391 / +16.3% 0.80 / 0.65 / +23.0%
tpch_q10/datafusion:parquet 1068109591 / 1048139091 / +1.9% 1323572849 / 1279689044 / +3.4% 0.81 / 0.82 / -1.5%
tpch_q11/datafusion:parquet 419293456 / 367014201 / +14.2% 575938299 / 578353867 / -0.4% 0.73 / 0.63 / +14.7%
tpch_q12/datafusion:parquet 412202003 / 459812081 / -10.4% 904757893 / 712882155 / +26.9% 0.46 / 0.65 / -29.4%
tpch_q13/datafusion:parquet 777523454 / 394443051 / +97.1% 🔴 1123566885 / 610408682 / +84.1% 🔴 0.69 / 0.65 / +7.1%
tpch_q14/datafusion:parquet 346313609 / 414005072 / -16.4% 599033109 / 746232380 / -19.7% 0.58 / 0.55 / +4.2%
tpch_q15/datafusion:parquet 1007637044 / 513833205 / +96.1% 🔴 1505645577 / 682070045 / +120.7% 🔴 0.67 / 0.75 / -11.2%
tpch_q16/datafusion:parquet 213498821 / 209562561 / +1.9% 485804246 / 458139223 / +6.0% 0.44 / 0.46 / -3.9%
tpch_q17/datafusion:parquet 728962748 / 745449100 / -2.2% 736733720 / 709526512 / +3.8% 0.99 / 1.05 / -5.8%
tpch_q18/datafusion:parquet 522717063 / 708511084 / -26.2% 797795417 / 735666591 / +8.4% 0.66 / 0.96 / -32.0%
tpch_q19/datafusion:parquet 427022210 / 478709528 / -10.8% 659891479 / 1001349051 / -34.1% 🟢 0.65 / 0.48 / +35.4%
tpch_q20/datafusion:parquet 702819079 / 1126302142 / -37.6% 🟢 905952407 / 1015710146 / -10.8% 0.78 / 1.11 / -30.0%
tpch_q21/datafusion:parquet 944585825 / 964843408 / -2.1% 1169453708 / 1106235552 / +5.7% 0.81 / 0.87 / -7.4%
tpch_q22/datafusion:parquet 475845768 / 395894855 / +20.2% 844137930 / 894469589 / -5.6% 0.56 / 0.44 / +27.4%
duckdb / vortex-file-compressed / ns (0.924x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1002573313 / 968481240 / +3.5% 1464719454 / 1458503795 / +0.4% 0.68 / 0.66 / +3.1%
tpch_q02/duckdb:vortex-file-compressed 535248917 / 637528187 / -16.0% 663516088 / 792440368 / -16.3% 0.81 / 0.80 / +0.3%
tpch_q03/duckdb:vortex-file-compressed 1449599229 / 1332266044 / +8.8% 1670629368 / 1668255499 / +0.1% 0.87 / 0.80 / +8.7%
tpch_q04/duckdb:vortex-file-compressed 1149697463 / 1054087746 / +9.1% 1506952493 / 1468184817 / +2.6% 0.76 / 0.72 / +6.3%
tpch_q05/duckdb:vortex-file-compressed 1225042993 / 1076710291 / +13.8% 1415178458 / 1620345210 / -12.7% 0.87 / 0.66 / +30.3%
tpch_q06/duckdb:vortex-file-compressed 829204035 / 799968569 / +3.7% 938248301 / 878670202 / +6.8% 0.88 / 0.91 / -2.9%
tpch_q07/duckdb:vortex-file-compressed 1197987174 / 1266992134 / -5.4% 1703029926 / 1508684791 / +12.9% 0.70 / 0.84 / -16.2%
tpch_q08/duckdb:vortex-file-compressed 1427593092 / 3773018152 / -62.2% 🟢 1476125859 / 2339432606 / -36.9% 🟢 0.97 / 1.61 / -40.0%
tpch_q09/duckdb:vortex-file-compressed 1327505826 / 1464654896 / -9.4% 1583087155 / 1575670747 / +0.5% 0.84 / 0.93 / -9.8%
tpch_q10/duckdb:vortex-file-compressed 1479969201 / 1437345913 / +3.0% 1674827474 / 1682416651 / -0.5% 0.88 / 0.85 / +3.4%
tpch_q11/duckdb:vortex-file-compressed 368558278 / 358346914 / +2.8% 559936072 / 538139308 / +4.1% 0.66 / 0.67 / -1.2%
tpch_q12/duckdb:vortex-file-compressed 1045815855 / 1427396554 / -26.7% 1188434724 / 1605459040 / -26.0% 0.88 / 0.89 / -1.0%
tpch_q13/duckdb:vortex-file-compressed 804043674 / 873661192 / -8.0% 1234595816 / 1319273622 / -6.4% 0.65 / 0.66 / -1.7%
tpch_q14/duckdb:vortex-file-compressed 949685458 / 1012234252 / -6.2% 1233652324 / 1064927083 / +15.8% 0.77 / 0.95 / -19.0%
tpch_q15/duckdb:vortex-file-compressed 918607305 / 848522587 / +8.3% 1162753538 / 973591930 / +19.4% 0.79 / 0.87 / -9.4%
tpch_q16/duckdb:vortex-file-compressed 344793771 / 277841200 / +24.1% 459570881 / 355938224 / +29.1% 0.75 / 0.78 / -3.9%
tpch_q17/duckdb:vortex-file-compressed 1062565253 / 1088648131 / -2.4% 1079297104 / 1169800690 / -7.7% 0.98 / 0.93 / +5.8%
tpch_q18/duckdb:vortex-file-compressed 1111227583 / 1182760119 / -6.0% 1191000999 / 1313613247 / -9.3% 0.93 / 0.90 / +3.6%
tpch_q19/duckdb:vortex-file-compressed 1056899916 / 1122401293 / -5.8% 1245312371 / 1270409813 / -2.0% 0.85 / 0.88 / -3.9%
tpch_q20/duckdb:vortex-file-compressed 1019121509 / 1048889439 / -2.8% 1175709327 / 1289562486 / -8.8% 0.87 / 0.81 / +6.6%
tpch_q21/duckdb:vortex-file-compressed 2449891051 / 2703314959 / -9.4% 2526793348 / 2663394001 / -5.1% 0.97 / 1.01 / -4.5%
tpch_q22/duckdb:vortex-file-compressed 372094167 / 573248973 / -35.1% 🟢 572690926 / 818527181 / -30.0% 🟢 0.65 / 0.70 / -7.2%
duckdb / vortex-compact / ns (1.070x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 944807325 / 875842412 / +7.9% 1559815534 / 1289653405 / +20.9% 0.61 / 0.68 / -10.8%
tpch_q02/duckdb:vortex-compact 698566257 / 517139358 / +35.1% 🔴 937692353 / 692499921 / +35.4% 🔴 0.74 / 0.75 / -0.2%
tpch_q03/duckdb:vortex-compact 1155700475 / 1187788772 / -2.7% 1570112024 / 1641432118 / -4.3% 0.74 / 0.72 / +1.7%
tpch_q04/duckdb:vortex-compact 1163761444 / 884377938 / +31.6% 🔴 1928286110 / 1170408188 / +64.8% 🔴 0.60 / 0.76 / -20.1%
tpch_q05/duckdb:vortex-compact 1533756197 / 1013614323 / +51.3% 🔴 1595452494 / 1551522081 / +2.8% 0.96 / 0.65 / +47.1%
tpch_q06/duckdb:vortex-compact 764024220 / 797265746 / -4.2% 889070294 / 912752926 / -2.6% 0.86 / 0.87 / -1.6%
tpch_q07/duckdb:vortex-compact 1141793144 / 1164864520 / -2.0% 1823998141 / 1386852173 / +31.5% 🔴 0.63 / 0.84 / -25.5%
tpch_q08/duckdb:vortex-compact 1126465742 / 1236135933 / -8.9% 1334487369 / 1524316783 / -12.5% 0.84 / 0.81 / +4.1%
tpch_q09/duckdb:vortex-compact 1334797454 / 1310299180 / +1.9% 1504479919 / 1590544856 / -5.4% 0.89 / 0.82 / +7.7%
tpch_q10/duckdb:vortex-compact 1325398183 / 1324511715 / +0.1% 1656565148 / 1831955434 / -9.6% 0.80 / 0.72 / +10.7%
tpch_q11/duckdb:vortex-compact 369766848 / 358154400 / +3.2% 433897111 / 505482653 / -14.2% 0.85 / 0.71 / +20.3%
tpch_q12/duckdb:vortex-compact 1064284928 / 897706522 / +18.6% 1261256428 / 1170680613 / +7.7% 0.84 / 0.77 / +10.0%
tpch_q13/duckdb:vortex-compact 843657973 / 771464604 / +9.4% 1129726201 / 976548237 / +15.7% 0.75 / 0.79 / -5.5%
tpch_q14/duckdb:vortex-compact 931094803 / 957208127 / -2.7% 1179954354 / 1233294447 / -4.3% 0.79 / 0.78 / +1.7%
tpch_q15/duckdb:vortex-compact 845957703 / 806690182 / +4.9% 985157286 / 881497510 / +11.8% 0.86 / 0.92 / -6.2%
tpch_q16/duckdb:vortex-compact 300561271 / 308848013 / -2.7% 354756994 / 375843733 / -5.6% 0.85 / 0.82 / +3.1%
tpch_q17/duckdb:vortex-compact 1041641714 / 969908964 / +7.4% 1346714963 / 1122632521 / +20.0% 0.77 / 0.86 / -10.5%
tpch_q18/duckdb:vortex-compact 1381410180 / 1096636401 / +26.0% 1237437626 / 1551137194 / -20.2% 1.12 / 0.71 / +57.9%
tpch_q19/duckdb:vortex-compact 1092307656 / 1111063782 / -1.7% 1298125272 / 1276373833 / +1.7% 0.84 / 0.87 / -3.3%
tpch_q20/duckdb:vortex-compact 1215272357 / 1145934534 / +6.1% 1527368440 / 1260633239 / +21.2% 0.80 / 0.91 / -12.5%
tpch_q21/duckdb:vortex-compact 2554158137 / 2301380729 / +11.0% 2721103913 / 2463764724 / +10.4% 0.94 / 0.93 / +0.5%
tpch_q22/duckdb:vortex-compact 369544112 / 426851288 / -13.4% 533636114 / 616043230 / -13.4% 0.69 / 0.69 / -0.1%
duckdb / parquet / ns (1.041x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 448886092 / 408448545 / +9.9% 442563472 / 412729507 / +7.2% 1.01 / 0.99 / +2.5%
tpch_q02/duckdb:parquet 589352895 / 639744914 / -7.9% 858823766 / 831377088 / +3.3% 0.69 / 0.77 / -10.8%
tpch_q03/duckdb:parquet 577151058 / 568472351 / +1.5% 1203946612 / 912924068 / +31.9% 🔴 0.48 / 0.62 / -23.0%
tpch_q04/duckdb:parquet 414863623 / 448539970 / -7.5% 607126064 / 617995627 / -1.8% 0.68 / 0.73 / -5.9%
tpch_q05/duckdb:parquet 881218208 / 741484688 / +18.8% 940501852 / 901987571 / +4.3% 0.94 / 0.82 / +14.0%
tpch_q06/duckdb:parquet 375217896 / 299004798 / +25.5% 407086813 / 321076710 / +26.8% 0.92 / 0.93 / -1.0%
tpch_q07/duckdb:parquet 903819877 / 941136057 / -4.0% 1078456948 / 884189354 / +22.0% 0.84 / 1.06 / -21.3%
tpch_q08/duckdb:parquet 971083796 / 974572725 / -0.4% 991987521 / 1008526835 / -1.6% 0.98 / 0.97 / +1.3%
tpch_q09/duckdb:parquet 1105644177 / 1079322748 / +2.4% 1236383416 / 1157342954 / +6.8% 0.89 / 0.93 / -4.1%
tpch_q10/duckdb:parquet 902088271 / 838068398 / +7.6% 1074637427 / 948704005 / +13.3% 0.84 / 0.88 / -5.0%
tpch_q11/duckdb:parquet 368682721 / 339358918 / +8.6% 433847707 / 432325432 / +0.4% 0.85 / 0.78 / +8.3%
tpch_q12/duckdb:parquet 411387009 / 418293717 / -1.7% 517487278 / 572778568 / -9.7% 0.79 / 0.73 / +8.9%
tpch_q13/duckdb:parquet 597505341 / 585577304 / +2.0% 799271539 / 794404332 / +0.6% 0.75 / 0.74 / +1.4%
tpch_q14/duckdb:parquet 588089756 / 534218653 / +10.1% 516075482 / 552317499 / -6.6% 1.14 / 0.97 / +17.8%
tpch_q15/duckdb:parquet 495088498 / 338603587 / +46.2% 🔴 559559683 / 345221398 / +62.1% 🔴 0.88 / 0.98 / -9.8%
tpch_q16/duckdb:parquet 376826924 / 339557019 / +11.0% 407707527 / 320011001 / +27.4% 0.92 / 1.06 / -12.9%
tpch_q17/duckdb:parquet 446831437 / 515310403 / -13.3% 732850942 / 1964881813 / -62.7% 🟢 0.61 / 0.26 / +132.5%
tpch_q18/duckdb:parquet 551504287 / 569245748 / -3.1% 953077243 / 711295016 / +34.0% 🔴 0.58 / 0.80 / -27.7%
tpch_q19/duckdb:parquet 597523578 / 511744776 / +16.8% 693633944 / 526144849 / +31.8% 🔴 0.86 / 0.97 / -11.4%
tpch_q20/duckdb:parquet 819800507 / 830494825 / -1.3% 924437260 / 929434802 / -0.5% 0.89 / 0.89 / -0.8%
tpch_q21/duckdb:parquet 728474848 / 795209547 / -8.4% 799489560 / 708586756 / +12.8% 0.91 / 1.12 / -18.8%
tpch_q22/duckdb:parquet 557955426 / 593358513 / -6.0% 632168614 / 730344123 / -13.4% 0.88 / 0.81 / +8.6%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

DuckDB on Vortex fails the TPC-DS nightly since the tables were split into files

2 participants