Skip to content

Push DataFusion dynamic filters into V2 scans - #11215

Merged
joseph-isaacs merged 10 commits into
developfrom
ji/sleepy-clarke-5utr8u
Nov 4, 2026
Merged

joseph-isaacs merged 10 commits into
developfrom
ji/sleepy-clarke-5utr8u

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

This is #11073 rebased onto develop, plus an on/off switch for dynamic conjuncts. The switch is ported to Scan V2 from the unselective-skip commit in #10415.

On TPC-DS SF1, CI showed #11073 alone with 38 of 99 DataFusion/Vortex queries slower and 2 faster. Most of that is the zone-pruning pass a dynamic filter adds before each scan. This PR checks whether switching off dynamic conjuncts that reject almost nothing recovers that, while keeping the SF10/SF20 gains. Everything is gated on scan_v2, so the default V1 path is unchanged.

Changes

  • Commits 1–5 (from Push DataFusion dynamic filters into V2 scans #11073, unchanged):
    1. Give each inline V2 scan root its own IO session.
    2. Push DataFusion dynamic filters into persistent V2 scans.
    3. Keep the conjuncts of a dynamic filter that convert.
    4. Merge the key bounds of a dynamic filter into a between.
    5. Skip dynamic zone pruning before scans of one filtered chunk.
  • Switch off unselective dynamic conjuncts:
    • A conjunct containing dynamic expressions switches off after it keeps at least 99% of its input rows on 4 consecutive chunks at one dynamic version.
    • While off, the scan skips its zone pruning, its prefetch and its evaluation, until its dynamic value changes.
    • Opt-in through v2::ScanBuilder::with_skip_unselective_dynamic. Only the DataFusion persistent opener enables it, because DataFusion pushes dynamic filters down inexactly (PushedDown::No) and the producing TopK or join applies them again. DuckDB is unchanged.
    • Cached filter plans are reused only by scans with the same setting.
    • find_between only merges comparisons against literals, so a switched-off conjunct never carries a static restriction with it.
  • Tests:
    • Unit tests for the switch state: it trips after the streak, resets on a selective evaluation, re-arms on a version change, and never trips without the opt-in.
    • A V2 scan test, with the switch on and off. Once the conjunct is switched off, the next scan reads no more segments than an unfiltered scan. Tightening the bound switches it back on with correct results.

Checks

  • cargo test -p vortex-layout -p vortex-datafusion: all passed (826 + 746 + 14 + 1, 2 ignored).
  • cargo clippy -p vortex-layout -p vortex-datafusion --all-targets --all-features -- -D warnings: clean.
  • cargo +nightly-2026-09-10 fmt -p vortex-layout -p vortex-datafusion: clean.
  • Not run locally: vortex-sqllogictest, vortex-array tests.
  • Benchmarks: pending. action/bench-sql covers TPC-DS SF1 for comparison with Push DataFusion dynamic filters into V2 scans #11073. SF10 is not in any PR preset.

The switch needs 4 chunks to trip, so it may not help the smallest SF1 scans.


Generated by Claude Code

joseph-isaacs and others added 7 commits November 4, 2026 10:14
Inline roots shared one session, and the run clears a root's session when the root retires. Once the first root finished, the remaining roots waited for reads that were never issued.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Evaluate TopK and hash join dynamic filters in the V2 file scan, so zones and rows are dropped before the engine sees them. The producing operator keeps enforcing them. V1 scans keep them out.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A join's hash table lookup has no Vortex equivalent, so one unconvertible conjunct turned the whole filter into a constant true and its bounds were lost. Convert each conjunct alone and keep the ones that convert.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A join's dynamic filter bounds its probe keys with key >= min AND key <= max. Each
comparison decoded the key column again, and the scan's between rewrite only ran on
static filters, so the bounds now merge into one between when the filter is read.

TPC-DS SF10, 10 join queries against the previous commit: geomean 0.972, Q69 and Q10
0.93, none slower than 1.007.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A scan of at most one filtered chunk evaluates its conjuncts on that chunk next, so
pruning its zones first saves little and delays the chunk, and pruning a dynamic conjunct
proves its current predicate over the zones again. DataFusion splits small join probes into
many such scans. Larger scans keep pruning their dynamic conjuncts: skipping it for every
scan made TPC-DS SF10 Q82 and Q37 3.4-3.7x slower.

TPC-DS, all 99 queries against the previous commit: SF1 geomean 0.97, SF10 0.99 on best
runs and 1.01 on medians; the SF10 outliers were flat when rerun.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…es change

A dynamic conjunct whose bound never prunes still costs a zone-pruning pass
before each scan and an evaluation per chunk. With
`ScanBuilder::with_skip_unselective_dynamic`, a conjunct containing dynamic
expressions that kept at least 99% of its input rows on four consecutive
chunks at one dynamic version is switched off: its zone pruning and its
evaluation are skipped until its dynamic values change.

The scan can then return rows the conjunct would reject, so this is opt-in.
Only the DataFusion persistent opener enables it, because DataFusion's TopK
and hash-join dynamic filters are pushed down inexactly and the producing
operator applies them again. DuckDB and other V2 scans are unchanged. Cached
filter plans are reused only by scans with the same setting.

`find_between` only merges comparisons against literals, so a switched-off
conjunct never carries a static restriction with it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBZYz5ae2yLro3TPmH
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A chunk announced the reads of every conjunct before evaluating any, so a
switched-off conjunct still had its column fetched. The scan test now checks
that a switched-off scan reads no more than an unfiltered one, and tightens
the bound enough that the conjunct stays switched on.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBZYz5ae2yLro3TPmH
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6dea363 vortex-queries 1 Explore Profiling Data
🟢 Done 6dea363 compress-bench 1 Explore Profiling Data
🟢 Done 6dea363 statpopgen 1 Explore Profiling Data
🟢 Done 6dea363 string-bench 1 Explore Profiling Data
🟢 Done 6dea363 random-access-bench 1 Explore Profiling Data
🟢 Done 6dea363 clickbench-nvme 1 Explore Profiling Data
🟢 Done 6dea363 tpch-nvme 1 Explore Profiling Data
🟢 Done 6dea363 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 6dea363 fineweb-s3 1 Explore Profiling Data
🟢 Done 6dea363 tpch-s3-10 1 Explore Profiling Data
🟢 Done 6dea363 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6dea363 job-nvme 1 Explore Profiling Data
🟢 Done 6dea363 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 6dea363 fineweb 1 Explore Profiling Data
🟢 Done 6dea363 appian-nvme 1 Explore Profiling Data
🟢 Done 6dea363 polarsignals 1 Explore Profiling Data
🟢 Done 6dea363 tpch-s3 1 Explore Profiling Data
🟢 Done 6dea363 tpcds-nvme 1 Explore Profiling Data
Previous Runs (17)
Status Commit Job Attempt Link
🟢 Done de56ec0 clickbench-nvme 1 Explore Profiling Data
🟢 Done de56ec0 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done de56ec0 tpch-nvme-10 1 Explore Profiling Data
🟢 Done de56ec0 polarsignals 1 Explore Profiling Data
🟢 Done de56ec0 fineweb 1 Explore Profiling Data
🟢 Done de56ec0 tpch-s3 1 Explore Profiling Data
🟢 Done de56ec0 tpch-nvme 1 Explore Profiling Data
🟢 Done de56ec0 tpcds-nvme 1 Explore Profiling Data
🟢 Done 13c5493 clickbench-nvme 2 Explore Profiling Data
🟢 Done 13c5493 tpch-s3 2 Explore Profiling Data
🟢 Done 13c5493 tpcds-nvme 2 Explore Profiling Data
🟢 Done 13c5493 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 13c5493 polarsignals 1 Explore Profiling Data
🟢 Done 13c5493 fineweb 1 Explore Profiling Data
🟢 Done 13c5493 tpch-nvme 1 Explore Profiling Data
🟢 Done 13c5493 tpch-s3 1 Explore Profiling Data
🟢 Done 13c5493 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR de56ec05 vs base 5605eab0
Vortex (geomean): hot 1.057x ➖ · cold 1.010x ➖


datafusion / vortex-file-compressed / ns (1.057x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44133214 / 44050590 / +0.2% 82261281 / 84417559 / -2.6% 0.54 / 0.52 / +2.8%
polarsignals_q01/datafusion:vortex-file-compressed 52562632 / 52883242 / -0.6% 107652609 / 104164252 / +3.3% 0.49 / 0.51 / -3.8%
polarsignals_q02/datafusion:vortex-file-compressed 16359966 / 12138620 / +34.8% 🔴 44515344 / 44471164 / +0.1% 0.37 / 0.27 / +34.6%
polarsignals_q03/datafusion:vortex-file-compressed 70093924 / 54339533 / +29.0% 🔴 110966549 / 109071796 / +1.7% 0.63 / 0.50 / +26.8%
polarsignals_q04/datafusion:vortex-file-compressed 9297706 / 9296832 / +0.0% 35907961 / 35854994 / +0.1% 0.26 / 0.26 / -0.1%
polarsignals_q05/datafusion:vortex-file-compressed 11628879 / 11640963 / -0.1% 41960147 / 40144875 / +4.5% 0.28 / 0.29 / -4.4%
polarsignals_q06/datafusion:vortex-file-compressed 22992044 / 22790831 / +0.9% 51268014 / 53670794 / -4.5% 0.45 / 0.42 / +5.6%
polarsignals_q07/datafusion:vortex-file-compressed 10887790 / 10842280 / +0.4% 39051493 / 37239656 / +4.9% 0.28 / 0.29 / -4.2%
polarsignals_q08/datafusion:vortex-file-compressed 96941896 / 97900538 / -1.0% 154477656 / 152544792 / +1.3% 0.63 / 0.64 / -2.2%
polarsignals_q09/datafusion:vortex-file-compressed 10151288 / 10138722 / +0.1% 36231810 / 35696137 / +1.5% 0.28 / 0.28 / -1.4%

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR de56ec05 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+5.3%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.032x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.998x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.050x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6144914 / 6043123 / +1.7% 21915627 / 21071119 / +4.0% 0.28 / 0.29 / -2.2%
fineweb_q01/datafusion:vortex-file-compressed 9776650 / 9586660 / +2.0% 39196423 / 37634276 / +4.2% 0.25 / 0.25 / -2.1%
fineweb_q02/datafusion:vortex-file-compressed 11192998 / 12277809 / -8.8% 43783962 / 38750264 / +13.0% 🔴 0.26 / 0.32 / -19.3%
fineweb_q03/datafusion:vortex-file-compressed 17847870 / 18463236 / -3.3% 105545753 / 111296411 / -5.2% 0.17 / 0.17 / +1.9%
fineweb_q04/datafusion:vortex-file-compressed 65090170 / 65043954 / +0.1% 144051923 / 146286112 / -1.5% 0.45 / 0.44 / +1.6%
fineweb_q05/datafusion:vortex-file-compressed 61188404 / 61601845 / -0.7% 142789040 / 135795552 / +5.2% 0.43 / 0.45 / -5.5%
fineweb_q06/datafusion:vortex-file-compressed 17625110 / 17572726 / +0.3% 106329436 / 105229866 / +1.0% 0.17 / 0.17 / -0.7%
fineweb_q07/datafusion:vortex-file-compressed 17659448 / 18453620 / -4.3% 107169299 / 106038575 / +1.1% 0.16 / 0.17 / -5.3%
fineweb_q08/datafusion:vortex-file-compressed 12695640 / 7116254 / +78.4% 🔴 26131764 / 30111637 / -13.2% 🟢 0.49 / 0.24 / +105.6%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9455601 / 9452966 / +0.0% 36951158 / 30679561 / +20.4% 🔴 0.26 / 0.31 / -16.9%
fineweb_q01/datafusion:parquet 74811062 / 74916052 / -0.1% 151890803 / 152078727 / -0.1% 0.49 / 0.49 / -0.0%
fineweb_q02/datafusion:parquet 76453738 / 75977840 / +0.6% 153077801 / 160422362 / -4.6% 0.50 / 0.47 / +5.5%
fineweb_q03/datafusion:parquet 73837147 / 73102312 / +1.0% 157266275 / 155325037 / +1.2% 0.47 / 0.47 / -0.2%
fineweb_q04/datafusion:parquet 82787464 / 81928140 / +1.0% 153122316 / 158987890 / -3.7% 0.54 / 0.52 / +4.9%
fineweb_q05/datafusion:parquet 80041048 / 80563007 / -0.6% 140971583 / 153213497 / -8.0% 0.57 / 0.53 / +8.0%
fineweb_q06/datafusion:parquet 74235488 / 76156013 / -2.5% 159209769 / 159982512 / -0.5% 0.47 / 0.48 / -2.0%
fineweb_q07/datafusion:parquet 73522350 / 72960314 / +0.8% 144239640 / 157349595 / -8.3% 0.51 / 0.46 / +9.9%
fineweb_q08/datafusion:parquet 72352738 / 73899872 / -2.1% 153647542 / 151674609 / +1.3% 0.47 / 0.49 / -3.4%
duckdb / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2065103 / 2102804 / -1.8% 7278574 / 8209453 / -11.3% 🟢 0.28 / 0.26 / +10.8%
fineweb_q01/duckdb:vortex-file-compressed 7783518 / 7670017 / +1.5% 26826418 / 25330993 / +5.9% 0.29 / 0.30 / -4.2%
fineweb_q02/duckdb:vortex-file-compressed 9500006 / 9608619 / -1.1% 29132350 / 30263937 / -3.7% 0.33 / 0.32 / +2.7%
fineweb_q03/duckdb:vortex-file-compressed 18921540 / 18697950 / +1.2% 98073960 / 92864174 / +5.6% 0.19 / 0.20 / -4.2%
fineweb_q04/duckdb:vortex-file-compressed 65223188 / 65151094 / +0.1% 112510417 / 106250583 / +5.9% 0.58 / 0.61 / -5.5%
fineweb_q05/duckdb:vortex-file-compressed 66464794 / 64626530 / +2.8% 109794688 / 104190408 / +5.4% 0.61 / 0.62 / -2.4%
fineweb_q06/duckdb:vortex-file-compressed 18328344 / 18132843 / +1.1% 99496934 / 92385184 / +7.7% 0.18 / 0.20 / -6.1%
fineweb_q07/duckdb:vortex-file-compressed 18233112 / 17449204 / +4.5% 97635896 / 91523664 / +6.7% 0.19 / 0.19 / -2.0%
fineweb_q08/duckdb:vortex-file-compressed 4869385 / 4667326 / +4.3% 12470334 / 13107207 / -4.9% 0.39 / 0.36 / +9.7%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22841974 / 23122729 / -1.2% 27643536 / 27993497 / -1.3% 0.83 / 0.83 / +0.0%
fineweb_q01/duckdb:parquet 53959863 / 54168991 / -0.4% 72930867 / 72384558 / +0.8% 0.74 / 0.75 / -1.1%
fineweb_q02/duckdb:parquet 57834620 / 57482670 / +0.6% 76483036 / 73752167 / +3.7% 0.76 / 0.78 / -3.0%
fineweb_q03/duckdb:parquet 118400226 / 119568795 / -1.0% 176242300 / 181426742 / -2.9% 0.67 / 0.66 / +1.9%
fineweb_q04/duckdb:parquet 161319496 / 159432394 / +1.2% 204121417 / 206027780 / -0.9% 0.79 / 0.77 / +2.1%
fineweb_q05/duckdb:parquet 158934130 / 155862710 / +2.0% 196473162 / 197647448 / -0.6% 0.81 / 0.79 / +2.6%
fineweb_q06/duckdb:parquet 87308924 / 86697084 / +0.7% 146996742 / 142327422 / +3.3% 0.59 / 0.61 / -2.5%
fineweb_q07/duckdb:parquet 92148509 / 89781687 / +2.6% 143687088 / 145535610 / -1.3% 0.64 / 0.62 / +4.0%
fineweb_q08/duckdb:parquet 28154886 / 28565923 / -1.4% 29557434 / 29454567 / +0.3% 0.95 / 0.97 / -1.8%

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR de56ec05 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.011x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.023x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16015590 / 15994567 / +0.1% 41237234 / 41445036 / -0.5% 0.39 / 0.39 / +0.6%
tpch_q02/datafusion:vortex-file-compressed 18374440 / 16833861 / +9.2% 38611706 / 34617599 / +11.5% 🔴 0.48 / 0.49 / -2.1%
tpch_q03/datafusion:vortex-file-compressed 19786660 / 19585680 / +1.0% 46195163 / 44777476 / +3.2% 0.43 / 0.44 / -2.1%
tpch_q04/datafusion:vortex-file-compressed 12385052 / 11734685 / +5.5% 35398723 / 34987252 / +1.2% 0.35 / 0.34 / +4.3%
tpch_q05/datafusion:vortex-file-compressed 37688515 / 37064232 / +1.7% 67697490 / 66824778 / +1.3% 0.56 / 0.55 / +0.4%
tpch_q06/datafusion:vortex-file-compressed 7517333 / 7320712 / +2.7% 27978060 / 28589041 / -2.1% 0.27 / 0.26 / +4.9%
tpch_q07/datafusion:vortex-file-compressed 53029753 / 51405430 / +3.2% 81927016 / 78972307 / +3.7% 0.65 / 0.65 / -0.6%
tpch_q08/datafusion:vortex-file-compressed 51402043 / 51642712 / -0.5% 82914640 / 76549731 / +8.3% 0.62 / 0.67 / -8.1%
tpch_q09/datafusion:vortex-file-compressed 48047318 / 47624437 / +0.9% 78878402 / 79193336 / -0.4% 0.61 / 0.60 / +1.3%
tpch_q10/datafusion:vortex-file-compressed 18804616 / 17296341 / +8.7% 47642598 / 48697457 / -2.2% 0.39 / 0.36 / +11.1%
tpch_q11/datafusion:vortex-file-compressed 14700347 / 14251262 / +3.2% 35100096 / 32790953 / +7.0% 0.42 / 0.43 / -3.6%
tpch_q12/datafusion:vortex-file-compressed 18642616 / 18485486 / +0.9% 46085420 / 41928506 / +9.9% 0.40 / 0.44 / -8.2%
tpch_q13/datafusion:vortex-file-compressed 19110037 / 19764968 / -3.3% 39268005 / 37796263 / +3.9% 0.49 / 0.52 / -6.9%
tpch_q14/datafusion:vortex-file-compressed 14311418 / 14615763 / -2.1% 37296411 / 37608208 / -0.8% 0.38 / 0.39 / -1.3%
tpch_q15/datafusion:vortex-file-compressed 18684172 / 18736331 / -0.3% 43655219 / 43822056 / -0.4% 0.43 / 0.43 / +0.1%
tpch_q16/datafusion:vortex-file-compressed 18732171 / 18453159 / +1.5% 39367312 / 37790274 / +4.2% 0.48 / 0.49 / -2.6%
tpch_q17/datafusion:vortex-file-compressed 29533843 / 28879639 / +2.3% 57732071 / 62563885 / -7.7% 0.51 / 0.46 / +10.8%
tpch_q18/datafusion:vortex-file-compressed 36921555 / 35901139 / +2.8% 59985805 / 57812434 / +3.8% 0.62 / 0.62 / -0.9%
tpch_q19/datafusion:vortex-file-compressed 14761111 / 12789775 / +15.4% 🔴 38590449 / 37254188 / +3.6% 0.38 / 0.34 / +11.4%
tpch_q20/datafusion:vortex-file-compressed 21587740 / 20441092 / +5.6% 47027774 / 43910991 / +7.1% 0.46 / 0.47 / -1.4%
tpch_q21/datafusion:vortex-file-compressed 36147474 / 39272940 / -8.0% 63381436 / 70074617 / -9.6% 0.57 / 0.56 / +1.8%
tpch_q22/datafusion:vortex-file-compressed 11077448 / 10770593 / +2.8% 30883084 / 29698026 / +4.0% 0.36 / 0.36 / -1.1%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71929992 / 71972188 / -0.1% 86617911 / 87720494 / -1.3% 0.83 / 0.82 / +1.2%
tpch_q02/datafusion:parquet 75719216 / 76223884 / -0.7% 92526665 / 93262934 / -0.8% 0.82 / 0.82 / +0.1%
tpch_q03/datafusion:parquet 81810733 / 81858158 / -0.1% 101753795 / 101626750 / +0.1% 0.80 / 0.81 / -0.2%
tpch_q04/datafusion:parquet 39349026 / 39483317 / -0.3% 57228208 / 57344027 / -0.2% 0.69 / 0.69 / -0.1%
tpch_q05/datafusion:parquet 109896433 / 110199490 / -0.3% 133666887 / 136730164 / -2.2% 0.82 / 0.81 / +2.0%
tpch_q06/datafusion:parquet 31530722 / 31466995 / +0.2% 47213533 / 47112822 / +0.2% 0.67 / 0.67 / -0.0%
tpch_q07/datafusion:parquet 113314992 / 113146826 / +0.1% 138650361 / 139072187 / -0.3% 0.82 / 0.81 / +0.5%
tpch_q08/datafusion:parquet 117394661 / 116685560 / +0.6% 143335710 / 142215641 / +0.8% 0.82 / 0.82 / -0.2%
tpch_q09/datafusion:parquet 138098190 / 138027657 / +0.1% 167076518 / 166290356 / +0.5% 0.83 / 0.83 / -0.4%
tpch_q10/datafusion:parquet 103642864 / 104366007 / -0.7% 125738243 / 124444035 / +1.0% 0.82 / 0.84 / -1.7%
tpch_q11/datafusion:parquet 61771647 / 63017802 / -2.0% 82206567 / 82187845 / +0.0% 0.75 / 0.77 / -2.0%
tpch_q12/datafusion:parquet 63748811 / 63914319 / -0.3% 84829306 / 84300317 / +0.6% 0.75 / 0.76 / -0.9%
tpch_q13/datafusion:parquet 143680117 / 144273410 / -0.4% 161857553 / 161641136 / +0.1% 0.89 / 0.89 / -0.5%
tpch_q14/datafusion:parquet 47270177 / 46958890 / +0.7% 69855360 / 68782244 / +1.6% 0.68 / 0.68 / -0.9%
tpch_q15/datafusion:parquet 74625783 / 74305827 / +0.4% 93693321 / 92605886 / +1.2% 0.80 / 0.80 / -0.7%
tpch_q16/datafusion:parquet 43622224 / 43249724 / +0.9% 61020300 / 60051918 / +1.6% 0.71 / 0.72 / -0.7%
tpch_q17/datafusion:parquet 122961039 / 123270205 / -0.3% 143326688 / 141611255 / +1.2% 0.86 / 0.87 / -1.4%
tpch_q18/datafusion:parquet 121346207 / 121099858 / +0.2% 142308068 / 140746527 / +1.1% 0.85 / 0.86 / -0.9%
tpch_q19/datafusion:parquet 56654066 / 57621263 / -1.7% 81919340 / 81204500 / +0.9% 0.69 / 0.71 / -2.5%
tpch_q20/datafusion:parquet 78120689 / 77891552 / +0.3% 100087179 / 98240990 / +1.9% 0.78 / 0.79 / -1.6%
tpch_q21/datafusion:parquet 113569896 / 113965774 / -0.3% 138060799 / 139301098 / -0.9% 0.82 / 0.82 / +0.5%
tpch_q22/datafusion:parquet 51705040 / 51811100 / -0.2% 67260683 / 66878560 / +0.6% 0.77 / 0.77 / -0.8%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9442729 / 9952166 / -5.1% 18197390 / 19147102 / -5.0% 0.52 / 0.52 / -0.2%
tpch_q02/duckdb:vortex-file-compressed 15268049 / 15459358 / -1.2% 24990629 / 25158677 / -0.7% 0.61 / 0.61 / -0.6%
tpch_q03/duckdb:vortex-file-compressed 18792313 / 18891492 / -0.5% 35290038 / 36324770 / -2.8% 0.53 / 0.52 / +2.4%
tpch_q04/duckdb:vortex-file-compressed 12544260 / 12352571 / +1.6% 26619216 / 26796268 / -0.7% 0.47 / 0.46 / +2.2%
tpch_q05/duckdb:vortex-file-compressed 20294327 / 20557286 / -1.3% 36371883 / 35972347 / +1.1% 0.56 / 0.57 / -2.4%
tpch_q06/duckdb:vortex-file-compressed 4666528 / 4746716 / -1.7% 13296070 / 13800633 / -3.7% 0.35 / 0.34 / +2.0%
tpch_q07/duckdb:vortex-file-compressed 24320810 / 24312492 / +0.0% 40400502 / 41690188 / -3.1% 0.60 / 0.58 / +3.2%
tpch_q08/duckdb:vortex-file-compressed 21238108 / 21251037 / -0.1% 36688944 / 36991371 / -0.8% 0.58 / 0.57 / +0.8%
tpch_q09/duckdb:vortex-file-compressed 22564987 / 22347028 / +1.0% 39282453 / 36877150 / +6.5% 0.57 / 0.61 / -5.2%
tpch_q10/duckdb:vortex-file-compressed 27105821 / 27107467 / -0.0% 43966512 / 44092898 / -0.3% 0.62 / 0.61 / +0.3%
tpch_q11/duckdb:vortex-file-compressed 8363855 / 8208688 / +1.9% 17385735 / 16953876 / +2.5% 0.48 / 0.48 / -0.6%
tpch_q12/duckdb:vortex-file-compressed 14837153 / 14767329 / +0.5% 25988551 / 26230146 / -0.9% 0.57 / 0.56 / +1.4%
tpch_q13/duckdb:vortex-file-compressed 19526257 / 19884313 / -1.8% 31543418 / 31353273 / +0.6% 0.62 / 0.63 / -2.4%
tpch_q14/duckdb:vortex-file-compressed 11308035 / 11366454 / -0.5% 24575748 / 23133900 / +6.2% 0.46 / 0.49 / -6.4%
tpch_q15/duckdb:vortex-file-compressed 8553149 / 8660161 / -1.2% 20585456 / 19921540 / +3.3% 0.42 / 0.43 / -4.4%
tpch_q16/duckdb:vortex-file-compressed 16618587 / 16691696 / -0.4% 23595287 / 23663766 / -0.3% 0.70 / 0.71 / -0.1%
tpch_q17/duckdb:vortex-file-compressed 12594943 / 12691521 / -0.8% 27942439 / 27920622 / +0.1% 0.45 / 0.45 / -0.8%
tpch_q18/duckdb:vortex-file-compressed 24187399 / 24590044 / -1.6% 34303818 / 33664865 / +1.9% 0.71 / 0.73 / -3.5%
tpch_q19/duckdb:vortex-file-compressed 12087835 / 12035221 / +0.4% 25356090 / 25904473 / -2.1% 0.48 / 0.46 / +2.6%
tpch_q20/duckdb:vortex-file-compressed 14281019 / 14549565 / -1.8% 30236321 / 30926383 / -2.2% 0.47 / 0.47 / +0.4%
tpch_q21/duckdb:vortex-file-compressed 49321583 / 49310786 / +0.0% 65540637 / 63211186 / +3.7% 0.75 / 0.78 / -3.5%
tpch_q22/duckdb:vortex-file-compressed 16751109 / 17086979 / -2.0% 26445163 / 26089607 / +1.4% 0.63 / 0.65 / -3.3%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47751740 / 47627830 / +0.3% 53783633 / 53852710 / -0.1% 0.89 / 0.88 / +0.4%
tpch_q02/duckdb:parquet 48394410 / 48331324 / +0.1% 55288749 / 55181260 / +0.2% 0.88 / 0.88 / -0.1%
tpch_q03/duckdb:parquet 60102950 / 60231292 / -0.2% 67722691 / 67088535 / +0.9% 0.89 / 0.90 / -1.1%
tpch_q04/duckdb:parquet 34749379 / 34771017 / -0.1% 42825642 / 43018440 / -0.4% 0.81 / 0.81 / +0.4%
tpch_q05/duckdb:parquet 67346932 / 67212284 / +0.2% 77566045 / 76417215 / +1.5% 0.87 / 0.88 / -1.3%
tpch_q06/duckdb:parquet 21650944 / 21577070 / +0.3% 26713503 / 27369272 / -2.4% 0.81 / 0.79 / +2.8%
tpch_q07/duckdb:parquet 64051186 / 63508964 / +0.9% 73135908 / 72734031 / +0.6% 0.88 / 0.87 / +0.3%
tpch_q08/duckdb:parquet 75720569 / 75652448 / +0.1% 86123444 / 86285534 / -0.2% 0.88 / 0.88 / +0.3%
tpch_q09/duckdb:parquet 108047801 / 107867572 / +0.2% 119253943 / 118954648 / +0.3% 0.91 / 0.91 / -0.1%
tpch_q10/duckdb:parquet 105796618 / 105874973 / -0.1% 117437892 / 116297807 / +1.0% 0.90 / 0.91 / -1.0%
tpch_q11/duckdb:parquet 29494090 / 29447559 / +0.2% 34744992 / 35016142 / -0.8% 0.85 / 0.84 / +0.9%
tpch_q12/duckdb:parquet 37360715 / 37219679 / +0.4% 43853805 / 43793262 / +0.1% 0.85 / 0.85 / +0.2%
tpch_q13/duckdb:parquet 175124954 / 175339795 / -0.1% 182498945 / 182305114 / +0.1% 0.96 / 0.96 / -0.2%
tpch_q14/duckdb:parquet 42420815 / 42369021 / +0.1% 50839046 / 51464834 / -1.2% 0.83 / 0.82 / +1.4%
tpch_q15/duckdb:parquet 32678779 / 32618878 / +0.2% 41232742 / 41034880 / +0.5% 0.79 / 0.79 / -0.3%
tpch_q16/duckdb:parquet 47576079 / 47382522 / +0.4% 53351534 / 52537427 / +1.5% 0.89 / 0.90 / -1.1%
tpch_q17/duckdb:parquet 48032283 / 47928338 / +0.2% 57396910 / 56872877 / +0.9% 0.84 / 0.84 / -0.7%
tpch_q18/duckdb:parquet 74377749 / 74611616 / -0.3% 80847390 / 81054453 / -0.3% 0.92 / 0.92 / -0.1%
tpch_q19/duckdb:parquet 48720941 / 48523781 / +0.4% 53947692 / 55858579 / -3.4% 0.90 / 0.87 / +4.0%
tpch_q20/duckdb:parquet 63651576 / 63438947 / +0.3% 72776796 / 73082362 / -0.4% 0.87 / 0.87 / +0.8%
tpch_q21/duckdb:parquet 107182443 / 106600815 / +0.5% 115998689 / 115462966 / +0.5% 0.92 / 0.92 / +0.1%
tpch_q22/duckdb:parquet 50651774 / 50648228 / +0.0% 58696717 / 58060315 / +1.1% 0.86 / 0.87 / -1.1%

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR de56ec05 vs base db0c25fb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (-3.5%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.984x ➖ · cold 1.014x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.959x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1269159 / 1268108 / +0.1% 22861693 / 22389581 / +2.1% 0.06 / 0.06 / -2.0%
clickbench_q01/datafusion:vortex-file-compressed 5852595 / 6231266 / -6.1% 29807638 / 32788050 / -9.1% 0.20 / 0.19 / +3.3%
clickbench_q02/datafusion:vortex-file-compressed 11322066 / 11149444 / +1.5% 45630082 / 45900616 / -0.6% 0.25 / 0.24 / +2.2%
clickbench_q03/datafusion:vortex-file-compressed 12622188 / 12953137 / -2.6% 56227371 / 53460698 / +5.2% 0.22 / 0.24 / -7.3%
clickbench_q04/datafusion:vortex-file-compressed 58400490 / 58503955 / -0.2% 103237966 / 102070314 / +1.1% 0.57 / 0.57 / -1.3%
clickbench_q05/datafusion:vortex-file-compressed 77470776 / 80178720 / -3.4% 126085156 / 127065392 / -0.8% 0.61 / 0.63 / -2.6%
clickbench_q06/datafusion:vortex-file-compressed 1228594 / 1288962 / -4.7% 22700630 / 22319455 / +1.7% 0.05 / 0.06 / -6.3%
clickbench_q07/datafusion:vortex-file-compressed 8994736 / 9274674 / -3.0% 34483126 / 33759231 / +2.1% 0.26 / 0.27 / -5.1%
clickbench_q08/datafusion:vortex-file-compressed 81934257 / 78122885 / +4.9% 126938588 / 123031021 / +3.2% 0.65 / 0.63 / +1.7%
clickbench_q09/datafusion:vortex-file-compressed 171182144 / 168016907 / +1.9% 215411501 / 215779931 / -0.2% 0.79 / 0.78 / +2.1%
clickbench_q10/datafusion:vortex-file-compressed 22688968 / 24231288 / -6.4% 69786977 / 67424597 / +3.5% 0.33 / 0.36 / -9.5%
clickbench_q11/datafusion:vortex-file-compressed 25386121 / 26352060 / -3.7% 71667609 / 67199101 / +6.6% 0.35 / 0.39 / -9.7%
clickbench_q12/datafusion:vortex-file-compressed 73360584 / 72328526 / +1.4% 126758868 / 125281426 / +1.2% 0.58 / 0.58 / +0.2%
clickbench_q13/datafusion:vortex-file-compressed 115998244 / 117501688 / -1.3% 182137523 / 183546547 / -0.8% 0.64 / 0.64 / -0.5%
clickbench_q14/datafusion:vortex-file-compressed 75232993 / 75085096 / +0.2% 125131154 / 126148983 / -0.8% 0.60 / 0.60 / +1.0%
clickbench_q15/datafusion:vortex-file-compressed 62710506 / 65859968 / -4.8% 104004606 / 99733822 / +4.3% 0.60 / 0.66 / -8.7%
clickbench_q16/datafusion:vortex-file-compressed 153572492 / 153307976 / +0.2% 215463108 / 215739705 / -0.1% 0.71 / 0.71 / +0.3%
clickbench_q17/datafusion:vortex-file-compressed 153328816 / 153471953 / -0.1% 222787867 / 222842092 / -0.0% 0.69 / 0.69 / -0.1%
clickbench_q18/datafusion:vortex-file-compressed 295464149 / 298651665 / -1.1% 383525631 / 380054604 / +0.9% 0.77 / 0.79 / -2.0%
clickbench_q19/datafusion:vortex-file-compressed 8180434 / 8622082 / -5.1% 45022885 / 43733673 / +2.9% 0.18 / 0.20 / -7.8%
clickbench_q20/datafusion:vortex-file-compressed 67863952 / 71415750 / -5.0% 250388774 / 248227261 / +0.9% 0.27 / 0.29 / -5.8%
clickbench_q21/datafusion:vortex-file-compressed 78892030 / 82238726 / -4.1% 292813285 / 288776632 / +1.4% 0.27 / 0.28 / -5.4%
clickbench_q22/datafusion:vortex-file-compressed 92597496 / 91198397 / +1.5% 403213818 / 400785843 / +0.6% 0.23 / 0.23 / +0.9%
clickbench_q23/datafusion:vortex-file-compressed 87953088 / 205951268 / -57.3% 🟢 384378758 / 566230244 / -32.1% 🟢 0.23 / 0.36 / -37.1%
clickbench_q24/datafusion:vortex-file-compressed 9496795 / 15747902 / -39.7% 🟢 53614895 / 64857125 / -17.3% 🟢 0.18 / 0.24 / -27.0%
clickbench_q25/datafusion:vortex-file-compressed 19002738 / 19696702 / -3.5% 60582073 / 63436503 / -4.5% 0.31 / 0.31 / +1.0%
clickbench_q26/datafusion:vortex-file-compressed 16177982 / 15051091 / +7.5% 67326132 / 67774253 / -0.7% 0.24 / 0.22 / +8.2%
clickbench_q27/datafusion:vortex-file-compressed 101170247 / 102902929 / -1.7% 259972671 / 259760870 / +0.1% 0.39 / 0.40 / -1.8%
clickbench_q28/datafusion:vortex-file-compressed 563523696 / 558855746 / +0.8% 641366282 / 647464399 / -0.9% 0.88 / 0.86 / +1.8%
clickbench_q29/datafusion:vortex-file-compressed 24489402 / 24116892 / +1.5% 55122949 / 56450157 / -2.4% 0.44 / 0.43 / +4.0%
clickbench_q30/datafusion:vortex-file-compressed 55437655 / 55849426 / -0.7% 108674137 / 108062266 / +0.6% 0.51 / 0.52 / -1.3%
clickbench_q31/datafusion:vortex-file-compressed 67001174 / 66823808 / +0.3% 161407821 / 153090609 / +5.4% 0.42 / 0.44 / -4.9%
clickbench_q32/datafusion:vortex-file-compressed 285916962 / 293915221 / -2.7% 388811177 / 395329452 / -1.6% 0.74 / 0.74 / -1.1%
clickbench_q33/datafusion:vortex-file-compressed 324567433 / 323048524 / +0.5% 427064598 / 440902564 / -3.1% 0.76 / 0.73 / +3.7%
clickbench_q34/datafusion:vortex-file-compressed 324170070 / 327204298 / -0.9% 427417488 / 442606429 / -3.4% 0.76 / 0.74 / +2.6%
clickbench_q35/datafusion:vortex-file-compressed 56995118 / 58175352 / -2.0% 91603717 / 92038856 / -0.5% 0.62 / 0.63 / -1.6%
clickbench_q36/datafusion:vortex-file-compressed 38115164 / 38580758 / -1.2% 66512772 / 66439720 / +0.1% 0.57 / 0.58 / -1.3%
clickbench_q37/datafusion:vortex-file-compressed 21370686 / 21282382 / +0.4% 47195078 / 47198738 / -0.0% 0.45 / 0.45 / +0.4%
clickbench_q38/datafusion:vortex-file-compressed 13581482 / 13493422 / +0.7% 40784995 / 41232828 / -1.1% 0.33 / 0.33 / +1.8%
clickbench_q39/datafusion:vortex-file-compressed 78549790 / 79362768 / -1.0% 110394377 / 110094850 / +0.3% 0.71 / 0.72 / -1.3%
clickbench_q40/datafusion:vortex-file-compressed 10717166 / 10438739 / +2.7% 36255183 / 36662005 / -1.1% 0.30 / 0.28 / +3.8%
clickbench_q41/datafusion:vortex-file-compressed 10045722 / 10349684 / -2.9% 35557695 / 35043007 / +1.5% 0.28 / 0.30 / -4.3%
clickbench_q42/datafusion:vortex-file-compressed 10293044 / 10368618 / -0.7% 35297314 / 35409468 / -0.3% 0.29 / 0.29 / -0.4%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1259138 / 1261694 / -0.2% 50323317 / 49098457 / +2.5% 0.03 / 0.03 / -2.6%
clickbench_q01/datafusion:parquet 15830750 / 16093454 / -1.6% 66995437 / 66683559 / +0.5% 0.24 / 0.24 / -2.1%
clickbench_q02/datafusion:parquet 19105368 / 18984815 / +0.6% 80870102 / 80421181 / +0.6% 0.24 / 0.24 / +0.1%
clickbench_q03/datafusion:parquet 17514586 / 16871760 / +3.8% 76873088 / 81848327 / -6.1% 0.23 / 0.21 / +10.5%
clickbench_q04/datafusion:parquet 62991665 / 63511409 / -0.8% 126486228 / 126674277 / -0.1% 0.50 / 0.50 / -0.7%
clickbench_q05/datafusion:parquet 88539595 / 89669278 / -1.3% 154819804 / 155144424 / -0.2% 0.57 / 0.58 / -1.1%
clickbench_q06/datafusion:parquet 1267107 / 1277167 / -0.8% 50062127 / 49497338 / +1.1% 0.03 / 0.03 / -1.9%
clickbench_q07/datafusion:parquet 17002052 / 17277116 / -1.6% 66979550 / 67706583 / -1.1% 0.25 / 0.26 / -0.5%
clickbench_q08/datafusion:parquet 86973284 / 83262942 / +4.5% 156446241 / 160222093 / -2.4% 0.56 / 0.52 / +7.0%
clickbench_q09/datafusion:parquet 186251841 / 187189178 / -0.5% 263490534 / 261111911 / +0.9% 0.71 / 0.72 / -1.4%
clickbench_q10/datafusion:parquet 36258404 / 36519444 / -0.7% 98192169 / 101744832 / -3.5% 0.37 / 0.36 / +2.9%
clickbench_q11/datafusion:parquet 43454867 / 42971846 / +1.1% 109394263 / 107348760 / +1.9% 0.40 / 0.40 / -0.8%
clickbench_q12/datafusion:parquet 95875182 / 96302225 / -0.4% 159948109 / 162210040 / -1.4% 0.60 / 0.59 / +1.0%
clickbench_q13/datafusion:parquet 147140868 / 145462743 / +1.2% 226909822 / 223364063 / +1.6% 0.65 / 0.65 / -0.4%
clickbench_q14/datafusion:parquet 102070309 / 101829817 / +0.2% 170736967 / 170310920 / +0.3% 0.60 / 0.60 / -0.0%
clickbench_q15/datafusion:parquet 69671446 / 74288941 / -6.2% 130689034 / 132254302 / -1.2% 0.53 / 0.56 / -5.1%
clickbench_q16/datafusion:parquet 155259507 / 157331626 / -1.3% 230805770 / 237783868 / -2.9% 0.67 / 0.66 / +1.7%
clickbench_q17/datafusion:parquet 155633328 / 158268728 / -1.7% 235590658 / 238317611 / -1.1% 0.66 / 0.66 / -0.5%
clickbench_q18/datafusion:parquet 310898454 / 317107578 / -2.0% 422518686 / 426337840 / -0.9% 0.74 / 0.74 / -1.1%
clickbench_q19/datafusion:parquet 18123278 / 19021332 / -4.7% 69772180 / 72919982 / -4.3% 0.26 / 0.26 / -0.4%
clickbench_q20/datafusion:parquet 179625347 / 179167670 / +0.3% 275145923 / 275645132 / -0.2% 0.65 / 0.65 / +0.4%
clickbench_q21/datafusion:parquet 172654358 / 174230982 / -0.9% 292892333 / 291847910 / +0.4% 0.59 / 0.60 / -1.3%
clickbench_q22/datafusion:parquet 259942642 / 263755476 / -1.4% 418798950 / 412494939 / +1.5% 0.62 / 0.64 / -2.9%
clickbench_q23/datafusion:parquet 1004597083 / 1008313197 / -0.4% 1180659852 / 1177369452 / +0.3% 0.85 / 0.86 / -0.6%
clickbench_q24/datafusion:parquet 30113666 / 30518168 / -1.3% 88039283 / 87223781 / +0.9% 0.34 / 0.35 / -2.2%
clickbench_q25/datafusion:parquet 36874719 / 36475001 / +1.1% 99497182 / 98910983 / +0.6% 0.37 / 0.37 / +0.5%
clickbench_q26/datafusion:parquet 30510098 / 30398792 / +0.4% 87891484 / 88560316 / -0.8% 0.35 / 0.34 / +1.1%
clickbench_q27/datafusion:parquet 193423528 / 194089860 / -0.3% 286600525 / 286170090 / +0.2% 0.67 / 0.68 / -0.5%
clickbench_q28/datafusion:parquet 613194747 / 618026794 / -0.8% 692398655 / 696065825 / -0.5% 0.89 / 0.89 / -0.3%
clickbench_q29/datafusion:parquet 28565064 / 29091407 / -1.8% 88635994 / 92887887 / -4.6% 0.32 / 0.31 / +2.9%
clickbench_q30/datafusion:parquet 89381674 / 91660875 / -2.5% 166573228 / 169355466 / -1.6% 0.54 / 0.54 / -0.9%
clickbench_q31/datafusion:parquet 102568237 / 103271078 / -0.7% 188735729 / 190925823 / -1.1% 0.54 / 0.54 / +0.5%
clickbench_q32/datafusion:parquet 307465152 / 307700968 / -0.1% 426532276 / 427336751 / -0.2% 0.72 / 0.72 / +0.1%
clickbench_q33/datafusion:parquet 379670794 / 379272907 / +0.1% 474281990 / 472773715 / +0.3% 0.80 / 0.80 / -0.2%
clickbench_q34/datafusion:parquet 378939826 / 378893081 / +0.0% 476642380 / 480275893 / -0.8% 0.80 / 0.79 / +0.8%
clickbench_q35/datafusion:parquet 65335480 / 65726338 / -0.6% 125161918 / 122645414 / +2.1% 0.52 / 0.54 / -2.6%
clickbench_q36/datafusion:parquet 73932426 / 74253246 / -0.4% 137666388 / 134892172 / +2.1% 0.54 / 0.55 / -2.4%
clickbench_q37/datafusion:parquet 35484976 / 35624447 / -0.4% 92635848 / 92646715 / -0.0% 0.38 / 0.38 / -0.4%
clickbench_q38/datafusion:parquet 47708958 / 48190818 / -1.0% 107313571 / 107463593 / -0.1% 0.44 / 0.45 / -0.9%
clickbench_q39/datafusion:parquet 143225690 / 144038540 / -0.6% 207103638 / 207845025 / -0.4% 0.69 / 0.69 / -0.2%
clickbench_q40/datafusion:parquet 19915472 / 20037456 / -0.6% 77569228 / 76311577 / +1.6% 0.26 / 0.26 / -2.2%
clickbench_q41/datafusion:parquet 18618302 / 18733077 / -0.6% 75959494 / 77577167 / -2.1% 0.25 / 0.24 / +1.5%
clickbench_q42/datafusion:parquet 19168032 / 19200514 / -0.2% 76636390 / 75719183 / +1.2% 0.25 / 0.25 / -1.4%
duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2159703 / 2198510 / -1.8% 25418164 / 25467247 / -0.2% 0.08 / 0.09 / -1.6%
clickbench_q01/duckdb:vortex-file-compressed 7858696 / 8161210 / -3.7% 28625239 / 28850766 / -0.8% 0.27 / 0.28 / -2.9%
clickbench_q02/duckdb:vortex-file-compressed 9409758 / 9440508 / -0.3% 35517641 / 34416130 / +3.2% 0.26 / 0.27 / -3.4%
clickbench_q03/duckdb:vortex-file-compressed 13800432 / 13936937 / -1.0% 47316839 / 45878910 / +3.1% 0.29 / 0.30 / -4.0%
clickbench_q04/duckdb:vortex-file-compressed 58928908 / 56302084 / +4.7% 94353970 / 85348400 / +10.6% 🔴 0.62 / 0.66 / -5.3%
clickbench_q05/duckdb:vortex-file-compressed 64080580 / 64757848 / -1.0% 93950244 / 93116416 / +0.9% 0.68 / 0.70 / -1.9%
clickbench_q06/duckdb:vortex-file-compressed 2602164 / 2604754 / -0.1% 32977533 / 31791322 / +3.7% 0.08 / 0.08 / -3.7%
clickbench_q07/duckdb:vortex-file-compressed 9775632 / 10138670 / -3.6% 31336400 / 31305646 / +0.1% 0.31 / 0.32 / -3.7%
clickbench_q08/duckdb:vortex-file-compressed 68678482 / 70273744 / -2.3% 105406840 / 101723669 / +3.6% 0.65 / 0.69 / -5.7%
clickbench_q09/duckdb:vortex-file-compressed 93626042 / 95539762 / -2.0% 127966256 / 127007693 / +0.8% 0.73 / 0.75 / -2.7%
clickbench_q10/duckdb:vortex-file-compressed 27862077 / 28305612 / -1.6% 64628449 / 64597947 / +0.0% 0.43 / 0.44 / -1.6%
clickbench_q11/duckdb:vortex-file-compressed 30817976 / 30976318 / -0.5% 67622270 / 67173013 / +0.7% 0.46 / 0.46 / -1.2%
clickbench_q12/duckdb:vortex-file-compressed 70609360 / 70376041 / +0.3% 96963204 / 98996493 / -2.1% 0.73 / 0.71 / +2.4%
clickbench_q13/duckdb:vortex-file-compressed 125278566 / 124695302 / +0.5% 161834100 / 159201135 / +1.7% 0.77 / 0.78 / -1.2%
clickbench_q14/duckdb:vortex-file-compressed 74917061 / 74956709 / -0.1% 104335344 / 103319138 / +1.0% 0.72 / 0.73 / -1.0%
clickbench_q15/duckdb:vortex-file-compressed 76583989 / 76450819 / +0.2% 107765560 / 106488656 / +1.2% 0.71 / 0.72 / -1.0%
clickbench_q16/duckdb:vortex-file-compressed 134908677 / 137684478 / -2.0% 173073294 / 171628384 / +0.8% 0.78 / 0.80 / -2.8%
clickbench_q17/duckdb:vortex-file-compressed 141459764 / 138061250 / +2.5% 170196992 / 171762657 / -0.9% 0.83 / 0.80 / +3.4%
clickbench_q18/duckdb:vortex-file-compressed 256440832 / 257269782 / -0.3% 306150275 / 304692870 / +0.5% 0.84 / 0.84 / -0.8%
clickbench_q19/duckdb:vortex-file-compressed 9266668 / 9914724 / -6.5% 37408252 / 37277491 / +0.4% 0.25 / 0.27 / -6.9%
clickbench_q20/duckdb:vortex-file-compressed 67285986 / 67590612 / -0.5% 163430783 / 159512557 / +2.5% 0.41 / 0.42 / -2.8%
clickbench_q21/duckdb:vortex-file-compressed 85552414 / 86144794 / -0.7% 191921526 / 185906760 / +3.2% 0.45 / 0.46 / -3.8%
clickbench_q22/duckdb:vortex-file-compressed 173160928 / 174473566 / -0.8% 329402775 / 327302455 / +0.6% 0.53 / 0.53 / -1.4%
clickbench_q23/duckdb:vortex-file-compressed 53254344 / 40970418 / +30.0% 🔴 177607770 / 84570275 / +110.0% 🔴 0.30 / 0.48 / -38.1%
clickbench_q24/duckdb:vortex-file-compressed 17955106 / 14668094 / +22.4% 🔴 46096142 / 38736858 / +19.0% 🔴 0.39 / 0.38 / +2.9%
clickbench_q25/duckdb:vortex-file-compressed 19724956 / 19947520 / -1.1% 54227081 / 51925670 / +4.4% 0.36 / 0.38 / -5.3%
clickbench_q26/duckdb:vortex-file-compressed 15016631 / 11626853 / +29.2% 🔴 49754844 / 38122862 / +30.5% 🔴 0.30 / 0.30 / -1.0%
clickbench_q27/duckdb:vortex-file-compressed 53509380 / 54179986 / -1.2% 161941368 / 168016768 / -3.6% 0.33 / 0.32 / +2.5%
clickbench_q28/duckdb:vortex-file-compressed 504438386 / 511614837 / -1.4% 532083149 / 553176017 / -3.8% 0.95 / 0.92 / +2.5%
clickbench_q29/duckdb:vortex-file-compressed 17110772 / 17242355 / -0.8% 41964862 / 38737577 / +8.3% 0.41 / 0.45 / -8.4%
clickbench_q30/duckdb:vortex-file-compressed 60845754 / 60619807 / +0.4% 102393404 / 101421531 / +1.0% 0.59 / 0.60 / -0.6%
clickbench_q31/duckdb:vortex-file-compressed 111259958 / 112183392 / -0.8% 187068810 / 165654267 / +12.9% 🔴 0.59 / 0.68 / -12.2%
clickbench_q32/duckdb:vortex-file-compressed 373739626 / 376132445 / -0.6% 408987655 / 404926232 / +1.0% 0.91 / 0.93 / -1.6%
clickbench_q33/duckdb:vortex-file-compressed 347976967 / 343032052 / +1.4% 406438633 / 390228413 / +4.2% 0.86 / 0.88 / -2.6%
clickbench_q34/duckdb:vortex-file-compressed 357255660 / 358045252 / -0.2% 407496285 / 410789501 / -0.8% 0.88 / 0.87 / +0.6%
clickbench_q35/duckdb:vortex-file-compressed 57966420 / 56894928 / +1.9% 90594914 / 90388679 / +0.2% 0.64 / 0.63 / +1.7%
clickbench_q36/duckdb:vortex-file-compressed 11733696 / 11664972 / +0.6% 33307402 / 33715556 / -1.2% 0.35 / 0.35 / +1.8%
clickbench_q37/duckdb:vortex-file-compressed 8161094 / 8209139 / -0.6% 27464473 / 28119626 / -2.3% 0.30 / 0.29 / +1.8%
clickbench_q38/duckdb:vortex-file-compressed 8802575 / 9074023 / -3.0% 27561071 / 28733969 / -4.1% 0.32 / 0.32 / +1.1%
clickbench_q39/duckdb:vortex-file-compressed 18809582 / 18987166 / -0.9% 39412459 / 40902698 / -3.6% 0.48 / 0.46 / +2.8%
clickbench_q40/duckdb:vortex-file-compressed 7282895 / 7714132 / -5.6% 27485200 / 29035607 / -5.3% 0.26 / 0.27 / -0.3%
clickbench_q41/duckdb:vortex-file-compressed 8517594 / 8497034 / +0.2% 30337449 / 29513626 / +2.8% 0.28 / 0.29 / -2.5%
clickbench_q42/duckdb:vortex-file-compressed 7456842 / 7490966 / -0.5% 29392071 / 27020408 / +8.8% 0.25 / 0.28 / -8.5%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9234254 / 9273775 / -0.4% 14837166 / 14365156 / +3.3% 0.62 / 0.65 / -3.6%
clickbench_q01/duckdb:parquet 14795196 / 15285489 / -3.2% 21037891 / 20285426 / +3.7% 0.70 / 0.75 / -6.7%
clickbench_q02/duckdb:parquet 22351258 / 22275908 / +0.3% 31984495 / 30992030 / +3.2% 0.70 / 0.72 / -2.8%
clickbench_q03/duckdb:parquet 22555418 / 22639125 / -0.4% 37881316 / 34187236 / +10.8% 🔴 0.60 / 0.66 / -10.1%
clickbench_q04/duckdb:parquet 61682542 / 61393118 / +0.5% 74493636 / 75344253 / -1.1% 0.83 / 0.81 / +1.6%
clickbench_q05/duckdb:parquet 81807396 / 83587825 / -2.1% 97285477 / 99284701 / -2.0% 0.84 / 0.84 / -0.1%
clickbench_q06/duckdb:parquet 20470392 / 20522225 / -0.3% 28276271 / 28245609 / +0.1% 0.72 / 0.73 / -0.4%
clickbench_q07/duckdb:parquet 16938128 / 16622890 / +1.9% 25541719 / 22709668 / +12.5% 🔴 0.66 / 0.73 / -9.4%
clickbench_q08/duckdb:parquet 75300292 / 74367894 / +1.3% 90647694 / 89097527 / +1.7% 0.83 / 0.83 / -0.5%
clickbench_q09/duckdb:parquet 102642933 / 104477519 / -1.8% 117671484 / 119683275 / -1.7% 0.87 / 0.87 / -0.1%
clickbench_q10/duckdb:parquet 41197889 / 40915322 / +0.7% 56344180 / 57416967 / -1.9% 0.73 / 0.71 / +2.6%
clickbench_q11/duckdb:parquet 46155954 / 46486286 / -0.7% 62989459 / 61050195 / +3.2% 0.73 / 0.76 / -3.8%
clickbench_q12/duckdb:parquet 93477612 / 91718598 / +1.9% 106897330 / 104302465 / +2.5% 0.87 / 0.88 / -0.6%
clickbench_q13/duckdb:parquet 149998986 / 149625487 / +0.2% 167133013 / 167003628 / +0.1% 0.90 / 0.90 / +0.2%
clickbench_q14/duckdb:parquet 101074988 / 100391805 / +0.7% 119316576 / 116999386 / +2.0% 0.85 / 0.86 / -1.3%
clickbench_q15/duckdb:parquet 87650286 / 87036210 / +0.7% 101551365 / 101440655 / +0.1% 0.86 / 0.86 / +0.6%
clickbench_q16/duckdb:parquet 170311288 / 159350142 / +6.9% 180681522 / 175981562 / +2.7% 0.94 / 0.91 / +4.1%
clickbench_q17/duckdb:parquet 164933878 / 169449936 / -2.7% 179800780 / 180577696 / -0.4% 0.92 / 0.94 / -2.2%
clickbench_q18/duckdb:parquet 296818386 / 291496904 / +1.8% 321962122 / 317699786 / +1.3% 0.92 / 0.92 / +0.5%
clickbench_q19/duckdb:parquet 20060954 / 19519294 / +2.8% 26338785 / 26177633 / +0.6% 0.76 / 0.75 / +2.1%
clickbench_q20/duckdb:parquet 179074016 / 177984070 / +0.6% 230373362 / 226511557 / +1.7% 0.78 / 0.79 / -1.1%
clickbench_q21/duckdb:parquet 222033296 / 219021714 / +1.4% 267923631 / 261136583 / +2.6% 0.83 / 0.84 / -1.2%
clickbench_q22/duckdb:parquet 310645070 / 301824390 / +2.9% 358921392 / 347633634 / +3.2% 0.87 / 0.87 / -0.3%
clickbench_q23/duckdb:parquet 168731582 / 172103688 / -2.0% 245893394 / 242211339 / +1.5% 0.69 / 0.71 / -3.4%
clickbench_q24/duckdb:parquet 29723984 / 29389778 / +1.1% 43750392 / 41753677 / +4.8% 0.68 / 0.70 / -3.5%
clickbench_q25/duckdb:parquet 42691377 / 41168066 / +3.7% 59635262 / 56685121 / +5.2% 0.72 / 0.73 / -1.4%
clickbench_q26/duckdb:parquet 30167000 / 30267808 / -0.3% 44377155 / 43780777 / +1.4% 0.68 / 0.69 / -1.7%
clickbench_q27/duckdb:parquet 195593778 / 187197402 / +4.5% 226899684 / 223745902 / +1.4% 0.86 / 0.84 / +3.0%
clickbench_q28/duckdb:parquet 961335054 / 979991823 / -1.9% 974397070 / 937590811 / +3.9% 0.99 / 1.05 / -5.6%
clickbench_q29/duckdb:parquet 24181684 / 23950035 / +1.0% 30636919 / 30443920 / +0.6% 0.79 / 0.79 / +0.3%
clickbench_q30/duckdb:parquet 106134734 / 105369038 / +0.7% 125881891 / 125587332 / +0.2% 0.84 / 0.84 / +0.5%
clickbench_q31/duckdb:parquet 159095618 / 158458517 / +0.4% 172848079 / 171670721 / +0.7% 0.92 / 0.92 / -0.3%
clickbench_q32/duckdb:parquet 382445224 / 384125162 / -0.4% 404024959 / 414864467 / -2.6% 0.95 / 0.93 / +2.2%
clickbench_q33/duckdb:parquet 471350350 / 479052012 / -1.6% 466830325 / 437987858 / +6.6% 1.01 / 1.09 / -7.7%
clickbench_q34/duckdb:parquet 476560504 / 462048634 / +3.1% 457141324 / 457391208 / -0.1% 1.04 / 1.01 / +3.2%
clickbench_q35/duckdb:parquet 61418502 / 60560274 / +1.4% 76522055 / 74823058 / +2.3% 0.80 / 0.81 / -0.8%
clickbench_q36/duckdb:parquet 30052760 / 30063520 / -0.0% 35495007 / 35412948 / +0.2% 0.85 / 0.85 / -0.3%
clickbench_q37/duckdb:parquet 23307544 / 24144922 / -3.5% 29977722 / 29245322 / +2.5% 0.78 / 0.83 / -5.8%
clickbench_q38/duckdb:parquet 23896709 / 24196208 / -1.2% 29480868 / 29897762 / -1.4% 0.81 / 0.81 / +0.2%
clickbench_q39/duckdb:parquet 52545118 / 52899734 / -0.7% 59192163 / 59624901 / -0.7% 0.89 / 0.89 / +0.1%
clickbench_q40/duckdb:parquet 15041586 / 15235074 / -1.3% 19897802 / 20255641 / -1.8% 0.76 / 0.75 / +0.5%
clickbench_q41/duckdb:parquet 14726552 / 15761478 / -6.6% 20828732 / 19934729 / +4.5% 0.71 / 0.79 / -10.6%
clickbench_q42/duckdb:parquet 13843743 / 14241285 / -2.8% 20241371 / 20833060 / -2.8% 0.68 / 0.68 / +0.1%

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR de56ec05 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.4%
Engines: DataFusion No clear signal (+6.7%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.034x ➖ · cold 1.044x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.026x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.070x ➖, 2↑ 30↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21983994 / 21449955 / +2.5% 40533054 / 36890157 / +9.9% 0.54 / 0.58 / -6.7%
tpcds_q02/datafusion:vortex-file-compressed 42948776 / 44549928 / -3.6% 64387496 / 64446099 / -0.1% 0.67 / 0.69 / -3.5%
tpcds_q03/datafusion:vortex-file-compressed 12268816 / 11230196 / +9.2% 28796112 / 26695625 / +7.9% 0.43 / 0.42 / +1.3%
tpcds_q04/datafusion:vortex-file-compressed 83081086 / 87981826 / -5.6% 112033642 / 120965403 / -7.4% 0.74 / 0.73 / +2.0%
tpcds_q05/datafusion:vortex-file-compressed 58722602 / 57080629 / +2.9% 76443826 / 78711868 / -2.9% 0.77 / 0.73 / +5.9%
tpcds_q06/datafusion:vortex-file-compressed 22352631 / 22423310 / -0.3% 43234689 / 40885119 / +5.7% 0.52 / 0.55 / -5.7%
tpcds_q07/datafusion:vortex-file-compressed 26778382 / 29007938 / -7.7% 50186169 / 50787717 / -1.2% 0.53 / 0.57 / -6.6%
tpcds_q08/datafusion:vortex-file-compressed 27207231 / 24772320 / +9.8% 45877827 / 40820871 / +12.4% 🔴 0.59 / 0.61 / -2.3%
tpcds_q09/datafusion:vortex-file-compressed 23933852 / 21180404 / +13.0% 🔴 39197725 / 37120969 / +5.6% 0.61 / 0.57 / +7.0%
tpcds_q10/datafusion:vortex-file-compressed 35752278 / 27089952 / +32.0% 🔴 56046917 / 48150963 / +16.4% 🔴 0.64 / 0.56 / +13.4%
tpcds_q11/datafusion:vortex-file-compressed 50042189 / 52658580 / -5.0% 77788018 / 80704795 / -3.6% 0.64 / 0.65 / -1.4%
tpcds_q12/datafusion:vortex-file-compressed 15517105 / 14807784 / +4.8% 33422627 / 30699151 / +8.9% 0.46 / 0.48 / -3.7%
tpcds_q13/datafusion:vortex-file-compressed 31042298 / 30808226 / +0.8% 58261277 / 55251329 / +5.4% 0.53 / 0.56 / -4.4%
tpcds_q14/datafusion:vortex-file-compressed 490606095 / 488510962 / +0.4% 549534431 / 546367575 / +0.6% 0.89 / 0.89 / -0.1%
tpcds_q15/datafusion:vortex-file-compressed 15541890 / 12526037 / +24.1% 🔴 32527380 / 31001294 / +4.9% 0.48 / 0.40 / +18.3%
tpcds_q16/datafusion:vortex-file-compressed 23823672 / 18616530 / +28.0% 🔴 41471838 / 37364761 / +11.0% 🔴 0.57 / 0.50 / +15.3%
tpcds_q17/datafusion:vortex-file-compressed 54602452 / 54881384 / -0.5% 77054450 / 75360654 / +2.2% 0.71 / 0.73 / -2.7%
tpcds_q18/datafusion:vortex-file-compressed 64075324 / 63672050 / +0.6% 71502333 / 86896388 / -17.7% 🟢 0.90 / 0.73 / +22.3%
tpcds_q19/datafusion:vortex-file-compressed 17690522 / 16751722 / +5.6% 40331051 / 36242965 / +11.3% 🔴 0.44 / 0.46 / -5.1%
tpcds_q20/datafusion:vortex-file-compressed 17153868 / 16071738 / +6.7% 34059137 / 34810807 / -2.2% 0.50 / 0.46 / +9.1%
tpcds_q21/datafusion:vortex-file-compressed 15622504 / 16184408 / -3.5% 35299675 / 36023984 / -2.0% 0.44 / 0.45 / -1.5%
tpcds_q22/datafusion:vortex-file-compressed 49017858 / 49230964 / -0.4% 71844702 / 71170972 / +0.9% 0.68 / 0.69 / -1.4%
tpcds_q23/datafusion:vortex-file-compressed 73454722 / 70264458 / +4.5% 99531775 / 96167475 / +3.5% 0.74 / 0.73 / +1.0%
tpcds_q24/datafusion:vortex-file-compressed 64559576 / 65418735 / -1.3% 86433706 / 83701751 / +3.3% 0.75 / 0.78 / -4.4%
tpcds_q25/datafusion:vortex-file-compressed 46452990 / 44327608 / +4.8% 66237219 / 64380287 / +2.9% 0.70 / 0.69 / +1.9%
tpcds_q26/datafusion:vortex-file-compressed 25893282 / 25924224 / -0.1% 46608328 / 45251458 / +3.0% 0.56 / 0.57 / -3.0%
tpcds_q27/datafusion:vortex-file-compressed 55604820 / 59316172 / -6.3% 72083596 / 76338737 / -5.6% 0.77 / 0.78 / -0.7%
tpcds_q28/datafusion:vortex-file-compressed 24227288 / 24375547 / -0.6% 43859960 / 39449065 / +11.2% 🔴 0.55 / 0.62 / -10.6%
tpcds_q29/datafusion:vortex-file-compressed 52151456 / 50139198 / +4.0% 79399000 / 77352276 / +2.6% 0.66 / 0.65 / +1.3%
tpcds_q30/datafusion:vortex-file-compressed 28200613 / 26281199 / +7.3% 47673623 / 42073332 / +13.3% 🔴 0.59 / 0.62 / -5.3%
tpcds_q31/datafusion:vortex-file-compressed 65184392 / 58977292 / +10.5% 🔴 92120404 / 82607877 / +11.5% 🔴 0.71 / 0.71 / -0.9%
tpcds_q32/datafusion:vortex-file-compressed 15773462 / 12750964 / +23.7% 🔴 32525155 / 28412641 / +14.5% 🔴 0.48 / 0.45 / +8.1%
tpcds_q33/datafusion:vortex-file-compressed 30315937 / 28104111 / +7.9% 52655537 / 47044127 / +11.9% 🔴 0.58 / 0.60 / -3.6%
tpcds_q34/datafusion:vortex-file-compressed 22098455 / 17745730 / +24.5% 🔴 39459339 / 36597596 / +7.8% 0.56 / 0.48 / +15.5%
tpcds_q35/datafusion:vortex-file-compressed 33083694 / 30280252 / +9.3% 56671418 / 52331800 / +8.3% 0.58 / 0.58 / +0.9%
tpcds_q36/datafusion:vortex-file-compressed 49380814 / 47413233 / +4.1% 69777564 / 69088114 / +1.0% 0.71 / 0.69 / +3.1%
tpcds_q37/datafusion:vortex-file-compressed 12667324 / 12404394 / +2.1% 36951744 / 30123300 / +22.7% 🔴 0.34 / 0.41 / -16.8%
tpcds_q38/datafusion:vortex-file-compressed 29814696 / 25667270 / +16.2% 🔴 51303484 / 45709604 / +12.2% 🔴 0.58 / 0.56 / +3.5%
tpcds_q39/datafusion:vortex-file-compressed 65482038 / 64867506 / +0.9% 87282352 / 90698438 / -3.8% 0.75 / 0.72 / +4.9%
tpcds_q40/datafusion:vortex-file-compressed 26882988 / 23206666 / +15.8% 🔴 44867124 / 42299546 / +6.1% 0.60 / 0.55 / +9.2%
tpcds_q41/datafusion:vortex-file-compressed 20833328 / 20961656 / -0.6% 33354116 / 31649582 / +5.4% 0.62 / 0.66 / -5.7%
tpcds_q42/datafusion:vortex-file-compressed 12883872 / 11058118 / +16.5% 🔴 29059803 / 26084343 / +11.4% 🔴 0.44 / 0.42 / +4.6%
tpcds_q43/datafusion:vortex-file-compressed 14156739 / 12425410 / +13.9% 🔴 33613294 / 30090684 / +11.7% 🔴 0.42 / 0.41 / +2.0%
tpcds_q44/datafusion:vortex-file-compressed 28957198 / 29757280 / -2.7% 53362195 / 50013384 / +6.7% 0.54 / 0.59 / -8.8%
tpcds_q45/datafusion:vortex-file-compressed 18296326 / 16504794 / +10.9% 🔴 37623377 / 32521744 / +15.7% 🔴 0.49 / 0.51 / -4.2%
tpcds_q46/datafusion:vortex-file-compressed 28881544 / 23536324 / +22.7% 🔴 53579174 / 44375286 / +20.7% 🔴 0.54 / 0.53 / +1.6%
tpcds_q47/datafusion:vortex-file-compressed 84118691 / 75569019 / +11.3% 🔴 112024038 / 103106598 / +8.6% 0.75 / 0.73 / +2.5%
tpcds_q48/datafusion:vortex-file-compressed 28948750 / 29254135 / -1.0% 54219674 / 49745068 / +9.0% 0.53 / 0.59 / -9.2%
tpcds_q49/datafusion:vortex-file-compressed 58698182 / 60699081 / -3.3% 86601531 / 79532403 / +8.9% 0.68 / 0.76 / -11.2%
tpcds_q50/datafusion:vortex-file-compressed 31436705 / 30412974 / +3.4% 54048435 / 53440581 / +1.1% 0.58 / 0.57 / +2.2%
tpcds_q51/datafusion:vortex-file-compressed 68423888 / 66055880 / +3.6% 92374738 / 85840317 / +7.6% 0.74 / 0.77 / -3.7%
tpcds_q52/datafusion:vortex-file-compressed 12386974 / 11663198 / +6.2% 29121024 / 25401947 / +14.6% 🔴 0.43 / 0.46 / -7.4%
tpcds_q53/datafusion:vortex-file-compressed 20892306 / 18117494 / +15.3% 🔴 42356470 / 35770885 / +18.4% 🔴 0.49 / 0.51 / -2.6%
tpcds_q54/datafusion:vortex-file-compressed 33204402 / 32337686 / +2.7% 56698394 / 52797084 / +7.4% 0.59 / 0.61 / -4.4%
tpcds_q55/datafusion:vortex-file-compressed 12189794 / 10977225 / +11.0% 🔴 29538015 / 25545519 / +15.6% 🔴 0.41 / 0.43 / -4.0%
tpcds_q56/datafusion:vortex-file-compressed 28708229 / 27107235 / +5.9% 51126487 / 46640711 / +9.6% 0.56 / 0.58 / -3.4%
tpcds_q57/datafusion:vortex-file-compressed 74367582 / 62452848 / +19.1% 🔴 96123537 / 85675318 / +12.2% 🔴 0.77 / 0.73 / +6.1%
tpcds_q58/datafusion:vortex-file-compressed 45599196 / 38712980 / +17.8% 🔴 71208513 / 60912833 / +16.9% 🔴 0.64 / 0.64 / +0.8%
tpcds_q59/datafusion:vortex-file-compressed 30534036 / 30011546 / +1.7% 57003368 / 51448691 / +10.8% 🔴 0.54 / 0.58 / -8.2%
tpcds_q60/datafusion:vortex-file-compressed 29215512 / 26709566 / +9.4% 49351150 / 46102276 / +7.0% 0.59 / 0.58 / +2.2%
tpcds_q61/datafusion:vortex-file-compressed 23346370 / 22007982 / +6.1% 46392615 / 41914821 / +10.7% 🔴 0.50 / 0.53 / -4.2%
tpcds_q62/datafusion:vortex-file-compressed 18242842 / 16390961 / +11.3% 🔴 38374217 / 33489052 / +14.6% 🔴 0.48 / 0.49 / -2.9%
tpcds_q63/datafusion:vortex-file-compressed 19801403 / 17443168 / +13.5% 🔴 40999071 / 37003474 / +10.8% 🔴 0.48 / 0.47 / +2.5%
tpcds_q64/datafusion:vortex-file-compressed 191008601 / 212368900 / -10.1% 🟢 224697321 / 242020771 / -7.2% 0.85 / 0.88 / -3.1%
tpcds_q65/datafusion:vortex-file-compressed 76127094 / 72660596 / +4.8% 96731010 / 93074158 / +3.9% 0.79 / 0.78 / +0.8%
tpcds_q66/datafusion:vortex-file-compressed 52420196 / 50261422 / +4.3% 72613464 / 70577736 / +2.9% 0.72 / 0.71 / +1.4%
tpcds_q67/datafusion:vortex-file-compressed 53708480 / 50923968 / +5.5% 86407140 / 80197929 / +7.7% 0.62 / 0.63 / -2.1%
tpcds_q68/datafusion:vortex-file-compressed 28651036 / 22802664 / +25.6% 🔴 50601621 / 43872645 / +15.3% 🔴 0.57 / 0.52 / +8.9%
tpcds_q69/datafusion:vortex-file-compressed 32584276 / 25642608 / +27.1% 🔴 53503023 / 46202908 / +15.8% 🔴 0.61 / 0.55 / +9.7%
tpcds_q70/datafusion:vortex-file-compressed 73722753 / 71417318 / +3.2% 98504672 / 91189386 / +8.0% 0.75 / 0.78 / -4.4%
tpcds_q71/datafusion:vortex-file-compressed 20443398 / 19612449 / +4.2% 41543449 / 38868515 / +6.9% 0.49 / 0.50 / -2.5%
tpcds_q72/datafusion:vortex-file-compressed 250259859 / 358141804 / -30.1% 🟢 285461940 / 387476158 / -26.3% 🟢 0.88 / 0.92 / -5.2%
tpcds_q73/datafusion:vortex-file-compressed 20881587 / 16294117 / +28.2% 🔴 40172506 / 35311442 / +13.8% 🔴 0.52 / 0.46 / +12.6%
tpcds_q74/datafusion:vortex-file-compressed 41648615 / 40123466 / +3.8% 69999779 / 65095803 / +7.5% 0.59 / 0.62 / -3.5%
tpcds_q75/datafusion:vortex-file-compressed 137639161 / 137688677 / -0.0% 164478013 / 163988091 / +0.3% 0.84 / 0.84 / -0.3%
tpcds_q76/datafusion:vortex-file-compressed 30638566 / 30038074 / +2.0% 51167431 / 46367615 / +10.4% 🔴 0.60 / 0.65 / -7.6%
tpcds_q77/datafusion:vortex-file-compressed 46454878 / 44811364 / +3.7% 69974642 / 64939737 / +7.8% 0.66 / 0.69 / -3.8%
tpcds_q78/datafusion:vortex-file-compressed 62637601 / 63991438 / -2.1% 93923878 / 90914274 / +3.3% 0.67 / 0.70 / -5.3%
tpcds_q79/datafusion:vortex-file-compressed 24245619 / 19446652 / +24.7% 🔴 44178124 / 42094356 / +5.0% 0.55 / 0.46 / +18.8%
tpcds_q80/datafusion:vortex-file-compressed 72264407 / 73043178 / -1.1% 94287219 / 102452153 / -8.0% 0.77 / 0.71 / +7.5%
tpcds_q81/datafusion:vortex-file-compressed 28542918 / 26368494 / +8.2% 48372338 / 43282707 / +11.8% 🔴 0.59 / 0.61 / -3.1%
tpcds_q82/datafusion:vortex-file-compressed 12471667 / 12767577 / -2.3% 35767567 / 33349594 / +7.3% 0.35 / 0.38 / -8.9%
tpcds_q83/datafusion:vortex-file-compressed 35638628 / 33515185 / +6.3% 56255553 / 52456903 / +7.2% 0.63 / 0.64 / -0.8%
tpcds_q84/datafusion:vortex-file-compressed 10670036 / 10163837 / +5.0% 28651023 / 24803934 / +15.5% 🔴 0.37 / 0.41 / -9.1%
tpcds_q85/datafusion:vortex-file-compressed 53088220 / 53509714 / -0.8% 80164860 / 77972294 / +2.8% 0.66 / 0.69 / -3.5%
tpcds_q86/datafusion:vortex-file-compressed 17187767 / 15870754 / +8.3% 36499771 / 32492390 / +12.3% 🔴 0.47 / 0.49 / -3.6%
tpcds_q87/datafusion:vortex-file-compressed 30924452 / 26006129 / +18.9% 🔴 50968290 / 46904172 / +8.7% 0.61 / 0.55 / +9.4%
tpcds_q88/datafusion:vortex-file-compressed 37347382 / 31730204 / +17.7% 🔴 54761110 / 50072211 / +9.4% 0.68 / 0.63 / +7.6%
tpcds_q89/datafusion:vortex-file-compressed 23134583 / 21416560 / +8.0% 46365206 / 41436261 / +11.9% 🔴 0.50 / 0.52 / -3.5%
tpcds_q90/datafusion:vortex-file-compressed 12635266 / 9987172 / +26.5% 🔴 25818770 / 24139244 / +7.0% 0.49 / 0.41 / +18.3%
tpcds_q91/datafusion:vortex-file-compressed 16954774 / 16897494 / +0.3% 38470131 / 33596053 / +14.5% 🔴 0.44 / 0.50 / -12.4%
tpcds_q92/datafusion:vortex-file-compressed 15319672 / 12824116 / +19.5% 🔴 33483104 / 26875329 / +24.6% 🔴 0.46 / 0.48 / -4.1%
tpcds_q93/datafusion:vortex-file-compressed 20402845 / 20685432 / -1.4% 40869845 / 37495952 / +9.0% 0.50 / 0.55 / -9.5%
tpcds_q94/datafusion:vortex-file-compressed 19556632 / 18561775 / +5.4% 42045698 / 35765571 / +17.6% 🔴 0.47 / 0.52 / -10.4%
tpcds_q95/datafusion:vortex-file-compressed 45713034 / 42142152 / +8.5% 66474276 / 61180576 / +8.7% 0.69 / 0.69 / -0.2%
tpcds_q96/datafusion:vortex-file-compressed 10568371 / 7650478 / +38.1% 🔴 26827468 / 22935839 / +17.0% 🔴 0.39 / 0.33 / +18.1%
tpcds_q97/datafusion:vortex-file-compressed 18116338 / 17325282 / +4.6% 40015560 / 35006862 / +14.3% 🔴 0.45 / 0.49 / -8.5%
tpcds_q98/datafusion:vortex-file-compressed 17324744 / 15985122 / +8.4% 36182991 / 35084819 / +3.1% 0.48 / 0.46 / +5.1%
tpcds_q99/datafusion:vortex-file-compressed 21621063 / 15914286 / +35.9% 🔴 38669977 / 33536757 / +15.3% 🔴 0.56 / 0.47 / +17.8%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41376866 / 43868998 / -5.7% 62015703 / 57792235 / +7.3% 0.67 / 0.76 / -12.1%
tpcds_q02/datafusion:parquet 55364648 / 54905326 / +0.8% 72694947 / 68962111 / +5.4% 0.76 / 0.80 / -4.3%
tpcds_q03/datafusion:parquet 19190376 / 19082322 / +0.6% 31090390 / 29816646 / +4.3% 0.62 / 0.64 / -3.6%
tpcds_q04/datafusion:parquet 178893218 / 181818236 / -1.6% 207274903 / 200857494 / +3.2% 0.86 / 0.91 / -4.7%
tpcds_q05/datafusion:parquet 68208164 / 69356080 / -1.7% 88669801 / 90224362 / -1.7% 0.77 / 0.77 / +0.1%
tpcds_q06/datafusion:parquet 34264127 / 33871373 / +1.2% 46967969 / 47024236 / -0.1% 0.73 / 0.72 / +1.3%
tpcds_q07/datafusion:parquet 46945355 / 46651698 / +0.6% 65457442 / 65908734 / -0.7% 0.72 / 0.71 / +1.3%
tpcds_q08/datafusion:parquet 31724337 / 31356762 / +1.2% 49857802 / 45423653 / +9.8% 0.64 / 0.69 / -7.8%
tpcds_q09/datafusion:parquet 30593680 / 30491130 / +0.3% 44080450 / 37049824 / +19.0% 🔴 0.69 / 0.82 / -15.7%
tpcds_q10/datafusion:parquet 44596175 / 44832285 / -0.5% 56242329 / 55593599 / +1.2% 0.79 / 0.81 / -1.7%
tpcds_q11/datafusion:parquet 96883812 / 97950887 / -1.1% 120600454 / 115108350 / +4.8% 0.80 / 0.85 / -5.6%
tpcds_q12/datafusion:parquet 24038540 / 23806698 / +1.0% 37097392 / 35317362 / +5.0% 0.65 / 0.67 / -3.9%
tpcds_q13/datafusion:parquet 46291312 / 45856160 / +0.9% 67953992 / 67208816 / +1.1% 0.68 / 0.68 / -0.2%
tpcds_q14/datafusion:parquet 536616434 / 537018351 / -0.1% 589559953 / 583498809 / +1.0% 0.91 / 0.92 / -1.1%
tpcds_q15/datafusion:parquet 24027132 / 23650278 / +1.6% 38689524 / 36895334 / +4.9% 0.62 / 0.64 / -3.1%
tpcds_q16/datafusion:parquet 36442444 / 36983696 / -1.5% 51370918 / 49282902 / +4.2% 0.71 / 0.75 / -5.5%
tpcds_q17/datafusion:parquet 73213174 / 75600460 / -3.2% 99891337 / 98869440 / +1.0% 0.73 / 0.76 / -4.1%
tpcds_q18/datafusion:parquet 68818626 / 68850332 / -0.0% 91574082 / 83238541 / +10.0% 🔴 0.75 / 0.83 / -9.1%
tpcds_q19/datafusion:parquet 29091290 / 29719598 / -2.1% 44357797 / 41802745 / +6.1% 0.66 / 0.71 / -7.8%
tpcds_q20/datafusion:parquet 24909097 / 25523878 / -2.4% 38306462 / 36268739 / +5.6% 0.65 / 0.70 / -7.6%
tpcds_q21/datafusion:parquet 19974648 / 20533178 / -2.7% 32707407 / 31530289 / +3.7% 0.61 / 0.65 / -6.2%
tpcds_q22/datafusion:parquet 76941606 / 77366874 / -0.5% 89300670 / 87687906 / +1.8% 0.86 / 0.88 / -2.3%
tpcds_q23/datafusion:parquet 91952458 / 93748514 / -1.9% 115098988 / 117534929 / -2.1% 0.80 / 0.80 / +0.2%
tpcds_q24/datafusion:parquet 91117858 / 90590262 / +0.6% 115585128 / 111276526 / +3.9% 0.79 / 0.81 / -3.2%
tpcds_q25/datafusion:parquet 80162636 / 80871984 / -0.9% 111499195 / 94328551 / +18.2% 🔴 0.72 / 0.86 / -16.1%
tpcds_q26/datafusion:parquet 44184100 / 44018081 / +0.4% 61103642 / 57397708 / +6.5% 0.72 / 0.77 / -5.7%
tpcds_q27/datafusion:parquet 79990679 / 77731044 / +2.9% 97314757 / 97530732 / -0.2% 0.82 / 0.80 / +3.1%
tpcds_q28/datafusion:parquet 28704559 / 28864233 / -0.6% 45026793 / 42250882 / +6.6% 0.64 / 0.68 / -6.7%
tpcds_q29/datafusion:parquet 75237198 / 73649013 / +2.2% 97921975 / 94337302 / +3.8% 0.77 / 0.78 / -1.6%
tpcds_q30/datafusion:parquet 44813367 / 45041546 / -0.5% 57096773 / 56910538 / +0.3% 0.78 / 0.79 / -0.8%
tpcds_q31/datafusion:parquet 82646000 / 80148984 / +3.1% 99701960 / 96414201 / +3.4% 0.83 / 0.83 / -0.3%
tpcds_q32/datafusion:parquet 27055957 / 26228284 / +3.2% 41205182 / 38629733 / +6.7% 0.66 / 0.68 / -3.3%
tpcds_q33/datafusion:parquet 39392975 / 37947355 / +3.8% 54409880 / 49169226 / +10.7% 🔴 0.72 / 0.77 / -6.2%
tpcds_q34/datafusion:parquet 24290120 / 24466732 / -0.7% 36676030 / 33781015 / +8.6% 0.66 / 0.72 / -8.6%
tpcds_q35/datafusion:parquet 52357600 / 49880874 / +5.0% 66142023 / 62452785 / +5.9% 0.79 / 0.80 / -0.9%
tpcds_q36/datafusion:parquet 53329195 / 51648292 / +3.3% 72179273 / 69966557 / +3.2% 0.74 / 0.74 / +0.1%
tpcds_q37/datafusion:parquet 21389863 / 21626878 / -1.1% 34747145 / 32527252 / +6.8% 0.62 / 0.66 / -7.4%
tpcds_q38/datafusion:parquet 45697224 / 45375882 / +0.7% 63878781 / 61827506 / +3.3% 0.72 / 0.73 / -2.5%
tpcds_q39/datafusion:parquet 68415762 / 68220012 / +0.3% 86592094 / 84854720 / +2.0% 0.79 / 0.80 / -1.7%
tpcds_q40/datafusion:parquet 30104902 / 30609906 / -1.6% 52121812 / 48588666 / +7.3% 0.58 / 0.63 / -8.3%
tpcds_q41/datafusion:parquet 19910462 / 20338040 / -2.1% 33439373 / 30843747 / +8.4% 0.60 / 0.66 / -9.7%
tpcds_q42/datafusion:parquet 18198971 / 17982778 / +1.2% 30137033 / 28438009 / +6.0% 0.60 / 0.63 / -4.5%
tpcds_q43/datafusion:parquet 19563553 / 19433710 / +0.7% 32270064 / 30977543 / +4.2% 0.61 / 0.63 / -3.4%
tpcds_q44/datafusion:parquet 34362513 / 34615438 / -0.7% 51287541 / 48032590 / +6.8% 0.67 / 0.72 / -7.0%
tpcds_q45/datafusion:parquet 27731141 / 27805524 / -0.3% 42665317 / 37719933 / +13.1% 🔴 0.65 / 0.74 / -11.8%
tpcds_q46/datafusion:parquet 28908506 / 28966051 / -0.2% 45416826 / 44069858 / +3.1% 0.64 / 0.66 / -3.2%
tpcds_q47/datafusion:parquet 97963360 / 98938351 / -1.0% 120464789 / 118194221 / +1.9% 0.81 / 0.84 / -2.9%
tpcds_q48/datafusion:parquet 42109935 / 42031157 / +0.2% 60863048 / 57489319 / +5.9% 0.69 / 0.73 / -5.4%
tpcds_q49/datafusion:parquet 71866569 / 72673856 / -1.1% 94725345 / 91067351 / +4.0% 0.76 / 0.80 / -4.9%
tpcds_q50/datafusion:parquet 46979457 / 46850272 / +0.3% 66390684 / 65931861 / +0.7% 0.71 / 0.71 / -0.4%
tpcds_q51/datafusion:parquet 75243686 / 76089406 / -1.1% 94277696 / 92461506 / +2.0% 0.80 / 0.82 / -3.0%
tpcds_q52/datafusion:parquet 18908880 / 18499946 / +2.2% 31003513 / 28440398 / +9.0% 0.61 / 0.65 / -6.2%
tpcds_q53/datafusion:parquet 22846282 / 22525606 / +1.4% 40446243 / 36596738 / +10.5% 🔴 0.56 / 0.62 / -8.2%
tpcds_q54/datafusion:parquet 53738207 / 53373818 / +0.7% 65276534 / 66058809 / -1.2% 0.82 / 0.81 / +1.9%
tpcds_q55/datafusion:parquet 18362680 / 18314364 / +0.3% 30314042 / 28956864 / +4.7% 0.61 / 0.63 / -4.2%
tpcds_q56/datafusion:parquet 41602406 / 41117251 / +1.2% 58085297 / 53225786 / +9.1% 0.72 / 0.77 / -7.3%
tpcds_q57/datafusion:parquet 101521536 / 101389000 / +0.1% 122639075 / 118843215 / +3.2% 0.83 / 0.85 / -3.0%
tpcds_q58/datafusion:parquet 65253585 / 66236498 / -1.5% 82803191 / 82029062 / +0.9% 0.79 / 0.81 / -2.4%
tpcds_q59/datafusion:parquet 47729064 / 47560035 / +0.4% 65802835 / 62231838 / +5.7% 0.73 / 0.76 / -5.1%
tpcds_q60/datafusion:parquet 41812760 / 42430193 / -1.5% 53867754 / 54718226 / -1.6% 0.78 / 0.78 / +0.1%
tpcds_q61/datafusion:parquet 36023832 / 35871564 / +0.4% 50484574 / 49348541 / +2.3% 0.71 / 0.73 / -1.8%
tpcds_q62/datafusion:parquet 25267904 / 25122940 / +0.6% 37826025 / 36351311 / +4.1% 0.67 / 0.69 / -3.3%
tpcds_q63/datafusion:parquet 22584214 / 22172324 / +1.9% 38205897 / 36307642 / +5.2% 0.59 / 0.61 / -3.2%
tpcds_q64/datafusion:parquet 287352137 / 287823022 / -0.2% 322926543 / 323180045 / -0.1% 0.89 / 0.89 / -0.1%
tpcds_q65/datafusion:parquet 121430213 / 122564299 / -0.9% 138506927 / 135661913 / +2.1% 0.88 / 0.90 / -3.0%
tpcds_q66/datafusion:parquet 60516292 / 60005627 / +0.9% 78145785 / 75764024 / +3.1% 0.77 / 0.79 / -2.2%
tpcds_q67/datafusion:parquet 69443882 / 69070309 / +0.5% 92364844 / 91511775 / +0.9% 0.75 / 0.75 / -0.4%
tpcds_q68/datafusion:parquet 28815782 / 28929153 / -0.4% 47160659 / 46154519 / +2.2% 0.61 / 0.63 / -2.5%
tpcds_q69/datafusion:parquet 43644150 / 43497268 / +0.3% 58679553 / 57163341 / +2.7% 0.74 / 0.76 / -2.3%
tpcds_q70/datafusion:parquet 80336312 / 81036663 / -0.9% 98691616 / 95480675 / +3.4% 0.81 / 0.85 / -4.1%
tpcds_q71/datafusion:parquet 27511733 / 25816364 / +6.6% 36669129 / 39660177 / -7.5% 0.75 / 0.65 / +15.3%
tpcds_q72/datafusion:parquet 523665620 / 520433934 / +0.6% 557170993 / 547678827 / +1.7% 0.94 / 0.95 / -1.1%
tpcds_q73/datafusion:parquet 23954620 / 24210527 / -1.1% 36589529 / 34623650 / +5.7% 0.65 / 0.70 / -6.4%
tpcds_q74/datafusion:parquet 70615492 / 70775004 / -0.2% 92874771 / 82849125 / +12.1% 🔴 0.76 / 0.85 / -11.0%
tpcds_q75/datafusion:parquet 155966630 / 152094114 / +2.5% 180276151 / 175498834 / +2.7% 0.87 / 0.87 / -0.2%
tpcds_q76/datafusion:parquet 33270552 / 33634765 / -1.1% 48492481 / 45116146 / +7.5% 0.69 / 0.75 / -8.0%
tpcds_q77/datafusion:parquet 59313352 / 58143028 / +2.0% 74765187 / 75667079 / -1.2% 0.79 / 0.77 / +3.2%
tpcds_q78/datafusion:parquet 86497898 / 86641812 / -0.2% 122284446 / 116306605 / +5.1% 0.71 / 0.74 / -5.0%
tpcds_q79/datafusion:parquet 27052764 / 27564524 / -1.9% 42177683 / 42148267 / +0.1% 0.64 / 0.65 / -1.9%
tpcds_q80/datafusion:parquet 79668154 / 81211510 / -1.9% 110608479 / 106482795 / +3.9% 0.72 / 0.76 / -5.6%
tpcds_q81/datafusion:parquet 39139859 / 37274256 / +5.0% 52013032 / 48618545 / +7.0% 0.75 / 0.77 / -1.8%
tpcds_q82/datafusion:parquet 22441251 / 22905268 / -2.0% 36747187 / 33891884 / +8.4% 0.61 / 0.68 / -9.6%
tpcds_q83/datafusion:parquet 59682334 / 59357048 / +0.5% 77630640 / 73454192 / +5.7% 0.77 / 0.81 / -4.9%
tpcds_q84/datafusion:parquet 27427587 / 25503568 / +7.5% 39773962 / 39966763 / -0.5% 0.69 / 0.64 / +8.1%
tpcds_q85/datafusion:parquet 81177255 / 79681350 / +1.9% 103750494 / 103381695 / +0.4% 0.78 / 0.77 / +1.5%
tpcds_q86/datafusion:parquet 20979088 / 20723188 / +1.2% 33748132 / 31380380 / +7.5% 0.62 / 0.66 / -5.9%
tpcds_q87/datafusion:parquet 44998511 / 44615014 / +0.9% 61881852 / 59085681 / +4.7% 0.73 / 0.76 / -3.7%
tpcds_q88/datafusion:parquet 37089993 / 37741110 / -1.7% 50380332 / 52141495 / -3.4% 0.74 / 0.72 / +1.7%
tpcds_q89/datafusion:parquet 26147703 / 25976840 / +0.7% 41542751 / 39387300 / +5.5% 0.63 / 0.66 / -4.6%
tpcds_q90/datafusion:parquet 15665276 / 15252228 / +2.7% 27028080 / 25143417 / +7.5% 0.58 / 0.61 / -4.5%
tpcds_q91/datafusion:parquet 33572984 / 32794231 / +2.4% 47433072 / 43865897 / +8.1% 0.71 / 0.75 / -5.3%
tpcds_q92/datafusion:parquet 27036166 / 27233964 / -0.7% 41177429 / 38923988 / +5.8% 0.66 / 0.70 / -6.2%
tpcds_q93/datafusion:parquet 27429226 / 26816533 / +2.3% 46198986 / 44562208 / +3.7% 0.59 / 0.60 / -1.3%
tpcds_q94/datafusion:parquet 35481032 / 35796473 / -0.9% 49019818 / 47174983 / +3.9% 0.72 / 0.76 / -4.6%
tpcds_q95/datafusion:parquet 64592924 / 65643832 / -1.6% 82895310 / 76727790 / +8.0% 0.78 / 0.86 / -8.9%
tpcds_q96/datafusion:parquet 12778858 / 13153128 / -2.8% 24713870 / 22724348 / +8.8% 0.52 / 0.58 / -10.7%
tpcds_q97/datafusion:parquet 36055782 / 35183400 / +2.5% 51095585 / 50669301 / +0.8% 0.71 / 0.69 / +1.6%
tpcds_q98/datafusion:parquet 24974400 / 24724902 / +1.0% 38886934 / 36964509 / +5.2% 0.64 / 0.67 / -4.0%
tpcds_q99/datafusion:parquet 29923520 / 29937421 / -0.0% 42148543 / 41196641 / +2.3% 0.71 / 0.73 / -2.3%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16026594 / 16212283 / -1.1% 24905287 / 24457668 / +1.8% 0.64 / 0.66 / -2.9%
tpcds_q02/duckdb:vortex-file-compressed 17056380 / 15612978 / +9.2% 22691551 / 22024953 / +3.0% 0.75 / 0.71 / +6.0%
tpcds_q03/duckdb:vortex-file-compressed 7291649 / 7255335 / +0.5% 16380765 / 16051387 / +2.1% 0.45 / 0.45 / -1.5%
tpcds_q04/duckdb:vortex-file-compressed 58726503 / 59041894 / -0.5% 72286925 / 71652632 / +0.9% 0.81 / 0.82 / -1.4%
tpcds_q05/duckdb:vortex-file-compressed 22991886 / 23144822 / -0.7% 32878821 / 31976332 / +2.8% 0.70 / 0.72 / -3.4%
tpcds_q06/duckdb:vortex-file-compressed 24322808 / 24645318 / -1.3% 38984984 / 38803176 / +0.5% 0.62 / 0.64 / -1.8%
tpcds_q07/duckdb:vortex-file-compressed 22693707 / 22574236 / +0.5% 34487681 / 33989268 / +1.5% 0.66 / 0.66 / -0.9%
tpcds_q08/duckdb:vortex-file-compressed 17456230 / 17352022 / +0.6% 25591471 / 24726953 / +3.5% 0.68 / 0.70 / -2.8%
tpcds_q09/duckdb:vortex-file-compressed 19094264 / 19341779 / -1.3% 31026708 / 30136903 / +3.0% 0.62 / 0.64 / -4.1%
tpcds_q10/duckdb:vortex-file-compressed 27297219 / 27823764 / -1.9% 40554998 / 40433605 / +0.3% 0.67 / 0.69 / -2.2%
tpcds_q11/duckdb:vortex-file-compressed 36442674 / 36445164 / -0.0% 46034605 / 44974403 / +2.4% 0.79 / 0.81 / -2.3%
tpcds_q12/duckdb:vortex-file-compressed 9838852 / 9932495 / -0.9% 16730138 / 15687278 / +6.6% 0.59 / 0.63 / -7.1%
tpcds_q13/duckdb:vortex-file-compressed 21280591 / 21108884 / +0.8% 33522255 / 32099208 / +4.4% 0.63 / 0.66 / -3.5%
tpcds_q14/duckdb:vortex-file-compressed 55036510 / 55203218 / -0.3% 65066404 / 65925454 / -1.3% 0.85 / 0.84 / +1.0%
tpcds_q15/duckdb:vortex-file-compressed 11100446 / 11296857 / -1.7% 18963602 / 18457576 / +2.7% 0.59 / 0.61 / -4.4%
tpcds_q16/duckdb:vortex-file-compressed 24727512 / 24840042 / -0.5% 35413409 / 34525443 / +2.6% 0.70 / 0.72 / -2.9%
tpcds_q17/duckdb:vortex-file-compressed 20932232 / 20533688 / +1.9% 32570051 / 32533264 / +0.1% 0.64 / 0.63 / +1.8%
tpcds_q18/duckdb:vortex-file-compressed 32513482 / 32584837 / -0.2% 44093378 / 44264778 / -0.4% 0.74 / 0.74 / +0.2%
tpcds_q19/duckdb:vortex-file-compressed 20735646 / 20504061 / +1.1% 29990732 / 29061523 / +3.2% 0.69 / 0.71 / -2.0%
tpcds_q20/duckdb:vortex-file-compressed 10803706 / 10704300 / +0.9% 17369866 / 17066806 / +1.8% 0.62 / 0.63 / -0.8%
tpcds_q21/duckdb:vortex-file-compressed 9126760 / 9558652 / -4.5% 22917099 / 22321682 / +2.7% 0.40 / 0.43 / -7.0%
tpcds_q22/duckdb:vortex-file-compressed 17567571 / 17533121 / +0.2% 29649847 / 29482596 / +0.6% 0.59 / 0.59 / -0.4%
tpcds_q23/duckdb:vortex-file-compressed 37769118 / 37737816 / +0.1% 49525433 / 48774222 / +1.5% 0.76 / 0.77 / -1.4%
tpcds_q24/duckdb:vortex-file-compressed 26311268 / 26430080 / -0.4% 35599333 / 36754228 / -3.1% 0.74 / 0.72 / +2.8%
tpcds_q25/duckdb:vortex-file-compressed 19902066 / 19798662 / +0.5% 31898071 / 32724115 / -2.5% 0.62 / 0.61 / +3.1%
tpcds_q26/duckdb:vortex-file-compressed 21632754 / 22292130 / -3.0% 32037353 / 31754520 / +0.9% 0.68 / 0.70 / -3.8%
tpcds_q27/duckdb:vortex-file-compressed 24998068 / 25017238 / -0.1% 37057059 / 36852692 / +0.6% 0.67 / 0.68 / -0.6%
tpcds_q28/duckdb:vortex-file-compressed 15471664 / 15218606 / +1.7% 25890671 / 25728072 / +0.6% 0.60 / 0.59 / +1.0%
tpcds_q29/duckdb:vortex-file-compressed 19528822 / 19110126 / +2.2% 31175352 / 30167251 / +3.3% 0.63 / 0.63 / -1.1%
tpcds_q30/duckdb:vortex-file-compressed 18736197 / 18503702 / +1.3% 27174290 / 26926625 / +0.9% 0.69 / 0.69 / +0.3%
tpcds_q31/duckdb:vortex-file-compressed 17974670 / 17704426 / +1.5% 27135924 / 26087708 / +4.0% 0.66 / 0.68 / -2.4%
tpcds_q32/duckdb:vortex-file-compressed 10330945 / 10330486 / +0.0% 18641667 / 17897966 / +4.2% 0.55 / 0.58 / -4.0%
tpcds_q33/duckdb:vortex-file-compressed 17590074 / 17431081 / +0.9% 27702611 / 27213870 / +1.8% 0.63 / 0.64 / -0.9%
tpcds_q34/duckdb:vortex-file-compressed 13147141 / 13046090 / +0.8% 22015689 / 21696273 / +1.5% 0.60 / 0.60 / -0.7%
tpcds_q35/duckdb:vortex-file-compressed 31504126 / 31424446 / +0.3% 43487945 / 44403467 / -2.1% 0.72 / 0.71 / +2.4%
tpcds_q36/duckdb:vortex-file-compressed 13979720 / 13898854 / +0.6% 23795500 / 24024523 / -1.0% 0.59 / 0.58 / +1.5%
tpcds_q37/duckdb:vortex-file-compressed 9318046 / 9499100 / -1.9% 23333055 / 23724212 / -1.6% 0.40 / 0.40 / -0.3%
tpcds_q38/duckdb:vortex-file-compressed 24515554 / 24550068 / -0.1% 32119262 / 32706083 / -1.8% 0.76 / 0.75 / +1.7%
tpcds_q39/duckdb:vortex-file-compressed 18471784 / 18640252 / -0.9% 31258131 / 31161682 / +0.3% 0.59 / 0.60 / -1.2%
tpcds_q40/duckdb:vortex-file-compressed 11202756 / 11295832 / -0.8% 19727750 / 19154296 / +3.0% 0.57 / 0.59 / -3.7%
tpcds_q41/duckdb:vortex-file-compressed 18938461 / 18811371 / +0.7% 25730619 / 25799613 / -0.3% 0.74 / 0.73 / +0.9%
tpcds_q42/duckdb:vortex-file-compressed 7063554 / 6977999 / +1.2% 15433815 / 15382620 / +0.3% 0.46 / 0.45 / +0.9%
tpcds_q43/duckdb:vortex-file-compressed 9754704 / 9707689 / +0.5% 18547438 / 18153179 / +2.2% 0.53 / 0.53 / -1.7%
tpcds_q44/duckdb:vortex-file-compressed 12734723 / 12651077 / +0.7% 24407646 / 23029930 / +6.0% 0.52 / 0.55 / -5.0%
tpcds_q45/duckdb:vortex-file-compressed 23581301 / 23699736 / -0.5% 31061113 / 30571899 / +1.6% 0.76 / 0.78 / -2.1%
tpcds_q46/duckdb:vortex-file-compressed 31905616 / 31721784 / +0.6% 45127560 / 43841233 / +2.9% 0.71 / 0.72 / -2.3%
tpcds_q47/duckdb:vortex-file-compressed 31214388 / 31444303 / -0.7% 40991439 / 40516087 / +1.2% 0.76 / 0.78 / -1.9%
tpcds_q48/duckdb:vortex-file-compressed 23430052 / 23551572 / -0.5% 36263073 / 35696586 / +1.6% 0.65 / 0.66 / -2.1%
tpcds_q49/duckdb:vortex-file-compressed 18782799 / 18754400 / +0.2% 30454859 / 30522276 / -0.2% 0.62 / 0.61 / +0.4%
tpcds_q50/duckdb:vortex-file-compressed 15355186 / 15317112 / +0.2% 26328218 / 25813857 / +2.0% 0.58 / 0.59 / -1.7%
tpcds_q51/duckdb:vortex-file-compressed 48999004 / 48594703 / +0.8% 77812735 / 58523352 / +33.0% 🔴 0.63 / 0.83 / -24.2%
tpcds_q52/duckdb:vortex-file-compressed 7226044 / 7107084 / +1.7% 15776423 / 15558766 / +1.4% 0.46 / 0.46 / +0.3%
tpcds_q53/duckdb:vortex-file-compressed 11571040 / 11433702 / +1.2% 21175620 / 20162697 / +5.0% 0.55 / 0.57 / -3.6%
tpcds_q54/duckdb:vortex-file-compressed 19802834 / 20221188 / -2.1% 29744150 / 29995116 / -0.8% 0.67 / 0.67 / -1.2%
tpcds_q55/duckdb:vortex-file-compressed 6890125 / 6910767 / -0.3% 16468000 / 15094973 / +9.1% 0.42 / 0.46 / -8.6%
tpcds_q56/duckdb:vortex-file-compressed 17943024 / 18008356 / -0.4% 28527140 / 27636711 / +3.2% 0.63 / 0.65 / -3.5%
tpcds_q57/duckdb:vortex-file-compressed 25913760 / 26017854 / -0.4% 34781609 / 32982417 / +5.5% 0.75 / 0.79 / -5.6%
tpcds_q58/duckdb:vortex-file-compressed 20380400 / 20106627 / +1.4% 30622437 / 30675871 / -0.2% 0.67 / 0.66 / +1.5%
tpcds_q59/duckdb:vortex-file-compressed 19468832 / 21048251 / -7.5% 27032947 / 26352319 / +2.6% 0.72 / 0.80 / -9.8%
tpcds_q60/duckdb:vortex-file-compressed 18742842 / 18138670 / +3.3% 29042973 / 27846365 / +4.3% 0.65 / 0.65 / -0.9%
tpcds_q61/duckdb:vortex-file-compressed 19902216 / 19696438 / +1.0% 30159187 / 30572547 / -1.4% 0.66 / 0.64 / +2.4%
tpcds_q62/duckdb:vortex-file-compressed 10971826 / 11255348 / -2.5% 17532034 / 17392856 / +0.8% 0.63 / 0.65 / -3.3%
tpcds_q63/duckdb:vortex-file-compressed 11031193 / 11157020 / -1.1% 20549175 / 19249213 / +6.8% 0.54 / 0.58 / -7.4%
tpcds_q64/duckdb:vortex-file-compressed 53633910 / 53286027 / +0.7% 70076270 / 68675130 / +2.0% 0.77 / 0.78 / -1.4%
tpcds_q65/duckdb:vortex-file-compressed 13093040 / 13185566 / -0.7% 23273868 / 22447474 / +3.7% 0.56 / 0.59 / -4.2%
tpcds_q66/duckdb:vortex-file-compressed 32270376 / 31532300 / +2.3% 39108445 / 38110873 / +2.6% 0.83 / 0.83 / -0.3%
tpcds_q67/duckdb:vortex-file-compressed 55772028 / 55542198 / +0.4% 64070440 / 65827709 / -2.7% 0.87 / 0.84 / +3.2%
tpcds_q68/duckdb:vortex-file-compressed 23249142 / 23128022 / +0.5% 35788385 / 35597057 / +0.5% 0.65 / 0.65 / -0.0%
tpcds_q69/duckdb:vortex-file-compressed 22923908 / 23225697 / -1.3% 37538531 / 37021570 / +1.4% 0.61 / 0.63 / -2.7%
tpcds_q70/duckdb:vortex-file-compressed 14925822 / 14917378 / +0.1% 25125690 / 24489297 / +2.6% 0.59 / 0.61 / -2.5%
tpcds_q71/duckdb:vortex-file-compressed 13195740 / 12983594 / +1.6% 23356557 / 23115528 / +1.0% 0.56 / 0.56 / +0.6%
tpcds_q72/duckdb:vortex-file-compressed 43404014 / 43341787 / +0.1% 56908700 / 57060005 / -0.3% 0.76 / 0.76 / +0.4%
tpcds_q73/duckdb:vortex-file-compressed 11987172 / 12119954 / -1.1% 20692677 / 21069621 / -1.8% 0.58 / 0.58 / +0.7%
tpcds_q74/duckdb:vortex-file-compressed 31099877 / 31365622 / -0.8% 40454689 / 39782134 / +1.7% 0.77 / 0.79 / -2.5%
tpcds_q75/duckdb:vortex-file-compressed 37340774 / 37638798 / -0.8% 50034878 / 49561340 / +1.0% 0.75 / 0.76 / -1.7%
tpcds_q76/duckdb:vortex-file-compressed 12720917 / 12742360 / -0.2% 23704329 / 21910060 / +8.2% 0.54 / 0.58 / -7.7%
tpcds_q77/duckdb:vortex-file-compressed 20504968 / 20600419 / -0.5% 32152310 / 30956012 / +3.9% 0.64 / 0.67 / -4.2%
tpcds_q78/duckdb:vortex-file-compressed 42646734 / 42660023 / -0.0% 52721596 / 53919404 / -2.2% 0.81 / 0.79 / +2.2%
tpcds_q79/duckdb:vortex-file-compressed 17210901 / 17474572 / -1.5% 27308237 / 28009317 / -2.5% 0.63 / 0.62 / +1.0%
tpcds_q80/duckdb:vortex-file-compressed 29979608 / 29990428 / -0.0% 42884066 / 41641944 / +3.0% 0.70 / 0.72 / -2.9%
tpcds_q81/duckdb:vortex-file-compressed 21216874 / 21165576 / +0.2% 30344623 / 30376073 / -0.1% 0.70 / 0.70 / +0.3%
tpcds_q82/duckdb:vortex-file-compressed 9563086 / 9734831 / -1.8% 23956887 / 23622547 / +1.4% 0.40 / 0.41 / -3.1%
tpcds_q83/duckdb:vortex-file-compressed 17455839 / 17388444 / +0.4% 25008776 / 24817514 / +0.8% 0.70 / 0.70 / -0.4%
tpcds_q84/duckdb:vortex-file-compressed 15655132 / 15570198 / +0.5% 23289101 / 22417002 / +3.9% 0.67 / 0.69 / -3.2%
tpcds_q85/duckdb:vortex-file-compressed 26465244 / 26208432 / +1.0% 37549190 / 37083801 / +1.3% 0.70 / 0.71 / -0.3%
tpcds_q86/duckdb:vortex-file-compressed 9767050 / 9778114 / -0.1% 16538055 / 16272283 / +1.6% 0.59 / 0.60 / -1.7%
tpcds_q87/duckdb:vortex-file-compressed 26061825 / 25985307 / +0.3% 33644805 / 33580392 / +0.2% 0.77 / 0.77 / +0.1%
tpcds_q88/duckdb:vortex-file-compressed 30161338 / 30291157 / -0.4% 37628073 / 37428676 / +0.5% 0.80 / 0.81 / -1.0%
tpcds_q89/duckdb:vortex-file-compressed 11931194 / 11890068 / +0.3% 21172422 / 20382273 / +3.9% 0.56 / 0.58 / -3.4%
tpcds_q90/duckdb:vortex-file-compressed 8213738 / 8138980 / +0.9% 15461780 / 15375321 / +0.6% 0.53 / 0.53 / +0.4%
tpcds_q91/duckdb:vortex-file-compressed 15129344 / 15189514 / -0.4% 23857725 / 23475559 / +1.6% 0.63 / 0.65 / -2.0%
tpcds_q92/duckdb:vortex-file-compressed 10431582 / 10566592 / -1.3% 18020004 / 18455223 / -2.4% 0.58 / 0.57 / +1.1%
tpcds_q93/duckdb:vortex-file-compressed 10420104 / 10498808 / -0.7% 23723009 / 22554029 / +5.2% 0.44 / 0.47 / -5.6%
tpcds_q94/duckdb:vortex-file-compressed 22088628 / 22018366 / +0.3% 32184627 / 31879938 / +1.0% 0.69 / 0.69 / -0.6%
tpcds_q95/duckdb:vortex-file-compressed 60708167 / 60937295 / -0.4% 68501426 / 68082802 / +0.6% 0.89 / 0.90 / -1.0%
tpcds_q96/duckdb:vortex-file-compressed 6887084 / 6931992 / -0.6% 15469846 / 14802725 / +4.5% 0.45 / 0.47 / -4.9%
tpcds_q97/duckdb:vortex-file-compressed 22931890 / 23108020 / -0.8% 32002746 / 33118139 / -3.4% 0.72 / 0.70 / +2.7%
tpcds_q98/duckdb:vortex-file-compressed 10920416 / 11084246 / -1.5% 19487457 / 19340276 / +0.8% 0.56 / 0.57 / -2.2%
tpcds_q99/duckdb:vortex-file-compressed 14669415 / 14630474 / +0.3% 22693678 / 22040464 / +3.0% 0.65 / 0.66 / -2.6%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24057300 / 23996042 / +0.3% 31193957 / 30903622 / +0.9% 0.77 / 0.78 / -0.7%
tpcds_q02/duckdb:parquet 18031808 / 17786752 / +1.4% 23745306 / 23740840 / +0.0% 0.76 / 0.75 / +1.4%
tpcds_q03/duckdb:parquet 9768374 / 9673594 / +1.0% 15630235 / 15321232 / +2.0% 0.62 / 0.63 / -1.0%
tpcds_q04/duckdb:parquet 118252214 / 117760600 / +0.4% 123234585 / 125551281 / -1.8% 0.96 / 0.94 / +2.3%
tpcds_q05/duckdb:parquet 28344290 / 28169823 / +0.6% 32301543 / 32699336 / -1.2% 0.88 / 0.86 / +1.9%
tpcds_q06/duckdb:parquet 26574566 / 26474932 / +0.4% 36024854 / 35397650 / +1.8% 0.74 / 0.75 / -1.4%
tpcds_q07/duckdb:parquet 31847109 / 33349046 / -4.5% 38438841 / 39303255 / -2.2% 0.83 / 0.85 / -2.4%
tpcds_q08/duckdb:parquet 19666313 / 19558422 / +0.6% 26305547 / 24537911 / +7.2% 0.75 / 0.80 / -6.2%
tpcds_q09/duckdb:parquet 26915797 / 26364488 / +2.1% 29280289 / 29704973 / -1.4% 0.92 / 0.89 / +3.6%
tpcds_q10/duckdb:parquet 32557890 / 32532463 / +0.1% 40214588 / 40039605 / +0.4% 0.81 / 0.81 / -0.4%
tpcds_q11/duckdb:parquet 68436944 / 68870108 / -0.6% 75041493 / 74795297 / +0.3% 0.91 / 0.92 / -1.0%
tpcds_q12/duckdb:parquet 13894984 / 14091031 / -1.4% 19099169 / 19040233 / +0.3% 0.73 / 0.74 / -1.7%
tpcds_q13/duckdb:parquet 30760396 / 32139856 / -4.3% 39279944 / 38969517 / +0.8% 0.78 / 0.82 / -5.0%
tpcds_q14/duckdb:parquet 63420833 / 64354318 / -1.5% 69638195 / 67949677 / +2.5% 0.91 / 0.95 / -3.8%
tpcds_q15/duckdb:parquet 16599644 / 16501586 / +0.6% 22283622 / 22228334 / +0.2% 0.74 / 0.74 / +0.3%
tpcds_q16/duckdb:parquet 30007134 / 30261378 / -0.8% 37177068 / 37085054 / +0.2% 0.81 / 0.82 / -1.1%
tpcds_q17/duckdb:parquet 34405106 / 34374024 / +0.1% 40192234 / 40258296 / -0.2% 0.86 / 0.85 / +0.3%
tpcds_q18/duckdb:parquet 47283912 / 47341254 / -0.1% 55680211 / 53822170 / +3.5% 0.85 / 0.88 / -3.5%
tpcds_q19/duckdb:parquet 18749132 / 18681093 / +0.4% 25499386 / 25327325 / +0.7% 0.74 / 0.74 / -0.3%
tpcds_q20/duckdb:parquet 14771700 / 15037937 / -1.8% 19305254 / 19303628 / +0.0% 0.77 / 0.78 / -1.8%
tpcds_q21/duckdb:parquet 10422214 / 10264242 / +1.5% 16480272 / 16593760 / -0.7% 0.63 / 0.62 / +2.2%
tpcds_q22/duckdb:parquet 20667387 / 20634817 / +0.2% 26795987 / 26711808 / +0.3% 0.77 / 0.77 / -0.2%
tpcds_q23/duckdb:parquet 43625746 / 43041032 / +1.4% 46742635 / 46521564 / +0.5% 0.93 / 0.93 / +0.9%
tpcds_q24/duckdb:parquet 30304573 / 30555330 / -0.8% 36748416 / 36178051 / +1.6% 0.82 / 0.84 / -2.4%
tpcds_q25/duckdb:parquet 30314801 / 30258642 / +0.2% 37038492 / 36566439 / +1.3% 0.82 / 0.83 / -1.1%
tpcds_q26/duckdb:parquet 29080639 / 29136078 / -0.2% 34855892 / 34991772 / -0.4% 0.83 / 0.83 / +0.2%
tpcds_q27/duckdb:parquet 32875770 / 33447661 / -1.7% 41960532 / 41683711 / +0.7% 0.78 / 0.80 / -2.4%
tpcds_q28/duckdb:parquet 26232814 / 26022834 / +0.8% 32048275 / 31289666 / +2.4% 0.82 / 0.83 / -1.6%
tpcds_q29/duckdb:parquet 31906182 / 31988569 / -0.3% 39169291 / 39116303 / +0.1% 0.81 / 0.82 / -0.4%
tpcds_q30/duckdb:parquet 35480130 / 35435476 / +0.1% 44582292 / 43993117 / +1.3% 0.80 / 0.81 / -1.2%
tpcds_q31/duckdb:parquet 35795864 / 35738276 / +0.2% 42657226 / 42663526 / -0.0% 0.84 / 0.84 / +0.2%
tpcds_q32/duckdb:parquet 14282225 / 14123830 / +1.1% 20624060 / 20031530 / +3.0% 0.69 / 0.71 / -1.8%
tpcds_q33/duckdb:parquet 24419687 / 24609394 / -0.8% 28783652 / 28380832 / +1.4% 0.85 / 0.87 / -2.2%
tpcds_q34/duckdb:parquet 20006968 / 18484024 / +8.2% 24005754 / 23925045 / +0.3% 0.83 / 0.77 / +7.9%
tpcds_q35/duckdb:parquet 34938169 / 35132136 / -0.6% 44010019 / 43531703 / +1.1% 0.79 / 0.81 / -1.6%
tpcds_q36/duckdb:parquet 41003856 / 41035856 / -0.1% 47594291 / 47893183 / -0.6% 0.86 / 0.86 / +0.5%
tpcds_q37/duckdb:parquet 12503868 / 12809626 / -2.4% 19253848 / 18496370 / +4.1% 0.65 / 0.69 / -6.2%
tpcds_q38/duckdb:parquet 29764980 / 29729394 / +0.1% 33451541 / 34840540 / -4.0% 0.89 / 0.85 / +4.3%
tpcds_q39/duckdb:parquet 23292118 / 23485818 / -0.8% 30768958 / 30291549 / +1.6% 0.76 / 0.78 / -2.4%
tpcds_q40/duckdb:parquet 15911600 / 15857985 / +0.3% 21363343 / 20818997 / +2.6% 0.74 / 0.76 / -2.2%
tpcds_q41/duckdb:parquet 11826590 / 11981630 / -1.3% 18113646 / 17649189 / +2.6% 0.65 / 0.68 / -3.8%
tpcds_q42/duckdb:parquet 9525982 / 9555690 / -0.3% 15350767 / 15279196 / +0.5% 0.62 / 0.63 / -0.8%
tpcds_q43/duckdb:parquet 11933202 / 12077722 / -1.2% 17962794 / 17813028 / +0.8% 0.66 / 0.68 / -2.0%
tpcds_q44/duckdb:parquet 21188498 / 21818490 / -2.9% 26969298 / 26440781 / +2.0% 0.79 / 0.83 / -4.8%
tpcds_q45/duckdb:parquet 20972129 / 20874288 / +0.5% 28196104 / 27464282 / +2.7% 0.74 / 0.76 / -2.1%
tpcds_q46/duckdb:parquet 36281924 / 38025740 / -4.6% 43983112 / 42714366 / +3.0% 0.82 / 0.89 / -7.3%
tpcds_q47/duckdb:parquet 34415688 / 34420600 / -0.0% 41085081 / 41163962 / -0.2% 0.84 / 0.84 / +0.2%
tpcds_q48/duckdb:parquet 29280040 / 30447377 / -3.8% 37139719 / 36046714 / +3.0% 0.79 / 0.84 / -6.7%
tpcds_q49/duckdb:parquet 29897542 / 30877056 / -3.2% 36043708 / 35801884 / +0.7% 0.83 / 0.86 / -3.8%
tpcds_q50/duckdb:parquet 19229294 / 19352233 / -0.6% 25727099 / 25423062 / +1.2% 0.75 / 0.76 / -1.8%
tpcds_q51/duckdb:parquet 52488148 / 52712596 / -0.4% 59792073 / 59167788 / +1.1% 0.88 / 0.89 / -1.5%
tpcds_q52/duckdb:parquet 9681874 / 9488666 / +2.0% 15439369 / 15139716 / +2.0% 0.63 / 0.63 / +0.1%
tpcds_q53/duckdb:parquet 13627559 / 13979474 / -2.5% 21311905 / 20440901 / +4.3% 0.64 / 0.68 / -6.5%
tpcds_q54/duckdb:parquet 24772544 / 24601710 / +0.7% 31388145 / 31679509 / -0.9% 0.79 / 0.78 / +1.6%
tpcds_q55/duckdb:parquet 9563378 / 9341512 / +2.4% 15419127 / 14944132 / +3.2% 0.62 / 0.63 / -0.8%
tpcds_q56/duckdb:parquet 24619032 / 24882942 / -1.1% 30475893 / 30322569 / +0.5% 0.81 / 0.82 / -1.6%
tpcds_q57/duckdb:parquet 30911516 / 30402402 / +1.7% 36224738 / 35544015 / +1.9% 0.85 / 0.86 / -0.2%
tpcds_q58/duckdb:parquet 23719968 / 23657598 / +0.3% 29807099 / 28913041 / +3.1% 0.80 / 0.82 / -2.7%
tpcds_q59/duckdb:parquet 22724271 / 22783736 / -0.3% 28591616 / 28969349 / -1.3% 0.79 / 0.79 / +1.1%
tpcds_q60/duckdb:parquet 27346539 / 26652178 / +2.6% 31508156 / 31536238 / -0.1% 0.87 / 0.85 / +2.7%
tpcds_q61/duckdb:parquet 25202532 / 25282762 / -0.3% 29327824 / 28140120 / +4.2% 0.86 / 0.90 / -4.4%
tpcds_q62/duckdb:parquet 12681020 / 12628204 / +0.4% 17869033 / 18054092 / -1.0% 0.71 / 0.70 / +1.5%
tpcds_q63/duckdb:parquet 14483652 / 13169518 / +10.0% 19675124 / 19765767 / -0.5% 0.74 / 0.67 / +10.5%
tpcds_q64/duckdb:parquet 69894636 / 70124306 / -0.3% 80683389 / 78473219 / +2.8% 0.87 / 0.89 / -3.1%
tpcds_q65/duckdb:parquet 20454754 / 19531788 / +4.7% 25209817 / 25390584 / -0.7% 0.81 / 0.77 / +5.5%
tpcds_q66/duckdb:parquet 33122966 / 33266424 / -0.4% 37811977 / 37699496 / +0.3% 0.88 / 0.88 / -0.7%
tpcds_q67/duckdb:parquet 60693560 / 61372094 / -1.1% 66672645 / 68218248 / -2.3% 0.91 / 0.90 / +1.2%
tpcds_q68/duckdb:parquet 27983032 / 29414076 / -4.9% 36085853 / 35986606 / +0.3% 0.78 / 0.82 / -5.1%
tpcds_q69/duckdb:parquet 25742468 / 25793781 / -0.2% 34399276 / 33996532 / +1.2% 0.75 / 0.76 / -1.4%
tpcds_q70/duckdb:parquet 19438858 / 19143344 / +1.5% 26594441 / 26365612 / +0.9% 0.73 / 0.73 / +0.7%
tpcds_q71/duckdb:parquet 16882630 / 17124168 / -1.4% 23716969 / 23186938 / +2.3% 0.71 / 0.74 / -3.6%
tpcds_q72/duckdb:parquet 52849128 / 52929268 / -0.2% 60019838 / 58879640 / +1.9% 0.88 / 0.90 / -2.0%
tpcds_q73/duckdb:parquet 14996090 / 14747736 / +1.7% 21206957 / 21389327 / -0.9% 0.71 / 0.69 / +2.6%
tpcds_q74/duckdb:parquet 84281748 / 85838255 / -1.8% 90614581 / 90051254 / +0.6% 0.93 / 0.95 / -2.4%
tpcds_q75/duckdb:parquet 42505966 / 43083905 / -1.3% 49868446 / 49148629 / +1.5% 0.85 / 0.88 / -2.8%
tpcds_q76/duckdb:parquet 19207611 / 19605366 / -2.0% 23739671 / 23181803 / +2.4% 0.81 / 0.85 / -4.3%
tpcds_q77/duckdb:parquet 23715500 / 25532766 / -7.1% 30894853 / 30882055 / +0.0% 0.77 / 0.83 / -7.2%
tpcds_q78/duckdb:parquet 78298585 / 77681797 / +0.8% 85046751 / 84930270 / +0.1% 0.92 / 0.91 / +0.7%
tpcds_q79/duckdb:parquet 23092106 / 22711582 / +1.7% 28884070 / 28372133 / +1.8% 0.80 / 0.80 / -0.1%
tpcds_q80/duckdb:parquet 35379844 / 38715876 / -8.6% 43518374 / 42947675 / +1.3% 0.81 / 0.90 / -9.8%
tpcds_q81/duckdb:parquet 36086179 / 36255840 / -0.5% 44292736 / 44557710 / -0.6% 0.81 / 0.81 / +0.1%
tpcds_q82/duckdb:parquet 13876210 / 13289966 / +4.4% 20309802 / 19942946 / +1.8% 0.68 / 0.67 / +2.5%
tpcds_q83/duckdb:parquet 19811980 / 20160996 / -1.7% 25141079 / 24766528 / +1.5% 0.79 / 0.81 / -3.2%
tpcds_q84/duckdb:parquet 22738385 / 22602292 / +0.6% 28701621 / 28441353 / +0.9% 0.79 / 0.79 / -0.3%
tpcds_q85/duckdb:parquet 31945833 / 32258556 / -1.0% 40076348 / 38942329 / +2.9% 0.80 / 0.83 / -3.8%
tpcds_q86/duckdb:parquet 11861476 / 11779433 / +0.7% 17029856 / 16343564 / +4.2% 0.70 / 0.72 / -3.4%
tpcds_q87/duckdb:parquet 30997792 / 31351080 / -1.1% 34848772 / 34915420 / -0.2% 0.89 / 0.90 / -0.9%
tpcds_q88/duckdb:parquet 37395116 / 38453567 / -2.8% 43615185 / 43234108 / +0.9% 0.86 / 0.89 / -3.6%
tpcds_q89/duckdb:parquet 13993883 / 14524206 / -3.7% 21087599 / 20793007 / +1.4% 0.66 / 0.70 / -5.0%
tpcds_q90/duckdb:parquet 9963604 / 10153406 / -1.9% 15032990 / 14930511 / +0.7% 0.66 / 0.68 / -2.5%
tpcds_q91/duckdb:parquet 20894341 / 21031335 / -0.7% 28075184 / 28062873 / +0.0% 0.74 / 0.75 / -0.7%
tpcds_q92/duckdb:parquet 15479427 / 15569576 / -0.6% 22235266 / 21843528 / +1.8% 0.70 / 0.71 / -2.3%
tpcds_q93/duckdb:parquet 13995514 / 14155761 / -1.1% 20258043 / 20142365 / +0.6% 0.69 / 0.70 / -1.7%
tpcds_q94/duckdb:parquet 25374830 / 25393021 / -0.1% 32473491 / 32307355 / +0.5% 0.78 / 0.79 / -0.6%
tpcds_q95/duckdb:parquet 43822578 / 43499790 / +0.7% 49431463 / 48995974 / +0.9% 0.89 / 0.89 / -0.1%
tpcds_q96/duckdb:parquet 8186072 / 8242915 / -0.7% 13703053 / 13728613 / -0.2% 0.60 / 0.60 / -0.5%
tpcds_q97/duckdb:parquet 27361780 / 27433995 / -0.3% 32477191 / 33803585 / -3.9% 0.84 / 0.81 / +3.8%
tpcds_q98/duckdb:parquet 16479372 / 16489278 / -0.1% 22888040 / 22825596 / +0.3% 0.72 / 0.72 / -0.3%
tpcds_q99/duckdb:parquet 18722614 / 18644899 / +0.4% 24675517 / 24285571 / +1.6% 0.76 / 0.77 / -1.2%

@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR de56ec05 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.5%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.018x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.986x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93474697 / 94724459 / -1.3% 153765715 / 157918340 / -2.6% 0.61 / 0.60 / +1.3%
tpch_q02/datafusion:vortex-file-compressed 64913141 / 64481395 / +0.7% 96254097 / 96546090 / -0.3% 0.67 / 0.67 / +1.0%
tpch_q03/datafusion:vortex-file-compressed 63074864 / 63899664 / -1.3% 127981758 / 113278862 / +13.0% 🔴 0.49 / 0.56 / -12.6%
tpch_q04/datafusion:vortex-file-compressed 34718173 / 35125694 / -1.2% 70887186 / 74530735 / -4.9% 0.49 / 0.47 / +3.9%
tpch_q05/datafusion:vortex-file-compressed 119163863 / 119197844 / -0.0% 184255846 / 176495070 / +4.4% 0.65 / 0.68 / -4.2%
tpch_q06/datafusion:vortex-file-compressed 10773512 / 10704202 / +0.6% 60001177 / 59995973 / +0.0% 0.18 / 0.18 / +0.6%
tpch_q07/datafusion:vortex-file-compressed 96954396 / 135313317 / -28.3% 🟢 163397164 / 197739148 / -17.4% 🟢 0.59 / 0.68 / -13.3%
tpch_q08/datafusion:vortex-file-compressed 143384075 / 145602136 / -1.5% 217819760 / 223321503 / -2.5% 0.66 / 0.65 / +1.0%
tpch_q09/datafusion:vortex-file-compressed 185754201 / 185031441 / +0.4% 264117878 / 269753645 / -2.1% 0.70 / 0.69 / +2.5%
tpch_q10/datafusion:vortex-file-compressed 70525826 / 70616942 / -0.1% 132993731 / 136406928 / -2.5% 0.53 / 0.52 / +2.4%
tpch_q11/datafusion:vortex-file-compressed 45548395 / 43651212 / +4.3% 71192686 / 69215001 / +2.9% 0.64 / 0.63 / +1.4%
tpch_q12/datafusion:vortex-file-compressed 36139230 / 35554476 / +1.6% 86575262 / 79213449 / +9.3% 0.42 / 0.45 / -7.0%
tpch_q13/datafusion:vortex-file-compressed 48435072 / 49018169 / -1.2% 84962741 / 83911409 / +1.3% 0.57 / 0.58 / -2.4%
tpch_q14/datafusion:vortex-file-compressed 20759841 / 22057955 / -5.9% 90412902 / 90406416 / +0.0% 0.23 / 0.24 / -5.9%
tpch_q15/datafusion:vortex-file-compressed 34659265 / 34811794 / -0.4% 95397486 / 89730471 / +6.3% 0.36 / 0.39 / -6.4%
tpch_q16/datafusion:vortex-file-compressed 36880786 / 37091588 / -0.6% 68708766 / 67014046 / +2.5% 0.54 / 0.55 / -3.0%
tpch_q17/datafusion:vortex-file-compressed 177171289 / 177988552 / -0.5% 229726630 / 232271247 / -1.1% 0.77 / 0.77 / +0.6%
tpch_q18/datafusion:vortex-file-compressed 206865823 / 205368188 / +0.7% 274551576 / 274987115 / -0.2% 0.75 / 0.75 / +0.9%
tpch_q19/datafusion:vortex-file-compressed 31490299 / 30006468 / +4.9% 90974259 / 89553589 / +1.6% 0.35 / 0.34 / +3.3%
tpch_q20/datafusion:vortex-file-compressed 62427047 / 61154165 / +2.1% 120250585 / 118338369 / +1.6% 0.52 / 0.52 / +0.5%
tpch_q21/datafusion:vortex-file-compressed 182588671 / 181036037 / +0.9% 230340803 / 244902144 / -5.9% 0.79 / 0.74 / +7.2%
tpch_q22/datafusion:vortex-file-compressed 25562501 / 25442537 / +0.5% 54630240 / 54603990 / +0.0% 0.47 / 0.47 / +0.4%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87440134 / 87868152 / -0.5% 130581240 / 126697566 / +3.1% 0.67 / 0.69 / -3.4%
tpch_q02/datafusion:parquet 174423392 / 175283206 / -0.5% 202506731 / 196066422 / +3.3% 0.86 / 0.89 / -3.7%
tpch_q03/datafusion:parquet 135321673 / 134922104 / +0.3% 182563082 / 176366268 / +3.5% 0.74 / 0.77 / -3.1%
tpch_q04/datafusion:parquet 56926000 / 57316807 / -0.7% 89984286 / 89345917 / +0.7% 0.63 / 0.64 / -1.4%
tpch_q05/datafusion:parquet 167400775 / 168218564 / -0.5% 229446498 / 226821158 / +1.2% 0.73 / 0.74 / -1.6%
tpch_q06/datafusion:parquet 36573007 / 36627999 / -0.2% 76995837 / 73531388 / +4.7% 0.47 / 0.50 / -4.6%
tpch_q07/datafusion:parquet 217594644 / 214276959 / +1.5% 271409744 / 266716815 / +1.8% 0.80 / 0.80 / -0.2%
tpch_q08/datafusion:parquet 218614739 / 218587770 / +0.0% 286758039 / 279522428 / +2.6% 0.76 / 0.78 / -2.5%
tpch_q09/datafusion:parquet 309329184 / 308753365 / +0.2% 378889374 / 373919031 / +1.3% 0.82 / 0.83 / -1.1%
tpch_q10/datafusion:parquet 312598682 / 310708532 / +0.6% 378814075 / 369399119 / +2.5% 0.83 / 0.84 / -1.9%
tpch_q11/datafusion:parquet 127086270 / 127162461 / -0.1% 151722096 / 151763831 / -0.0% 0.84 / 0.84 / -0.0%
tpch_q12/datafusion:parquet 82539190 / 82762449 / -0.3% 122387572 / 119080214 / +2.8% 0.67 / 0.70 / -3.0%
tpch_q13/datafusion:parquet 210491580 / 210365033 / +0.1% 243130806 / 239986311 / +1.3% 0.87 / 0.88 / -1.2%
tpch_q14/datafusion:parquet 86556671 / 85459524 / +1.3% 190343910 / 178848390 / +6.4% 0.45 / 0.48 / -4.8%
tpch_q15/datafusion:parquet 106054738 / 105657567 / +0.4% 162006193 / 151740314 / +6.8% 0.65 / 0.70 / -6.0%
tpch_q16/datafusion:parquet 95295215 / 95323992 / -0.0% 123846414 / 118749088 / +4.3% 0.77 / 0.80 / -4.1%
tpch_q17/datafusion:parquet 215617263 / 216868678 / -0.6% 266633832 / 259822287 / +2.6% 0.81 / 0.83 / -3.1%
tpch_q18/datafusion:parquet 268722287 / 267825735 / +0.3% 322250193 / 312077493 / +3.3% 0.83 / 0.86 / -2.8%
tpch_q19/datafusion:parquet 108370621 / 108324213 / +0.0% 163817184 / 161551730 / +1.4% 0.66 / 0.67 / -1.3%
tpch_q20/datafusion:parquet 186055917 / 186113481 / -0.0% 244174905 / 238274933 / +2.5% 0.76 / 0.78 / -2.4%
tpch_q21/datafusion:parquet 243721999 / 241673720 / +0.8% 308679948 / 308352833 / +0.1% 0.79 / 0.78 / +0.7%
tpch_q22/datafusion:parquet 150303627 / 150198208 / +0.1% 174258138 / 177243780 / -1.7% 0.86 / 0.85 / +1.8%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33881293 / 34045722 / -0.5% 72212749 / 68408179 / +5.6% 0.47 / 0.50 / -5.7%
tpch_q02/duckdb:vortex-file-compressed 28054866 / 28952751 / -3.1% 44575164 / 43260395 / +3.0% 0.63 / 0.67 / -6.0%
tpch_q03/duckdb:vortex-file-compressed 53226444 / 52923932 / +0.6% 102777818 / 102141079 / +0.6% 0.52 / 0.52 / -0.1%
tpch_q04/duckdb:vortex-file-compressed 51820731 / 52043820 / -0.4% 88598054 / 91719732 / -3.4% 0.58 / 0.57 / +3.1%
tpch_q05/duckdb:vortex-file-compressed 67933362 / 68671505 / -1.1% 108345102 / 112336218 / -3.6% 0.63 / 0.61 / +2.6%
tpch_q06/duckdb:vortex-file-compressed 15696647 / 15816437 / -0.8% 52466167 / 51786820 / +1.3% 0.30 / 0.31 / -2.0%
tpch_q07/duckdb:vortex-file-compressed 56117316 / 55824028 / +0.5% 110480515 / 110137384 / +0.3% 0.51 / 0.51 / +0.2%
tpch_q08/duckdb:vortex-file-compressed 84797013 / 84579156 / +0.3% 132406632 / 131165858 / +0.9% 0.64 / 0.64 / -0.7%
tpch_q09/duckdb:vortex-file-compressed 103842662 / 102823137 / +1.0% 158212127 / 158073028 / +0.1% 0.66 / 0.65 / +0.9%
tpch_q10/duckdb:vortex-file-compressed 96027367 / 96711838 / -0.7% 145783574 / 150067139 / -2.9% 0.66 / 0.64 / +2.2%
tpch_q11/duckdb:vortex-file-compressed 12922211 / 13465132 / -4.0% 28294206 / 27124139 / +4.3% 0.46 / 0.50 / -8.0%
tpch_q12/duckdb:vortex-file-compressed 45528181 / 46001329 / -1.0% 83261593 / 84088188 / -1.0% 0.55 / 0.55 / -0.0%
tpch_q13/duckdb:vortex-file-compressed 70925880 / 72196786 / -1.8% 99236113 / 101134616 / -1.9% 0.71 / 0.71 / +0.1%
tpch_q14/duckdb:vortex-file-compressed 28630910 / 28673495 / -0.1% 74633303 / 74955962 / -0.4% 0.38 / 0.38 / +0.3%
tpch_q15/duckdb:vortex-file-compressed 25083753 / 25090692 / -0.0% 66022889 / 63814490 / +3.5% 0.38 / 0.39 / -3.4%
tpch_q16/duckdb:vortex-file-compressed 49279765 / 48915060 / +0.7% 58550424 / 59075298 / -0.9% 0.84 / 0.83 / +1.6%
tpch_q17/duckdb:vortex-file-compressed 35069454 / 35666688 / -1.7% 68416675 / 66500934 / +2.9% 0.51 / 0.54 / -4.4%
tpch_q18/duckdb:vortex-file-compressed 104926511 / 106737036 / -1.7% 128717860 / 122341130 / +5.2% 0.82 / 0.87 / -6.6%
tpch_q19/duckdb:vortex-file-compressed 27691388 / 27613725 / +0.3% 75787601 / 74879613 / +1.2% 0.37 / 0.37 / -0.9%
tpch_q20/duckdb:vortex-file-compressed 42471129 / 42899457 / -1.0% 95443101 / 93417846 / +2.2% 0.44 / 0.46 / -3.1%
tpch_q21/duckdb:vortex-file-compressed 95140280 / 95930606 / -0.8% 151293049 / 147604775 / +2.5% 0.63 / 0.65 / -3.2%
tpch_q22/duckdb:vortex-file-compressed 33361068 / 33407533 / -0.1% 48904373 / 48951455 / -0.1% 0.68 / 0.68 / -0.0%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67662476 / 67735634 / -0.1% 89775541 / 88462634 / +1.5% 0.75 / 0.77 / -1.6%
tpch_q02/duckdb:parquet 86674510 / 87275704 / -0.7% 98679575 / 97489968 / +1.2% 0.88 / 0.90 / -1.9%
tpch_q03/duckdb:parquet 110069378 / 109362637 / +0.6% 143661121 / 143653002 / +0.0% 0.77 / 0.76 / +0.6%
tpch_q04/duckdb:parquet 76219245 / 76250087 / -0.0% 96784973 / 96343205 / +0.5% 0.79 / 0.79 / -0.5%
tpch_q05/duckdb:parquet 122181168 / 123872375 / -1.4% 157712552 / 154942780 / +1.8% 0.77 / 0.80 / -3.1%
tpch_q06/duckdb:parquet 35798939 / 35934326 / -0.4% 60447601 / 56188319 / +7.6% 0.59 / 0.64 / -7.4%
tpch_q07/duckdb:parquet 116776492 / 119737528 / -2.5% 154603927 / 152041604 / +1.7% 0.76 / 0.79 / -4.1%
tpch_q08/duckdb:parquet 147908347 / 147240689 / +0.5% 191582884 / 191280444 / +0.2% 0.77 / 0.77 / +0.3%
tpch_q09/duckdb:parquet 237121775 / 237250697 / -0.1% 278758972 / 276443381 / +0.8% 0.85 / 0.86 / -0.9%
tpch_q10/duckdb:parquet 312946823 / 313282159 / -0.1% 338057942 / 337558534 / +0.1% 0.93 / 0.93 / -0.3%
tpch_q11/duckdb:parquet 43573313 / 43616057 / -0.1% 50115345 / 50497035 / -0.8% 0.87 / 0.86 / +0.7%
tpch_q12/duckdb:parquet 70300631 / 70363566 / -0.1% 92186066 / 90310493 / +2.1% 0.76 / 0.78 / -2.1%
tpch_q13/duckdb:parquet 292398363 / 292011736 / +0.1% 306756572 / 305343263 / +0.5% 0.95 / 0.96 / -0.3%
tpch_q14/duckdb:parquet 101249254 / 101015070 / +0.2% 135596336 / 134851549 / +0.6% 0.75 / 0.75 / -0.3%
tpch_q15/duckdb:parquet 57205557 / 57593355 / -0.7% 87765996 / 83094267 / +5.6% 0.65 / 0.69 / -6.0%
tpch_q16/duckdb:parquet 99921157 / 100455330 / -0.5% 106548126 / 106865437 / -0.3% 0.94 / 0.94 / -0.2%
tpch_q17/duckdb:parquet 81273438 / 81999914 / -0.9% 113749564 / 109163304 / +4.2% 0.71 / 0.75 / -4.9%
tpch_q18/duckdb:parquet 158193100 / 157658139 / +0.3% 169538255 / 171957512 / -1.4% 0.93 / 0.92 / +1.8%
tpch_q19/duckdb:parquet 97751589 / 98074533 / -0.3% 128576472 / 129074964 / -0.4% 0.76 / 0.76 / +0.1%
tpch_q20/duckdb:parquet 146768739 / 147244521 / -0.3% 182170681 / 180957971 / +0.7% 0.81 / 0.81 / -1.0%
tpch_q21/duckdb:parquet 255080714 / 252151711 / +1.2% 277062272 / 277410674 / -0.1% 0.92 / 0.91 / +1.3%
tpch_q22/duckdb:parquet 168085625 / 168196214 / -0.1% 179561344 / 179379411 / +0.1% 0.94 / 0.94 / -0.2%

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR de56ec05 vs base 5605eab0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.6%
Engines: DataFusion No clear signal (-2.9%, environment too noisy confidence) · DuckDB No clear signal (-12.1%, environment too noisy confidence)
Vortex (geomean): hot 0.932x ➖ · cold 0.958x ➖
Parquet (geomean): hot 1.009x ➖ · cold 0.971x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.965x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 208688848 / 219799164 / -5.1% 725828875 / 751507630 / -3.4% 0.29 / 0.29 / -1.7%
tpch_q02/datafusion:vortex-file-compressed 342072778 / 347284031 / -1.5% 701329034 / 617713842 / +13.5% 0.49 / 0.56 / -13.2%
tpch_q03/datafusion:vortex-file-compressed 354744325 / 366192670 / -3.1% 920881075 / 1020795838 / -9.8% 0.39 / 0.36 / +7.4%
tpch_q04/datafusion:vortex-file-compressed 193921912 / 201624244 / -3.8% 524766220 / 380787599 / +37.8% 🔴 0.37 / 0.53 / -30.2%
tpch_q05/datafusion:vortex-file-compressed 390319371 / 402348090 / -3.0% 638076202 / 709186641 / -10.0% 0.61 / 0.57 / +7.8%
tpch_q06/datafusion:vortex-file-compressed 293328905 / 202547927 / +44.8% 🔴 380379733 / 300688579 / +26.5% 0.77 / 0.67 / +14.5%
tpch_q07/datafusion:vortex-file-compressed 438632762 / 407277373 / +7.7% 554532688 / 564421536 / -1.8% 0.79 / 0.72 / +9.6%
tpch_q08/datafusion:vortex-file-compressed 420816150 / 511994837 / -17.8% 570901431 / 991100304 / -42.4% 🟢 0.74 / 0.52 / +42.7%
tpch_q09/datafusion:vortex-file-compressed 338914742 / 299597669 / +13.1% 557087683 / 450547553 / +23.6% 0.61 / 0.66 / -8.5%
tpch_q10/datafusion:vortex-file-compressed 385369868 / 388984940 / -0.9% 556921226 / 482170809 / +15.5% 0.69 / 0.81 / -14.2%
tpch_q11/datafusion:vortex-file-compressed 303364386 / 285335942 / +6.3% 464358001 / 425163410 / +9.2% 0.65 / 0.67 / -2.7%
tpch_q12/datafusion:vortex-file-compressed 213560577 / 388283213 / -45.0% 🟢 408806791 / 489782211 / -16.5% 0.52 / 0.79 / -34.1%
tpch_q13/datafusion:vortex-file-compressed 141027289 / 305468048 / -53.8% 🟢 346230232 / 466037071 / -25.7% 0.41 / 0.66 / -37.9%
tpch_q14/datafusion:vortex-file-compressed 212393647 / 199620127 / +6.4% 360376391 / 303128127 / +18.9% 0.59 / 0.66 / -10.5%
tpch_q15/datafusion:vortex-file-compressed 311638259 / 328723372 / -5.2% 545635428 / 535953171 / +1.8% 0.57 / 0.61 / -6.9%
tpch_q16/datafusion:vortex-file-compressed 164220338 / 129183088 / +27.1% 275033131 / 304290279 / -9.6% 0.60 / 0.42 / +40.6%
tpch_q17/datafusion:vortex-file-compressed 284561300 / 270099130 / +5.4% 456786896 / 483187156 / -5.5% 0.62 / 0.56 / +11.4%
tpch_q18/datafusion:vortex-file-compressed 318822048 / 297524319 / +7.2% 552482429 / 463921753 / +19.1% 0.58 / 0.64 / -10.0%
tpch_q19/datafusion:vortex-file-compressed 246731964 / 242447769 / +1.8% 402983186 / 409249888 / -1.5% 0.61 / 0.59 / +3.3%
tpch_q20/datafusion:vortex-file-compressed 348936929 / 301198504 / +15.8% 646526216 / 474579897 / +36.2% 🔴 0.54 / 0.63 / -15.0%
tpch_q21/datafusion:vortex-file-compressed 446850828 / 526343938 / -15.1% 693076239 / 981707422 / -29.4% 0.64 / 0.54 / +20.3%
tpch_q22/datafusion:vortex-file-compressed 160266963 / 166649025 / -3.8% 365239489 / 466202686 / -21.7% 0.44 / 0.36 / +22.8%
datafusion / parquet / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 186892834 / 158814686 / +17.7% 616930489 / 439671059 / +40.3% 🔴 0.30 / 0.36 / -16.1%
tpch_q02/datafusion:parquet 289347998 / 304740371 / -5.1% 584691343 / 427448736 / +36.8% 🔴 0.49 / 0.71 / -30.6%
tpch_q03/datafusion:parquet 261975240 / 241158894 / +8.6% 720532124 / 651167920 / +10.7% 0.36 / 0.37 / -1.8%
tpch_q04/datafusion:parquet 151907344 / 135909526 / +11.8% 272457720 / 458430899 / -40.6% 🟢 0.56 / 0.30 / +88.1%
tpch_q05/datafusion:parquet 401231913 / 350374514 / +14.5% 480962768 / 613397025 / -21.6% 0.83 / 0.57 / +46.0%
tpch_q06/datafusion:parquet 124829366 / 211512831 / -41.0% 🟢 215162280 / 445292211 / -51.7% 🟢 0.58 / 0.47 / +22.1%
tpch_q07/datafusion:parquet 348115003 / 416757686 / -16.5% 448529675 / 676840388 / -33.7% 🟢 0.78 / 0.62 / +26.0%
tpch_q08/datafusion:parquet 467092645 / 406774128 / +14.8% 528854178 / 585006324 / -9.6% 0.88 / 0.70 / +27.0%
tpch_q09/datafusion:parquet 405640252 / 414100212 / -2.0% 580053776 / 559104706 / +3.7% 0.70 / 0.74 / -5.6%
tpch_q10/datafusion:parquet 349172275 / 324485758 / +7.6% 431242728 / 403377910 / +6.9% 0.81 / 0.80 / +0.7%
tpch_q11/datafusion:parquet 272438396 / 273361135 / -0.3% 404305846 / 525888838 / -23.1% 0.67 / 0.52 / +29.6%
tpch_q12/datafusion:parquet 178941123 / 177127517 / +1.0% 399195781 / 519191985 / -23.1% 0.45 / 0.34 / +31.4%
tpch_q13/datafusion:parquet 295890000 / 271908071 / +8.8% 542880903 / 438092356 / +23.9% 0.55 / 0.62 / -12.2%
tpch_q14/datafusion:parquet 152377536 / 164113406 / -7.2% 298851325 / 298504654 / +0.1% 0.51 / 0.55 / -7.3%
tpch_q15/datafusion:parquet 309786348 / 305166477 / +1.5% 448674296 / 516744619 / -13.2% 0.69 / 0.59 / +16.9%
tpch_q16/datafusion:parquet 110068498 / 102274521 / +7.6% 229690085 / 227673313 / +0.9% 0.48 / 0.45 / +6.7%
tpch_q17/datafusion:parquet 285838506 / 291877094 / -2.1% 431850133 / 440424737 / -1.9% 0.66 / 0.66 / -0.1%
tpch_q18/datafusion:parquet 317841844 / 378460913 / -16.0% 431732738 / 497138670 / -13.2% 0.74 / 0.76 / -3.3%
tpch_q19/datafusion:parquet 169093386 / 171545813 / -1.4% 346485871 / 288061657 / +20.3% 0.49 / 0.60 / -18.1%
tpch_q20/datafusion:parquet 259845003 / 257752789 / +0.8% 413350200 / 373273142 / +10.7% 0.63 / 0.69 / -9.0%
tpch_q21/datafusion:parquet 327309742 / 336871304 / -2.8% 434535558 / 493831701 / -12.0% 0.75 / 0.68 / +10.4%
tpch_q22/datafusion:parquet 162245478 / 153174332 / +5.9% 335557945 / 306142770 / +9.6% 0.48 / 0.50 / -3.4%
duckdb / vortex-file-compressed / ns (0.901x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 259798918 / 245983071 / +5.6% 286035714 / 427614311 / -33.1% 🟢 0.91 / 0.58 / +57.9%
tpch_q02/duckdb:vortex-file-compressed 409533794 / 441190493 / -7.2% 493298842 / 464391559 / +6.2% 0.83 / 0.95 / -12.6%
tpch_q03/duckdb:vortex-file-compressed 420321846 / 436567808 / -3.7% 464366036 / 450361661 / +3.1% 0.91 / 0.97 / -6.6%
tpch_q04/duckdb:vortex-file-compressed 273638770 / 279144630 / -2.0% 295965457 / 318042948 / -6.9% 0.92 / 0.88 / +5.3%
tpch_q05/duckdb:vortex-file-compressed 541407501 / 925581272 / -41.5% 🟢 591241286 / 1099019099 / -46.2% 🟢 0.92 / 0.84 / +8.7%
tpch_q06/duckdb:vortex-file-compressed 198901680 / 408034074 / -51.3% 🟢 200093438 / 305989907 / -34.6% 🟢 0.99 / 1.33 / -25.5%
tpch_q07/duckdb:vortex-file-compressed 400957896 / 468744622 / -14.5% 448388683 / 522853572 / -14.2% 0.89 / 0.90 / -0.3%
tpch_q08/duckdb:vortex-file-compressed 566005112 / 662789944 / -14.6% 601138110 / 794862129 / -24.4% 0.94 / 0.83 / +12.9%
tpch_q09/duckdb:vortex-file-compressed 405178676 / 403489631 / +0.4% 463244018 / 503284161 / -8.0% 0.87 / 0.80 / +9.1%
tpch_q10/duckdb:vortex-file-compressed 520910083 / 523819622 / -0.6% 565147842 / 595318356 / -5.1% 0.92 / 0.88 / +4.8%
tpch_q11/duckdb:vortex-file-compressed 289381920 / 311504523 / -7.1% 310561419 / 293601696 / +5.8% 0.93 / 1.06 / -12.2%
tpch_q12/duckdb:vortex-file-compressed 251994016 / 336623916 / -25.1% 327196529 / 331540454 / -1.3% 0.77 / 1.02 / -24.1%
tpch_q13/duckdb:vortex-file-compressed 261781226 / 223155036 / +17.3% 256100062 / 311966454 / -17.9% 1.02 / 0.72 / +42.9%
tpch_q14/duckdb:vortex-file-compressed 241170592 / 256880296 / -6.1% 366655013 / 357583935 / +2.5% 0.66 / 0.72 / -8.4%
tpch_q15/duckdb:vortex-file-compressed 246940111 / 248942273 / -0.8% 253939413 / 322394288 / -21.2% 0.97 / 0.77 / +25.9%
tpch_q16/duckdb:vortex-file-compressed 242733239 / 200678858 / +21.0% 198772590 / 224899862 / -11.6% 1.22 / 0.89 / +36.9%
tpch_q17/duckdb:vortex-file-compressed 303373589 / 291672221 / +4.0% 410875056 / 309915158 / +32.6% 🔴 0.74 / 0.94 / -21.5%
tpch_q18/duckdb:vortex-file-compressed 382880965 / 495791219 / -22.8% 472147179 / 610222216 / -22.6% 0.81 / 0.81 / -0.2%
tpch_q19/duckdb:vortex-file-compressed 288629321 / 418534686 / -31.0% 🟢 325571953 / 404257455 / -19.5% 0.89 / 1.04 / -14.4%
tpch_q20/duckdb:vortex-file-compressed 332806210 / 372428208 / -10.6% 1112136308 / 441593262 / +151.8% 🔴 0.30 / 0.84 / -64.5%
tpch_q21/duckdb:vortex-file-compressed 638905916 / 554387905 / +15.2% 627773894 / 608165776 / +3.2% 1.02 / 0.91 / +11.6%
tpch_q22/duckdb:vortex-file-compressed 248253659 / 248467953 / -0.1% 305232649 / 277086143 / +10.2% 0.81 / 0.90 / -9.3%
duckdb / parquet / ns (1.025x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 192529252 / 164976939 / +16.7% 227183202 / 204860353 / +10.9% 0.85 / 0.81 / +5.2%
tpch_q02/duckdb:parquet 444298177 / 501465451 / -11.4% 473391072 / 513407135 / -7.8% 0.94 / 0.98 / -3.9%
tpch_q03/duckdb:parquet 379272875 / 366319149 / +3.5% 473301666 / 397944916 / +18.9% 0.80 / 0.92 / -12.9%
tpch_q04/duckdb:parquet 356100732 / 250909363 / +41.9% 🔴 366356128 / 334878095 / +9.4% 0.97 / 0.75 / +29.7%
tpch_q05/duckdb:parquet 517734033 / 594650969 / -12.9% 552385544 / 658790632 / -16.2% 0.94 / 0.90 / +3.8%
tpch_q06/duckdb:parquet 155823479 / 165234072 / -5.7% 182669571 / 207189043 / -11.8% 0.85 / 0.80 / +7.0%
tpch_q07/duckdb:parquet 441890591 / 466453572 / -5.3% 452486983 / 536373236 / -15.6% 0.98 / 0.87 / +12.3%
tpch_q08/duckdb:parquet 641874360 / 649556107 / -1.2% 633503861 / 581031584 / +9.0% 1.01 / 1.12 / -9.4%
tpch_q09/duckdb:parquet 598171224 / 575347521 / +4.0% 614147019 / 635054812 / -3.3% 0.97 / 0.91 / +7.5%
tpch_q10/duckdb:parquet 523323938 / 566640281 / -7.6% 572155112 / 663826915 / -13.8% 0.91 / 0.85 / +7.2%
tpch_q11/duckdb:parquet 345601363 / 292813485 / +18.0% 324176864 / 317785760 / +2.0% 1.07 / 0.92 / +15.7%
tpch_q12/duckdb:parquet 223366849 / 220614324 / +1.2% 273029974 / 278261820 / -1.9% 0.82 / 0.79 / +3.2%
tpch_q13/duckdb:parquet 370611950 / 355392393 / +4.3% 412412841 / 468245741 / -11.9% 0.90 / 0.76 / +18.4%
tpch_q14/duckdb:parquet 301443591 / 234552068 / +28.5% 385825109 / 290821312 / +32.7% 🔴 0.78 / 0.81 / -3.1%
tpch_q15/duckdb:parquet 260661970 / 200688698 / +29.9% 343554211 / 232126005 / +48.0% 🔴 0.76 / 0.86 / -12.2%
tpch_q16/duckdb:parquet 284927951 / 286791531 / -0.6% 313832579 / 272001842 / +15.4% 0.91 / 1.05 / -13.9%
tpch_q17/duckdb:parquet 292454825 / 308231658 / -5.1% 340846395 / 304930366 / +11.8% 0.86 / 1.01 / -15.1%
tpch_q18/duckdb:parquet 374648331 / 352176737 / +6.4% 416816051 / 363833879 / +14.6% 0.90 / 0.97 / -7.1%
tpch_q19/duckdb:parquet 255187264 / 256008148 / -0.3% 332410283 / 264782579 / +25.5% 0.77 / 0.97 / -20.6%
tpch_q20/duckdb:parquet 431479520 / 559387115 / -22.9% 436522413 / 699324207 / -37.6% 🟢 0.99 / 0.80 / +23.6%
tpch_q21/duckdb:parquet 471713534 / 494971314 / -4.7% 460810631 / 476584480 / -3.3% 1.02 / 1.04 / -1.4%
tpch_q22/duckdb:parquet 298167602 / 297480044 / +0.2% 274733007 / 333595309 / -17.6% 1.09 / 0.89 / +21.7%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR de56ec05 vs base bc585872
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.7%
Engines: DataFusion No clear signal (-9.5%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.950x ➖ · cold 0.954x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.905x ➖, 29↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 37869676 / 34490874 / +9.8% 63292190 / 57725633 / +9.6% 0.60 / 0.60 / +0.1%
tpcds_q02/datafusion:vortex-file-compressed 49515542 / 58812899 / -15.8% 🟢 76346906 / 86424727 / -11.7% 🟢 0.65 / 0.68 / -4.7%
tpcds_q03/datafusion:vortex-file-compressed 20751614 / 20140331 / +3.0% 48211051 / 43427782 / +11.0% 🔴 0.43 / 0.46 / -7.2%
tpcds_q04/datafusion:vortex-file-compressed 298841534 / 450264906 / -33.6% 🟢 357113199 / 514855692 / -30.6% 🟢 0.84 / 0.87 / -4.3%
tpcds_q05/datafusion:vortex-file-compressed 74761214 / 75738608 / -1.3% 109571828 / 110247889 / -0.6% 0.68 / 0.69 / -0.7%
tpcds_q06/datafusion:vortex-file-compressed 43212324 / 57092470 / -24.3% 🟢 71752904 / 84622984 / -15.2% 🟢 0.60 / 0.67 / -10.7%
tpcds_q07/datafusion:vortex-file-compressed 43998062 / 78711698 / -44.1% 🟢 82566912 / 113365994 / -27.2% 🟢 0.53 / 0.69 / -23.3%
tpcds_q08/datafusion:vortex-file-compressed 29822260 / 30510866 / -2.3% 55591473 / 62435045 / -11.0% 🟢 0.54 / 0.49 / +9.8%
tpcds_q09/datafusion:vortex-file-compressed 44186120 / 42998907 / +2.8% 72774714 / 75820090 / -4.0% 0.61 / 0.57 / +7.1%
tpcds_q10/datafusion:vortex-file-compressed 43011284 / 34263287 / +25.5% 🔴 68782702 / 65233275 / +5.4% 0.63 / 0.53 / +19.1%
tpcds_q11/datafusion:vortex-file-compressed 178213263 / 281982230 / -36.8% 🟢 219430648 / 323083169 / -32.1% 🟢 0.81 / 0.87 / -6.9%
tpcds_q12/datafusion:vortex-file-compressed 18447668 / 21462888 / -14.0% 🟢 38028578 / 43354672 / -12.3% 🟢 0.49 / 0.50 / -2.0%
tpcds_q13/datafusion:vortex-file-compressed 39802496 / 41643209 / -4.4% 81445182 / 85879501 / -5.2% 0.49 / 0.48 / +0.8%
tpcds_q14/datafusion:vortex-file-compressed 237434179 / 282213820 / -15.9% 🟢 280785676 / 326372302 / -14.0% 🟢 0.85 / 0.86 / -2.2%
tpcds_q15/datafusion:vortex-file-compressed 42249433 / 40170803 / +5.2% 61792989 / 62132726 / -0.5% 0.68 / 0.65 / +5.8%
tpcds_q16/datafusion:vortex-file-compressed 25010687 / 24149834 / +3.6% 43736635 / 49193215 / -11.1% 🟢 0.57 / 0.49 / +16.5%
tpcds_q17/datafusion:vortex-file-compressed 68676228 / 92828524 / -26.0% 🟢 93401424 / 116103089 / -19.6% 🟢 0.74 / 0.80 / -8.0%
tpcds_q18/datafusion:vortex-file-compressed 68591204 / 67190699 / +2.1% 91369142 / 96516874 / -5.3% 0.75 / 0.70 / +7.8%
tpcds_q19/datafusion:vortex-file-compressed 25432264 / 26287329 / -3.3% 54452605 / 55120303 / -1.2% 0.47 / 0.48 / -2.1%
tpcds_q20/datafusion:vortex-file-compressed 24432662 / 24536924 / -0.4% 41318530 / 42746792 / -3.3% 0.59 / 0.57 / +3.0%
tpcds_q21/datafusion:vortex-file-compressed 49562519 / 54476895 / -9.0% 77732016 / 80307873 / -3.2% 0.64 / 0.68 / -6.0%
tpcds_q22/datafusion:vortex-file-compressed 437481566 / 439765774 / -0.5% 459018669 / 474034422 / -3.2% 0.95 / 0.93 / +2.7%
tpcds_q23/datafusion:vortex-file-compressed 295065484 / 318923484 / -7.5% 361951568 / 371633551 / -2.6% 0.82 / 0.86 / -5.0%
tpcds_q24/datafusion:vortex-file-compressed 118843000 / 167227548 / -28.9% 🟢 163124153 / 204557127 / -20.3% 🟢 0.73 / 0.82 / -10.9%
tpcds_q25/datafusion:vortex-file-compressed 63222882 / 97343062 / -35.1% 🟢 92696799 / 131490121 / -29.5% 🟢 0.68 / 0.74 / -7.9%
tpcds_q26/datafusion:vortex-file-compressed 38987626 / 39503642 / -1.3% 59265152 / 63592861 / -6.8% 0.66 / 0.62 / +5.9%
tpcds_q27/datafusion:vortex-file-compressed 76457174 / 177271178 / -56.9% 🟢 107049539 / 216403002 / -50.5% 🟢 0.71 / 0.82 / -12.8%
tpcds_q28/datafusion:vortex-file-compressed 43796628 / 41661519 / +5.1% 93341951 / 81935560 / +13.9% 🔴 0.47 / 0.51 / -7.7%
tpcds_q29/datafusion:vortex-file-compressed 69603292 / 101208646 / -31.2% 🟢 105154804 / 135125703 / -22.2% 🟢 0.66 / 0.75 / -11.6%
tpcds_q30/datafusion:vortex-file-compressed 52563788 / 49553408 / +6.1% 77903681 / 73603885 / +5.8% 0.67 / 0.67 / +0.2%
tpcds_q31/datafusion:vortex-file-compressed 203678369 / 206128924 / -1.2% 235622456 / 237105640 / -0.6% 0.86 / 0.87 / -0.6%
tpcds_q32/datafusion:vortex-file-compressed 16324028 / 18684705 / -12.6% 🟢 32001335 / 34052924 / -6.0% 0.51 / 0.55 / -7.0%
tpcds_q33/datafusion:vortex-file-compressed 35424486 / 37356493 / -5.2% 69594897 / 70394280 / -1.1% 0.51 / 0.53 / -4.1%
tpcds_q34/datafusion:vortex-file-compressed 44244956 / 42160296 / +4.9% 70398611 / 71862138 / -2.0% 0.63 / 0.59 / +7.1%
tpcds_q35/datafusion:vortex-file-compressed 94437641 / 93986138 / +0.5% 124608210 / 121554351 / +2.5% 0.76 / 0.77 / -2.0%
tpcds_q36/datafusion:vortex-file-compressed 72910000 / 92969324 / -21.6% 🟢 101501278 / 128291724 / -20.9% 🟢 0.72 / 0.72 / -0.9%
tpcds_q37/datafusion:vortex-file-compressed 26854483 / 28914150 / -7.1% 42021053 / 57933171 / -27.5% 🟢 0.64 / 0.50 / +28.0%
tpcds_q38/datafusion:vortex-file-compressed 79379277 / 81638460 / -2.8% 108647573 / 110911360 / -2.0% 0.73 / 0.74 / -0.7%
tpcds_q39/datafusion:vortex-file-compressed 889420133 / 900504494 / -1.2% 907349485 / 922343334 / -1.6% 0.98 / 0.98 / +0.4%
tpcds_q40/datafusion:vortex-file-compressed 29998618 / 30511664 / -1.7% 49727974 / 53843252 / -7.6% 0.60 / 0.57 / +6.5%
tpcds_q41/datafusion:vortex-file-compressed 22298464 / 21876338 / +1.9% 33226190 / 33765092 / -1.6% 0.67 / 0.65 / +3.6%
tpcds_q42/datafusion:vortex-file-compressed 14901370 / 16901763 / -11.8% 🟢 37839278 / 43099042 / -12.2% 🟢 0.39 / 0.39 / +0.4%
tpcds_q43/datafusion:vortex-file-compressed 20082097 / 21294766 / -5.7% 42121556 / 45384260 / -7.2% 0.48 / 0.47 / +1.6%
tpcds_q44/datafusion:vortex-file-compressed 44076746 / 43183290 / +2.1% 71951590 / 70706201 / +1.8% 0.61 / 0.61 / +0.3%
tpcds_q45/datafusion:vortex-file-compressed 45543536 / 50201178 / -9.3% 67481508 / 72028108 / -6.3% 0.67 / 0.70 / -3.2%
tpcds_q46/datafusion:vortex-file-compressed 73289672 / 75757644 / -3.3% 103444970 / 118839287 / -13.0% 🟢 0.71 / 0.64 / +11.1%
tpcds_q47/datafusion:vortex-file-compressed 179253210 / 220625616 / -18.8% 🟢 221214909 / 267833508 / -17.4% 🟢 0.81 / 0.82 / -1.6%
tpcds_q48/datafusion:vortex-file-compressed 38397797 / 41306743 / -7.0% 71231517 / 77324802 / -7.9% 0.54 / 0.53 / +0.9%
tpcds_q49/datafusion:vortex-file-compressed 78055758 / 87957089 / -11.3% 🟢 123643887 / 122907868 / +0.6% 0.63 / 0.72 / -11.8%
tpcds_q50/datafusion:vortex-file-compressed 57597174 / 62256967 / -7.5% 87378169 / 96516948 / -9.5% 0.66 / 0.65 / +2.2%
tpcds_q51/datafusion:vortex-file-compressed 242622001 / 246923648 / -1.7% 272191559 / 281653954 / -3.4% 0.89 / 0.88 / +1.7%
tpcds_q52/datafusion:vortex-file-compressed 15041607 / 17285503 / -13.0% 🟢 39827302 / 40985346 / -2.8% 0.38 / 0.42 / -10.5%
tpcds_q53/datafusion:vortex-file-compressed 25197912 / 27051042 / -6.9% 54343302 / 57589489 / -5.6% 0.46 / 0.47 / -1.3%
tpcds_q54/datafusion:vortex-file-compressed 62278900 / 56122356 / +11.0% 🔴 91078692 / 90359153 / +0.8% 0.68 / 0.62 / +10.1%
tpcds_q55/datafusion:vortex-file-compressed 14400822 / 16813094 / -14.3% 🟢 38608032 / 41488837 / -6.9% 0.37 / 0.41 / -8.0%
tpcds_q56/datafusion:vortex-file-compressed 35216182 / 37525361 / -6.2% 62982070 / 70422183 / -10.6% 🟢 0.56 / 0.53 / +4.9%
tpcds_q57/datafusion:vortex-file-compressed 135298582 / 130749388 / +3.5% 164891588 / 159823264 / +3.2% 0.82 / 0.82 / +0.3%
tpcds_q58/datafusion:vortex-file-compressed 50932034 / 69904782 / -27.1% 🟢 87986547 / 102515657 / -14.2% 🟢 0.58 / 0.68 / -15.1%
tpcds_q59/datafusion:vortex-file-compressed 57266612 / 94205275 / -39.2% 🟢 83551014 / 132603974 / -37.0% 🟢 0.69 / 0.71 / -3.5%
tpcds_q60/datafusion:vortex-file-compressed 36000156 / 37695802 / -4.5% 63034919 / 67024214 / -6.0% 0.57 / 0.56 / +1.5%
tpcds_q61/datafusion:vortex-file-compressed 42751524 / 52971280 / -19.3% 🟢 74816849 / 87180670 / -14.2% 🟢 0.57 / 0.61 / -6.0%
tpcds_q62/datafusion:vortex-file-compressed 21706190 / 22501192 / -3.5% 41326334 / 45420401 / -9.0% 0.53 / 0.50 / +6.0%
tpcds_q63/datafusion:vortex-file-compressed 24192005 / 26800512 / -9.7% 51996505 / 56167705 / -7.4% 0.47 / 0.48 / -2.5%
tpcds_q64/datafusion:vortex-file-compressed 338812347 / 496052193 / -31.7% 🟢 408812940 / 565751330 / -27.7% 🟢 0.83 / 0.88 / -5.5%
tpcds_q65/datafusion:vortex-file-compressed 77656820 / 80814909 / -3.9% 112569544 / 117797913 / -4.4% 0.69 / 0.69 / +0.6%
tpcds_q66/datafusion:vortex-file-compressed 55349008 / 68209772 / -18.9% 🟢 78676350 / 96514374 / -18.5% 🟢 0.70 / 0.71 / -0.5%
tpcds_q67/datafusion:vortex-file-compressed 423807556 / 421663222 / +0.5% 521099041 / 505206016 / +3.1% 0.81 / 0.83 / -2.6%
tpcds_q68/datafusion:vortex-file-compressed 67393998 / 74050378 / -9.0% 103024495 / 118347971 / -12.9% 🟢 0.65 / 0.63 / +4.5%
tpcds_q69/datafusion:vortex-file-compressed 40422237 / 33943142 / +19.1% 🔴 67921684 / 63279430 / +7.3% 0.60 / 0.54 / +10.9%
tpcds_q70/datafusion:vortex-file-compressed 196297926 / 200734872 / -2.2% 230022924 / 240634791 / -4.4% 0.85 / 0.83 / +2.3%
tpcds_q71/datafusion:vortex-file-compressed 26256824 / 28797142 / -8.8% 57658522 / 59756916 / -3.5% 0.46 / 0.48 / -5.5%
tpcds_q72/datafusion:vortex-file-compressed 1655041546 / 4537106302 / -63.5% 🟢 1606319187 / 4762972832 / -66.3% 🟢 1.03 / 0.95 / +8.2%
tpcds_q73/datafusion:vortex-file-compressed 41571840 / 40062268 / +3.8% 65703344 / 72226243 / -9.0% 0.63 / 0.55 / +14.1%
tpcds_q74/datafusion:vortex-file-compressed 139870271 / 186587281 / -25.0% 🟢 172627567 / 221953895 / -22.2% 🟢 0.81 / 0.84 / -3.6%
tpcds_q75/datafusion:vortex-file-compressed 160027120 / 173869828 / -8.0% 208960730 / 211973023 / -1.4% 0.77 / 0.82 / -6.6%
tpcds_q76/datafusion:vortex-file-compressed 34675480 / 34473709 / +0.6% 75005506 / 72066194 / +4.1% 0.46 / 0.48 / -3.4%
tpcds_q77/datafusion:vortex-file-compressed 57499478 / 59229286 / -2.9% 88300282 / 93188176 / -5.2% 0.65 / 0.64 / +2.5%
tpcds_q78/datafusion:vortex-file-compressed 143553044 / 195390051 / -26.5% 🟢 194572664 / 244579342 / -20.4% 🟢 0.74 / 0.80 / -7.6%
tpcds_q79/datafusion:vortex-file-compressed 56789782 / 56071345 / +1.3% 88111836 / 88050597 / +0.1% 0.64 / 0.64 / +1.2%
tpcds_q80/datafusion:vortex-file-compressed 82851194 / 143028338 / -42.1% 🟢 132071106 / 187099953 / -29.4% 🟢 0.63 / 0.76 / -17.9%
tpcds_q81/datafusion:vortex-file-compressed 57939000 / 54750336 / +5.8% 82685145 / 79880741 / +3.5% 0.70 / 0.69 / +2.2%
tpcds_q82/datafusion:vortex-file-compressed 32716332 / 33168910 / -1.4% 57820765 / 71357135 / -19.0% 🟢 0.57 / 0.46 / +21.7%
tpcds_q83/datafusion:vortex-file-compressed 43612807 / 39880804 / +9.4% 67765219 / 62002557 / +9.3% 0.64 / 0.64 / +0.1%
tpcds_q84/datafusion:vortex-file-compressed 14207213 / 12014408 / +18.3% 🔴 31409446 / 29972891 / +4.8% 0.45 / 0.40 / +12.8%
tpcds_q85/datafusion:vortex-file-compressed 64937014 / 61535551 / +5.5% 93134826 / 89287485 / +4.3% 0.70 / 0.69 / +1.2%
tpcds_q86/datafusion:vortex-file-compressed 19352798 / 18959252 / +2.1% 40185757 / 39090155 / +2.8% 0.48 / 0.49 / -0.7%
tpcds_q87/datafusion:vortex-file-compressed 82690896 / 82950631 / -0.3% 110212391 / 108727952 / +1.4% 0.75 / 0.76 / -1.7%
tpcds_q88/datafusion:vortex-file-compressed 66116831 / 69301148 / -4.6% 102897374 / 104284597 / -1.3% 0.64 / 0.66 / -3.3%
tpcds_q89/datafusion:vortex-file-compressed 28325347 / 31062054 / -8.8% 55126759 / 61671456 / -10.6% 🟢 0.51 / 0.50 / +2.0%
tpcds_q90/datafusion:vortex-file-compressed 15736819 / 12840910 / +22.6% 🔴 32512191 / 31064250 / +4.7% 0.48 / 0.41 / +17.1%
tpcds_q91/datafusion:vortex-file-compressed 21135152 / 19570972 / +8.0% 44867939 / 40130324 / +11.8% 🔴 0.47 / 0.49 / -3.4%
tpcds_q92/datafusion:vortex-file-compressed 17620780 / 15892456 / +10.9% 🔴 37823680 / 37181636 / +1.7% 0.47 / 0.43 / +9.0%
tpcds_q93/datafusion:vortex-file-compressed 54242862 / 55230424 / -1.8% 94324369 / 85697212 / +10.1% 🔴 0.58 / 0.64 / -10.8%
tpcds_q94/datafusion:vortex-file-compressed 23943100 / 22415792 / +6.8% 47598093 / 47331792 / +0.6% 0.50 / 0.47 / +6.2%
tpcds_q95/datafusion:vortex-file-compressed 97545370 / 96131327 / +1.5% 125546630 / 123214779 / +1.9% 0.78 / 0.78 / -0.4%
tpcds_q96/datafusion:vortex-file-compressed 12806345 / 13669360 / -6.3% 33035473 / 37980297 / -13.0% 🟢 0.39 / 0.36 / +7.7%
tpcds_q97/datafusion:vortex-file-compressed 40706540 / 41433282 / -1.8% 66326475 / 71403658 / -7.1% 0.61 / 0.58 / +5.8%
tpcds_q98/datafusion:vortex-file-compressed 20664039 / 40346230 / -48.8% 🟢 47448924 / 69356584 / -31.6% 🟢 0.44 / 0.58 / -25.1%
tpcds_q99/datafusion:vortex-file-compressed 30865173 / 28227145 / +9.3% 50623480 / 49243634 / +2.8% 0.61 / 0.57 / +6.4%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59444452 / 59562394 / -0.2% 75264975 / 81973541 / -8.2% 0.79 / 0.73 / +8.7%
tpcds_q02/datafusion:parquet 69746567 / 68848089 / +1.3% 93044326 / 92685301 / +0.4% 0.75 / 0.74 / +0.9%
tpcds_q03/datafusion:parquet 28323843 / 28746309 / -1.5% 51722766 / 51612248 / +0.2% 0.55 / 0.56 / -1.7%
tpcds_q04/datafusion:parquet 641637606 / 642054766 / -0.1% 704434015 / 716901330 / -1.7% 0.91 / 0.90 / +1.7%
tpcds_q05/datafusion:parquet 81926021 / 82374102 / -0.5% 110367730 / 115476819 / -4.4% 0.74 / 0.71 / +4.1%
tpcds_q06/datafusion:parquet 90684460 / 91755252 / -1.2% 114772313 / 113221732 / +1.4% 0.79 / 0.81 / -2.5%
tpcds_q07/datafusion:parquet 100190278 / 101268458 / -1.1% 137631253 / 132847458 / +3.6% 0.73 / 0.76 / -4.5%
tpcds_q08/datafusion:parquet 48524434 / 49068442 / -1.1% 76622302 / 75878698 / +1.0% 0.63 / 0.65 / -2.1%
tpcds_q09/datafusion:parquet 75318888 / 75357990 / -0.1% 104459801 / 104173380 / +0.3% 0.72 / 0.72 / -0.3%
tpcds_q10/datafusion:parquet 58933134 / 59205446 / -0.5% 79594342 / 84151393 / -5.4% 0.74 / 0.70 / +5.2%
tpcds_q11/datafusion:parquet 414336134 / 415068906 / -0.2% 454673506 / 462653926 / -1.7% 0.91 / 0.90 / +1.6%
tpcds_q12/datafusion:parquet 40529097 / 40226532 / +0.8% 57193468 / 57933216 / -1.3% 0.71 / 0.69 / +2.1%
tpcds_q13/datafusion:parquet 85185880 / 85313794 / -0.1% 131295828 / 136668962 / -3.9% 0.65 / 0.62 / +3.9%
tpcds_q14/datafusion:parquet 404678119 / 380378514 / +6.4% 411125145 / 409373209 / +0.4% 0.98 / 0.93 / +5.9%
tpcds_q15/datafusion:parquet 50937872 / 51134539 / -0.4% 70978665 / 72526095 / -2.1% 0.72 / 0.71 / +1.8%
tpcds_q16/datafusion:parquet 45776538 / 45265184 / +1.1% 62859831 / 63003582 / -0.2% 0.73 / 0.72 / +1.4%
tpcds_q17/datafusion:parquet 136156692 / 136275040 / -0.1% 178149508 / 179342009 / -0.7% 0.76 / 0.76 / +0.6%
tpcds_q18/datafusion:parquet 109994240 / 109581858 / +0.4% 142958694 / 143676017 / -0.5% 0.77 / 0.76 / +0.9%
tpcds_q19/datafusion:parquet 48280371 / 48626202 / -0.7% 78969128 / 76609170 / +3.1% 0.61 / 0.63 / -3.7%
tpcds_q20/datafusion:parquet 42044023 / 41204176 / +2.0% 54522705 / 54456650 / +0.1% 0.77 / 0.76 / +1.9%
tpcds_q21/datafusion:parquet 61446674 / 61394890 / +0.1% 72933470 / 75148543 / -2.9% 0.84 / 0.82 / +3.1%
tpcds_q22/datafusion:parquet 464155412 / 463076374 / +0.2% 477514687 / 479287012 / -0.4% 0.97 / 0.97 / +0.6%
tpcds_q23/datafusion:parquet 363503986 / 366050916 / -0.7% 417100558 / 407254701 / +2.4% 0.87 / 0.90 / -3.0%
tpcds_q24/datafusion:parquet 245713026 / 240909515 / +2.0% 274056906 / 281981770 / -2.8% 0.90 / 0.85 / +4.9%
tpcds_q25/datafusion:parquet 145372088 / 145096427 / +0.2% 193501068 / 195545916 / -1.0% 0.75 / 0.74 / +1.2%
tpcds_q26/datafusion:parquet 55005222 / 55722818 / -1.3% 79778416 / 79268195 / +0.6% 0.69 / 0.70 / -1.9%
tpcds_q27/datafusion:parquet 210612841 / 212580704 / -0.9% 242518917 / 235658266 / +2.9% 0.87 / 0.90 / -3.7%
tpcds_q28/datafusion:parquet 87634450 / 86765016 / +1.0% 116645880 / 117066376 / -0.4% 0.75 / 0.74 / +1.4%
tpcds_q29/datafusion:parquet 142505656 / 144458204 / -1.4% 181315255 / 175304610 / +3.4% 0.79 / 0.82 / -4.6%
tpcds_q30/datafusion:parquet 98753134 / 98208516 / +0.6% 117194861 / 120202265 / -2.5% 0.84 / 0.82 / +3.1%
tpcds_q31/datafusion:parquet 319211844 / 321872676 / -0.8% 346440448 / 348415189 / -0.6% 0.92 / 0.92 / -0.3%
tpcds_q32/datafusion:parquet 29231757 / 29450601 / -0.7% 45914505 / 44853411 / +2.4% 0.64 / 0.66 / -3.0%
tpcds_q33/datafusion:parquet 49912954 / 52044530 / -4.1% 77918400 / 82308146 / -5.3% 0.64 / 0.63 / +1.3%
tpcds_q34/datafusion:parquet 63285048 / 63766546 / -0.8% 83788423 / 84790324 / -1.2% 0.76 / 0.75 / +0.4%
tpcds_q35/datafusion:parquet 124336435 / 124934560 / -0.5% 149296106 / 151283099 / -1.3% 0.83 / 0.83 / +0.8%
tpcds_q36/datafusion:parquet 99195945 / 98102672 / +1.1% 129427079 / 130923561 / -1.1% 0.77 / 0.75 / +2.3%
tpcds_q37/datafusion:parquet 51594220 / 50165633 / +2.8% 66497717 / 67878392 / -2.0% 0.78 / 0.74 / +5.0%
tpcds_q38/datafusion:parquet 124774824 / 125216310 / -0.4% 147067741 / 147419308 / -0.2% 0.85 / 0.85 / -0.1%
tpcds_q39/datafusion:parquet 847384277 / 846800026 / +0.1% 863815224 / 870067394 / -0.7% 0.98 / 0.97 / +0.8%
tpcds_q40/datafusion:parquet 35819012 / 34827391 / +2.8% 56690852 / 53960445 / +5.1% 0.63 / 0.65 / -2.1%
tpcds_q41/datafusion:parquet 31989888 / 31935535 / +0.2% 42956139 / 42034458 / +2.2% 0.74 / 0.76 / -2.0%
tpcds_q42/datafusion:parquet 25971031 / 26814002 / -3.1% 46262706 / 44585334 / +3.8% 0.56 / 0.60 / -6.7%
tpcds_q43/datafusion:parquet 26867864 / 26916072 / -0.2% 49498169 / 46897888 / +5.5% 0.54 / 0.57 / -5.4%
tpcds_q44/datafusion:parquet 66869256 / 66797887 / +0.1% 87028718 / 84812924 / +2.6% 0.77 / 0.79 / -2.4%
tpcds_q45/datafusion:parquet 64535936 / 65615575 / -1.6% 87119139 / 88256618 / -1.3% 0.74 / 0.74 / -0.4%
tpcds_q46/datafusion:parquet 108664926 / 107003158 / +1.6% 150474103 / 145686621 / +3.3% 0.72 / 0.73 / -1.7%
tpcds_q47/datafusion:parquet 235773591 / 236868468 / -0.5% 273740767 / 272641305 / +0.4% 0.86 / 0.87 / -0.9%
tpcds_q48/datafusion:parquet 77563618 / 78542064 / -1.2% 107077727 / 106935458 / +0.1% 0.72 / 0.73 / -1.4%
tpcds_q49/datafusion:parquet 116951966 / 115474834 / +1.3% 154189127 / 158864958 / -2.9% 0.76 / 0.73 / +4.4%
tpcds_q50/datafusion:parquet 91539008 / 91439884 / +0.1% 120447655 / 125599739 / -4.1% 0.76 / 0.73 / +4.4%
tpcds_q51/datafusion:parquet 252851868 / 253297316 / -0.2% 282023069 / 286678638 / -1.6% 0.90 / 0.88 / +1.5%
tpcds_q52/datafusion:parquet 26756216 / 26843905 / -0.3% 45805445 / 46810874 / -2.1% 0.58 / 0.57 / +1.9%
tpcds_q53/datafusion:parquet 35998024 / 36642923 / -1.8% 60656383 / 60564577 / +0.2% 0.59 / 0.61 / -1.9%
tpcds_q54/datafusion:parquet 85436422 / 85820838 / -0.4% 110807407 / 106867334 / +3.7% 0.77 / 0.80 / -4.0%
tpcds_q55/datafusion:parquet 26335439 / 26084212 / +1.0% 45776618 / 46467652 / -1.5% 0.58 / 0.56 / +2.5%
tpcds_q56/datafusion:parquet 53651387 / 52435182 / +2.3% 78245483 / 72888576 / +7.3% 0.69 / 0.72 / -4.7%
tpcds_q57/datafusion:parquet 170589979 / 171380706 / -0.5% 193418579 / 192267162 / +0.6% 0.88 / 0.89 / -1.1%
tpcds_q58/datafusion:parquet 98925990 / 96622320 / +2.4% 125293684 / 124538672 / +0.6% 0.79 / 0.78 / +1.8%
tpcds_q59/datafusion:parquet 104479146 / 106425224 / -1.8% 131366366 / 128937355 / +1.9% 0.80 / 0.83 / -3.6%
tpcds_q60/datafusion:parquet 55580337 / 54478058 / +2.0% 76039127 / 72860476 / +4.4% 0.73 / 0.75 / -2.2%
tpcds_q61/datafusion:parquet 74748810 / 77744132 / -3.9% 100098631 / 106954389 / -6.4% 0.75 / 0.73 / +2.7%
tpcds_q62/datafusion:parquet 27833130 / 27901132 / -0.2% 44767633 / 44366723 / +0.9% 0.62 / 0.63 / -1.1%
tpcds_q63/datafusion:parquet 35988200 / 37113916 / -3.0% 57332105 / 59011631 / -2.8% 0.63 / 0.63 / -0.2%
tpcds_q64/datafusion:parquet 664357514 / 665177948 / -0.1% 744715516 / 730407973 / +2.0% 0.89 / 0.91 / -2.0%
tpcds_q65/datafusion:parquet 101863847 / 102433006 / -0.6% 133430518 / 135909758 / -1.8% 0.76 / 0.75 / +1.3%
tpcds_q66/datafusion:parquet 77056252 / 75430672 / +2.2% 102760919 / 100699574 / +2.0% 0.75 / 0.75 / +0.1%
tpcds_q67/datafusion:parquet 434191824 / 432250701 / +0.4% 501150989 / 497319408 / +0.8% 0.87 / 0.87 / -0.3%
tpcds_q68/datafusion:parquet 106970748 / 108807174 / -1.7% 152433982 / 152510432 / -0.1% 0.70 / 0.71 / -1.6%
tpcds_q69/datafusion:parquet 61589481 / 63114425 / -2.4% 83953166 / 82528330 / +1.7% 0.73 / 0.76 / -4.1%
tpcds_q70/datafusion:parquet 211290390 / 212366031 / -0.5% 240149827 / 243604712 / -1.4% 0.88 / 0.87 / +0.9%
tpcds_q71/datafusion:parquet 37051968 / 38092440 / -2.7% 67657540 / 63256325 / +7.0% 0.55 / 0.60 / -9.1%
tpcds_q72/datafusion:parquet 1766206958 / 1742177002 / +1.4% 1912810774 / 1814091911 / +5.4% 0.92 / 0.96 / -3.9%
tpcds_q73/datafusion:parquet 62041258 / 63371411 / -2.1% 86012174 / 84148263 / +2.2% 0.72 / 0.75 / -4.2%
tpcds_q74/datafusion:parquet 292280351 / 293656254 / -0.5% 329821615 / 319622384 / +3.2% 0.89 / 0.92 / -3.5%
tpcds_q75/datafusion:parquet 196802110 / 196057900 / +0.4% 235771514 / 236618530 / -0.4% 0.83 / 0.83 / +0.7%
tpcds_q76/datafusion:parquet 49874744 / 50425142 / -1.1% 88275250 / 79819285 / +10.6% 🔴 0.56 / 0.63 / -10.6%
tpcds_q77/datafusion:parquet 75628494 / 72301754 / +4.6% 100859418 / 103409963 / -2.5% 0.75 / 0.70 / +7.2%
tpcds_q78/datafusion:parquet 209668936 / 209493442 / +0.1% 270386504 / 266922507 / +1.3% 0.78 / 0.78 / -1.2%
tpcds_q79/datafusion:parquet 78113651 / 77443161 / +0.9% 118120187 / 111775710 / +5.7% 0.66 / 0.69 / -4.6%
tpcds_q80/datafusion:parquet 144826630 / 144503946 / +0.2% 191045617 / 192216581 / -0.6% 0.76 / 0.75 / +0.8%
tpcds_q81/datafusion:parquet 108222662 / 106333185 / +1.8% 125534615 / 132800070 / -5.5% 0.86 / 0.80 / +7.7%
tpcds_q82/datafusion:parquet 54468395 / 53977774 / +0.9% 69816763 / 71607449 / -2.5% 0.78 / 0.75 / +3.5%
tpcds_q83/datafusion:parquet 66341214 / 66298842 / +0.1% 85769425 / 84435444 / +1.6% 0.77 / 0.79 / -1.5%
tpcds_q84/datafusion:parquet 35941184 / 35742750 / +0.6% 49177894 / 49263496 / -0.2% 0.73 / 0.73 / +0.7%
tpcds_q85/datafusion:parquet 104571468 / 103070485 / +1.5% 132342600 / 131123967 / +0.9% 0.79 / 0.79 / +0.5%
tpcds_q86/datafusion:parquet 21865210 / 22436760 / -2.5% 40432909 / 38784273 / +4.3% 0.54 / 0.58 / -6.5%
tpcds_q87/datafusion:parquet 123265366 / 120499232 / +2.3% 143892409 / 141332266 / +1.8% 0.86 / 0.85 / +0.5%
tpcds_q88/datafusion:parquet 85842949 / 84561665 / +1.5% 106789277 / 107508639 / -0.7% 0.80 / 0.79 / +2.2%
tpcds_q89/datafusion:parquet 38115270 / 39496004 / -3.5% 62858256 / 62334871 / +0.8% 0.61 / 0.63 / -4.3%
tpcds_q90/datafusion:parquet 17648584 / 17393990 / +1.5% 30810659 / 30214220 / +2.0% 0.57 / 0.58 / -0.5%
tpcds_q91/datafusion:parquet 42701367 / 42590936 / +0.3% 58949870 / 57755609 / +2.1% 0.72 / 0.74 / -1.8%
tpcds_q92/datafusion:parquet 29505456 / 28789643 / +2.5% 46925843 / 46759505 / +0.4% 0.63 / 0.62 / +2.1%
tpcds_q93/datafusion:parquet 61633542 / 62259186 / -1.0% 86861071 / 91513510 / -5.1% 0.71 / 0.68 / +4.3%
tpcds_q94/datafusion:parquet 38220506 / 38399588 / -0.5% 57732776 / 56853395 / +1.5% 0.66 / 0.68 / -2.0%
tpcds_q95/datafusion:parquet 130134654 / 125127494 / +4.0% 150485063 / 152170307 / -1.1% 0.86 / 0.82 / +5.2%
tpcds_q96/datafusion:parquet 21391868 / 21551494 / -0.7% 35101874 / 37486344 / -6.4% 0.61 / 0.57 / +6.0%
tpcds_q97/datafusion:parquet 54289645 / 55529435 / -2.2% 78661230 / 78742438 / -0.1% 0.69 / 0.71 / -2.1%
tpcds_q98/datafusion:parquet 62585011 / 61361914 / +2.0% 86132522 / 85723274 / +0.5% 0.73 / 0.72 / +1.5%
tpcds_q99/datafusion:parquet 42946703 / 42604324 / +0.8% 58314190 / 56908149 / +2.5% 0.74 / 0.75 / -1.6%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32992808 / 32763675 / +0.7% 45484445 / 44558273 / +2.1% 0.73 / 0.74 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed 30435508 / 30374604 / +0.2% 42445217 / 44907404 / -5.5% 0.72 / 0.68 / +6.0%
tpcds_q03/duckdb:vortex-file-compressed 13407170 / 13633820 / -1.7% 29390216 / 28698242 / +2.4% 0.46 / 0.48 / -4.0%
tpcds_q04/duckdb:vortex-file-compressed 129643964 / 129476176 / +0.1% 157446460 / 154922833 / +1.6% 0.82 / 0.84 / -1.5%
tpcds_q05/duckdb:vortex-file-compressed 55104582 / 54440849 / +1.2% 77274504 / 77315332 / -0.1% 0.71 / 0.70 / +1.3%
tpcds_q06/duckdb:vortex-file-compressed 58613712 / 58862882 / -0.4% 76737808 / 78125689 / -1.8% 0.76 / 0.75 / +1.4%
tpcds_q07/duckdb:vortex-file-compressed 30485807 / 30799532 / -1.0% 54112536 / 54567910 / -0.8% 0.56 / 0.56 / -0.2%
tpcds_q08/duckdb:vortex-file-compressed 31056368 / 30902362 / +0.5% 46900393 / 47089342 / -0.4% 0.66 / 0.66 / +0.9%
tpcds_q09/duckdb:vortex-file-compressed 57185180 / 56307219 / +1.6% 81017215 / 77386697 / +4.7% 0.71 / 0.73 / -3.0%
tpcds_q10/duckdb:vortex-file-compressed 38773968 / 38690641 / +0.2% 59104883 / 56640742 / +4.4% 0.66 / 0.68 / -4.0%
tpcds_q11/duckdb:vortex-file-compressed 95604249 / 95487010 / +0.1% 113746201 / 112989411 / +0.7% 0.84 / 0.85 / -0.5%
tpcds_q12/duckdb:vortex-file-compressed 17260312 / 17148132 / +0.7% 29916917 / 30360974 / -1.5% 0.58 / 0.56 / +2.1%
tpcds_q13/duckdb:vortex-file-compressed 40838454 / 40079477 / +1.9% 74276545 / 75080354 / -1.1% 0.55 / 0.53 / +3.0%
tpcds_q14/duckdb:vortex-file-compressed 116711828 / 122643171 / -4.8% 138512455 / 139635966 / -0.8% 0.84 / 0.88 / -4.1%
tpcds_q15/duckdb:vortex-file-compressed 60639778 / 60556696 / +0.1% 69195136 / 73276052 / -5.6% 0.88 / 0.83 / +6.0%
tpcds_q16/duckdb:vortex-file-compressed 34279794 / 34363846 / -0.2% 53991718 / 52445315 / +2.9% 0.63 / 0.66 / -3.1%
tpcds_q17/duckdb:vortex-file-compressed 57459405 / 58137380 / -1.2% 82998972 / 81079356 / +2.4% 0.69 / 0.72 / -3.5%
tpcds_q18/duckdb:vortex-file-compressed 82870234 / 83094493 / -0.3% 104275057 / 103122587 / +1.1% 0.79 / 0.81 / -1.4%
tpcds_q19/duckdb:vortex-file-compressed 44584741 / 45427502 / -1.9% 62584758 / 62595331 / -0.0% 0.71 / 0.73 / -1.8%
tpcds_q20/duckdb:vortex-file-compressed 22275468 / 22006184 / +1.2% 36075893 / 36906718 / -2.3% 0.62 / 0.60 / +3.6%
tpcds_q21/duckdb:vortex-file-compressed 27826450 / 28293348 / -1.7% 62504590 / 60029278 / +4.1% 0.45 / 0.47 / -5.5%
tpcds_q22/duckdb:vortex-file-compressed 163420250 / 165899288 / -1.5% 173510981 / 176791722 / -1.9% 0.94 / 0.94 / +0.4%
tpcds_q23/duckdb:vortex-file-compressed 181028864 / 182310708 / -0.7% 197800160 / 196529307 / +0.6% 0.92 / 0.93 / -1.3%
tpcds_q24/duckdb:vortex-file-compressed 52479826 / 52660262 / -0.3% 75980007 / 78858307 / -3.6% 0.69 / 0.67 / +3.4%
tpcds_q25/duckdb:vortex-file-compressed 53945617 / 54027358 / -0.2% 78271437 / 78713086 / -0.6% 0.69 / 0.69 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed 26640588 / 26462774 / +0.7% 42268878 / 43499143 / -2.8% 0.63 / 0.61 / +3.6%
tpcds_q27/duckdb:vortex-file-compressed 31776892 / 31846126 / -0.2% 52449148 / 52686770 / -0.5% 0.61 / 0.60 / +0.2%
tpcds_q28/duckdb:vortex-file-compressed 42828760 / 45091776 / -5.0% 64328297 / 67356868 / -4.5% 0.67 / 0.67 / -0.5%
tpcds_q29/duckdb:vortex-file-compressed 52816794 / 53041025 / -0.4% 76123470 / 75283227 / +1.1% 0.69 / 0.70 / -1.5%
tpcds_q30/duckdb:vortex-file-compressed 38556744 / 37938584 / +1.6% 51144273 / 49468422 / +3.4% 0.75 / 0.77 / -1.7%
tpcds_q31/duckdb:vortex-file-compressed 37271410 / 36859340 / +1.1% 51432957 / 53612859 / -4.1% 0.72 / 0.69 / +5.4%
tpcds_q32/duckdb:vortex-file-compressed 13733180 / 13819659 / -0.6% 29385512 / 28481156 / +3.2% 0.47 / 0.49 / -3.7%
tpcds_q33/duckdb:vortex-file-compressed 34299236 / 33773584 / +1.6% 56268859 / 58479664 / -3.8% 0.61 / 0.58 / +5.5%
tpcds_q34/duckdb:vortex-file-compressed 22904607 / 22674972 / +1.0% 39397535 / 37521700 / +5.0% 0.58 / 0.60 / -3.8%
tpcds_q35/duckdb:vortex-file-compressed 67979901 / 67663247 / +0.5% 88844785 / 88547962 / +0.3% 0.77 / 0.76 / +0.1%
tpcds_q36/duckdb:vortex-file-compressed 29386196 / 29338673 / +0.2% 49075635 / 49925509 / -1.7% 0.60 / 0.59 / +1.9%
tpcds_q37/duckdb:vortex-file-compressed 25856256 / 26388705 / -2.0% 76828622 / 72910227 / +5.4% 0.34 / 0.36 / -7.0%
tpcds_q38/duckdb:vortex-file-compressed 59833794 / 59506108 / +0.6% 80007081 / 73786319 / +8.4% 0.75 / 0.81 / -7.3%
tpcds_q39/duckdb:vortex-file-compressed 54826434 / 54747094 / +0.1% 84364903 / 86734103 / -2.7% 0.65 / 0.63 / +3.0%
tpcds_q40/duckdb:vortex-file-compressed 19192820 / 19222596 / -0.2% 35591404 / 35672258 / -0.2% 0.54 / 0.54 / +0.1%
tpcds_q41/duckdb:vortex-file-compressed 20544136 / 20582048 / -0.2% 27569942 / 27464645 / +0.4% 0.75 / 0.75 / -0.6%
tpcds_q42/duckdb:vortex-file-compressed 13890620 / 14545142 / -4.5% 29642069 / 30445715 / -2.6% 0.47 / 0.48 / -1.9%
tpcds_q43/duckdb:vortex-file-compressed 18892123 / 19269486 / -2.0% 32574519 / 32726433 / -0.5% 0.58 / 0.59 / -1.5%
tpcds_q44/duckdb:vortex-file-compressed 28471618 / 28278198 / +0.7% 48849466 / 48604354 / +0.5% 0.58 / 0.58 / +0.2%
tpcds_q45/duckdb:vortex-file-compressed 47101038 / 47012160 / +0.2% 59538839 / 59240590 / +0.5% 0.79 / 0.79 / -0.3%
tpcds_q46/duckdb:vortex-file-compressed 51203069 / 51638727 / -0.8% 76097668 / 75711003 / +0.5% 0.67 / 0.68 / -1.3%
tpcds_q47/duckdb:vortex-file-compressed 80386138 / 81573704 / -1.5% 95855075 / 97959992 / -2.1% 0.84 / 0.83 / +0.7%
tpcds_q48/duckdb:vortex-file-compressed 55441415 / 55404230 / +0.1% 80104980 / 80013672 / +0.1% 0.69 / 0.69 / -0.0%
tpcds_q49/duckdb:vortex-file-compressed 41164624 / 42079176 / -2.2% 79862856 / 83400144 / -4.2% 0.52 / 0.50 / +2.2%
tpcds_q50/duckdb:vortex-file-compressed 33524274 / 35422470 / -5.4% 56314769 / 56730822 / -0.7% 0.60 / 0.62 / -4.7%
tpcds_q51/duckdb:vortex-file-compressed 202761341 / 205105908 / -1.1% 220898842 / 219961973 / +0.4% 0.92 / 0.93 / -1.6%
tpcds_q52/duckdb:vortex-file-compressed 14956673 / 14853958 / +0.7% 31483014 / 31305660 / +0.6% 0.48 / 0.47 / +0.1%
tpcds_q53/duckdb:vortex-file-compressed 22466654 / 22020448 / +2.0% 38006438 / 39682594 / -4.2% 0.59 / 0.55 / +6.5%
tpcds_q54/duckdb:vortex-file-compressed 45096686 / 44824882 / +0.6% 64199864 / 64255363 / -0.1% 0.70 / 0.70 / +0.7%
tpcds_q55/duckdb:vortex-file-compressed 14299986 / 14126330 / +1.2% 31157208 / 31899858 / -2.3% 0.46 / 0.44 / +3.6%
tpcds_q56/duckdb:vortex-file-compressed 32653070 / 32378177 / +0.8% 57985279 / 58009966 / -0.0% 0.56 / 0.56 / +0.9%
tpcds_q57/duckdb:vortex-file-compressed 64311201 / 68176666 / -5.7% 77103740 / 77042219 / +0.1% 0.83 / 0.88 / -5.7%
tpcds_q58/duckdb:vortex-file-compressed 37519022 / 37984702 / -1.2% 58164411 / 57264455 / +1.6% 0.65 / 0.66 / -2.8%
tpcds_q59/duckdb:vortex-file-compressed 52105954 / 52712381 / -1.2% 65548179 / 66075278 / -0.8% 0.79 / 0.80 / -0.4%
tpcds_q60/duckdb:vortex-file-compressed 35081249 / 35003312 / +0.2% 58298789 / 59392361 / -1.8% 0.60 / 0.59 / +2.1%
tpcds_q61/duckdb:vortex-file-compressed 34077713 / 33916333 / +0.5% 56289798 / 55329788 / +1.7% 0.61 / 0.61 / -1.2%
tpcds_q62/duckdb:vortex-file-compressed 14978408 / 14720416 / +1.8% 25952012 / 26745249 / -3.0% 0.58 / 0.55 / +4.9%
tpcds_q63/duckdb:vortex-file-compressed 21648418 / 21488832 / +0.7% 38307117 / 37743562 / +1.5% 0.57 / 0.57 / -0.7%
tpcds_q64/duckdb:vortex-file-compressed 119727218 / 120295926 / -0.5% 159718377 / 161903971 / -1.3% 0.75 / 0.74 / +0.9%
tpcds_q65/duckdb:vortex-file-compressed 46109636 / 48698234 / -5.3% 58449196 / 60602025 / -3.6% 0.79 / 0.80 / -1.8%
tpcds_q66/duckdb:vortex-file-compressed 41419612 / 42479470 / -2.5% 57003212 / 58220450 / -2.1% 0.73 / 0.73 / -0.4%
tpcds_q67/duckdb:vortex-file-compressed 277267144 / 276718126 / +0.2% 285694892 / 285125733 / +0.2% 0.97 / 0.97 / -0.0%
tpcds_q68/duckdb:vortex-file-compressed 44067885 / 44532540 / -1.0% 71730844 / 75221702 / -4.6% 0.61 / 0.59 / +3.8%
tpcds_q69/duckdb:vortex-file-compressed 38645425 / 39298346 / -1.7% 61313342 / 58489112 / +4.8% 0.63 / 0.67 / -6.2%
tpcds_q70/duckdb:vortex-file-compressed 25113170 / 24960494 / +0.6% 41948859 / 41190953 / +1.8% 0.60 / 0.61 / -1.2%
tpcds_q71/duckdb:vortex-file-compressed 27818404 / 27850452 / -0.1% 50616500 / 50192610 / +0.8% 0.55 / 0.55 / -1.0%
tpcds_q72/duckdb:vortex-file-compressed 138712986 / 138299802 / +0.3% 161569568 / 159068445 / +1.6% 0.86 / 0.87 / -1.3%
tpcds_q73/duckdb:vortex-file-compressed 19841610 / 20332026 / -2.4% 35788282 / 35862922 / -0.2% 0.55 / 0.57 / -2.2%
tpcds_q74/duckdb:vortex-file-compressed 82932736 / 82857374 / +0.1% 97183542 / 99717434 / -2.5% 0.85 / 0.83 / +2.7%
tpcds_q75/duckdb:vortex-file-compressed 110462777 / 112897874 / -2.2% 137583655 / 142545476 / -3.5% 0.80 / 0.79 / +1.4%
tpcds_q76/duckdb:vortex-file-compressed 27839326 / 28110236 / -1.0% 58902566 / 59110965 / -0.4% 0.47 / 0.48 / -0.6%
tpcds_q77/duckdb:vortex-file-compressed 34866568 / 35627225 / -2.1% 60701858 / 59396052 / +2.2% 0.57 / 0.60 / -4.2%
tpcds_q78/duckdb:vortex-file-compressed 135120662 / 135514948 / -0.3% 160858672 / 163890288 / -1.8% 0.84 / 0.83 / +1.6%
tpcds_q79/duckdb:vortex-file-compressed 38192648 / 38517378 / -0.8% 61941064 / 60374872 / +2.6% 0.62 / 0.64 / -3.4%
tpcds_q80/duckdb:vortex-file-compressed 57753390 / 57597706 / +0.3% 89481936 / 88851224 / +0.7% 0.65 / 0.65 / -0.4%
tpcds_q81/duckdb:vortex-file-compressed 58660656 / 57866282 / +1.4% 70780688 / 70887714 / -0.2% 0.83 / 0.82 / +1.5%
tpcds_q82/duckdb:vortex-file-compressed 27075096 / 26968474 / +0.4% 79047723 / 75090606 / +5.3% 0.34 / 0.36 / -4.6%
tpcds_q83/duckdb:vortex-file-compressed 22146332 / 21501608 / +3.0% 31607242 / 32071122 / -1.4% 0.70 / 0.67 / +4.5%
tpcds_q84/duckdb:vortex-file-compressed 13408574 / 13787284 / -2.7% 23248586 / 23140512 / +0.5% 0.58 / 0.60 / -3.2%
tpcds_q85/duckdb:vortex-file-compressed 37872846 / 37793294 / +0.2% 56009493 / 56267871 / -0.5% 0.68 / 0.67 / +0.7%
tpcds_q86/duckdb:vortex-file-compressed 16248530 / 16578918 / -2.0% 27437549 / 28081501 / -2.3% 0.59 / 0.59 / +0.3%
tpcds_q87/duckdb:vortex-file-compressed 71621007 / 70943892 / +1.0% 87624759 / 86598277 / +1.2% 0.82 / 0.82 / -0.2%
tpcds_q88/duckdb:vortex-file-compressed 38190511 / 38427508 / -0.6% 48171221 / 48367045 / -0.4% 0.79 / 0.79 / -0.2%
tpcds_q89/duckdb:vortex-file-compressed 24580256 / 24490819 / +0.4% 40379022 / 41650877 / -3.1% 0.61 / 0.59 / +3.5%
tpcds_q90/duckdb:vortex-file-compressed 9627468 / 9706214 / -0.8% 21282586 / 19606861 / +8.5% 0.45 / 0.50 / -8.6%
tpcds_q91/duckdb:vortex-file-compressed 19745622 / 19605099 / +0.7% 29491311 / 30381798 / -2.9% 0.67 / 0.65 / +3.8%
tpcds_q92/duckdb:vortex-file-compressed 13500733 / 13486701 / +0.1% 25390185 / 26696668 / -4.9% 0.53 / 0.51 / +5.3%
tpcds_q93/duckdb:vortex-file-compressed 25590982 / 25811955 / -0.9% 55677190 / 52519765 / +6.0% 0.46 / 0.49 / -6.5%
tpcds_q94/duckdb:vortex-file-compressed 32845105 / 32863964 / -0.1% 47373608 / 48912485 / -3.1% 0.69 / 0.67 / +3.2%
tpcds_q95/duckdb:vortex-file-compressed 94055282 / 94209918 / -0.2% 111675684 / 110161336 / +1.4% 0.84 / 0.86 / -1.5%
tpcds_q96/duckdb:vortex-file-compressed 11854268 / 12017076 / -1.4% 25072325 / 23825271 / +5.2% 0.47 / 0.50 / -6.3%
tpcds_q97/duckdb:vortex-file-compressed 62865497 / 61274119 / +2.6% 81226380 / 81589685 / -0.4% 0.77 / 0.75 / +3.1%
tpcds_q98/duckdb:vortex-file-compressed 27514763 / 27455458 / +0.2% 45429522 / 43607112 / +4.2% 0.61 / 0.63 / -3.8%
tpcds_q99/duckdb:vortex-file-compressed 25960965 / 22940824 / +13.2% 🔴 37057320 / 34403470 / +7.7% 0.70 / 0.67 / +5.1%
duckdb / parquet / ns (0.993x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41504661 / 42107320 / -1.4% 50547477 / 49801305 / +1.5% 0.82 / 0.85 / -2.9%
tpcds_q02/duckdb:parquet 40041760 / 38473446 / +4.1% 47852685 / 50051995 / -4.4% 0.84 / 0.77 / +8.9%
tpcds_q03/duckdb:parquet 25943120 / 25374601 / +2.2% 35029020 / 34786020 / +0.7% 0.74 / 0.73 / +1.5%
tpcds_q04/duckdb:parquet 204654823 / 203776006 / +0.4% 218450657 / 223178158 / -2.1% 0.94 / 0.91 / +2.6%
tpcds_q05/duckdb:parquet 68734842 / 68671545 / +0.1% 86225743 / 91391493 / -5.7% 0.80 / 0.75 / +6.1%
tpcds_q06/duckdb:parquet 75424160 / 74880981 / +0.7% 84888434 / 86509678 / -1.9% 0.89 / 0.87 / +2.6%
tpcds_q07/duckdb:parquet 60352618 / 61497243 / -1.9% 79908649 / 75386380 / +6.0% 0.76 / 0.82 / -7.4%
tpcds_q08/duckdb:parquet 38048080 / 38073824 / -0.1% 41442716 / 45005786 / -7.9% 0.92 / 0.85 / +8.5%
tpcds_q09/duckdb:parquet 86052100 / 86604062 / -0.6% 96714884 / 98228278 / -1.5% 0.89 / 0.88 / +0.9%
tpcds_q10/duckdb:parquet 52688574 / 52105206 / +1.1% 62115452 / 61214153 / +1.5% 0.85 / 0.85 / -0.3%
tpcds_q11/duckdb:parquet 159234618 / 156624549 / +1.7% 169642104 / 164617806 / +3.1% 0.94 / 0.95 / -1.3%
tpcds_q12/duckdb:parquet 39903128 / 41193346 / -3.1% 46769217 / 47464803 / -1.5% 0.85 / 0.87 / -1.7%
tpcds_q13/duckdb:parquet 69791480 / 70569292 / -1.1% 86995225 / 87638048 / -0.7% 0.80 / 0.81 / -0.4%
tpcds_q14/duckdb:parquet 183976702 / 184209804 / -0.1% 199427759 / 201867458 / -1.2% 0.92 / 0.91 / +1.1%
tpcds_q15/duckdb:parquet 60820146 / 60315334 / +0.8% 69554682 / 68515609 / +1.5% 0.87 / 0.88 / -0.7%
tpcds_q16/duckdb:parquet 38048940 / 37590666 / +1.2% 48150869 / 46641648 / +3.2% 0.79 / 0.81 / -2.0%
tpcds_q17/duckdb:parquet 83685872 / 82550304 / +1.4% 91508827 / 88071076 / +3.9% 0.91 / 0.94 / -2.4%
tpcds_q18/duckdb:parquet 87597060 / 87038720 / +0.6% 96920875 / 97142745 / -0.2% 0.90 / 0.90 / +0.9%
tpcds_q19/duckdb:parquet 46978722 / 47939996 / -2.0% 57715897 / 58743757 / -1.7% 0.81 / 0.82 / -0.3%
tpcds_q20/duckdb:parquet 41229748 / 41193608 / +0.1% 48273939 / 48748198 / -1.0% 0.85 / 0.85 / +1.1%
tpcds_q21/duckdb:parquet 23506862 / 24089445 / -2.4% 30025741 / 28587104 / +5.0% 0.78 / 0.84 / -7.1%
tpcds_q22/duckdb:parquet 161035705 / 162932925 / -1.2% 164775324 / 165444497 / -0.4% 0.98 / 0.98 / -0.8%
tpcds_q23/duckdb:parquet 186282352 / 185183488 / +0.6% 195866062 / 195666249 / +0.1% 0.95 / 0.95 / +0.5%
tpcds_q24/duckdb:parquet 71400350 / 70562584 / +1.2% 83844318 / 82213507 / +2.0% 0.85 / 0.86 / -0.8%
tpcds_q25/duckdb:parquet 50523022 / 51175827 / -1.3% 60696614 / 60281423 / +0.7% 0.83 / 0.85 / -2.0%
tpcds_q26/duckdb:parquet 43925316 / 45073797 / -2.5% 51253681 / 51415525 / -0.3% 0.86 / 0.88 / -2.2%
tpcds_q27/duckdb:parquet 58808136 / 58512208 / +0.5% 74053131 / 78906195 / -6.2% 0.79 / 0.74 / +7.1%
tpcds_q28/duckdb:parquet 93901742 / 94534962 / -0.7% 115183480 / 110864553 / +3.9% 0.82 / 0.85 / -4.4%
tpcds_q29/duckdb:parquet 85765272 / 83262603 / +3.0% 95006083 / 96410547 / -1.5% 0.90 / 0.86 / +4.5%
tpcds_q30/duckdb:parquet 72329650 / 71527880 / +1.1% 81143026 / 80479652 / +0.8% 0.89 / 0.89 / +0.3%
tpcds_q31/duckdb:parquet 98447771 / 99698538 / -1.3% 108410978 / 110603270 / -2.0% 0.91 / 0.90 / +0.7%
tpcds_q32/duckdb:parquet 17968278 / 18000702 / -0.2% 26092636 / 26351708 / -1.0% 0.69 / 0.68 / +0.8%
tpcds_q33/duckdb:parquet 61885494 / 60835333 / +1.7% 77688251 / 73938498 / +5.1% 0.80 / 0.82 / -3.2%
tpcds_q34/duckdb:parquet 31201987 / 32117610 / -2.9% 40197761 / 42745062 / -6.0% 0.78 / 0.75 / +3.3%
tpcds_q35/duckdb:parquet 76473424 / 77253368 / -1.0% 88656326 / 85625156 / +3.5% 0.86 / 0.90 / -4.4%
tpcds_q36/duckdb:parquet 98142144 / 98105296 / +0.0% 112854843 / 110022064 / +2.6% 0.87 / 0.89 / -2.5%
tpcds_q37/duckdb:parquet 41540500 / 40960938 / +1.4% 48275927 / 46381232 / +4.1% 0.86 / 0.88 / -2.6%
tpcds_q38/duckdb:parquet 75231408 / 77015046 / -2.3% 81635496 / 81838164 / -0.2% 0.92 / 0.94 / -2.1%
tpcds_q39/duckdb:parquet 61179488 / 61763795 / -0.9% 67544546 / 68058227 / -0.8% 0.91 / 0.91 / -0.2%
tpcds_q40/duckdb:parquet 27856210 / 27821937 / +0.1% 35512436 / 35803895 / -0.8% 0.78 / 0.78 / +0.9%
tpcds_q41/duckdb:parquet 19863400 / 20561818 / -3.4% 26222613 / 27395062 / -4.3% 0.76 / 0.75 / +0.9%
tpcds_q42/duckdb:parquet 26702156 / 26086220 / +2.4% 36742692 / 38382184 / -4.3% 0.73 / 0.68 / +6.9%
tpcds_q43/duckdb:parquet 25378772 / 25660125 / -1.1% 33879737 / 32910197 / +2.9% 0.75 / 0.78 / -3.9%
tpcds_q44/duckdb:parquet 60545880 / 61148362 / -1.0% 76347851 / 77726267 / -1.8% 0.79 / 0.79 / +0.8%
tpcds_q45/duckdb:parquet 60822932 / 61358140 / -0.9% 68759896 / 66022884 / +4.1% 0.88 / 0.93 / -4.8%
tpcds_q46/duckdb:parquet 72293477 / 72710300 / -0.6% 87300342 / 90964838 / -4.0% 0.83 / 0.80 / +3.6%
tpcds_q47/duckdb:parquet 90621705 / 91344571 / -0.8% 101248728 / 100936473 / +0.3% 0.90 / 0.90 / -1.1%
tpcds_q48/duckdb:parquet 64607496 / 67141800 / -3.8% 80051865 / 80417002 / -0.5% 0.81 / 0.83 / -3.3%
tpcds_q49/duckdb:parquet 67970022 / 70261256 / -3.3% 90135939 / 90664731 / -0.6% 0.75 / 0.77 / -2.7%
tpcds_q50/duckdb:parquet 45669330 / 40955138 / +11.5% 🔴 51023498 / 51608824 / -1.1% 0.90 / 0.79 / +12.8%
tpcds_q51/duckdb:parquet 215862950 / 215778743 / +0.0% 223681247 / 227232469 / -1.6% 0.97 / 0.95 / +1.6%
tpcds_q52/duckdb:parquet 27014031 / 26700966 / +1.2% 36550221 / 38966525 / -6.2% 0.74 / 0.69 / +7.9%
tpcds_q53/duckdb:parquet 35203436 / 35530483 / -0.9% 45682552 / 44803038 / +2.0% 0.77 / 0.79 / -2.8%
tpcds_q54/duckdb:parquet 55836617 / 55793969 / +0.1% 62609539 / 61818601 / +1.3% 0.89 / 0.90 / -1.2%
tpcds_q55/duckdb:parquet 25929008 / 26978701 / -3.9% 39471467 / 40376822 / -2.2% 0.66 / 0.67 / -1.7%
tpcds_q56/duckdb:parquet 67051550 / 69896778 / -4.1% 79312643 / 79718308 / -0.5% 0.85 / 0.88 / -3.6%
tpcds_q57/duckdb:parquet 68704001 / 69044456 / -0.5% 74713322 / 75031041 / -0.4% 0.92 / 0.92 / -0.1%
tpcds_q58/duckdb:parquet 54329386 / 56775072 / -4.3% 65274768 / 68291301 / -4.4% 0.83 / 0.83 / +0.1%
tpcds_q59/duckdb:parquet 60367840 / 61205984 / -1.4% 68527920 / 67358087 / +1.7% 0.88 / 0.91 / -3.1%
tpcds_q60/duckdb:parquet 81947644 / 82093132 / -0.2% 94369297 / 95254488 / -0.9% 0.87 / 0.86 / +0.8%
tpcds_q61/duckdb:parquet 80254378 / 79950782 / +0.4% 97652601 / 93598252 / +4.3% 0.82 / 0.85 / -3.8%
tpcds_q62/duckdb:parquet 19806498 / 20071938 / -1.3% 27955194 / 28516764 / -2.0% 0.71 / 0.70 / +0.7%
tpcds_q63/duckdb:parquet 33344290 / 33969782 / -1.8% 42671822 / 46372818 / -8.0% 0.78 / 0.73 / +6.7%
tpcds_q64/duckdb:parquet 137029278 / 136186962 / +0.6% 157325003 / 150552035 / +4.5% 0.87 / 0.90 / -3.7%
tpcds_q65/duckdb:parquet 84295292 / 97587200 / -13.6% 🟢 104361698 / 105716016 / -1.3% 0.81 / 0.92 / -12.5%
tpcds_q66/duckdb:parquet 46407194 / 46631144 / -0.5% 53377141 / 52327683 / +2.0% 0.87 / 0.89 / -2.4%
tpcds_q67/duckdb:parquet 291457564 / 296229361 / -1.6% 302009114 / 297866250 / +1.4% 0.97 / 0.99 / -3.0%
tpcds_q68/duckdb:parquet 59697636 / 63007356 / -5.3% 81122073 / 80804289 / +0.4% 0.74 / 0.78 / -5.6%
tpcds_q69/duckdb:parquet 65358928 / 66481025 / -1.7% 77460679 / 76586517 / +1.1% 0.84 / 0.87 / -2.8%
tpcds_q70/duckdb:parquet 42067482 / 41730980 / +0.8% 53979840 / 52871302 / +2.1% 0.78 / 0.79 / -1.3%
tpcds_q71/duckdb:parquet 41658487 / 40842653 / +2.0% 54840933 / 55272950 / -0.8% 0.76 / 0.74 / +2.8%
tpcds_q72/duckdb:parquet 169775172 / 173318047 / -2.0% 184992436 / 185115785 / -0.1% 0.92 / 0.94 / -2.0%
tpcds_q73/duckdb:parquet 27096895 / 28175492 / -3.8% 33814337 / 37944437 / -10.9% 🟢 0.80 / 0.74 / +7.9%
tpcds_q74/duckdb:parquet 214791294 / 214315450 / +0.2% 224809525 / 224104981 / +0.3% 0.96 / 0.96 / -0.1%
tpcds_q75/duckdb:parquet 131522752 / 133873844 / -1.8% 147764871 / 147391021 / +0.3% 0.89 / 0.91 / -2.0%
tpcds_q76/duckdb:parquet 50894744 / 49860330 / +2.1% 69019910 / 66794996 / +3.3% 0.74 / 0.75 / -1.2%
tpcds_q77/duckdb:parquet 55551670 / 54329876 / +2.2% 72980669 / 72039575 / +1.3% 0.76 / 0.75 / +0.9%
tpcds_q78/duckdb:parquet 148422056 / 161136406 / -7.9% 161041353 / 162699446 / -1.0% 0.92 / 0.99 / -6.9%
tpcds_q79/duckdb:parquet 53273382 / 53736142 / -0.9% 66318308 / 62778978 / +5.6% 0.80 / 0.86 / -6.2%
tpcds_q80/duckdb:parquet 82777688 / 83467247 / -0.8% 102701416 / 103216507 / -0.5% 0.81 / 0.81 / -0.3%
tpcds_q81/duckdb:parquet 97692450 / 97939283 / -0.3% 105619875 / 106745290 / -1.1% 0.92 / 0.92 / +0.8%
tpcds_q82/duckdb:parquet 46084006 / 46175784 / -0.2% 53672548 / 52731239 / +1.8% 0.86 / 0.88 / -1.9%
tpcds_q83/duckdb:parquet 27998604 / 28064296 / -0.2% 32940933 / 32970041 / -0.1% 0.85 / 0.85 / -0.1%
tpcds_q84/duckdb:parquet 22652062 / 22703744 / -0.2% 29305748 / 29355892 / -0.2% 0.77 / 0.77 / -0.1%
tpcds_q85/duckdb:parquet 51129376 / 50646763 / +1.0% 62546467 / 60613657 / +3.2% 0.82 / 0.84 / -2.2%
tpcds_q86/duckdb:parquet 26012181 / 25352732 / +2.6% 30757453 / 32314430 / -4.8% 0.85 / 0.78 / +7.8%
tpcds_q87/duckdb:parquet 86405032 / 87014720 / -0.7% 92682501 / 92592880 / +0.1% 0.93 / 0.94 / -0.8%
tpcds_q88/duckdb:parquet 104741870 / 103651716 / +1.1% 113411378 / 112442634 / +0.9% 0.92 / 0.92 / +0.2%
tpcds_q89/duckdb:parquet 36807850 / 37786070 / -2.6% 46194180 / 45715650 / +1.0% 0.80 / 0.83 / -3.6%
tpcds_q90/duckdb:parquet 14732862 / 14814988 / -0.6% 21031194 / 19570806 / +7.5% 0.70 / 0.76 / -7.5%
tpcds_q91/duckdb:parquet 25445820 / 25654269 / -0.8% 33171680 / 32645256 / +1.6% 0.77 / 0.79 / -2.4%
tpcds_q92/duckdb:parquet 23460347 / 23659090 / -0.8% 28984285 / 30675528 / -5.5% 0.81 / 0.77 / +4.9%
tpcds_q93/duckdb:parquet 35628304 / 37218976 / -4.3% 48846800 / 47791896 / +2.2% 0.73 / 0.78 / -6.3%
tpcds_q94/duckdb:parquet 37301436 / 38380801 / -2.8% 48298158 / 44098714 / +9.5% 0.77 / 0.87 / -11.3%
tpcds_q95/duckdb:parquet 80439418 / 81008108 / -0.7% 85138388 / 86466296 / -1.5% 0.94 / 0.94 / +0.8%
tpcds_q96/duckdb:parquet 16891868 / 17504137 / -3.5% 23841224 / 22191736 / +7.4% 0.71 / 0.79 / -10.2%
tpcds_q97/duckdb:parquet 72898658 / 73535938 / -0.9% 80095281 / 82740110 / -3.2% 0.91 / 0.89 / +2.4%
tpcds_q98/duckdb:parquet 54873456 / 55310249 / -0.8% 68520506 / 69590967 / -1.5% 0.80 / 0.79 / +0.8%
tpcds_q99/duckdb:parquet 25397408 / 23951534 / +6.0% 32832281 / 33072452 / -0.7% 0.77 / 0.72 / +6.8%

@joseph-isaacs
joseph-isaacs marked this pull request as ready for review November 4, 2026 15:13
`filter_run_end_primitive` counted every run's range of the mask from scratch. On columns with
short runs, such as TPC-DS `ss_ticket_number`, that is one popcount call per run, and it took most
of the extra CPU of DataFusion scans that apply dynamic filters (q73 SF1: 2.5 s of 2.8 s extra over
150 iterations). Run ends increase, so walk the mask's words once with a running rank instead.

`run_end_filter` bench, median before -> after: 4K rows run 16: 1.28 us -> 0.52 us; 16K rows run
16: 4.75 us -> 1.81 us; 64K rows run 4: 65.0 us -> 24.0 us; 64K rows run 256: 1.79 us -> 0.86 us.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 4, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 4, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 6dea3638 vs base 5605eab0
Vortex (geomean): hot 1.014x ➖ · cold 1.040x ➖


datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44231834 / 44050590 / +0.4% 83955284 / 84417559 / -0.5% 0.53 / 0.52 / +1.0%
polarsignals_q01/datafusion:vortex-file-compressed 53725790 / 52883242 / +1.6% 137981411 / 104164252 / +32.5% 🔴 0.39 / 0.51 / -23.3%
polarsignals_q02/datafusion:vortex-file-compressed 12070056 / 12138620 / -0.6% 45250210 / 44471164 / +1.8% 0.27 / 0.27 / -2.3%
polarsignals_q03/datafusion:vortex-file-compressed 68377353 / 54339533 / +25.8% 🔴 111640143 / 109071796 / +2.4% 0.61 / 0.50 / +22.9%
polarsignals_q04/datafusion:vortex-file-compressed 9067704 / 9296832 / -2.5% 37637065 / 35854994 / +5.0% 0.24 / 0.26 / -7.1%
polarsignals_q05/datafusion:vortex-file-compressed 11579070 / 11640963 / -0.5% 41282394 / 40144875 / +2.8% 0.28 / 0.29 / -3.3%
polarsignals_q06/datafusion:vortex-file-compressed 22790364 / 22790831 / -0.0% 51174100 / 53670794 / -4.7% 0.45 / 0.42 / +4.9%
polarsignals_q07/datafusion:vortex-file-compressed 10518444 / 10842280 / -3.0% 38993892 / 37239656 / +4.7% 0.27 / 0.29 / -7.4%
polarsignals_q08/datafusion:vortex-file-compressed 98183618 / 97900538 / +0.3% 153068581 / 152544792 / +0.3% 0.64 / 0.64 / -0.1%
polarsignals_q09/datafusion:vortex-file-compressed 9708748 / 10138722 / -4.2% 35486592 / 35696137 / -0.6% 0.27 / 0.28 / -3.7%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.011x ➖ · cold 0.996x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.025x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.030x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6244942 / 6043123 / +3.3% 19991532 / 21071119 / -5.1% 0.31 / 0.29 / +8.9%
fineweb_q01/datafusion:vortex-file-compressed 9657025 / 9586660 / +0.7% 39476151 / 37634276 / +4.9% 0.24 / 0.25 / -4.0%
fineweb_q02/datafusion:vortex-file-compressed 11618364 / 12277809 / -5.4% 42876047 / 38750264 / +10.6% 🔴 0.27 / 0.32 / -14.5%
fineweb_q03/datafusion:vortex-file-compressed 18186464 / 18463236 / -1.5% 114478450 / 111296411 / +2.9% 0.16 / 0.17 / -4.2%
fineweb_q04/datafusion:vortex-file-compressed 64795682 / 65043954 / -0.4% 150998409 / 146286112 / +3.2% 0.43 / 0.44 / -3.5%
fineweb_q05/datafusion:vortex-file-compressed 62618590 / 61601845 / +1.7% 146972918 / 135795552 / +8.2% 0.43 / 0.45 / -6.1%
fineweb_q06/datafusion:vortex-file-compressed 17967439 / 17572726 / +2.2% 112967758 / 105229866 / +7.4% 0.16 / 0.17 / -4.8%
fineweb_q07/datafusion:vortex-file-compressed 18921611 / 18453620 / +2.5% 108493931 / 106038575 / +2.3% 0.17 / 0.17 / +0.2%
fineweb_q08/datafusion:vortex-file-compressed 8982397 / 7116254 / +26.2% 🔴 30844946 / 30111637 / +2.4% 0.29 / 0.24 / +23.2%
datafusion / vortex-compact / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6183886 / 6154852 / +0.5% 20870820 / 20552939 / +1.5% 0.30 / 0.30 / -1.1%
fineweb_q01/datafusion:vortex-compact 103071086 / 102308350 / +0.7% 131041501 / 135088800 / -3.0% 0.79 / 0.76 / +3.9%
fineweb_q02/datafusion:vortex-compact 103399102 / 103708517 / -0.3% 137161951 / 128688943 / +6.6% 0.75 / 0.81 / -6.5%
fineweb_q03/datafusion:vortex-compact 178070662 / 186149968 / -4.3% 268908848 / 255911352 / +5.1% 0.66 / 0.73 / -9.0%
fineweb_q04/datafusion:vortex-compact 200624822 / 191963960 / +4.5% 266298850 / 264394834 / +0.7% 0.75 / 0.73 / +3.8%
fineweb_q05/datafusion:vortex-compact 185463434 / 179444152 / +3.4% 256873037 / 254527424 / +0.9% 0.72 / 0.71 / +2.4%
fineweb_q06/datafusion:vortex-compact 127398428 / 124615732 / +2.2% 195432502 / 198452701 / -1.5% 0.65 / 0.63 / +3.8%
fineweb_q07/datafusion:vortex-compact 128569640 / 126337326 / +1.8% 198807765 / 197152326 / +0.8% 0.65 / 0.64 / +0.9%
fineweb_q08/datafusion:vortex-compact 8105700 / 9411014 / -13.9% 🟢 22029844 / 23627585 / -6.8% 0.37 / 0.40 / -7.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9370938 / 9452966 / -0.9% 34475218 / 30679561 / +12.4% 🔴 0.27 / 0.31 / -11.8%
fineweb_q01/datafusion:parquet 75338466 / 74916052 / +0.6% 164640938 / 152078727 / +8.3% 0.46 / 0.49 / -7.1%
fineweb_q02/datafusion:parquet 74290708 / 75977840 / -2.2% 165143464 / 160422362 / +2.9% 0.45 / 0.47 / -5.0%
fineweb_q03/datafusion:parquet 74008166 / 73102312 / +1.2% 166057468 / 155325037 / +6.9% 0.45 / 0.47 / -5.3%
fineweb_q04/datafusion:parquet 81774141 / 81928140 / -0.2% 168358307 / 158987890 / +5.9% 0.49 / 0.52 / -5.7%
fineweb_q05/datafusion:parquet 80829153 / 80563007 / +0.3% 156660117 / 153213497 / +2.2% 0.52 / 0.53 / -1.9%
fineweb_q06/datafusion:parquet 74531892 / 76156013 / -2.1% 160017874 / 159982512 / +0.0% 0.47 / 0.48 / -2.2%
fineweb_q07/datafusion:parquet 75327517 / 72960314 / +3.2% 152775107 / 157349595 / -2.9% 0.49 / 0.46 / +6.3%
fineweb_q08/datafusion:parquet 73609800 / 73899872 / -0.4% 163129642 / 151674609 / +7.6% 0.45 / 0.49 / -7.4%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2106433 / 2102804 / +0.2% 7168451 / 8209453 / -12.7% 🟢 0.29 / 0.26 / +14.7%
fineweb_q01/duckdb:vortex-file-compressed 7962074 / 7670017 / +3.8% 26235123 / 25330993 / +3.6% 0.30 / 0.30 / +0.2%
fineweb_q02/duckdb:vortex-file-compressed 9161783 / 9608619 / -4.7% 27957450 / 30263937 / -7.6% 0.33 / 0.32 / +3.2%
fineweb_q03/duckdb:vortex-file-compressed 19656558 / 18697950 / +5.1% 90689809 / 92864174 / -2.3% 0.22 / 0.20 / +7.6%
fineweb_q04/duckdb:vortex-file-compressed 65508424 / 65151094 / +0.5% 106557803 / 106250583 / +0.3% 0.61 / 0.61 / +0.3%
fineweb_q05/duckdb:vortex-file-compressed 64673740 / 64626530 / +0.1% 103884075 / 104190408 / -0.3% 0.62 / 0.62 / +0.4%
fineweb_q06/duckdb:vortex-file-compressed 18093782 / 18132843 / -0.2% 89933164 / 92385184 / -2.7% 0.20 / 0.20 / +2.5%
fineweb_q07/duckdb:vortex-file-compressed 17231753 / 17449204 / -1.2% 90850558 / 91523664 / -0.7% 0.19 / 0.19 / -0.5%
fineweb_q08/duckdb:vortex-file-compressed 5063548 / 4667326 / +8.5% 12096859 / 13107207 / -7.7% 0.42 / 0.36 / +17.6%
duckdb / vortex-compact / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2445025 / 2222906 / +10.0% 7297414 / 8296201 / -12.0% 🟢 0.34 / 0.27 / +25.0%
fineweb_q01/duckdb:vortex-compact 38226014 / 38434642 / -0.5% 56096855 / 56898286 / -1.4% 0.68 / 0.68 / +0.9%
fineweb_q02/duckdb:vortex-compact 39462592 / 39476634 / -0.0% 57788138 / 58687655 / -1.5% 0.68 / 0.67 / +1.5%
fineweb_q03/duckdb:vortex-compact 153311336 / 147606404 / +3.9% 185607687 / 190325554 / -2.5% 0.83 / 0.78 / +6.5%
fineweb_q04/duckdb:vortex-compact 161177294 / 157100274 / +2.6% 195918648 / 193266749 / +1.4% 0.82 / 0.81 / +1.2%
fineweb_q05/duckdb:vortex-compact 152629635 / 153968976 / -0.9% 194467109 / 191260513 / +1.7% 0.78 / 0.81 / -2.5%
fineweb_q06/duckdb:vortex-compact 82268553 / 84070428 / -2.1% 124449066 / 125200526 / -0.6% 0.66 / 0.67 / -1.6%
fineweb_q07/duckdb:vortex-compact 84257826 / 84853368 / -0.7% 124805086 / 126646598 / -1.5% 0.68 / 0.67 / +0.8%
fineweb_q08/duckdb:vortex-compact 4611800 / 4832146 / -4.6% 9950649 / 10513337 / -5.4% 0.46 / 0.46 / +0.8%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23837152 / 23122729 / +3.1% 28529702 / 27993497 / +1.9% 0.84 / 0.83 / +1.2%
fineweb_q01/duckdb:parquet 54677076 / 54168991 / +0.9% 72895053 / 72384558 / +0.7% 0.75 / 0.75 / +0.2%
fineweb_q02/duckdb:parquet 57995283 / 57482670 / +0.9% 71558446 / 73752167 / -3.0% 0.81 / 0.78 / +4.0%
fineweb_q03/duckdb:parquet 119224712 / 119568795 / -0.3% 177234423 / 181426742 / -2.3% 0.67 / 0.66 / +2.1%
fineweb_q04/duckdb:parquet 161289032 / 159432394 / +1.2% 205724854 / 206027780 / -0.1% 0.78 / 0.77 / +1.3%
fineweb_q05/duckdb:parquet 156508215 / 155862710 / +0.4% 198178611 / 197647448 / +0.3% 0.79 / 0.79 / +0.1%
fineweb_q06/duckdb:parquet 88008988 / 86697084 / +1.5% 147354111 / 142327422 / +3.5% 0.60 / 0.61 / -1.9%
fineweb_q07/duckdb:parquet 90536592 / 89781687 / +0.8% 141978895 / 145535610 / -2.4% 0.64 / 0.62 / +3.4%
fineweb_q08/duckdb:parquet 29051512 / 28565923 / +1.7% 30861830 / 29454567 / +4.8% 0.94 / 0.97 / -2.9%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-5.8%, low confidence) · DuckDB No clear signal (+4.3%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.153x ❌
Parquet (geomean): hot 0.999x ➖ · cold 1.020x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.933x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 101595063 / 171077827 / -40.6% 🟢 531754602 / 545335592 / -2.5% 0.19 / 0.31 / -39.1%
clickbench-sorted_q24/datafusion:vortex-file-compressed 8814208 / 9816061 / -10.2% 🟢 61520430 / 50823458 / +21.0% 🔴 0.14 / 0.19 / -25.8%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11490244 / 11531604 / -0.4% 62880758 / 53110297 / +18.4% 🔴 0.18 / 0.22 / -15.8%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22951724 / 23233188 / -1.2% 75714564 / 67700976 / +11.8% 🔴 0.30 / 0.34 / -11.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18532476 / 17951425 / +3.2% 62414675 / 56341983 / +10.8% 🔴 0.30 / 0.32 / -6.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 12729219 / 13379486 / -4.9% 65808287 / 57917876 / +13.6% 🔴 0.19 / 0.23 / -16.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 38136228 / 38635673 / -1.3% 100877344 / 95174761 / +6.0% 0.38 / 0.41 / -6.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 10830060 / 11056460 / -2.0% 46283116 / 40294041 / +14.9% 🔴 0.23 / 0.27 / -14.7%
clickbench-sorted_q41/datafusion:vortex-file-compressed 10839332 / 11146731 / -2.8% 49572911 / 38593531 / +28.4% 🔴 0.22 / 0.29 / -24.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9485966 / 9239316 / +2.7% 38557946 / 33537925 / +15.0% 🔴 0.25 / 0.28 / -10.7%
datafusion / vortex-compact / ns (0.943x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 280140909 / 373429342 / -25.0% 🟢 529691474 / 662311930 / -20.0% 🟢 0.53 / 0.56 / -6.2%
clickbench-sorted_q24/datafusion:vortex-compact 15072214 / 20405605 / -26.1% 🟢 57961107 / 64562548 / -10.2% 🟢 0.26 / 0.32 / -17.7%
clickbench-sorted_q26/datafusion:vortex-compact 20992314 / 19814957 / +5.9% 67273114 / 57715105 / +16.6% 🔴 0.31 / 0.34 / -9.1%
clickbench-sorted_q36/datafusion:vortex-compact 36172863 / 35909202 / +0.7% 80545158 / 73313109 / +9.9% 0.45 / 0.49 / -8.3%
clickbench-sorted_q37/datafusion:vortex-compact 29925448 / 31741218 / -5.7% 77191158 / 73157599 / +5.5% 0.39 / 0.43 / -10.6%
clickbench-sorted_q38/datafusion:vortex-compact 23571266 / 23374074 / +0.8% 71965114 / 66452820 / +8.3% 0.33 / 0.35 / -6.9%
clickbench-sorted_q39/datafusion:vortex-compact 43573254 / 42990494 / +1.4% 97051361 / 98905447 / -1.9% 0.45 / 0.43 / +3.3%
clickbench-sorted_q40/datafusion:vortex-compact 13646744 / 13480116 / +1.2% 49575220 / 42767728 / +15.9% 🔴 0.28 / 0.32 / -12.7%
clickbench-sorted_q41/datafusion:vortex-compact 12471772 / 13074810 / -4.6% 46157347 / 44115674 / +4.6% 0.27 / 0.30 / -8.8%
clickbench-sorted_q42/datafusion:vortex-compact 10566304 / 10496945 / +0.7% 40847959 / 34833729 / +17.3% 🔴 0.26 / 0.30 / -14.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 739725813 / 746876675 / -1.0% 965275956 / 943693541 / +2.3% 0.77 / 0.79 / -3.2%
clickbench-sorted_q24/datafusion:parquet 8865364 / 9166523 / -3.3% 73573369 / 71774123 / +2.5% 0.12 / 0.13 / -5.7%
clickbench-sorted_q26/datafusion:parquet 9337910 / 9307248 / +0.3% 77301015 / 71750365 / +7.7% 0.12 / 0.13 / -6.9%
clickbench-sorted_q36/datafusion:parquet 90456566 / 89561907 / +1.0% 168793426 / 162515667 / +3.9% 0.54 / 0.55 / -2.8%
clickbench-sorted_q37/datafusion:parquet 61614106 / 61640964 / -0.0% 130852008 / 128587939 / +1.8% 0.47 / 0.48 / -1.8%
clickbench-sorted_q38/datafusion:parquet 83470858 / 83002186 / +0.6% 161651065 / 157690947 / +2.5% 0.52 / 0.53 / -1.9%
clickbench-sorted_q39/datafusion:parquet 152718964 / 153036212 / -0.2% 234145022 / 226470416 / +3.4% 0.65 / 0.68 / -3.5%
clickbench-sorted_q40/datafusion:parquet 41932168 / 41906304 / +0.1% 114901264 / 110300776 / +4.2% 0.36 / 0.38 / -3.9%
clickbench-sorted_q41/datafusion:parquet 39428744 / 39752856 / -0.8% 110348752 / 107019954 / +3.1% 0.36 / 0.37 / -3.8%
clickbench-sorted_q42/datafusion:parquet 24962614 / 25144422 / -0.7% 87218163 / 84330837 / +3.4% 0.29 / 0.30 / -4.0%
duckdb / vortex-file-compressed / ns (1.080x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 53143453 / 35336560 / +50.4% 🔴 288978067 / 69811839 / +313.9% 🔴 0.18 / 0.51 / -63.7%
clickbench-sorted_q24/duckdb:vortex-file-compressed 12051508 / 9544106 / +26.3% 🔴 34289756 / 28814520 / +19.0% 🔴 0.35 / 0.33 / +6.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed 11579851 / 9225133 / +25.5% 🔴 32640203 / 28835237 / +13.2% 🔴 0.35 / 0.32 / +10.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 21922761 / 22327656 / -1.8% 48455137 / 44443192 / +9.0% 0.45 / 0.50 / -9.9%
clickbench-sorted_q37/duckdb:vortex-file-compressed 17499753 / 17428389 / +0.4% 43276811 / 40918058 / +5.8% 0.40 / 0.43 / -5.1%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18511302 / 19002905 / -2.6% 48461915 / 48590615 / -0.3% 0.38 / 0.39 / -2.3%
clickbench-sorted_q39/duckdb:vortex-file-compressed 41997292 / 42890723 / -2.1% 86379149 / 77829682 / +11.0% 🔴 0.49 / 0.55 / -11.8%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10709056 / 10620712 / +0.8% 34356648 / 32980891 / +4.2% 0.31 / 0.32 / -3.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 12037894 / 12351915 / -2.5% 36687012 / 34645820 / +5.9% 0.33 / 0.36 / -8.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8942594 / 9128530 / -2.0% 29185483 / 29877185 / -2.3% 0.31 / 0.31 / +0.3%
duckdb / vortex-compact / ns (1.091x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 57158928 / 41992086 / +36.1% 🔴 290239911 / 74978721 / +287.1% 🔴 0.20 / 0.56 / -64.8%
clickbench-sorted_q24/duckdb:vortex-compact 14857492 / 11447504 / +29.8% 🔴 35540393 / 30580511 / +16.2% 🔴 0.42 / 0.37 / +11.7%
clickbench-sorted_q26/duckdb:vortex-compact 14933964 / 10928032 / +36.7% 🔴 37511329 / 26866667 / +39.6% 🔴 0.40 / 0.41 / -2.1%
clickbench-sorted_q36/duckdb:vortex-compact 31733389 / 32427044 / -2.1% 57116504 / 54885752 / +4.1% 0.56 / 0.59 / -6.0%
clickbench-sorted_q37/duckdb:vortex-compact 27180755 / 26025180 / +4.4% 51115373 / 50441643 / +1.3% 0.53 / 0.52 / +3.1%
clickbench-sorted_q38/duckdb:vortex-compact 21335378 / 21774116 / -2.0% 53249028 / 51161539 / +4.1% 0.40 / 0.43 / -5.9%
clickbench-sorted_q39/duckdb:vortex-compact 50975857 / 51396326 / -0.8% 86781376 / 79277172 / +9.5% 0.59 / 0.65 / -9.4%
clickbench-sorted_q40/duckdb:vortex-compact 13070818 / 13095294 / -0.2% 35915141 / 35869844 / +0.1% 0.36 / 0.37 / -0.3%
clickbench-sorted_q41/duckdb:vortex-compact 13517154 / 13223077 / +2.2% 39046952 / 38780784 / +0.7% 0.35 / 0.34 / +1.5%
clickbench-sorted_q42/duckdb:vortex-compact 9789584 / 9983342 / -1.9% 30918960 / 31735102 / -2.6% 0.32 / 0.31 / +0.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 141316223 / 140991284 / +0.2% 176517167 / 179837880 / -1.8% 0.80 / 0.78 / +2.1%
clickbench-sorted_q24/duckdb:parquet 14696124 / 15697524 / -6.4% 21106482 / 20610952 / +2.4% 0.70 / 0.76 / -8.6%
clickbench-sorted_q26/duckdb:parquet 15562114 / 16523465 / -5.8% 19419833 / 22007579 / -11.8% 🟢 0.80 / 0.75 / +6.7%
clickbench-sorted_q36/duckdb:parquet 47234556 / 46380314 / +1.8% 58814455 / 56069369 / +4.9% 0.80 / 0.83 / -2.9%
clickbench-sorted_q37/duckdb:parquet 37307277 / 35128216 / +6.2% 44697985 / 43567969 / +2.6% 0.83 / 0.81 / +3.5%
clickbench-sorted_q38/duckdb:parquet 41590552 / 41716259 / -0.3% 54668416 / 53306202 / +2.6% 0.76 / 0.78 / -2.8%
clickbench-sorted_q39/duckdb:parquet 75879841 / 72995313 / +4.0% 83140565 / 84283843 / -1.4% 0.91 / 0.87 / +5.4%
clickbench-sorted_q40/duckdb:parquet 22295198 / 22482156 / -0.8% 30632917 / 27943146 / +9.6% 0.73 / 0.80 / -9.5%
clickbench-sorted_q41/duckdb:parquet 22596775 / 23189566 / -2.6% 29176592 / 28819649 / +1.2% 0.77 / 0.80 / -3.7%
clickbench-sorted_q42/duckdb:parquet 18191172 / 16957794 / +7.3% 24151354 / 24446978 / -1.2% 0.75 / 0.69 / +8.6%
duckdb / duckdb / ns (0.970x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 68805489 / 71260562 / -3.4% 121758669 / 114620571 / +6.2% 0.57 / 0.62 / -9.1%
clickbench-sorted_q24/duckdb:duckdb 22955966 / 23477218 / -2.2% 29250142 / 28689372 / +2.0% 0.78 / 0.82 / -4.1%
clickbench-sorted_q26/duckdb:duckdb 22890604 / 23223678 / -1.4% 31462787 / 29333153 / +7.3% 0.73 / 0.79 / -8.1%
clickbench-sorted_q36/duckdb:duckdb 38172805 / 37572347 / +1.6% 69996020 / 69738708 / +0.4% 0.55 / 0.54 / +1.2%
clickbench-sorted_q37/duckdb:duckdb 36992514 / 41812012 / -11.5% 🟢 77512256 / 70562818 / +9.8% 0.48 / 0.59 / -19.5%
clickbench-sorted_q38/duckdb:duckdb 29619544 / 32411167 / -8.6% 64067517 / 64380847 / -0.5% 0.46 / 0.50 / -8.2%
clickbench-sorted_q39/duckdb:duckdb 53497516 / 55077939 / -2.9% 104662801 / 102341457 / +2.3% 0.51 / 0.54 / -5.0%
clickbench-sorted_q40/duckdb:duckdb 21849697 / 21790350 / +0.3% 45532520 / 43957010 / +3.6% 0.48 / 0.50 / -3.2%
clickbench-sorted_q41/duckdb:duckdb 20731408 / 20905628 / -0.8% 38263265 / 37459148 / +2.1% 0.54 / 0.56 / -2.9%
clickbench-sorted_q42/duckdb:duckdb 16915128 / 16918343 / -0.0% 27868879 / 27530016 / +1.2% 0.61 / 0.61 / -1.2%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Engines: DataFusion No clear signal (+8.9%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.047x ➖ · cold 1.051x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.028x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.061x ➖, 3↑ 27↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 22097068 / 21449955 / +3.0% 42037739 / 36890157 / +14.0% 🔴 0.53 / 0.58 / -9.6%
tpcds_q02/datafusion:vortex-file-compressed 42824032 / 44549928 / -3.9% 67192266 / 64446099 / +4.3% 0.64 / 0.69 / -7.8%
tpcds_q03/datafusion:vortex-file-compressed 12388540 / 11230196 / +10.3% 🔴 30163681 / 26695625 / +13.0% 🔴 0.41 / 0.42 / -2.4%
tpcds_q04/datafusion:vortex-file-compressed 82581202 / 87981826 / -6.1% 113161658 / 120965403 / -6.5% 0.73 / 0.73 / +0.3%
tpcds_q05/datafusion:vortex-file-compressed 56484946 / 57080629 / -1.0% 86014650 / 78711868 / +9.3% 0.66 / 0.73 / -9.4%
tpcds_q06/datafusion:vortex-file-compressed 23893830 / 22423310 / +6.6% 43858678 / 40885119 / +7.3% 0.54 / 0.55 / -0.7%
tpcds_q07/datafusion:vortex-file-compressed 26635846 / 29007938 / -8.2% 48235988 / 50787717 / -5.0% 0.55 / 0.57 / -3.3%
tpcds_q08/datafusion:vortex-file-compressed 26581140 / 24772320 / +7.3% 44622327 / 40820871 / +9.3% 0.60 / 0.61 / -1.8%
tpcds_q09/datafusion:vortex-file-compressed 20375801 / 21180404 / -3.8% 39165676 / 37120969 / +5.5% 0.52 / 0.57 / -8.8%
tpcds_q10/datafusion:vortex-file-compressed 33691341 / 27089952 / +24.4% 🔴 52242775 / 48150963 / +8.5% 0.64 / 0.56 / +14.6%
tpcds_q11/datafusion:vortex-file-compressed 50088226 / 52658580 / -4.9% 78180545 / 80704795 / -3.1% 0.64 / 0.65 / -1.8%
tpcds_q12/datafusion:vortex-file-compressed 15471004 / 14807784 / +4.5% 33384549 / 30699151 / +8.7% 0.46 / 0.48 / -3.9%
tpcds_q13/datafusion:vortex-file-compressed 30662077 / 30808226 / -0.5% 57870994 / 55251329 / +4.7% 0.53 / 0.56 / -5.0%
tpcds_q14/datafusion:vortex-file-compressed 491105624 / 488510962 / +0.5% 554132498 / 546367575 / +1.4% 0.89 / 0.89 / -0.9%
tpcds_q15/datafusion:vortex-file-compressed 13516836 / 12526037 / +7.9% 32366268 / 31001294 / +4.4% 0.42 / 0.40 / +3.4%
tpcds_q16/datafusion:vortex-file-compressed 23949584 / 18616530 / +28.6% 🔴 42640823 / 37364761 / +14.1% 🔴 0.56 / 0.50 / +12.7%
tpcds_q17/datafusion:vortex-file-compressed 53642006 / 54881384 / -2.3% 78836700 / 75360654 / +4.6% 0.68 / 0.73 / -6.6%
tpcds_q18/datafusion:vortex-file-compressed 63928875 / 63672050 / +0.4% 72177874 / 86896388 / -16.9% 🟢 0.89 / 0.73 / +20.9%
tpcds_q19/datafusion:vortex-file-compressed 17624828 / 16751722 / +5.2% 43491813 / 36242965 / +20.0% 🔴 0.41 / 0.46 / -12.3%
tpcds_q20/datafusion:vortex-file-compressed 16921910 / 16071738 / +5.3% 34740403 / 34810807 / -0.2% 0.49 / 0.46 / +5.5%
tpcds_q21/datafusion:vortex-file-compressed 15164794 / 16184408 / -6.3% 36060431 / 36023984 / +0.1% 0.42 / 0.45 / -6.4%
tpcds_q22/datafusion:vortex-file-compressed 50171236 / 49230964 / +1.9% 71081675 / 71170972 / -0.1% 0.71 / 0.69 / +2.0%
tpcds_q23/datafusion:vortex-file-compressed 72856483 / 70264458 / +3.7% 101846027 / 96167475 / +5.9% 0.72 / 0.73 / -2.1%
tpcds_q24/datafusion:vortex-file-compressed 64446431 / 65418735 / -1.5% 86572056 / 83701751 / +3.4% 0.74 / 0.78 / -4.8%
tpcds_q25/datafusion:vortex-file-compressed 46061244 / 44327608 / +3.9% 69267980 / 64380287 / +7.6% 0.66 / 0.69 / -3.4%
tpcds_q26/datafusion:vortex-file-compressed 26508914 / 25924224 / +2.3% 47092420 / 45251458 / +4.1% 0.56 / 0.57 / -1.7%
tpcds_q27/datafusion:vortex-file-compressed 51895052 / 59316172 / -12.5% 🟢 73910942 / 76338737 / -3.2% 0.70 / 0.78 / -9.6%
tpcds_q28/datafusion:vortex-file-compressed 24146573 / 24375547 / -0.9% 39327055 / 39449065 / -0.3% 0.61 / 0.62 / -0.6%
tpcds_q29/datafusion:vortex-file-compressed 51235766 / 50139198 / +2.2% 69591738 / 77352276 / -10.0% 🟢 0.74 / 0.65 / +13.6%
tpcds_q30/datafusion:vortex-file-compressed 27970360 / 26281199 / +6.4% 47824339 / 42073332 / +13.7% 🔴 0.58 / 0.62 / -6.4%
tpcds_q31/datafusion:vortex-file-compressed 65073433 / 58977292 / +10.3% 🔴 94115547 / 82607877 / +13.9% 🔴 0.69 / 0.71 / -3.2%
tpcds_q32/datafusion:vortex-file-compressed 15862628 / 12750964 / +24.4% 🔴 35482124 / 28412641 / +24.9% 🔴 0.45 / 0.45 / -0.4%
tpcds_q33/datafusion:vortex-file-compressed 29697515 / 28104111 / +5.7% 51985021 / 47044127 / +10.5% 🔴 0.57 / 0.60 / -4.4%
tpcds_q34/datafusion:vortex-file-compressed 21605732 / 17745730 / +21.8% 🔴 40829359 / 36597596 / +11.6% 🔴 0.53 / 0.48 / +9.1%
tpcds_q35/datafusion:vortex-file-compressed 33152410 / 30280252 / +9.5% 55964187 / 52331800 / +6.9% 0.59 / 0.58 / +2.4%
tpcds_q36/datafusion:vortex-file-compressed 49356264 / 47413233 / +4.1% 69641425 / 69088114 / +0.8% 0.71 / 0.69 / +3.3%
tpcds_q37/datafusion:vortex-file-compressed 12182102 / 12404394 / -1.8% 35305986 / 30123300 / +17.2% 🔴 0.35 / 0.41 / -16.2%
tpcds_q38/datafusion:vortex-file-compressed 30572336 / 25667270 / +19.1% 🔴 50121554 / 45709604 / +9.7% 0.61 / 0.56 / +8.6%
tpcds_q39/datafusion:vortex-file-compressed 64572936 / 64867506 / -0.5% 88439768 / 90698438 / -2.5% 0.73 / 0.72 / +2.1%
tpcds_q40/datafusion:vortex-file-compressed 26082883 / 23206666 / +12.4% 🔴 44338370 / 42299546 / +4.8% 0.59 / 0.55 / +7.2%
tpcds_q41/datafusion:vortex-file-compressed 21212211 / 20961656 / +1.2% 33233877 / 31649582 / +5.0% 0.64 / 0.66 / -3.6%
tpcds_q42/datafusion:vortex-file-compressed 11869202 / 11058118 / +7.3% 30334779 / 26084343 / +16.3% 🔴 0.39 / 0.42 / -7.7%
tpcds_q43/datafusion:vortex-file-compressed 14178874 / 12425410 / +14.1% 🔴 34277324 / 30090684 / +13.9% 🔴 0.41 / 0.41 / +0.2%
tpcds_q44/datafusion:vortex-file-compressed 29188313 / 29757280 / -1.9% 52793653 / 50013384 / +5.6% 0.55 / 0.59 / -7.1%
tpcds_q45/datafusion:vortex-file-compressed 18161122 / 16504794 / +10.0% 🔴 36883305 / 32521744 / +13.4% 🔴 0.49 / 0.51 / -3.0%
tpcds_q46/datafusion:vortex-file-compressed 28573453 / 23536324 / +21.4% 🔴 48102810 / 44375286 / +8.4% 0.59 / 0.53 / +12.0%
tpcds_q47/datafusion:vortex-file-compressed 83479276 / 75569019 / +10.5% 🔴 112978202 / 103106598 / +9.6% 0.74 / 0.73 / +0.8%
tpcds_q48/datafusion:vortex-file-compressed 29699881 / 29254135 / +1.5% 52169273 / 49745068 / +4.9% 0.57 / 0.59 / -3.2%
tpcds_q49/datafusion:vortex-file-compressed 58512916 / 60699081 / -3.6% 82751887 / 79532403 / +4.0% 0.71 / 0.76 / -7.4%
tpcds_q50/datafusion:vortex-file-compressed 31157771 / 30412974 / +2.4% 53332397 / 53440581 / -0.2% 0.58 / 0.57 / +2.7%
tpcds_q51/datafusion:vortex-file-compressed 66394748 / 66055880 / +0.5% 90614427 / 85840317 / +5.6% 0.73 / 0.77 / -4.8%
tpcds_q52/datafusion:vortex-file-compressed 12784402 / 11663198 / +9.6% 29188663 / 25401947 / +14.9% 🔴 0.44 / 0.46 / -4.6%
tpcds_q53/datafusion:vortex-file-compressed 20890554 / 18117494 / +15.3% 🔴 43678704 / 35770885 / +22.1% 🔴 0.48 / 0.51 / -5.6%
tpcds_q54/datafusion:vortex-file-compressed 33465208 / 32337686 / +3.5% 56260017 / 52797084 / +6.6% 0.59 / 0.61 / -2.9%
tpcds_q55/datafusion:vortex-file-compressed 12043274 / 10977225 / +9.7% 29340060 / 25545519 / +14.9% 🔴 0.41 / 0.43 / -4.5%
tpcds_q56/datafusion:vortex-file-compressed 28779862 / 27107235 / +6.2% 47902456 / 46640711 / +2.7% 0.60 / 0.58 / +3.4%
tpcds_q57/datafusion:vortex-file-compressed 72331488 / 62452848 / +15.8% 🔴 97795422 / 85675318 / +14.1% 🔴 0.74 / 0.73 / +1.5%
tpcds_q58/datafusion:vortex-file-compressed 45164780 / 38712980 / +16.7% 🔴 73193287 / 60912833 / +20.2% 🔴 0.62 / 0.64 / -2.9%
tpcds_q59/datafusion:vortex-file-compressed 30618764 / 30011546 / +2.0% 56814033 / 51448691 / +10.4% 🔴 0.54 / 0.58 / -7.6%
tpcds_q60/datafusion:vortex-file-compressed 29041046 / 26709566 / +8.7% 50121847 / 46102276 / +8.7% 0.58 / 0.58 / +0.0%
tpcds_q61/datafusion:vortex-file-compressed 23625930 / 22007982 / +7.4% 43638365 / 41914821 / +4.1% 0.54 / 0.53 / +3.1%
tpcds_q62/datafusion:vortex-file-compressed 18550832 / 16390961 / +13.2% 🔴 36597850 / 33489052 / +9.3% 0.51 / 0.49 / +3.6%
tpcds_q63/datafusion:vortex-file-compressed 19173838 / 17443168 / +9.9% 41468178 / 37003474 / +12.1% 🔴 0.46 / 0.47 / -1.9%
tpcds_q64/datafusion:vortex-file-compressed 190937535 / 212368900 / -10.1% 🟢 227452096 / 242020771 / -6.0% 0.84 / 0.88 / -4.3%
tpcds_q65/datafusion:vortex-file-compressed 76970360 / 72660596 / +5.9% 96715228 / 93074158 / +3.9% 0.80 / 0.78 / +1.9%
tpcds_q66/datafusion:vortex-file-compressed 52220496 / 50261422 / +3.9% 74352321 / 70577736 / +5.3% 0.70 / 0.71 / -1.4%
tpcds_q67/datafusion:vortex-file-compressed 53974070 / 50923968 / +6.0% 84771710 / 80197929 / +5.7% 0.64 / 0.63 / +0.3%
tpcds_q68/datafusion:vortex-file-compressed 27784004 / 22802664 / +21.8% 🔴 45550893 / 43872645 / +3.8% 0.61 / 0.52 / +17.4%
tpcds_q69/datafusion:vortex-file-compressed 31636628 / 25642608 / +23.4% 🔴 51937066 / 46202908 / +12.4% 🔴 0.61 / 0.55 / +9.8%
tpcds_q70/datafusion:vortex-file-compressed 74320886 / 71417318 / +4.1% 99684785 / 91189386 / +9.3% 0.75 / 0.78 / -4.8%
tpcds_q71/datafusion:vortex-file-compressed 19423916 / 19612449 / -1.0% 41581959 / 38868515 / +7.0% 0.47 / 0.50 / -7.4%
tpcds_q72/datafusion:vortex-file-compressed 254375697 / 358141804 / -29.0% 🟢 284199655 / 387476158 / -26.7% 🟢 0.90 / 0.92 / -3.2%
tpcds_q73/datafusion:vortex-file-compressed 20347438 / 16294117 / +24.9% 🔴 39720931 / 35311442 / +12.5% 🔴 0.51 / 0.46 / +11.0%
tpcds_q74/datafusion:vortex-file-compressed 41577433 / 40123466 / +3.6% 69990383 / 65095803 / +7.5% 0.59 / 0.62 / -3.6%
tpcds_q75/datafusion:vortex-file-compressed 137679022 / 137688677 / -0.0% 164165920 / 163988091 / +0.1% 0.84 / 0.84 / -0.1%
tpcds_q76/datafusion:vortex-file-compressed 30572148 / 30038074 / +1.8% 51584189 / 46367615 / +11.3% 🔴 0.59 / 0.65 / -8.5%
tpcds_q77/datafusion:vortex-file-compressed 45544474 / 44811364 / +1.6% 72263403 / 64939737 / +11.3% 🔴 0.63 / 0.69 / -8.7%
tpcds_q78/datafusion:vortex-file-compressed 64207868 / 63991438 / +0.3% 95243347 / 90914274 / +4.8% 0.67 / 0.70 / -4.2%
tpcds_q79/datafusion:vortex-file-compressed 25196942 / 19446652 / +29.6% 🔴 44347726 / 42094356 / +5.4% 0.57 / 0.46 / +23.0%
tpcds_q80/datafusion:vortex-file-compressed 69967928 / 73043178 / -4.2% 99063698 / 102452153 / -3.3% 0.71 / 0.71 / -0.9%
tpcds_q81/datafusion:vortex-file-compressed 28400937 / 26368494 / +7.7% 47271251 / 43282707 / +9.2% 0.60 / 0.61 / -1.4%
tpcds_q82/datafusion:vortex-file-compressed 13565688 / 12767577 / +6.3% 36827704 / 33349594 / +10.4% 🔴 0.37 / 0.38 / -3.8%
tpcds_q83/datafusion:vortex-file-compressed 35556032 / 33515185 / +6.1% 58228347 / 52456903 / +11.0% 🔴 0.61 / 0.64 / -4.4%
tpcds_q84/datafusion:vortex-file-compressed 10609196 / 10163837 / +4.4% 27446024 / 24803934 / +10.7% 🔴 0.39 / 0.41 / -5.7%
tpcds_q85/datafusion:vortex-file-compressed 53517688 / 53509714 / +0.0% 80799761 / 77972294 / +3.6% 0.66 / 0.69 / -3.5%
tpcds_q86/datafusion:vortex-file-compressed 17619628 / 15870754 / +11.0% 🔴 36930040 / 32492390 / +13.7% 🔴 0.48 / 0.49 / -2.3%
tpcds_q87/datafusion:vortex-file-compressed 30120238 / 26006129 / +15.8% 🔴 54472807 / 46904172 / +16.1% 🔴 0.55 / 0.55 / -0.3%
tpcds_q88/datafusion:vortex-file-compressed 37281266 / 31730204 / +17.5% 🔴 55643342 / 50072211 / +11.1% 🔴 0.67 / 0.63 / +5.7%
tpcds_q89/datafusion:vortex-file-compressed 22436011 / 21416560 / +4.8% 45065482 / 41436261 / +8.8% 0.50 / 0.52 / -3.7%
tpcds_q90/datafusion:vortex-file-compressed 13782087 / 9987172 / +38.0% 🔴 26980951 / 24139244 / +11.8% 🔴 0.51 / 0.41 / +23.5%
tpcds_q91/datafusion:vortex-file-compressed 17440648 / 16897494 / +3.2% 38914608 / 33596053 / +15.8% 🔴 0.45 / 0.50 / -10.9%
tpcds_q92/datafusion:vortex-file-compressed 15138604 / 12824116 / +18.0% 🔴 34931787 / 26875329 / +30.0% 🔴 0.43 / 0.48 / -9.2%
tpcds_q93/datafusion:vortex-file-compressed 20468878 / 20685432 / -1.0% 41694851 / 37495952 / +11.2% 🔴 0.49 / 0.55 / -11.0%
tpcds_q94/datafusion:vortex-file-compressed 21303932 / 18561775 / +14.8% 🔴 41060587 / 35765571 / +14.8% 🔴 0.52 / 0.52 / -0.0%
tpcds_q95/datafusion:vortex-file-compressed 44677720 / 42142152 / +6.0% 64849828 / 61180576 / +6.0% 0.69 / 0.69 / +0.0%
tpcds_q96/datafusion:vortex-file-compressed 10788057 / 7650478 / +41.0% 🔴 25255387 / 22935839 / +10.1% 🔴 0.43 / 0.33 / +28.1%
tpcds_q97/datafusion:vortex-file-compressed 18793578 / 17325282 / +8.5% 40527031 / 35006862 / +15.8% 🔴 0.46 / 0.49 / -6.3%
tpcds_q98/datafusion:vortex-file-compressed 16452330 / 15985122 / +2.9% 35048006 / 35084819 / -0.1% 0.47 / 0.46 / +3.0%
tpcds_q99/datafusion:vortex-file-compressed 16593464 / 15914286 / +4.3% 39366729 / 33536757 / +17.4% 🔴 0.42 / 0.47 / -11.2%
datafusion / vortex-compact / ns (1.120x ❌, 1↑ 45↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 22428990 / 20991774 / +6.8% 42509484 / 37922108 / +12.1% 🔴 0.53 / 0.55 / -4.7%
tpcds_q02/datafusion:vortex-compact 43498926 / 44817138 / -2.9% 66465979 / 65255178 / +1.9% 0.65 / 0.69 / -4.7%
tpcds_q03/datafusion:vortex-compact 12541772 / 11374278 / +10.3% 🔴 33468016 / 28855673 / +16.0% 🔴 0.37 / 0.39 / -4.9%
tpcds_q04/datafusion:vortex-compact 93640030 / 94766610 / -1.2% 121879528 / 123821652 / -1.6% 0.77 / 0.77 / +0.4%
tpcds_q05/datafusion:vortex-compact 56880122 / 56360839 / +0.9% 78951105 / 77755295 / +1.5% 0.72 / 0.72 / -0.6%
tpcds_q06/datafusion:vortex-compact 26606258 / 24251630 / +9.7% 47529824 / 44288863 / +7.3% 0.56 / 0.55 / +2.2%
tpcds_q07/datafusion:vortex-compact 30630938 / 31184304 / -1.8% 51975097 / 51101370 / +1.7% 0.59 / 0.61 / -3.4%
tpcds_q08/datafusion:vortex-compact 31253636 / 27315354 / +14.4% 🔴 52506930 / 44815200 / +17.2% 🔴 0.60 / 0.61 / -2.3%
tpcds_q09/datafusion:vortex-compact 25049069 / 24591916 / +1.9% 44496108 / 40092768 / +11.0% 🔴 0.56 / 0.61 / -8.2%
tpcds_q10/datafusion:vortex-compact 39245578 / 30684232 / +27.9% 🔴 62625475 / 48664259 / +28.7% 🔴 0.63 / 0.63 / -0.6%
tpcds_q11/datafusion:vortex-compact 55407266 / 56347562 / -1.7% 85524681 / 81547040 / +4.9% 0.65 / 0.69 / -6.2%
tpcds_q12/datafusion:vortex-compact 21162994 / 18781331 / +12.7% 🔴 39490491 / 35389788 / +11.6% 🔴 0.54 / 0.53 / +1.0%
tpcds_q13/datafusion:vortex-compact 54876956 / 47045130 / +16.6% 🔴 70002226 / 66058401 / +6.0% 0.78 / 0.71 / +10.1%
tpcds_q14/datafusion:vortex-compact 658399096 / 632217203 / +4.1% 706164738 / 697218850 / +1.3% 0.93 / 0.91 / +2.8%
tpcds_q15/datafusion:vortex-compact 15661894 / 14216571 / +10.2% 🔴 35760663 / 33165218 / +7.8% 0.44 / 0.43 / +2.2%
tpcds_q16/datafusion:vortex-compact 25493136 / 19196358 / +32.8% 🔴 42963229 / 38211623 / +12.4% 🔴 0.59 / 0.50 / +18.1%
tpcds_q17/datafusion:vortex-compact 59419419 / 57969732 / +2.5% 81851908 / 80022290 / +2.3% 0.73 / 0.72 / +0.2%
tpcds_q18/datafusion:vortex-compact 57511068 / 60611382 / -5.1% 75217923 / 81062988 / -7.2% 0.76 / 0.75 / +2.3%
tpcds_q19/datafusion:vortex-compact 23320418 / 19076050 / +22.2% 🔴 48008574 / 38736960 / +23.9% 🔴 0.49 / 0.49 / -1.4%
tpcds_q20/datafusion:vortex-compact 20967212 / 20180479 / +3.9% 41358440 / 39105260 / +5.8% 0.51 / 0.52 / -1.8%
tpcds_q21/datafusion:vortex-compact 17968314 / 18216921 / -1.4% 38820492 / 40598248 / -4.4% 0.46 / 0.45 / +3.2%
tpcds_q22/datafusion:vortex-compact 50906718 / 51149376 / -0.5% 74182175 / 71929132 / +3.1% 0.69 / 0.71 / -3.5%
tpcds_q23/datafusion:vortex-compact 77228020 / 75049653 / +2.9% 104714111 / 96325231 / +8.7% 0.74 / 0.78 / -5.3%
tpcds_q24/datafusion:vortex-compact 73264910 / 71696214 / +2.2% 101441348 / 93757496 / +8.2% 0.72 / 0.76 / -5.6%
tpcds_q25/datafusion:vortex-compact 52697177 / 49024669 / +7.5% 76504723 / 81432665 / -6.1% 0.69 / 0.60 / +14.4%
tpcds_q26/datafusion:vortex-compact 27934822 / 28136618 / -0.7% 49574753 / 46045802 / +7.7% 0.56 / 0.61 / -7.8%
tpcds_q27/datafusion:vortex-compact 59083831 / 58778911 / +0.5% 80036423 / 74152889 / +7.9% 0.74 / 0.79 / -6.9%
tpcds_q28/datafusion:vortex-compact 29726060 / 29396516 / +1.1% 47829384 / 48565466 / -1.5% 0.62 / 0.61 / +2.7%
tpcds_q29/datafusion:vortex-compact 57432892 / 56918763 / +0.9% 73480091 / 76039158 / -3.4% 0.78 / 0.75 / +4.4%
tpcds_q30/datafusion:vortex-compact 29419614 / 28679053 / +2.6% 49775226 / 43518410 / +14.4% 🔴 0.59 / 0.66 / -10.3%
tpcds_q31/datafusion:vortex-compact 70638868 / 61370840 / +15.1% 🔴 99725294 / 86039731 / +15.9% 🔴 0.71 / 0.71 / -0.7%
tpcds_q32/datafusion:vortex-compact 16619564 / 13677840 / +21.5% 🔴 36388303 / 30839443 / +18.0% 🔴 0.46 / 0.44 / +3.0%
tpcds_q33/datafusion:vortex-compact 32655896 / 27638632 / +18.2% 🔴 54584391 / 50406836 / +8.3% 0.60 / 0.55 / +9.1%
tpcds_q34/datafusion:vortex-compact 26465748 / 18296008 / +44.7% 🔴 41160231 / 39740861 / +3.6% 0.64 / 0.46 / +39.7%
tpcds_q35/datafusion:vortex-compact 41862422 / 33656260 / +24.4% 🔴 66027704 / 55901424 / +18.1% 🔴 0.63 / 0.60 / +5.3%
tpcds_q36/datafusion:vortex-compact 57724236 / 48590758 / +18.8% 🔴 79324787 / 70759697 / +12.1% 🔴 0.73 / 0.69 / +6.0%
tpcds_q37/datafusion:vortex-compact 15461956 / 14418686 / +7.2% 41505355 / 34313663 / +21.0% 🔴 0.37 / 0.42 / -11.3%
tpcds_q38/datafusion:vortex-compact 31204590 / 26769106 / +16.6% 🔴 54068128 / 45281258 / +19.4% 🔴 0.58 / 0.59 / -2.4%
tpcds_q39/datafusion:vortex-compact 68274150 / 66690406 / +2.4% 89955507 / 87385162 / +2.9% 0.76 / 0.76 / -0.6%
tpcds_q40/datafusion:vortex-compact 25901888 / 24102852 / +7.5% 48654336 / 43488567 / +11.9% 🔴 0.53 / 0.55 / -3.9%
tpcds_q41/datafusion:vortex-compact 21794024 / 21047016 / +3.5% 37449010 / 34289738 / +9.2% 0.58 / 0.61 / -5.2%
tpcds_q42/datafusion:vortex-compact 13841304 / 11245264 / +23.1% 🔴 34036959 / 28876712 / +17.9% 🔴 0.41 / 0.39 / +4.4%
tpcds_q43/datafusion:vortex-compact 16102905 / 13420804 / +20.0% 🔴 35425778 / 30227611 / +17.2% 🔴 0.45 / 0.44 / +2.4%
tpcds_q44/datafusion:vortex-compact 29932730 / 29510213 / +1.4% 52956216 / 47369356 / +11.8% 🔴 0.57 / 0.62 / -9.3%
tpcds_q45/datafusion:vortex-compact 21740493 / 17807424 / +22.1% 🔴 39318333 / 35204086 / +11.7% 🔴 0.55 / 0.51 / +9.3%
tpcds_q46/datafusion:vortex-compact 34598346 / 25209091 / +37.2% 🔴 54134863 / 44560575 / +21.5% 🔴 0.64 / 0.57 / +13.0%
tpcds_q47/datafusion:vortex-compact 92070388 / 79307242 / +16.1% 🔴 124195739 / 109771334 / +13.1% 🔴 0.74 / 0.72 / +2.6%
tpcds_q48/datafusion:vortex-compact 46031064 / 44629626 / +3.1% 66490683 / 61809863 / +7.6% 0.69 / 0.72 / -4.1%
tpcds_q49/datafusion:vortex-compact 60896475 / 59641856 / +2.1% 89876988 / 81808407 / +9.9% 0.68 / 0.73 / -7.1%
tpcds_q50/datafusion:vortex-compact 34765387 / 31472955 / +10.5% 🔴 54519355 / 50035045 / +9.0% 0.64 / 0.63 / +1.4%
tpcds_q51/datafusion:vortex-compact 68346086 / 66779574 / +2.3% 90206733 / 84321717 / +7.0% 0.76 / 0.79 / -4.3%
tpcds_q52/datafusion:vortex-compact 13050563 / 11776608 / +10.8% 🔴 34229056 / 31656715 / +8.1% 0.38 / 0.37 / +2.5%
tpcds_q53/datafusion:vortex-compact 26665106 / 20557738 / +29.7% 🔴 45194183 / 42209744 / +7.1% 0.59 / 0.49 / +21.1%
tpcds_q54/datafusion:vortex-compact 36869882 / 34083056 / +8.2% 61573826 / 57503645 / +7.1% 0.60 / 0.59 / +1.0%
tpcds_q55/datafusion:vortex-compact 13035580 / 11264312 / +15.7% 🔴 33171758 / 29683220 / +11.8% 🔴 0.39 / 0.38 / +3.6%
tpcds_q56/datafusion:vortex-compact 30318802 / 26932660 / +12.6% 🔴 52403380 / 46653644 / +12.3% 🔴 0.58 / 0.58 / +0.2%
tpcds_q57/datafusion:vortex-compact 77300422 / 66894922 / +15.6% 🔴 107361230 / 93417422 / +14.9% 🔴 0.72 / 0.72 / +0.5%
tpcds_q58/datafusion:vortex-compact 51962210 / 42410986 / +22.5% 🔴 82865064 / 65515455 / +26.5% 🔴 0.63 / 0.65 / -3.1%
tpcds_q59/datafusion:vortex-compact 35665636 / 32456738 / +9.9% 57922013 / 55030218 / +5.3% 0.62 / 0.59 / +4.4%
tpcds_q60/datafusion:vortex-compact 33517040 / 26577152 / +26.1% 🔴 56841878 / 47885497 / +18.7% 🔴 0.59 / 0.56 / +6.2%
tpcds_q61/datafusion:vortex-compact 30777048 / 23792879 / +29.4% 🔴 51208814 / 41459989 / +23.5% 🔴 0.60 / 0.57 / +4.7%
tpcds_q62/datafusion:vortex-compact 17182210 / 16710009 / +2.8% 36994618 / 33726657 / +9.7% 0.46 / 0.50 / -6.3%
tpcds_q63/datafusion:vortex-compact 26366401 / 20667872 / +27.6% 🔴 45366732 / 40062643 / +13.2% 🔴 0.58 / 0.52 / +12.7%
tpcds_q64/datafusion:vortex-compact 294003904 / 303645814 / -3.2% 335081759 / 334592852 / +0.1% 0.88 / 0.91 / -3.3%
tpcds_q65/datafusion:vortex-compact 80891711 / 74784719 / +8.2% 102261798 / 98147497 / +4.2% 0.79 / 0.76 / +3.8%
tpcds_q66/datafusion:vortex-compact 54917410 / 51700769 / +6.2% 76228262 / 73752835 / +3.4% 0.72 / 0.70 / +2.8%
tpcds_q67/datafusion:vortex-compact 56485616 / 52551785 / +7.5% 87086905 / 80895364 / +7.7% 0.65 / 0.65 / -0.2%
tpcds_q68/datafusion:vortex-compact 35528300 / 24734972 / +43.6% 🔴 53537923 / 47236979 / +13.3% 🔴 0.66 / 0.52 / +26.7%
tpcds_q69/datafusion:vortex-compact 39317776 / 29319846 / +34.1% 🔴 61009662 / 50164325 / +21.6% 🔴 0.64 / 0.58 / +10.3%
tpcds_q70/datafusion:vortex-compact 77476540 / 72149906 / +7.4% 99522148 / 93076398 / +6.9% 0.78 / 0.78 / +0.4%
tpcds_q71/datafusion:vortex-compact 21966537 / 19142090 / +14.8% 🔴 42520299 / 39515718 / +7.6% 0.52 / 0.48 / +6.6%
tpcds_q72/datafusion:vortex-compact 255657160 / 344605138 / -25.8% 🟢 284573069 / 432883226 / -34.3% 🟢 0.90 / 0.80 / +12.9%
tpcds_q73/datafusion:vortex-compact 28174165 / 17593438 / +60.1% 🔴 42758442 / 38578690 / +10.8% 🔴 0.66 / 0.46 / +44.5%
tpcds_q74/datafusion:vortex-compact 45279842 / 42342883 / +6.9% 71136013 / 69325667 / +2.6% 0.64 / 0.61 / +4.2%
tpcds_q75/datafusion:vortex-compact 144245514 / 141231724 / +2.1% 180656067 / 167219959 / +8.0% 0.80 / 0.84 / -5.5%
tpcds_q76/datafusion:vortex-compact 32031779 / 29939534 / +7.0% 54748598 / 47925635 / +14.2% 🔴 0.59 / 0.62 / -6.3%
tpcds_q77/datafusion:vortex-compact 48263108 / 45658662 / +5.7% 70943608 / 66553097 / +6.6% 0.68 / 0.69 / -0.8%
tpcds_q78/datafusion:vortex-compact 66844034 / 66609260 / +0.4% 94528363 / 90738295 / +4.2% 0.71 / 0.73 / -3.7%
tpcds_q79/datafusion:vortex-compact 29412188 / 21198467 / +38.7% 🔴 45535317 / 42073956 / +8.2% 0.65 / 0.50 / +28.2%
tpcds_q80/datafusion:vortex-compact 72450734 / 73887544 / -1.9% 101046112 / 102363093 / -1.3% 0.72 / 0.72 / -0.7%
tpcds_q81/datafusion:vortex-compact 29097928 / 26842612 / +8.4% 47735614 / 43630990 / +9.4% 0.61 / 0.62 / -0.9%
tpcds_q82/datafusion:vortex-compact 14600448 / 14201960 / +2.8% 39034072 / 34902345 / +11.8% 🔴 0.37 / 0.41 / -8.1%
tpcds_q83/datafusion:vortex-compact 35955848 / 33472234 / +7.4% 58420050 / 55031189 / +6.2% 0.62 / 0.61 / +1.2%
tpcds_q84/datafusion:vortex-compact 12518346 / 11160080 / +12.2% 🔴 28635988 / 24486262 / +16.9% 🔴 0.44 / 0.46 / -4.1%
tpcds_q85/datafusion:vortex-compact 96899028 / 95851094 / +1.1% 120247466 / 118727163 / +1.3% 0.81 / 0.81 / -0.2%
tpcds_q86/datafusion:vortex-compact 17157496 / 16012168 / +7.2% 37299876 / 31950738 / +16.7% 🔴 0.46 / 0.50 / -8.2%
tpcds_q87/datafusion:vortex-compact 31770111 / 26673153 / +19.1% 🔴 52552974 / 47714448 / +10.1% 🔴 0.60 / 0.56 / +8.1%
tpcds_q88/datafusion:vortex-compact 56116516 / 36773043 / +52.6% 🔴 79696623 / 56815982 / +40.3% 🔴 0.70 / 0.65 / +8.8%
tpcds_q89/datafusion:vortex-compact 28066578 / 23094376 / +21.5% 🔴 47560304 / 41751224 / +13.9% 🔴 0.59 / 0.55 / +6.7%
tpcds_q90/datafusion:vortex-compact 16913555 / 10486984 / +61.3% 🔴 32464574 / 24124954 / +34.6% 🔴 0.52 / 0.43 / +19.9%
tpcds_q91/datafusion:vortex-compact 26009158 / 24122632 / +7.8% 46363348 / 43550736 / +6.5% 0.56 / 0.55 / +1.3%
tpcds_q92/datafusion:vortex-compact 19137097 / 13949884 / +37.2% 🔴 35741259 / 28188162 / +26.8% 🔴 0.54 / 0.49 / +8.2%
tpcds_q93/datafusion:vortex-compact 20506266 / 21118032 / -2.9% 41559854 / 41253281 / +0.7% 0.49 / 0.51 / -3.6%
tpcds_q94/datafusion:vortex-compact 24915684 / 19660188 / +26.7% 🔴 40988126 / 37755747 / +8.6% 0.61 / 0.52 / +16.7%
tpcds_q95/datafusion:vortex-compact 47549890 / 43314079 / +9.8% 66454410 / 60268992 / +10.3% 🔴 0.72 / 0.72 / -0.4%
tpcds_q96/datafusion:vortex-compact 12009696 / 8440212 / +42.3% 🔴 30515694 / 24964713 / +22.2% 🔴 0.39 / 0.34 / +16.4%
tpcds_q97/datafusion:vortex-compact 19712276 / 17328290 / +13.8% 🔴 40241757 / 35797423 / +12.4% 🔴 0.49 / 0.48 / +1.2%
tpcds_q98/datafusion:vortex-compact 21014722 / 20465597 / +2.7% 44224976 / 40675359 / +8.7% 0.48 / 0.50 / -5.6%
tpcds_q99/datafusion:vortex-compact 22055704 / 16854348 / +30.9% 🔴 40768305 / 34069400 / +19.7% 🔴 0.54 / 0.49 / +9.4%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43440666 / 43868998 / -1.0% 61932485 / 57792235 / +7.2% 0.70 / 0.76 / -7.6%
tpcds_q02/datafusion:parquet 54499728 / 54905326 / -0.7% 71092781 / 68962111 / +3.1% 0.77 / 0.80 / -3.7%
tpcds_q03/datafusion:parquet 19173738 / 19082322 / +0.5% 30296003 / 29816646 / +1.6% 0.63 / 0.64 / -1.1%
tpcds_q04/datafusion:parquet 178971864 / 181818236 / -1.6% 200955302 / 200857494 / +0.0% 0.89 / 0.91 / -1.6%
tpcds_q05/datafusion:parquet 67812708 / 69356080 / -2.2% 90216953 / 90224362 / -0.0% 0.75 / 0.77 / -2.2%
tpcds_q06/datafusion:parquet 33959436 / 33871373 / +0.3% 46782892 / 47024236 / -0.5% 0.73 / 0.72 / +0.8%
tpcds_q07/datafusion:parquet 47318256 / 46651698 / +1.4% 67744038 / 65908734 / +2.8% 0.70 / 0.71 / -1.3%
tpcds_q08/datafusion:parquet 31785886 / 31356762 / +1.4% 47847889 / 45423653 / +5.3% 0.66 / 0.69 / -3.8%
tpcds_q09/datafusion:parquet 30406448 / 30491130 / -0.3% 37262041 / 37049824 / +0.6% 0.82 / 0.82 / -0.8%
tpcds_q10/datafusion:parquet 45300636 / 44832285 / +1.0% 59814735 / 55593599 / +7.6% 0.76 / 0.81 / -6.1%
tpcds_q11/datafusion:parquet 96955792 / 97950887 / -1.0% 120504246 / 115108350 / +4.7% 0.80 / 0.85 / -5.4%
tpcds_q12/datafusion:parquet 24012192 / 23806698 / +0.9% 35827576 / 35317362 / +1.4% 0.67 / 0.67 / -0.6%
tpcds_q13/datafusion:parquet 47016754 / 45856160 / +2.5% 67730939 / 67208816 / +0.8% 0.69 / 0.68 / +1.7%
tpcds_q14/datafusion:parquet 530206650 / 537018351 / -1.3% 577880161 / 583498809 / -1.0% 0.92 / 0.92 / -0.3%
tpcds_q15/datafusion:parquet 23779351 / 23650278 / +0.5% 38255538 / 36895334 / +3.7% 0.62 / 0.64 / -3.0%
tpcds_q16/datafusion:parquet 37145669 / 36983696 / +0.4% 50791677 / 49282902 / +3.1% 0.73 / 0.75 / -2.5%
tpcds_q17/datafusion:parquet 73077076 / 75600460 / -3.3% 101527235 / 98869440 / +2.7% 0.72 / 0.76 / -5.9%
tpcds_q18/datafusion:parquet 70642106 / 68850332 / +2.6% 89450030 / 83238541 / +7.5% 0.79 / 0.83 / -4.5%
tpcds_q19/datafusion:parquet 29962499 / 29719598 / +0.8% 43561388 / 41802745 / +4.2% 0.69 / 0.71 / -3.3%
tpcds_q20/datafusion:parquet 25855281 / 25523878 / +1.3% 37396220 / 36268739 / +3.1% 0.69 / 0.70 / -1.8%
tpcds_q21/datafusion:parquet 20506764 / 20533178 / -0.1% 34805293 / 31530289 / +10.4% 🔴 0.59 / 0.65 / -9.5%
tpcds_q22/datafusion:parquet 77346054 / 77366874 / -0.0% 88682342 / 87687906 / +1.1% 0.87 / 0.88 / -1.1%
tpcds_q23/datafusion:parquet 92827230 / 93748514 / -1.0% 115680090 / 117534929 / -1.6% 0.80 / 0.80 / +0.6%
tpcds_q24/datafusion:parquet 90887040 / 90590262 / +0.3% 117681560 / 111276526 / +5.8% 0.77 / 0.81 / -5.1%
tpcds_q25/datafusion:parquet 81827826 / 80871984 / +1.2% 100398671 / 94328551 / +6.4% 0.82 / 0.86 / -4.9%
tpcds_q26/datafusion:parquet 42843944 / 44018081 / -2.7% 59422785 / 57397708 / +3.5% 0.72 / 0.77 / -6.0%
tpcds_q27/datafusion:parquet 76486706 / 77731044 / -1.6% 97260246 / 97530732 / -0.3% 0.79 / 0.80 / -1.3%
tpcds_q28/datafusion:parquet 28200798 / 28864233 / -2.3% 42236817 / 42250882 / -0.0% 0.67 / 0.68 / -2.3%
tpcds_q29/datafusion:parquet 75237386 / 73649013 / +2.2% 100652409 / 94337302 / +6.7% 0.75 / 0.78 / -4.3%
tpcds_q30/datafusion:parquet 44861969 / 45041546 / -0.4% 58509261 / 56910538 / +2.8% 0.77 / 0.79 / -3.1%
tpcds_q31/datafusion:parquet 82039233 / 80148984 / +2.4% 101491143 / 96414201 / +5.3% 0.81 / 0.83 / -2.8%
tpcds_q32/datafusion:parquet 27103832 / 26228284 / +3.3% 40204054 / 38629733 / +4.1% 0.67 / 0.68 / -0.7%
tpcds_q33/datafusion:parquet 39210362 / 37947355 / +3.3% 55960455 / 49169226 / +13.8% 🔴 0.70 / 0.77 / -9.2%
tpcds_q34/datafusion:parquet 24491385 / 24466732 / +0.1% 35974747 / 33781015 / +6.5% 0.68 / 0.72 / -6.0%
tpcds_q35/datafusion:parquet 50252711 / 49880874 / +0.7% 62677557 / 62452785 / +0.4% 0.80 / 0.80 / +0.4%
tpcds_q36/datafusion:parquet 51594554 / 51648292 / -0.1% 70372837 / 69966557 / +0.6% 0.73 / 0.74 / -0.7%
tpcds_q37/datafusion:parquet 21657918 / 21626878 / +0.1% 34569711 / 32527252 / +6.3% 0.63 / 0.66 / -5.8%
tpcds_q38/datafusion:parquet 45432982 / 45375882 / +0.1% 59554827 / 61827506 / -3.7% 0.76 / 0.73 / +3.9%
tpcds_q39/datafusion:parquet 69829544 / 68220012 / +2.4% 85386300 / 84854720 / +0.6% 0.82 / 0.80 / +1.7%
tpcds_q40/datafusion:parquet 31061810 / 30609906 / +1.5% 50027504 / 48588666 / +3.0% 0.62 / 0.63 / -1.4%
tpcds_q41/datafusion:parquet 20258951 / 20338040 / -0.4% 32432079 / 30843747 / +5.1% 0.62 / 0.66 / -5.3%
tpcds_q42/datafusion:parquet 18267580 / 17982778 / +1.6% 29458715 / 28438009 / +3.6% 0.62 / 0.63 / -1.9%
tpcds_q43/datafusion:parquet 19277810 / 19433710 / -0.8% 33632441 / 30977543 / +8.6% 0.57 / 0.63 / -8.6%
tpcds_q44/datafusion:parquet 35880686 / 34615438 / +3.7% 51210646 / 48032590 / +6.6% 0.70 / 0.72 / -2.8%
tpcds_q45/datafusion:parquet 27939446 / 27805524 / +0.5% 39359182 / 37719933 / +4.3% 0.71 / 0.74 / -3.7%
tpcds_q46/datafusion:parquet 28867092 / 28966051 / -0.3% 45966550 / 44069858 / +4.3% 0.63 / 0.66 / -4.5%
tpcds_q47/datafusion:parquet 97377902 / 98938351 / -1.6% 119881511 / 118194221 / +1.4% 0.81 / 0.84 / -3.0%
tpcds_q48/datafusion:parquet 42710496 / 42031157 / +1.6% 61235510 / 57489319 / +6.5% 0.70 / 0.73 / -4.6%
tpcds_q49/datafusion:parquet 70718086 / 72673856 / -2.7% 101829151 / 91067351 / +11.8% 🔴 0.69 / 0.80 / -13.0%
tpcds_q50/datafusion:parquet 49020140 / 46850272 / +4.6% 66793007 / 65931861 / +1.3% 0.73 / 0.71 / +3.3%
tpcds_q51/datafusion:parquet 74943150 / 76089406 / -1.5% 94069409 / 92461506 / +1.7% 0.80 / 0.82 / -3.2%
tpcds_q52/datafusion:parquet 18712707 / 18499946 / +1.2% 29857613 / 28440398 / +5.0% 0.63 / 0.65 / -3.7%
tpcds_q53/datafusion:parquet 22720011 / 22525606 / +0.9% 38642518 / 36596738 / +5.6% 0.59 / 0.62 / -4.5%
tpcds_q54/datafusion:parquet 52964590 / 53373818 / -0.8% 69238650 / 66058809 / +4.8% 0.76 / 0.81 / -5.3%
tpcds_q55/datafusion:parquet 18056658 / 18314364 / -1.4% 29408896 / 28956864 / +1.6% 0.61 / 0.63 / -2.9%
tpcds_q56/datafusion:parquet 40799852 / 41117251 / -0.8% 53918687 / 53225786 / +1.3% 0.76 / 0.77 / -2.0%
tpcds_q57/datafusion:parquet 101874213 / 101389000 / +0.5% 113526125 / 118843215 / -4.5% 0.90 / 0.85 / +5.2%
tpcds_q58/datafusion:parquet 65601251 / 66236498 / -1.0% 83266238 / 82029062 / +1.5% 0.79 / 0.81 / -2.4%
tpcds_q59/datafusion:parquet 47660692 / 47560035 / +0.2% 65522366 / 62231838 / +5.3% 0.73 / 0.76 / -4.8%
tpcds_q60/datafusion:parquet 41898438 / 42430193 / -1.3% 53850315 / 54718226 / -1.6% 0.78 / 0.78 / +0.3%
tpcds_q61/datafusion:parquet 36328848 / 35871564 / +1.3% 51720767 / 49348541 / +4.8% 0.70 / 0.73 / -3.4%
tpcds_q62/datafusion:parquet 25428364 / 25122940 / +1.2% 38049515 / 36351311 / +4.7% 0.67 / 0.69 / -3.3%
tpcds_q63/datafusion:parquet 22159065 / 22172324 / -0.1% 39171031 / 36307642 / +7.9% 0.57 / 0.61 / -7.4%
tpcds_q64/datafusion:parquet 287631127 / 287823022 / -0.1% 327311514 / 323180045 / +1.3% 0.88 / 0.89 / -1.3%
tpcds_q65/datafusion:parquet 121529694 / 122564299 / -0.8% 135362396 / 135661913 / -0.2% 0.90 / 0.90 / -0.6%
tpcds_q66/datafusion:parquet 59336388 / 60005627 / -1.1% 77803328 / 75764024 / +2.7% 0.76 / 0.79 / -3.7%
tpcds_q67/datafusion:parquet 69220042 / 69070309 / +0.2% 93189854 / 91511775 / +1.8% 0.74 / 0.75 / -1.6%
tpcds_q68/datafusion:parquet 29079888 / 28929153 / +0.5% 49074022 / 46154519 / +6.3% 0.59 / 0.63 / -5.5%
tpcds_q69/datafusion:parquet 43861612 / 43497268 / +0.8% 59383765 / 57163341 / +3.9% 0.74 / 0.76 / -2.9%
tpcds_q70/datafusion:parquet 80869342 / 81036663 / -0.2% 97816015 / 95480675 / +2.4% 0.83 / 0.85 / -2.6%
tpcds_q71/datafusion:parquet 24754002 / 25816364 / -4.1% 40379344 / 39660177 / +1.8% 0.61 / 0.65 / -5.8%
tpcds_q72/datafusion:parquet 526056720 / 520433934 / +1.1% 550383267 / 547678827 / +0.5% 0.96 / 0.95 / +0.6%
tpcds_q73/datafusion:parquet 23921150 / 24210527 / -1.2% 37367868 / 34623650 / +7.9% 0.64 / 0.70 / -8.5%
tpcds_q74/datafusion:parquet 70673530 / 70775004 / -0.1% 90239818 / 82849125 / +8.9% 0.78 / 0.85 / -8.3%
tpcds_q75/datafusion:parquet 151479858 / 152094114 / -0.4% 183278712 / 175498834 / +4.4% 0.83 / 0.87 / -4.6%
tpcds_q76/datafusion:parquet 33591848 / 33634765 / -0.1% 47780841 / 45116146 / +5.9% 0.70 / 0.75 / -5.7%
tpcds_q77/datafusion:parquet 57210359 / 58143028 / -1.6% 77562053 / 75667079 / +2.5% 0.74 / 0.77 / -4.0%
tpcds_q78/datafusion:parquet 87424978 / 86641812 / +0.9% 119096134 / 116306605 / +2.4% 0.73 / 0.74 / -1.5%
tpcds_q79/datafusion:parquet 27375932 / 27564524 / -0.7% 42454670 / 42148267 / +0.7% 0.64 / 0.65 / -1.4%
tpcds_q80/datafusion:parquet 80346442 / 81211510 / -1.1% 108059787 / 106482795 / +1.5% 0.74 / 0.76 / -2.5%
tpcds_q81/datafusion:parquet 38235168 / 37274256 / +2.6% 52184838 / 48618545 / +7.3% 0.73 / 0.77 / -4.4%
tpcds_q82/datafusion:parquet 22882842 / 22905268 / -0.1% 36823376 / 33891884 / +8.6% 0.62 / 0.68 / -8.1%
tpcds_q83/datafusion:parquet 58269336 / 59357048 / -1.8% 76426573 / 73454192 / +4.0% 0.76 / 0.81 / -5.7%
tpcds_q84/datafusion:parquet 26298442 / 25503568 / +3.1% 40987020 / 39966763 / +2.6% 0.64 / 0.64 / +0.5%
tpcds_q85/datafusion:parquet 79631483 / 79681350 / -0.1% 103944243 / 103381695 / +0.5% 0.77 / 0.77 / -0.6%
tpcds_q86/datafusion:parquet 20951184 / 20723188 / +1.1% 33776821 / 31380380 / +7.6% 0.62 / 0.66 / -6.1%
tpcds_q87/datafusion:parquet 45056834 / 44615014 / +1.0% 62224556 / 59085681 / +5.3% 0.72 / 0.76 / -4.1%
tpcds_q88/datafusion:parquet 38366977 / 37741110 / +1.7% 51194683 / 52141495 / -1.8% 0.75 / 0.72 / +3.5%
tpcds_q89/datafusion:parquet 25999696 / 25976840 / +0.1% 42597299 / 39387300 / +8.1% 0.61 / 0.66 / -7.5%
tpcds_q90/datafusion:parquet 15806508 / 15252228 / +3.6% 27287791 / 25143417 / +8.5% 0.58 / 0.61 / -4.5%
tpcds_q91/datafusion:parquet 32898939 / 32794231 / +0.3% 48335436 / 43865897 / +10.2% 🔴 0.68 / 0.75 / -9.0%
tpcds_q92/datafusion:parquet 27276122 / 27233964 / +0.2% 40142775 / 38923988 / +3.1% 0.68 / 0.70 / -2.9%
tpcds_q93/datafusion:parquet 26988212 / 26816533 / +0.6% 47175408 / 44562208 / +5.9% 0.57 / 0.60 / -4.9%
tpcds_q94/datafusion:parquet 35352884 / 35796473 / -1.2% 49661205 / 47174983 / +5.3% 0.71 / 0.76 / -6.2%
tpcds_q95/datafusion:parquet 63635679 / 65643832 / -3.1% 78170214 / 76727790 / +1.9% 0.81 / 0.86 / -4.8%
tpcds_q96/datafusion:parquet 13065972 / 13153128 / -0.7% 24440130 / 22724348 / +7.6% 0.53 / 0.58 / -7.6%
tpcds_q97/datafusion:parquet 35408162 / 35183400 / +0.6% 52062842 / 50669301 / +2.8% 0.68 / 0.69 / -2.1%
tpcds_q98/datafusion:parquet 24636743 / 24724902 / -0.4% 39112170 / 36964509 / +5.8% 0.63 / 0.67 / -5.8%
tpcds_q99/datafusion:parquet 30248355 / 29937421 / +1.0% 43233224 / 41196641 / +4.9% 0.70 / 0.73 / -3.7%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16109932 / 16212283 / -0.6% 25092187 / 24457668 / +2.6% 0.64 / 0.66 / -3.1%
tpcds_q02/duckdb:vortex-file-compressed 17809948 / 15612978 / +14.1% 🔴 22728418 / 22024953 / +3.2% 0.78 / 0.71 / +10.5%
tpcds_q03/duckdb:vortex-file-compressed 7147217 / 7255335 / -1.5% 16407344 / 16051387 / +2.2% 0.44 / 0.45 / -3.6%
tpcds_q04/duckdb:vortex-file-compressed 59419728 / 59041894 / +0.6% 72501623 / 71652632 / +1.2% 0.82 / 0.82 / -0.5%
tpcds_q05/duckdb:vortex-file-compressed 23167038 / 23144822 / +0.1% 32581138 / 31976332 / +1.9% 0.71 / 0.72 / -1.8%
tpcds_q06/duckdb:vortex-file-compressed 24664973 / 24645318 / +0.1% 38257813 / 38803176 / -1.4% 0.64 / 0.64 / +1.5%
tpcds_q07/duckdb:vortex-file-compressed 22694211 / 22574236 / +0.5% 33746781 / 33989268 / -0.7% 0.67 / 0.66 / +1.3%
tpcds_q08/duckdb:vortex-file-compressed 17592176 / 17352022 / +1.4% 25602327 / 24726953 / +3.5% 0.69 / 0.70 / -2.1%
tpcds_q09/duckdb:vortex-file-compressed 19760211 / 19341779 / +2.2% 30419890 / 30136903 / +0.9% 0.65 / 0.64 / +1.2%
tpcds_q10/duckdb:vortex-file-compressed 27775329 / 27823764 / -0.2% 41127543 / 40433605 / +1.7% 0.68 / 0.69 / -1.9%
tpcds_q11/duckdb:vortex-file-compressed 36367823 / 36445164 / -0.2% 45334243 / 44974403 / +0.8% 0.80 / 0.81 / -1.0%
tpcds_q12/duckdb:vortex-file-compressed 9873708 / 9932495 / -0.6% 17159386 / 15687278 / +9.4% 0.58 / 0.63 / -9.1%
tpcds_q13/duckdb:vortex-file-compressed 20576162 / 21108884 / -2.5% 32714614 / 32099208 / +1.9% 0.63 / 0.66 / -4.4%
tpcds_q14/duckdb:vortex-file-compressed 56988469 / 55203218 / +3.2% 66581833 / 65925454 / +1.0% 0.86 / 0.84 / +2.2%
tpcds_q15/duckdb:vortex-file-compressed 11498082 / 11296857 / +1.8% 17710803 / 18457576 / -4.0% 0.65 / 0.61 / +6.1%
tpcds_q16/duckdb:vortex-file-compressed 24800092 / 24840042 / -0.2% 35468480 / 34525443 / +2.7% 0.70 / 0.72 / -2.8%
tpcds_q17/duckdb:vortex-file-compressed 20616800 / 20533688 / +0.4% 32899647 / 32533264 / +1.1% 0.63 / 0.63 / -0.7%
tpcds_q18/duckdb:vortex-file-compressed 32726714 / 32584837 / +0.4% 44223039 / 44264778 / -0.1% 0.74 / 0.74 / +0.5%
tpcds_q19/duckdb:vortex-file-compressed 20785549 / 20504061 / +1.4% 29735077 / 29061523 / +2.3% 0.70 / 0.71 / -0.9%
tpcds_q20/duckdb:vortex-file-compressed 10994003 / 10704300 / +2.7% 17880032 / 17066806 / +4.8% 0.61 / 0.63 / -2.0%
tpcds_q21/duckdb:vortex-file-compressed 9283600 / 9558652 / -2.9% 21962988 / 22321682 / -1.6% 0.42 / 0.43 / -1.3%
tpcds_q22/duckdb:vortex-file-compressed 17510268 / 17533121 / -0.1% 29492418 / 29482596 / +0.0% 0.59 / 0.59 / -0.2%
tpcds_q23/duckdb:vortex-file-compressed 37276928 / 37737816 / -1.2% 50033307 / 48774222 / +2.6% 0.75 / 0.77 / -3.7%
tpcds_q24/duckdb:vortex-file-compressed 26484634 / 26430080 / +0.2% 38384100 / 36754228 / +4.4% 0.69 / 0.72 / -4.0%
tpcds_q25/duckdb:vortex-file-compressed 20056964 / 19798662 / +1.3% 31498200 / 32724115 / -3.7% 0.64 / 0.61 / +5.2%
tpcds_q26/duckdb:vortex-file-compressed 21709095 / 22292130 / -2.6% 32297633 / 31754520 / +1.7% 0.67 / 0.70 / -4.3%
tpcds_q27/duckdb:vortex-file-compressed 25198500 / 25017238 / +0.7% 37170377 / 36852692 / +0.9% 0.68 / 0.68 / -0.1%
tpcds_q28/duckdb:vortex-file-compressed 15725939 / 15218606 / +3.3% 25881134 / 25728072 / +0.6% 0.61 / 0.59 / +2.7%
tpcds_q29/duckdb:vortex-file-compressed 18999278 / 19110126 / -0.6% 31465730 / 30167251 / +4.3% 0.60 / 0.63 / -4.7%
tpcds_q30/duckdb:vortex-file-compressed 18787758 / 18503702 / +1.5% 27005717 / 26926625 / +0.3% 0.70 / 0.69 / +1.2%
tpcds_q31/duckdb:vortex-file-compressed 18029932 / 17704426 / +1.8% 27352639 / 26087708 / +4.8% 0.66 / 0.68 / -2.9%
tpcds_q32/duckdb:vortex-file-compressed 10298882 / 10330486 / -0.3% 18853719 / 17897966 / +5.3% 0.55 / 0.58 / -5.4%
tpcds_q33/duckdb:vortex-file-compressed 18136826 / 17431081 / +4.0% 28233715 / 27213870 / +3.7% 0.64 / 0.64 / +0.3%
tpcds_q34/duckdb:vortex-file-compressed 13238989 / 13046090 / +1.5% 22580674 / 21696273 / +4.1% 0.59 / 0.60 / -2.5%
tpcds_q35/duckdb:vortex-file-compressed 31356258 / 31424446 / -0.2% 44656775 / 44403467 / +0.6% 0.70 / 0.71 / -0.8%
tpcds_q36/duckdb:vortex-file-compressed 14354345 / 13898854 / +3.3% 24479598 / 24024523 / +1.9% 0.59 / 0.58 / +1.4%
tpcds_q37/duckdb:vortex-file-compressed 9537716 / 9499100 / +0.4% 23413522 / 23724212 / -1.3% 0.41 / 0.40 / +1.7%
tpcds_q38/duckdb:vortex-file-compressed 24213196 / 24550068 / -1.4% 33084168 / 32706083 / +1.2% 0.73 / 0.75 / -2.5%
tpcds_q39/duckdb:vortex-file-compressed 18646383 / 18640252 / +0.0% 33020764 / 31161682 / +6.0% 0.56 / 0.60 / -5.6%
tpcds_q40/duckdb:vortex-file-compressed 11413871 / 11295832 / +1.0% 19817654 / 19154296 / +3.5% 0.58 / 0.59 / -2.3%
tpcds_q41/duckdb:vortex-file-compressed 19143402 / 18811371 / +1.8% 25935821 / 25799613 / +0.5% 0.74 / 0.73 / +1.2%
tpcds_q42/duckdb:vortex-file-compressed 6977759 / 6977999 / -0.0% 15937662 / 15382620 / +3.6% 0.44 / 0.45 / -3.5%
tpcds_q43/duckdb:vortex-file-compressed 10082020 / 9707689 / +3.9% 19710954 / 18153179 / +8.6% 0.51 / 0.53 / -4.4%
tpcds_q44/duckdb:vortex-file-compressed 12829222 / 12651077 / +1.4% 24874710 / 23029930 / +8.0% 0.52 / 0.55 / -6.1%
tpcds_q45/duckdb:vortex-file-compressed 24262482 / 23699736 / +2.4% 31321074 / 30571899 / +2.5% 0.77 / 0.78 / -0.1%
tpcds_q46/duckdb:vortex-file-compressed 32196542 / 31721784 / +1.5% 44751234 / 43841233 / +2.1% 0.72 / 0.72 / -0.6%
tpcds_q47/duckdb:vortex-file-compressed 31336876 / 31444303 / -0.3% 41532932 / 40516087 / +2.5% 0.75 / 0.78 / -2.8%
tpcds_q48/duckdb:vortex-file-compressed 23172823 / 23551572 / -1.6% 35602893 / 35696586 / -0.3% 0.65 / 0.66 / -1.3%
tpcds_q49/duckdb:vortex-file-compressed 19324628 / 18754400 / +3.0% 31628310 / 30522276 / +3.6% 0.61 / 0.61 / -0.6%
tpcds_q50/duckdb:vortex-file-compressed 15019824 / 15317112 / -1.9% 25585775 / 25813857 / -0.9% 0.59 / 0.59 / -1.1%
tpcds_q51/duckdb:vortex-file-compressed 48960494 / 48594703 / +0.8% 59198134 / 58523352 / +1.2% 0.83 / 0.83 / -0.4%
tpcds_q52/duckdb:vortex-file-compressed 7162280 / 7107084 / +0.8% 15943233 / 15558766 / +2.5% 0.45 / 0.46 / -1.7%
tpcds_q53/duckdb:vortex-file-compressed 11600977 / 11433702 / +1.5% 21375164 / 20162697 / +6.0% 0.54 / 0.57 / -4.3%
tpcds_q54/duckdb:vortex-file-compressed 20208092 / 20221188 / -0.1% 30718440 / 29995116 / +2.4% 0.66 / 0.67 / -2.4%
tpcds_q55/duckdb:vortex-file-compressed 7039292 / 6910767 / +1.9% 16553826 / 15094973 / +9.7% 0.43 / 0.46 / -7.1%
tpcds_q56/duckdb:vortex-file-compressed 18035069 / 18008356 / +0.1% 28307205 / 27636711 / +2.4% 0.64 / 0.65 / -2.2%
tpcds_q57/duckdb:vortex-file-compressed 26107742 / 26017854 / +0.3% 33768074 / 32982417 / +2.4% 0.77 / 0.79 / -2.0%
tpcds_q58/duckdb:vortex-file-compressed 20734232 / 20106627 / +3.1% 31948805 / 30675871 / +4.1% 0.65 / 0.66 / -1.0%
tpcds_q59/duckdb:vortex-file-compressed 19753743 / 21048251 / -6.2% 26780908 / 26352319 / +1.6% 0.74 / 0.80 / -7.7%
tpcds_q60/duckdb:vortex-file-compressed 19034425 / 18138670 / +4.9% 29205153 / 27846365 / +4.9% 0.65 / 0.65 / +0.1%
tpcds_q61/duckdb:vortex-file-compressed 20230910 / 19696438 / +2.7% 30060983 / 30572547 / -1.7% 0.67 / 0.64 / +4.5%
tpcds_q62/duckdb:vortex-file-compressed 11320686 / 11255348 / +0.6% 17939325 / 17392856 / +3.1% 0.63 / 0.65 / -2.5%
tpcds_q63/duckdb:vortex-file-compressed 11214260 / 11157020 / +0.5% 20177828 / 19249213 / +4.8% 0.56 / 0.58 / -4.1%
tpcds_q64/duckdb:vortex-file-compressed 53333811 / 53286027 / +0.1% 68995401 / 68675130 / +0.5% 0.77 / 0.78 / -0.4%
tpcds_q65/duckdb:vortex-file-compressed 13156329 / 13185566 / -0.2% 23561335 / 22447474 / +5.0% 0.56 / 0.59 / -4.9%
tpcds_q66/duckdb:vortex-file-compressed 31825498 / 31532300 / +0.9% 38967728 / 38110873 / +2.2% 0.82 / 0.83 / -1.3%
tpcds_q67/duckdb:vortex-file-compressed 55635042 / 55542198 / +0.2% 65048002 / 65827709 / -1.2% 0.86 / 0.84 / +1.4%
tpcds_q68/duckdb:vortex-file-compressed 23291418 / 23128022 / +0.7% 36789519 / 35597057 / +3.3% 0.63 / 0.65 / -2.6%
tpcds_q69/duckdb:vortex-file-compressed 22823050 / 23225697 / -1.7% 36624625 / 37021570 / -1.1% 0.62 / 0.63 / -0.7%
tpcds_q70/duckdb:vortex-file-compressed 14657410 / 14917378 / -1.7% 25976982 / 24489297 / +6.1% 0.56 / 0.61 / -7.4%
tpcds_q71/duckdb:vortex-file-compressed 13368024 / 12983594 / +3.0% 24144774 / 23115528 / +4.5% 0.55 / 0.56 / -1.4%
tpcds_q72/duckdb:vortex-file-compressed 43909511 / 43341787 / +1.3% 57056922 / 57060005 / -0.0% 0.77 / 0.76 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed 12109664 / 12119954 / -0.1% 21526593 / 21069621 / +2.2% 0.56 / 0.58 / -2.2%
tpcds_q74/duckdb:vortex-file-compressed 31058070 / 31365622 / -1.0% 41154980 / 39782134 / +3.5% 0.75 / 0.79 / -4.3%
tpcds_q75/duckdb:vortex-file-compressed 37331148 / 37638798 / -0.8% 51205505 / 49561340 / +3.3% 0.73 / 0.76 / -4.0%
tpcds_q76/duckdb:vortex-file-compressed 13018906 / 12742360 / +2.2% 23136344 / 21910060 / +5.6% 0.56 / 0.58 / -3.2%
tpcds_q77/duckdb:vortex-file-compressed 20696889 / 20600419 / +0.5% 32363466 / 30956012 / +4.5% 0.64 / 0.67 / -3.9%
tpcds_q78/duckdb:vortex-file-compressed 43432770 / 42660023 / +1.8% 54233916 / 53919404 / +0.6% 0.80 / 0.79 / +1.2%
tpcds_q79/duckdb:vortex-file-compressed 17208613 / 17474572 / -1.5% 28131424 / 28009317 / +0.4% 0.61 / 0.62 / -1.9%
tpcds_q80/duckdb:vortex-file-compressed 29991870 / 29990428 / +0.0% 45751438 / 41641944 / +9.9% 0.66 / 0.72 / -9.0%
tpcds_q81/duckdb:vortex-file-compressed 21457979 / 21165576 / +1.4% 30464867 / 30376073 / +0.3% 0.70 / 0.70 / +1.1%
tpcds_q82/duckdb:vortex-file-compressed 9757104 / 9734831 / +0.2% 24964721 / 23622547 / +5.7% 0.39 / 0.41 / -5.2%
tpcds_q83/duckdb:vortex-file-compressed 17810646 / 17388444 / +2.4% 25499946 / 24817514 / +2.7% 0.70 / 0.70 / -0.3%
tpcds_q84/duckdb:vortex-file-compressed 15419560 / 15570198 / -1.0% 22855615 / 22417002 / +2.0% 0.67 / 0.69 / -2.9%
tpcds_q85/duckdb:vortex-file-compressed 26234900 / 26208432 / +0.1% 38269473 / 37083801 / +3.2% 0.69 / 0.71 / -3.0%
tpcds_q86/duckdb:vortex-file-compressed 9985694 / 9778114 / +2.1% 16441967 / 16272283 / +1.0% 0.61 / 0.60 / +1.1%
tpcds_q87/duckdb:vortex-file-compressed 26164650 / 25985307 / +0.7% 33676824 / 33580392 / +0.3% 0.78 / 0.77 / +0.4%
tpcds_q88/duckdb:vortex-file-compressed 30808846 / 30291157 / +1.7% 37915126 / 37428676 / +1.3% 0.81 / 0.81 / +0.4%
tpcds_q89/duckdb:vortex-file-compressed 12136578 / 11890068 / +2.1% 21327613 / 20382273 / +4.6% 0.57 / 0.58 / -2.5%
tpcds_q90/duckdb:vortex-file-compressed 8031184 / 8138980 / -1.3% 15592237 / 15375321 / +1.4% 0.52 / 0.53 / -2.7%
tpcds_q91/duckdb:vortex-file-compressed 15345312 / 15189514 / +1.0% 23984567 / 23475559 / +2.2% 0.64 / 0.65 / -1.1%
tpcds_q92/duckdb:vortex-file-compressed 10733251 / 10566592 / +1.6% 18846726 / 18455223 / +2.1% 0.57 / 0.57 / -0.5%
tpcds_q93/duckdb:vortex-file-compressed 10291422 / 10498808 / -2.0% 23277076 / 22554029 / +3.2% 0.44 / 0.47 / -5.0%
tpcds_q94/duckdb:vortex-file-compressed 22288603 / 22018366 / +1.2% 32417953 / 31879938 / +1.7% 0.69 / 0.69 / -0.5%
tpcds_q95/duckdb:vortex-file-compressed 60908441 / 60937295 / -0.0% 69104964 / 68082802 / +1.5% 0.88 / 0.90 / -1.5%
tpcds_q96/duckdb:vortex-file-compressed 6811335 / 6931992 / -1.7% 15040659 / 14802725 / +1.6% 0.45 / 0.47 / -3.3%
tpcds_q97/duckdb:vortex-file-compressed 23602221 / 23108020 / +2.1% 33054164 / 33118139 / -0.2% 0.71 / 0.70 / +2.3%
tpcds_q98/duckdb:vortex-file-compressed 11046091 / 11084246 / -0.3% 19810244 / 19340276 / +2.4% 0.56 / 0.57 / -2.7%
tpcds_q99/duckdb:vortex-file-compressed 14539513 / 14630474 / -0.6% 22474139 / 22040464 / +2.0% 0.65 / 0.66 / -2.5%
duckdb / vortex-compact / ns (1.003x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17803874 / 17730191 / +0.4% 25701989 / 25494262 / +0.8% 0.69 / 0.70 / -0.4%
tpcds_q02/duckdb:vortex-compact 18137804 / 18239360 / -0.6% 23521134 / 23566151 / -0.2% 0.77 / 0.77 / -0.4%
tpcds_q03/duckdb:vortex-compact 8567601 / 8397266 / +2.0% 17706009 / 17131065 / +3.4% 0.48 / 0.49 / -1.3%
tpcds_q04/duckdb:vortex-compact 62894990 / 64528130 / -2.5% 74639884 / 74371572 / +0.4% 0.84 / 0.87 / -2.9%
tpcds_q05/duckdb:vortex-compact 25031810 / 24899458 / +0.5% 34301318 / 33734321 / +1.7% 0.73 / 0.74 / -1.1%
tpcds_q06/duckdb:vortex-compact 26308912 / 26051011 / +1.0% 40259478 / 39211369 / +2.7% 0.65 / 0.66 / -1.6%
tpcds_q07/duckdb:vortex-compact 27494881 / 27613708 / -0.4% 39459343 / 37898076 / +4.1% 0.70 / 0.73 / -4.4%
tpcds_q08/duckdb:vortex-compact 22483080 / 22193600 / +1.3% 29787116 / 29607378 / +0.6% 0.75 / 0.75 / +0.7%
tpcds_q09/duckdb:vortex-compact 22350731 / 22112125 / +1.1% 31788020 / 30595864 / +3.9% 0.70 / 0.72 / -2.7%
tpcds_q10/duckdb:vortex-compact 32454254 / 32213886 / +0.7% 45108396 / 44363332 / +1.7% 0.72 / 0.73 / -0.9%
tpcds_q11/duckdb:vortex-compact 38633864 / 38510621 / +0.3% 49781951 / 47416896 / +5.0% 0.78 / 0.81 / -4.4%
tpcds_q12/duckdb:vortex-compact 12490524 / 12597368 / -0.8% 19563126 / 18022577 / +8.5% 0.64 / 0.70 / -8.7%
tpcds_q13/duckdb:vortex-compact 36398128 / 37006976 / -1.6% 46690619 / 47429000 / -1.6% 0.78 / 0.78 / -0.1%
tpcds_q14/duckdb:vortex-compact 58015546 / 58430269 / -0.7% 67802957 / 68879897 / -1.6% 0.86 / 0.85 / +0.9%
tpcds_q15/duckdb:vortex-compact 14874278 / 14836036 / +0.3% 21999007 / 21713154 / +1.3% 0.68 / 0.68 / -1.0%
tpcds_q16/duckdb:vortex-compact 26196216 / 27491604 / -4.7% 36185995 / 35787688 / +1.1% 0.72 / 0.77 / -5.8%
tpcds_q17/duckdb:vortex-compact 24436704 / 24239804 / +0.8% 35238252 / 35900615 / -1.8% 0.69 / 0.68 / +2.7%
tpcds_q18/duckdb:vortex-compact 37888795 / 38242408 / -0.9% 50126992 / 49228969 / +1.8% 0.76 / 0.78 / -2.7%
tpcds_q19/duckdb:vortex-compact 26595157 / 25484494 / +4.4% 32976231 / 32754059 / +0.7% 0.81 / 0.78 / +3.7%
tpcds_q20/duckdb:vortex-compact 13317108 / 13180310 / +1.0% 20462694 / 19618801 / +4.3% 0.65 / 0.67 / -3.1%
tpcds_q21/duckdb:vortex-compact 11113021 / 11028976 / +0.8% 23124843 / 22950521 / +0.8% 0.48 / 0.48 / +0.0%
tpcds_q22/duckdb:vortex-compact 22785013 / 20303102 / +12.2% 🔴 32019297 / 31253474 / +2.5% 0.71 / 0.65 / +9.5%
tpcds_q23/duckdb:vortex-compact 42352286 / 41961359 / +0.9% 53403052 / 52383742 / +1.9% 0.79 / 0.80 / -1.0%
tpcds_q24/duckdb:vortex-compact 28464454 / 28719144 / -0.9% 37757776 / 36286776 / +4.1% 0.75 / 0.79 / -4.7%
tpcds_q25/duckdb:vortex-compact 23304576 / 23407914 / -0.4% 35060447 / 34998908 / +0.2% 0.66 / 0.67 / -0.6%
tpcds_q26/duckdb:vortex-compact 26992942 / 26816998 / +0.7% 38736657 / 37850503 / +2.3% 0.70 / 0.71 / -1.6%
tpcds_q27/duckdb:vortex-compact 29787228 / 29627986 / +0.5% 41488938 / 39840599 / +4.1% 0.72 / 0.74 / -3.5%
tpcds_q28/duckdb:vortex-compact 22500800 / 21517046 / +4.6% 31264047 / 30474176 / +2.6% 0.72 / 0.71 / +1.9%
tpcds_q29/duckdb:vortex-compact 23147363 / 22862550 / +1.2% 34734426 / 32973929 / +5.3% 0.67 / 0.69 / -3.9%
tpcds_q30/duckdb:vortex-compact 22113691 / 22130720 / -0.1% 31492589 / 30246101 / +4.1% 0.70 / 0.73 / -4.0%
tpcds_q31/duckdb:vortex-compact 19583170 / 21479945 / -8.8% 28383370 / 28428266 / -0.2% 0.69 / 0.76 / -8.7%
tpcds_q32/duckdb:vortex-compact 11297262 / 11238321 / +0.5% 19150053 / 18730838 / +2.2% 0.59 / 0.60 / -1.7%
tpcds_q33/duckdb:vortex-compact 20459446 / 20414600 / +0.2% 30422175 / 28648937 / +6.2% 0.67 / 0.71 / -5.6%
tpcds_q34/duckdb:vortex-compact 14543608 / 14446048 / +0.7% 23971798 / 24256377 / -1.2% 0.61 / 0.60 / +1.9%
tpcds_q35/duckdb:vortex-compact 34685014 / 36258400 / -4.3% 47882302 / 47186180 / +1.5% 0.72 / 0.77 / -5.7%
tpcds_q36/duckdb:vortex-compact 16049312 / 15980377 / +0.4% 25585833 / 24455649 / +4.6% 0.63 / 0.65 / -4.0%
tpcds_q37/duckdb:vortex-compact 13356922 / 13569042 / -1.6% 27056884 / 25289570 / +7.0% 0.49 / 0.54 / -8.0%
tpcds_q38/duckdb:vortex-compact 25612666 / 25467776 / +0.6% 33225234 / 33202530 / +0.1% 0.77 / 0.77 / +0.5%
tpcds_q39/duckdb:vortex-compact 19992328 / 19535382 / +2.3% 31851210 / 32272163 / -1.3% 0.63 / 0.61 / +3.7%
tpcds_q40/duckdb:vortex-compact 12456030 / 12542064 / -0.7% 21466381 / 21350413 / +0.5% 0.58 / 0.59 / -1.2%
tpcds_q41/duckdb:vortex-compact 20801573 / 20601766 / +1.0% 28322098 / 28082072 / +0.9% 0.73 / 0.73 / +0.1%
tpcds_q42/duckdb:vortex-compact 8283226 / 8339226 / -0.7% 16796546 / 16468610 / +2.0% 0.49 / 0.51 / -2.6%
tpcds_q43/duckdb:vortex-compact 11341224 / 11101277 / +2.2% 20345177 / 19661322 / +3.5% 0.56 / 0.56 / -1.3%
tpcds_q44/duckdb:vortex-compact 14663680 / 14890860 / -1.5% 27445065 / 26106974 / +5.1% 0.53 / 0.57 / -6.3%
tpcds_q45/duckdb:vortex-compact 26519525 / 26368171 / +0.6% 34057338 / 33285817 / +2.3% 0.78 / 0.79 / -1.7%
tpcds_q46/duckdb:vortex-compact 33381838 / 33288595 / +0.3% 43847588 / 43806232 / +0.1% 0.76 / 0.76 / +0.2%
tpcds_q47/duckdb:vortex-compact 33329820 / 33005677 / +1.0% 42369265 / 41500588 / +2.1% 0.79 / 0.80 / -1.1%
tpcds_q48/duckdb:vortex-compact 37686384 / 38323124 / -1.7% 48275744 / 48256935 / +0.0% 0.78 / 0.79 / -1.7%
tpcds_q49/duckdb:vortex-compact 24338746 / 22834550 / +6.6% 32472392 / 32380168 / +0.3% 0.75 / 0.71 / +6.3%
tpcds_q50/duckdb:vortex-compact 17104799 / 18052536 / -5.2% 26756929 / 25974352 / +3.0% 0.64 / 0.70 / -8.0%
tpcds_q51/duckdb:vortex-compact 50223176 / 50434823 / -0.4% 59661257 / 78155565 / -23.7% 🟢 0.84 / 0.65 / +30.4%
tpcds_q52/duckdb:vortex-compact 8513968 / 8627010 / -1.3% 17240402 / 16338423 / +5.5% 0.49 / 0.53 / -6.5%
tpcds_q53/duckdb:vortex-compact 13581528 / 14811526 / -8.3% 23181542 / 22854874 / +1.4% 0.59 / 0.65 / -9.6%
tpcds_q54/duckdb:vortex-compact 21760986 / 21306912 / +2.1% 32680094 / 30951803 / +5.6% 0.67 / 0.69 / -3.3%
tpcds_q55/duckdb:vortex-compact 8472106 / 8247940 / +2.7% 16285301 / 17123832 / -4.9% 0.52 / 0.48 / +8.0%
tpcds_q56/duckdb:vortex-compact 22018204 / 21296627 / +3.4% 30196388 / 30133557 / +0.2% 0.73 / 0.71 / +3.2%
tpcds_q57/duckdb:vortex-compact 27428376 / 26845439 / +2.2% 35246659 / 34192289 / +3.1% 0.78 / 0.79 / -0.9%
tpcds_q58/duckdb:vortex-compact 22036610 / 21761145 / +1.3% 31860931 / 32834252 / -3.0% 0.69 / 0.66 / +4.4%
tpcds_q59/duckdb:vortex-compact 21131128 / 21599340 / -2.2% 28484698 / 28977467 / -1.7% 0.74 / 0.75 / -0.5%
tpcds_q60/duckdb:vortex-compact 21847425 / 20617374 / +6.0% 30741863 / 30621832 / +0.4% 0.71 / 0.67 / +5.6%
tpcds_q61/duckdb:vortex-compact 22407161 / 22746823 / -1.5% 32852324 / 32225615 / +1.9% 0.68 / 0.71 / -3.4%
tpcds_q62/duckdb:vortex-compact 12487148 / 12348330 / +1.1% 19413285 / 18789544 / +3.3% 0.64 / 0.66 / -2.1%
tpcds_q63/duckdb:vortex-compact 13132849 / 13095540 / +0.3% 23633866 / 21768070 / +8.6% 0.56 / 0.60 / -7.6%
tpcds_q64/duckdb:vortex-compact 62566938 / 63272916 / -1.1% 75829822 / 75634899 / +0.3% 0.83 / 0.84 / -1.4%
tpcds_q65/duckdb:vortex-compact 14807548 / 14630514 / +1.2% 24775494 / 24572334 / +0.8% 0.60 / 0.60 / +0.4%
tpcds_q66/duckdb:vortex-compact 34717506 / 34184496 / +1.6% 40381449 / 39439449 / +2.4% 0.86 / 0.87 / -0.8%
tpcds_q67/duckdb:vortex-compact 68846616 / 60997294 / +12.9% 🔴 67252851 / 66367107 / +1.3% 1.02 / 0.92 / +11.4%
tpcds_q68/duckdb:vortex-compact 24661464 / 24819134 / -0.6% 37460075 / 36151981 / +3.6% 0.66 / 0.69 / -4.1%
tpcds_q69/duckdb:vortex-compact 28228273 / 28877062 / -2.2% 42819318 / 43311216 / -1.1% 0.66 / 0.67 / -1.1%
tpcds_q70/duckdb:vortex-compact 16061484 / 16119506 / -0.4% 26742181 / 25348132 / +5.5% 0.60 / 0.64 / -5.6%
tpcds_q71/duckdb:vortex-compact 15586684 / 14395854 / +8.3% 24899103 / 24622637 / +1.1% 0.63 / 0.58 / +7.1%
tpcds_q72/duckdb:vortex-compact 49171765 / 48412805 / +1.6% 60236915 / 59792335 / +0.7% 0.82 / 0.81 / +0.8%
tpcds_q73/duckdb:vortex-compact 13262416 / 13344906 / -0.6% 22168943 / 22689228 / -2.3% 0.60 / 0.59 / +1.7%
tpcds_q74/duckdb:vortex-compact 32997582 / 32737974 / +0.8% 41521683 / 40558363 / +2.4% 0.79 / 0.81 / -1.5%
tpcds_q75/duckdb:vortex-compact 39990486 / 39865697 / +0.3% 52515631 / 50419148 / +4.2% 0.76 / 0.79 / -3.7%
tpcds_q76/duckdb:vortex-compact 14144984 / 13966382 / +1.3% 22703991 / 22469594 / +1.0% 0.62 / 0.62 / +0.2%
tpcds_q77/duckdb:vortex-compact 22540449 / 23350698 / -3.5% 32371582 / 31864974 / +1.6% 0.70 / 0.73 / -5.0%
tpcds_q78/duckdb:vortex-compact 44993154 / 45105572 / -0.2% 56155294 / 54459490 / +3.1% 0.80 / 0.83 / -3.3%
tpcds_q79/duckdb:vortex-compact 18437120 / 18187226 / +1.4% 28442533 / 28739527 / -1.0% 0.65 / 0.63 / +2.4%
tpcds_q80/duckdb:vortex-compact 32972838 / 33893837 / -2.7% 45028523 / 43611996 / +3.2% 0.73 / 0.78 / -5.8%
tpcds_q81/duckdb:vortex-compact 23244460 / 23072908 / +0.7% 31857653 / 31365922 / +1.6% 0.73 / 0.74 / -0.8%
tpcds_q82/duckdb:vortex-compact 12499325 / 12521126 / -0.2% 27663698 / 25703112 / +7.6% 0.45 / 0.49 / -7.2%
tpcds_q83/duckdb:vortex-compact 18984324 / 18873688 / +0.6% 26145589 / 25311132 / +3.3% 0.73 / 0.75 / -2.6%
tpcds_q84/duckdb:vortex-compact 17729876 / 17736043 / -0.0% 23807499 / 23469486 / +1.4% 0.74 / 0.76 / -1.5%
tpcds_q85/duckdb:vortex-compact 40751183 / 41171062 / -1.0% 54151966 / 52189440 / +3.8% 0.75 / 0.79 / -4.6%
tpcds_q86/duckdb:vortex-compact 11074087 / 11038162 / +0.3% 17690425 / 17026654 / +3.9% 0.63 / 0.65 / -3.4%
tpcds_q87/duckdb:vortex-compact 27173542 / 26898781 / +1.0% 34536871 / 35389422 / -2.4% 0.79 / 0.76 / +3.5%
tpcds_q88/duckdb:vortex-compact 32651480 / 32257886 / +1.2% 39199077 / 38485299 / +1.9% 0.83 / 0.84 / -0.6%
tpcds_q89/duckdb:vortex-compact 15107357 / 15244164 / -0.9% 23677572 / 22793055 / +3.9% 0.64 / 0.67 / -4.6%
tpcds_q90/duckdb:vortex-compact 8614763 / 8557445 / +0.7% 15476333 / 15727951 / -1.6% 0.56 / 0.54 / +2.3%
tpcds_q91/duckdb:vortex-compact 24233758 / 24137092 / +0.4% 32785718 / 32003479 / +2.4% 0.74 / 0.75 / -2.0%
tpcds_q92/duckdb:vortex-compact 11619442 / 11494285 / +1.1% 19374142 / 18902751 / +2.5% 0.60 / 0.61 / -1.4%
tpcds_q93/duckdb:vortex-compact 12537632 / 12839347 / -2.3% 25327552 / 24916149 / +1.7% 0.50 / 0.52 / -3.9%
tpcds_q94/duckdb:vortex-compact 24042135 / 23830125 / +0.9% 33275250 / 32953979 / +1.0% 0.72 / 0.72 / -0.1%
tpcds_q95/duckdb:vortex-compact 62546116 / 62701992 / -0.2% 70310041 / 70371185 / -0.1% 0.89 / 0.89 / -0.2%
tpcds_q96/duckdb:vortex-compact 8116800 / 8639236 / -6.0% 15244470 / 16029824 / -4.9% 0.53 / 0.54 / -1.2%
tpcds_q97/duckdb:vortex-compact 24247702 / 24338372 / -0.4% 32971692 / 32487670 / +1.5% 0.74 / 0.75 / -1.8%
tpcds_q98/duckdb:vortex-compact 14088264 / 13904135 / +1.3% 22481087 / 21213501 / +6.0% 0.63 / 0.66 / -4.4%
tpcds_q99/duckdb:vortex-compact 15472570 / 15672407 / -1.3% 22803244 / 23025786 / -1.0% 0.68 / 0.68 / -0.3%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24325724 / 23996042 / +1.4% 31360679 / 30903622 / +1.5% 0.78 / 0.78 / -0.1%
tpcds_q02/duckdb:parquet 17984190 / 17786752 / +1.1% 24046218 / 23740840 / +1.3% 0.75 / 0.75 / -0.2%
tpcds_q03/duckdb:parquet 9805862 / 9673594 / +1.4% 15828850 / 15321232 / +3.3% 0.62 / 0.63 / -1.9%
tpcds_q04/duckdb:parquet 118122470 / 117760600 / +0.3% 126562038 / 125551281 / +0.8% 0.93 / 0.94 / -0.5%
tpcds_q05/duckdb:parquet 28329678 / 28169823 / +0.6% 33280861 / 32699336 / +1.8% 0.85 / 0.86 / -1.2%
tpcds_q06/duckdb:parquet 26599262 / 26474932 / +0.5% 35863175 / 35397650 / +1.3% 0.74 / 0.75 / -0.8%
tpcds_q07/duckdb:parquet 30820688 / 33349046 / -7.6% 38997967 / 39303255 / -0.8% 0.79 / 0.85 / -6.9%
tpcds_q08/duckdb:parquet 19803966 / 19558422 / +1.3% 24458190 / 24537911 / -0.3% 0.81 / 0.80 / +1.6%
tpcds_q09/duckdb:parquet 26474006 / 26364488 / +0.4% 29306549 / 29704973 / -1.3% 0.90 / 0.89 / +1.8%
tpcds_q10/duckdb:parquet 32917514 / 32532463 / +1.2% 40972002 / 40039605 / +2.3% 0.80 / 0.81 / -1.1%
tpcds_q11/duckdb:parquet 68844262 / 68870108 / -0.0% 75140233 / 74795297 / +0.5% 0.92 / 0.92 / -0.5%
tpcds_q12/duckdb:parquet 14076620 / 14091031 / -0.1% 19369586 / 19040233 / +1.7% 0.73 / 0.74 / -1.8%
tpcds_q13/duckdb:parquet 31957631 / 32139856 / -0.6% 39390296 / 38969517 / +1.1% 0.81 / 0.82 / -1.6%
tpcds_q14/duckdb:parquet 65396879 / 64354318 / +1.6% 68466928 / 67949677 / +0.8% 0.96 / 0.95 / +0.9%
tpcds_q15/duckdb:parquet 16897233 / 16501586 / +2.4% 22593311 / 22228334 / +1.6% 0.75 / 0.74 / +0.7%
tpcds_q16/duckdb:parquet 30237819 / 30261378 / -0.1% 37580000 / 37085054 / +1.3% 0.80 / 0.82 / -1.4%
tpcds_q17/duckdb:parquet 34563888 / 34374024 / +0.6% 40454286 / 40258296 / +0.5% 0.85 / 0.85 / +0.1%
tpcds_q18/duckdb:parquet 47413327 / 47341254 / +0.2% 55130714 / 53822170 / +2.4% 0.86 / 0.88 / -2.2%
tpcds_q19/duckdb:parquet 18971224 / 18681093 / +1.6% 26025735 / 25327325 / +2.8% 0.73 / 0.74 / -1.2%
tpcds_q20/duckdb:parquet 15007133 / 15037937 / -0.2% 19593678 / 19303628 / +1.5% 0.77 / 0.78 / -1.7%
tpcds_q21/duckdb:parquet 10478464 / 10264242 / +2.1% 16899843 / 16593760 / +1.8% 0.62 / 0.62 / +0.2%
tpcds_q22/duckdb:parquet 20802840 / 20634817 / +0.8% 26721363 / 26711808 / +0.0% 0.78 / 0.77 / +0.8%
tpcds_q23/duckdb:parquet 46347049 / 43041032 / +7.7% 47403554 / 46521564 / +1.9% 0.98 / 0.93 / +5.7%
tpcds_q24/duckdb:parquet 31853990 / 30555330 / +4.3% 36677982 / 36178051 / +1.4% 0.87 / 0.84 / +2.8%
tpcds_q25/duckdb:parquet 30711482 / 30258642 / +1.5% 37569930 / 36566439 / +2.7% 0.82 / 0.83 / -1.2%
tpcds_q26/duckdb:parquet 29052832 / 29136078 / -0.3% 35993739 / 34991772 / +2.9% 0.81 / 0.83 / -3.1%
tpcds_q27/duckdb:parquet 33825468 / 33447661 / +1.1% 41884429 / 41683711 / +0.5% 0.81 / 0.80 / +0.6%
tpcds_q28/duckdb:parquet 26102852 / 26022834 / +0.3% 34157518 / 31289666 / +9.2% 0.76 / 0.83 / -8.1%
tpcds_q29/duckdb:parquet 32044004 / 31988569 / +0.2% 40420189 / 39116303 / +3.3% 0.79 / 0.82 / -3.1%
tpcds_q30/duckdb:parquet 35692586 / 35435476 / +0.7% 45007619 / 43993117 / +2.3% 0.79 / 0.81 / -1.5%
tpcds_q31/duckdb:parquet 35634996 / 35738276 / -0.3% 43328481 / 42663526 / +1.6% 0.82 / 0.84 / -1.8%
tpcds_q32/duckdb:parquet 14225448 / 14123830 / +0.7% 20687442 / 20031530 / +3.3% 0.69 / 0.71 / -2.5%
tpcds_q33/duckdb:parquet 23996922 / 24609394 / -2.5% 29494847 / 28380832 / +3.9% 0.81 / 0.87 / -6.2%
tpcds_q34/duckdb:parquet 17863405 / 18484024 / -3.4% 24368001 / 23925045 / +1.9% 0.73 / 0.77 / -5.1%
tpcds_q35/duckdb:parquet 35421389 / 35132136 / +0.8% 44423016 / 43531703 / +2.0% 0.80 / 0.81 / -1.2%
tpcds_q36/duckdb:parquet 41060987 / 41035856 / +0.1% 47987595 / 47893183 / +0.2% 0.86 / 0.86 / -0.1%
tpcds_q37/duckdb:parquet 12951202 / 12809626 / +1.1% 20075676 / 18496370 / +8.5% 0.65 / 0.69 / -6.8%
tpcds_q38/duckdb:parquet 29796912 / 29729394 / +0.2% 33997588 / 34840540 / -2.4% 0.88 / 0.85 / +2.7%
tpcds_q39/duckdb:parquet 23276853 / 23485818 / -0.9% 30678032 / 30291549 / +1.3% 0.76 / 0.78 / -2.1%
tpcds_q40/duckdb:parquet 16127688 / 15857985 / +1.7% 21649493 / 20818997 / +4.0% 0.74 / 0.76 / -2.2%
tpcds_q41/duckdb:parquet 12180588 / 11981630 / +1.7% 17896966 / 17649189 / +1.4% 0.68 / 0.68 / +0.3%
tpcds_q42/duckdb:parquet 9547962 / 9555690 / -0.1% 15640305 / 15279196 / +2.4% 0.61 / 0.63 / -2.4%
tpcds_q43/duckdb:parquet 12094613 / 12077722 / +0.1% 18450528 / 17813028 / +3.6% 0.66 / 0.68 / -3.3%
tpcds_q44/duckdb:parquet 20247286 / 21818490 / -7.2% 27484327 / 26440781 / +3.9% 0.74 / 0.83 / -10.7%
tpcds_q45/duckdb:parquet 21054306 / 20874288 / +0.9% 28131897 / 27464282 / +2.4% 0.75 / 0.76 / -1.5%
tpcds_q46/duckdb:parquet 36627408 / 38025740 / -3.7% 44113076 / 42714366 / +3.3% 0.83 / 0.89 / -6.7%
tpcds_q47/duckdb:parquet 34627049 / 34420600 / +0.6% 41634561 / 41163962 / +1.1% 0.83 / 0.84 / -0.5%
tpcds_q48/duckdb:parquet 29007354 / 30447377 / -4.7% 37104570 / 36046714 / +2.9% 0.78 / 0.84 / -7.4%
tpcds_q49/duckdb:parquet 29910164 / 30877056 / -3.1% 36318687 / 35801884 / +1.4% 0.82 / 0.86 / -4.5%
tpcds_q50/duckdb:parquet 19461590 / 19352233 / +0.6% 26000418 / 25423062 / +2.3% 0.75 / 0.76 / -1.7%
tpcds_q51/duckdb:parquet 52474688 / 52712596 / -0.5% 60961219 / 59167788 / +3.0% 0.86 / 0.89 / -3.4%
tpcds_q52/duckdb:parquet 9691190 / 9488666 / +2.1% 15997784 / 15139716 / +5.7% 0.61 / 0.63 / -3.3%
tpcds_q53/duckdb:parquet 13739171 / 13979474 / -1.7% 21851399 / 20440901 / +6.9% 0.63 / 0.68 / -8.1%
tpcds_q54/duckdb:parquet 24983594 / 24601710 / +1.6% 32235220 / 31679509 / +1.8% 0.78 / 0.78 / -0.2%
tpcds_q55/duckdb:parquet 9583032 / 9341512 / +2.6% 15310041 / 14944132 / +2.4% 0.63 / 0.63 / +0.1%
tpcds_q56/duckdb:parquet 26760934 / 24882942 / +7.5% 30515737 / 30322569 / +0.6% 0.88 / 0.82 / +6.9%
tpcds_q57/duckdb:parquet 30730506 / 30402402 / +1.1% 35967232 / 35544015 / +1.2% 0.85 / 0.86 / -0.1%
tpcds_q58/duckdb:parquet 24196780 / 23657598 / +2.3% 30450929 / 28913041 / +5.3% 0.79 / 0.82 / -2.9%
tpcds_q59/duckdb:parquet 22740218 / 22783736 / -0.2% 29037175 / 28969349 / +0.2% 0.78 / 0.79 / -0.4%
tpcds_q60/duckdb:parquet 26194835 / 26652178 / -1.7% 32154537 / 31536238 / +2.0% 0.81 / 0.85 / -3.6%
tpcds_q61/duckdb:parquet 25015008 / 25282762 / -1.1% 28726129 / 28140120 / +2.1% 0.87 / 0.90 / -3.1%
tpcds_q62/duckdb:parquet 12890759 / 12628204 / +2.1% 17871987 / 18054092 / -1.0% 0.72 / 0.70 / +3.1%
tpcds_q63/duckdb:parquet 13651219 / 13169518 / +3.7% 19959199 / 19765767 / +1.0% 0.68 / 0.67 / +2.7%
tpcds_q64/duckdb:parquet 70556791 / 70124306 / +0.6% 80585871 / 78473219 / +2.7% 0.88 / 0.89 / -2.0%
tpcds_q65/duckdb:parquet 19698598 / 19531788 / +0.9% 26043263 / 25390584 / +2.6% 0.76 / 0.77 / -1.7%
tpcds_q66/duckdb:parquet 33196490 / 33266424 / -0.2% 38233564 / 37699496 / +1.4% 0.87 / 0.88 / -1.6%
tpcds_q67/duckdb:parquet 61061488 / 61372094 / -0.5% 68064866 / 68218248 / -0.2% 0.90 / 0.90 / -0.3%
tpcds_q68/duckdb:parquet 28407861 / 29414076 / -3.4% 36523586 / 35986606 / +1.5% 0.78 / 0.82 / -4.8%
tpcds_q69/duckdb:parquet 25887181 / 25793781 / +0.4% 34323745 / 33996532 / +1.0% 0.75 / 0.76 / -0.6%
tpcds_q70/duckdb:parquet 19457487 / 19143344 / +1.6% 27114288 / 26365612 / +2.8% 0.72 / 0.73 / -1.2%
tpcds_q71/duckdb:parquet 17027484 / 17124168 / -0.6% 23987254 / 23186938 / +3.5% 0.71 / 0.74 / -3.9%
tpcds_q72/duckdb:parquet 54018778 / 52929268 / +2.1% 60382913 / 58879640 / +2.6% 0.89 / 0.90 / -0.5%
tpcds_q73/duckdb:parquet 14636217 / 14747736 / -0.8% 21258919 / 21389327 / -0.6% 0.69 / 0.69 / -0.1%
tpcds_q74/duckdb:parquet 84341208 / 85838255 / -1.7% 91002747 / 90051254 / +1.1% 0.93 / 0.95 / -2.8%
tpcds_q75/duckdb:parquet 46029258 / 43083905 / +6.8% 50439633 / 49148629 / +2.6% 0.91 / 0.88 / +4.1%
tpcds_q76/duckdb:parquet 19472460 / 19605366 / -0.7% 23555751 / 23181803 / +1.6% 0.83 / 0.85 / -2.3%
tpcds_q77/duckdb:parquet 24205234 / 25532766 / -5.2% 31113947 / 30882055 / +0.8% 0.78 / 0.83 / -5.9%
tpcds_q78/duckdb:parquet 78137700 / 77681797 / +0.6% 86350978 / 84930270 / +1.7% 0.90 / 0.91 / -1.1%
tpcds_q79/duckdb:parquet 24494965 / 22711582 / +7.9% 28796259 / 28372133 / +1.5% 0.85 / 0.80 / +6.3%
tpcds_q80/duckdb:parquet 36932319 / 38715876 / -4.6% 44127272 / 42947675 / +2.7% 0.84 / 0.90 / -7.2%
tpcds_q81/duckdb:parquet 36391398 / 36255840 / +0.4% 44687818 / 44557710 / +0.3% 0.81 / 0.81 / +0.1%
tpcds_q82/duckdb:parquet 13597291 / 13289966 / +2.3% 20592722 / 19942946 / +3.3% 0.66 / 0.67 / -0.9%
tpcds_q83/duckdb:parquet 20354424 / 20160996 / +1.0% 25858104 / 24766528 / +4.4% 0.79 / 0.81 / -3.3%
tpcds_q84/duckdb:parquet 22970299 / 22602292 / +1.6% 28848043 / 28441353 / +1.4% 0.80 / 0.79 / +0.2%
tpcds_q85/duckdb:parquet 32217889 / 32258556 / -0.1% 39769901 / 38942329 / +2.1% 0.81 / 0.83 / -2.2%
tpcds_q86/duckdb:parquet 11756888 / 11779433 / -0.2% 16872421 / 16343564 / +3.2% 0.70 / 0.72 / -3.3%
tpcds_q87/duckdb:parquet 31342568 / 31351080 / -0.0% 35526556 / 34915420 / +1.8% 0.88 / 0.90 / -1.7%
tpcds_q88/duckdb:parquet 38881776 / 38453567 / +1.1% 44133354 / 43234108 / +2.1% 0.88 / 0.89 / -0.9%
tpcds_q89/duckdb:parquet 14246968 / 14524206 / -1.9% 21570709 / 20793007 / +3.7% 0.66 / 0.70 / -5.4%
tpcds_q90/duckdb:parquet 10061405 / 10153406 / -0.9% 15183776 / 14930511 / +1.7% 0.66 / 0.68 / -2.6%
tpcds_q91/duckdb:parquet 21087596 / 21031335 / +0.3% 28577177 / 28062873 / +1.8% 0.74 / 0.75 / -1.5%
tpcds_q92/duckdb:parquet 15589995 / 15569576 / +0.1% 22277637 / 21843528 / +2.0% 0.70 / 0.71 / -1.8%
tpcds_q93/duckdb:parquet 14119800 / 14155761 / -0.3% 20553822 / 20142365 / +2.0% 0.69 / 0.70 / -2.3%
tpcds_q94/duckdb:parquet 25294190 / 25393021 / -0.4% 33381738 / 32307355 / +3.3% 0.76 / 0.79 / -3.6%
tpcds_q95/duckdb:parquet 44204381 / 43499790 / +1.6% 49819353 / 48995974 / +1.7% 0.89 / 0.89 / -0.1%
tpcds_q96/duckdb:parquet 8310618 / 8242915 / +0.8% 13676694 / 13728613 / -0.4% 0.61 / 0.60 / +1.2%
tpcds_q97/duckdb:parquet 27697824 / 27433995 / +1.0% 33868127 / 33803585 / +0.2% 0.82 / 0.81 / +0.8%
tpcds_q98/duckdb:parquet 16512488 / 16489278 / +0.1% 22916908 / 22825596 / +0.4% 0.72 / 0.72 / -0.3%
tpcds_q99/duckdb:parquet 18740901 / 18644899 / +0.5% 24718863 / 24285571 / +1.8% 0.76 / 0.77 / -1.2%
duckdb / duckdb / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15624350 / 15698208 / -0.5% 24689935 / 24784459 / -0.4% 0.63 / 0.63 / -0.1%
tpcds_q02/duckdb:duckdb 12360924 / 12221734 / +1.1% 19327021 / 18331205 / +5.4% 0.64 / 0.67 / -4.1%
tpcds_q03/duckdb:duckdb 4915426 / 4917159 / -0.0% 12690355 / 10959359 / +15.8% 🔴 0.39 / 0.45 / -13.7%
tpcds_q04/duckdb:duckdb 48593832 / 48776356 / -0.4% 55780240 / 55609773 / +0.3% 0.87 / 0.88 / -0.7%
tpcds_q05/duckdb:duckdb 15413090 / 15052978 / +2.4% 23100973 / 21621405 / +6.8% 0.67 / 0.70 / -4.2%
tpcds_q06/duckdb:duckdb 17982769 / 17860286 / +0.7% 29581689 / 28411747 / +4.1% 0.61 / 0.63 / -3.3%
tpcds_q07/duckdb:duckdb 21264282 / 21087715 / +0.8% 31620416 / 30290797 / +4.4% 0.67 / 0.70 / -3.4%
tpcds_q08/duckdb:duckdb 18215838 / 18460852 / -1.3% 28053010 / 27261299 / +2.9% 0.65 / 0.68 / -4.1%
tpcds_q09/duckdb:duckdb 8455784 / 8557178 / -1.2% 13375308 / 13270478 / +0.8% 0.63 / 0.64 / -2.0%
tpcds_q10/duckdb:duckdb 18303778 / 18008133 / +1.6% 28539211 / 27191708 / +5.0% 0.64 / 0.66 / -3.2%
tpcds_q11/duckdb:duckdb 41978124 / 42296534 / -0.8% 50419940 / 50153072 / +0.5% 0.83 / 0.84 / -1.3%
tpcds_q12/duckdb:duckdb 9046280 / 9093019 / -0.5% 16437543 / 15830784 / +3.8% 0.55 / 0.57 / -4.2%
tpcds_q13/duckdb:duckdb 20006057 / 20225857 / -1.1% 32134916 / 30815437 / +4.3% 0.62 / 0.66 / -5.1%
tpcds_q14/duckdb:duckdb 40121600 / 39789386 / +0.8% 46590912 / 45704672 / +1.9% 0.86 / 0.87 / -1.1%
tpcds_q15/duckdb:duckdb 7894336 / 7905994 / -0.1% 14023455 / 13603151 / +3.1% 0.56 / 0.58 / -3.1%
tpcds_q16/duckdb:duckdb 12260336 / 12299868 / -0.3% 21645311 / 20780076 / +4.2% 0.57 / 0.59 / -4.3%
tpcds_q17/duckdb:duckdb 17570924 / 17589603 / -0.1% 29433795 / 27064198 / +8.8% 0.60 / 0.65 / -8.1%
tpcds_q18/duckdb:duckdb 31819162 / 32321721 / -1.6% 45893853 / 43721480 / +5.0% 0.69 / 0.74 / -6.2%
tpcds_q19/duckdb:duckdb 10485762 / 10630475 / -1.4% 19944655 / 19175181 / +4.0% 0.53 / 0.55 / -5.2%
tpcds_q20/duckdb:duckdb 9614189 / 9573547 / +0.4% 16623487 / 16233293 / +2.4% 0.58 / 0.59 / -1.9%
tpcds_q21/duckdb:duckdb 6153549 / 6092138 / +1.0% 11377048 / 10914274 / +4.2% 0.54 / 0.56 / -3.1%
tpcds_q22/duckdb:duckdb 17493222 / 17533923 / -0.2% 22685228 / 22615422 / +0.3% 0.77 / 0.78 / -0.5%
tpcds_q23/duckdb:duckdb 26712178 / 26719811 / -0.0% 34740497 / 34011280 / +2.1% 0.77 / 0.79 / -2.1%
tpcds_q24/duckdb:duckdb 15397628 / 15367806 / +0.2% 29460953 / 28158082 / +4.6% 0.52 / 0.55 / -4.2%
tpcds_q25/duckdb:duckdb 13727475 / 13738026 / -0.1% 27411300 / 25369324 / +8.0% 0.50 / 0.54 / -7.5%
tpcds_q26/duckdb:duckdb 18115312 / 18313424 / -1.1% 27635522 / 26193437 / +5.5% 0.66 / 0.70 / -6.2%
tpcds_q27/duckdb:duckdb 23499764 / 23149646 / +1.5% 35135175 / 33496964 / +4.9% 0.67 / 0.69 / -3.2%
tpcds_q28/duckdb:duckdb 12018588 / 11756034 / +2.2% 17310327 / 16428571 / +5.4% 0.69 / 0.72 / -3.0%
tpcds_q29/duckdb:duckdb 13858830 / 13832484 / +0.2% 26215615 / 24022180 / +9.1% 0.53 / 0.58 / -8.2%
tpcds_q30/duckdb:duckdb 17706118 / 17641554 / +0.4% 30225458 / 29378564 / +2.9% 0.59 / 0.60 / -2.4%
tpcds_q31/duckdb:duckdb 30159981 / 30266866 / -0.4% 40023233 / 38363834 / +4.3% 0.75 / 0.79 / -4.5%
tpcds_q32/duckdb:duckdb 5387453 / 5358127 / +0.5% 12857930 / 12117138 / +6.1% 0.42 / 0.44 / -5.2%
tpcds_q33/duckdb:duckdb 9008100 / 9095366 / -1.0% 16501218 / 14850149 / +11.1% 🔴 0.55 / 0.61 / -10.9%
tpcds_q34/duckdb:duckdb 10456589 / 10446625 / +0.1% 19845768 / 18515271 / +7.2% 0.53 / 0.56 / -6.6%
tpcds_q35/duckdb:duckdb 24217532 / 24214200 / +0.0% 34267454 / 33732941 / +1.6% 0.71 / 0.72 / -1.5%
tpcds_q36/duckdb:duckdb 12718212 / 12967492 / -1.9% 22500487 / 22157013 / +1.6% 0.57 / 0.59 / -3.4%
tpcds_q37/duckdb:duckdb 5330405 / 5301912 / +0.5% 13382917 / 13117058 / +2.0% 0.40 / 0.40 / -1.5%
tpcds_q38/duckdb:duckdb 22788818 / 22911670 / -0.5% 29750495 / 29351732 / +1.4% 0.77 / 0.78 / -1.9%
tpcds_q39/duckdb:duckdb 19391707 / 19267836 / +0.6% 25030208 / 24484118 / +2.2% 0.77 / 0.79 / -1.6%
tpcds_q40/duckdb:duckdb 8369387 / 8366918 / +0.0% 16041687 / 15516218 / +3.4% 0.52 / 0.54 / -3.2%
tpcds_q41/duckdb:duckdb 10185944 / 10120862 / +0.6% 16752490 / 16606930 / +0.9% 0.61 / 0.61 / -0.2%
tpcds_q42/duckdb:duckdb 4771158 / 4849955 / -1.6% 11564788 / 11490524 / +0.6% 0.41 / 0.42 / -2.3%
tpcds_q43/duckdb:duckdb 7509990 / 7561610 / -0.7% 15950472 / 14234699 / +12.1% 🔴 0.47 / 0.53 / -11.4%
tpcds_q44/duckdb:duckdb 9260054 / 9211100 / +0.5% 18446361 / 17288420 / +6.7% 0.50 / 0.53 / -5.8%
tpcds_q45/duckdb:duckdb 13717272 / 13556096 / +1.2% 22432143 / 21261203 / +5.5% 0.61 / 0.64 / -4.1%
tpcds_q46/duckdb:duckdb 25068630 / 25176650 / -0.4% 36604502 / 34431172 / +6.3% 0.68 / 0.73 / -6.3%
tpcds_q47/duckdb:duckdb 33309806 / 33327336 / -0.1% 41393969 / 40301873 / +2.7% 0.80 / 0.83 / -2.7%
tpcds_q48/duckdb:duckdb 27280068 / 27197186 / +0.3% 36755233 / 34763011 / +5.7% 0.74 / 0.78 / -5.1%
tpcds_q49/duckdb:duckdb 14756926 / 14452013 / +2.1% 25413165 / 23856036 / +6.5% 0.58 / 0.61 / -4.1%
tpcds_q50/duckdb:duckdb 10075805 / 9954652 / +1.2% 18252035 / 16853984 / +8.3% 0.55 / 0.59 / -6.5%
tpcds_q51/duckdb:duckdb 46763624 / 46446186 / +0.7% 70718375 / 54648594 / +29.4% 🔴 0.66 / 0.85 / -22.2%
tpcds_q52/duckdb:duckdb 4955426 / 5057382 / -2.0% 11979831 / 11587426 / +3.4% 0.41 / 0.44 / -5.2%
tpcds_q53/duckdb:duckdb 9417144 / 9351928 / +0.7% 17207215 / 16186105 / +6.3% 0.55 / 0.58 / -5.3%
tpcds_q54/duckdb:duckdb 11746442 / 11787664 / -0.3% 21633241 / 21268755 / +1.7% 0.54 / 0.55 / -2.0%
tpcds_q55/duckdb:duckdb 4821636 / 4875844 / -1.1% 12962585 / 11125128 / +16.5% 🔴 0.37 / 0.44 / -15.1%
tpcds_q56/duckdb:duckdb 10297167 / 10331390 / -0.3% 17926974 / 16674579 / +7.5% 0.57 / 0.62 / -7.3%
tpcds_q57/duckdb:duckdb 27780928 / 27596210 / +0.7% 35416181 / 34102975 / +3.9% 0.78 / 0.81 / -3.1%
tpcds_q58/duckdb:duckdb 10800184 / 10894581 / -0.9% 18359429 / 17101730 / +7.4% 0.59 / 0.64 / -7.7%
tpcds_q59/duckdb:duckdb 16826518 / 16889808 / -0.4% 25047462 / 23415341 / +7.0% 0.67 / 0.72 / -6.9%
tpcds_q60/duckdb:duckdb 10894574 / 10988404 / -0.9% 18152871 / 17263818 / +5.1% 0.60 / 0.64 / -5.7%
tpcds_q61/duckdb:duckdb 10047964 / 10054644 / -0.1% 19429891 / 18317214 / +6.1% 0.52 / 0.55 / -5.8%
tpcds_q62/duckdb:duckdb 8326778 / 8353882 / -0.3% 15487388 / 14283014 / +8.4% 0.54 / 0.58 / -8.1%
tpcds_q63/duckdb:duckdb 8837892 / 8846206 / -0.1% 17281118 / 15927754 / +8.5% 0.51 / 0.56 / -7.9%
tpcds_q64/duckdb:duckdb 38666068 / 37889572 / +2.0% 56503653 / 52199763 / +8.2% 0.68 / 0.73 / -5.7%
tpcds_q65/duckdb:duckdb 9739096 / 9691036 / +0.5% 19662037 / 18207533 / +8.0% 0.50 / 0.53 / -6.9%
tpcds_q66/duckdb:duckdb 24541017 / 24331466 / +0.9% 31663465 / 31053151 / +2.0% 0.78 / 0.78 / -1.1%
tpcds_q67/duckdb:duckdb 55106486 / 55030353 / +0.1% 65368854 / 64920604 / +0.7% 0.84 / 0.85 / -0.5%
tpcds_q68/duckdb:duckdb 15764279 / 15769788 / -0.0% 27691191 / 25184863 / +10.0% 0.57 / 0.63 / -9.1%
tpcds_q69/duckdb:duckdb 15176808 / 15162486 / +0.1% 24936356 / 23985087 / +4.0% 0.61 / 0.63 / -3.7%
tpcds_q70/duckdb:duckdb 10120332 / 10104738 / +0.2% 20251361 / 19623398 / +3.2% 0.50 / 0.51 / -3.0%
tpcds_q71/duckdb:duckdb 7916646 / 7877645 / +0.5% 15513712 / 14267232 / +8.7% 0.51 / 0.55 / -7.6%
tpcds_q72/duckdb:duckdb 36467644 / 36566332 / -0.3% 47249028 / 45252816 / +4.4% 0.77 / 0.81 / -4.5%
tpcds_q73/duckdb:duckdb 7938424 / 7961354 / -0.3% 17458686 / 16324126 / +7.0% 0.45 / 0.49 / -6.8%
tpcds_q74/duckdb:duckdb 36107502 / 36041758 / +0.2% 43812969 / 43970237 / -0.4% 0.82 / 0.82 / +0.5%
tpcds_q75/duckdb:duckdb 29953232 / 29844986 / +0.4% 40205896 / 38944312 / +3.2% 0.74 / 0.77 / -2.8%
tpcds_q76/duckdb:duckdb 8168726 / 8134020 / +0.4% 16835918 / 15402601 / +9.3% 0.49 / 0.53 / -8.1%
tpcds_q77/duckdb:duckdb 10507781 / 10565370 / -0.5% 20693970 / 19377603 / +6.8% 0.51 / 0.55 / -6.9%
tpcds_q78/duckdb:duckdb 64109154 / 64231928 / -0.2% 76097665 / 73931809 / +2.9% 0.84 / 0.87 / -3.0%
tpcds_q79/duckdb:duckdb 12103468 / 12189726 / -0.7% 21624008 / 20777370 / +4.1% 0.56 / 0.59 / -4.6%
tpcds_q80/duckdb:duckdb 16858326 / 16913376 / -0.3% 29139964 / 27715162 / +5.1% 0.58 / 0.61 / -5.2%
tpcds_q81/duckdb:duckdb 25044526 / 25241942 / -0.8% 38546652 / 37548125 / +2.7% 0.65 / 0.67 / -3.4%
tpcds_q82/duckdb:duckdb 5822146 / 5810306 / +0.2% 14280060 / 13785964 / +3.6% 0.41 / 0.42 / -3.3%
tpcds_q83/duckdb:duckdb 9020790 / 8877621 / +1.6% 15306724 / 14392234 / +6.4% 0.59 / 0.62 / -4.5%
tpcds_q84/duckdb:duckdb 9294108 / 9317486 / -0.3% 18438604 / 17400972 / +6.0% 0.50 / 0.54 / -5.9%
tpcds_q85/duckdb:duckdb 21195234 / 21177574 / +0.1% 35064832 / 34095301 / +2.8% 0.60 / 0.62 / -2.7%
tpcds_q86/duckdb:duckdb 8470312 / 8490072 / -0.2% 15236056 / 14490165 / +5.1% 0.56 / 0.59 / -5.1%
tpcds_q87/duckdb:duckdb 24762437 / 24882074 / -0.5% 31455420 / 30313205 / +3.8% 0.79 / 0.82 / -4.1%
tpcds_q88/duckdb:duckdb 18851834 / 18818782 / +0.2% 24668890 / 23956428 / +3.0% 0.76 / 0.79 / -2.7%
tpcds_q89/duckdb:duckdb 10293170 / 10242261 / +0.5% 18749022 / 17343209 / +8.1% 0.55 / 0.59 / -7.0%
tpcds_q90/duckdb:duckdb 4949557 / 4888927 / +1.2% 10716472 / 10386408 / +3.2% 0.46 / 0.47 / -1.9%
tpcds_q91/duckdb:duckdb 8748526 / 8711736 / +0.4% 19003027 / 18119554 / +4.9% 0.46 / 0.48 / -4.2%
tpcds_q92/duckdb:duckdb 6698040 / 6722879 / -0.4% 14751924 / 14127085 / +4.4% 0.45 / 0.48 / -4.6%
tpcds_q93/duckdb:duckdb 6980504 / 6905214 / +1.1% 14829164 / 13749531 / +7.9% 0.47 / 0.50 / -6.3%
tpcds_q94/duckdb:duckdb 11814335 / 11744454 / +0.6% 23103000 / 21575433 / +7.1% 0.51 / 0.54 / -6.1%
tpcds_q95/duckdb:duckdb 35801436 / 35477648 / +0.9% 44399781 / 42518999 / +4.4% 0.81 / 0.83 / -3.4%
tpcds_q96/duckdb:duckdb 3803550 / 3822212 / -0.5% 9173250 / 8709311 / +5.3% 0.41 / 0.44 / -5.5%
tpcds_q97/duckdb:duckdb 21761895 / 21495320 / +1.2% 28184777 / 27132507 / +3.9% 0.77 / 0.79 / -2.5%
tpcds_q98/duckdb:duckdb 10796336 / 10728338 / +0.6% 19258273 / 17939143 / +7.4% 0.56 / 0.60 / -6.3%
tpcds_q99/duckdb:duckdb 13012120 / 13003278 / +0.1% 19702838 / 19087001 / +3.2% 0.66 / 0.68 / -3.1%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 52397693 / 51360248 / +2.0% 81586582 / 74989480 / +8.8% 0.64 / 0.68 / -6.2%
appian_q02/datafusion:vortex-file-compressed 228598758 / 227644807 / +0.4% 274227501 / 267258966 / +2.6% 0.83 / 0.85 / -2.1%
appian_q03/datafusion:vortex-file-compressed 129388412 / 141890835 / -8.8% 178249274 / 195568358 / -8.9% 0.73 / 0.73 / +0.0%
appian_q04/datafusion:vortex-file-compressed 9652583578 / 9592617741 / +0.6% 9645996843 / 9646907983 / -0.0% 1.00 / 0.99 / +0.6%
appian_q05/datafusion:vortex-file-compressed 134560193 / 131739451 / +2.1% 176124045 / 174134366 / +1.1% 0.76 / 0.76 / +1.0%
appian_q06/datafusion:vortex-file-compressed 146078751 / 140410975 / +4.0% 174359845 / 165223323 / +5.5% 0.84 / 0.85 / -1.4%
appian_q07/datafusion:vortex-file-compressed 159497001 / 158559680 / +0.6% 204253361 / 202236201 / +1.0% 0.78 / 0.78 / -0.4%
appian_q08/datafusion:vortex-file-compressed 525363072 / 522660642 / +0.5% 595858030 / 581593708 / +2.5% 0.88 / 0.90 / -1.9%
datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 53202814 / 52591773 / +1.2% 76569914 / 78724370 / -2.7% 0.69 / 0.67 / +4.0%
appian_q02/datafusion:vortex-compact 229431287 / 228043589 / +0.6% 274422756 / 267123379 / +2.7% 0.84 / 0.85 / -2.1%
appian_q03/datafusion:vortex-compact 132768461 / 146197797 / -9.2% 172646086 / 195710812 / -11.8% 🟢 0.77 / 0.75 / +2.9%
appian_q04/datafusion:vortex-compact 9647143504 / 9642015343 / +0.1% 9740100016 / 9713628959 / +0.3% 0.99 / 0.99 / -0.2%
appian_q05/datafusion:vortex-compact 139111757 / 132425733 / +5.0% 172402503 / 167684627 / +2.8% 0.81 / 0.79 / +2.2%
appian_q06/datafusion:vortex-compact 149812710 / 142474143 / +5.2% 179583516 / 163896987 / +9.6% 0.83 / 0.87 / -4.0%
appian_q07/datafusion:vortex-compact 160542452 / 158939682 / +1.0% 207210683 / 196998736 / +5.2% 0.77 / 0.81 / -4.0%
appian_q08/datafusion:vortex-compact 534772929 / 535695638 / -0.2% 603965218 / 599807942 / +0.7% 0.89 / 0.89 / -0.9%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72062516 / 71604461 / +0.6% 93851353 / 91547470 / +2.5% 0.77 / 0.78 / -1.8%
appian_q02/datafusion:parquet 292658950 / 290135308 / +0.9% 326685691 / 333916185 / -2.2% 0.90 / 0.87 / +3.1%
appian_q03/datafusion:parquet 184721984 / 184210766 / +0.3% 228979996 / 224642808 / +1.9% 0.81 / 0.82 / -1.6%
appian_q04/datafusion:parquet 9686426132 / 9671026791 / +0.2% 9786766901 / 9689012426 / +1.0% 0.99 / 1.00 / -0.8%
appian_q05/datafusion:parquet 190177662 / 190381109 / -0.1% 220479625 / 224765040 / -1.9% 0.86 / 0.85 / +1.8%
appian_q06/datafusion:parquet 164242105 / 167152851 / -1.7% 187703818 / 196684109 / -4.6% 0.88 / 0.85 / +3.0%
appian_q07/datafusion:parquet 203919457 / 203733859 / +0.1% 241182470 / 239833038 / +0.6% 0.85 / 0.85 / -0.5%
appian_q08/datafusion:parquet 630129967 / 629784211 / +0.1% 696174116 / 693500773 / +0.4% 0.91 / 0.91 / -0.3%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 83525774 / 82905149 / +0.7% 97910060 / 98609748 / -0.7% 0.85 / 0.84 / +1.5%
appian_q02/duckdb:vortex-file-compressed 234966474 / 232776863 / +0.9% 252385312 / 264174556 / -4.5% 0.93 / 0.88 / +5.7%
appian_q03/duckdb:vortex-file-compressed 114049235 / 113731418 / +0.3% 130070064 / 130595707 / -0.4% 0.88 / 0.87 / +0.7%
appian_q04/duckdb:vortex-file-compressed 606809096 / 594602875 / +2.1% 639383070 / 628496423 / +1.7% 0.95 / 0.95 / +0.3%
appian_q05/duckdb:vortex-file-compressed 117460722 / 116574553 / +0.8% 129371226 / 131845138 / -1.9% 0.91 / 0.88 / +2.7%
appian_q06/duckdb:vortex-file-compressed 195985539 / 198286095 / -1.2% 204473339 / 216746522 / -5.7% 0.96 / 0.91 / +4.8%
appian_q07/duckdb:vortex-file-compressed 117771778 / 116879761 / +0.8% 130560213 / 133382919 / -2.1% 0.90 / 0.88 / +2.9%
appian_q08/duckdb:vortex-file-compressed 339896391 / 338682223 / +0.4% 354303742 / 346125442 / +2.4% 0.96 / 0.98 / -2.0%
duckdb / vortex-compact / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 84609105 / 85511076 / -1.1% 99448237 / 98285774 / +1.2% 0.85 / 0.87 / -2.2%
appian_q02/duckdb:vortex-compact 236166041 / 241525746 / -2.2% 254198920 / 259893400 / -2.2% 0.93 / 0.93 / -0.0%
appian_q03/duckdb:vortex-compact 119012710 / 118041131 / +0.8% 129403645 / 133205259 / -2.9% 0.92 / 0.89 / +3.8%
appian_q04/duckdb:vortex-compact 617221325 / 626703191 / -1.5% 638427879 / 629004988 / +1.5% 0.97 / 1.00 / -3.0%
appian_q05/duckdb:vortex-compact 118350582 / 118543273 / -0.2% 131298925 / 129073338 / +1.7% 0.90 / 0.92 / -1.9%
appian_q06/duckdb:vortex-compact 197051413 / 201476533 / -2.2% 210101832 / 202539451 / +3.7% 0.94 / 0.99 / -5.7%
appian_q07/duckdb:vortex-compact 119628490 / 120366920 / -0.6% 131450309 / 136032864 / -3.4% 0.91 / 0.88 / +2.9%
appian_q08/duckdb:vortex-compact 339965347 / 344424812 / -1.3% 350137812 / 355192304 / -1.4% 0.97 / 0.97 / +0.1%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 95916642 / 92658647 / +3.5% 104975861 / 103775048 / +1.2% 0.91 / 0.89 / +2.3%
appian_q02/duckdb:parquet 239379642 / 243356559 / -1.6% 254714876 / 251372569 / +1.3% 0.94 / 0.97 / -2.9%
appian_q03/duckdb:parquet 130182234 / 132774392 / -2.0% 136728539 / 137530816 / -0.6% 0.95 / 0.97 / -1.4%
appian_q04/duckdb:parquet 488739273 / 489995130 / -0.3% 484199870 / 488558508 / -0.9% 1.01 / 1.00 / +0.6%
appian_q05/duckdb:parquet 132711837 / 131549911 / +0.9% 138590311 / 137949319 / +0.5% 0.96 / 0.95 / +0.4%
appian_q06/duckdb:parquet 114536774 / 114571291 / -0.0% 119980054 / 118638266 / +1.1% 0.95 / 0.97 / -1.1%
appian_q07/duckdb:parquet 106711271 / 107213606 / -0.5% 120886242 / 113501599 / +6.5% 0.88 / 0.94 / -6.5%
appian_q08/duckdb:parquet 349493072 / 359076008 / -2.7% 344320395 / 349220628 / -1.4% 1.02 / 1.03 / -1.3%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 78626302 / 78883732 / -0.3% 91230352 / 90641779 / +0.6% 0.86 / 0.87 / -1.0%
appian_q02/duckdb:duckdb 213260344 / 212850315 / +0.2% 226741221 / 213534718 / +6.2% 0.94 / 1.00 / -5.6%
appian_q03/duckdb:duckdb 83928459 / 83929014 / -0.0% 92565099 / 92122131 / +0.5% 0.91 / 0.91 / -0.5%
appian_q04/duckdb:duckdb 542094832 / 542852191 / -0.1% 578139057 / 563895795 / +2.5% 0.94 / 0.96 / -2.6%
appian_q05/duckdb:duckdb 106460578 / 106538690 / -0.1% 118668947 / 119708589 / -0.9% 0.90 / 0.89 / +0.8%
appian_q06/duckdb:duckdb 184661291 / 188943437 / -2.3% 190630497 / 192767095 / -1.1% 0.97 / 0.98 / -1.2%
appian_q07/duckdb:duckdb 87879430 / 87476747 / +0.5% 101500600 / 100474830 / +1.0% 0.87 / 0.87 / -0.6%
appian_q08/duckdb:duckdb 314030112 / 312896802 / +0.4% 330653446 / 326484050 / +1.3% 0.95 / 0.96 / -0.9%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (-0.7%, environment too noisy confidence)
Vortex (geomean): hot 1.011x ➖ · cold 1.046x ➖
Parquet (geomean): hot 1.012x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +1.2% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.022x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 220078988 / 219799164 / +0.1% 771395974 / 751507630 / +2.6% 0.29 / 0.29 / -2.5%
tpch_q02/datafusion:vortex-file-compressed 335268024 / 347284031 / -3.5% 711716142 / 617713842 / +15.2% 0.47 / 0.56 / -16.2%
tpch_q03/datafusion:vortex-file-compressed 321401825 / 366192670 / -12.2% 870146139 / 1020795838 / -14.8% 0.37 / 0.36 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 184949287 / 201624244 / -8.3% 378072004 / 380787599 / -0.7% 0.49 / 0.53 / -7.6%
tpch_q05/datafusion:vortex-file-compressed 365641230 / 402348090 / -9.1% 595728212 / 709186641 / -16.0% 0.61 / 0.57 / +8.2%
tpch_q06/datafusion:vortex-file-compressed 152162431 / 202547927 / -24.9% 366845671 / 300688579 / +22.0% 0.41 / 0.67 / -38.4%
tpch_q07/datafusion:vortex-file-compressed 428319726 / 407277373 / +5.2% 674462872 / 564421536 / +19.5% 0.64 / 0.72 / -12.0%
tpch_q08/datafusion:vortex-file-compressed 426786637 / 511994837 / -16.6% 584654967 / 991100304 / -41.0% 🟢 0.73 / 0.52 / +41.3%
tpch_q09/datafusion:vortex-file-compressed 321960221 / 299597669 / +7.5% 535397044 / 450547553 / +18.8% 0.60 / 0.66 / -9.6%
tpch_q10/datafusion:vortex-file-compressed 400994810 / 388984940 / +3.1% 516473309 / 482170809 / +7.1% 0.78 / 0.81 / -3.8%
tpch_q11/datafusion:vortex-file-compressed 304188265 / 285335942 / +6.6% 486357650 / 425163410 / +14.4% 0.63 / 0.67 / -6.8%
tpch_q12/datafusion:vortex-file-compressed 260960838 / 388283213 / -32.8% 🟢 412395372 / 489782211 / -15.8% 0.63 / 0.79 / -20.2%
tpch_q13/datafusion:vortex-file-compressed 137432537 / 305468048 / -55.0% 🟢 367915537 / 466037071 / -21.1% 0.37 / 0.66 / -43.0%
tpch_q14/datafusion:vortex-file-compressed 219374440 / 199620127 / +9.9% 351441310 / 303128127 / +15.9% 0.62 / 0.66 / -5.2%
tpch_q15/datafusion:vortex-file-compressed 438943793 / 328723372 / +33.5% 🔴 648992727 / 535953171 / +21.1% 0.68 / 0.61 / +10.3%
tpch_q16/datafusion:vortex-file-compressed 155095812 / 129183088 / +20.1% 347567857 / 304290279 / +14.2% 0.45 / 0.42 / +5.1%
tpch_q17/datafusion:vortex-file-compressed 267535459 / 270099130 / -0.9% 495477057 / 483187156 / +2.5% 0.54 / 0.56 / -3.4%
tpch_q18/datafusion:vortex-file-compressed 733947972 / 297524319 / +146.7% 🔴 826494579 / 463921753 / +78.2% 🔴 0.89 / 0.64 / +38.5%
tpch_q19/datafusion:vortex-file-compressed 318795208 / 242447769 / +31.5% 🔴 410422272 / 409249888 / +0.3% 0.78 / 0.59 / +31.1%
tpch_q20/datafusion:vortex-file-compressed 316536196 / 301198504 / +5.1% 787771056 / 474579897 / +66.0% 🔴 0.40 / 0.63 / -36.7%
tpch_q21/datafusion:vortex-file-compressed 626438434 / 526343938 / +19.0% 982022180 / 981707422 / +0.0% 0.64 / 0.54 / +19.0%
tpch_q22/datafusion:vortex-file-compressed 229792402 / 166649025 / +37.9% 🔴 402131739 / 466202686 / -13.7% 0.57 / 0.36 / +59.9%
datafusion / vortex-compact / ns (0.941x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 225251621 / 247301781 / -8.9% 728222551 / 772605412 / -5.7% 0.31 / 0.32 / -3.4%
tpch_q02/datafusion:vortex-compact 340322831 / 340844943 / -0.2% 707336749 / 679780647 / +4.1% 0.48 / 0.50 / -4.0%
tpch_q03/datafusion:vortex-compact 319190800 / 322637048 / -1.1% 769968358 / 819067712 / -6.0% 0.41 / 0.39 / +5.2%
tpch_q04/datafusion:vortex-compact 199413297 / 236688469 / -15.7% 475901693 / 349171759 / +36.3% 🔴 0.42 / 0.68 / -38.2%
tpch_q05/datafusion:vortex-compact 367588719 / 495604411 / -25.8% 530082212 / 540579213 / -1.9% 0.69 / 0.92 / -24.4%
tpch_q06/datafusion:vortex-compact 148572392 / 146686084 / +1.3% 311805446 / 275644286 / +13.1% 0.48 / 0.53 / -10.5%
tpch_q07/datafusion:vortex-compact 466158558 / 383653716 / +21.5% 607416196 / 541710539 / +12.1% 0.77 / 0.71 / +8.4%
tpch_q08/datafusion:vortex-compact 429501855 / 426248062 / +0.8% 638168538 / 644380058 / -1.0% 0.67 / 0.66 / +1.7%
tpch_q09/datafusion:vortex-compact 368151469 / 439674754 / -16.3% 598309478 / 608356927 / -1.7% 0.62 / 0.72 / -14.9%
tpch_q10/datafusion:vortex-compact 365184826 / 559206108 / -34.7% 🟢 790461305 / 657183947 / +20.3% 0.46 / 0.85 / -45.7%
tpch_q11/datafusion:vortex-compact 330229957 / 272100103 / +21.4% 399947717 / 452162508 / -11.5% 0.83 / 0.60 / +37.2%
tpch_q12/datafusion:vortex-compact 199030256 / 171052625 / +16.4% 370149462 / 304614829 / +21.5% 0.54 / 0.56 / -4.2%
tpch_q13/datafusion:vortex-compact 130595464 / 144524852 / -9.6% 309971787 / 289739757 / +7.0% 0.42 / 0.50 / -15.5%
tpch_q14/datafusion:vortex-compact 198020985 / 171594612 / +15.4% 369239150 / 332095398 / +11.2% 0.54 / 0.52 / +3.8%
tpch_q15/datafusion:vortex-compact 343537997 / 304920468 / +12.7% 598631480 / 513656459 / +16.5% 0.57 / 0.59 / -3.3%
tpch_q16/datafusion:vortex-compact 128848547 / 142782569 / -9.8% 242685815 / 275834993 / -12.0% 0.53 / 0.52 / +2.6%
tpch_q17/datafusion:vortex-compact 309620843 / 294413649 / +5.2% 532503935 / 445592418 / +19.5% 0.58 / 0.66 / -12.0%
tpch_q18/datafusion:vortex-compact 286274416 / 244167168 / +17.2% 434757128 / 476514392 / -8.8% 0.66 / 0.51 / +28.5%
tpch_q19/datafusion:vortex-compact 272341428 / 369998731 / -26.4% 434545109 / 505267086 / -14.0% 0.63 / 0.73 / -14.4%
tpch_q20/datafusion:vortex-compact 292224719 / 284768646 / +2.6% 454725114 / 570006295 / -20.2% 0.64 / 0.50 / +28.6%
tpch_q21/datafusion:vortex-compact 467785468 / 600312020 / -22.1% 700525563 / 617185599 / +13.5% 0.67 / 0.97 / -31.3%
tpch_q22/datafusion:vortex-compact 173027117 / 270646275 / -36.1% 🟢 370076208 / 479897343 / -22.9% 0.47 / 0.56 / -17.1%
datafusion / parquet / ns (0.976x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 155693234 / 158814686 / -2.0% 574461760 / 439671059 / +30.7% 🔴 0.27 / 0.36 / -25.0%
tpch_q02/datafusion:parquet 277148194 / 304740371 / -9.1% 552234896 / 427448736 / +29.2% 0.50 / 0.71 / -29.6%
tpch_q03/datafusion:parquet 313130908 / 241158894 / +29.8% 690144802 / 651167920 / +6.0% 0.45 / 0.37 / +22.5%
tpch_q04/datafusion:parquet 167431870 / 135909526 / +23.2% 322377459 / 458430899 / -29.7% 0.52 / 0.30 / +75.2%
tpch_q05/datafusion:parquet 363282118 / 350374514 / +3.7% 824178218 / 613397025 / +34.4% 🔴 0.44 / 0.57 / -22.8%
tpch_q06/datafusion:parquet 105105248 / 211512831 / -50.3% 🟢 300737302 / 445292211 / -32.5% 🟢 0.35 / 0.47 / -26.4%
tpch_q07/datafusion:parquet 372653020 / 416757686 / -10.6% 492251611 / 676840388 / -27.3% 0.76 / 0.62 / +22.9%
tpch_q08/datafusion:parquet 386087519 / 406774128 / -5.1% 496080315 / 585006324 / -15.2% 0.78 / 0.70 / +11.9%
tpch_q09/datafusion:parquet 431249784 / 414100212 / +4.1% 563986562 / 559104706 / +0.9% 0.76 / 0.74 / +3.2%
tpch_q10/datafusion:parquet 300326289 / 324485758 / -7.4% 413583345 / 403377910 / +2.5% 0.73 / 0.80 / -9.7%
tpch_q11/datafusion:parquet 356139449 / 273361135 / +30.3% 🔴 433922545 / 525888838 / -17.5% 0.82 / 0.52 / +57.9%
tpch_q12/datafusion:parquet 155413960 / 177127517 / -12.3% 293621530 / 519191985 / -43.4% 🟢 0.53 / 0.34 / +55.1%
tpch_q13/datafusion:parquet 272250974 / 271908071 / +0.1% 466914388 / 438092356 / +6.6% 0.58 / 0.62 / -6.1%
tpch_q14/datafusion:parquet 155838817 / 164113406 / -5.0% 301599735 / 298504654 / +1.0% 0.52 / 0.55 / -6.0%
tpch_q15/datafusion:parquet 462716961 / 305166477 / +51.6% 🔴 473556026 / 516744619 / -8.4% 0.98 / 0.59 / +65.5%
tpch_q16/datafusion:parquet 104998863 / 102274521 / +2.7% 187433704 / 227673313 / -17.7% 0.56 / 0.45 / +24.7%
tpch_q17/datafusion:parquet 269662749 / 291877094 / -7.6% 434401047 / 440424737 / -1.4% 0.62 / 0.66 / -6.3%
tpch_q18/datafusion:parquet 311281060 / 378460913 / -17.8% 432185766 / 497138670 / -13.1% 0.72 / 0.76 / -5.4%
tpch_q19/datafusion:parquet 151830759 / 171545813 / -11.5% 295817323 / 288061657 / +2.7% 0.51 / 0.60 / -13.8%
tpch_q20/datafusion:parquet 232663018 / 257752789 / -9.7% 329660723 / 373273142 / -11.7% 0.71 / 0.69 / +2.2%
tpch_q21/datafusion:parquet 309220638 / 336871304 / -8.2% 488454694 / 493831701 / -1.1% 0.63 / 0.68 / -7.2%
tpch_q22/datafusion:parquet 156960340 / 153174332 / +2.5% 306063842 / 306142770 / -0.0% 0.51 / 0.50 / +2.5%
duckdb / vortex-file-compressed / ns (1.045x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 269035427 / 245983071 / +9.4% 353200395 / 427614311 / -17.4% 0.76 / 0.58 / +32.4%
tpch_q02/duckdb:vortex-file-compressed 425475455 / 441190493 / -3.6% 477713230 / 464391559 / +2.9% 0.89 / 0.95 / -6.3%
tpch_q03/duckdb:vortex-file-compressed 439315347 / 436567808 / +0.6% 537209374 / 450361661 / +19.3% 0.82 / 0.97 / -15.6%
tpch_q04/duckdb:vortex-file-compressed 422112740 / 279144630 / +51.2% 🔴 442876307 / 318042948 / +39.3% 🔴 0.95 / 0.88 / +8.6%
tpch_q05/duckdb:vortex-file-compressed 574216037 / 925581272 / -38.0% 🟢 597190610 / 1099019099 / -45.7% 🟢 0.96 / 0.84 / +14.2%
tpch_q06/duckdb:vortex-file-compressed 413744650 / 408034074 / +1.4% 503534919 / 305989907 / +64.6% 🔴 0.82 / 1.33 / -38.4%
tpch_q07/duckdb:vortex-file-compressed 439108914 / 468744622 / -6.3% 562874695 / 522853572 / +7.7% 0.78 / 0.90 / -13.0%
tpch_q08/duckdb:vortex-file-compressed 650604857 / 662789944 / -1.8% 681866865 / 794862129 / -14.2% 0.95 / 0.83 / +14.4%
tpch_q09/duckdb:vortex-file-compressed 412787283 / 403489631 / +2.3% 447311367 / 503284161 / -11.1% 0.92 / 0.80 / +15.1%
tpch_q10/duckdb:vortex-file-compressed 560200331 / 523819622 / +6.9% 663666827 / 595318356 / +11.5% 0.84 / 0.88 / -4.1%
tpch_q11/duckdb:vortex-file-compressed 314926105 / 311504523 / +1.1% 373438855 / 293601696 / +27.2% 0.84 / 1.06 / -20.5%
tpch_q12/duckdb:vortex-file-compressed 319506476 / 336623916 / -5.1% 349228509 / 331540454 / +5.3% 0.91 / 1.02 / -9.9%
tpch_q13/duckdb:vortex-file-compressed 242485516 / 223155036 / +8.7% 223146382 / 311966454 / -28.5% 1.09 / 0.72 / +51.9%
tpch_q14/duckdb:vortex-file-compressed 296431005 / 256880296 / +15.4% 334007384 / 357583935 / -6.6% 0.89 / 0.72 / +23.5%
tpch_q15/duckdb:vortex-file-compressed 250250977 / 248942273 / +0.5% 365491497 / 322394288 / +13.4% 0.68 / 0.77 / -11.3%
tpch_q16/duckdb:vortex-file-compressed 207003114 / 200678858 / +3.2% 261267092 / 224899862 / +16.2% 0.79 / 0.89 / -11.2%
tpch_q17/duckdb:vortex-file-compressed 355352435 / 291672221 / +21.8% 535844568 / 309915158 / +72.9% 🔴 0.66 / 0.94 / -29.5%
tpch_q18/duckdb:vortex-file-compressed 622742461 / 495791219 / +25.6% 709248752 / 610222216 / +16.2% 0.88 / 0.81 / +8.1%
tpch_q19/duckdb:vortex-file-compressed 415230384 / 418534686 / -0.8% 400763885 / 404257455 / -0.9% 1.04 / 1.04 / +0.1%
tpch_q20/duckdb:vortex-file-compressed 461958279 / 372428208 / +24.0% 637319520 / 441593262 / +44.3% 🔴 0.72 / 0.84 / -14.1%
tpch_q21/duckdb:vortex-file-compressed 641030069 / 554387905 / +15.6% 856752913 / 608165776 / +40.9% 🔴 0.75 / 0.91 / -17.9%
tpch_q22/duckdb:vortex-file-compressed 237250720 / 248467953 / -4.5% 213741628 / 277086143 / -22.9% 1.11 / 0.90 / +23.8%
duckdb / vortex-compact / ns (1.038x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 259660930 / 261473380 / -0.7% 420396481 / 287141458 / +46.4% 🔴 0.62 / 0.91 / -32.2%
tpch_q02/duckdb:vortex-compact 463113560 / 416589336 / +11.2% 528142511 / 499321045 / +5.8% 0.88 / 0.83 / +5.1%
tpch_q03/duckdb:vortex-compact 403134276 / 810348916 / -50.3% 🟢 576710823 / 549714054 / +4.9% 0.70 / 1.47 / -52.6%
tpch_q04/duckdb:vortex-compact 239910522 / 252288698 / -4.9% 355751157 / 277716000 / +28.1% 0.67 / 0.91 / -25.8%
tpch_q05/duckdb:vortex-compact 577199441 / 517520528 / +11.5% 576651636 / 793198656 / -27.3% 1.00 / 0.65 / +53.4%
tpch_q06/duckdb:vortex-compact 206999504 / 163280661 / +26.8% 352546680 / 238461655 / +47.8% 🔴 0.59 / 0.68 / -14.2%
tpch_q07/duckdb:vortex-compact 427254855 / 404461809 / +5.6% 749074422 / 499176044 / +50.1% 🔴 0.57 / 0.81 / -29.6%
tpch_q08/duckdb:vortex-compact 611157899 / 577998051 / +5.7% 708292075 / 563043257 / +25.8% 0.86 / 1.03 / -15.9%
tpch_q09/duckdb:vortex-compact 422202049 / 648426621 / -34.9% 🟢 475110403 / 526727957 / -9.8% 0.89 / 1.23 / -27.8%
tpch_q10/duckdb:vortex-compact 522078148 / 486284911 / +7.4% 471952928 / 517523246 / -8.8% 1.11 / 0.94 / +17.7%
tpch_q11/duckdb:vortex-compact 325427807 / 305096869 / +6.7% 324125321 / 267565292 / +21.1% 1.00 / 1.14 / -11.9%
tpch_q12/duckdb:vortex-compact 236420634 / 195384008 / +21.0% 263540599 / 224982591 / +17.1% 0.90 / 0.87 / +3.3%
tpch_q13/duckdb:vortex-compact 218939931 / 209121710 / +4.7% 298424537 / 417236828 / -28.5% 0.73 / 0.50 / +46.4%
tpch_q14/duckdb:vortex-compact 262129939 / 224662412 / +16.7% 276503414 / 331044785 / -16.5% 0.95 / 0.68 / +39.7%
tpch_q15/duckdb:vortex-compact 263020098 / 269799396 / -2.5% 284871782 / 331926236 / -14.2% 0.92 / 0.81 / +13.6%
tpch_q16/duckdb:vortex-compact 219845220 / 209845061 / +4.8% 253916395 / 267876443 / -5.2% 0.87 / 0.78 / +10.5%
tpch_q17/duckdb:vortex-compact 367058086 / 296089988 / +24.0% 433942477 / 360103540 / +20.5% 0.85 / 0.82 / +2.9%
tpch_q18/duckdb:vortex-compact 341091308 / 286648673 / +19.0% 352322446 / 298380429 / +18.1% 0.97 / 0.96 / +0.8%
tpch_q19/duckdb:vortex-compact 317193957 / 300259284 / +5.6% 361322174 / 394318679 / -8.4% 0.88 / 0.76 / +15.3%
tpch_q20/duckdb:vortex-compact 360755288 / 383425365 / -5.9% 449617278 / 430450802 / +4.5% 0.80 / 0.89 / -9.9%
tpch_q21/duckdb:vortex-compact 656727511 / 489499740 / +34.2% 🔴 666379201 / 665885801 / +0.1% 0.99 / 0.74 / +34.1%
tpch_q22/duckdb:vortex-compact 314797410 / 255113491 / +23.4% 338148774 / 399193793 / -15.3% 0.93 / 0.64 / +45.7%
duckdb / parquet / ns (1.049x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 174774291 / 164976939 / +5.9% 199116851 / 204860353 / -2.8% 0.88 / 0.81 / +9.0%
tpch_q02/duckdb:parquet 459781255 / 501465451 / -8.3% 468979524 / 513407135 / -8.7% 0.98 / 0.98 / +0.4%
tpch_q03/duckdb:parquet 367377819 / 366319149 / +0.3% 451593480 / 397944916 / +13.5% 0.81 / 0.92 / -11.6%
tpch_q04/duckdb:parquet 260965609 / 250909363 / +4.0% 330741623 / 334878095 / -1.2% 0.79 / 0.75 / +5.3%
tpch_q05/duckdb:parquet 489170944 / 594650969 / -17.7% 558866304 / 658790632 / -15.2% 0.88 / 0.90 / -3.0%
tpch_q06/duckdb:parquet 137786577 / 165234072 / -16.6% 155895308 / 207189043 / -24.8% 0.88 / 0.80 / +10.8%
tpch_q07/duckdb:parquet 494105673 / 466453572 / +5.9% 1539193359 / 536373236 / +187.0% 🔴 0.32 / 0.87 / -63.1%
tpch_q08/duckdb:parquet 621818246 / 649556107 / -4.3% 738573306 / 581031584 / +27.1% 0.84 / 1.12 / -24.7%
tpch_q09/duckdb:parquet 593260197 / 575347521 / +3.1% 586695125 / 635054812 / -7.6% 1.01 / 0.91 / +11.6%
tpch_q10/duckdb:parquet 528363231 / 566640281 / -6.8% 540830725 / 663826915 / -18.5% 0.98 / 0.85 / +14.5%
tpch_q11/duckdb:parquet 301008655 / 292813485 / +2.8% 305190094 / 317785760 / -4.0% 0.99 / 0.92 / +7.0%
tpch_q12/duckdb:parquet 310518735 / 220614324 / +40.8% 🔴 348113744 / 278261820 / +25.1% 0.89 / 0.79 / +12.5%
tpch_q13/duckdb:parquet 433460794 / 355392393 / +22.0% 523963393 / 468245741 / +11.9% 0.83 / 0.76 / +9.0%
tpch_q14/duckdb:parquet 262211175 / 234552068 / +11.8% 307828650 / 290821312 / +5.8% 0.85 / 0.81 / +5.6%
tpch_q15/duckdb:parquet 310794808 / 200688698 / +54.9% 🔴 283975510 / 232126005 / +22.3% 1.09 / 0.86 / +26.6%
tpch_q16/duckdb:parquet 292604880 / 286791531 / +2.0% 278786567 / 272001842 / +2.5% 1.05 / 1.05 / -0.5%
tpch_q17/duckdb:parquet 317999141 / 308231658 / +3.2% 362093090 / 304930366 / +18.7% 0.88 / 1.01 / -13.1%
tpch_q18/duckdb:parquet 352471016 / 352176737 / +0.1% 386081543 / 363833879 / +6.1% 0.91 / 0.97 / -5.7%
tpch_q19/duckdb:parquet 309762482 / 256008148 / +21.0% 402839110 / 264782579 / +52.1% 🔴 0.77 / 0.97 / -20.5%
tpch_q20/duckdb:parquet 541639450 / 559387115 / -3.2% 592915874 / 699324207 / -15.2% 0.91 / 0.80 / +14.2%
tpch_q21/duckdb:parquet 503828790 / 494971314 / +1.8% 640224568 / 476584480 / +34.3% 🔴 0.79 / 1.04 / -24.2%
tpch_q22/duckdb:parquet 326238784 / 297480044 / +9.7% 339868166 / 333595309 / +1.9% 0.96 / 0.89 / +7.6%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-4.0%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 1.029x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.017x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.968x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1240911 / 1262128 / -1.7% 24185817 / 22011302 / +9.9% 0.05 / 0.06 / -10.5%
clickbench_q01/datafusion:vortex-file-compressed 5916364 / 5957167 / -0.7% 31367241 / 29919636 / +4.8% 0.19 / 0.20 / -5.3%
clickbench_q02/datafusion:vortex-file-compressed 11263578 / 11099297 / +1.5% 48405502 / 45185082 / +7.1% 0.23 / 0.25 / -5.3%
clickbench_q03/datafusion:vortex-file-compressed 13880962 / 12871460 / +7.8% 55392646 / 55454076 / -0.1% 0.25 / 0.23 / +8.0%
clickbench_q04/datafusion:vortex-file-compressed 57719768 / 58913794 / -2.0% 104590114 / 102877125 / +1.7% 0.55 / 0.57 / -3.6%
clickbench_q05/datafusion:vortex-file-compressed 78853114 / 75998638 / +3.8% 128860918 / 129109176 / -0.2% 0.61 / 0.59 / +4.0%
clickbench_q06/datafusion:vortex-file-compressed 1282794 / 1250440 / +2.6% 24651376 / 22146043 / +11.3% 🔴 0.05 / 0.06 / -7.8%
clickbench_q07/datafusion:vortex-file-compressed 9251259 / 9650378 / -4.1% 35335125 / 33552101 / +5.3% 0.26 / 0.29 / -9.0%
clickbench_q08/datafusion:vortex-file-compressed 79727438 / 79275900 / +0.6% 124312266 / 123580243 / +0.6% 0.64 / 0.64 / -0.0%
clickbench_q09/datafusion:vortex-file-compressed 171341578 / 172830794 / -0.9% 222178869 / 208265024 / +6.7% 0.77 / 0.83 / -7.1%
clickbench_q10/datafusion:vortex-file-compressed 23975974 / 24348996 / -1.5% 68662440 / 71000579 / -3.3% 0.35 / 0.34 / +1.8%
clickbench_q11/datafusion:vortex-file-compressed 25321778 / 25833256 / -2.0% 72115522 / 69957845 / +3.1% 0.35 / 0.37 / -4.9%
clickbench_q12/datafusion:vortex-file-compressed 73549492 / 72226072 / +1.8% 125401154 / 123671545 / +1.4% 0.59 / 0.58 / +0.4%
clickbench_q13/datafusion:vortex-file-compressed 115976886 / 117219335 / -1.1% 193169468 / 186156613 / +3.8% 0.60 / 0.63 / -4.7%
clickbench_q14/datafusion:vortex-file-compressed 75294105 / 76403443 / -1.5% 132111571 / 126335131 / +4.6% 0.57 / 0.60 / -5.8%
clickbench_q15/datafusion:vortex-file-compressed 64240583 / 64371500 / -0.2% 104189206 / 101072491 / +3.1% 0.62 / 0.64 / -3.2%
clickbench_q16/datafusion:vortex-file-compressed 151961914 / 155067201 / -2.0% 220448187 / 209571282 / +5.2% 0.69 / 0.74 / -6.8%
clickbench_q17/datafusion:vortex-file-compressed 155763078 / 154885927 / +0.6% 228876547 / 217776168 / +5.1% 0.68 / 0.71 / -4.3%
clickbench_q18/datafusion:vortex-file-compressed 294522952 / 293252086 / +0.4% 389677268 / 391165899 / -0.4% 0.76 / 0.75 / +0.8%
clickbench_q19/datafusion:vortex-file-compressed 7849460 / 7850766 / -0.0% 49204927 / 43562688 / +13.0% 🔴 0.16 / 0.18 / -11.5%
clickbench_q20/datafusion:vortex-file-compressed 69737626 / 65976705 / +5.7% 253255705 / 248211268 / +2.0% 0.28 / 0.27 / +3.6%
clickbench_q21/datafusion:vortex-file-compressed 80527470 / 78777847 / +2.2% 294077702 / 280989621 / +4.7% 0.27 / 0.28 / -2.3%
clickbench_q22/datafusion:vortex-file-compressed 93238001 / 93124602 / +0.1% 394108756 / 389972808 / +1.1% 0.24 / 0.24 / -0.9%
clickbench_q23/datafusion:vortex-file-compressed 94541107 / 200399244 / -52.8% 🟢 394656896 / 548943969 / -28.1% 🟢 0.24 / 0.37 / -34.4%
clickbench_q24/datafusion:vortex-file-compressed 8915078 / 15843412 / -43.7% 🟢 57009164 / 61446068 / -7.2% 0.16 / 0.26 / -39.4%
clickbench_q25/datafusion:vortex-file-compressed 18470385 / 20443624 / -9.7% 66785497 / 65367922 / +2.2% 0.28 / 0.31 / -11.6%
clickbench_q26/datafusion:vortex-file-compressed 15199056 / 16868528 / -9.9% 67757401 / 68256928 / -0.7% 0.22 / 0.25 / -9.2%
clickbench_q27/datafusion:vortex-file-compressed 101793170 / 102555777 / -0.7% 258012119 / 257563301 / +0.2% 0.39 / 0.40 / -0.9%
clickbench_q28/datafusion:vortex-file-compressed 564087231 / 560854615 / +0.6% 637277305 / 648033538 / -1.7% 0.89 / 0.87 / +2.3%
clickbench_q29/datafusion:vortex-file-compressed 24456526 / 24452324 / +0.0% 59077589 / 51684568 / +14.3% 🔴 0.41 / 0.47 / -12.5%
clickbench_q30/datafusion:vortex-file-compressed 58283952 / 57931297 / +0.6% 119210595 / 112719831 / +5.8% 0.49 / 0.51 / -4.9%
clickbench_q31/datafusion:vortex-file-compressed 66743734 / 66277289 / +0.7% 164404132 / 153441012 / +7.1% 0.41 / 0.43 / -6.0%
clickbench_q32/datafusion:vortex-file-compressed 288669478 / 290085674 / -0.5% 395994453 / 385618469 / +2.7% 0.73 / 0.75 / -3.1%
clickbench_q33/datafusion:vortex-file-compressed 325625350 / 323394350 / +0.7% 445133603 / 430984647 / +3.3% 0.73 / 0.75 / -2.5%
clickbench_q34/datafusion:vortex-file-compressed 324578004 / 322701009 / +0.6% 444232915 / 438923900 / +1.2% 0.73 / 0.74 / -0.6%
clickbench_q35/datafusion:vortex-file-compressed 56406851 / 56285232 / +0.2% 95811462 / 90587601 / +5.8% 0.59 / 0.62 / -5.2%
clickbench_q36/datafusion:vortex-file-compressed 37963402 / 37639768 / +0.9% 68427872 / 66525358 / +2.9% 0.55 / 0.57 / -1.9%
clickbench_q37/datafusion:vortex-file-compressed 21453056 / 21180364 / +1.3% 49059229 / 46335210 / +5.9% 0.44 / 0.46 / -4.3%
clickbench_q38/datafusion:vortex-file-compressed 13269577 / 13258659 / +0.1% 42852612 / 39477830 / +8.5% 0.31 / 0.34 / -7.8%
clickbench_q39/datafusion:vortex-file-compressed 79414394 / 79153274 / +0.3% 112437652 / 110357789 / +1.9% 0.71 / 0.72 / -1.5%
clickbench_q40/datafusion:vortex-file-compressed 10671096 / 10613159 / +0.5% 37603159 / 35999757 / +4.5% 0.28 / 0.29 / -3.7%
clickbench_q41/datafusion:vortex-file-compressed 10386488 / 10436510 / -0.5% 36597786 / 33721986 / +8.5% 0.28 / 0.31 / -8.3%
clickbench_q42/datafusion:vortex-file-compressed 10554241 / 10513507 / +0.4% 36669749 / 35272211 / +4.0% 0.29 / 0.30 / -3.4%
datafusion / vortex-compact / ns (0.955x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1274088 / 1234940 / +3.2% 23041303 / 21286757 / +8.2% 0.06 / 0.06 / -4.7%
clickbench_q01/datafusion:vortex-compact 7330438 / 7547625 / -2.9% 34836241 / 30080231 / +15.8% 🔴 0.21 / 0.25 / -16.1%
clickbench_q02/datafusion:vortex-compact 13769302 / 13654242 / +0.8% 45920604 / 40988538 / +12.0% 🔴 0.30 / 0.33 / -10.0%
clickbench_q03/datafusion:vortex-compact 12573507 / 13315987 / -5.6% 49851647 / 45106170 / +10.5% 🔴 0.25 / 0.30 / -14.6%
clickbench_q04/datafusion:vortex-compact 59768000 / 59430016 / +0.6% 101798979 / 95280841 / +6.8% 0.59 / 0.62 / -5.9%
clickbench_q05/datafusion:vortex-compact 88540087 / 88380065 / +0.2% 136189210 / 133972403 / +1.7% 0.65 / 0.66 / -1.4%
clickbench_q06/datafusion:vortex-compact 1239153 / 1259712 / -1.6% 22467401 / 21443640 / +4.8% 0.06 / 0.06 / -6.1%
clickbench_q07/datafusion:vortex-compact 12291615 / 12204329 / +0.7% 36410587 / 36212643 / +0.5% 0.34 / 0.34 / +0.2%
clickbench_q08/datafusion:vortex-compact 82303124 / 81376418 / +1.1% 124026116 / 123935183 / +0.1% 0.66 / 0.66 / +1.1%
clickbench_q09/datafusion:vortex-compact 175021916 / 178580436 / -2.0% 215313527 / 219836554 / -2.1% 0.81 / 0.81 / +0.1%
clickbench_q10/datafusion:vortex-compact 27588968 / 26376342 / +4.6% 61276093 / 63376725 / -3.3% 0.45 / 0.42 / +8.2%
clickbench_q11/datafusion:vortex-compact 30420036 / 29085314 / +4.6% 66842335 / 63674384 / +5.0% 0.46 / 0.46 / -0.4%
clickbench_q12/datafusion:vortex-compact 90459535 / 90312385 / +0.2% 136153397 / 140565917 / -3.1% 0.66 / 0.64 / +3.4%
clickbench_q13/datafusion:vortex-compact 134116788 / 132791214 / +1.0% 192631275 / 198274583 / -2.8% 0.70 / 0.67 / +4.0%
clickbench_q14/datafusion:vortex-compact 92544186 / 95771762 / -3.4% 140613183 / 137886234 / +2.0% 0.66 / 0.69 / -5.2%
clickbench_q15/datafusion:vortex-compact 64585847 / 64376254 / +0.3% 103798448 / 100147515 / +3.6% 0.62 / 0.64 / -3.2%
clickbench_q16/datafusion:vortex-compact 160917059 / 165391542 / -2.7% 221884175 / 230565798 / -3.8% 0.73 / 0.72 / +1.1%
clickbench_q17/datafusion:vortex-compact 163950406 / 167967911 / -2.4% 227482727 / 227395963 / +0.0% 0.72 / 0.74 / -2.4%
clickbench_q18/datafusion:vortex-compact 299318732 / 297681895 / +0.5% 391270052 / 377764690 / +3.6% 0.76 / 0.79 / -2.9%
clickbench_q19/datafusion:vortex-compact 10264236 / 10053996 / +2.1% 41995635 / 37442131 / +12.2% 🔴 0.24 / 0.27 / -9.0%
clickbench_q20/datafusion:vortex-compact 85482648 / 84587457 / +1.1% 230900332 / 228014896 / +1.3% 0.37 / 0.37 / -0.2%
clickbench_q21/datafusion:vortex-compact 116342440 / 122673167 / -5.2% 260981170 / 254168561 / +2.7% 0.45 / 0.48 / -7.6%
clickbench_q22/datafusion:vortex-compact 220134507 / 218137677 / +0.9% 399803296 / 370361234 / +7.9% 0.55 / 0.59 / -6.5%
clickbench_q23/datafusion:vortex-compact 186323810 / 654292555 / -71.5% 🟢 341949177 / 816556405 / -58.1% 🟢 0.54 / 0.80 / -32.0%
clickbench_q24/datafusion:vortex-compact 19941932 / 33213995 / -40.0% 🟢 56941918 / 76950206 / -26.0% 🟢 0.35 / 0.43 / -18.9%
clickbench_q25/datafusion:vortex-compact 38581576 / 40183660 / -4.0% 79375637 / 78017477 / +1.7% 0.49 / 0.52 / -5.6%
clickbench_q26/datafusion:vortex-compact 32981572 / 32886912 / +0.3% 72074652 / 72717704 / -0.9% 0.46 / 0.45 / +1.2%
clickbench_q27/datafusion:vortex-compact 164930708 / 167523793 / -1.5% 258049291 / 257888934 / +0.1% 0.64 / 0.65 / -1.6%
clickbench_q28/datafusion:vortex-compact 600670868 / 612816978 / -2.0% 679855887 / 688644009 / -1.3% 0.88 / 0.89 / -0.7%
clickbench_q29/datafusion:vortex-compact 26054052 / 26672704 / -2.3% 57919358 / 51647865 / +12.1% 🔴 0.45 / 0.52 / -12.9%
clickbench_q30/datafusion:vortex-compact 70028872 / 73710466 / -5.0% 116639847 / 116026240 / +0.5% 0.60 / 0.64 / -5.5%
clickbench_q31/datafusion:vortex-compact 78388784 / 79207930 / -1.0% 151525496 / 149452541 / +1.4% 0.52 / 0.53 / -2.4%
clickbench_q32/datafusion:vortex-compact 287203626 / 291664682 / -1.5% 395465629 / 389414649 / +1.6% 0.73 / 0.75 / -3.0%
clickbench_q33/datafusion:vortex-compact 339300442 / 334202158 / +1.5% 436069515 / 439502154 / -0.8% 0.78 / 0.76 / +2.3%
clickbench_q34/datafusion:vortex-compact 338756774 / 337241899 / +0.4% 442685077 / 449734213 / -1.6% 0.77 / 0.75 / +2.0%
clickbench_q35/datafusion:vortex-compact 60878941 / 59055964 / +3.1% 93703810 / 93691411 / +0.0% 0.65 / 0.63 / +3.1%
clickbench_q36/datafusion:vortex-compact 43459748 / 43802240 / -0.8% 72570143 / 69791851 / +4.0% 0.60 / 0.63 / -4.6%
clickbench_q37/datafusion:vortex-compact 22895904 / 22660398 / +1.0% 48879723 / 47630099 / +2.6% 0.47 / 0.48 / -1.5%
clickbench_q38/datafusion:vortex-compact 18747078 / 19120426 / -2.0% 48050781 / 46829187 / +2.6% 0.39 / 0.41 / -4.4%
clickbench_q39/datafusion:vortex-compact 83393196 / 84353154 / -1.1% 116704449 / 113277968 / +3.0% 0.71 / 0.74 / -4.0%
clickbench_q40/datafusion:vortex-compact 12597326 / 12563054 / +0.3% 37919178 / 36066795 / +5.1% 0.33 / 0.35 / -4.6%
clickbench_q41/datafusion:vortex-compact 11259720 / 11463318 / -1.8% 35346773 / 34700312 / +1.9% 0.32 / 0.33 / -3.6%
clickbench_q42/datafusion:vortex-compact 10633488 / 10803602 / -1.6% 35658018 / 34876108 / +2.2% 0.30 / 0.31 / -3.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1240080 / 1265866 / -2.0% 51249081 / 49281008 / +4.0% 0.02 / 0.03 / -5.8%
clickbench_q01/datafusion:parquet 16549020 / 15984200 / +3.5% 74640761 / 66048802 / +13.0% 🔴 0.22 / 0.24 / -8.4%
clickbench_q02/datafusion:parquet 18858954 / 18707778 / +0.8% 85635664 / 80569587 / +6.3% 0.22 / 0.23 / -5.2%
clickbench_q03/datafusion:parquet 17492382 / 17141418 / +2.0% 84042735 / 78952963 / +6.4% 0.21 / 0.22 / -4.1%
clickbench_q04/datafusion:parquet 63426876 / 63560234 / -0.2% 126599038 / 126705660 / -0.1% 0.50 / 0.50 / -0.1%
clickbench_q05/datafusion:parquet 89512164 / 90277776 / -0.8% 158333030 / 152802534 / +3.6% 0.57 / 0.59 / -4.3%
clickbench_q06/datafusion:parquet 1258746 / 1276378 / -1.4% 51808236 / 49431469 / +4.8% 0.02 / 0.03 / -5.9%
clickbench_q07/datafusion:parquet 16829231 / 17430054 / -3.4% 68675788 / 66494520 / +3.3% 0.25 / 0.26 / -6.5%
clickbench_q08/datafusion:parquet 85256872 / 86089413 / -1.0% 164187905 / 154947707 / +6.0% 0.52 / 0.56 / -6.5%
clickbench_q09/datafusion:parquet 192730999 / 184448760 / +4.5% 273102038 / 262430229 / +4.1% 0.71 / 0.70 / +0.4%
clickbench_q10/datafusion:parquet 37243782 / 36159902 / +3.0% 103443405 / 100722901 / +2.7% 0.36 / 0.36 / +0.3%
clickbench_q11/datafusion:parquet 43215847 / 42941094 / +0.6% 113529252 / 106666642 / +6.4% 0.38 / 0.40 / -5.4%
clickbench_q12/datafusion:parquet 96508588 / 97546406 / -1.1% 164833167 / 160735184 / +2.5% 0.59 / 0.61 / -3.5%
clickbench_q13/datafusion:parquet 147164070 / 147693802 / -0.4% 232159567 / 227906710 / +1.9% 0.63 / 0.65 / -2.2%
clickbench_q14/datafusion:parquet 101636382 / 101442500 / +0.2% 176807724 / 169487306 / +4.3% 0.57 / 0.60 / -4.0%
clickbench_q15/datafusion:parquet 70963142 / 72871380 / -2.6% 131387044 / 130972911 / +0.3% 0.54 / 0.56 / -2.9%
clickbench_q16/datafusion:parquet 156451316 / 155627594 / +0.5% 240140215 / 236740077 / +1.4% 0.65 / 0.66 / -0.9%
clickbench_q17/datafusion:parquet 158776183 / 156029722 / +1.8% 239592710 / 236141836 / +1.5% 0.66 / 0.66 / +0.3%
clickbench_q18/datafusion:parquet 315690918 / 310577898 / +1.6% 430802544 / 425177503 / +1.3% 0.73 / 0.73 / +0.3%
clickbench_q19/datafusion:parquet 19550469 / 19977235 / -2.1% 81610549 / 74498644 / +9.5% 0.24 / 0.27 / -10.7%
clickbench_q20/datafusion:parquet 178831256 / 180573348 / -1.0% 296144580 / 276175821 / +7.2% 0.60 / 0.65 / -7.6%
clickbench_q21/datafusion:parquet 176997204 / 175218405 / +1.0% 315801934 / 290182670 / +8.8% 0.56 / 0.60 / -7.2%
clickbench_q22/datafusion:parquet 264627587 / 262140592 / +0.9% 457492659 / 412035967 / +11.0% 🔴 0.58 / 0.64 / -9.1%
clickbench_q23/datafusion:parquet 1014732886 / 1009361316 / +0.5% 1193269918 / 1186351240 / +0.6% 0.85 / 0.85 / -0.1%
clickbench_q24/datafusion:parquet 30273240 / 30282128 / -0.0% 94084602 / 87292342 / +7.8% 0.32 / 0.35 / -7.2%
clickbench_q25/datafusion:parquet 37156242 / 36829426 / +0.9% 105469219 / 103305289 / +2.1% 0.35 / 0.36 / -1.2%
clickbench_q26/datafusion:parquet 30874348 / 30623270 / +0.8% 92231905 / 87824429 / +5.0% 0.33 / 0.35 / -4.0%
clickbench_q27/datafusion:parquet 194186364 / 194381240 / -0.1% 308656370 / 279536344 / +10.4% 🔴 0.63 / 0.70 / -9.5%
clickbench_q28/datafusion:parquet 619054154 / 622644755 / -0.6% 712951027 / 696557088 / +2.4% 0.87 / 0.89 / -2.9%
clickbench_q29/datafusion:parquet 29003916 / 29310968 / -1.0% 92246443 / 91489683 / +0.8% 0.31 / 0.32 / -1.9%
clickbench_q30/datafusion:parquet 91526658 / 92386908 / -0.9% 177700781 / 170163065 / +4.4% 0.52 / 0.54 / -5.1%
clickbench_q31/datafusion:parquet 103953888 / 103721671 / +0.2% 204833802 / 192016800 / +6.7% 0.51 / 0.54 / -6.0%
clickbench_q32/datafusion:parquet 308346220 / 306941040 / +0.5% 434049927 / 420087731 / +3.3% 0.71 / 0.73 / -2.8%
clickbench_q33/datafusion:parquet 376363647 / 378003448 / -0.4% 479777742 / 470931489 / +1.9% 0.78 / 0.80 / -2.3%
clickbench_q34/datafusion:parquet 380263106 / 377927753 / +0.6% 480165396 / 478404981 / +0.4% 0.79 / 0.79 / +0.2%
clickbench_q35/datafusion:parquet 64969110 / 64371609 / +0.9% 124361002 / 124416723 / -0.0% 0.52 / 0.52 / +1.0%
clickbench_q36/datafusion:parquet 74089654 / 74075164 / +0.0% 137677003 / 135084203 / +1.9% 0.54 / 0.55 / -1.9%
clickbench_q37/datafusion:parquet 35835424 / 35962957 / -0.4% 91778610 / 91520816 / +0.3% 0.39 / 0.39 / -0.6%
clickbench_q38/datafusion:parquet 48225694 / 48181426 / +0.1% 109378747 / 109235182 / +0.1% 0.44 / 0.44 / -0.0%
clickbench_q39/datafusion:parquet 143485115 / 143821262 / -0.2% 214269757 / 208298460 / +2.9% 0.67 / 0.69 / -3.0%
clickbench_q40/datafusion:parquet 19913704 / 19900638 / +0.1% 77614005 / 79995146 / -3.0% 0.26 / 0.25 / +3.1%
clickbench_q41/datafusion:parquet 18817008 / 18884346 / -0.4% 74573593 / 76139353 / -2.1% 0.25 / 0.25 / +1.7%
clickbench_q42/datafusion:parquet 19143828 / 19150923 / -0.0% 73563964 / 75130820 / -2.1% 0.26 / 0.25 / +2.1%
duckdb / vortex-file-compressed / ns (1.021x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2169928 / 2199007 / -1.3% 25503349 / 24935243 / +2.3% 0.09 / 0.09 / -3.5%
clickbench_q01/duckdb:vortex-file-compressed 7949559 / 7914016 / +0.4% 29087069 / 29452620 / -1.2% 0.27 / 0.27 / +1.7%
clickbench_q02/duckdb:vortex-file-compressed 9490588 / 9503036 / -0.1% 37576773 / 37303633 / +0.7% 0.25 / 0.25 / -0.9%
clickbench_q03/duckdb:vortex-file-compressed 14064716 / 13819752 / +1.8% 50139722 / 48330925 / +3.7% 0.28 / 0.29 / -1.9%
clickbench_q04/duckdb:vortex-file-compressed 58005711 / 56331441 / +3.0% 90595226 / 86171463 / +5.1% 0.64 / 0.65 / -2.1%
clickbench_q05/duckdb:vortex-file-compressed 64279677 / 63781782 / +0.8% 98242414 / 92892023 / +5.8% 0.65 / 0.69 / -4.7%
clickbench_q06/duckdb:vortex-file-compressed 2652834 / 2636668 / +0.6% 31423215 / 31890183 / -1.5% 0.08 / 0.08 / +2.1%
clickbench_q07/duckdb:vortex-file-compressed 9750366 / 9589752 / +1.7% 31620375 / 30877036 / +2.4% 0.31 / 0.31 / -0.7%
clickbench_q08/duckdb:vortex-file-compressed 68908028 / 68706477 / +0.3% 104958043 / 106070485 / -1.0% 0.66 / 0.65 / +1.4%
clickbench_q09/duckdb:vortex-file-compressed 94438983 / 93169816 / +1.4% 131991391 / 118818289 / +11.1% 🔴 0.72 / 0.78 / -8.8%
clickbench_q10/duckdb:vortex-file-compressed 27632841 / 27798574 / -0.6% 69485953 / 66158949 / +5.0% 0.40 / 0.42 / -5.4%
clickbench_q11/duckdb:vortex-file-compressed 30342576 / 30817072 / -1.5% 78712835 / 66739806 / +17.9% 🔴 0.39 / 0.46 / -16.5%
clickbench_q12/duckdb:vortex-file-compressed 70048993 / 70849869 / -1.1% 102844735 / 100965251 / +1.9% 0.68 / 0.70 / -2.9%
clickbench_q13/duckdb:vortex-file-compressed 127087208 / 124936378 / +1.7% 170569352 / 163647724 / +4.2% 0.75 / 0.76 / -2.4%
clickbench_q14/duckdb:vortex-file-compressed 74614020 / 74736806 / -0.2% 102784010 / 104420508 / -1.6% 0.73 / 0.72 / +1.4%
clickbench_q15/duckdb:vortex-file-compressed 75591394 / 75826670 / -0.3% 109395042 / 106779791 / +2.4% 0.69 / 0.71 / -2.7%
clickbench_q16/duckdb:vortex-file-compressed 133553136 / 133726284 / -0.1% 175662357 / 170281021 / +3.2% 0.76 / 0.79 / -3.2%
clickbench_q17/duckdb:vortex-file-compressed 141557752 / 139144716 / +1.7% 173465056 / 171248394 / +1.3% 0.82 / 0.81 / +0.4%
clickbench_q18/duckdb:vortex-file-compressed 262456486 / 255653542 / +2.7% 301649588 / 305652840 / -1.3% 0.87 / 0.84 / +4.0%
clickbench_q19/duckdb:vortex-file-compressed 9699168 / 9371124 / +3.5% 37885303 / 35996459 / +5.2% 0.26 / 0.26 / -1.7%
clickbench_q20/duckdb:vortex-file-compressed 68964934 / 68343734 / +0.9% 168020369 / 159726171 / +5.2% 0.41 / 0.43 / -4.1%
clickbench_q21/duckdb:vortex-file-compressed 86245084 / 85599765 / +0.8% 194734550 / 184771515 / +5.4% 0.44 / 0.46 / -4.4%
clickbench_q22/duckdb:vortex-file-compressed 172717593 / 173118616 / -0.2% 343130364 / 330032916 / +4.0% 0.50 / 0.52 / -4.0%
clickbench_q23/duckdb:vortex-file-compressed 54915673 / 40344767 / +36.1% 🔴 162052316 / 83262579 / +94.6% 🔴 0.34 / 0.48 / -30.1%
clickbench_q24/duckdb:vortex-file-compressed 18024232 / 14614728 / +23.3% 🔴 47354450 / 38296225 / +23.7% 🔴 0.38 / 0.38 / -0.3%
clickbench_q25/duckdb:vortex-file-compressed 19321102 / 19848312 / -2.7% 53675104 / 53379806 / +0.6% 0.36 / 0.37 / -3.2%
clickbench_q26/duckdb:vortex-file-compressed 15264052 / 10978038 / +39.0% 🔴 47338625 / 38094986 / +24.3% 🔴 0.32 / 0.29 / +11.9%
clickbench_q27/duckdb:vortex-file-compressed 54551912 / 54326782 / +0.4% 181440784 / 172510868 / +5.2% 0.30 / 0.31 / -4.5%
clickbench_q28/duckdb:vortex-file-compressed 509236582 / 514952414 / -1.1% 562862951 / 558801247 / +0.7% 0.90 / 0.92 / -1.8%
clickbench_q29/duckdb:vortex-file-compressed 17167944 / 17441914 / -1.6% 46247475 / 38189978 / +21.1% 🔴 0.37 / 0.46 / -18.7%
clickbench_q30/duckdb:vortex-file-compressed 59954194 / 60637436 / -1.1% 108606953 / 102605662 / +5.8% 0.55 / 0.59 / -6.6%
clickbench_q31/duckdb:vortex-file-compressed 110135638 / 111528546 / -1.2% 180127793 / 187592183 / -4.0% 0.61 / 0.59 / +2.8%
clickbench_q32/duckdb:vortex-file-compressed 364527768 / 358069046 / +1.8% 397684622 / 393637413 / +1.0% 0.92 / 0.91 / +0.8%
clickbench_q33/duckdb:vortex-file-compressed 355683496 / 350899059 / +1.4% 410255204 / 413264224 / -0.7% 0.87 / 0.85 / +2.1%
clickbench_q34/duckdb:vortex-file-compressed 349285758 / 351354534 / -0.6% 411934218 / 413776389 / -0.4% 0.85 / 0.85 / -0.1%
clickbench_q35/duckdb:vortex-file-compressed 56870802 / 58392974 / -2.6% 87513768 / 87256297 / +0.3% 0.65 / 0.67 / -2.9%
clickbench_q36/duckdb:vortex-file-compressed 11364240 / 11635963 / -2.3% 32944172 / 34397863 / -4.2% 0.34 / 0.34 / +2.0%
clickbench_q37/duckdb:vortex-file-compressed 8357678 / 8513262 / -1.8% 28659573 / 29703818 / -3.5% 0.29 / 0.29 / +1.7%
clickbench_q38/duckdb:vortex-file-compressed 8917810 / 8831332 / +1.0% 30207177 / 28544174 / +5.8% 0.30 / 0.31 / -4.6%
clickbench_q39/duckdb:vortex-file-compressed 18721932 / 19554903 / -4.3% 40279786 / 40249253 / +0.1% 0.46 / 0.49 / -4.3%
clickbench_q40/duckdb:vortex-file-compressed 7458355 / 7193020 / +3.7% 27923245 / 29944319 / -6.7% 0.27 / 0.24 / +11.2%
clickbench_q41/duckdb:vortex-file-compressed 8317052 / 8562172 / -2.9% 30825113 / 29735489 / +3.7% 0.27 / 0.29 / -6.3%
clickbench_q42/duckdb:vortex-file-compressed 7553170 / 7428438 / +1.7% 27782201 / 26909742 / +3.2% 0.27 / 0.28 / -1.5%
duckdb / vortex-compact / ns (1.018x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 2163314 / 2194496 / -1.4% 26780043 / 25252064 / +6.1% 0.08 / 0.09 / -7.0%
clickbench_q01/duckdb:vortex-compact 7812206 / 7778826 / +0.4% 30907272 / 31170158 / -0.8% 0.25 / 0.25 / +1.3%
clickbench_q02/duckdb:vortex-compact 14018204 / 13925958 / +0.7% 37633375 / 40352470 / -6.7% 0.37 / 0.35 / +7.9%
clickbench_q03/duckdb:vortex-compact 14999689 / 14851392 / +1.0% 44314242 / 43172632 / +2.6% 0.34 / 0.34 / -1.6%
clickbench_q04/duckdb:vortex-compact 60142658 / 58023784 / +3.7% 89620455 / 90032625 / -0.5% 0.67 / 0.64 / +4.1%
clickbench_q05/duckdb:vortex-compact 70417301 / 69774595 / +0.9% 98959680 / 99617831 / -0.7% 0.71 / 0.70 / +1.6%
clickbench_q06/duckdb:vortex-compact 2549852 / 2652964 / -3.9% 30613737 / 32934289 / -7.0% 0.08 / 0.08 / +3.4%
clickbench_q07/duckdb:vortex-compact 10009652 / 9970398 / +0.4% 32935117 / 36388971 / -9.5% 0.30 / 0.27 / +10.9%
clickbench_q08/duckdb:vortex-compact 73844702 / 73333064 / +0.7% 110042583 / 104803802 / +5.0% 0.67 / 0.70 / -4.1%
clickbench_q09/duckdb:vortex-compact 101809572 / 104047873 / -2.2% 138221942 / 137935207 / +0.2% 0.74 / 0.75 / -2.4%
clickbench_q10/duckdb:vortex-compact 33040011 / 33436412 / -1.2% 70956477 / 69046019 / +2.8% 0.47 / 0.48 / -3.8%
clickbench_q11/duckdb:vortex-compact 36795164 / 37427500 / -1.7% 77105877 / 71280321 / +8.2% 0.48 / 0.53 / -9.1%
clickbench_q12/duckdb:vortex-compact 83461074 / 82737831 / +0.9% 116350726 / 116127942 / +0.2% 0.72 / 0.71 / +0.7%
clickbench_q13/duckdb:vortex-compact 154016753 / 153185874 / +0.5% 192098479 / 182081748 / +5.5% 0.80 / 0.84 / -4.7%
clickbench_q14/duckdb:vortex-compact 91053915 / 90198962 / +0.9% 120705931 / 119500915 / +1.0% 0.75 / 0.75 / -0.1%
clickbench_q15/duckdb:vortex-compact 77997960 / 77613892 / +0.5% 110491013 / 106025552 / +4.2% 0.71 / 0.73 / -3.6%
clickbench_q16/duckdb:vortex-compact 144949673 / 145916853 / -0.7% 181822761 / 179106794 / +1.5% 0.80 / 0.81 / -2.1%
clickbench_q17/duckdb:vortex-compact 149258743 / 154770764 / -3.6% 178245273 / 175973856 / +1.3% 0.84 / 0.88 / -4.8%
clickbench_q18/duckdb:vortex-compact 261461228 / 259835036 / +0.6% 302413829 / 305530359 / -1.0% 0.86 / 0.85 / +1.7%
clickbench_q19/duckdb:vortex-compact 10129956 / 10256275 / -1.2% 34745604 / 32888003 / +5.6% 0.29 / 0.31 / -6.5%
clickbench_q20/duckdb:vortex-compact 81188884 / 80493452 / +0.9% 148545162 / 144014288 / +3.1% 0.55 / 0.56 / -2.2%
clickbench_q21/duckdb:vortex-compact 121006602 / 120479412 / +0.4% 193718334 / 187162102 / +3.5% 0.62 / 0.64 / -3.0%
clickbench_q22/duckdb:vortex-compact 300542476 / 300772494 / -0.1% 407830086 / 373793975 / +9.1% 0.74 / 0.80 / -8.4%
clickbench_q23/duckdb:vortex-compact 68483556 / 52388760 / +30.7% 🔴 145173577 / 83469465 / +73.9% 🔴 0.47 / 0.63 / -24.8%
clickbench_q24/duckdb:vortex-compact 23727168 / 18036828 / +31.5% 🔴 53769844 / 39269327 / +36.9% 🔴 0.44 / 0.46 / -3.9%
clickbench_q25/duckdb:vortex-compact 42740296 / 43024540 / -0.7% 73606845 / 73972599 / -0.5% 0.58 / 0.58 / -0.2%
clickbench_q26/duckdb:vortex-compact 22918102 / 15680352 / +46.2% 🔴 52126294 / 40874819 / +27.5% 🔴 0.44 / 0.38 / +14.6%
clickbench_q27/duckdb:vortex-compact 136079220 / 137706090 / -1.2% 193719440 / 185838398 / +4.2% 0.70 / 0.74 / -5.2%
clickbench_q28/duckdb:vortex-compact 574864236 / 573432895 / +0.2% 611560269 / 612069037 / -0.1% 0.94 / 0.94 / +0.3%
clickbench_q29/duckdb:vortex-compact 20603373 / 20969334 / -1.7% 48825884 / 46504613 / +5.0% 0.42 / 0.45 / -6.4%
clickbench_q30/duckdb:vortex-compact 81195854 / 81944371 / -0.9% 125787234 / 116469884 / +8.0% 0.65 / 0.70 / -8.3%
clickbench_q31/duckdb:vortex-compact 109603699 / 131263888 / -16.5% 🟢 188727410 / 191674400 / -1.5% 0.58 / 0.68 / -15.2%
clickbench_q32/duckdb:vortex-compact 388053310 / 377150663 / +2.9% 412193678 / 410664719 / +0.4% 0.94 / 0.92 / +2.5%
clickbench_q33/duckdb:vortex-compact 351089842 / 348994520 / +0.6% 396800344 / 389577274 / +1.9% 0.88 / 0.90 / -1.2%
clickbench_q34/duckdb:vortex-compact 367441357 / 355660962 / +3.3% 412306671 / 393699701 / +4.7% 0.89 / 0.90 / -1.4%
clickbench_q35/duckdb:vortex-compact 60684034 / 60721930 / -0.1% 89550836 / 88856948 / +0.8% 0.68 / 0.68 / -0.8%
clickbench_q36/duckdb:vortex-compact 13097754 / 12714948 / +3.0% 34701716 / 34714038 / -0.0% 0.38 / 0.37 / +3.0%
clickbench_q37/duckdb:vortex-compact 10458442 / 10416445 / +0.4% 31062587 / 31960637 / -2.8% 0.34 / 0.33 / +3.3%
clickbench_q38/duckdb:vortex-compact 9683921 / 9403700 / +3.0% 29606817 / 29202958 / +1.4% 0.33 / 0.32 / +1.6%
clickbench_q39/duckdb:vortex-compact 19747042 / 19915284 / -0.8% 40757112 / 41207123 / -1.1% 0.48 / 0.48 / +0.3%
clickbench_q40/duckdb:vortex-compact 8059712 / 8227811 / -2.0% 29166040 / 28824802 / +1.2% 0.28 / 0.29 / -3.2%
clickbench_q41/duckdb:vortex-compact 8982370 / 8986408 / -0.0% 28359426 / 28706412 / -1.2% 0.32 / 0.31 / +1.2%
clickbench_q42/duckdb:vortex-compact 7746641 / 7564046 / +2.4% 29490409 / 27076577 / +8.9% 0.26 / 0.28 / -6.0%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9554199 / 8815339 / +8.4% 13936666 / 14189991 / -1.8% 0.69 / 0.62 / +10.4%
clickbench_q01/duckdb:parquet 15221630 / 15445892 / -1.5% 22114282 / 21346758 / +3.6% 0.69 / 0.72 / -4.9%
clickbench_q02/duckdb:parquet 22189324 / 22472260 / -1.3% 32339736 / 31358645 / +3.1% 0.69 / 0.72 / -4.3%
clickbench_q03/duckdb:parquet 22962222 / 22998272 / -0.2% 33043444 / 36207727 / -8.7% 0.69 / 0.64 / +9.4%
clickbench_q04/duckdb:parquet 61193072 / 61859198 / -1.1% 75719307 / 76049681 / -0.4% 0.81 / 0.81 / -0.6%
clickbench_q05/duckdb:parquet 83956348 / 83761206 / +0.2% 96563287 / 94563883 / +2.1% 0.87 / 0.89 / -1.8%
clickbench_q06/duckdb:parquet 20974614 / 20315944 / +3.2% 28052311 / 29608510 / -5.3% 0.75 / 0.69 / +9.0%
clickbench_q07/duckdb:parquet 16465952 / 16939550 / -2.8% 22264398 / 23417291 / -4.9% 0.74 / 0.72 / +2.2%
clickbench_q08/duckdb:parquet 75088236 / 75760344 / -0.9% 87817270 / 93873472 / -6.5% 0.86 / 0.81 / +5.9%
clickbench_q09/duckdb:parquet 101505954 / 103536454 / -2.0% 119856769 / 117579821 / +1.9% 0.85 / 0.88 / -3.8%
clickbench_q10/duckdb:parquet 41568209 / 41778034 / -0.5% 55438833 / 55829132 / -0.7% 0.75 / 0.75 / +0.2%
clickbench_q11/duckdb:parquet 46810514 / 46413326 / +0.9% 61599314 / 61310263 / +0.5% 0.76 / 0.76 / +0.4%
clickbench_q12/duckdb:parquet 92196278 / 92150227 / +0.0% 108601452 / 102651522 / +5.8% 0.85 / 0.90 / -5.4%
clickbench_q13/duckdb:parquet 152787342 / 150790881 / +1.3% 169541564 / 168590991 / +0.6% 0.90 / 0.89 / +0.8%
clickbench_q14/duckdb:parquet 101345321 / 101500388 / -0.2% 118794616 / 117937937 / +0.7% 0.85 / 0.86 / -0.9%
clickbench_q15/duckdb:parquet 86077671 / 86271976 / -0.2% 99170113 / 100318699 / -1.1% 0.87 / 0.86 / +0.9%
clickbench_q16/duckdb:parquet 168914443 / 164517162 / +2.7% 178370537 / 177546496 / +0.5% 0.95 / 0.93 / +2.2%
clickbench_q17/duckdb:parquet 163600655 / 167011323 / -2.0% 184129780 / 181083625 / +1.7% 0.89 / 0.92 / -3.7%
clickbench_q18/duckdb:parquet 292573164 / 295343783 / -0.9% 316921731 / 322164500 / -1.6% 0.92 / 0.92 / +0.7%
clickbench_q19/duckdb:parquet 19761758 / 19628178 / +0.7% 26376614 / 26083819 / +1.1% 0.75 / 0.75 / -0.4%
clickbench_q20/duckdb:parquet 188148842 / 181211970 / +3.8% 221279834 / 221604334 / -0.1% 0.85 / 0.82 / +4.0%
clickbench_q21/duckdb:parquet 217081018 / 214972235 / +1.0% 260304281 / 264638353 / -1.6% 0.83 / 0.81 / +2.7%
clickbench_q22/duckdb:parquet 303490762 / 300790510 / +0.9% 357504989 / 356222614 / +0.4% 0.85 / 0.84 / +0.5%
clickbench_q23/duckdb:parquet 174093725 / 171376976 / +1.6% 238856057 / 247053629 / -3.3% 0.73 / 0.69 / +5.1%
clickbench_q24/duckdb:parquet 30112337 / 30551374 / -1.4% 44129126 / 41506868 / +6.3% 0.68 / 0.74 / -7.3%
clickbench_q25/duckdb:parquet 42508272 / 42296802 / +0.5% 60644201 / 56602915 / +7.1% 0.70 / 0.75 / -6.2%
clickbench_q26/duckdb:parquet 30370901 / 31514832 / -3.6% 49007889 / 45525349 / +7.6% 0.62 / 0.69 / -10.5%
clickbench_q27/duckdb:parquet 195810988 / 196254777 / -0.2% 233658182 / 226386051 / +3.2% 0.84 / 0.87 / -3.3%
clickbench_q28/duckdb:parquet 950230116 / 973550864 / -2.4% 937381987 / 939149059 / -0.2% 1.01 / 1.04 / -2.2%
clickbench_q29/duckdb:parquet 24081406 / 24121804 / -0.2% 31147476 / 31664380 / -1.6% 0.77 / 0.76 / +1.5%
clickbench_q30/duckdb:parquet 105892742 / 105569440 / +0.3% 126277006 / 126738446 / -0.4% 0.84 / 0.83 / +0.7%
clickbench_q31/duckdb:parquet 156606506 / 160278524 / -2.3% 173159336 / 197944416 / -12.5% 🟢 0.90 / 0.81 / +11.7%
clickbench_q32/duckdb:parquet 398898089 / 380178874 / +4.9% 422722421 / 407687989 / +3.7% 0.94 / 0.93 / +1.2%
clickbench_q33/duckdb:parquet 478522813 / 483101208 / -0.9% 441403084 / 464606588 / -5.0% 1.08 / 1.04 / +4.3%
clickbench_q34/duckdb:parquet 471313927 / 460342397 / +2.4% 470860513 / 445531722 / +5.7% 1.00 / 1.03 / -3.1%
clickbench_q35/duckdb:parquet 61532848 / 61173499 / +0.6% 73530510 / 72709343 / +1.1% 0.84 / 0.84 / -0.5%
clickbench_q36/duckdb:parquet 29973520 / 30182986 / -0.7% 35736068 / 36385231 / -1.8% 0.84 / 0.83 / +1.1%
clickbench_q37/duckdb:parquet 23047391 / 23515404 / -2.0% 29328680 / 29503988 / -0.6% 0.79 / 0.80 / -1.4%
clickbench_q38/duckdb:parquet 23340273 / 23922075 / -2.4% 29753503 / 29087385 / +2.3% 0.78 / 0.82 / -4.6%
clickbench_q39/duckdb:parquet 52971007 / 53065460 / -0.2% 59239418 / 59834840 / -1.0% 0.89 / 0.89 / +0.8%
clickbench_q40/duckdb:parquet 14833808 / 14922165 / -0.6% 20444642 / 20854036 / -2.0% 0.73 / 0.72 / +1.4%
clickbench_q41/duckdb:parquet 14903626 / 15651810 / -4.8% 19934211 / 20872570 / -4.5% 0.75 / 0.75 / -0.3%
clickbench_q42/duckdb:parquet 14277174 / 14338484 / -0.4% 22109036 / 21012230 / +5.2% 0.65 / 0.68 / -5.4%
duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11255478 / 11237791 / +0.2% 13970088 / 13590131 / +2.8% 0.81 / 0.83 / -2.6%
clickbench_q01/duckdb:duckdb 26513826 / 26521483 / -0.0% 45424590 / 45583116 / -0.3% 0.58 / 0.58 / +0.3%
clickbench_q02/duckdb:duckdb 22412288 / 22516560 / -0.5% 50490134 / 50997872 / -1.0% 0.44 / 0.44 / +0.5%
clickbench_q03/duckdb:duckdb 21082016 / 21559216 / -2.2% 45635303 / 47066217 / -3.0% 0.46 / 0.46 / +0.9%
clickbench_q04/duckdb:duckdb 74836557 / 73652526 / +1.6% 99150620 / 96866810 / +2.4% 0.75 / 0.76 / -0.7%
clickbench_q05/duckdb:duckdb 79956109 / 79814073 / +0.2% 100851109 / 102485671 / -1.6% 0.79 / 0.78 / +1.8%
clickbench_q06/duckdb:duckdb 21598894 / 21750078 / -0.7% 29638221 / 31110018 / -4.7% 0.73 / 0.70 / +4.2%
clickbench_q07/duckdb:duckdb 17488422 / 17762504 / -1.5% 34107762 / 33835027 / +0.8% 0.51 / 0.52 / -2.3%
clickbench_q08/duckdb:duckdb 86573150 / 88500325 / -2.2% 118589262 / 117412412 / +1.0% 0.73 / 0.75 / -3.1%
clickbench_q09/duckdb:duckdb 96902828 / 97484456 / -0.6% 138010929 / 131966010 / +4.6% 0.70 / 0.74 / -5.0%
clickbench_q10/duckdb:duckdb 52291580 / 52698728 / -0.8% 89122640 / 89282874 / -0.2% 0.59 / 0.59 / -0.6%
clickbench_q11/duckdb:duckdb 55438866 / 55774427 / -0.6% 96418080 / 98678391 / -2.3% 0.57 / 0.57 / +1.7%
clickbench_q12/duckdb:duckdb 81177310 / 82679338 / -1.8% 106356118 / 104651989 / +1.6% 0.76 / 0.79 / -3.4%
clickbench_q13/duckdb:duckdb 143934328 / 147157512 / -2.2% 179099610 / 180567335 / -0.8% 0.80 / 0.81 / -1.4%
clickbench_q14/duckdb:duckdb 92409299 / 90704160 / +1.9% 115276515 / 114595141 / +0.6% 0.80 / 0.79 / +1.3%
clickbench_q15/duckdb:duckdb 83474071 / 82872334 / +0.7% 105785205 / 104236857 / +1.5% 0.79 / 0.80 / -0.7%
clickbench_q16/duckdb:duckdb 163196710 / 167697029 / -2.7% 194019801 / 188062195 / +3.2% 0.84 / 0.89 / -5.7%
clickbench_q17/duckdb:duckdb 153353354 / 153582119 / -0.1% 185706134 / 184562976 / +0.6% 0.83 / 0.83 / -0.8%
clickbench_q18/duckdb:duckdb 305257338 / 302459134 / +0.9% 353360153 / 345002393 / +2.4% 0.86 / 0.88 / -1.5%
clickbench_q19/duckdb:duckdb 17482930 / 17882282 / -2.2% 35784052 / 32856318 / +8.9% 0.49 / 0.54 / -10.2%
clickbench_q20/duckdb:duckdb 191587150 / 185006682 / +3.6% 466731202 / 431469212 / +8.2% 0.41 / 0.43 / -4.3%
clickbench_q21/duckdb:duckdb 181221694 / 174771950 / +3.7% 459896451 / 430042680 / +6.9% 0.39 / 0.41 / -3.0%
clickbench_q22/duckdb:duckdb 185020216 / 188784498 / -2.0% 437932320 / 463858379 / -5.6% 0.42 / 0.41 / +3.8%
clickbench_q23/duckdb:duckdb 69392639 / 69890242 / -0.7% 143699261 / 137003063 / +4.9% 0.48 / 0.51 / -5.3%
clickbench_q24/duckdb:duckdb 30773034 / 30919122 / -0.5% 45742805 / 46054964 / -0.7% 0.67 / 0.67 / +0.2%
clickbench_q25/duckdb:duckdb 40357080 / 41383310 / -2.5% 77499020 / 75617227 / +2.5% 0.52 / 0.55 / -4.8%
clickbench_q26/duckdb:duckdb 31113339 / 30657068 / +1.5% 48312871 / 47921609 / +0.8% 0.64 / 0.64 / +0.7%
clickbench_q27/duckdb:duckdb 159174720 / 154002349 / +3.4% 436959391 / 394717224 / +10.7% 🔴 0.36 / 0.39 / -6.6%
clickbench_q28/duckdb:duckdb 823786684 / 841476924 / -2.1% 901195319 / 870534275 / +3.5% 0.91 / 0.97 / -5.4%
clickbench_q29/duckdb:duckdb 27253058 / 27150759 / +0.4% 45207251 / 44000085 / +2.7% 0.60 / 0.62 / -2.3%
clickbench_q30/duckdb:duckdb 101345691 / 101782966 / -0.4% 173367177 / 167808703 / +3.3% 0.58 / 0.61 / -3.6%
clickbench_q31/duckdb:duckdb 171302542 / 171487002 / -0.1% 249946342 / 237036749 / +5.4% 0.69 / 0.72 / -5.3%
clickbench_q32/duckdb:duckdb 486509424 / 480458339 / +1.3% 494455792 / 483466670 / +2.3% 0.98 / 0.99 / -1.0%
clickbench_q33/duckdb:duckdb 455296566 / 466448713 / -2.4% 607957367 / 588587924 / +3.3% 0.75 / 0.79 / -5.5%
clickbench_q34/duckdb:duckdb 469163410 / 452026162 / +3.8% 624883421 / 577854473 / +8.1% 0.75 / 0.78 / -4.0%
clickbench_q35/duckdb:duckdb 75039149 / 74505554 / +0.7% 94368463 / 94082334 / +0.3% 0.80 / 0.79 / +0.4%
clickbench_q36/duckdb:duckdb 32441523 / 31721818 / +2.3% 48089494 / 45862251 / +4.9% 0.67 / 0.69 / -2.5%
clickbench_q37/duckdb:duckdb 16969080 / 17025368 / -0.3% 26930407 / 25268168 / +6.6% 0.63 / 0.67 / -6.5%
clickbench_q38/duckdb:duckdb 18889893 / 19724995 / -4.2% 35922013 / 34188685 / +5.1% 0.53 / 0.58 / -8.9%
clickbench_q39/duckdb:duckdb 54255601 / 54818176 / -1.0% 80777363 / 76164906 / +6.1% 0.67 / 0.72 / -6.7%
clickbench_q40/duckdb:duckdb 16183774 / 16289102 / -0.6% 30330654 / 27882144 / +8.8% 0.53 / 0.58 / -8.7%
clickbench_q41/duckdb:duckdb 15681006 / 15801496 / -0.8% 26288155 / 24222752 / +8.5% 0.60 / 0.65 / -8.6%
clickbench_q42/duckdb:duckdb 16120288 / 16251276 / -0.8% 27924228 / 26537531 / +5.2% 0.58 / 0.61 / -5.7%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.009x ➖ · cold 0.998x ➖
Shifts: Parquet (control) +0.9% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1791166 / 1792880 / -0.1% 6193029 / 7086750 / -12.6% 🟢 0.29 / 0.25 / +14.3%
statpopgen_q01/datafusion:vortex-file-compressed 3931037 / 4174088 / -5.8% 11910140 / 12304580 / -3.2% 0.33 / 0.34 / -2.7%
statpopgen_q02/datafusion:vortex-file-compressed 39740501 / 38637146 / +2.9% 65108591 / 65859951 / -1.1% 0.61 / 0.59 / +4.0%
statpopgen_q03/datafusion:vortex-file-compressed 124184002 / 116669294 / +6.4% 152378261 / 156680491 / -2.7% 0.81 / 0.74 / +9.4%
statpopgen_q04/datafusion:vortex-file-compressed 117501217 / 118978348 / -1.2% 153039414 / 159201461 / -3.9% 0.77 / 0.75 / +2.7%
statpopgen_q05/datafusion:vortex-file-compressed 69901886 / 72784110 / -4.0% 106321343 / 108453643 / -2.0% 0.66 / 0.67 / -2.0%
statpopgen_q06/datafusion:vortex-file-compressed 194834090 / 195448278 / -0.3% 231782540 / 233186918 / -0.6% 0.84 / 0.84 / +0.3%
statpopgen_q07/datafusion:vortex-file-compressed 283283410 / 278869694 / +1.6% 312979475 / 308556553 / +1.4% 0.91 / 0.90 / +0.1%
statpopgen_q08/datafusion:vortex-file-compressed 283450504 / 285269610 / -0.6% 316350290 / 318941184 / -0.8% 0.90 / 0.89 / +0.2%
statpopgen_q09/datafusion:vortex-file-compressed 97596303 / 98349553 / -0.8% 131641683 / 132628520 / -0.7% 0.74 / 0.74 / -0.0%
statpopgen_q10/datafusion:vortex-file-compressed 255222908 / 252853764 / +0.9% 298412356 / 299454828 / -0.3% 0.86 / 0.84 / +1.3%
datafusion / vortex-compact / ns (0.998x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1802985 / 1830352 / -1.5% 6273866 / 6890515 / -8.9% 0.29 / 0.27 / +8.2%
statpopgen_q01/datafusion:vortex-compact 4056318 / 4814726 / -15.8% 🟢 11338587 / 13310542 / -14.8% 🟢 0.36 / 0.36 / -1.1%
statpopgen_q02/datafusion:vortex-compact 43685860 / 42398570 / +3.0% 65619064 / 64479528 / +1.8% 0.67 / 0.66 / +1.2%
statpopgen_q03/datafusion:vortex-compact 136275698 / 118687780 / +14.8% 🔴 161105160 / 154860067 / +4.0% 0.85 / 0.77 / +10.4%
statpopgen_q04/datafusion:vortex-compact 119447313 / 119636088 / -0.2% 158615378 / 154345625 / +2.8% 0.75 / 0.78 / -2.8%
statpopgen_q05/datafusion:vortex-compact 73158406 / 74169912 / -1.4% 105553219 / 105824752 / -0.3% 0.69 / 0.70 / -1.1%
statpopgen_q06/datafusion:vortex-compact 200457740 / 199840460 / +0.3% 229603492 / 231375514 / -0.8% 0.87 / 0.86 / +1.1%
statpopgen_q07/datafusion:vortex-compact 354969447 / 351448688 / +1.0% 363926099 / 376765851 / -3.4% 0.98 / 0.93 / +4.6%
statpopgen_q08/datafusion:vortex-compact 358762760 / 355796834 / +0.8% 414246890 / 382451866 / +8.3% 0.87 / 0.93 / -6.9%
statpopgen_q09/datafusion:vortex-compact 100657436 / 100281224 / +0.4% 131029295 / 131941466 / -0.7% 0.77 / 0.76 / +1.1%
statpopgen_q10/datafusion:vortex-compact 256531446 / 259067171 / -1.0% 296324119 / 314818102 / -5.9% 0.87 / 0.82 / +5.2%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1942272 / 1963713 / -1.1% 88047261 / 91754826 / -4.0% 0.02 / 0.02 / +3.1%
statpopgen_q01/datafusion:parquet 162379535 / 161805310 / +0.4% 174322507 / 174911345 / -0.3% 0.93 / 0.93 / +0.7%
statpopgen_q02/datafusion:parquet 280915142 / 292412250 / -3.9% 414878229 / 426598116 / -2.7% 0.68 / 0.69 / -1.2%
statpopgen_q03/datafusion:parquet 386245811 / 378327494 / +2.1% 509201800 / 534302682 / -4.7% 0.76 / 0.71 / +7.1%
statpopgen_q04/datafusion:parquet 391288648 / 393215226 / -0.5% 529013140 / 528221922 / +0.1% 0.74 / 0.74 / -0.6%
statpopgen_q05/datafusion:parquet 327179250 / 328455312 / -0.4% 427810411 / 449372405 / -4.8% 0.76 / 0.73 / +4.6%
statpopgen_q06/datafusion:parquet 481566348 / 486777106 / -1.1% 610300747 / 638337402 / -4.4% 0.79 / 0.76 / +3.5%
statpopgen_q07/datafusion:parquet 420661908 / 421970698 / -0.3% 556945970 / 542870272 / +2.6% 0.76 / 0.78 / -2.8%
statpopgen_q08/datafusion:parquet 420967049 / 418506134 / +0.6% 599610827 / 544361582 / +10.1% 🔴 0.70 / 0.77 / -8.7%
statpopgen_q09/datafusion:parquet 354634379 / 362331946 / -2.1% 466355714 / 483993780 / -3.6% 0.76 / 0.75 / +1.6%
statpopgen_q10/datafusion:parquet 545301628 / 548391767 / -0.6% 678105156 / 709904814 / -4.5% 0.80 / 0.77 / +4.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12939099 / 12973336 / -0.3% 15060469 / 15053752 / +0.0% 0.86 / 0.86 / -0.3%
statpopgen_q01/duckdb:vortex-file-compressed 14030866 / 13992532 / +0.3% 18584591 / 18357032 / +1.2% 0.75 / 0.76 / -1.0%
statpopgen_q02/duckdb:vortex-file-compressed 133305364 / 139121228 / -4.2% 149287453 / 162924538 / -8.4% 0.89 / 0.85 / +4.6%
statpopgen_q03/duckdb:vortex-file-compressed 337054962 / 336218158 / +0.2% 367586020 / 357513127 / +2.8% 0.92 / 0.94 / -2.5%
statpopgen_q04/duckdb:vortex-file-compressed 337574080 / 343855884 / -1.8% 359436416 / 360353748 / -0.3% 0.94 / 0.95 / -1.6%
statpopgen_q05/duckdb:vortex-file-compressed 98587977 / 96704080 / +1.9% 116355782 / 122461647 / -5.0% 0.85 / 0.79 / +7.3%
statpopgen_q06/duckdb:vortex-file-compressed 226757624 / 227200218 / -0.2% 246554343 / 249502833 / -1.2% 0.92 / 0.91 / +1.0%
statpopgen_q07/duckdb:vortex-file-compressed 141125942 / 142249286 / -0.8% 163283043 / 165954720 / -1.6% 0.86 / 0.86 / +0.8%
statpopgen_q08/duckdb:vortex-file-compressed 151973644 / 151098604 / +0.6% 167580006 / 171844340 / -2.5% 0.91 / 0.88 / +3.1%
statpopgen_q09/duckdb:vortex-file-compressed 300585402 / 289004060 / +4.0% 323277575 / 304432549 / +6.2% 0.93 / 0.95 / -2.1%
statpopgen_q10/duckdb:vortex-file-compressed 783920270 / 766554064 / +2.3% 828228439 / 799857722 / +3.5% 0.95 / 0.96 / -1.2%
duckdb / vortex-compact / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12942330 / 12909160 / +0.3% 14933433 / 15039950 / -0.7% 0.87 / 0.86 / +1.0%
statpopgen_q01/duckdb:vortex-compact 13699844 / 13969798 / -1.9% 18263983 / 18282064 / -0.1% 0.75 / 0.76 / -1.8%
statpopgen_q02/duckdb:vortex-compact 125555990 / 128270504 / -2.1% 163558973 / 161770263 / +1.1% 0.77 / 0.79 / -3.2%
statpopgen_q03/duckdb:vortex-compact 291401645 / 293092090 / -0.6% 340912045 / 356344698 / -4.3% 0.85 / 0.82 / +3.9%
statpopgen_q04/duckdb:vortex-compact 286672542 / 326175556 / -12.1% 🟢 357919842 / 369211344 / -3.1% 0.80 / 0.88 / -9.3%
statpopgen_q05/duckdb:vortex-compact 101969678 / 102783794 / -0.8% 119524432 / 120604773 / -0.9% 0.85 / 0.85 / +0.1%
statpopgen_q06/duckdb:vortex-compact 232479274 / 230727854 / +0.8% 251093224 / 251933220 / -0.3% 0.93 / 0.92 / +1.1%
statpopgen_q07/duckdb:vortex-compact 200828076 / 202248506 / -0.7% 215268864 / 217023447 / -0.8% 0.93 / 0.93 / +0.1%
statpopgen_q08/duckdb:vortex-compact 214284395 / 213605180 / +0.3% 227682654 / 225439389 / +1.0% 0.94 / 0.95 / -0.7%
statpopgen_q09/duckdb:vortex-compact 268697617 / 265519092 / +1.2% 326387251 / 320748835 / +1.8% 0.82 / 0.83 / -0.6%
statpopgen_q10/duckdb:vortex-compact 774656074 / 783851856 / -1.2% 868760036 / 816187004 / +6.4% 0.89 / 0.96 / -7.2%
duckdb / parquet / ns (1.026x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244553222 / 237906623 / +2.8% 245783321 / 236962365 / +3.7% 0.99 / 1.00 / -0.9%
statpopgen_q01/duckdb:parquet 304381342 / 295176810 / +3.1% 305912934 / 297537922 / +2.8% 0.99 / 0.99 / +0.3%
statpopgen_q02/duckdb:parquet 555105966 / 560108596 / -0.9% 542950379 / 552591288 / -1.7% 1.02 / 1.01 / +0.9%
statpopgen_q03/duckdb:parquet 803831398 / 719602282 / +11.7% 🔴 785255808 / 779097051 / +0.8% 1.02 / 0.92 / +10.8%
statpopgen_q04/duckdb:parquet 751628482 / 721315112 / +4.2% 808447499 / 781538651 / +3.4% 0.93 / 0.92 / +0.7%
statpopgen_q05/duckdb:parquet 533373270 / 528559778 / +0.9% 567967937 / 569874078 / -0.3% 0.94 / 0.93 / +1.2%
statpopgen_q06/duckdb:parquet 672262430 / 648634492 / +3.6% 678622646 / 694239854 / -2.2% 0.99 / 0.93 / +6.0%
statpopgen_q07/duckdb:parquet 558873808 / 558011002 / +0.2% 564505377 / 555394788 / +1.6% 0.99 / 1.00 / -1.5%
statpopgen_q08/duckdb:parquet 566644220 / 559123459 / +1.3% 565639904 / 556935059 / +1.6% 1.00 / 1.00 / -0.2%
statpopgen_q09/duckdb:parquet 746160356 / 727416976 / +2.6% 764293993 / 788416776 / -3.1% 0.98 / 0.92 / +5.8%
statpopgen_q10/duckdb:parquet 1023207248 / 1032123118 / -0.9% 1167177190 / 1102333892 / +5.9% 0.88 / 0.94 / -6.4%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 6dea3638 vs base 5605eab0


vortex / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/strings/amazon/book_reviews/fsst 554052068 / 554208135 / -0.0% 554063516 / 554031435 / +0.0% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-12 987334565 / 984278941 / +0.3% 987262927 / 984053276 / +0.3% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-16 999740627 / 996875230 / +0.3% 999517353 / 996273705 / +0.3% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_titles/fsst 57634112 / 57809498 / -0.3% 57644665 / 57873701 / -0.4% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_titles/onpair-12 89698590 / 89421408 / +0.3% 89727609 / 89407146 / +0.4% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_titles/onpair-16 92419750 / 92154436 / +0.3% 92430360 / 92271197 / +0.2% 1.00 / 1.00 / +0.1%
compress time/strings/clickbench/url/shard-0/fsst 426052996 / 426223586 / -0.0% 426014039 / 426332791 / -0.1% 1.00 / 1.00 / +0.0%
compress time/strings/clickbench/url/shard-0/onpair-12 602363668 / 603215687 / -0.1% 602556298 / 602965195 / -0.1% 1.00 / 1.00 / -0.1%
compress time/strings/clickbench/url/shard-0/onpair-16 607464633 / 610986917 / -0.6% 607224786 / 610926966 / -0.6% 1.00 / 1.00 / +0.0%
compress time/strings/fineweb/text/fsst 213348274 / 213073858 / +0.1% 213150329 / 212844256 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/fineweb/text/onpair-12 512605641 / 512062844 / +0.1% 512528232 / 512401240 / +0.0% 1.00 / 1.00 / +0.1%
compress time/strings/fineweb/text/onpair-16 527004753 / 523343763 / +0.7% 528018310 / 523811985 / +0.8% 1.00 / 1.00 / -0.1%
compress time/strings/news/headlines/fsst 332327188 / 332931533 / -0.2% 332169737 / 332905855 / -0.2% 1.00 / 1.00 / +0.0%
compress time/strings/news/headlines/onpair-12 470665114 / 469895386 / +0.2% 470790096 / 469981164 / +0.2% 1.00 / 1.00 / -0.0%
compress time/strings/news/headlines/onpair-16 481955523 / 481054119 / +0.2% 482227634 / 481211459 / +0.2% 1.00 / 1.00 / -0.0%
compress time/strings/tpch/l_comment/fsst 1058196639 / 1061432325 / -0.3% 1058188613 / 1061486068 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/tpch/l_comment/onpair-12 1033570236 / 1035474241 / -0.2% 1033680663 / 1035391107 / -0.2% 1.00 / 1.00 / -0.0%
compress time/strings/tpch/l_comment/onpair-16 1046464855 / 1048905151 / -0.2% 1045380030 / 1048830880 / -0.3% 1.00 / 1.00 / +0.1%
compress time/strings/twitter/sentiment140/fsst 554900753 / 555491680 / -0.1% 554611193 / 555456563 / -0.2% 1.00 / 1.00 / +0.0%
compress time/strings/twitter/sentiment140/onpair-12 954931433 / 951757615 / +0.3% 955071167 / 951563389 / +0.4% 1.00 / 1.00 / -0.0%
compress time/strings/twitter/sentiment140/onpair-16 1040084001 / 1038017616 / +0.2% 1039478068 / 1037793007 / +0.2% 1.00 / 1.00 / +0.0%
decompress time/strings/amazon/book_reviews/fsst 41444388 / 41490296 / -0.1% 41387805 / 41504020 / -0.3% 1.00 / 1.00 / +0.2%
decompress time/strings/amazon/book_reviews/onpair-12 30530322 / 30526269 / +0.0% 30529641 / 30555692 / -0.1% 1.00 / 1.00 / +0.1%
decompress time/strings/amazon/book_reviews/onpair-16 33962109 / 34110806 / -0.4% 34070686 / 33998561 / +0.2% 1.00 / 1.00 / -0.6%
decompress time/strings/amazon/book_titles/fsst 3426900 / 3433193 / -0.2% 3440780 / 3423625 / +0.5% 1.00 / 1.00 / -0.7%
decompress time/strings/amazon/book_titles/onpair-12 3153741 / 3150626 / +0.1% 3154457 / 3132747 / +0.7% 1.00 / 1.01 / -0.6%
decompress time/strings/amazon/book_titles/onpair-16 3022002 / 3016335 / +0.2% 3048943 / 3005166 / +1.5% 0.99 / 1.00 / -1.3%
decompress time/strings/clickbench/url/shard-0/fsst 31784206 / 31800846 / -0.1% 31830119 / 31810386 / +0.1% 1.00 / 1.00 / -0.1%
decompress time/strings/clickbench/url/shard-0/onpair-12 18923230 / 18801475 / +0.6% 18918090 / 18876354 / +0.2% 1.00 / 1.00 / +0.4%
decompress time/strings/clickbench/url/shard-0/onpair-16 18250132 / 18152461 / +0.5% 18276504 / 18173529 / +0.6% 1.00 / 1.00 / -0.0%
decompress time/strings/fineweb/text/fsst 10351195 / 10354438 / -0.0% 10354446 / 10331195 / +0.2% 1.00 / 1.00 / -0.3%
decompress time/strings/fineweb/text/onpair-12 9556779 / 9632302 / -0.8% 9444245 / 9449337 / -0.1% 1.01 / 1.02 / -0.7%
decompress time/strings/fineweb/text/onpair-16 8453295 / 8447815 / +0.1% 8481152 / 8463719 / +0.2% 1.00 / 1.00 / -0.1%
decompress time/strings/news/headlines/fsst 17733290 / 17708363 / +0.1% 17687950 / 17671541 / +0.1% 1.00 / 1.00 / +0.0%
decompress time/strings/news/headlines/onpair-12 17008332 / 16968279 / +0.2% 16973279 / 16917801 / +0.3% 1.00 / 1.00 / -0.1%
decompress time/strings/news/headlines/onpair-16 16051595 / 16024797 / +0.2% 16025241 / 16014760 / +0.1% 1.00 / 1.00 / +0.1%
decompress time/strings/tpch/l_comment/fsst 50677078 / 50720927 / -0.1% 50661217 / 50814970 / -0.3% 1.00 / 1.00 / +0.2%
decompress time/strings/tpch/l_comment/onpair-12 42627343 / 42796858 / -0.4% 42808261 / 42613369 / +0.5% 1.00 / 1.00 / -0.8%
decompress time/strings/tpch/l_comment/onpair-16 42454152 / 42385377 / +0.2% 42805239 / 42351676 / +1.1% 0.99 / 1.00 / -0.9%
decompress time/strings/twitter/sentiment140/fsst 36933968 / 36882967 / +0.1% 36969492 / 36796787 / +0.5% 1.00 / 1.00 / -0.3%
decompress time/strings/twitter/sentiment140/onpair-12 33780450 / 33806847 / -0.1% 33868561 / 33747897 / +0.4% 1.00 / 1.00 / -0.4%
decompress time/strings/twitter/sentiment140/onpair-16 33648854 / 33674713 / -0.1% 33741449 / 33624263 / +0.3% 1.00 / 1.00 / -0.4%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/strings/amazon/book_reviews/fsst 66249788 / 66249788 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-12 48618844 / 48618844 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-16 48243532 / 48243532 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/fsst 5434916 / 5434916 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-12 4765620 / 4765620 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-16 4892932 / 4892932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/fsst 49403932 / 49403932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-12 29634060 / 29634060 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-16 30002068 / 30002068 / +0.0%
vortex-file-compressed size/strings/fineweb/text/fsst 17098836 / 17098836 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-12 13554932 / 13554932 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-16 12265644 / 12265644 / +0.0%
vortex-file-compressed size/strings/news/headlines/fsst 30686308 / 30686308 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-12 26439252 / 26439252 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-16 26916196 / 26916196 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/fsst 75050292 / 75050292 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-12 57417388 / 57417388 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-16 57453556 / 57453556 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/fsst 63507044 / 63507044 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-12 54111996 / 54111996 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-16 56477060 / 56477060 / +0.0%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 6dea3638 vs base 5605eab0


vortex / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 456026924 / 472583812 / -3.5% 455221342 / 472730341 / -3.7% 1.00 / 1.00 / +0.2%
compress time/bimbo 2315474134 / 2346375032 / -1.3% 2306179936 / 2332276359 / -1.1% 1.00 / 1.01 / -0.2%
compress time/cmsprovider 1064779720 / 1067253945 / -0.2% 1052401409 / 1057597541 / -0.5% 1.01 / 1.01 / +0.3%
compress time/euro2016 177250578 / 177874909 / -0.4% 178244988 / 179406134 / -0.6% 0.99 / 0.99 / +0.3%
compress time/food 207384454 / 209543150 / -1.0% 207970364 / 210318897 / -1.1% 1.00 / 1.00 / +0.1%
compress time/hashtags 397227660 / 400261460 / -0.8% 393791158 / 394906611 / -0.3% 1.01 / 1.01 / -0.5%
compress time/sparse-wide-flat-runs 98852784 / 97918935 / +1.0% 100146736 / 98752614 / +1.4% 0.99 / 0.99 / -0.5%
compress time/sparse-wide-lists-runs 665220358 / 689995776 / -3.6% 671894824 / 664643307 / +1.1% 0.99 / 1.04 / -4.6%
compress time/sparse-wide-lists-shuffled 303988438 / 309676338 / -1.8% 297073580 / 299851048 / -0.9% 1.02 / 1.03 / -0.9%
compress time/sparse-wide-nested-child-nulls 620652593 / 627096075 / -1.0% 606033688 / 633941720 / -4.4% 1.02 / 0.99 / +3.5%
compress time/sparse-wide-nested-runs 614788818 / 649760938 / -5.4% 616717892 / 634373913 / -2.8% 1.00 / 1.02 / -2.7%
compress time/taxi 207143596 / 209007714 / -0.9% 207439224 / 211187156 / -1.8% 1.00 / 0.99 / +0.9%
compress time/tpc-h l_comment canonical 414083081 / 416406493 / -0.6% 413434484 / 416293281 / -0.7% 1.00 / 1.00 / +0.1%
compress time/tpc-h l_comment chunked 414986640 / 416844936 / -0.4% 413026892 / 416433960 / -0.8% 1.00 / 1.00 / +0.4%
compress time/wide table cols=100 chunks=1 rows=1000 5807690 / 5807301 / +0.0% 7544491 / 7634802 / -1.2% 0.77 / 0.76 / +1.2%
compress time/wide table cols=100 chunks=50 rows=1000 5802100 / 5799508 / +0.0% 7166188 / 7465034 / -4.0% 0.81 / 0.78 / +4.2%
compress time/wide table cols=1000 chunks=1 rows=1000 57092908 / 56433136 / +1.2% 59556450 / 60306710 / -1.2% 0.96 / 0.94 / +2.4%
compress time/wide table cols=1000 chunks=50 rows=1000 57002274 / 56816604 / +0.3% 58273874 / 60170080 / -3.2% 0.98 / 0.94 / +3.6%
compress time/wide table cols=10000 chunks=1 rows=1000 646974590 / 649220563 / -0.3% 650900668 / 644102836 / +1.1% 0.99 / 1.01 / -1.4%
compress time/wide table cols=10000 chunks=50 rows=1000 646713472 / 645720142 / +0.2% 646561963 / 653766948 / -1.1% 1.00 / 0.99 / +1.3%
decompress time/arade 14399196 / 14337380 / +0.4% 16009397 / 14949601 / +7.1% 0.90 / 0.96 / -6.2%
decompress time/bimbo 68788232 / 69199829 / -0.6% 74828104 / 75860372 / -1.4% 0.92 / 0.91 / +0.8%
decompress time/cmsprovider 38646454 / 39109712 / -1.2% 40616278 / 45392109 / -10.5% 🟢 0.95 / 0.86 / +10.4%
decompress time/euro2016 14606473 / 14593524 / +0.1% 15389571 / 15583756 / -1.2% 0.95 / 0.94 / +1.4%
decompress time/food 3856478 / 4170984 / -7.5% 5005426 / 4813089 / +4.0% 0.77 / 0.87 / -11.1%
decompress time/hashtags 41229958 / 40567270 / +1.6% 41526197 / 40337188 / +2.9% 0.99 / 1.01 / -1.3%
decompress time/sparse-wide-flat-runs 24501546 / 25285014 / -3.1% 24686555 / 24928944 / -1.0% 0.99 / 1.01 / -2.1%
decompress time/sparse-wide-lists-runs 15447560 / 15700392 / -1.6% 15428695 / 16033344 / -3.8% 1.00 / 0.98 / +2.2%
decompress time/sparse-wide-lists-shuffled 57402660 / 58286311 / -1.5% 58553383 / 59538684 / -1.7% 0.98 / 0.98 / +0.1%
decompress time/sparse-wide-nested-child-nulls 27774370 / 27700730 / +0.3% 27628580 / 28244731 / -2.2% 1.01 / 0.98 / +2.5%
decompress time/sparse-wide-nested-runs 27498096 / 27455181 / +0.2% 27538167 / 27876162 / -1.2% 1.00 / 0.98 / +1.4%
decompress time/taxi 10155267 / 10126653 / +0.3% 11650100 / 11626182 / +0.2% 0.87 / 0.87 / +0.1%
decompress time/tpc-h l_comment canonical 15162622 / 15093284 / +0.5% 15630277 / 15040245 / +3.9% 0.97 / 1.00 / -3.3%
decompress time/tpc-h l_comment chunked 15105074 / 15180938 / -0.5% 15371891 / 15291023 / +0.5% 0.98 / 0.99 / -1.0%
decompress time/wide table cols=100 chunks=1 rows=1000 1574590 / 1552122 / +1.4% 1676267 / 1635900 / +2.5% 0.94 / 0.95 / -1.0%
decompress time/wide table cols=100 chunks=50 rows=1000 1571874 / 1587338 / -1.0% 1642137 / 1669719 / -1.7% 0.96 / 0.95 / +0.7%
decompress time/wide table cols=1000 chunks=1 rows=1000 14238238 / 14021454 / +1.5% 14641586 / 14350485 / +2.0% 0.97 / 0.98 / -0.5%
decompress time/wide table cols=1000 chunks=50 rows=1000 14139022 / 14022472 / +0.8% 14555103 / 14383978 / +1.2% 0.97 / 0.97 / -0.4%
decompress time/wide table cols=10000 chunks=1 rows=1000 146627062 / 144084152 / +1.8% 148529583 / 145076726 / +2.4% 0.99 / 0.99 / -0.6%
decompress time/wide table cols=10000 chunks=50 rows=1000 146189338 / 144152802 / +1.4% 148304207 / 144794851 / +2.4% 0.99 / 1.00 / -1.0%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/arade 142213732 / 142213732 / +0.0%
vortex-file-compressed size/bimbo 458581076 / 458581076 / +0.0%
vortex-file-compressed size/cmsprovider 420808044 / 420808044 / +0.0%
vortex-file-compressed size/euro2016 164572116 / 164572116 / +0.0%
vortex-file-compressed size/food 38951000 / 38951000 / +0.0%
vortex-file-compressed size/hashtags 195463900 / 195463900 / +0.0%
vortex-file-compressed size/sparse-wide-flat-runs 6872768 / 6872768 / +0.0%
vortex-file-compressed size/sparse-wide-lists-runs 10900860 / 10900860 / +0.0%
vortex-file-compressed size/sparse-wide-lists-shuffled 13447164 / 13447164 / +0.0%
vortex-file-compressed size/sparse-wide-nested-child-nulls 11303724 / 11303724 / +0.0%
vortex-file-compressed size/sparse-wide-nested-runs 11504220 / 11504220 / +0.0%
vortex-file-compressed size/taxi 49997860 / 49997860 / +0.0%
vortex-file-compressed size/tpc-h l_comment canonical 178708640 / 178708640 / +0.0%
vortex-file-compressed size/tpc-h l_comment chunked 178708640 / 178708640 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934856 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934856 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9333656 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9333656 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93357656 / 93357656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93357656 / 93357656 / +0.0%
vortex / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 1156640987 / 1160602058 / -0.3% 1158664225 / 1177630354 / -1.6% 1.00 / 0.99 / +1.3%
compress time/bimbo 2162969208 / 2145448351 / +0.8% 2170054861 / 2153031767 / +0.8% 1.00 / 1.00 / +0.0%
compress time/cmsprovider 1675271684 / 1672739864 / +0.2% 1675342632 / 1684878052 / -0.6% 1.00 / 0.99 / +0.7%
compress time/euro2016 1001108228 / 1000243696 / +0.1% 1003127780 / 1008106342 / -0.5% 1.00 / 0.99 / +0.6%
compress time/food 409885608 / 407441482 / +0.6% 410639588 / 407225095 / +0.8% 1.00 / 1.00 / -0.2%
compress time/hashtags 539281660 / 540408402 / -0.2% 549324830 / 544083791 / +1.0% 0.98 / 0.99 / -1.2%
compress time/sparse-wide-flat-runs 41915970 / 41801251 / +0.3% 41380700 / 42174877 / -1.9% 1.01 / 0.99 / +2.2%
compress time/sparse-wide-lists-runs 81002256 / 84101607 / -3.7% 80682449 / 81262813 / -0.7% 1.00 / 1.03 / -3.0%
compress time/sparse-wide-lists-shuffled 155686388 / 156129742 / -0.3% 154058664 / 155420015 / -0.9% 1.01 / 1.00 / +0.6%
compress time/sparse-wide-nested-child-nulls 54779380 / 54397526 / +0.7% 54932573 / 54385928 / +1.0% 1.00 / 1.00 / -0.3%
compress time/sparse-wide-nested-runs 55150348 / 55387452 / -0.4% 56153413 / 56034186 / +0.2% 0.98 / 0.99 / -0.6%
compress time/taxi 241227844 / 240303149 / +0.4% 242864199 / 242862667 / +0.0% 0.99 / 0.99 / +0.4%
compress time/tpc-h l_comment canonical 1200493284 / 1201094550 / -0.1% 1201031413 / 1212738175 / -1.0% 1.00 / 0.99 / +0.9%
compress time/tpc-h l_comment chunked 1199659908 / 1201295312 / -0.1% 1206790210 / 1201117716 / +0.5% 0.99 / 1.00 / -0.6%
compress time/wide table cols=100 chunks=1 rows=1000 3794665 / 3775344 / +0.5% 4707722 / 4563750 / +3.2% 0.81 / 0.83 / -2.6%
compress time/wide table cols=100 chunks=50 rows=1000 3677702 / 3666632 / +0.3% 4651645 / 4587886 / +1.4% 0.79 / 0.80 / -1.1%
compress time/wide table cols=1000 chunks=1 rows=1000 37746724 / 37637157 / +0.3% 39571250 / 39178544 / +1.0% 0.95 / 0.96 / -0.7%
compress time/wide table cols=1000 chunks=50 rows=1000 37637457 / 37467670 / +0.5% 39824099 / 38984860 / +2.2% 0.95 / 0.96 / -1.7%
compress time/wide table cols=10000 chunks=1 rows=1000 378355079 / 380178456 / -0.5% 384758188 / 386178397 / -0.4% 0.98 / 0.98 / -0.1%
compress time/wide table cols=10000 chunks=50 rows=1000 374608296 / 375669458 / -0.3% 382534347 / 383881459 / -0.4% 0.98 / 0.98 / +0.1%
decompress time/arade 54677113 / 54672256 / +0.0% 54663666 / 55447260 / -1.4% 1.00 / 0.99 / +1.4%
decompress time/bimbo 92482502 / 92414214 / +0.1% 92642178 / 93130627 / -0.5% 1.00 / 0.99 / +0.6%
decompress time/cmsprovider 103421490 / 103393412 / +0.0% 103610744 / 104160016 / -0.5% 1.00 / 0.99 / +0.6%
decompress time/euro2016 159708774 / 159595874 / +0.1% 160023500 / 160534504 / -0.3% 1.00 / 0.99 / +0.4%
decompress time/food 26599929 / 26596412 / +0.0% 26838448 / 27381808 / -2.0% 0.99 / 0.97 / +2.0%
decompress time/hashtags 447523212 / 446365542 / +0.3% 447831920 / 447859372 / -0.0% 1.00 / 1.00 / +0.3%
decompress time/sparse-wide-flat-runs 15035370 / 15199106 / -1.1% 15507697 / 15840341 / -2.1% 0.97 / 0.96 / +1.0%
decompress time/sparse-wide-lists-runs 277217310 / 277111412 / +0.0% 277659953 / 277589034 / +0.0% 1.00 / 1.00 / +0.0%
decompress time/sparse-wide-lists-shuffled 318567850 / 319536152 / -0.3% 319293991 / 320174376 / -0.3% 1.00 / 1.00 / -0.0%
decompress time/sparse-wide-nested-child-nulls 53112782 / 53105144 / +0.0% 53524620 / 53620178 / -0.2% 0.99 / 0.99 / +0.2%
decompress time/sparse-wide-nested-runs 52646680 / 52944418 / -0.6% 52981859 / 53383135 / -0.8% 0.99 / 0.99 / +0.2%
decompress time/taxi 60597196 / 60680632 / -0.1% 60719036 / 61105874 / -0.6% 1.00 / 0.99 / +0.5%
decompress time/tpc-h l_comment canonical 82321788 / 82310163 / +0.0% 82772185 / 83086948 / -0.4% 0.99 / 0.99 / +0.4%
decompress time/tpc-h l_comment chunked 82026364 / 82296799 / -0.3% 82359516 / 83401798 / -1.2% 1.00 / 0.99 / +0.9%
decompress time/wide table cols=100 chunks=1 rows=1000 1929166 / 1967102 / -1.9% 2174280 / 2137761 / +1.7% 0.89 / 0.92 / -3.6%
decompress time/wide table cols=100 chunks=50 rows=1000 1939247 / 1945266 / -0.3% 2046951 / 2087712 / -2.0% 0.95 / 0.93 / +1.7%
decompress time/wide table cols=1000 chunks=1 rows=1000 22489706 / 22621567 / -0.6% 23245320 / 23456521 / -0.9% 0.97 / 0.96 / +0.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 22407496 / 22612284 / -0.9% 23122943 / 23220969 / -0.4% 0.97 / 0.97 / -0.5%
decompress time/wide table cols=10000 chunks=1 rows=1000 232808104 / 233325234 / -0.2% 235226516 / 237081094 / -0.8% 0.99 / 0.98 / +0.6%
decompress time/wide table cols=10000 chunks=50 rows=1000 230910801 / 232821326 / -0.8% 232292814 / 235197208 / -1.2% 0.99 / 0.99 / +0.4%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/arade 210020851 / 210020851 / +0.0%
parquet size/bimbo 376187078 / 376187078 / +0.0%
parquet size/cmsprovider 364268159 / 364268159 / +0.0%
parquet size/euro2016 111035158 / 111035158 / +0.0%
parquet size/food 34903783 / 34903783 / +0.0%
parquet size/hashtags 126189203 / 126189203 / +0.0%
parquet size/sparse-wide-flat-runs 1388944 / 1388944 / +0.0%
parquet size/sparse-wide-lists-runs 4327813 / 4327813 / +0.0%
parquet size/sparse-wide-lists-shuffled 5710569 / 5710569 / +0.0%
parquet size/sparse-wide-nested-child-nulls 1266042 / 1266042 / +0.0%
parquet size/sparse-wide-nested-runs 1388944 / 1388944 / +0.0%
parquet size/taxi 52142534 / 52142534 / +0.0%
parquet size/tpc-h l_comment canonical 153403836 / 153403836 / +0.0%
parquet size/tpc-h l_comment chunked 153403836 / 153403836 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 94974934 / 96289152 / -1.4% 120980507 / 121427481 / -0.4% 0.79 / 0.79 / -1.0%
compress time/bimbo 599167738 / 602045335 / -0.5% 663947963 / 664929240 / -0.1% 0.90 / 0.91 / -0.3%
compress time/cmsprovider 376671011 / 379303887 / -0.7% 438597685 / 443820769 / -1.2% 0.86 / 0.85 / +0.5%
compress time/euro2016 38088988 / 38225800 / -0.4% 51948111 / 52544791 / -1.1% 0.73 / 0.73 / +0.8%
compress time/food 39937396 / 39948705 / -0.0% 53462978 / 54255997 / -1.5% 0.75 / 0.74 / +1.5%
compress time/hashtags 77590898 / 78077954 / -0.6% 105828945 / 106852504 / -1.0% 0.73 / 0.73 / +0.3%
compress time/sparse-wide-flat-runs 27826548 / 28071043 / -0.9% 36583892 / 37256009 / -1.8% 0.76 / 0.75 / +1.0%
compress time/sparse-wide-lists-runs 44445788 / 44567626 / -0.3% 51262718 / 51529487 / -0.5% 0.87 / 0.86 / +0.2%
compress time/sparse-wide-lists-shuffled 45799967 / 46435427 / -1.4% 49284280 / 49971781 / -1.4% 0.93 / 0.93 / +0.0%
compress time/sparse-wide-nested-child-nulls 39860663 / 40277348 / -1.0% 49390053 / 50314423 / -1.8% 0.81 / 0.80 / +0.8%
compress time/sparse-wide-nested-runs 40596946 / 40360562 / +0.6% 50029670 / 50226300 / -0.4% 0.81 / 0.80 / +1.0%
compress time/taxi 59025820 / 59089205 / -0.1% 75057818 / 75769074 / -0.9% 0.79 / 0.78 / +0.8%
compress time/tpc-h l_comment canonical 127257370 / 127611235 / -0.3% 163255585 / 163759995 / -0.3% 0.78 / 0.78 / +0.0%
compress time/tpc-h l_comment chunked 127243153 / 127439358 / -0.2% 162917174 / 164074036 / -0.7% 0.78 / 0.78 / +0.6%
compress time/wide table cols=100 chunks=1 rows=1000 193600.5 / 194981 / -0.7% 416709 / 596489 / -30.1% 🟢 0.46 / 0.33 / +42.1%
compress time/wide table cols=100 chunks=50 rows=1000 197176.5 / 199145 / -1.0% 374726 / 622475 / -39.8% 🟢 0.53 / 0.32 / +64.5%
compress time/wide table cols=1000 chunks=1 rows=1000 2332339 / 2367494 / -1.5% 2816454 / 3214868 / -12.4% 🟢 0.83 / 0.74 / +12.5%
compress time/wide table cols=1000 chunks=50 rows=1000 2306320 / 2335672 / -1.3% 2773653 / 3067877 / -9.6% 0.83 / 0.76 / +9.2%
compress time/wide table cols=10000 chunks=1 rows=1000 24837257 / 25278210 / -1.7% 31067437 / 31502985 / -1.4% 0.80 / 0.80 / -0.4%
compress time/wide table cols=10000 chunks=50 rows=1000 25027246 / 25150386 / -0.5% 31093364 / 31520539 / -1.4% 0.80 / 0.80 / +0.9%
decompress time/arade 210731702 / 220158973 / -4.3% 210953510 / 220258558 / -4.2% 1.00 / 1.00 / -0.1%
decompress time/bimbo 413863214 / 427426612 / -3.2% 409620510 / 428535719 / -4.4% 1.01 / 1.00 / +1.3%
decompress time/cmsprovider 672142502 / 704120454 / -4.5% 673489708 / 704886806 / -4.5% 1.00 / 1.00 / -0.1%
decompress time/euro2016 83330348 / 86170265 / -3.3% 83626846 / 86462962 / -3.3% 1.00 / 1.00 / -0.0%
decompress time/food 65612002 / 65691646 / -0.1% 65666939 / 65800608 / -0.2% 1.00 / 1.00 / +0.1%
decompress time/hashtags 159452685 / 166259577 / -4.1% 160015232 / 166977106 / -4.2% 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-flat-runs 18781530 / 19424778 / -3.3% 19910749 / 20868213 / -4.6% 0.94 / 0.93 / +1.3%
decompress time/sparse-wide-lists-runs 81155776 / 81775014 / -0.8% 81512068 / 82035269 / -0.6% 1.00 / 1.00 / -0.1%
decompress time/sparse-wide-lists-shuffled 81574976 / 81993598 / -0.5% 81697923 / 82171959 / -0.6% 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-nested-child-nulls 26484528 / 27442980 / -3.5% 27008788 / 28711924 / -5.9% 0.98 / 0.96 / +2.6%
decompress time/sparse-wide-nested-runs 26546408 / 27321244 / -2.8% 27756415 / 28670169 / -3.2% 0.96 / 0.95 / +0.4%
decompress time/taxi 50559747 / 51133572 / -1.1% 50737650 / 51555148 / -1.6% 1.00 / 0.99 / +0.5%
decompress time/tpc-h l_comment canonical 191697698 / 190718842 / +0.5% 191858003 / 190935614 / +0.5% 1.00 / 1.00 / +0.0%
decompress time/tpc-h l_comment chunked 191303653 / 190680197 / +0.3% 191511502 / 190719076 / +0.4% 1.00 / 1.00 / -0.1%
decompress time/wide table cols=100 chunks=1 rows=1000 318793 / 321820.5 / -0.9% 352196 / 337737 / +4.3% 0.91 / 0.95 / -5.0%
decompress time/wide table cols=100 chunks=50 rows=1000 323879 / 318735.5 / +1.6% 342934 / 338025 / +1.5% 0.94 / 0.94 / +0.2%
decompress time/wide table cols=1000 chunks=1 rows=1000 3684192 / 3769630 / -2.3% 3674202 / 3809740 / -3.6% 1.00 / 0.99 / +1.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 3794688 / 3732395 / +1.7% 3794670 / 3759039 / +0.9% 1.00 / 0.99 / +0.7%
decompress time/wide table cols=10000 chunks=1 rows=1000 36250270 / 36162666 / +0.2% 36979677 / 36745426 / +0.6% 0.98 / 0.98 / -0.4%
decompress time/wide table cols=10000 chunks=50 rows=1000 36154064 / 35405440 / +2.1% 36562521 / 35603215 / +2.7% 0.99 / 0.99 / -0.6%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/arade 680639722 / 680639722 / +0.0%
arrow-ipc size/bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/cmsprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/food 252069442 / 252069442 / +0.0%
arrow-ipc size/hashtags 700364562 / 700364562 / +0.0%
arrow-ipc size/sparse-wide-flat-runs 245220370 / 245220370 / +0.0%
arrow-ipc size/sparse-wide-lists-runs 142046306 / 142046306 / +0.0%
arrow-ipc size/sparse-wide-lists-shuffled 142870882 / 142870882 / +0.0%
arrow-ipc size/sparse-wide-nested-child-nulls 251527506 / 251527506 / +0.0%
arrow-ipc size/sparse-wide-nested-runs 251527122 / 251527122 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/tpc-h l_comment canonical 1021072290 / 1021072290 / +0.0%
arrow-ipc size/tpc-h l_comment chunked 1021072290 / 1021072290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@codspeed

codspeed Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 22.33%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 1 improved benchmark
✅ 1766 untouched benchmarks
⏩ 130 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ CPU Simulation missing_stats[16] 92.1 µs 75.3 µs +22.33%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/sleepy-clarke-5utr8u (f92da47) with develop (8d9e027)

Open in CodSpeed

Footnotes

  1. 130 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.8%
Engines: random-access No clear signal (+8.8%, environment too noisy confidence)
Vortex (geomean): hot 1.183x ➖ · cold 1.167x ➖
Parquet (geomean): hot 1.088x ➖ · cold 1.177x ➖
Shifts: Parquet (control) +8.8% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.183x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/vortex-cached 110759 / 112901 / -1.9% 112851 / 111185 / +1.5% 0.98 / 1.02 / -3.3%
random-access/feature-vectors-s3/correlated/vortex-reopen 156253135 / 137508280 / +13.6% 294681702 / 280420856 / +5.1% 0.53 / 0.49 / +8.1%
random-access/feature-vectors-s3/uniform/vortex-cached 67959967 / 78809932 / -13.8% 243014284 / 73087503 / +232.5% 🔴 0.28 / 1.08 / -74.1%
random-access/feature-vectors-s3/uniform/vortex-reopen 303772914 / 172043205 / +76.6% 🔴 460266636 / 401339440 / +14.7% 0.66 / 0.43 / +54.0%
random-access/nested-lists-s3/correlated/vortex-cached 95763 / 98525 / -2.8% 95538 / 100766 / -5.2% 1.00 / 0.98 / +2.5%
random-access/nested-lists-s3/correlated/vortex-reopen 427906013 / 91974473 / +365.2% 🔴 375595301 / 223723310 / +67.9% 🔴 1.14 / 0.41 / +177.1%
random-access/nested-lists-s3/uniform/vortex-cached 45012408 / 41848898 / +7.6% 42234928 / 36602704 / +15.4% 1.07 / 1.14 / -6.8%
random-access/nested-lists-s3/uniform/vortex-reopen 137860678 / 150721679 / -8.5% 402389025 / 186197634 / +116.1% 🔴 0.34 / 0.81 / -57.7%
random-access/nested-structs-s3/correlated/vortex-cached 125664 / 128574 / -2.3% 124605 / 128273 / -2.9% 1.01 / 1.00 / +0.6%
random-access/nested-structs-s3/correlated/vortex-reopen 155988176 / 97963097 / +59.2% 🔴 185740781 / 157175385 / +18.2% 0.84 / 0.62 / +34.7%
random-access/nested-structs-s3/uniform/vortex-cached 286910 / 303300 / -5.4% 287348 / 296174 / -3.0% 1.00 / 1.02 / -2.5%
random-access/nested-structs-s3/uniform/vortex-reopen 131897926 / 101278755 / +30.2% 🔴 153413426 / 145609232 / +5.4% 0.86 / 0.70 / +23.6%
random-access/taxi-s3/correlated/vortex-cached 327590 / 333192 / -1.7% 326109 / 331113 / -1.5% 1.00 / 1.01 / -0.2%
random-access/taxi-s3/correlated/vortex-reopen 155326261 / 142647364 / +8.9% 145330373 / 169895085 / -14.5% 1.07 / 0.84 / +27.3%
random-access/taxi-s3/uniform/vortex-cached 1488708 / 1495027 / -0.4% 1491144 / 1496239 / -0.3% 1.00 / 1.00 / -0.1%
random-access/taxi-s3/uniform/vortex-reopen 188771710 / 165951704 / +13.8% 275315440 / 265742124 / +3.6% 0.69 / 0.62 / +9.8%
random-access/taxi-s3/vortex-cached 270800 / 273273 / -0.9% 276659 / 270824 / +2.2% 0.98 / 1.01 / -3.0%
random-access/taxi-s3/vortex-reopen 148485302 / 125291255 / +18.5% 147039344 / 154431177 / -4.8% 1.01 / 0.81 / +24.5%
random-access / parquet / ns (1.088x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/parquet-cached 53322729 / 55499318 / -3.9% 58828889 / 65717478 / -10.5% 0.91 / 0.84 / +7.3%
random-access/feature-vectors-s3/correlated/parquet-reopen 150934501 / 136427711 / +10.6% 152486641 / 156460676 / -2.5% 0.99 / 0.87 / +13.5%
random-access/feature-vectors-s3/uniform/parquet-cached 638807157 / 564047377 / +13.3% 1268112464 / 949277235 / +33.6% 🔴 0.50 / 0.59 / -15.2%
random-access/feature-vectors-s3/uniform/parquet-reopen 672448642 / 630964243 / +6.6% 724630376 / 696878456 / +4.0% 0.93 / 0.91 / +2.5%
random-access/nested-lists-s3/correlated/parquet-cached 52432680 / 43449989 / +20.7% 53956700 / 47144796 / +14.4% 0.97 / 0.92 / +5.4%
random-access/nested-lists-s3/correlated/parquet-reopen 261807425 / 142652225 / +83.5% 🔴 323479071 / 167724007 / +92.9% 🔴 0.81 / 0.85 / -4.8%
random-access/nested-lists-s3/uniform/parquet-cached 195540565 / 179036056 / +9.2% 244604634 / 371811885 / -34.2% 🟢 0.80 / 0.48 / +66.0%
random-access/nested-lists-s3/uniform/parquet-reopen 278910308 / 253791273 / +9.9% 339152204 / 293504426 / +15.6% 0.82 / 0.86 / -4.9%
random-access/nested-structs-s3/correlated/parquet-cached 62052451 / 62987525 / -1.5% 64181785 / 77249286 / -16.9% 0.97 / 0.82 / +18.6%
random-access/nested-structs-s3/correlated/parquet-reopen 164345876 / 134819350 / +21.9% 407196472 / 181332765 / +124.6% 🔴 0.40 / 0.74 / -45.7%
random-access/nested-structs-s3/uniform/parquet-cached 444785046 / 445791064 / -0.2% 445140892 / 446528073 / -0.3% 1.00 / 1.00 / +0.1%
random-access/nested-structs-s3/uniform/parquet-reopen 530355360 / 521671916 / +1.7% 524406868 / 527294415 / -0.5% 1.01 / 0.99 / +2.2%
random-access/taxi-s3/correlated/parquet-cached 203001028 / 201481614 / +0.8% 200851340 / 199872960 / +0.5% 1.01 / 1.01 / +0.3%
random-access/taxi-s3/correlated/parquet-reopen 287821597 / 255145306 / +12.8% 642238732 / 255108019 / +151.8% 🔴 0.45 / 1.00 / -55.2%
random-access/taxi-s3/parquet-cached 199571712 / 195368076 / +2.2% 195759049 / 198105022 / -1.2% 1.02 / 0.99 / +3.4%
random-access/taxi-s3/parquet-reopen 266231906 / 260888874 / +2.0% 498930865 / 262036835 / +90.4% 🔴 0.53 / 1.00 / -46.4%
random-access/taxi-s3/uniform/parquet-cached 227161399 / 219696373 / +3.4% 222315810 / 233240349 / -4.7% 1.02 / 0.94 / +8.5%
random-access/taxi-s3/uniform/parquet-reopen 276610669 / 310641952 / -11.0% 287163495 / 261961962 / +9.6% 0.96 / 1.19 / -18.8%
random-access / lance / ns (1.051x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/lance-cached 44386943 / 37463130 / +18.5% 31838780 / 31241482 / +1.9% 1.39 / 1.20 / +16.3%
random-access/feature-vectors-s3/correlated/lance-reopen 227237096 / 199317599 / +14.0% 202355246 / 182808234 / +10.7% 1.12 / 1.09 / +3.0%
random-access/feature-vectors-s3/uniform/lance-cached 73449175 / 101389946 / -27.6% 68003772 / 98088004 / -30.7% 🟢 1.08 / 1.03 / +4.5%
random-access/feature-vectors-s3/uniform/lance-reopen 254576088 / 231976205 / +9.7% 258591078 / 228744269 / +13.0% 0.98 / 1.01 / -2.9%
random-access/nested-lists-s3/correlated/lance-cached 35784621 / 33228397 / +7.7% 35917902 / 30730870 / +16.9% 1.00 / 1.08 / -7.9%
random-access/nested-lists-s3/correlated/lance-reopen 249820230 / 241250194 / +3.6% 357387024 / 328716910 / +8.7% 0.70 / 0.73 / -4.8%
random-access/nested-lists-s3/uniform/lance-cached 71451433 / 79228465 / -9.8% 58506680 / 65879140 / -11.2% 1.22 / 1.20 / +1.5%
random-access/nested-lists-s3/uniform/lance-reopen 296262598 / 288526576 / +2.7% 264003661 / 291009613 / -9.3% 1.12 / 0.99 / +13.2%
random-access/nested-structs-s3/correlated/lance-cached 76062695 / 40933728 / +85.8% 🔴 83555226 / 38638439 / +116.2% 🔴 0.91 / 1.06 / -14.1%
random-access/nested-structs-s3/correlated/lance-reopen 261370582 / 230466714 / +13.4% 317670159 / 262674514 / +20.9% 0.82 / 0.88 / -6.2%
random-access/nested-structs-s3/uniform/lance-cached 118566762 / 109520591 / +8.3% 100370155 / 94593802 / +6.1% 1.18 / 1.16 / +2.0%
random-access/nested-structs-s3/uniform/lance-reopen 297289522 / 297217138 / +0.0% 394483114 / 318231336 / +24.0% 0.75 / 0.93 / -19.3%
random-access/taxi-s3/correlated/lance-cached 64048439 / 63140128 / +1.4% 81444691 / 73677258 / +10.5% 0.79 / 0.86 / -8.2%
random-access/taxi-s3/correlated/lance-reopen 323488607 / 281500060 / +14.9% 269918313 / 265151647 / +1.8% 1.20 / 1.06 / +12.9%
random-access/taxi-s3/lance-cached 51950844 / 50507239 / +2.9% 89089521 / 62276942 / +43.1% 🔴 0.58 / 0.81 / -28.1%
random-access/taxi-s3/lance-reopen 270820448 / 285343132 / -5.1% 289105296 / 283260622 / +2.1% 0.94 / 1.01 / -7.0%
random-access/taxi-s3/uniform/lance-cached 242920708 / 291193800 / -16.6% 238034666 / 420222673 / -43.4% 🟢 1.02 / 0.69 / +47.3%
random-access/taxi-s3/uniform/lance-reopen 456768060 / 444518052 / +2.8% 403202931 / 484048659 / -16.7% 1.13 / 0.92 / +23.4%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-2.8%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 1.150x ❌
Parquet (geomean): hot 1.006x ➖ · cold 1.049x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.979x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 185043231 / 183239754 / +1.0% 530313286 / 512729435 / +3.4% 0.35 / 0.36 / -2.4%
vortex_q01/datafusion:vortex-file-compressed 128993524 / 131437579 / -1.9% 287119003 / 292176121 / -1.7% 0.45 / 0.45 / -0.1%
vortex_q02/datafusion:vortex-file-compressed 329126509 / 347845384 / -5.4% 289211975 / 292790853 / -1.2% 1.14 / 1.19 / -4.2%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 135682766 / 135090677 / +0.4% 1160677591 / 1161157500 / -0.0% 0.12 / 0.12 / +0.5%
vortex_q01/datafusion:parquet 70907763 / 69261519 / +2.4% 121606469 / 103669720 / +17.3% 🔴 0.58 / 0.67 / -12.7%
vortex_q02/datafusion:parquet 291610914 / 293559499 / -0.7% 680441209 / 652366088 / +4.3% 0.43 / 0.45 / -4.8%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 197591322 / 196364687 / +0.6% 905133817 / 707751964 / +27.9% 🔴 0.22 / 0.28 / -21.3%
vortex_q01/duckdb:vortex-file-compressed 92307014 / 92847584 / -0.6% 327040578 / 248500137 / +31.6% 🔴 0.28 / 0.37 / -24.5%
vortex_q02/duckdb:vortex-file-compressed 188634223 / 187818943 / +0.4% 495111148 / 362252105 / +36.7% 🔴 0.38 / 0.52 / -26.5%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 279503066 / 278948581 / +0.2% 819267139 / 808703092 / +1.3% 0.34 / 0.34 / -1.1%
vortex_q01/duckdb:parquet 164193999 / 162705511 / +0.9% 175049857 / 170059015 / +2.9% 0.94 / 0.96 / -2.0%
vortex_q02/duckdb:parquet 345151635 / 343764296 / +0.4% 608502272 / 582357094 / +4.5% 0.57 / 0.59 / -3.9%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +18.2%
Engines: DataFusion No clear signal (+30.5%, environment too noisy confidence) · DuckDB No clear signal (+7.0%, environment too noisy confidence)
Vortex (geomean): hot 1.168x ➖ · cold 1.143x ➖
Parquet (geomean): hot 0.988x ➖ · cold 0.978x ➖
Shifts: Parquet (control) -1.2% · Median polish +6.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.286x ➖, 1↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 369726173 / 465777932 / -20.6% 979242995 / 1113098737 / -12.0% 0.38 / 0.42 / -9.8%
tpch_q02/datafusion:vortex-file-compressed 3098209422 / 501936913 / +517.3% 🔴 1378490464 / 1080247800 / +27.6% 2.25 / 0.46 / +383.7%
tpch_q03/datafusion:vortex-file-compressed 652106476 / 526269381 / +23.9% 2155984694 / 1371169661 / +57.2% 🔴 0.30 / 0.38 / -21.2%
tpch_q04/datafusion:vortex-file-compressed 557390527 / 557507986 / -0.0% 779613031 / 789608312 / -1.3% 0.71 / 0.71 / +1.3%
tpch_q05/datafusion:vortex-file-compressed 1441620071 / 757277821 / +90.4% 🔴 1463488014 / 1034996100 / +41.4% 🔴 0.99 / 0.73 / +34.6%
tpch_q06/datafusion:vortex-file-compressed 534864434 / 248462382 / +115.3% 🔴 702436994 / 409545265 / +71.5% 🔴 0.76 / 0.61 / +25.5%
tpch_q07/datafusion:vortex-file-compressed 1552114525 / 651320561 / +138.3% 🔴 2656006727 / 918775772 / +189.1% 🔴 0.58 / 0.71 / -17.6%
tpch_q08/datafusion:vortex-file-compressed 1228822129 / 889677804 / +38.1% 🔴 1370628927 / 1315658980 / +4.2% 0.90 / 0.68 / +32.6%
tpch_q09/datafusion:vortex-file-compressed 763037988 / 729687405 / +4.6% 1172120865 / 1149185126 / +2.0% 0.65 / 0.63 / +2.5%
tpch_q10/datafusion:vortex-file-compressed 687726734 / 601482729 / +14.3% 1078567649 / 981208829 / +9.9% 0.64 / 0.61 / +4.0%
tpch_q11/datafusion:vortex-file-compressed 567458796 / 361478488 / +57.0% 🔴 815595038 / 762038080 / +7.0% 0.70 / 0.47 / +46.7%
tpch_q12/datafusion:vortex-file-compressed 478874252 / 364063698 / +31.5% 🔴 820954101 / 537110598 / +52.8% 🔴 0.58 / 0.68 / -13.9%
tpch_q13/datafusion:vortex-file-compressed 366465271 / 346851189 / +5.7% 542550909 / 648326347 / -16.3% 0.68 / 0.53 / +26.3%
tpch_q14/datafusion:vortex-file-compressed 419998908 / 420908212 / -0.2% 582048997 / 616208287 / -5.5% 0.72 / 0.68 / +5.6%
tpch_q15/datafusion:vortex-file-compressed 1153941296 / 534324979 / +116.0% 🔴 1205820231 / 933777569 / +29.1% 0.96 / 0.57 / +67.2%
tpch_q16/datafusion:vortex-file-compressed 243955425 / 325278092 / -25.0% 462792202 / 591799254 / -21.8% 0.53 / 0.55 / -4.1%
tpch_q17/datafusion:vortex-file-compressed 625500049 / 928952283 / -32.7% 🟢 968518951 / 1038918623 / -6.8% 0.65 / 0.89 / -27.8%
tpch_q18/datafusion:vortex-file-compressed 768992779 / 989045515 / -22.2% 865299857 / 1373903299 / -37.0% 🟢 0.89 / 0.72 / +23.5%
tpch_q19/datafusion:vortex-file-compressed 520012901 / 399724732 / +30.1% 🔴 848783318 / 673866350 / +26.0% 0.61 / 0.59 / +3.3%
tpch_q20/datafusion:vortex-file-compressed 865559203 / 714845112 / +21.1% 1093394817 / 872440040 / +25.3% 0.79 / 0.82 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 1042852478 / 1086873343 / -4.1% 1237458738 / 1337823626 / -7.5% 0.84 / 0.81 / +3.7%
tpch_q22/datafusion:vortex-file-compressed 382925232 / 409865481 / -6.6% 825202042 / 809618646 / +1.9% 0.46 / 0.51 / -8.3%
datafusion / vortex-compact / ns (1.243x ➖, 1↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 329861079 / 524349887 / -37.1% 🟢 934756698 / 1013929505 / -7.8% 0.35 / 0.52 / -31.8%
tpch_q02/datafusion:vortex-compact 574736332 / 474243798 / +21.2% 1179356247 / 1071623826 / +10.1% 0.49 / 0.44 / +10.1%
tpch_q03/datafusion:vortex-compact 628567837 / 506714962 / +24.0% 1306917462 / 1400305966 / -6.7% 0.48 / 0.36 / +32.9%
tpch_q04/datafusion:vortex-compact 371999400 / 425439462 / -12.6% 836789017 / 651047609 / +28.5% 0.44 / 0.65 / -32.0%
tpch_q05/datafusion:vortex-compact 803229395 / 687313739 / +16.9% 1143121856 / 1168003476 / -2.1% 0.70 / 0.59 / +19.4%
tpch_q06/datafusion:vortex-compact 625886117 / 246044298 / +154.4% 🔴 849810956 / 423961488 / +100.4% 🔴 0.74 / 0.58 / +26.9%
tpch_q07/datafusion:vortex-compact 828009059 / 602452347 / +37.4% 🔴 994199987 / 797968627 / +24.6% 0.83 / 0.75 / +10.3%
tpch_q08/datafusion:vortex-compact 1589791507 / 888303946 / +79.0% 🔴 2020819099 / 1245583134 / +62.2% 🔴 0.79 / 0.71 / +10.3%
tpch_q09/datafusion:vortex-compact 1039068501 / 802288260 / +29.5% 1584102093 / 1077150266 / +47.1% 🔴 0.66 / 0.74 / -11.9%
tpch_q10/datafusion:vortex-compact 837582273 / 533141017 / +57.1% 🔴 1133231385 / 864892606 / +31.0% 🔴 0.74 / 0.62 / +19.9%
tpch_q11/datafusion:vortex-compact 436787237 / 324766980 / +34.5% 🔴 889339168 / 612631390 / +45.2% 🔴 0.49 / 0.53 / -7.4%
tpch_q12/datafusion:vortex-compact 563055570 / 691349074 / -18.6% 867849227 / 654386521 / +32.6% 🔴 0.65 / 1.06 / -38.6%
tpch_q13/datafusion:vortex-compact 597956506 / 305921838 / +95.5% 🔴 1144710760 / 494103321 / +131.7% 🔴 0.52 / 0.62 / -15.6%
tpch_q14/datafusion:vortex-compact 358760197 / 320600591 / +11.9% 647952225 / 572177990 / +13.2% 0.55 / 0.56 / -1.2%
tpch_q15/datafusion:vortex-compact 787241906 / 497661251 / +58.2% 🔴 1160226575 / 940775235 / +23.3% 0.68 / 0.53 / +28.3%
tpch_q16/datafusion:vortex-compact 430171483 / 273235748 / +57.4% 🔴 510533664 / 474591991 / +7.6% 0.84 / 0.58 / +46.4%
tpch_q17/datafusion:vortex-compact 665624619 / 791477724 / -15.9% 937645461 / 674151746 / +39.1% 🔴 0.71 / 1.17 / -39.5%
tpch_q18/datafusion:vortex-compact 953254860 / 736824754 / +29.4% 1068284446 / 1018495162 / +4.9% 0.89 / 0.72 / +23.3%
tpch_q19/datafusion:vortex-compact 474266450 / 414888599 / +14.3% 664762770 / 537492235 / +23.7% 0.71 / 0.77 / -7.6%
tpch_q20/datafusion:vortex-compact 736230333 / 514435304 / +43.1% 🔴 885384062 / 762235784 / +16.2% 0.83 / 0.67 / +23.2%
tpch_q21/datafusion:vortex-compact 969576177 / 1102497123 / -12.1% 1096897334 / 1098796522 / -0.2% 0.88 / 1.00 / -11.9%
tpch_q22/datafusion:vortex-compact 315303823 / 302774641 / +4.1% 1136269331 / 663066545 / +71.4% 🔴 0.28 / 0.46 / -39.2%
datafusion / parquet / ns (0.969x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 218498653 / 245884641 / -11.1% 688483868 / 591779928 / +16.3% 0.32 / 0.42 / -23.6%
tpch_q02/datafusion:parquet 455248441 / 474919724 / -4.1% 1005794807 / 1011834168 / -0.6% 0.45 / 0.47 / -3.6%
tpch_q03/datafusion:parquet 493777988 / 663410142 / -25.6% 1120946413 / 1043130037 / +7.5% 0.44 / 0.64 / -30.7%
tpch_q04/datafusion:parquet 379182770 / 358047716 / +5.9% 512469599 / 495580963 / +3.4% 0.74 / 0.72 / +2.4%
tpch_q05/datafusion:parquet 602017773 / 652361153 / -7.7% 747643763 / 1243999221 / -39.9% 🟢 0.81 / 0.52 / +53.5%
tpch_q06/datafusion:parquet 184147126 / 335647876 / -45.1% 🟢 305262338 / 582289174 / -47.6% 🟢 0.60 / 0.58 / +4.7%
tpch_q07/datafusion:parquet 594939873 / 747857896 / -20.4% 771529592 / 868753731 / -11.2% 0.77 / 0.86 / -10.4%
tpch_q08/datafusion:parquet 756341174 / 1031724434 / -26.7% 945364968 / 1956486787 / -51.7% 🟢 0.80 / 0.53 / +51.7%
tpch_q09/datafusion:parquet 1053491489 / 924714194 / +13.9% 1337427741 / 1254372924 / +6.6% 0.79 / 0.74 / +6.9%
tpch_q10/datafusion:parquet 1088573622 / 1243136555 / -12.4% 1302330509 / 1544598449 / -15.7% 0.84 / 0.80 / +3.9%
tpch_q11/datafusion:parquet 379621594 / 363131870 / +4.5% 566951669 / 730533692 / -22.4% 0.67 / 0.50 / +34.7%
tpch_q12/datafusion:parquet 376878224 / 387393560 / -2.7% 517377463 / 522109964 / -0.9% 0.73 / 0.74 / -1.8%
tpch_q13/datafusion:parquet 410874950 / 408618699 / +0.6% 691318313 / 669499506 / +3.3% 0.59 / 0.61 / -2.6%
tpch_q14/datafusion:parquet 397376995 / 408983955 / -2.8% 715241388 / 708172067 / +1.0% 0.56 / 0.58 / -3.8%
tpch_q15/datafusion:parquet 564983973 / 486720956 / +16.1% 852906607 / 789978137 / +8.0% 0.66 / 0.62 / +7.5%
tpch_q16/datafusion:parquet 208350195 / 222900175 / -6.5% 495994806 / 463491953 / +7.0% 0.42 / 0.48 / -12.7%
tpch_q17/datafusion:parquet 796344732 / 706722372 / +12.7% 830535982 / 926814727 / -10.4% 0.96 / 0.76 / +25.7%
tpch_q18/datafusion:parquet 568341832 / 590536343 / -3.8% 1055399676 / 779411596 / +35.4% 🔴 0.54 / 0.76 / -28.9%
tpch_q19/datafusion:parquet 471782236 / 454321025 / +3.8% 629077757 / 496842766 / +26.6% 0.75 / 0.91 / -18.0%
tpch_q20/datafusion:parquet 1121453627 / 729059724 / +53.8% 🔴 1315192283 / 953633956 / +37.9% 🔴 0.85 / 0.76 / +11.5%
tpch_q21/datafusion:parquet 1145465684 / 912308176 / +25.6% 1167526066 / 963467182 / +21.2% 0.98 / 0.95 / +3.6%
tpch_q22/datafusion:parquet 465689469 / 432137728 / +7.8% 821518010 / 736280141 / +11.6% 0.57 / 0.59 / -3.4%
duckdb / vortex-file-compressed / ns (1.048x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1052156476 / 961493383 / +9.4% 2115183224 / 1527363967 / +38.5% 🔴 0.50 / 0.63 / -21.0%
tpch_q02/duckdb:vortex-file-compressed 633414510 / 532387700 / +19.0% 681034079 / 674093969 / +1.0% 0.93 / 0.79 / +17.8%
tpch_q03/duckdb:vortex-file-compressed 1277633709 / 1431453983 / -10.7% 1852617586 / 1754262191 / +5.6% 0.69 / 0.82 / -15.5%
tpch_q04/duckdb:vortex-file-compressed 1086703463 / 1081623612 / +0.5% 1446787744 / 1922675411 / -24.8% 0.75 / 0.56 / +33.5%
tpch_q05/duckdb:vortex-file-compressed 1077139333 / 1280867612 / -15.9% 1443389325 / 1486003511 / -2.9% 0.75 / 0.86 / -13.4%
tpch_q06/duckdb:vortex-file-compressed 868460196 / 816483687 / +6.4% 1044581995 / 926931076 / +12.7% 0.83 / 0.88 / -5.6%
tpch_q07/duckdb:vortex-file-compressed 1322977196 / 1347937756 / -1.9% 1635327212 / 1459208488 / +12.1% 0.81 / 0.92 / -12.4%
tpch_q08/duckdb:vortex-file-compressed 1286170964 / 1449725786 / -11.3% 1630001307 / 1844271985 / -11.6% 0.79 / 0.79 / +0.4%
tpch_q09/duckdb:vortex-file-compressed 1582711088 / 1609593089 / -1.7% 1779995209 / 2029296937 / -12.3% 0.89 / 0.79 / +12.1%
tpch_q10/duckdb:vortex-file-compressed 1496949010 / 1414060917 / +5.9% 2142659030 / 1802343244 / +18.9% 0.70 / 0.78 / -11.0%
tpch_q11/duckdb:vortex-file-compressed 409119338 / 389925425 / +4.9% 535610245 / 497887604 / +7.6% 0.76 / 0.78 / -2.5%
tpch_q12/duckdb:vortex-file-compressed 1057989093 / 1014680409 / +4.3% 1204442913 / 1352617886 / -11.0% 0.88 / 0.75 / +17.1%
tpch_q13/duckdb:vortex-file-compressed 850342652 / 836525413 / +1.7% 1269802168 / 1162409563 / +9.2% 0.67 / 0.72 / -6.9%
tpch_q14/duckdb:vortex-file-compressed 956560922 / 1024007708 / -6.6% 1082581734 / 1027817019 / +5.3% 0.88 / 1.00 / -11.3%
tpch_q15/duckdb:vortex-file-compressed 905569553 / 870829515 / +4.0% 1045478377 / 1318548726 / -20.7% 0.87 / 0.66 / +31.2%
tpch_q16/duckdb:vortex-file-compressed 353582719 / 289076919 / +22.3% 402022297 / 400682444 / +0.3% 0.88 / 0.72 / +21.9%
tpch_q17/duckdb:vortex-file-compressed 1319318268 / 1302723552 / +1.3% 1214366415 / 1213536811 / +0.1% 1.09 / 1.07 / +1.2%
tpch_q18/duckdb:vortex-file-compressed 1571133831 / 1332880925 / +17.9% 1670786360 / 1620175077 / +3.1% 0.94 / 0.82 / +14.3%
tpch_q19/duckdb:vortex-file-compressed 1217041045 / 1025898620 / +18.6% 1587993622 / 1159588953 / +36.9% 🔴 0.77 / 0.88 / -13.4%
tpch_q20/duckdb:vortex-file-compressed 1140708845 / 1058483242 / +7.8% 1365480233 / 1163335706 / +17.4% 0.84 / 0.91 / -8.2%
tpch_q21/duckdb:vortex-file-compressed 2948178386 / 2542360555 / +16.0% 2770941402 / 2631916752 / +5.3% 1.06 / 0.97 / +10.1%
tpch_q22/duckdb:vortex-file-compressed 544132738 / 431210760 / +26.2% 698450793 / 674478504 / +3.6% 0.78 / 0.64 / +21.9%
duckdb / vortex-compact / ns (1.111x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1049374536 / 918088254 / +14.3% 1800440160 / 1542704039 / +16.7% 0.58 / 0.60 / -2.1%
tpch_q02/duckdb:vortex-compact 547200543 / 1053813771 / -48.1% 🟢 776867236 / 888481198 / -12.6% 0.70 / 1.19 / -40.6%
tpch_q03/duckdb:vortex-compact 1297566390 / 1208274555 / +7.4% 1817919398 / 1634976523 / +11.2% 0.71 / 0.74 / -3.4%
tpch_q04/duckdb:vortex-compact 1058227278 / 1026185451 / +3.1% 1237826442 / 1123585363 / +10.2% 0.85 / 0.91 / -6.4%
tpch_q05/duckdb:vortex-compact 1260330352 / 1171847799 / +7.6% 1573894740 / 1695882243 / -7.2% 0.80 / 0.69 / +15.9%
tpch_q06/duckdb:vortex-compact 872725379 / 757453139 / +15.2% 946853795 / 912271935 / +3.8% 0.92 / 0.83 / +11.0%
tpch_q07/duckdb:vortex-compact 1423358194 / 1148761489 / +23.9% 1569294844 / 1367674620 / +14.7% 0.91 / 0.84 / +8.0%
tpch_q08/duckdb:vortex-compact 1389938302 / 1519115667 / -8.5% 1597384183 / 2048832741 / -22.0% 0.87 / 0.74 / +17.4%
tpch_q09/duckdb:vortex-compact 1416395372 / 1279033344 / +10.7% 1626380957 / 1593717969 / +2.0% 0.87 / 0.80 / +8.5%
tpch_q10/duckdb:vortex-compact 1488888557 / 1471014828 / +1.2% 2043563824 / 1633335131 / +25.1% 0.73 / 0.90 / -19.1%
tpch_q11/duckdb:vortex-compact 436907617 / 384316035 / +13.7% 559753288 / 510757116 / +9.6% 0.78 / 0.75 / +3.7%
tpch_q12/duckdb:vortex-compact 1181065076 / 944313373 / +25.1% 1141720532 / 1339049094 / -14.7% 1.03 / 0.71 / +46.7%
tpch_q13/duckdb:vortex-compact 907085854 / 754582071 / +20.2% 1473542629 / 1005730356 / +46.5% 🔴 0.62 / 0.75 / -18.0%
tpch_q14/duckdb:vortex-compact 1060002725 / 948069451 / +11.8% 1163408363 / 1077738314 / +7.9% 0.91 / 0.88 / +3.6%
tpch_q15/duckdb:vortex-compact 904032516 / 824663301 / +9.6% 1089000488 / 980448444 / +11.1% 0.83 / 0.84 / -1.3%
tpch_q16/duckdb:vortex-compact 306844852 / 298836863 / +2.7% 398668335 / 330236494 / +20.7% 0.77 / 0.90 / -14.9%
tpch_q17/duckdb:vortex-compact 1227596024 / 1152314321 / +6.5% 1340240080 / 1119986758 / +19.7% 0.92 / 1.03 / -11.0%
tpch_q18/duckdb:vortex-compact 1639873270 / 1009820068 / +62.4% 🔴 1907542330 / 1199708310 / +59.0% 🔴 0.86 / 0.84 / +2.1%
tpch_q19/duckdb:vortex-compact 1252162358 / 1089036623 / +15.0% 1479646740 / 1206555676 / +22.6% 0.85 / 0.90 / -6.2%
tpch_q20/duckdb:vortex-compact 1182109996 / 1031809292 / +14.6% 1430211002 / 1256438040 / +13.8% 0.83 / 0.82 / +0.6%
tpch_q21/duckdb:vortex-compact 2656192828 / 2215931795 / +19.9% 2815064473 / 2370288369 / +18.8% 0.94 / 0.93 / +0.9%
tpch_q22/duckdb:vortex-compact 929029890 / 553811458 / +67.8% 🔴 1120688677 / 556507600 / +101.4% 🔴 0.83 / 1.00 / -16.7%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 353533599 / 342151222 / +3.3% 452389848 / 491596670 / -8.0% 0.78 / 0.70 / +12.3%
tpch_q02/duckdb:parquet 562777096 / 624604186 / -9.9% 757678166 / 926372859 / -18.2% 0.74 / 0.67 / +10.2%
tpch_q03/duckdb:parquet 747144987 / 635857999 / +17.5% 1142602460 / 1042541785 / +9.6% 0.65 / 0.61 / +7.2%
tpch_q04/duckdb:parquet 443582998 / 432278380 / +2.6% 715142158 / 978184529 / -26.9% 0.62 / 0.44 / +40.4%
tpch_q05/duckdb:parquet 909629043 / 754171220 / +20.6% 1195404447 / 1115009592 / +7.2% 0.76 / 0.68 / +12.5%
tpch_q06/duckdb:parquet 405033666 / 430017574 / -5.8% 434919124 / 587585432 / -26.0% 0.93 / 0.73 / +27.3%
tpch_q07/duckdb:parquet 922759106 / 890902816 / +3.6% 966319599 / 821970191 / +17.6% 0.95 / 1.08 / -11.9%
tpch_q08/duckdb:parquet 1049852079 / 1031533993 / +1.8% 1196594856 / 1059183755 / +13.0% 0.88 / 0.97 / -9.9%
tpch_q09/duckdb:parquet 1099800825 / 1072738777 / +2.5% 2242264705 / 1363081834 / +64.5% 🔴 0.49 / 0.79 / -37.7%
tpch_q10/duckdb:parquet 878553422 / 935876474 / -6.1% 1049290142 / 1089078094 / -3.7% 0.84 / 0.86 / -2.6%
tpch_q11/duckdb:parquet 327870115 / 358267075 / -8.5% 438310373 / 408377837 / +7.3% 0.75 / 0.88 / -14.7%
tpch_q12/duckdb:parquet 428321097 / 467504777 / -8.4% 519230432 / 526280289 / -1.3% 0.82 / 0.89 / -7.1%
tpch_q13/duckdb:parquet 622047597 / 589785233 / +5.5% 764943514 / 752497457 / +1.7% 0.81 / 0.78 / +3.8%
tpch_q14/duckdb:parquet 700202774 / 834383511 / -16.1% 632713729 / 438781522 / +44.2% 🔴 1.11 / 1.90 / -41.8%
tpch_q15/duckdb:parquet 479415038 / 496146399 / -3.4% 552364627 / 390636954 / +41.4% 🔴 0.87 / 1.27 / -31.7%
tpch_q16/duckdb:parquet 380097390 / 388977440 / -2.3% 404997681 / 388796647 / +4.2% 0.94 / 1.00 / -6.2%
tpch_q17/duckdb:parquet 531910291 / 505646289 / +5.2% 500814766 / 520193895 / -3.7% 1.06 / 0.97 / +9.3%
tpch_q18/duckdb:parquet 600817926 / 634629920 / -5.3% 593664979 / 723015622 / -17.9% 1.01 / 0.88 / +15.3%
tpch_q19/duckdb:parquet 608581396 / 656373035 / -7.3% 518177346 / 1083550844 / -52.2% 🟢 1.17 / 0.61 / +93.9%
tpch_q20/duckdb:parquet 901043378 / 795187398 / +13.3% 994025539 / 781097705 / +27.3% 0.91 / 1.02 / -11.0%
tpch_q21/duckdb:parquet 887944827 / 762554161 / +16.4% 700509089 / 738889219 / -5.2% 1.27 / 1.03 / +22.8%
tpch_q22/duckdb:parquet 580989385 / 537688773 / +8.1% 592294376 / 680283134 / -12.9% 0.98 / 0.79 / +24.1%

@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 6dea3638 vs base 5605eab0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: random-access No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.990x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.099x ➖, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/arrow-ipc-cached 3160552 / 3035425 / +4.1% 3052290 / 3080827 / -0.9% 1.04 / 0.99 / +5.1%
random-access/feature-vectors/correlated/arrow-ipc-reopen 2001328 / 1969204 / +1.6% 12866619 / 13603068 / -5.4% 0.16 / 0.14 / +7.4%
random-access/feature-vectors/uniform/arrow-ipc-cached 54544274 / 32479470 / +67.9% 🔴 54367005 / 32284848 / +68.4% 🔴 1.00 / 1.01 / -0.3%
random-access/feature-vectors/uniform/arrow-ipc-reopen 53462524 / 51625252 / +3.6% 183648981 / 179474536 / +2.3% 0.29 / 0.29 / +1.2%
random-access/nested-lists/correlated/arrow-ipc-cached 64196 / 57879 / +10.9% 🔴 67834 / 60045 / +13.0% 🔴 0.95 / 0.96 / -1.8%
random-access/nested-lists/correlated/arrow-ipc-reopen 106243 / 97112 / +9.4% 3706631 / 3854158 / -3.8% 0.03 / 0.03 / +13.8%
random-access/nested-lists/uniform/arrow-ipc-cached 1109459 / 1034866 / +7.2% 1102782 / 1038574 / +6.2% 1.01 / 1.00 / +1.0%
random-access/nested-lists/uniform/arrow-ipc-reopen 1177147 / 1089785 / +8.0% 25379094 / 25013840 / +1.5% 0.05 / 0.04 / +6.5%
random-access/nested-structs/correlated/arrow-ipc-cached 53290 / 47745 / +11.6% 🔴 56177 / 46209 / +21.6% 🔴 0.95 / 1.03 / -8.2%
random-access/nested-structs/correlated/arrow-ipc-reopen 93836 / 84709 / +10.8% 🔴 3419168 / 3388478 / +0.9% 0.03 / 0.02 / +9.8%
random-access/nested-structs/uniform/arrow-ipc-cached 891460 / 784950 / +13.6% 🔴 875617 / 783443 / +11.8% 🔴 1.02 / 1.00 / +1.6%
random-access/nested-structs/uniform/arrow-ipc-reopen 948820.5 / 838031 / +13.2% 🔴 20124950 / 20162940 / -0.2% 0.05 / 0.04 / +13.4%
random-access/taxi/arrow-ipc-cached 72575.5 / 66597 / +9.0% 72220 / 72145 / +0.1% 1.00 / 0.92 / +8.9%
random-access/taxi/arrow-ipc-reopen 163130.5 / 157532 / +3.6% 3797135 / 4014171 / -5.4% 0.04 / 0.04 / +9.5%
random-access/taxi/correlated/arrow-ipc-cached 123110 / 118985 / +3.5% 120140 / 117837 / +2.0% 1.02 / 1.01 / +1.5%
random-access/taxi/correlated/arrow-ipc-reopen 217341 / 212266 / +2.4% 1672124 / 1550382 / +7.9% 0.13 / 0.14 / -5.1%
random-access/taxi/uniform/arrow-ipc-cached 2907691 / 2736274 / +6.3% 2931109 / 2722406 / +7.7% 0.99 / 1.01 / -1.3%
random-access/taxi/uniform/arrow-ipc-reopen 3017518 / 2864118 / +5.4% 32778411 / 32808466 / -0.1% 0.09 / 0.09 / +5.5%
random-access / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-cached 107184 / 111223 / -3.6% 107650 / 106128 / +1.4% 1.00 / 1.05 / -5.0%
random-access/feature-vectors/correlated/vortex-reopen 1934601 / 1920193 / +0.8% 4396121 / 4438970 / -1.0% 0.44 / 0.43 / +1.7%
random-access/feature-vectors/uniform/vortex-cached 1049152 / 1057060 / -0.7% 1056344 / 1021419 / +3.4% 0.99 / 1.03 / -4.0%
random-access/feature-vectors/uniform/vortex-reopen 3084305 / 3014347 / +2.3% 12244129 / 12417868 / -1.4% 0.25 / 0.24 / +3.8%
random-access/nested-lists/correlated/vortex-cached 95966 / 99242 / -3.3% 102538 / 99409 / +3.1% 0.94 / 1.00 / -6.3%
random-access/nested-lists/correlated/vortex-reopen 375278.5 / 353677 / +6.1% 2481359 / 2515516 / -1.4% 0.15 / 0.14 / +7.6%
random-access/nested-lists/uniform/vortex-cached 492836 / 482078 / +2.2% 367973 / 508287 / -27.6% 🟢 1.34 / 0.95 / +41.2%
random-access/nested-lists/uniform/vortex-reopen 970552 / 944765.5 / +2.7% 8266643 / 7569128 / +9.2% 0.12 / 0.12 / -5.9%
random-access/nested-structs/correlated/vortex-cached 125762 / 126745 / -0.8% 124275 / 129196 / -3.8% 1.01 / 0.98 / +3.2%
random-access/nested-structs/correlated/vortex-reopen 430690.5 / 441924 / -2.5% 3846951 / 3316244 / +16.0% 🔴 0.11 / 0.13 / -16.0%
random-access/nested-structs/uniform/vortex-cached 297482 / 298629 / -0.4% 302131 / 288550 / +4.7% 0.98 / 1.03 / -4.9%
random-access/nested-structs/uniform/vortex-reopen 688989.5 / 675364.5 / +2.0% 5538430 / 4946056 / +12.0% 🔴 0.12 / 0.14 / -8.9%
random-access/taxi/correlated/vortex-cached 328963 / 335033 / -1.8% 331816 / 339240 / -2.2% 0.99 / 0.99 / +0.4%
random-access/taxi/correlated/vortex-reopen 1249655 / 1231683 / +1.5% 2889113 / 3332738 / -13.3% 🟢 0.43 / 0.37 / +17.0%
random-access/taxi/uniform/vortex-cached 1454760 / 1486055 / -2.1% 1437533 / 1483221 / -3.1% 1.01 / 1.00 / +1.0%
random-access/taxi/uniform/vortex-reopen 3645558 / 3689922 / -1.2% 5710170 / 5924306 / -3.6% 0.64 / 0.62 / +2.5%
random-access/taxi/vortex-cached 270042 / 272118 / -0.8% 266174 / 270979 / -1.8% 1.01 / 1.00 / +1.0%
random-access/taxi/vortex-reopen 1055244 / 1043887 / +1.1% 3531711 / 3558299 / -0.7% 0.30 / 0.29 / +1.8%
random-access / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-cached 10140911 / 10088178 / +0.5% 10151272 / 10081246 / +0.7% 1.00 / 1.00 / -0.2%
random-access/feature-vectors/correlated/parquet-reopen 10451943 / 10409875 / +0.4% 17723273 / 17319789 / +2.3% 0.59 / 0.60 / -1.9%
random-access/feature-vectors/uniform/parquet-cached 133484118 / 133167011 / +0.2% 134014261 / 133556291 / +0.3% 1.00 / 1.00 / -0.1%
random-access/feature-vectors/uniform/parquet-reopen 132153456 / 133027162 / -0.7% 199362922 / 191005114 / +4.4% 0.66 / 0.70 / -4.8%
random-access/nested-lists/correlated/parquet-cached 4575992 / 4526979 / +1.1% 4565069 / 4551145 / +0.3% 1.00 / 0.99 / +0.8%
random-access/nested-lists/correlated/parquet-reopen 4694094 / 4607046 / +1.9% 11928944 / 11043822 / +8.0% 0.39 / 0.42 / -5.7%
random-access/nested-lists/uniform/parquet-cached 37066395 / 36924170 / +0.4% 37068312 / 36930877 / +0.4% 1.00 / 1.00 / +0.0%
random-access/nested-lists/uniform/parquet-reopen 37267552 / 39276106 / -5.1% 63236441 / 64137051 / -1.4% 0.59 / 0.61 / -3.8%
random-access/nested-structs/correlated/parquet-cached 9149089 / 8989059 / +1.8% 9187430 / 8978808 / +2.3% 1.00 / 1.00 / -0.5%
random-access/nested-structs/correlated/parquet-reopen 9189231 / 9109460 / +0.9% 20736250 / 21005134 / -1.3% 0.44 / 0.43 / +2.2%
random-access/nested-structs/uniform/parquet-cached 36659148 / 36600809 / +0.2% 36681642 / 36581152 / +0.3% 1.00 / 1.00 / -0.1%
random-access/nested-structs/uniform/parquet-reopen 36750261 / 36761507 / -0.0% 45408644 / 47182172 / -3.8% 0.81 / 0.78 / +3.9%
random-access/taxi/correlated/parquet-cached 23794600 / 23493108 / +1.3% 23616139 / 23455576 / +0.7% 1.01 / 1.00 / +0.6%
random-access/taxi/correlated/parquet-reopen 23989292 / 23890142 / +0.4% 27745309 / 27555991 / +0.7% 0.86 / 0.87 / -0.3%
random-access/taxi/parquet-cached 16671426 / 16518959 / +0.9% 16716686 / 16524772 / +1.2% 1.00 / 1.00 / -0.2%
random-access/taxi/parquet-reopen 16670184 / 16911082 / -1.4% 22318580 / 23891329 / -6.6% 0.75 / 0.71 / +5.5%
random-access/taxi/uniform/parquet-cached 37604266 / 37353035 / +0.7% 37783542 / 37362631 / +1.1% 1.00 / 1.00 / -0.4%
random-access/taxi/uniform/parquet-reopen 37767267 / 37808791 / -0.1% 41445933 / 41801787 / -0.9% 0.91 / 0.90 / +0.7%
random-access / lance / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/lance-cached 148100 / 149617.5 / -1.0% 156775 / 161382 / -2.9% 0.94 / 0.93 / +1.9%
random-access/feature-vectors/correlated/lance-reopen 935607 / 892952 / +4.8% 6846320 / 5782268 / +18.4% 🔴 0.14 / 0.15 / -11.5%
random-access/feature-vectors/uniform/lance-cached 975499 / 955566 / +2.1% 1000026 / 936852 / +6.7% 0.98 / 1.02 / -4.4%
random-access/feature-vectors/uniform/lance-reopen 1770958 / 1768752 / +0.1% 9544079 / 9030802 / +5.7% 0.19 / 0.20 / -5.3%
random-access/nested-lists/correlated/lance-cached 109638 / 110094 / -0.4% 111556 / 110510 / +0.9% 0.98 / 1.00 / -1.3%
random-access/nested-lists/correlated/lance-reopen 423011.5 / 419615 / +0.8% 5987650 / 4930346 / +21.4% 🔴 0.07 / 0.09 / -17.0%
random-access/nested-lists/uniform/lance-cached 815806 / 812369 / +0.4% 814393 / 809400 / +0.6% 1.00 / 1.00 / -0.2%
random-access/nested-lists/uniform/lance-reopen 1302031 / 1292925 / +0.7% 9293544 / 8720791 / +6.6% 0.14 / 0.15 / -5.5%
random-access/nested-structs/correlated/lance-cached 205469 / 207280 / -0.9% 194172 / 197371 / -1.6% 1.06 / 1.05 / +0.8%
random-access/nested-structs/correlated/lance-reopen 471662 / 469129 / +0.5% 5664114 / 4772107 / +18.7% 🔴 0.08 / 0.10 / -15.3%
random-access/nested-structs/uniform/lance-cached 2173550 / 2143895 / +1.4% 2179901 / 2154158 / +1.2% 1.00 / 1.00 / +0.2%
random-access/nested-structs/uniform/lance-reopen 2386201 / 2459502 / -3.0% 14810674 / 14680019 / +0.9% 0.16 / 0.17 / -3.8%
random-access/taxi/correlated/lance-cached 619422 / 623060 / -0.6% 608708 / 620937 / -2.0% 1.02 / 1.00 / +1.4%
random-access/taxi/correlated/lance-reopen 1596530 / 1595644 / +0.1% 2747482 / 2737546 / +0.4% 0.58 / 0.58 / -0.3%
random-access/taxi/lance-cached 417647 / 425704 / -1.9% 416262 / 438073 / -5.0% 1.00 / 0.97 / +3.2%
random-access/taxi/lance-reopen 1232438 / 1228684 / +0.3% 8099817 / 7778066 / +4.1% 0.15 / 0.16 / -3.7%
random-access/taxi/uniform/lance-cached 6626168 / 6692261 / -1.0% 6622462 / 6743023 / -1.8% 1.00 / 0.99 / +0.8%
random-access/taxi/uniform/lance-reopen 7977300 / 7899061 / +1.0% 24686545 / 24739369 / -0.2% 0.32 / 0.32 / +1.2%
random-access / litdata / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/litdata-cached 729606 / 729952 / -0.0% 734498 / 730399 / +0.6% 0.99 / 1.00 / -0.6%
random-access/feature-vectors/correlated/litdata-reopen 3032370 / 3051486 / -0.6% 3714904 / 3740118 / -0.7% 0.82 / 0.82 / +0.0%
random-access/feature-vectors/uniform/litdata-cached 1087524 / 1073898 / +1.3% 1098116 / 1095650 / +0.2% 0.99 / 0.98 / +1.0%
random-access/feature-vectors/uniform/litdata-reopen 15998015 / 16077189 / -0.5% 31926099 / 33904452 / -5.8% 0.50 / 0.47 / +5.7%
random-access/nested-lists/correlated/litdata-cached 584981 / 575319 / +1.7% 586078 / 573498 / +2.2% 1.00 / 1.00 / -0.5%
random-access/nested-lists/correlated/litdata-reopen 17114014 / 17392491 / -1.6% 25233079 / 25146617 / +0.3% 0.68 / 0.69 / -1.9%
random-access/nested-lists/uniform/litdata-cached 603871 / 609451 / -0.9% 605315 / 604324 / +0.2% 1.00 / 1.01 / -1.1%
random-access/nested-lists/uniform/litdata-reopen 17368354 / 17385975 / -0.1% 25316419 / 25302707 / +0.1% 0.69 / 0.69 / -0.2%
random-access/nested-structs/correlated/litdata-cached 658281.5 / 649413 / +1.4% 660988 / 658791 / +0.3% 1.00 / 0.99 / +1.0%
random-access/nested-structs/correlated/litdata-reopen 18728097 / 18596080 / +0.7% 22001179 / 22062117 / -0.3% 0.85 / 0.84 / +1.0%
random-access/nested-structs/uniform/litdata-cached 703654.5 / 701919 / +0.2% 707387 / 705679 / +0.2% 0.99 / 0.99 / +0.0%
random-access/nested-structs/uniform/litdata-reopen 16146606 / 16183236 / -0.2% 24863644 / 24848131 / +0.1% 0.65 / 0.65 / -0.3%
random-access/taxi/correlated/litdata-cached 1149540 / 1140668 / +0.8% 1148751 / 1143968 / +0.4% 1.00 / 1.00 / +0.4%
random-access/taxi/correlated/litdata-reopen 19735625 / 19060015 / +3.5% 29315345 / 29522359 / -0.7% 0.67 / 0.65 / +4.3%
random-access/taxi/litdata-cached 78407 / 78742 / -0.4% 77580 / 79214 / -2.1% 1.01 / 0.99 / +1.7%
random-access/taxi/litdata-reopen 11509295 / 10669192 / +7.9% 14732887 / 14679411 / +0.4% 0.78 / 0.73 / +7.5%
random-access/taxi/uniform/litdata-cached 1280770 / 1277267 / +0.3% 1284184 / 1291374 / -0.6% 1.00 / 0.99 / +0.8%
random-access/taxi/uniform/litdata-reopen 55209344 / 55117108 / +0.2% 84504030 / 84235280 / +0.3% 0.65 / 0.65 / -0.2%

@vercel

vercel Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vortex-docs Ready Ready Preview Nov 4, 2026 5:26pm UTC
vortex-explorer Ready Ready Preview Nov 4, 2026 5:26pm UTC

Request Review

@joseph-isaacs joseph-isaacs changed the title Push DataFusion dynamic filters into V2 scans, switching off unselective ones Push DataFusion dynamic filters into V2 scans Nov 4, 2026
@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 4, 2026 17:26
@joseph-isaacs
joseph-isaacs merged commit 9e6770d into develop Nov 4, 2026
76 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/sleepy-clarke-5utr8u branch November 4, 2026 17:51
robert3005 added a commit that referenced this pull request Nov 4, 2026
Fold the commits of the V2 dynamic filter branch into one change on top of
develop, which pushed DataFusion dynamic filters into V2 scans in #11215:

- Push DataFusion dynamic filters into V2 scans as switched conjuncts
- Drop dynamic filter parts that file statistics show keep every row
- Filter run-end arrays by mask rank and by set bits for sparse masks
- Log the native filter of each Vortex scan in DataFusion
- Share switch measurements across files and push routed join filters
- Route rows of partitioned join filters through a table of branches
- Convert Scan API dynamic filters conjunct by conjunct
- Prune with the bounds a multi-column dynamic filter implies

The switch of each optional conjunct replaces develop's skipping of
unselective dynamic conjuncts, so ScanBuilder::with_skip_unselective_dynamic
and the dynamic filter path through the V2 scan predicate are removed. The
dynamic filters reach the scan through the file pruning predicate for V1 and
V2 scans. V2 scans keep develop's skip of dynamic pruning in scans of one
filtered chunk, and also skip the pruning of a paused switch.

The run-end filter keeps develop's rank walk with POPCNT dispatch and adds
the walk over set bits for masks that keep fewer rows than there are runs.
The Scan API dynamic filter keeps develop's merge of key bounds into a
between.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Robert Kruszewski <github@robertk.io>
robert3005 added a commit that referenced this pull request Nov 5, 2026
Fold the commits of the V2 dynamic filter branch into one change on top of
develop, which pushed DataFusion dynamic filters into V2 scans in #11215:

- Push DataFusion dynamic filters into V2 scans as switched conjuncts
- Drop dynamic filter parts that file statistics show keep every row
- Filter run-end arrays by mask rank and by set bits for sparse masks
- Log the native filter of each Vortex scan in DataFusion
- Share switch measurements across files and push routed join filters
- Route rows of partitioned join filters through a table of branches
- Convert Scan API dynamic filters conjunct by conjunct
- Prune with the bounds a multi-column dynamic filter implies

The switch of each optional conjunct replaces develop's skipping of
unselective dynamic conjuncts, so ScanBuilder::with_skip_unselective_dynamic
and the dynamic filter path through the V2 scan predicate are removed. The
dynamic filters reach the scan through the file pruning predicate for V1 and
V2 scans. V2 scans keep develop's skip of dynamic pruning in scans of one
filtered chunk, and also skip the pruning of a paused switch.

The run-end filter keeps develop's rank walk with POPCNT dispatch and adds
the walk over set bits for masks that keep fewer rows than there are runs.
The Scan API dynamic filter keeps develop's merge of key bounds into a
between.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@joseph-isaacs joseph-isaacs mentioned this pull request Nov 9, 2026
16 of 46 tasks
@adriangb

Copy link
Copy Markdown

Switch off unselective dynamic conjuncts

Very interesting! This is essentially what we are planning on doing in DataFusion as well. Just blocked on review capacity...

joseph-isaacs added a commit that referenced this pull request Nov 11, 2026
develop now scans with the V2 scan by default and already pushes DataFusion
dynamic filters into it (#11215). The V1 scan changes on this branch are
superseded, and the RunEnd files they touched moved and were rewritten, so
this merge keeps develop's version of every file. The partitioned hash join
handling is ported onto the V2 dynamic filter in the next commit.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01So4kxsqCY8WFG1NTMNJxKX
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants