Skip to content

Fast FastLanes Delta: fused decode, SIMD transposes, probe, filter, take and is_constant kernels - #11428

Merged
robert3005 merged 11 commits into
developfrom
claude/stoic-brahmagupta-p44si2
Nov 13, 2026
Merged

robert3005 merged 11 commits into
developfrom
claude/stoic-brahmagupta-p44si2

Conversation

@robert3005

@robert3005 robert3005 commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Summary

FastLanes Delta decoded slowly and had almost no compute kernels: every filter, take, scalar_at or is_constant decoded the whole array first. Vortex now has the APIs this needs (the probe API and execute kernels). This PR uses them, together with fastlanes 0.8.0's fused unpack-and-undelta and SIMD transpose kernels, so Delta is cheap enough to select by default.

Changes

Decode

  • Fused decode. Delta(BitPacked) decodes each 1024-value chunk with fastlanes' fused unchecked_undelta_pack. The deltas are no longer unpacked into a full intermediate array. This covers patched and block-width bit-packing.
  • Sliced arrays decode only the chunks the slice covers, then trim the result.
  • SIMD transposes. fastlanes is updated to 0.8.0. Transposes are dispatched at runtime through fearless_simd: AVX-512 for 8- and 16-bit values; for 32- and 64-bit values, fastlanes' own dispatch, because AVX-512 is slower there on Zen 4.
  • DeltaChunks is a reusable chunk decoder with scratch space. The kernels below share it.

Kernels

  • Probe API. scalar_at decodes only the chunk holding the row. A repeated probe caches the last decoded chunk.
  • Filter and take decode only the chunks that have selected rows. Take falls back to a full decode for large index sets.
  • is_constant reads only the stored parts where it can: all-null, mixed-null, or all-zero interior deltas plus constant bases. Only the partial chunks at either end of a slice are decoded.
  • The chunked take logic in take_chunks.rs is shared between BitPacked and Delta.

Compression

  • Back-fill leading nulls per chunk. delta_compress used to carry the previous chunk's last value into a chunk that starts with nulls. Values that restart in every chunk, such as RLE indices, then got wrapping residuals, and the compressor rejected Delta for them. Those leading nulls now take the chunk's first valid value.
  • Keep RunEnd off RLE indices. RLE indices count up within each chunk, so Delta packs them into a few bits. Allowing RunEnd there produced RLE(indices = RunEnd(ends = Delta)), which every decode and filter expands twice. This enables the exclusion that had been commented out.

@robert3005 robert3005 added the changelog/feature A new feature label Nov 12, 2026
@codspeed

codspeed Bot commented Nov 12, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 20 improved benchmarks
❌ 1 regressed benchmark
✅ 1915 untouched benchmarks
⏩ 50 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation compare[1] 61.9 µs 71.4 µs -13.26%
⚡ Walltime decode_bitpacked_deltas_avx512[u16, 524288] 333 µs 26.2 µs ×13
⚡ Walltime decode_bitpacked_deltas_avx2[u16, 524288] 330.6 µs 31.8 µs ×10
⚡ Walltime decode_bitpacked_deltas_neon[u16, 524288] 348.3 µs 47.2 µs ×7.4
⚡ Walltime decode_bitpacked_deltas_avx512[u32, 524288] 180.5 µs 25 µs ×7.2
⚡ Walltime decode_bitpacked_deltas_avx2[u32, 524288] 187.3 µs 29.2 µs ×6.4
⚡ Walltime decode_bitpacked_deltas_neon[u32, 524288] 190.5 µs 40.8 µs ×4.7
⚡ Walltime decode_bitpacked_deltas_avx512[u64, 524288] 113 µs 28.5 µs ×4
⚡ Walltime decode_bitpacked_deltas_avx2[u64, 524288] 114.9 µs 31.4 µs ×3.7
⚡ Walltime decode_bitpacked_deltas_neon[u64, 524288] 132.4 µs 37 µs ×3.6
⚡ CPU Simulation probe_repeated 378.6 µs 112.3 µs ×3.4
⚡ CPU Simulation filter[64] 243 µs 74 µs ×3.3
⚡ CPU Simulation filter[4096] 226 µs 73.9 µs ×3.1
⚡ CPU Simulation take[128] 235.3 µs 84.8 µs ×2.8
⚡ CPU Simulation decode_primitive_deltas 184.8 µs 117.6 µs +57.09%
⚡ CPU Simulation delta_compress_u32 97.1 µs 62.1 µs +56.39%
⚡ CPU Simulation probe_once 374.9 µs 247 µs +51.74%
⚡ CPU Simulation delta_decompress_u32 104.8 µs 72.8 µs +43.88%
⚡ CPU Simulation compare[1] 57.8 µs 47.6 µs +21.59%
⚡ Walltime scalar_subtract_neon 13.5 µs 12 µs +12.47%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/stoic-brahmagupta-p44si2 (c005092) with develop (815e344)

Open in CodSpeed

Footnotes

  1. 50 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@robert3005
robert3005 force-pushed the claude/stoic-brahmagupta-p44si2 branch from e121213 to 438088d Compare November 12, 2026 18:52
@robert3005
robert3005 changed the base branch from develop to rk/delta-decode-bench November 12, 2026 18:52
@robert3005
robert3005 force-pushed the claude/stoic-brahmagupta-p44si2 branch from 34f85ea to 1d8c9ac Compare November 13, 2026 11:04
robert3005 added a commit that referenced this pull request Nov 13, 2026
This PR adds benchmarks for the Delta encoding. They are split out of
#11428 so that its changes can be measured against `develop`, and #11428
stacks on this PR.

## Changes

`encodings/fastlanes/benches/delta_decode.rs` adds 15 benchmarks.

**Walltime (9 benchmarks).** `decode_bitpacked_deltas` decodes a 512 KiB
Delta array whose deltas are bit-packed, for u16, u32 and u64. It
carries `#[cpu_features]`, so it runs on each walltime CPU-feature leg,
where the build selects the transpose and decode kernels.

**Simulation (6 benchmarks).** These run once each, on 32 KiB arrays so
they stay under 1 ms in CodSpeed's simulation, which runs roughly 13×
slower than native:
- `decode_primitive_deltas` decodes a u32 Delta array whose deltas are a
primitive array.
- `probe_once` and `probe_repeated` read 8 rows from 2 chunks of a
2048-row array. `probe_once` uses a one-off probe per row;
`probe_repeated` reuses one probe for all 8.
- `filter` selects one row in every 64, or one in every 4096.
- `take` takes 128 scattered rows.

---------

Signed-off-by: Robert Kruszewski <github@robertk.io>
Base automatically changed from rk/delta-decode-bench to develop November 13, 2026 11:28
@robert3005
robert3005 force-pushed the claude/stoic-brahmagupta-p44si2 branch from 1d8c9ac to b369847 Compare November 13, 2026 12:36
@robert3005 robert3005 added action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 13, 2026
@github-actions github-actions Bot removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-compress Run only the compression benchmark on this PR labels Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9e4c9ab random-access-bench 1 Explore Profiling Data
🟢 Done 9e4c9ab clickbench-nvme 1 Explore Profiling Data
🟢 Done 9e4c9ab tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 9e4c9ab tpch-nvme-10 1 Explore Profiling Data
🟢 Done 9e4c9ab polarsignals 1 Explore Profiling Data
🟢 Done 9e4c9ab fineweb 1 Explore Profiling Data
🟢 Done 9e4c9ab tpch-s3 1 Explore Profiling Data
🟢 Done 9e4c9ab tpch-nvme 1 Explore Profiling Data
🟢 Done 9e4c9ab tpcds-nvme 1 Explore Profiling Data
🟢 Done 9e4c9ab compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Vortex (geomean): hot 0.984x ➖ · cold 1.040x ➖


datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80850974 / 81402376 / -0.7% 122565648 / 123368731 / -0.7% 0.66 / 0.66 / -0.0%
polarsignals_q01/datafusion:vortex-file-compressed 88726264 / 88717144 / +0.0% 145029904 / 143927906 / +0.8% 0.61 / 0.62 / -0.7%
polarsignals_q02/datafusion:vortex-file-compressed 11374155 / 11632375 / -2.2% 41877498 / 39927482 / +4.9% 0.27 / 0.29 / -6.8%
polarsignals_q03/datafusion:vortex-file-compressed 90126522 / 89831540 / +0.3% 153380115 / 146222139 / +4.9% 0.59 / 0.61 / -4.4%
polarsignals_q04/datafusion:vortex-file-compressed 9507850 / 9260281 / +2.7% 40955655 / 37912966 / +8.0% 0.23 / 0.24 / -5.0%
polarsignals_q05/datafusion:vortex-file-compressed 11734976 / 11746666 / -0.1% 45698798 / 42146108 / +8.4% 0.26 / 0.28 / -7.9%
polarsignals_q06/datafusion:vortex-file-compressed 22997446 / 23052276 / -0.2% 54307618 / 51855264 / +4.7% 0.42 / 0.44 / -4.7%
polarsignals_q07/datafusion:vortex-file-compressed 10701643 / 10643783 / +0.5% 41712644 / 39106084 / +6.7% 0.26 / 0.27 / -5.7%
polarsignals_q08/datafusion:vortex-file-compressed 133756635 / 134701366 / -0.7% 191053952 / 189250315 / +1.0% 0.70 / 0.71 / -1.6%
polarsignals_q09/datafusion:vortex-file-compressed 10090681 / 9995078 / +1.0% 38571755 / 36122404 / +6.8% 0.26 / 0.28 / -5.5%
polarsignals_q10/datafusion:vortex-file-compressed 13477334 / 17176254 / -21.5% 🟢 49308825 / 47542243 / +3.7% 0.27 / 0.36 / -24.3%
polarsignals_q11/datafusion:vortex-file-compressed 15870171 / 16094628 / -1.4% 46705672 / 46257041 / +1.0% 0.34 / 0.35 / -2.3%
polarsignals_q12/datafusion:vortex-file-compressed 16726865 / 16147652 / +3.6% 46247466 / 44936304 / +2.9% 0.36 / 0.36 / +0.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+4.0%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 0.993x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6021388 / 6144977 / -2.0% 20682058 / 19409038 / +6.6% 0.29 / 0.32 / -8.0%
fineweb_q01/datafusion:vortex-file-compressed 9019902 / 9368240 / -3.7% 36402685 / 34394711 / +5.8% 0.25 / 0.27 / -9.0%
fineweb_q02/datafusion:vortex-file-compressed 11876206 / 12240136 / -3.0% 40659137 / 38834180 / +4.7% 0.29 / 0.32 / -7.3%
fineweb_q03/datafusion:vortex-file-compressed 18148394 / 17175720 / +5.7% 101533582 / 108056379 / -6.0% 0.18 / 0.16 / +12.5%
fineweb_q04/datafusion:vortex-file-compressed 68741782 / 65728016 / +4.6% 149436475 / 138198929 / +8.1% 0.46 / 0.48 / -3.3%
fineweb_q05/datafusion:vortex-file-compressed 63483571 / 62323036 / +1.9% 136762423 / 134896767 / +1.4% 0.46 / 0.46 / +0.5%
fineweb_q06/datafusion:vortex-file-compressed 17268935 / 16876480 / +2.3% 98572878 / 106499306 / -7.4% 0.18 / 0.16 / +10.6%
fineweb_q07/datafusion:vortex-file-compressed 17743477 / 17167858 / +3.4% 97029491 / 99228879 / -2.2% 0.18 / 0.17 / +5.7%
fineweb_q08/datafusion:vortex-file-compressed 8750000 / 10335775 / -15.3% 🟢 27816860 / 26424347 / +5.3% 0.31 / 0.39 / -19.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9566444 / 9439626 / +1.3% 32481619 / 34662454 / -6.3% 0.29 / 0.27 / +8.1%
fineweb_q01/datafusion:parquet 75542348 / 74307928 / +1.7% 145623015 / 152415147 / -4.5% 0.52 / 0.49 / +6.4%
fineweb_q02/datafusion:parquet 74922113 / 73948724 / +1.3% 144899429 / 152808795 / -5.2% 0.52 / 0.48 / +6.8%
fineweb_q03/datafusion:parquet 74391585 / 73954250 / +0.6% 142070500 / 146866472 / -3.3% 0.52 / 0.50 / +4.0%
fineweb_q04/datafusion:parquet 82305895 / 82148899 / +0.2% 139858675 / 147978380 / -5.5% 0.59 / 0.56 / +6.0%
fineweb_q05/datafusion:parquet 80306206 / 79958060 / +0.4% 149075836 / 145906937 / +2.2% 0.54 / 0.55 / -1.7%
fineweb_q06/datafusion:parquet 74709290 / 76982718 / -3.0% 149814318 / 144895054 / +3.4% 0.50 / 0.53 / -6.1%
fineweb_q07/datafusion:parquet 74878412 / 74290236 / +0.8% 139891874 / 140100207 / -0.1% 0.54 / 0.53 / +0.9%
fineweb_q08/datafusion:parquet 73422885 / 74215560 / -1.1% 141790821 / 147735419 / -4.0% 0.52 / 0.50 / +3.1%
duckdb / vortex-file-compressed / ns (1.028x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2144452 / 2142432 / +0.1% 7266765 / 8106437 / -10.4% 🟢 0.30 / 0.26 / +11.7%
fineweb_q01/duckdb:vortex-file-compressed 9178232 / 8273139 / +10.9% 🔴 25155354 / 26802470 / -6.1% 0.36 / 0.31 / +18.2%
fineweb_q02/duckdb:vortex-file-compressed 10551264 / 10676302 / -1.2% 27474002 / 27965344 / -1.8% 0.38 / 0.38 / +0.6%
fineweb_q03/duckdb:vortex-file-compressed 18452882 / 18436980 / +0.1% 85864657 / 88742881 / -3.2% 0.21 / 0.21 / +3.4%
fineweb_q04/duckdb:vortex-file-compressed 70778700 / 68077498 / +4.0% 112390324 / 111269199 / +1.0% 0.63 / 0.61 / +2.9%
fineweb_q05/duckdb:vortex-file-compressed 68148399 / 68398767 / -0.4% 109101842 / 109473100 / -0.3% 0.62 / 0.62 / -0.0%
fineweb_q06/duckdb:vortex-file-compressed 18805777 / 18061612 / +4.1% 87153776 / 87030379 / +0.1% 0.22 / 0.21 / +4.0%
fineweb_q07/duckdb:vortex-file-compressed 19336846 / 19718354 / -1.9% 87816865 / 88546170 / -0.8% 0.22 / 0.22 / -1.1%
fineweb_q08/duckdb:vortex-file-compressed 4803678 / 4362678 / +10.1% 🔴 11827339 / 12440361 / -4.9% 0.41 / 0.35 / +15.8%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23645987 / 23795547 / -0.6% 27585030 / 28560847 / -3.4% 0.86 / 0.83 / +2.9%
fineweb_q01/duckdb:parquet 54440642 / 56261254 / -3.2% 71038159 / 70456256 / +0.8% 0.77 / 0.80 / -4.0%
fineweb_q02/duckdb:parquet 58794521 / 59562376 / -1.3% 72884691 / 77856795 / -6.4% 0.81 / 0.77 / +5.4%
fineweb_q03/duckdb:parquet 119895006 / 118923920 / +0.8% 177554352 / 173386386 / +2.4% 0.68 / 0.69 / -1.6%
fineweb_q04/duckdb:parquet 162238692 / 163269886 / -0.6% 200623512 / 201415380 / -0.4% 0.81 / 0.81 / -0.2%
fineweb_q05/duckdb:parquet 158429072 / 160777748 / -1.5% 198616998 / 197477143 / +0.6% 0.80 / 0.81 / -2.0%
fineweb_q06/duckdb:parquet 87465765 / 89523540 / -2.3% 148895884 / 150846353 / -1.3% 0.59 / 0.59 / -1.0%
fineweb_q07/duckdb:parquet 89660960 / 90791772 / -1.2% 149174173 / 146218091 / +2.0% 0.60 / 0.62 / -3.2%
fineweb_q08/duckdb:parquet 28818799 / 28923165 / -0.4% 30967999 / 31322323 / -1.1% 0.93 / 0.92 / +0.8%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 0.962x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.987x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15758214 / 15527670 / +1.5% 43300983 / 45241086 / -4.3% 0.36 / 0.34 / +6.0%
tpch_q02/datafusion:vortex-file-compressed 17501361 / 17830427 / -1.8% 38876656 / 38695488 / +0.5% 0.45 / 0.46 / -2.3%
tpch_q03/datafusion:vortex-file-compressed 18905645 / 19184651 / -1.5% 44154923 / 47844815 / -7.7% 0.43 / 0.40 / +6.8%
tpch_q04/datafusion:vortex-file-compressed 10593273 / 10252271 / +3.3% 34992061 / 38129389 / -8.2% 0.30 / 0.27 / +12.6%
tpch_q05/datafusion:vortex-file-compressed 37432432 / 37125592 / +0.8% 66740338 / 67991496 / -1.8% 0.56 / 0.55 / +2.7%
tpch_q06/datafusion:vortex-file-compressed 4395978 / 4462363 / -1.5% 24917443 / 27738824 / -10.2% 🟢 0.18 / 0.16 / +9.7%
tpch_q07/datafusion:vortex-file-compressed 53010225 / 52230946 / +1.5% 83615359 / 84788955 / -1.4% 0.63 / 0.62 / +2.9%
tpch_q08/datafusion:vortex-file-compressed 52622366 / 51857892 / +1.5% 82464107 / 89601942 / -8.0% 0.64 / 0.58 / +10.3%
tpch_q09/datafusion:vortex-file-compressed 47831404 / 47072842 / +1.6% 79056237 / 79568122 / -0.6% 0.61 / 0.59 / +2.3%
tpch_q10/datafusion:vortex-file-compressed 17458567 / 17732827 / -1.5% 46286781 / 54936715 / -15.7% 🟢 0.38 / 0.32 / +16.9%
tpch_q11/datafusion:vortex-file-compressed 14702864 / 14287703 / +2.9% 36288832 / 35634055 / +1.8% 0.41 / 0.40 / +1.0%
tpch_q12/datafusion:vortex-file-compressed 18702914 / 18866844 / -0.9% 42123466 / 45965754 / -8.4% 0.44 / 0.41 / +8.2%
tpch_q13/datafusion:vortex-file-compressed 19693113 / 19725101 / -0.2% 41311751 / 44402877 / -7.0% 0.48 / 0.44 / +7.3%
tpch_q14/datafusion:vortex-file-compressed 14642658 / 14207694 / +3.1% 39520687 / 41270575 / -4.2% 0.37 / 0.34 / +7.6%
tpch_q15/datafusion:vortex-file-compressed 18565353 / 18131421 / +2.4% 46008255 / 48132499 / -4.4% 0.40 / 0.38 / +7.1%
tpch_q16/datafusion:vortex-file-compressed 18239230 / 18155590 / +0.5% 40717512 / 40533907 / +0.5% 0.45 / 0.45 / +0.0%
tpch_q17/datafusion:vortex-file-compressed 28967052 / 29010625 / -0.2% 59660016 / 61789869 / -3.4% 0.49 / 0.47 / +3.4%
tpch_q18/datafusion:vortex-file-compressed 36327445 / 36487162 / -0.4% 63668525 / 61777318 / +3.1% 0.57 / 0.59 / -3.4%
tpch_q19/datafusion:vortex-file-compressed 9994945 / 9359845 / +6.8% 37162521 / 37858511 / -1.8% 0.27 / 0.25 / +8.8%
tpch_q20/datafusion:vortex-file-compressed 20955183 / 20790814 / +0.8% 49578854 / 52809851 / -6.1% 0.42 / 0.39 / +7.4%
tpch_q21/datafusion:vortex-file-compressed 35153981 / 35223671 / -0.2% 64065981 / 70334455 / -8.9% 0.55 / 0.50 / +9.6%
tpch_q22/datafusion:vortex-file-compressed 11077715 / 10780540 / +2.8% 33450434 / 31885738 / +4.9% 0.33 / 0.34 / -2.1%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71480468 / 71291284 / +0.3% 88335195 / 92167753 / -4.2% 0.81 / 0.77 / +4.6%
tpch_q02/datafusion:parquet 76581355 / 75875702 / +0.9% 93433076 / 94995492 / -1.6% 0.82 / 0.80 / +2.6%
tpch_q03/datafusion:parquet 82075333 / 81520156 / +0.7% 103221742 / 105967814 / -2.6% 0.80 / 0.77 / +3.4%
tpch_q04/datafusion:parquet 39560643 / 39334978 / +0.6% 59059166 / 59045747 / +0.0% 0.67 / 0.67 / +0.6%
tpch_q05/datafusion:parquet 110137614 / 110504937 / -0.3% 136066647 / 140833765 / -3.4% 0.81 / 0.78 / +3.2%
tpch_q06/datafusion:parquet 31768401 / 31539937 / +0.7% 47623013 / 49539415 / -3.9% 0.67 / 0.64 / +4.8%
tpch_q07/datafusion:parquet 112862159 / 112942926 / -0.1% 138245364 / 140480903 / -1.6% 0.82 / 0.80 / +1.5%
tpch_q08/datafusion:parquet 117600312 / 116718840 / +0.8% 143823975 / 144742968 / -0.6% 0.82 / 0.81 / +1.4%
tpch_q09/datafusion:parquet 137066854 / 137508203 / -0.3% 164869294 / 168517921 / -2.2% 0.83 / 0.82 / +1.9%
tpch_q10/datafusion:parquet 104164938 / 103767686 / +0.4% 128599940 / 128351813 / +0.2% 0.81 / 0.81 / +0.2%
tpch_q11/datafusion:parquet 62482997 / 61692244 / +1.3% 82583520 / 83814561 / -1.5% 0.76 / 0.74 / +2.8%
tpch_q12/datafusion:parquet 64418005 / 63609225 / +1.3% 85960037 / 86658070 / -0.8% 0.75 / 0.73 / +2.1%
tpch_q13/datafusion:parquet 143843908 / 143764314 / +0.1% 164093524 / 165039271 / -0.6% 0.88 / 0.87 / +0.6%
tpch_q14/datafusion:parquet 47830528 / 47448835 / +0.8% 72713113 / 72762568 / -0.1% 0.66 / 0.65 / +0.9%
tpch_q15/datafusion:parquet 74367073 / 74256637 / +0.1% 96007735 / 94958754 / +1.1% 0.77 / 0.78 / -0.9%
tpch_q16/datafusion:parquet 43212138 / 44012240 / -1.8% 63344303 / 62883289 / +0.7% 0.68 / 0.70 / -2.5%
tpch_q17/datafusion:parquet 123742452 / 123166246 / +0.5% 144608073 / 149692057 / -3.4% 0.86 / 0.82 / +4.0%
tpch_q18/datafusion:parquet 121199952 / 120997117 / +0.2% 141903636 / 144157223 / -1.6% 0.85 / 0.84 / +1.8%
tpch_q19/datafusion:parquet 56772827 / 56436955 / +0.6% 80641972 / 84117721 / -4.1% 0.70 / 0.67 / +4.9%
tpch_q20/datafusion:parquet 79467257 / 76928425 / +3.3% 98442484 / 101356620 / -2.9% 0.81 / 0.76 / +6.4%
tpch_q21/datafusion:parquet 114084961 / 113295905 / +0.7% 138748432 / 140309836 / -1.1% 0.82 / 0.81 / +1.8%
tpch_q22/datafusion:parquet 52372740 / 51337398 / +2.0% 68281942 / 70076051 / -2.6% 0.77 / 0.73 / +4.7%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9606312 / 8969257 / +7.1% 18256399 / 18356459 / -0.5% 0.53 / 0.49 / +7.7%
tpch_q02/duckdb:vortex-file-compressed 15267193 / 15432805 / -1.1% 24735614 / 25477804 / -2.9% 0.62 / 0.61 / +1.9%
tpch_q03/duckdb:vortex-file-compressed 18612329 / 18469494 / +0.8% 33891681 / 34635554 / -2.1% 0.55 / 0.53 / +3.0%
tpch_q04/duckdb:vortex-file-compressed 12374015 / 12037173 / +2.8% 25007650 / 25395664 / -1.5% 0.49 / 0.47 / +4.4%
tpch_q05/duckdb:vortex-file-compressed 20094430 / 20167454 / -0.4% 35745363 / 36264287 / -1.4% 0.56 / 0.56 / +1.1%
tpch_q06/duckdb:vortex-file-compressed 4722787 / 4446633 / +6.2% 13912633 / 14437630 / -3.6% 0.34 / 0.31 / +10.2%
tpch_q07/duckdb:vortex-file-compressed 24333138 / 24411388 / -0.3% 42997953 / 37814851 / +13.7% 🔴 0.57 / 0.65 / -12.3%
tpch_q08/duckdb:vortex-file-compressed 20866161 / 20932419 / -0.3% 35625543 / 36990580 / -3.7% 0.59 / 0.57 / +3.5%
tpch_q09/duckdb:vortex-file-compressed 23252274 / 23145143 / +0.5% 35890572 / 38973051 / -7.9% 0.65 / 0.59 / +9.1%
tpch_q10/duckdb:vortex-file-compressed 27445743 / 27893302 / -1.6% 42689172 / 44724291 / -4.6% 0.64 / 0.62 / +3.1%
tpch_q11/duckdb:vortex-file-compressed 8123109 / 8251582 / -1.6% 16873658 / 18317607 / -7.9% 0.48 / 0.45 / +6.9%
tpch_q12/duckdb:vortex-file-compressed 14509122 / 14715031 / -1.4% 25162593 / 25901944 / -2.9% 0.58 / 0.57 / +1.5%
tpch_q13/duckdb:vortex-file-compressed 19766639 / 19473796 / +1.5% 31483382 / 32699146 / -3.7% 0.63 / 0.60 / +5.4%
tpch_q14/duckdb:vortex-file-compressed 11052267 / 11050348 / +0.0% 23574653 / 23666503 / -0.4% 0.47 / 0.47 / +0.4%
tpch_q15/duckdb:vortex-file-compressed 8285698 / 8358339 / -0.9% 19209781 / 20452320 / -6.1% 0.43 / 0.41 / +5.5%
tpch_q16/duckdb:vortex-file-compressed 16668846 / 16577347 / +0.6% 23153352 / 22967669 / +0.8% 0.72 / 0.72 / -0.3%
tpch_q17/duckdb:vortex-file-compressed 12632660 / 12627425 / +0.0% 27005957 / 28213597 / -4.3% 0.47 / 0.45 / +4.5%
tpch_q18/duckdb:vortex-file-compressed 24020270 / 24490651 / -1.9% 33640157 / 35582064 / -5.5% 0.71 / 0.69 / +3.7%
tpch_q19/duckdb:vortex-file-compressed 11390618 / 11317621 / +0.6% 24448890 / 27665018 / -11.6% 🟢 0.47 / 0.41 / +13.9%
tpch_q20/duckdb:vortex-file-compressed 14557403 / 14326741 / +1.6% 29185441 / 30761910 / -5.1% 0.50 / 0.47 / +7.1%
tpch_q21/duckdb:vortex-file-compressed 48214147 / 48366614 / -0.3% 62853274 / 65405228 / -3.9% 0.77 / 0.74 / +3.7%
tpch_q22/duckdb:vortex-file-compressed 17045039 / 16705146 / +2.0% 25674748 / 27375534 / -6.2% 0.66 / 0.61 / +8.8%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47631294 / 47605691 / +0.1% 53701593 / 53882998 / -0.3% 0.89 / 0.88 / +0.4%
tpch_q02/duckdb:parquet 48520038 / 48415461 / +0.2% 55264624 / 55795860 / -1.0% 0.88 / 0.87 / +1.2%
tpch_q03/duckdb:parquet 60601112 / 60511045 / +0.1% 67432676 / 68682582 / -1.8% 0.90 / 0.88 / +2.0%
tpch_q04/duckdb:parquet 34793820 / 34815397 / -0.1% 42753163 / 43467335 / -1.6% 0.81 / 0.80 / +1.6%
tpch_q05/duckdb:parquet 67285191 / 67417897 / -0.2% 77299514 / 77534698 / -0.3% 0.87 / 0.87 / +0.1%
tpch_q06/duckdb:parquet 21687367 / 21843408 / -0.7% 26420703 / 26654640 / -0.9% 0.82 / 0.82 / +0.2%
tpch_q07/duckdb:parquet 63991219 / 64156613 / -0.3% 71752120 / 73839765 / -2.8% 0.89 / 0.87 / +2.6%
tpch_q08/duckdb:parquet 75790361 / 76037959 / -0.3% 86502472 / 87136692 / -0.7% 0.88 / 0.87 / +0.4%
tpch_q09/duckdb:parquet 107915885 / 108064180 / -0.1% 118964761 / 119876686 / -0.8% 0.91 / 0.90 / +0.6%
tpch_q10/duckdb:parquet 105977245 / 105861562 / +0.1% 116855721 / 117272311 / -0.4% 0.91 / 0.90 / +0.5%
tpch_q11/duckdb:parquet 29540364 / 29572145 / -0.1% 34783500 / 35171963 / -1.1% 0.85 / 0.84 / +1.0%
tpch_q12/duckdb:parquet 37272966 / 37399911 / -0.3% 43702499 / 43885388 / -0.4% 0.85 / 0.85 / +0.1%
tpch_q13/duckdb:parquet 175197084 / 175160809 / +0.0% 181739949 / 184364379 / -1.4% 0.96 / 0.95 / +1.5%
tpch_q14/duckdb:parquet 42230572 / 42326677 / -0.2% 50244609 / 50787231 / -1.1% 0.84 / 0.83 / +0.9%
tpch_q15/duckdb:parquet 32781196 / 32670096 / +0.3% 40845428 / 41214315 / -0.9% 0.80 / 0.79 / +1.2%
tpch_q16/duckdb:parquet 47734904 / 47408138 / +0.7% 53087653 / 52362094 / +1.4% 0.90 / 0.91 / -0.7%
tpch_q17/duckdb:parquet 48016520 / 47909385 / +0.2% 57461179 / 57054086 / +0.7% 0.84 / 0.84 / -0.5%
tpch_q18/duckdb:parquet 74533123 / 74201137 / +0.4% 81013120 / 80991596 / +0.0% 0.92 / 0.92 / +0.4%
tpch_q19/duckdb:parquet 48238855 / 48648290 / -0.8% 57867157 / 60582700 / -4.5% 0.83 / 0.80 / +3.8%
tpch_q20/duckdb:parquet 63704254 / 63492546 / +0.3% 72652463 / 73857322 / -1.6% 0.88 / 0.86 / +2.0%
tpch_q21/duckdb:parquet 107134621 / 106948279 / +0.2% 115852453 / 116114304 / -0.2% 0.92 / 0.92 / +0.4%
tpch_q22/duckdb:parquet 50681803 / 50530116 / +0.3% 58543938 / 59193250 / -1.1% 0.87 / 0.85 / +1.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.973x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90028675 / 91723064 / -1.8% 149921746 / 156900434 / -4.4% 0.60 / 0.58 / +2.7%
tpch_q02/datafusion:vortex-file-compressed 66001835 / 65095651 / +1.4% 96435518 / 96085707 / +0.4% 0.68 / 0.68 / +1.0%
tpch_q03/datafusion:vortex-file-compressed 62773940 / 64024244 / -2.0% 120652940 / 124530414 / -3.1% 0.52 / 0.51 / +1.2%
tpch_q04/datafusion:vortex-file-compressed 33530164 / 34095591 / -1.7% 64549153 / 74165496 / -13.0% 🟢 0.52 / 0.46 / +13.0%
tpch_q05/datafusion:vortex-file-compressed 117786152 / 119432060 / -1.4% 184253213 / 188025973 / -2.0% 0.64 / 0.64 / +0.6%
tpch_q06/datafusion:vortex-file-compressed 9616635 / 9776327 / -1.6% 51949478 / 55893709 / -7.1% 0.19 / 0.17 / +5.8%
tpch_q07/datafusion:vortex-file-compressed 97397630 / 98184930 / -0.8% 148052024 / 151834623 / -2.5% 0.66 / 0.65 / +1.7%
tpch_q08/datafusion:vortex-file-compressed 142376544 / 141434430 / +0.7% 263819118 / 219384476 / +20.3% 🔴 0.54 / 0.64 / -16.3%
tpch_q09/datafusion:vortex-file-compressed 184113782 / 187156879 / -1.6% 268138541 / 263249479 / +1.9% 0.69 / 0.71 / -3.4%
tpch_q10/datafusion:vortex-file-compressed 69797127 / 69975278 / -0.3% 124777120 / 139133403 / -10.3% 🟢 0.56 / 0.50 / +11.2%
tpch_q11/datafusion:vortex-file-compressed 46394925 / 45899013 / +1.1% 75984375 / 73505181 / +3.4% 0.61 / 0.62 / -2.2%
tpch_q12/datafusion:vortex-file-compressed 35088663 / 36102062 / -2.8% 75476797 / 87064471 / -13.3% 🟢 0.46 / 0.41 / +12.1%
tpch_q13/datafusion:vortex-file-compressed 49574601 / 48767446 / +1.7% 81636510 / 87221236 / -6.4% 0.61 / 0.56 / +8.6%
tpch_q14/datafusion:vortex-file-compressed 20325879 / 20717277 / -1.9% 87864133 / 85471112 / +2.8% 0.23 / 0.24 / -4.6%
tpch_q15/datafusion:vortex-file-compressed 32544608 / 32901332 / -1.1% 91747713 / 93707983 / -2.1% 0.35 / 0.35 / +1.0%
tpch_q16/datafusion:vortex-file-compressed 37100346 / 37059762 / +0.1% 67916390 / 69223231 / -1.9% 0.55 / 0.54 / +2.0%
tpch_q17/datafusion:vortex-file-compressed 176391560 / 174930406 / +0.8% 224061344 / 225373349 / -0.6% 0.79 / 0.78 / +1.4%
tpch_q18/datafusion:vortex-file-compressed 207689357 / 209739909 / -1.0% 267523974 / 268131115 / -0.2% 0.78 / 0.78 / -0.8%
tpch_q19/datafusion:vortex-file-compressed 27988755 / 28712267 / -2.5% 84777051 / 84511562 / +0.3% 0.33 / 0.34 / -2.8%
tpch_q20/datafusion:vortex-file-compressed 60396671 / 60221894 / +0.3% 113803659 / 120164665 / -5.3% 0.53 / 0.50 / +5.9%
tpch_q21/datafusion:vortex-file-compressed 180946936 / 182241011 / -0.7% 226148871 / 234987819 / -3.8% 0.80 / 0.78 / +3.2%
tpch_q22/datafusion:vortex-file-compressed 25519305 / 25639277 / -0.5% 54447937 / 53593032 / +1.6% 0.47 / 0.48 / -2.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87548449 / 87464321 / +0.1% 132481153 / 133128494 / -0.5% 0.66 / 0.66 / +0.6%
tpch_q02/datafusion:parquet 174338525 / 173901198 / +0.3% 201689907 / 201240630 / +0.2% 0.86 / 0.86 / +0.0%
tpch_q03/datafusion:parquet 135073130 / 135239208 / -0.1% 185829030 / 182608259 / +1.8% 0.73 / 0.74 / -1.9%
tpch_q04/datafusion:parquet 57524917 / 56498805 / +1.8% 93730396 / 91930326 / +2.0% 0.61 / 0.61 / -0.1%
tpch_q05/datafusion:parquet 167053412 / 166420207 / +0.4% 226705243 / 220986347 / +2.6% 0.74 / 0.75 / -2.2%
tpch_q06/datafusion:parquet 36445756 / 36283076 / +0.4% 80344034 / 77269516 / +4.0% 0.45 / 0.47 / -3.4%
tpch_q07/datafusion:parquet 215089435 / 215637675 / -0.3% 277651569 / 277313882 / +0.1% 0.77 / 0.78 / -0.4%
tpch_q08/datafusion:parquet 217623377 / 216645483 / +0.5% 287502750 / 283906791 / +1.3% 0.76 / 0.76 / -0.8%
tpch_q09/datafusion:parquet 310312521 / 308117800 / +0.7% 375675360 / 375009445 / +0.2% 0.83 / 0.82 / +0.5%
tpch_q10/datafusion:parquet 311258761 / 311041176 / +0.1% 370147411 / 371551549 / -0.4% 0.84 / 0.84 / +0.4%
tpch_q11/datafusion:parquet 126658486 / 127645357 / -0.8% 149963698 / 152187768 / -1.5% 0.84 / 0.84 / +0.7%
tpch_q12/datafusion:parquet 82422642 / 82479687 / -0.1% 122273820 / 120305559 / +1.6% 0.67 / 0.69 / -1.7%
tpch_q13/datafusion:parquet 210614342 / 210304730 / +0.1% 245183000 / 241250570 / +1.6% 0.86 / 0.87 / -1.5%
tpch_q14/datafusion:parquet 86580383 / 85580201 / +1.2% 193331115 / 190586859 / +1.4% 0.45 / 0.45 / -0.3%
tpch_q15/datafusion:parquet 104918729 / 106624719 / -1.6% 158586334 / 158006681 / +0.4% 0.66 / 0.67 / -2.0%
tpch_q16/datafusion:parquet 96842407 / 94936236 / +2.0% 121597411 / 124612410 / -2.4% 0.80 / 0.76 / +4.5%
tpch_q17/datafusion:parquet 214127847 / 216384924 / -1.0% 269845722 / 258393436 / +4.4% 0.79 / 0.84 / -5.2%
tpch_q18/datafusion:parquet 268224572 / 270180642 / -0.7% 320620919 / 319108544 / +0.5% 0.84 / 0.85 / -1.2%
tpch_q19/datafusion:parquet 108236987 / 108446648 / -0.2% 167494350 / 170545739 / -1.8% 0.65 / 0.64 / +1.6%
tpch_q20/datafusion:parquet 184949212 / 185118786 / -0.1% 246095874 / 262630403 / -6.3% 0.75 / 0.70 / +6.6%
tpch_q21/datafusion:parquet 245169477 / 244617361 / +0.2% 313420682 / 318746941 / -1.7% 0.78 / 0.77 / +1.9%
tpch_q22/datafusion:parquet 150045533 / 150381714 / -0.2% 173122805 / 180485247 / -4.1% 0.87 / 0.83 / +4.0%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33923952 / 32511072 / +4.3% 67972692 / 67835623 / +0.2% 0.50 / 0.48 / +4.1%
tpch_q02/duckdb:vortex-file-compressed 28635432 / 28295187 / +1.2% 42661761 / 42836397 / -0.4% 0.67 / 0.66 / +1.6%
tpch_q03/duckdb:vortex-file-compressed 51470226 / 51960375 / -0.9% 93897861 / 101756870 / -7.7% 0.55 / 0.51 / +7.3%
tpch_q04/duckdb:vortex-file-compressed 49500577 / 51520049 / -3.9% 81495809 / 88785284 / -8.2% 0.61 / 0.58 / +4.7%
tpch_q05/duckdb:vortex-file-compressed 68436532 / 68497859 / -0.1% 102714379 / 110099617 / -6.7% 0.67 / 0.62 / +7.1%
tpch_q06/duckdb:vortex-file-compressed 15192566 / 14965980 / +1.5% 50519274 / 49838561 / +1.4% 0.30 / 0.30 / +0.1%
tpch_q07/duckdb:vortex-file-compressed 54502974 / 53620450 / +1.6% 101925849 / 109839719 / -7.2% 0.53 / 0.49 / +9.5%
tpch_q08/duckdb:vortex-file-compressed 84674486 / 85359804 / -0.8% 124933627 / 130311123 / -4.1% 0.68 / 0.66 / +3.5%
tpch_q09/duckdb:vortex-file-compressed 104185935 / 103673094 / +0.5% 151272591 / 158945441 / -4.8% 0.69 / 0.65 / +5.6%
tpch_q10/duckdb:vortex-file-compressed 95216296 / 95864153 / -0.7% 139438497 / 152014206 / -8.3% 0.68 / 0.63 / +8.3%
tpch_q11/duckdb:vortex-file-compressed 13539771 / 13526756 / +0.1% 29852059 / 28035958 / +6.5% 0.45 / 0.48 / -6.0%
tpch_q12/duckdb:vortex-file-compressed 45292583 / 45317947 / -0.1% 77590242 / 85057459 / -8.8% 0.58 / 0.53 / +9.6%
tpch_q13/duckdb:vortex-file-compressed 72031678 / 71573995 / +0.6% 94981287 / 100407503 / -5.4% 0.76 / 0.71 / +6.4%
tpch_q14/duckdb:vortex-file-compressed 27974629 / 27600038 / +1.4% 72370618 / 74643140 / -3.0% 0.39 / 0.37 / +4.5%
tpch_q15/duckdb:vortex-file-compressed 23745302 / 23938909 / -0.8% 63186622 / 64166219 / -1.5% 0.38 / 0.37 / +0.7%
tpch_q16/duckdb:vortex-file-compressed 48878990 / 49224984 / -0.7% 56376353 / 59957277 / -6.0% 0.87 / 0.82 / +5.6%
tpch_q17/duckdb:vortex-file-compressed 34614480 / 35535952 / -2.6% 67291140 / 65906915 / +2.1% 0.51 / 0.54 / -4.6%
tpch_q18/duckdb:vortex-file-compressed 103094170 / 110585786 / -6.8% 114735562 / 122063073 / -6.0% 0.90 / 0.91 / -0.8%
tpch_q19/duckdb:vortex-file-compressed 27868802 / 26844025 / +3.8% 74380246 / 72668058 / +2.4% 0.37 / 0.37 / +1.4%
tpch_q20/duckdb:vortex-file-compressed 41277438 / 40937893 / +0.8% 94494288 / 91847421 / +2.9% 0.44 / 0.45 / -2.0%
tpch_q21/duckdb:vortex-file-compressed 91894089 / 91678494 / +0.2% 142414428 / 150764035 / -5.5% 0.65 / 0.61 / +6.1%
tpch_q22/duckdb:vortex-file-compressed 33420147 / 33015962 / +1.2% 49193974 / 49139982 / +0.1% 0.68 / 0.67 / +1.1%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67764906 / 67911658 / -0.2% 88938660 / 91419845 / -2.7% 0.76 / 0.74 / +2.6%
tpch_q02/duckdb:parquet 86949039 / 87726752 / -0.9% 97604719 / 98427950 / -0.8% 0.89 / 0.89 / -0.1%
tpch_q03/duckdb:parquet 110363101 / 110839842 / -0.4% 145629086 / 141782190 / +2.7% 0.76 / 0.78 / -3.1%
tpch_q04/duckdb:parquet 76269298 / 77438003 / -1.5% 97080270 / 99458999 / -2.4% 0.79 / 0.78 / +0.9%
tpch_q05/duckdb:parquet 123905263 / 123923751 / -0.0% 158228431 / 156519053 / +1.1% 0.78 / 0.79 / -1.1%
tpch_q06/duckdb:parquet 35629625 / 35831063 / -0.6% 62749482 / 59302413 / +5.8% 0.57 / 0.60 / -6.0%
tpch_q07/duckdb:parquet 117540756 / 119049789 / -1.3% 152156268 / 155294853 / -2.0% 0.77 / 0.77 / +0.8%
tpch_q08/duckdb:parquet 148161311 / 148520510 / -0.2% 191646651 / 191402669 / +0.1% 0.77 / 0.78 / -0.4%
tpch_q09/duckdb:parquet 237798011 / 235284226 / +1.1% 281995933 / 284114730 / -0.7% 0.84 / 0.83 / +1.8%
tpch_q10/duckdb:parquet 313106100 / 314116732 / -0.3% 337134166 / 337874255 / -0.2% 0.93 / 0.93 / -0.1%
tpch_q11/duckdb:parquet 43751494 / 43565036 / +0.4% 50873576 / 50139452 / +1.5% 0.86 / 0.87 / -1.0%
tpch_q12/duckdb:parquet 71296277 / 69657504 / +2.4% 92738032 / 91849007 / +1.0% 0.77 / 0.76 / +1.4%
tpch_q13/duckdb:parquet 293037026 / 292083076 / +0.3% 308650341 / 308441087 / +0.1% 0.95 / 0.95 / +0.3%
tpch_q14/duckdb:parquet 105424163 / 100794148 / +4.6% 146082172 / 144671155 / +1.0% 0.72 / 0.70 / +3.6%
tpch_q15/duckdb:parquet 57703458 / 57396004 / +0.5% 87378735 / 85651643 / +2.0% 0.66 / 0.67 / -1.5%
tpch_q16/duckdb:parquet 100614423 / 100671352 / -0.1% 107595041 / 107971035 / -0.3% 0.94 / 0.93 / +0.3%
tpch_q17/duckdb:parquet 83934032 / 83350690 / +0.7% 118021786 / 123074513 / -4.1% 0.71 / 0.68 / +5.0%
tpch_q18/duckdb:parquet 139176229 / 156561637 / -11.1% 🟢 174881433 / 174134230 / +0.4% 0.80 / 0.90 / -11.5%
tpch_q19/duckdb:parquet 98078081 / 99413979 / -1.3% 139820856 / 135538738 / +3.2% 0.70 / 0.73 / -4.4%
tpch_q20/duckdb:parquet 147305500 / 147775829 / -0.3% 185243706 / 196829865 / -5.9% 0.80 / 0.75 / +5.9%
tpch_q21/duckdb:parquet 252403367 / 249817240 / +1.0% 268685033 / 275134547 / -2.3% 0.94 / 0.91 / +3.5%
tpch_q22/duckdb:parquet 168502364 / 168567606 / -0.0% 181266944 / 181195537 / +0.0% 0.93 / 0.93 / -0.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (+2.4%, low confidence) · DuckDB No clear signal (+3.0%, low confidence)
Vortex (geomean): hot 1.034x ➖ · cold 1.020x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.7% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.032x ➖, 1↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21861712 / 21805097 / +0.3% 41297647 / 41009658 / +0.7% 0.53 / 0.53 / -0.4%
tpcds_q02/datafusion:vortex-file-compressed 42850493 / 42911902 / -0.1% 65404356 / 64583377 / +1.3% 0.66 / 0.66 / -1.4%
tpcds_q03/datafusion:vortex-file-compressed 11845614 / 11700964 / +1.2% 29473479 / 29309818 / +0.6% 0.40 / 0.40 / +0.7%
tpcds_q04/datafusion:vortex-file-compressed 83360624 / 79405334 / +5.0% 113374898 / 110411020 / +2.7% 0.74 / 0.72 / +2.2%
tpcds_q05/datafusion:vortex-file-compressed 56727646 / 56125140 / +1.1% 84971185 / 81313163 / +4.5% 0.67 / 0.69 / -3.3%
tpcds_q06/datafusion:vortex-file-compressed 23290060 / 21786838 / +6.9% 43668350 / 42503610 / +2.7% 0.53 / 0.51 / +4.0%
tpcds_q07/datafusion:vortex-file-compressed 27178824 / 26197772 / +3.7% 51260454 / 48391196 / +5.9% 0.53 / 0.54 / -2.1%
tpcds_q08/datafusion:vortex-file-compressed 25681294 / 25534194 / +0.6% 46404891 / 47465337 / -2.2% 0.55 / 0.54 / +2.9%
tpcds_q09/datafusion:vortex-file-compressed 19709430 / 20608778 / -4.4% 37918255 / 37814368 / +0.3% 0.52 / 0.54 / -4.6%
tpcds_q10/datafusion:vortex-file-compressed 33209104 / 30489908 / +8.9% 56090615 / 53059106 / +5.7% 0.59 / 0.57 / +3.0%
tpcds_q11/datafusion:vortex-file-compressed 50243476 / 49837302 / +0.8% 77909127 / 77901356 / +0.0% 0.64 / 0.64 / +0.8%
tpcds_q12/datafusion:vortex-file-compressed 15452114 / 15250332 / +1.3% 34917766 / 33946914 / +2.9% 0.44 / 0.45 / -1.5%
tpcds_q13/datafusion:vortex-file-compressed 32339460 / 30824930 / +4.9% 58536415 / 56856679 / +3.0% 0.55 / 0.54 / +1.9%
tpcds_q14/datafusion:vortex-file-compressed 489377842 / 490363839 / -0.2% 544561009 / 547328237 / -0.5% 0.90 / 0.90 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 13228552 / 12332376 / +7.3% 33089309 / 31673259 / +4.5% 0.40 / 0.39 / +2.7%
tpcds_q16/datafusion:vortex-file-compressed 19328980 / 18530371 / +4.3% 38849539 / 37553487 / +3.5% 0.50 / 0.49 / +0.8%
tpcds_q17/datafusion:vortex-file-compressed 53951556 / 53127470 / +1.6% 75943127 / 75078802 / +1.2% 0.71 / 0.71 / +0.4%
tpcds_q18/datafusion:vortex-file-compressed 56361058 / 63271659 / -10.9% 🟢 75336513 / 73382700 / +2.7% 0.75 / 0.86 / -13.2%
tpcds_q19/datafusion:vortex-file-compressed 18215540 / 17168770 / +6.1% 40348611 / 39315530 / +2.6% 0.45 / 0.44 / +3.4%
tpcds_q20/datafusion:vortex-file-compressed 16674428 / 16469372 / +1.2% 35120545 / 34188606 / +2.7% 0.47 / 0.48 / -1.4%
tpcds_q21/datafusion:vortex-file-compressed 15189366 / 14678799 / +3.5% 36530320 / 34017274 / +7.4% 0.42 / 0.43 / -3.6%
tpcds_q22/datafusion:vortex-file-compressed 49595656 / 49522164 / +0.1% 70678844 / 72008555 / -1.8% 0.70 / 0.69 / +2.0%
tpcds_q23/datafusion:vortex-file-compressed 73579079 / 72350974 / +1.7% 104198804 / 98966253 / +5.3% 0.71 / 0.73 / -3.4%
tpcds_q24/datafusion:vortex-file-compressed 65471434 / 63944944 / +2.4% 88298715 / 86553265 / +2.0% 0.74 / 0.74 / +0.4%
tpcds_q25/datafusion:vortex-file-compressed 46225178 / 45915984 / +0.7% 73017712 / 71396514 / +2.3% 0.63 / 0.64 / -1.6%
tpcds_q26/datafusion:vortex-file-compressed 27765556 / 26777058 / +3.7% 46987973 / 45421520 / +3.4% 0.59 / 0.59 / +0.2%
tpcds_q27/datafusion:vortex-file-compressed 55747846 / 51687021 / +7.9% 75959693 / 81156834 / -6.4% 0.73 / 0.64 / +15.2%
tpcds_q28/datafusion:vortex-file-compressed 18891202 / 18921609 / -0.2% 40252184 / 39101506 / +2.9% 0.47 / 0.48 / -3.0%
tpcds_q29/datafusion:vortex-file-compressed 53370376 / 51112462 / +4.4% 72696899 / 75990781 / -4.3% 0.73 / 0.67 / +9.1%
tpcds_q30/datafusion:vortex-file-compressed 28142568 / 27850826 / +1.0% 47914077 / 48192376 / -0.6% 0.59 / 0.58 / +1.6%
tpcds_q31/datafusion:vortex-file-compressed 66608304 / 63025460 / +5.7% 96644521 / 89842797 / +7.6% 0.69 / 0.70 / -1.8%
tpcds_q32/datafusion:vortex-file-compressed 13160786 / 12654292 / +4.0% 31531142 / 30609275 / +3.0% 0.42 / 0.41 / +1.0%
tpcds_q33/datafusion:vortex-file-compressed 29917842 / 28600529 / +4.6% 53729660 / 49679315 / +8.2% 0.56 / 0.58 / -3.3%
tpcds_q34/datafusion:vortex-file-compressed 19022906 / 17491330 / +8.8% 40846109 / 37164695 / +9.9% 0.47 / 0.47 / -1.0%
tpcds_q35/datafusion:vortex-file-compressed 33853225 / 30676175 / +10.4% 🔴 59132351 / 54945718 / +7.6% 0.57 / 0.56 / +2.5%
tpcds_q36/datafusion:vortex-file-compressed 48700894 / 47175469 / +3.2% 69523320 / 67342112 / +3.2% 0.70 / 0.70 / -0.0%
tpcds_q37/datafusion:vortex-file-compressed 12996328 / 12649240 / +2.7% 35384312 / 36061348 / -1.9% 0.37 / 0.35 / +4.7%
tpcds_q38/datafusion:vortex-file-compressed 28090648 / 26114874 / +7.6% 50263202 / 48366837 / +3.9% 0.56 / 0.54 / +3.5%
tpcds_q39/datafusion:vortex-file-compressed 64281024 / 64937470 / -1.0% 88495206 / 91331162 / -3.1% 0.73 / 0.71 / +2.2%
tpcds_q40/datafusion:vortex-file-compressed 23318537 / 22888785 / +1.9% 42250762 / 41056735 / +2.9% 0.55 / 0.56 / -1.0%
tpcds_q41/datafusion:vortex-file-compressed 20048225 / 19922006 / +0.6% 32925656 / 32648058 / +0.9% 0.61 / 0.61 / -0.2%
tpcds_q42/datafusion:vortex-file-compressed 11731604 / 11697122 / +0.3% 28453157 / 28559722 / -0.4% 0.41 / 0.41 / +0.7%
tpcds_q43/datafusion:vortex-file-compressed 13302442 / 13020351 / +2.2% 34003196 / 33348757 / +2.0% 0.39 / 0.39 / +0.2%
tpcds_q44/datafusion:vortex-file-compressed 27848230 / 27246425 / +2.2% 50022527 / 52299139 / -4.4% 0.56 / 0.52 / +6.9%
tpcds_q45/datafusion:vortex-file-compressed 17494763 / 17289717 / +1.2% 39631886 / 37430498 / +5.9% 0.44 / 0.46 / -4.4%
tpcds_q46/datafusion:vortex-file-compressed 25633587 / 23518224 / +9.0% 49395805 / 47033807 / +5.0% 0.52 / 0.50 / +3.8%
tpcds_q47/datafusion:vortex-file-compressed 76083772 / 75573638 / +0.7% 106048716 / 107017460 / -0.9% 0.72 / 0.71 / +1.6%
tpcds_q48/datafusion:vortex-file-compressed 29943294 / 29351126 / +2.0% 54023711 / 53487181 / +1.0% 0.55 / 0.55 / +1.0%
tpcds_q49/datafusion:vortex-file-compressed 57688303 / 56162740 / +2.7% 80121949 / 75859897 / +5.6% 0.72 / 0.74 / -2.7%
tpcds_q50/datafusion:vortex-file-compressed 31724194 / 30951990 / +2.5% 52148994 / 52303422 / -0.3% 0.61 / 0.59 / +2.8%
tpcds_q51/datafusion:vortex-file-compressed 66870893 / 66518802 / +0.5% 92011628 / 90983629 / +1.1% 0.73 / 0.73 / -0.6%
tpcds_q52/datafusion:vortex-file-compressed 12261707 / 12284219 / -0.2% 29921427 / 29425131 / +1.7% 0.41 / 0.42 / -1.8%
tpcds_q53/datafusion:vortex-file-compressed 18614076 / 18195045 / +2.3% 40345514 / 39979896 / +0.9% 0.46 / 0.46 / +1.4%
tpcds_q54/datafusion:vortex-file-compressed 33207885 / 32417366 / +2.4% 57833178 / 55625757 / +4.0% 0.57 / 0.58 / -1.5%
tpcds_q55/datafusion:vortex-file-compressed 11665455 / 11433533 / +2.0% 28404024 / 27400110 / +3.7% 0.41 / 0.42 / -1.6%
tpcds_q56/datafusion:vortex-file-compressed 28257723 / 26781370 / +5.5% 50520174 / 48541908 / +4.1% 0.56 / 0.55 / +1.4%
tpcds_q57/datafusion:vortex-file-compressed 62692346 / 62266736 / +0.7% 89447736 / 88439979 / +1.1% 0.70 / 0.70 / -0.5%
tpcds_q58/datafusion:vortex-file-compressed 40518017 / 40890432 / -0.9% 67891178 / 68182278 / -0.4% 0.60 / 0.60 / -0.5%
tpcds_q59/datafusion:vortex-file-compressed 27996524 / 27729321 / +1.0% 56362691 / 54304550 / +3.8% 0.50 / 0.51 / -2.7%
tpcds_q60/datafusion:vortex-file-compressed 28001430 / 26518096 / +5.6% 50202222 / 48005421 / +4.6% 0.56 / 0.55 / +1.0%
tpcds_q61/datafusion:vortex-file-compressed 22405942 / 20310566 / +10.3% 🔴 44183072 / 42190655 / +4.7% 0.51 / 0.48 / +5.3%
tpcds_q62/datafusion:vortex-file-compressed 16572874 / 16546332 / +0.2% 35266521 / 36188256 / -2.5% 0.47 / 0.46 / +2.8%
tpcds_q63/datafusion:vortex-file-compressed 18720188 / 18101046 / +3.4% 40712772 / 39111272 / +4.1% 0.46 / 0.46 / -0.6%
tpcds_q64/datafusion:vortex-file-compressed 193957424 / 190925665 / +1.6% 227305934 / 229889990 / -1.1% 0.85 / 0.83 / +2.7%
tpcds_q65/datafusion:vortex-file-compressed 75297922 / 73941309 / +1.8% 98723939 / 95692729 / +3.2% 0.76 / 0.77 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed 50068632 / 49969578 / +0.2% 72872551 / 70272675 / +3.7% 0.69 / 0.71 / -3.4%
tpcds_q67/datafusion:vortex-file-compressed 52708128 / 50760707 / +3.8% 84868103 / 85420097 / -0.6% 0.62 / 0.59 / +4.5%
tpcds_q68/datafusion:vortex-file-compressed 25627105 / 23063395 / +11.1% 🔴 48314508 / 45895277 / +5.3% 0.53 / 0.50 / +5.6%
tpcds_q69/datafusion:vortex-file-compressed 31721392 / 27106578 / +17.0% 🔴 53468989 / 49113098 / +8.9% 0.59 / 0.55 / +7.5%
tpcds_q70/datafusion:vortex-file-compressed 74239122 / 72999276 / +1.7% 94905239 / 97001414 / -2.2% 0.78 / 0.75 / +3.9%
tpcds_q71/datafusion:vortex-file-compressed 20400896 / 19683316 / +3.6% 39920031 / 39414571 / +1.3% 0.51 / 0.50 / +2.3%
tpcds_q72/datafusion:vortex-file-compressed 269051607 / 274897580 / -2.1% 201776901 / 212109197 / -4.9% 1.33 / 1.30 / +2.9%
tpcds_q73/datafusion:vortex-file-compressed 18826170 / 16512666 / +14.0% 🔴 39535404 / 38194369 / +3.5% 0.48 / 0.43 / +10.1%
tpcds_q74/datafusion:vortex-file-compressed 42369012 / 40857726 / +3.7% 68921645 / 69440352 / -0.7% 0.61 / 0.59 / +4.5%
tpcds_q75/datafusion:vortex-file-compressed 137243444 / 137608348 / -0.3% 171585631 / 158036023 / +8.6% 0.80 / 0.87 / -8.1%
tpcds_q76/datafusion:vortex-file-compressed 29531819 / 28944332 / +2.0% 49498062 / 49908467 / -0.8% 0.60 / 0.58 / +2.9%
tpcds_q77/datafusion:vortex-file-compressed 45300794 / 46774752 / -3.2% 69277530 / 67813263 / +2.2% 0.65 / 0.69 / -5.2%
tpcds_q78/datafusion:vortex-file-compressed 62580808 / 61125220 / +2.4% 91076902 / 91029710 / +0.1% 0.69 / 0.67 / +2.3%
tpcds_q79/datafusion:vortex-file-compressed 21901592 / 20097484 / +9.0% 44086431 / 45027454 / -2.1% 0.50 / 0.45 / +11.3%
tpcds_q80/datafusion:vortex-file-compressed 68563539 / 68448161 / +0.2% 99951470 / 94327710 / +6.0% 0.69 / 0.73 / -5.5%
tpcds_q81/datafusion:vortex-file-compressed 27911914 / 27864128 / +0.2% 48789941 / 47546647 / +2.6% 0.57 / 0.59 / -2.4%
tpcds_q82/datafusion:vortex-file-compressed 12874732 / 12560262 / +2.5% 36205245 / 34174027 / +5.9% 0.36 / 0.37 / -3.2%
tpcds_q83/datafusion:vortex-file-compressed 34873554 / 34640452 / +0.7% 54726109 / 56528043 / -3.2% 0.64 / 0.61 / +4.0%
tpcds_q84/datafusion:vortex-file-compressed 10374902 / 10337635 / +0.4% 26684201 / 27656900 / -3.5% 0.39 / 0.37 / +4.0%
tpcds_q85/datafusion:vortex-file-compressed 52537380 / 52931234 / -0.7% 78839768 / 80627595 / -2.2% 0.67 / 0.66 / +1.5%
tpcds_q86/datafusion:vortex-file-compressed 16349467 / 16250520 / +0.6% 35366931 / 35871001 / -1.4% 0.46 / 0.45 / +2.0%
tpcds_q87/datafusion:vortex-file-compressed 28931407 / 26718828 / +8.3% 51016613 / 48735015 / +4.7% 0.57 / 0.55 / +3.4%
tpcds_q88/datafusion:vortex-file-compressed 41030314 / 31424390 / +30.6% 🔴 65532928 / 52364327 / +25.1% 🔴 0.63 / 0.60 / +4.3%
tpcds_q89/datafusion:vortex-file-compressed 22073000 / 21559306 / +2.4% 44302646 / 43181637 / +2.6% 0.50 / 0.50 / -0.2%
tpcds_q90/datafusion:vortex-file-compressed 11780420 / 10556428 / +11.6% 🔴 27336064 / 25976794 / +5.2% 0.43 / 0.41 / +6.0%
tpcds_q91/datafusion:vortex-file-compressed 16775031 / 15928348 / +5.3% 36435731 / 37373848 / -2.5% 0.46 / 0.43 / +8.0%
tpcds_q92/datafusion:vortex-file-compressed 13266416 / 13283170 / -0.1% 30420560 / 30773277 / -1.1% 0.44 / 0.43 / +1.0%
tpcds_q93/datafusion:vortex-file-compressed 20111142 / 20487418 / -1.8% 40460070 / 41709133 / -3.0% 0.50 / 0.49 / +1.2%
tpcds_q94/datafusion:vortex-file-compressed 19086284 / 19002288 / +0.4% 37972031 / 37876582 / +0.3% 0.50 / 0.50 / +0.2%
tpcds_q95/datafusion:vortex-file-compressed 42191513 / 42360161 / -0.4% 63645503 / 62446949 / +1.9% 0.66 / 0.68 / -2.3%
tpcds_q96/datafusion:vortex-file-compressed 9090642 / 7643970 / +18.9% 🔴 27773503 / 25485214 / +9.0% 0.33 / 0.30 / +9.1%
tpcds_q97/datafusion:vortex-file-compressed 18668029 / 17513234 / +6.6% 40521794 / 38685824 / +4.7% 0.46 / 0.45 / +1.8%
tpcds_q98/datafusion:vortex-file-compressed 16212454 / 15985382 / +1.4% 38028116 / 35145651 / +8.2% 0.43 / 0.45 / -6.3%
tpcds_q99/datafusion:vortex-file-compressed 16532314 / 16346675 / +1.1% 35013150 / 33949516 / +3.1% 0.47 / 0.48 / -1.9%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42441220 / 42272875 / +0.4% 61684876 / 64631392 / -4.6% 0.69 / 0.65 / +5.2%
tpcds_q02/datafusion:parquet 54980363 / 54917202 / +0.1% 72020863 / 71390560 / +0.9% 0.76 / 0.77 / -0.8%
tpcds_q03/datafusion:parquet 18936584 / 18921073 / +0.1% 31814630 / 32388034 / -1.8% 0.60 / 0.58 / +1.9%
tpcds_q04/datafusion:parquet 177979796 / 178610230 / -0.4% 204424996 / 207901122 / -1.7% 0.87 / 0.86 / +1.3%
tpcds_q05/datafusion:parquet 68250815 / 67902707 / +0.5% 88838077 / 90511669 / -1.8% 0.77 / 0.75 / +2.4%
tpcds_q06/datafusion:parquet 33966937 / 34595290 / -1.8% 49552275 / 47713437 / +3.9% 0.69 / 0.73 / -5.5%
tpcds_q07/datafusion:parquet 47193598 / 46918100 / +0.6% 66888014 / 67605881 / -1.1% 0.71 / 0.69 / +1.7%
tpcds_q08/datafusion:parquet 31423992 / 31373242 / +0.2% 49345830 / 47443469 / +4.0% 0.64 / 0.66 / -3.7%
tpcds_q09/datafusion:parquet 33549202 / 32120464 / +4.4% 44969961 / 43715946 / +2.9% 0.75 / 0.73 / +1.5%
tpcds_q10/datafusion:parquet 43729476 / 43600320 / +0.3% 62075777 / 59945108 / +3.6% 0.70 / 0.73 / -3.1%
tpcds_q11/datafusion:parquet 97769827 / 96386662 / +1.4% 125096165 / 118087376 / +5.9% 0.78 / 0.82 / -4.2%
tpcds_q12/datafusion:parquet 23936646 / 23511908 / +1.8% 37514899 / 33949292 / +10.5% 🔴 0.64 / 0.69 / -7.9%
tpcds_q13/datafusion:parquet 47088319 / 46587421 / +1.1% 71046125 / 64330648 / +10.4% 🔴 0.66 / 0.72 / -8.5%
tpcds_q14/datafusion:parquet 535463802 / 534729701 / +0.1% 582491772 / 585322484 / -0.5% 0.92 / 0.91 / +0.6%
tpcds_q15/datafusion:parquet 24206756 / 23387204 / +3.5% 39765984 / 37846734 / +5.1% 0.61 / 0.62 / -1.5%
tpcds_q16/datafusion:parquet 37207996 / 36485332 / +2.0% 52777340 / 49534366 / +6.5% 0.70 / 0.74 / -4.3%
tpcds_q17/datafusion:parquet 75116621 / 74331801 / +1.1% 100859602 / 99280720 / +1.6% 0.74 / 0.75 / -0.5%
tpcds_q18/datafusion:parquet 67934914 / 68276741 / -0.5% 89103105 / 89018161 / +0.1% 0.76 / 0.77 / -0.6%
tpcds_q19/datafusion:parquet 29855632 / 29651051 / +0.7% 43635804 / 43785262 / -0.3% 0.68 / 0.68 / +1.0%
tpcds_q20/datafusion:parquet 25657356 / 25231151 / +1.7% 38408112 / 37460272 / +2.5% 0.67 / 0.67 / -0.8%
tpcds_q21/datafusion:parquet 20386527 / 20272522 / +0.6% 33932468 / 30910818 / +9.8% 0.60 / 0.66 / -8.4%
tpcds_q22/datafusion:parquet 77904262 / 77954834 / -0.1% 90250931 / 88935442 / +1.5% 0.86 / 0.88 / -1.5%
tpcds_q23/datafusion:parquet 92459387 / 91385448 / +1.2% 115137886 / 117070650 / -1.7% 0.80 / 0.78 / +2.9%
tpcds_q24/datafusion:parquet 90995454 / 90021098 / +1.1% 115089545 / 115472607 / -0.3% 0.79 / 0.78 / +1.4%
tpcds_q25/datafusion:parquet 81525826 / 81971788 / -0.5% 107292029 / 98002880 / +9.5% 0.76 / 0.84 / -9.2%
tpcds_q26/datafusion:parquet 43661106 / 42463514 / +2.8% 60300279 / 60591877 / -0.5% 0.72 / 0.70 / +3.3%
tpcds_q27/datafusion:parquet 76188323 / 75470090 / +1.0% 98144386 / 96090021 / +2.1% 0.78 / 0.79 / -1.2%
tpcds_q28/datafusion:parquet 28747872 / 28284374 / +1.6% 43119415 / 44484962 / -3.1% 0.67 / 0.64 / +4.9%
tpcds_q29/datafusion:parquet 75161539 / 74347911 / +1.1% 97817859 / 98557357 / -0.8% 0.77 / 0.75 / +1.9%
tpcds_q30/datafusion:parquet 46303460 / 44821932 / +3.3% 58912260 / 57862447 / +1.8% 0.79 / 0.77 / +1.5%
tpcds_q31/datafusion:parquet 82570854 / 82451354 / +0.1% 98325141 / 100574861 / -2.2% 0.84 / 0.82 / +2.4%
tpcds_q32/datafusion:parquet 26657476 / 27073534 / -1.5% 41180969 / 44015117 / -6.4% 0.65 / 0.62 / +5.2%
tpcds_q33/datafusion:parquet 37441972 / 37776374 / -0.9% 54192496 / 53279306 / +1.7% 0.69 / 0.71 / -2.6%
tpcds_q34/datafusion:parquet 24361798 / 23781190 / +2.4% 36897733 / 35843094 / +2.9% 0.66 / 0.66 / -0.5%
tpcds_q35/datafusion:parquet 51748350 / 48810058 / +6.0% 63955362 / 68295632 / -6.4% 0.81 / 0.71 / +13.2%
tpcds_q36/datafusion:parquet 53315278 / 54881688 / -2.9% 71720723 / 71432486 / +0.4% 0.74 / 0.77 / -3.2%
tpcds_q37/datafusion:parquet 21278376 / 21371569 / -0.4% 34746098 / 33686725 / +3.1% 0.61 / 0.63 / -3.5%
tpcds_q38/datafusion:parquet 45638244 / 44457184 / +2.7% 64442640 / 61410213 / +4.9% 0.71 / 0.72 / -2.2%
tpcds_q39/datafusion:parquet 68579768 / 68398593 / +0.3% 86099031 / 83619283 / +3.0% 0.80 / 0.82 / -2.6%
tpcds_q40/datafusion:parquet 30857798 / 29467989 / +4.7% 52039006 / 49593972 / +4.9% 0.59 / 0.59 / -0.2%
tpcds_q41/datafusion:parquet 20080234 / 19739226 / +1.7% 34585544 / 32712313 / +5.7% 0.58 / 0.60 / -3.8%
tpcds_q42/datafusion:parquet 18148890 / 18221236 / -0.4% 30806103 / 30888985 / -0.3% 0.59 / 0.59 / -0.1%
tpcds_q43/datafusion:parquet 19240486 / 19203396 / +0.2% 33010097 / 31545827 / +4.6% 0.58 / 0.61 / -4.3%
tpcds_q44/datafusion:parquet 35191728 / 33491120 / +5.1% 52977541 / 48894425 / +8.4% 0.66 / 0.68 / -3.0%
tpcds_q45/datafusion:parquet 27846070 / 27385343 / +1.7% 40530016 / 41445232 / -2.2% 0.69 / 0.66 / +4.0%
tpcds_q46/datafusion:parquet 28847904 / 28779116 / +0.2% 46855293 / 45277419 / +3.5% 0.62 / 0.64 / -3.1%
tpcds_q47/datafusion:parquet 96114859 / 96650050 / -0.6% 120660387 / 119382173 / +1.1% 0.80 / 0.81 / -1.6%
tpcds_q48/datafusion:parquet 41759396 / 42123174 / -0.9% 61087300 / 61038495 / +0.1% 0.68 / 0.69 / -0.9%
tpcds_q49/datafusion:parquet 71849015 / 70619526 / +1.7% 96283662 / 92464270 / +4.1% 0.75 / 0.76 / -2.3%
tpcds_q50/datafusion:parquet 47363376 / 46459075 / +1.9% 68031875 / 66326231 / +2.6% 0.70 / 0.70 / -0.6%
tpcds_q51/datafusion:parquet 75047258 / 75075057 / -0.0% 93258666 / 94039907 / -0.8% 0.80 / 0.80 / +0.8%
tpcds_q52/datafusion:parquet 18749094 / 18580430 / +0.9% 30567011 / 31991513 / -4.5% 0.61 / 0.58 / +5.6%
tpcds_q53/datafusion:parquet 22106952 / 22418766 / -1.4% 40031220 / 38719120 / +3.4% 0.55 / 0.58 / -4.6%
tpcds_q54/datafusion:parquet 53770020 / 53666896 / +0.2% 70237108 / 67532375 / +4.0% 0.77 / 0.79 / -3.7%
tpcds_q55/datafusion:parquet 18257977 / 18178910 / +0.4% 32481278 / 30110914 / +7.9% 0.56 / 0.60 / -6.9%
tpcds_q56/datafusion:parquet 42582226 / 41217939 / +3.3% 58261004 / 56671239 / +2.8% 0.73 / 0.73 / +0.5%
tpcds_q57/datafusion:parquet 99721882 / 100813400 / -1.1% 114423429 / 119766236 / -4.5% 0.87 / 0.84 / +3.5%
tpcds_q58/datafusion:parquet 66092294 / 65379907 / +1.1% 84676865 / 82742676 / +2.3% 0.78 / 0.79 / -1.2%
tpcds_q59/datafusion:parquet 48187700 / 47165554 / +2.2% 66737402 / 64094994 / +4.1% 0.72 / 0.74 / -1.9%
tpcds_q60/datafusion:parquet 42258466 / 40340588 / +4.8% 56418269 / 53034920 / +6.4% 0.75 / 0.76 / -1.5%
tpcds_q61/datafusion:parquet 37577194 / 36298751 / +3.5% 51750820 / 51258926 / +1.0% 0.73 / 0.71 / +2.5%
tpcds_q62/datafusion:parquet 24994023 / 24915542 / +0.3% 39581491 / 39353199 / +0.6% 0.63 / 0.63 / -0.3%
tpcds_q63/datafusion:parquet 22226994 / 22259500 / -0.1% 40913907 / 38497596 / +6.3% 0.54 / 0.58 / -6.0%
tpcds_q64/datafusion:parquet 288328099 / 283566334 / +1.7% 325470927 / 325047747 / +0.1% 0.89 / 0.87 / +1.5%
tpcds_q65/datafusion:parquet 123347680 / 123402020 / -0.0% 140274112 / 133625443 / +5.0% 0.88 / 0.92 / -4.8%
tpcds_q66/datafusion:parquet 60925652 / 59198006 / +2.9% 77827215 / 76948603 / +1.1% 0.78 / 0.77 / +1.8%
tpcds_q67/datafusion:parquet 68624412 / 68226895 / +0.6% 93353214 / 92142312 / +1.3% 0.74 / 0.74 / -0.7%
tpcds_q68/datafusion:parquet 29043480 / 28399338 / +2.3% 49638928 / 48549753 / +2.2% 0.59 / 0.58 / +0.0%
tpcds_q69/datafusion:parquet 43430601 / 42887446 / +1.3% 56236467 / 56535933 / -0.5% 0.77 / 0.76 / +1.8%
tpcds_q70/datafusion:parquet 81082056 / 80485552 / +0.7% 98344482 / 96575813 / +1.8% 0.82 / 0.83 / -1.1%
tpcds_q71/datafusion:parquet 25392006 / 25189437 / +0.8% 38223033 / 37853314 / +1.0% 0.66 / 0.67 / -0.2%
tpcds_q72/datafusion:parquet 519581040 / 525655214 / -1.2% 551402575 / 552150724 / -0.1% 0.94 / 0.95 / -1.0%
tpcds_q73/datafusion:parquet 23848594 / 23800026 / +0.2% 37022439 / 36758046 / +0.7% 0.64 / 0.65 / -0.5%
tpcds_q74/datafusion:parquet 68064349 / 69127434 / -1.5% 87856356 / 87234240 / +0.7% 0.77 / 0.79 / -2.2%
tpcds_q75/datafusion:parquet 152375110 / 151286489 / +0.7% 178656326 / 183279436 / -2.5% 0.85 / 0.83 / +3.3%
tpcds_q76/datafusion:parquet 33086224 / 33423486 / -1.0% 48994294 / 48063203 / +1.9% 0.68 / 0.70 / -2.9%
tpcds_q77/datafusion:parquet 57138360 / 56596460 / +1.0% 75318856 / 73467648 / +2.5% 0.76 / 0.77 / -1.5%
tpcds_q78/datafusion:parquet 85733554 / 86344050 / -0.7% 117136823 / 119441584 / -1.9% 0.73 / 0.72 / +1.2%
tpcds_q79/datafusion:parquet 26964772 / 26910375 / +0.2% 42948533 / 41761718 / +2.8% 0.63 / 0.64 / -2.6%
tpcds_q80/datafusion:parquet 81225781 / 79961989 / +1.6% 108828970 / 108678343 / +0.1% 0.75 / 0.74 / +1.4%
tpcds_q81/datafusion:parquet 39366076 / 38627444 / +1.9% 52661937 / 52683010 / -0.0% 0.75 / 0.73 / +2.0%
tpcds_q82/datafusion:parquet 22494722 / 21909412 / +2.7% 34636557 / 36306515 / -4.6% 0.65 / 0.60 / +7.6%
tpcds_q83/datafusion:parquet 59384756 / 58235048 / +2.0% 74751772 / 75303168 / -0.7% 0.79 / 0.77 / +2.7%
tpcds_q84/datafusion:parquet 25585699 / 26005620 / -1.6% 40059522 / 41372464 / -3.2% 0.64 / 0.63 / +1.6%
tpcds_q85/datafusion:parquet 80229802 / 79670120 / +0.7% 103202617 / 103999786 / -0.8% 0.78 / 0.77 / +1.5%
tpcds_q86/datafusion:parquet 20915132 / 20774022 / +0.7% 33656976 / 33257714 / +1.2% 0.62 / 0.62 / -0.5%
tpcds_q87/datafusion:parquet 44440068 / 45656462 / -2.7% 59008148 / 63828528 / -7.6% 0.75 / 0.72 / +5.3%
tpcds_q88/datafusion:parquet 37656732 / 36764665 / +2.4% 51334887 / 50990440 / +0.7% 0.73 / 0.72 / +1.7%
tpcds_q89/datafusion:parquet 25747210 / 25510714 / +0.9% 42413024 / 42661819 / -0.6% 0.61 / 0.60 / +1.5%
tpcds_q90/datafusion:parquet 15225491 / 15962144 / -4.6% 25992182 / 26420644 / -1.6% 0.59 / 0.60 / -3.0%
tpcds_q91/datafusion:parquet 32245848 / 32920696 / -2.0% 47672797 / 46914899 / +1.6% 0.68 / 0.70 / -3.6%
tpcds_q92/datafusion:parquet 27102221 / 26952762 / +0.6% 39560760 / 43424062 / -8.9% 0.69 / 0.62 / +10.4%
tpcds_q93/datafusion:parquet 27730382 / 27142168 / +2.2% 47134700 / 46726994 / +0.9% 0.59 / 0.58 / +1.3%
tpcds_q94/datafusion:parquet 3534979 / 35224574 / +0.4% 49185132 / 50476527 / -2.6% 0.72 / 0.70 / +3.0%
tpcds_q95/datafusion:parquet 63024387 / 64849728 / -2.8% 78131354 / 80209208 / -2.6% 0.81 / 0.81 / -0.2%
tpcds_q96/datafusion:parquet 13117218 / 12984378 / +1.0% 23938542 / 25351720 / -5.6% 0.55 / 0.51 / +7.0%
tpcds_q97/datafusion:parquet 35372557 / 35235307 / +0.4% 50176987 / 51152066 / -1.9% 0.70 / 0.69 / +2.3%
tpcds_q98/datafusion:parquet 25017240 / 24399177 / +2.5% 39505916 / 38744932 / +2.0% 0.63 / 0.63 / +0.6%
tpcds_q99/datafusion:parquet 29491200 / 29764645 / -0.9% 42245142 / 42672215 / -1.0% 0.70 / 0.70 / +0.1%
duckdb / vortex-file-compressed / ns (1.037x ➖, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16206789 / 16045524 / +1.0% 25264077 / 24965755 / +1.2% 0.64 / 0.64 / -0.2%
tpcds_q02/duckdb:vortex-file-compressed 17512884 / 17742759 / -1.3% 23226774 / 23050928 / +0.8% 0.75 / 0.77 / -2.0%
tpcds_q03/duckdb:vortex-file-compressed 7568907 / 7055236 / +7.3% 16883186 / 16429246 / +2.8% 0.45 / 0.43 / +4.4%
tpcds_q04/duckdb:vortex-file-compressed 59207353 / 59122978 / +0.1% 71941224 / 72196743 / -0.4% 0.82 / 0.82 / +0.5%
tpcds_q05/duckdb:vortex-file-compressed 23327346 / 22907564 / +1.8% 32787145 / 33680071 / -2.7% 0.71 / 0.68 / +4.6%
tpcds_q06/duckdb:vortex-file-compressed 25668692 / 24043259 / +6.8% 38706006 / 38392408 / +0.8% 0.66 / 0.63 / +5.9%
tpcds_q07/duckdb:vortex-file-compressed 23054548 / 22496578 / +2.5% 35164117 / 35128140 / +0.1% 0.66 / 0.64 / +2.4%
tpcds_q08/duckdb:vortex-file-compressed 17797582 / 17385510 / +2.4% 25916809 / 25330891 / +2.3% 0.69 / 0.69 / +0.1%
tpcds_q09/duckdb:vortex-file-compressed 19389144 / 19257132 / +0.7% 29842450 / 29862908 / -0.1% 0.65 / 0.64 / +0.8%
tpcds_q10/duckdb:vortex-file-compressed 29338638 / 27927382 / +5.1% 44261771 / 41238193 / +7.3% 0.66 / 0.68 / -2.1%
tpcds_q11/duckdb:vortex-file-compressed 36356234 / 36598680 / -0.7% 46129751 / 45247086 / +2.0% 0.79 / 0.81 / -2.6%
tpcds_q12/duckdb:vortex-file-compressed 10570438 / 10326977 / +2.4% 17812018 / 16959090 / +5.0% 0.59 / 0.61 / -2.5%
tpcds_q13/duckdb:vortex-file-compressed 22202217 / 19742047 / +12.5% 🔴 35589971 / 33795959 / +5.3% 0.62 / 0.58 / +6.8%
tpcds_q14/duckdb:vortex-file-compressed 57020286 / 56134523 / +1.6% 65311309 / 65202655 / +0.2% 0.87 / 0.86 / +1.4%
tpcds_q15/duckdb:vortex-file-compressed 11755438 / 11037537 / +6.5% 19093913 / 17408069 / +9.7% 0.62 / 0.63 / -2.9%
tpcds_q16/duckdb:vortex-file-compressed 24764163 / 24529645 / +1.0% 35811981 / 34844975 / +2.8% 0.69 / 0.70 / -1.8%
tpcds_q17/duckdb:vortex-file-compressed 22219017 / 20310648 / +9.4% 34432596 / 33213816 / +3.7% 0.65 / 0.61 / +5.5%
tpcds_q18/duckdb:vortex-file-compressed 32772769 / 32196421 / +1.8% 43466410 / 42374778 / +2.6% 0.75 / 0.76 / -0.8%
tpcds_q19/duckdb:vortex-file-compressed 21953974 / 20462632 / +7.3% 31048032 / 29583422 / +5.0% 0.71 / 0.69 / +2.2%
tpcds_q20/duckdb:vortex-file-compressed 11162924 / 10734634 / +4.0% 18074499 / 17818501 / +1.4% 0.62 / 0.60 / +2.5%
tpcds_q21/duckdb:vortex-file-compressed 10412742 / 10479295 / -0.6% 23320101 / 23018552 / +1.3% 0.45 / 0.46 / -1.9%
tpcds_q22/duckdb:vortex-file-compressed 18210100 / 18151290 / +0.3% 31228534 / 30901601 / +1.1% 0.58 / 0.59 / -0.7%
tpcds_q23/duckdb:vortex-file-compressed 39049200 / 37699259 / +3.6% 52388320 / 48433402 / +8.2% 0.75 / 0.78 / -4.2%
tpcds_q24/duckdb:vortex-file-compressed 26706890 / 26280692 / +1.6% 37735130 / 35608393 / +6.0% 0.71 / 0.74 / -4.1%
tpcds_q25/duckdb:vortex-file-compressed 20914976 / 19159561 / +9.2% 33919148 / 31202748 / +8.7% 0.62 / 0.61 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed 22404674 / 21825218 / +2.7% 33207208 / 32367382 / +2.6% 0.67 / 0.67 / +0.1%
tpcds_q27/duckdb:vortex-file-compressed 25851240 / 24731122 / +4.5% 37860097 / 35846128 / +5.6% 0.68 / 0.69 / -1.0%
tpcds_q28/duckdb:vortex-file-compressed 15237575 / 15085510 / +1.0% 25696041 / 26504841 / -3.1% 0.59 / 0.57 / +4.2%
tpcds_q29/duckdb:vortex-file-compressed 20444887 / 18791395 / +8.8% 31726119 / 30876691 / +2.8% 0.64 / 0.61 / +5.9%
tpcds_q30/duckdb:vortex-file-compressed 18228704 / 18393538 / -0.9% 26615761 / 27476210 / -3.1% 0.68 / 0.67 / +2.3%
tpcds_q31/duckdb:vortex-file-compressed 19636102 / 17637073 / +11.3% 🔴 27843802 / 26157360 / +6.4% 0.71 / 0.67 / +4.6%
tpcds_q32/duckdb:vortex-file-compressed 10478010 / 10192816 / +2.8% 18099109 / 19125855 / -5.4% 0.58 / 0.53 / +8.6%
tpcds_q33/duckdb:vortex-file-compressed 19854908 / 17852596 / +11.2% 🔴 29821412 / 28066683 / +6.3% 0.67 / 0.64 / +4.7%
tpcds_q34/duckdb:vortex-file-compressed 13404452 / 13002898 / +3.1% 23473497 / 22700422 / +3.4% 0.57 / 0.57 / -0.3%
tpcds_q35/duckdb:vortex-file-compressed 33115426 / 30993438 / +6.8% 45197986 / 44429314 / +1.7% 0.73 / 0.70 / +5.0%
tpcds_q36/duckdb:vortex-file-compressed 14713506 / 13978545 / +5.3% 25297503 / 24459671 / +3.4% 0.58 / 0.57 / +1.8%
tpcds_q37/duckdb:vortex-file-compressed 9515228 / 9833248 / -3.2% 24628559 / 27131509 / -9.2% 0.39 / 0.36 / +6.6%
tpcds_q38/duckdb:vortex-file-compressed 25370564 / 24496920 / +3.6% 32409004 / 32299758 / +0.3% 0.78 / 0.76 / +3.2%
tpcds_q39/duckdb:vortex-file-compressed 19159647 / 18916844 / +1.3% 33310901 / 32633020 / +2.1% 0.58 / 0.58 / -0.8%
tpcds_q40/duckdb:vortex-file-compressed 11446613 / 11179762 / +2.4% 20033699 / 20812952 / -3.7% 0.57 / 0.54 / +6.4%
tpcds_q41/duckdb:vortex-file-compressed 17449352 / 17169621 / +1.6% 23533592 / 23741538 / -0.9% 0.74 / 0.72 / +2.5%
tpcds_q42/duckdb:vortex-file-compressed 7781372 / 6834123 / +13.9% 🔴 16813027 / 16293402 / +3.2% 0.46 / 0.42 / +10.3%
tpcds_q43/duckdb:vortex-file-compressed 10102744 / 10788812 / -6.4% 19467600 / 18770368 / +3.7% 0.52 / 0.57 / -9.7%
tpcds_q44/duckdb:vortex-file-compressed 12928658 / 12769238 / +1.2% 24730359 / 26124898 / -5.3% 0.52 / 0.49 / +7.0%
tpcds_q45/duckdb:vortex-file-compressed 24202538 / 23941972 / +1.1% 31641106 / 31183529 / +1.5% 0.76 / 0.77 / -0.4%
tpcds_q46/duckdb:vortex-file-compressed 32299678 / 31560232 / +2.3% 46057556 / 44353000 / +3.8% 0.70 / 0.71 / -1.4%
tpcds_q47/duckdb:vortex-file-compressed 31454943 / 30965890 / +1.6% 41894194 / 40418316 / +3.7% 0.75 / 0.77 / -2.0%
tpcds_q48/duckdb:vortex-file-compressed 24513844 / 22532740 / +8.8% 36497888 / 35945024 / +1.5% 0.67 / 0.63 / +7.1%
tpcds_q49/duckdb:vortex-file-compressed 19238006 / 18476728 / +4.1% 31077093 / 31177044 / -0.3% 0.62 / 0.59 / +4.5%
tpcds_q50/duckdb:vortex-file-compressed 15807454 / 14844408 / +6.5% 27751748 / 26287152 / +5.6% 0.57 / 0.56 / +0.9%
tpcds_q51/duckdb:vortex-file-compressed 49404984 / 48792890 / +1.3% 57295023 / 60378724 / -5.1% 0.86 / 0.81 / +6.7%
tpcds_q52/duckdb:vortex-file-compressed 7597492 / 7098110 / +7.0% 16666343 / 16160240 / +3.1% 0.46 / 0.44 / +3.8%
tpcds_q53/duckdb:vortex-file-compressed 12053062 / 11252382 / +7.1% 21736322 / 21289828 / +2.1% 0.55 / 0.53 / +4.9%
tpcds_q54/duckdb:vortex-file-compressed 20888623 / 19865192 / +5.2% 30265559 / 31370322 / -3.5% 0.69 / 0.63 / +9.0%
tpcds_q55/duckdb:vortex-file-compressed 7370538 / 6771400 / +8.8% 16508994 / 16563863 / -0.3% 0.45 / 0.41 / +9.2%
tpcds_q56/duckdb:vortex-file-compressed 19695355 / 18008058 / +9.4% 29436526 / 28499861 / +3.3% 0.67 / 0.63 / +5.9%
tpcds_q57/duckdb:vortex-file-compressed 25928601 / 25592498 / +1.3% 33366469 / 33936955 / -1.7% 0.78 / 0.75 / +3.0%
tpcds_q58/duckdb:vortex-file-compressed 21038836 / 20889130 / +0.7% 29978722 / 31169441 / -3.8% 0.70 / 0.67 / +4.7%
tpcds_q59/duckdb:vortex-file-compressed 20277122 / 19572163 / +3.6% 28294330 / 26102564 / +8.4% 0.72 / 0.75 / -4.4%
tpcds_q60/duckdb:vortex-file-compressed 19798688 / 18825724 / +5.2% 30357186 / 28936882 / +4.9% 0.65 / 0.65 / +0.2%
tpcds_q61/duckdb:vortex-file-compressed 21002859 / 20268450 / +3.6% 32522432 / 30686258 / +6.0% 0.65 / 0.66 / -2.2%
tpcds_q62/duckdb:vortex-file-compressed 11394788 / 11488194 / -0.8% 18674650 / 18535442 / +0.8% 0.61 / 0.62 / -1.6%
tpcds_q63/duckdb:vortex-file-compressed 11625326 / 10960590 / +6.1% 20526939 / 19974010 / +2.8% 0.57 / 0.55 / +3.2%
tpcds_q64/duckdb:vortex-file-compressed 55540618 / 52614274 / +5.6% 69900918 / 69854650 / +0.1% 0.79 / 0.75 / +5.5%
tpcds_q65/duckdb:vortex-file-compressed 13416789 / 12865098 / +4.3% 24823662 / 23230438 / +6.9% 0.54 / 0.55 / -2.4%
tpcds_q66/duckdb:vortex-file-compressed 32811954 / 31298825 / +4.8% 38575371 / 39108470 / -1.4% 0.85 / 0.80 / +6.3%
tpcds_q67/duckdb:vortex-file-compressed 56193476 / 55160962 / +1.9% 67880341 / 65118710 / +4.2% 0.83 / 0.85 / -2.3%
tpcds_q68/duckdb:vortex-file-compressed 23579934 / 22778809 / +3.5% 36911183 / 35490210 / +4.0% 0.64 / 0.64 / -0.5%
tpcds_q69/duckdb:vortex-file-compressed 25355024 / 22765211 / +11.4% 🔴 39882645 / 37739926 / +5.7% 0.64 / 0.60 / +5.4%
tpcds_q70/duckdb:vortex-file-compressed 15354648 / 14477612 / +6.1% 26350408 / 26141385 / +0.8% 0.58 / 0.55 / +5.2%
tpcds_q71/duckdb:vortex-file-compressed 14815449 / 14460726 / +2.5% 25274732 / 23370622 / +8.1% 0.59 / 0.62 / -5.3%
tpcds_q72/duckdb:vortex-file-compressed 43584708 / 42998650 / +1.4% 58078617 / 57260312 / +1.4% 0.75 / 0.75 / -0.1%
tpcds_q73/duckdb:vortex-file-compressed 12318424 / 11782168 / +4.6% 22628845 / 21079076 / +7.4% 0.54 / 0.56 / -2.6%
tpcds_q74/duckdb:vortex-file-compressed 31937830 / 31586609 / +1.1% 40622837 / 41076713 / -1.1% 0.79 / 0.77 / +2.2%
tpcds_q75/duckdb:vortex-file-compressed 37952066 / 37123444 / +2.2% 50750970 / 50604481 / +0.3% 0.75 / 0.73 / +1.9%
tpcds_q76/duckdb:vortex-file-compressed 13067736 / 12730804 / +2.6% 23404839 / 22433302 / +4.3% 0.56 / 0.57 / -1.6%
tpcds_q77/duckdb:vortex-file-compressed 21293159 / 21315470 / -0.1% 32387084 / 31920813 / +1.5% 0.66 / 0.67 / -1.5%
tpcds_q78/duckdb:vortex-file-compressed 43080350 / 42663924 / +1.0% 54707606 / 52820403 / +3.6% 0.79 / 0.81 / -2.5%
tpcds_q79/duckdb:vortex-file-compressed 17276150 / 16894481 / +2.3% 30308053 / 28277924 / +7.2% 0.57 / 0.60 / -4.6%
tpcds_q80/duckdb:vortex-file-compressed 30519890 / 29328353 / +4.1% 44401110 / 45520006 / -2.5% 0.69 / 0.64 / +6.7%
tpcds_q81/duckdb:vortex-file-compressed 21718103 / 21390914 / +1.5% 30432758 / 30523427 / -0.3% 0.71 / 0.70 / +1.8%
tpcds_q82/duckdb:vortex-file-compressed 10229264 / 10282370 / -0.5% 25281240 / 27254318 / -7.2% 0.40 / 0.38 / +7.2%
tpcds_q83/duckdb:vortex-file-compressed 17933531 / 17450653 / +2.8% 25349428 / 24808454 / +2.2% 0.71 / 0.70 / +0.6%
tpcds_q84/duckdb:vortex-file-compressed 16013570 / 15770061 / +1.5% 23354141 / 23330367 / +0.1% 0.69 / 0.68 / +1.4%
tpcds_q85/duckdb:vortex-file-compressed 25478728 / 25010087 / +1.9% 36901078 / 36608459 / +0.8% 0.69 / 0.68 / +1.1%
tpcds_q86/duckdb:vortex-file-compressed 10155072 / 10153573 / +0.0% 17255793 / 17522652 / -1.5% 0.59 / 0.58 / +1.6%
tpcds_q87/duckdb:vortex-file-compressed 26708542 / 25925264 / +3.0% 34709324 / 34031089 / +2.0% 0.77 / 0.76 / +1.0%
tpcds_q88/duckdb:vortex-file-compressed 32036136 / 30084912 / +6.5% 39593292 / 38511578 / +2.8% 0.81 / 0.78 / +3.6%
tpcds_q89/duckdb:vortex-file-compressed 13835825 / 11994803 / +15.3% 🔴 22460107 / 20678027 / +8.6% 0.62 / 0.58 / +6.2%
tpcds_q90/duckdb:vortex-file-compressed 8211556 / 7944275 / +3.4% 14704544 / 14763030 / -0.4% 0.56 / 0.54 / +3.8%
tpcds_q91/duckdb:vortex-file-compressed 15255139 / 14845174 / +2.8% 24745134 / 24111949 / +2.6% 0.62 / 0.62 / +0.1%
tpcds_q92/duckdb:vortex-file-compressed 10931668 / 10952790 / -0.2% 18800264 / 19754981 / -4.8% 0.58 / 0.55 / +4.9%
tpcds_q93/duckdb:vortex-file-compressed 10421048 / 10358161 / +0.6% 23565921 / 23121962 / +1.9% 0.44 / 0.45 / -1.3%
tpcds_q94/duckdb:vortex-file-compressed 22447408 / 22091734 / +1.6% 32465397 / 31894156 / +1.8% 0.69 / 0.69 / -0.2%
tpcds_q95/duckdb:vortex-file-compressed 60617569 / 60683326 / -0.1% 68500187 / 68378916 / +0.2% 0.88 / 0.89 / -0.3%
tpcds_q96/duckdb:vortex-file-compressed 7950244 / 6419525 / +23.8% 🔴 15965507 / 16622164 / -4.0% 0.50 / 0.39 / +28.9%
tpcds_q97/duckdb:vortex-file-compressed 23640864 / 23094342 / +2.4% 31988115 / 32412290 / -1.3% 0.74 / 0.71 / +3.7%
tpcds_q98/duckdb:vortex-file-compressed 11864494 / 11254432 / +5.4% 21351676 / 20138725 / +6.0% 0.56 / 0.56 / -0.6%
tpcds_q99/duckdb:vortex-file-compressed 14700302 / 14569882 / +0.9% 22812297 / 22788168 / +0.1% 0.64 / 0.64 / +0.8%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24181427 / 23810394 / +1.6% 30830168 / 30505661 / +1.1% 0.78 / 0.78 / +0.5%
tpcds_q02/duckdb:parquet 17887252 / 17941156 / -0.3% 23829207 / 23922636 / -0.4% 0.75 / 0.75 / +0.1%
tpcds_q03/duckdb:parquet 10088845 / 9767895 / +3.3% 15724094 / 15657909 / +0.4% 0.64 / 0.62 / +2.9%
tpcds_q04/duckdb:parquet 118395132 / 118184330 / +0.2% 126484375 / 126646667 / -0.1% 0.94 / 0.93 / +0.3%
tpcds_q05/duckdb:parquet 28410426 / 28285949 / +0.4% 32807949 / 33593329 / -2.3% 0.87 / 0.84 / +2.8%
tpcds_q06/duckdb:parquet 26617156 / 26676332 / -0.2% 35965947 / 35876982 / +0.2% 0.74 / 0.74 / -0.5%
tpcds_q07/duckdb:parquet 30960312 / 32181513 / -3.8% 39190398 / 39737888 / -1.4% 0.79 / 0.81 / -2.5%
tpcds_q08/duckdb:parquet 19989183 / 19815813 / +0.9% 26169053 / 26276794 / -0.4% 0.76 / 0.75 / +1.3%
tpcds_q09/duckdb:parquet 26413002 / 26435700 / -0.1% 30292168 / 29144865 / +3.9% 0.87 / 0.91 / -3.9%
tpcds_q10/duckdb:parquet 33432252 / 32574008 / +2.6% 40098952 / 40068036 / +0.1% 0.83 / 0.81 / +2.6%
tpcds_q11/duckdb:parquet 68527154 / 68376381 / +0.2% 77254960 / 75406084 / +2.5% 0.89 / 0.91 / -2.2%
tpcds_q12/duckdb:parquet 14068049 / 13983996 / +0.6% 19091942 / 19178420 / -0.5% 0.74 / 0.73 / +1.1%
tpcds_q13/duckdb:parquet 30567844 / 30604097 / -0.1% 40096150 / 39722233 / +0.9% 0.76 / 0.77 / -1.0%
tpcds_q14/duckdb:parquet 63677522 / 65102894 / -2.2% 70628422 / 67684442 / +4.3% 0.90 / 0.96 / -6.3%
tpcds_q15/duckdb:parquet 16722900 / 16508372 / +1.3% 22769209 / 22688721 / +0.4% 0.73 / 0.73 / +0.9%
tpcds_q16/duckdb:parquet 30317132 / 30130438 / +0.6% 37309379 / 37345800 / -0.1% 0.81 / 0.81 / +0.7%
tpcds_q17/duckdb:parquet 34541144 / 34464568 / +0.2% 40460084 / 40455736 / +0.0% 0.85 / 0.85 / +0.2%
tpcds_q18/duckdb:parquet 47333610 / 46821444 / +1.1% 55826674 / 54221317 / +3.0% 0.85 / 0.86 / -1.8%
tpcds_q19/duckdb:parquet 20401614 / 18989641 / +7.4% 26001272 / 25797047 / +0.8% 0.78 / 0.74 / +6.6%
tpcds_q20/duckdb:parquet 15029930 / 14749710 / +1.9% 19611808 / 19637401 / -0.1% 0.77 / 0.75 / +2.0%
tpcds_q21/duckdb:parquet 10416476 / 10444663 / -0.3% 16937664 / 16958227 / -0.1% 0.61 / 0.62 / -0.1%
tpcds_q22/duckdb:parquet 20668316 / 20846988 / -0.9% 26541992 / 26461417 / +0.3% 0.78 / 0.79 / -1.2%
tpcds_q23/duckdb:parquet 45008412 / 42516360 / +5.9% 48674440 / 49747940 / -2.2% 0.92 / 0.85 / +8.2%
tpcds_q24/duckdb:parquet 31707986 / 29990221 / +5.7% 36107263 / 36853201 / -2.0% 0.88 / 0.81 / +7.9%
tpcds_q25/duckdb:parquet 30607221 / 30434998 / +0.6% 37562511 / 36961338 / +1.6% 0.81 / 0.82 / -1.0%
tpcds_q26/duckdb:parquet 29188348 / 28949739 / +0.8% 35519970 / 35818184 / -0.8% 0.82 / 0.81 / +1.7%
tpcds_q27/duckdb:parquet 34691522 / 35324466 / -1.8% 41561500 / 41751159 / -0.5% 0.83 / 0.85 / -1.3%
tpcds_q28/duckdb:parquet 25818662 / 25921212 / -0.4% 35983827 / 32829776 / +9.6% 0.72 / 0.79 / -9.1%
tpcds_q29/duckdb:parquet 32307502 / 32206476 / +0.3% 39267220 / 39709171 / -1.1% 0.82 / 0.81 / +1.4%
tpcds_q30/duckdb:parquet 35451005 / 35262072 / +0.5% 44267891 / 44600797 / -0.7% 0.80 / 0.79 / +1.3%
tpcds_q31/duckdb:parquet 35901634 / 35615188 / +0.8% 43299118 / 43325440 / -0.1% 0.83 / 0.82 / +0.9%
tpcds_q32/duckdb:parquet 14153389 / 14141278 / +0.1% 21025232 / 20795261 / +1.1% 0.67 / 0.68 / -1.0%
tpcds_q33/duckdb:parquet 25180556 / 24421536 / +3.1% 29615479 / 28812209 / +2.8% 0.85 / 0.85 / +0.3%
tpcds_q34/duckdb:parquet 17382416 / 16829472 / +3.3% 24142547 / 24139585 / +0.0% 0.72 / 0.70 / +3.3%
tpcds_q35/duckdb:parquet 35883712 / 35252276 / +1.8% 44033271 / 43926946 / +0.2% 0.81 / 0.80 / +1.5%
tpcds_q36/duckdb:parquet 40127304 / 39322664 / +2.0% 47650990 / 47149541 / +1.1% 0.84 / 0.83 / +1.0%
tpcds_q37/duckdb:parquet 12773928 / 12639092 / +1.1% 19413004 / 19502793 / -0.5% 0.66 / 0.65 / +1.5%
tpcds_q38/duckdb:parquet 29648122 / 29589750 / +0.2% 34620763 / 34180369 / +1.3% 0.86 / 0.87 / -1.1%
tpcds_q39/duckdb:parquet 23463610 / 23202125 / +1.1% 30442029 / 29993161 / +1.5% 0.77 / 0.77 / -0.4%
tpcds_q40/duckdb:parquet 16115018 / 15822188 / +1.9% 21458772 / 21392569 / +0.3% 0.75 / 0.74 / +1.5%
tpcds_q41/duckdb:parquet 12012219 / 12006023 / +0.1% 17785356 / 18193990 / -2.2% 0.68 / 0.66 / +2.4%
tpcds_q42/duckdb:parquet 9558988 / 9518758 / +0.4% 15667203 / 15493839 / +1.1% 0.61 / 0.61 / -0.7%
tpcds_q43/duckdb:parquet 12048592 / 12055606 / -0.1% 18000772 / 18092780 / -0.5% 0.67 / 0.67 / +0.5%
tpcds_q44/duckdb:parquet 20104366 / 21178908 / -5.1% 29266198 / 27647914 / +5.9% 0.69 / 0.77 / -10.3%
tpcds_q45/duckdb:parquet 21017682 / 20972180 / +0.2% 28160378 / 27691156 / +1.7% 0.75 / 0.76 / -1.5%
tpcds_q46/duckdb:parquet 36505297 / 36700546 / -0.5% 43355163 / 43594948 / -0.6% 0.84 / 0.84 / +0.0%
tpcds_q47/duckdb:parquet 35765348 / 34645331 / +3.2% 41706521 / 41186252 / +1.3% 0.86 / 0.84 / +1.9%
tpcds_q48/duckdb:parquet 29932134 / 30592336 / -2.2% 37770705 / 37668475 / +0.3% 0.79 / 0.81 / -2.4%
tpcds_q49/duckdb:parquet 30127294 / 30085117 / +0.1% 35794904 / 35636406 / +0.4% 0.84 / 0.84 / -0.3%
tpcds_q50/duckdb:parquet 19714934 / 19452070 / +1.4% 25265054 / 25427119 / -0.6% 0.78 / 0.77 / +2.0%
tpcds_q51/duckdb:parquet 52160701 / 52292939 / -0.3% 59520571 / 60731585 / -2.0% 0.88 / 0.86 / +1.8%
tpcds_q52/duckdb:parquet 9802963 / 9732527 / +0.7% 15694422 / 15675600 / +0.1% 0.62 / 0.62 / +0.6%
tpcds_q53/duckdb:parquet 14026780 / 15051126 / -6.8% 20853761 / 21175995 / -1.5% 0.67 / 0.71 / -5.4%
tpcds_q54/duckdb:parquet 25429251 / 24727277 / +2.8% 32317456 / 32091207 / +0.7% 0.79 / 0.77 / +2.1%
tpcds_q55/duckdb:parquet 9574296 / 9469814 / +1.1% 15101985 / 15311455 / -1.4% 0.63 / 0.62 / +2.5%
tpcds_q56/duckdb:parquet 25419619 / 24872050 / +2.2% 30925804 / 30977915 / -0.2% 0.82 / 0.80 / +2.4%
tpcds_q57/duckdb:parquet 30765396 / 30442104 / +1.1% 36197221 / 36060004 / +0.4% 0.85 / 0.84 / +0.7%
tpcds_q58/duckdb:parquet 24137123 / 23894518 / +1.0% 30286218 / 30227790 / +0.2% 0.80 / 0.79 / +0.8%
tpcds_q59/duckdb:parquet 23056234 / 22590175 / +2.1% 28809187 / 28525660 / +1.0% 0.80 / 0.79 / +1.1%
tpcds_q60/duckdb:parquet 28091098 / 26468831 / +6.1% 32193158 / 32157635 / +0.1% 0.87 / 0.82 / +6.0%
tpcds_q61/duckdb:parquet 25007914 / 24997136 / +0.0% 29238119 / 29388450 / -0.5% 0.86 / 0.85 / +0.6%
tpcds_q62/duckdb:parquet 12804721 / 12674948 / +1.0% 17841414 / 17793535 / +0.3% 0.72 / 0.71 / +0.8%
tpcds_q63/duckdb:parquet 13195190 / 13180385 / +0.1% 20009894 / 19955919 / +0.3% 0.66 / 0.66 / -0.2%
tpcds_q64/duckdb:parquet 73266230 / 70029590 / +4.6% 80137231 / 79702893 / +0.5% 0.91 / 0.88 / +4.1%
tpcds_q65/duckdb:parquet 20721224 / 20381379 / +1.7% 26615985 / 26205681 / +1.6% 0.78 / 0.78 / +0.1%
tpcds_q66/duckdb:parquet 33333522 / 33109306 / +0.7% 37931601 / 37912293 / +0.1% 0.88 / 0.87 / +0.6%
tpcds_q67/duckdb:parquet 61330610 / 61427646 / -0.2% 68275182 / 67778210 / +0.7% 0.90 / 0.91 / -0.9%
tpcds_q68/duckdb:parquet 28668589 / 28270800 / +1.4% 37516932 / 36491440 / +2.8% 0.76 / 0.77 / -1.4%
tpcds_q69/duckdb:parquet 26176612 / 25713991 / +1.8% 34622358 / 34856652 / -0.7% 0.76 / 0.74 / +2.5%
tpcds_q70/duckdb:parquet 19685886 / 19111549 / +3.0% 27309132 / 27095700 / +0.8% 0.72 / 0.71 / +2.2%
tpcds_q71/duckdb:parquet 17123392 / 16687382 / +2.6% 24128928 / 23582339 / +2.3% 0.71 / 0.71 / +0.3%
tpcds_q72/duckdb:parquet 53513050 / 53076012 / +0.8% 60526412 / 59871835 / +1.1% 0.88 / 0.89 / -0.3%
tpcds_q73/duckdb:parquet 14654507 / 14882740 / -1.5% 21575433 / 21484713 / +0.4% 0.68 / 0.69 / -1.9%
tpcds_q74/duckdb:parquet 84588690 / 85330348 / -0.9% 91736623 / 90810155 / +1.0% 0.92 / 0.94 / -1.9%
tpcds_q75/duckdb:parquet 43821650 / 44779393 / -2.1% 50738060 / 49933374 / +1.6% 0.86 / 0.90 / -3.7%
tpcds_q76/duckdb:parquet 18789688 / 18953734 / -0.9% 23639131 / 24873206 / -5.0% 0.79 / 0.76 / +4.3%
tpcds_q77/duckdb:parquet 25515296 / 26104071 / -2.3% 31025407 / 31020223 / +0.0% 0.82 / 0.84 / -2.3%
tpcds_q78/duckdb:parquet 78207264 / 78144562 / +0.1% 85575575 / 84317848 / +1.5% 0.91 / 0.93 / -1.4%
tpcds_q79/duckdb:parquet 22795266 / 22718754 / +0.3% 28794228 / 29037274 / -0.8% 0.79 / 0.78 / +1.2%
tpcds_q80/duckdb:parquet 37246586 / 38547797 / -3.4% 43946606 / 43826088 / +0.3% 0.85 / 0.88 / -3.6%
tpcds_q81/duckdb:parquet 36474580 / 36156710 / +0.9% 44786922 / 43875843 / +2.1% 0.81 / 0.82 / -1.2%
tpcds_q82/duckdb:parquet 13846199 / 13437674 / +3.0% 20790503 / 20541233 / +1.2% 0.67 / 0.65 / +1.8%
tpcds_q83/duckdb:parquet 20288438 / 20322945 / -0.2% 25551392 / 25260983 / +1.1% 0.79 / 0.80 / -1.3%
tpcds_q84/duckdb:parquet 23232924 / 22770568 / +2.0% 28928339 / 28804265 / +0.4% 0.80 / 0.79 / +1.6%
tpcds_q85/duckdb:parquet 32188127 / 32402652 / -0.7% 39851737 / 39555828 / +0.7% 0.81 / 0.82 / -1.4%
tpcds_q86/duckdb:parquet 11912142 / 11693996 / +1.9% 17044642 / 16863158 / +1.1% 0.70 / 0.69 / +0.8%
tpcds_q87/duckdb:parquet 31431554 / 31115256 / +1.0% 35588033 / 36049303 / -1.3% 0.88 / 0.86 / +2.3%
tpcds_q88/duckdb:parquet 38586761 / 38157178 / +1.1% 45048352 / 42549816 / +5.9% 0.86 / 0.90 / -4.5%
tpcds_q89/duckdb:parquet 14248118 / 14241302 / +0.0% 21868308 / 21204181 / +3.1% 0.65 / 0.67 / -3.0%
tpcds_q90/duckdb:parquet 9984983 / 10013881 / -0.3% 15448920 / 15219439 / +1.5% 0.65 / 0.66 / -1.8%
tpcds_q91/duckdb:parquet 21237315 / 20902441 / +1.6% 28442099 / 28190864 / +0.9% 0.75 / 0.74 / +0.7%
tpcds_q92/duckdb:parquet 15682260 / 15548326 / +0.9% 22311088 / 22044790 / +1.2% 0.70 / 0.71 / -0.3%
tpcds_q93/duckdb:parquet 14085434 / 14078353 / +0.1% 20308110 / 20145096 / +0.8% 0.69 / 0.70 / -0.8%
tpcds_q94/duckdb:parquet 25639474 / 25568235 / +0.3% 32649368 / 32731826 / -0.3% 0.79 / 0.78 / +0.5%
tpcds_q95/duckdb:parquet 44220839 / 43689340 / +1.2% 50191703 / 49676112 / +1.0% 0.88 / 0.88 / +0.2%
tpcds_q96/duckdb:parquet 8210758 / 8171757 / +0.5% 13768043 / 13959328 / -1.4% 0.60 / 0.59 / +1.9%
tpcds_q97/duckdb:parquet 27696100 / 27500057 / +0.7% 34672336 / 34592401 / +0.2% 0.80 / 0.79 / +0.5%
tpcds_q98/duckdb:parquet 16563192 / 16416732 / +0.9% 23603756 / 23097631 / +2.2% 0.70 / 0.71 / -1.3%
tpcds_q99/duckdb:parquet 18767778 / 18777963 / -0.1% 24779256 / 24963490 / -0.7% 0.76 / 0.75 / +0.7%

@github-actions

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.1%
Engines: DataFusion No clear signal (+7.3%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.038x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.070x ➖, 0↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1281954 / 1267639 / +1.1% 23103482 / 22261192 / +3.8% 0.06 / 0.06 / -2.6%
clickbench_q01/datafusion:vortex-file-compressed 9080468 / 5599441 / +62.2% 🔴 32700903 / 30089165 / +8.7% 0.28 / 0.19 / +49.2%
clickbench_q02/datafusion:vortex-file-compressed 14013840 / 11039524 / +26.9% 🔴 43790635 / 36194539 / +21.0% 🔴 0.32 / 0.31 / +4.9%
clickbench_q03/datafusion:vortex-file-compressed 13897220 / 13255654 / +4.8% 49834413 / 51229115 / -2.7% 0.28 / 0.26 / +7.8%
clickbench_q04/datafusion:vortex-file-compressed 59983924 / 57650312 / +4.0% 100729563 / 104635736 / -3.7% 0.60 / 0.55 / +8.1%
clickbench_q05/datafusion:vortex-file-compressed 78949443 / 79038402 / -0.1% 129994038 / 129177639 / +0.6% 0.61 / 0.61 / -0.7%
clickbench_q06/datafusion:vortex-file-compressed 1301561 / 1246249 / +4.4% 22620630 / 22270338 / +1.6% 0.06 / 0.06 / +2.8%
clickbench_q07/datafusion:vortex-file-compressed 12571282 / 9039175 / +39.1% 🔴 36272256 / 34615190 / +4.8% 0.35 / 0.26 / +32.7%
clickbench_q08/datafusion:vortex-file-compressed 82942674 / 78130508 / +6.2% 130572434 / 123726583 / +5.5% 0.64 / 0.63 / +0.6%
clickbench_q09/datafusion:vortex-file-compressed 179461618 / 173785329 / +3.3% 205238165 / 224551826 / -8.6% 0.87 / 0.77 / +13.0%
clickbench_q10/datafusion:vortex-file-compressed 25516024 / 22774244 / +12.0% 🔴 64490951 / 65959763 / -2.2% 0.40 / 0.35 / +14.6%
clickbench_q11/datafusion:vortex-file-compressed 27636120 / 24239194 / +14.0% 🔴 66214175 / 66411736 / -0.3% 0.42 / 0.36 / +14.4%
clickbench_q12/datafusion:vortex-file-compressed 77159442 / 73774628 / +4.6% 129129017 / 122144906 / +5.7% 0.60 / 0.60 / -1.1%
clickbench_q13/datafusion:vortex-file-compressed 119704936 / 115205938 / +3.9% 188570533 / 184141809 / +2.4% 0.63 / 0.63 / +1.5%
clickbench_q14/datafusion:vortex-file-compressed 79730820 / 77915642 / +2.3% 128936475 / 129282812 / -0.3% 0.62 / 0.60 / +2.6%
clickbench_q15/datafusion:vortex-file-compressed 65989211 / 64172171 / +2.8% 98799074 / 100345170 / -1.5% 0.67 / 0.64 / +4.4%
clickbench_q16/datafusion:vortex-file-compressed 157121784 / 154588194 / +1.6% 213064372 / 218944796 / -2.7% 0.74 / 0.71 / +4.4%
clickbench_q17/datafusion:vortex-file-compressed 157845402 / 154074008 / +2.4% 222129097 / 220840099 / +0.6% 0.71 / 0.70 / +1.9%
clickbench_q18/datafusion:vortex-file-compressed 298218672 / 293127153 / +1.7% 385959554 / 377993439 / +2.1% 0.77 / 0.78 / -0.4%
clickbench_q19/datafusion:vortex-file-compressed 9874082 / 7128980 / +38.5% 🔴 44695428 / 43401318 / +3.0% 0.22 / 0.16 / +34.5%
clickbench_q20/datafusion:vortex-file-compressed 71675451 / 69791872 / +2.7% 239602142 / 239166619 / +0.2% 0.30 / 0.29 / +2.5%
clickbench_q21/datafusion:vortex-file-compressed 81784018 / 78242918 / +4.5% 286775564 / 286834123 / -0.0% 0.29 / 0.27 / +4.5%
clickbench_q22/datafusion:vortex-file-compressed 96063076 / 92364899 / +4.0% 390518187 / 388674157 / +0.5% 0.25 / 0.24 / +3.5%
clickbench_q23/datafusion:vortex-file-compressed 90163344 / 77685351 / +16.1% 🔴 343354699 / 449260316 / -23.6% 🟢 0.26 / 0.17 / +51.9%
clickbench_q24/datafusion:vortex-file-compressed 8899315 / 8468966 / +5.1% 57104721 / 53873448 / +6.0% 0.16 / 0.16 / -0.9%
clickbench_q25/datafusion:vortex-file-compressed 20496673 / 18521688 / +10.7% 🔴 62029018 / 62528858 / -0.8% 0.33 / 0.30 / +11.6%
clickbench_q26/datafusion:vortex-file-compressed 15239358 / 14918352 / +2.2% 65227786 / 65323810 / -0.1% 0.23 / 0.23 / +2.3%
clickbench_q27/datafusion:vortex-file-compressed 104547230 / 98141518 / +6.5% 252555428 / 248511267 / +1.6% 0.41 / 0.39 / +4.8%
clickbench_q28/datafusion:vortex-file-compressed 558754073 / 561280755 / -0.5% 633412697 / 640284837 / -1.1% 0.88 / 0.88 / +0.6%
clickbench_q29/datafusion:vortex-file-compressed 27108044 / 24224116 / +11.9% 🔴 54384777 / 57600420 / -5.6% 0.50 / 0.42 / +18.5%
clickbench_q30/datafusion:vortex-file-compressed 60390179 / 56306174 / +7.3% 111683693 / 110862963 / +0.7% 0.54 / 0.51 / +6.5%
clickbench_q31/datafusion:vortex-file-compressed 71670940 / 65375395 / +9.6% 150810250 / 155059910 / -2.7% 0.48 / 0.42 / +12.7%
clickbench_q32/datafusion:vortex-file-compressed 292120314 / 293438164 / -0.4% 386750801 / 383787479 / +0.8% 0.76 / 0.76 / -1.2%
clickbench_q33/datafusion:vortex-file-compressed 324934240 / 318998594 / +1.9% 434617139 / 436291263 / -0.4% 0.75 / 0.73 / +2.3%
clickbench_q34/datafusion:vortex-file-compressed 323546844 / 324306746 / -0.2% 434945802 / 432895559 / +0.5% 0.74 / 0.75 / -0.7%
clickbench_q35/datafusion:vortex-file-compressed 62436379 / 57186814 / +9.2% 91405357 / 91824411 / -0.5% 0.68 / 0.62 / +9.7%
clickbench_q36/datafusion:vortex-file-compressed 37404844 / 37959908 / -1.5% 66313002 / 67383538 / -1.6% 0.56 / 0.56 / +0.1%
clickbench_q37/datafusion:vortex-file-compressed 20586032 / 21302132 / -3.4% 45195770 / 47462712 / -4.8% 0.46 / 0.45 / +1.5%
clickbench_q38/datafusion:vortex-file-compressed 12968908 / 12788406 / +1.4% 39878067 / 39793140 / +0.2% 0.33 / 0.32 / +1.2%
clickbench_q39/datafusion:vortex-file-compressed 80204918 / 78803669 / +1.8% 107638151 / 112421828 / -4.3% 0.75 / 0.70 / +6.3%
clickbench_q40/datafusion:vortex-file-compressed 10416037 / 10077042 / +3.4% 35466741 / 34795197 / +1.9% 0.29 / 0.29 / +1.4%
clickbench_q41/datafusion:vortex-file-compressed 9553853 / 9586150 / -0.3% 34833852 / 34544900 / +0.8% 0.27 / 0.28 / -1.2%
clickbench_q42/datafusion:vortex-file-compressed 9750824 / 9738388 / +0.1% 35374024 / 36149219 / -2.1% 0.28 / 0.27 / +2.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1252290 / 1259311 / -0.6% 49087162 / 48757638 / +0.7% 0.03 / 0.03 / -1.2%
clickbench_q01/datafusion:parquet 15977902 / 16154027 / -1.1% 64984674 / 73282985 / -11.3% 🟢 0.25 / 0.22 / +11.5%
clickbench_q02/datafusion:parquet 19478958 / 18641046 / +4.5% 80057023 / 80870576 / -1.0% 0.24 / 0.23 / +5.6%
clickbench_q03/datafusion:parquet 16727952 / 17032146 / -1.8% 74979177 / 76638906 / -2.2% 0.22 / 0.22 / +0.4%
clickbench_q04/datafusion:parquet 63800530 / 64431938 / -1.0% 121747964 / 123921374 / -1.8% 0.52 / 0.52 / +0.8%
clickbench_q05/datafusion:parquet 87393986 / 88361748 / -1.1% 148574732 / 156236938 / -4.9% 0.59 / 0.57 / +4.0%
clickbench_q06/datafusion:parquet 1271953 / 1295988 / -1.9% 48628547 / 49039154 / -0.8% 0.03 / 0.03 / -1.0%
clickbench_q07/datafusion:parquet 16923218 / 16937354 / -0.1% 67928249 / 68218987 / -0.4% 0.25 / 0.25 / +0.3%
clickbench_q08/datafusion:parquet 87845384 / 87973610 / -0.1% 157988845 / 157437916 / +0.3% 0.56 / 0.56 / -0.5%
clickbench_q09/datafusion:parquet 189783624 / 186137604 / +2.0% 261198656 / 266501305 / -2.0% 0.73 / 0.70 / +4.0%
clickbench_q10/datafusion:parquet 36288891 / 36271560 / +0.0% 96624373 / 101621614 / -4.9% 0.38 / 0.36 / +5.2%
clickbench_q11/datafusion:parquet 42742780 / 42556656 / +0.4% 104814772 / 109140701 / -4.0% 0.41 / 0.39 / +4.6%
clickbench_q12/datafusion:parquet 94758448 / 98327556 / -3.6% 156102007 / 159819545 / -2.3% 0.61 / 0.62 / -1.3%
clickbench_q13/datafusion:parquet 147041694 / 145807988 / +0.8% 225946342 / 226600587 / -0.3% 0.65 / 0.64 / +1.1%
clickbench_q14/datafusion:parquet 102700174 / 101306079 / +1.4% 171158140 / 171544350 / -0.2% 0.60 / 0.59 / +1.6%
clickbench_q15/datafusion:parquet 72612750 / 68645154 / +5.8% 128256999 / 132933980 / -3.5% 0.57 / 0.52 / +9.6%
clickbench_q16/datafusion:parquet 156172878 / 157905208 / -1.1% 231004997 / 235157283 / -1.8% 0.68 / 0.67 / +0.7%
clickbench_q17/datafusion:parquet 156647578 / 156906690 / -0.2% 234919862 / 238634033 / -1.6% 0.67 / 0.66 / +1.4%
clickbench_q18/datafusion:parquet 312924982 / 314200720 / -0.4% 420122726 / 409875279 / +2.5% 0.74 / 0.77 / -2.8%
clickbench_q19/datafusion:parquet 19149284 / 19055356 / +0.5% 74193194 / 78059517 / -5.0% 0.26 / 0.24 / +5.7%
clickbench_q20/datafusion:parquet 178133174 / 178327854 / -0.1% 273385262 / 277188622 / -1.4% 0.65 / 0.64 / +1.3%
clickbench_q21/datafusion:parquet 173203386 / 173006178 / +0.1% 289032921 / 294515723 / -1.9% 0.60 / 0.59 / +2.0%
clickbench_q22/datafusion:parquet 258535707 / 262917848 / -1.7% 414094016 / 415747590 / -0.4% 0.62 / 0.63 / -1.3%
clickbench_q23/datafusion:parquet 1005824086 / 1010890059 / -0.5% 1183484598 / 1177957707 / +0.5% 0.85 / 0.86 / -1.0%
clickbench_q24/datafusion:parquet 29837953 / 30115954 / -0.9% 85575085 / 88000202 / -2.8% 0.35 / 0.34 / +1.9%
clickbench_q25/datafusion:parquet 36177900 / 37028574 / -2.3% 97864311 / 100911023 / -3.0% 0.37 / 0.37 / +0.7%
clickbench_q26/datafusion:parquet 30527125 / 30496682 / +0.1% 86792591 / 89181620 / -2.7% 0.35 / 0.34 / +2.9%
clickbench_q27/datafusion:parquet 193131241 / 191971551 / +0.6% 283482425 / 283324170 / +0.1% 0.68 / 0.68 / +0.5%
clickbench_q28/datafusion:parquet 620699128 / 621712196 / -0.2% 700669507 / 697139739 / +0.5% 0.89 / 0.89 / -0.7%
clickbench_q29/datafusion:parquet 28874908 / 29245330 / -1.3% 88905432 / 90141764 / -1.4% 0.32 / 0.32 / +0.1%
clickbench_q30/datafusion:parquet 89638243 / 92291603 / -2.9% 164978927 / 168377086 / -2.0% 0.54 / 0.55 / -0.9%
clickbench_q31/datafusion:parquet 101561305 / 101703184 / -0.1% 188763465 / 191696114 / -1.5% 0.54 / 0.53 / +1.4%
clickbench_q32/datafusion:parquet 307325119 / 308335460 / -0.3% 422024933 / 418996116 / +0.7% 0.73 / 0.74 / -1.0%
clickbench_q33/datafusion:parquet 374453452 / 376438904 / -0.5% 469356241 / 470353160 / -0.2% 0.80 / 0.80 / -0.3%
clickbench_q34/datafusion:parquet 377257638 / 382426037 / -1.4% 472589599 / 476602807 / -0.8% 0.80 / 0.80 / -0.5%
clickbench_q35/datafusion:parquet 64531776 / 64741402 / -0.3% 124707100 / 123453612 / +1.0% 0.52 / 0.52 / -1.3%
clickbench_q36/datafusion:parquet 73547678 / 74050217 / -0.7% 134740747 / 135026761 / -0.2% 0.55 / 0.55 / -0.5%
clickbench_q37/datafusion:parquet 35562446 / 35373582 / +0.5% 90823848 / 92623296 / -1.9% 0.39 / 0.38 / +2.5%
clickbench_q38/datafusion:parquet 47955340 / 47987725 / -0.1% 106754541 / 106707488 / +0.0% 0.45 / 0.45 / -0.1%
clickbench_q39/datafusion:parquet 143618746 / 143739514 / -0.1% 206522105 / 206379961 / +0.1% 0.70 / 0.70 / -0.2%
clickbench_q40/datafusion:parquet 19828007 / 20079606 / -1.3% 76348082 / 78038960 / -2.2% 0.26 / 0.26 / +0.9%
clickbench_q41/datafusion:parquet 18766570 / 18901772 / -0.7% 76753641 / 76823291 / -0.1% 0.24 / 0.25 / -0.6%
clickbench_q42/datafusion:parquet 19138678 / 19224722 / -0.4% 73440060 / 76775932 / -4.3% 0.26 / 0.25 / +4.1%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2234584 / 2239442 / -0.2% 24141573 / 25369206 / -4.8% 0.09 / 0.09 / +4.9%
clickbench_q01/duckdb:vortex-file-compressed 7075830 / 7536986 / -6.1% 27608287 / 28259475 / -2.3% 0.26 / 0.27 / -3.9%
clickbench_q02/duckdb:vortex-file-compressed 9759150 / 9000364 / +8.4% 35194451 / 34257376 / +2.7% 0.28 / 0.26 / +5.5%
clickbench_q03/duckdb:vortex-file-compressed 14011329 / 14103760 / -0.7% 44239402 / 46504894 / -4.9% 0.32 / 0.30 / +4.4%
clickbench_q04/duckdb:vortex-file-compressed 57782082 / 56832065 / +1.7% 87675241 / 85214459 / +2.9% 0.66 / 0.67 / -1.2%
clickbench_q05/duckdb:vortex-file-compressed 63949068 / 64263032 / -0.5% 94744412 / 93545469 / +1.3% 0.67 / 0.69 / -1.7%
clickbench_q06/duckdb:vortex-file-compressed 2624142 / 2661376 / -1.4% 33011458 / 32999228 / +0.0% 0.08 / 0.08 / -1.4%
clickbench_q07/duckdb:vortex-file-compressed 9973537 / 9621980 / +3.7% 30207916 / 29659855 / +1.8% 0.33 / 0.32 / +1.8%
clickbench_q08/duckdb:vortex-file-compressed 68964369 / 69337386 / -0.5% 99002419 / 100748992 / -1.7% 0.70 / 0.69 / +1.2%
clickbench_q09/duckdb:vortex-file-compressed 91585980 / 92795013 / -1.3% 123188918 / 126662801 / -2.7% 0.74 / 0.73 / +1.5%
clickbench_q10/duckdb:vortex-file-compressed 28253412 / 27227979 / +3.8% 63185477 / 63382855 / -0.3% 0.45 / 0.43 / +4.1%
clickbench_q11/duckdb:vortex-file-compressed 31674745 / 30008447 / +5.6% 65134156 / 67005906 / -2.8% 0.49 / 0.45 / +8.6%
clickbench_q12/duckdb:vortex-file-compressed 68723362 / 69207538 / -0.7% 96598729 / 98644946 / -2.1% 0.71 / 0.70 / +1.4%
clickbench_q13/duckdb:vortex-file-compressed 118482510 / 118345386 / +0.1% 156582696 / 161561583 / -3.1% 0.76 / 0.73 / +3.3%
clickbench_q14/duckdb:vortex-file-compressed 72877346 / 73891442 / -1.4% 96875199 / 101837913 / -4.9% 0.75 / 0.73 / +3.7%
clickbench_q15/duckdb:vortex-file-compressed 76683982 / 77240848 / -0.7% 106103965 / 106525302 / -0.4% 0.72 / 0.73 / -0.3%
clickbench_q16/duckdb:vortex-file-compressed 138013532 / 139232726 / -0.9% 170518975 / 170482534 / +0.0% 0.81 / 0.82 / -0.9%
clickbench_q17/duckdb:vortex-file-compressed 138522322 / 139758200 / -0.9% 166678325 / 168916381 / -1.3% 0.83 / 0.83 / +0.4%
clickbench_q18/duckdb:vortex-file-compressed 256215848 / 255047162 / +0.5% 294259249 / 307748043 / -4.4% 0.87 / 0.83 / +5.1%
clickbench_q19/duckdb:vortex-file-compressed 9211302 / 9199179 / +0.1% 32930259 / 34501484 / -4.6% 0.28 / 0.27 / +4.9%
clickbench_q20/duckdb:vortex-file-compressed 67275312 / 68244484 / -1.4% 159838896 / 164113271 / -2.6% 0.42 / 0.42 / +1.2%
clickbench_q21/duckdb:vortex-file-compressed 75873959 / 75789776 / +0.1% 179862634 / 181664637 / -1.0% 0.42 / 0.42 / +1.1%
clickbench_q22/duckdb:vortex-file-compressed 111843212 / 108798534 / +2.8% 290058673 / 295013617 / -1.7% 0.39 / 0.37 / +4.6%
clickbench_q23/duckdb:vortex-file-compressed 66476849 / 60633788 / +9.6% 171684656 / 168797657 / +1.7% 0.39 / 0.36 / +7.8%
clickbench_q24/duckdb:vortex-file-compressed 17002258 / 16925131 / +0.5% 42254731 / 44630910 / -5.3% 0.40 / 0.38 / +6.1%
clickbench_q25/duckdb:vortex-file-compressed 19541729 / 18323122 / +6.7% 50044867 / 50986910 / -1.8% 0.39 / 0.36 / +8.7%
clickbench_q26/duckdb:vortex-file-compressed 14180014 / 13710818 / +3.4% 42235914 / 46566427 / -9.3% 0.34 / 0.29 / +14.0%
clickbench_q27/duckdb:vortex-file-compressed 50782214 / 49689776 / +2.2% 163937954 / 165933609 / -1.2% 0.31 / 0.30 / +3.4%
clickbench_q28/duckdb:vortex-file-compressed 513587806 / 512465832 / +0.2% 553479306 / 552181616 / +0.2% 0.93 / 0.93 / -0.0%
clickbench_q29/duckdb:vortex-file-compressed 17816126 / 17119234 / +4.1% 44903698 / 42439176 / +5.8% 0.40 / 0.40 / -1.6%
clickbench_q30/duckdb:vortex-file-compressed 61212708 / 58931829 / +3.9% 101764340 / 102230044 / -0.5% 0.60 / 0.58 / +4.3%
clickbench_q31/duckdb:vortex-file-compressed 111629436 / 110705018 / +0.8% 163917140 / 162709746 / +0.7% 0.68 / 0.68 / +0.1%
clickbench_q32/duckdb:vortex-file-compressed 358793044 / 380073897 / -5.6% 394806780 / 404601177 / -2.4% 0.91 / 0.94 / -3.3%
clickbench_q33/duckdb:vortex-file-compressed 345068988 / 344553137 / +0.1% 399662390 / 401024689 / -0.3% 0.86 / 0.86 / +0.5%
clickbench_q34/duckdb:vortex-file-compressed 352133702 / 356103648 / -1.1% 404295971 / 416631309 / -3.0% 0.87 / 0.85 / +1.9%
clickbench_q35/duckdb:vortex-file-compressed 57760986 / 58100316 / -0.6% 86686507 / 88667137 / -2.2% 0.67 / 0.66 / +1.7%
clickbench_q36/duckdb:vortex-file-compressed 11100230 / 11525562 / -3.7% 31929950 / 33844721 / -5.7% 0.35 / 0.34 / +2.1%
clickbench_q37/duckdb:vortex-file-compressed 7616162 / 7558698 / +0.8% 28278607 / 29318058 / -3.5% 0.27 / 0.26 / +4.5%
clickbench_q38/duckdb:vortex-file-compressed 8319552 / 8031642 / +3.6% 30087779 / 30490717 / -1.3% 0.28 / 0.26 / +5.0%
clickbench_q39/duckdb:vortex-file-compressed 18214406 / 17606396 / +3.5% 43210501 / 43088595 / +0.3% 0.42 / 0.41 / +3.2%
clickbench_q40/duckdb:vortex-file-compressed 6887293 / 7054667 / -2.4% 29354662 / 30372350 / -3.4% 0.23 / 0.23 / +1.0%
clickbench_q41/duckdb:vortex-file-compressed 7838881 / 7919858 / -1.0% 28178985 / 30331072 / -7.1% 0.28 / 0.26 / +6.5%
clickbench_q42/duckdb:vortex-file-compressed 6954126 / 7023563 / -1.0% 26269004 / 28081933 / -6.5% 0.26 / 0.25 / +5.8%
duckdb / parquet / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9275204 / 9367681 / -1.0% 14001566 / 14780921 / -5.3% 0.66 / 0.63 / +4.5%
clickbench_q01/duckdb:parquet 14557485 / 15488964 / -6.0% 20842068 / 21141102 / -1.4% 0.70 / 0.73 / -4.7%
clickbench_q02/duckdb:parquet 21882952 / 23060620 / -5.1% 31141736 / 30527174 / +2.0% 0.70 / 0.76 / -7.0%
clickbench_q03/duckdb:parquet 22512376 / 22814378 / -1.3% 35836890 / 35023390 / +2.3% 0.63 / 0.65 / -3.6%
clickbench_q04/duckdb:parquet 61367034 / 61598213 / -0.4% 72612175 / 70433858 / +3.1% 0.85 / 0.87 / -3.4%
clickbench_q05/duckdb:parquet 83961268 / 83870738 / +0.1% 97665553 / 95894960 / +1.8% 0.86 / 0.87 / -1.7%
clickbench_q06/duckdb:parquet 20224990 / 20405819 / -0.9% 27224433 / 28112879 / -3.2% 0.74 / 0.73 / +2.3%
clickbench_q07/duckdb:parquet 17435400 / 16971435 / +2.7% 24675682 / 24494643 / +0.7% 0.71 / 0.69 / +2.0%
clickbench_q08/duckdb:parquet 74541530 / 75323061 / -1.0% 86449400 / 90835451 / -4.8% 0.86 / 0.83 / +4.0%
clickbench_q09/duckdb:parquet 102453925 / 103136552 / -0.7% 120562212 / 118668791 / +1.6% 0.85 / 0.87 / -2.2%
clickbench_q10/duckdb:parquet 41378670 / 41238710 / +0.3% 53268843 / 54627929 / -2.5% 0.78 / 0.75 / +2.9%
clickbench_q11/duckdb:parquet 46543780 / 47145277 / -1.3% 60689082 / 63268481 / -4.1% 0.77 / 0.75 / +2.9%
clickbench_q12/duckdb:parquet 93514786 / 94371587 / -0.9% 106731983 / 109362113 / -2.4% 0.88 / 0.86 / +1.5%
clickbench_q13/duckdb:parquet 149899081 / 149738047 / +0.1% 166622589 / 166822080 / -0.1% 0.90 / 0.90 / +0.2%
clickbench_q14/duckdb:parquet 100735719 / 103577978 / -2.7% 116999568 / 119870160 / -2.4% 0.86 / 0.86 / -0.4%
clickbench_q15/duckdb:parquet 86107554 / 86882682 / -0.9% 100397455 / 101448229 / -1.0% 0.86 / 0.86 / +0.1%
clickbench_q16/duckdb:parquet 159357466 / 163773262 / -2.7% 175715616 / 176919090 / -0.7% 0.91 / 0.93 / -2.0%
clickbench_q17/duckdb:parquet 158628702 / 167384281 / -5.2% 180208510 / 179141726 / +0.6% 0.88 / 0.93 / -5.8%
clickbench_q18/duckdb:parquet 297143415 / 289319458 / +2.7% 326421533 / 319824951 / +2.1% 0.91 / 0.90 / +0.6%
clickbench_q19/duckdb:parquet 19880966 / 20006408 / -0.6% 25392186 / 26901094 / -5.6% 0.78 / 0.74 / +5.3%
clickbench_q20/duckdb:parquet 192402892 / 184730872 / +4.2% 225085841 / 229129434 / -1.8% 0.85 / 0.81 / +6.0%
clickbench_q21/duckdb:parquet 224257444 / 220139544 / +1.9% 267449840 / 274044871 / -2.4% 0.84 / 0.80 / +4.4%
clickbench_q22/duckdb:parquet 315487298 / 310734536 / +1.5% 355369383 / 355675510 / -0.1% 0.89 / 0.87 / +1.6%
clickbench_q23/duckdb:parquet 180026870 / 170837560 / +5.4% 237829538 / 245382152 / -3.1% 0.76 / 0.70 / +8.7%
clickbench_q24/duckdb:parquet 30384181 / 29683521 / +2.4% 43730787 / 43133598 / +1.4% 0.69 / 0.69 / +1.0%
clickbench_q25/duckdb:parquet 41763090 / 42753210 / -2.3% 58390890 / 57983198 / +0.7% 0.72 / 0.74 / -3.0%
clickbench_q26/duckdb:parquet 30838678 / 30859150 / -0.1% 44703962 / 47201175 / -5.3% 0.69 / 0.65 / +5.5%
clickbench_q27/duckdb:parquet 191808530 / 189835506 / +1.0% 224975640 / 231335772 / -2.7% 0.85 / 0.82 / +3.9%
clickbench_q28/duckdb:parquet 968737973 / 967613012 / +0.1% 946860068 / 942475011 / +0.5% 1.02 / 1.03 / -0.3%
clickbench_q29/duckdb:parquet 24084996 / 23903488 / +0.8% 30176764 / 30949418 / -2.5% 0.80 / 0.77 / +3.3%
clickbench_q30/duckdb:parquet 106620906 / 106631879 / -0.0% 126247190 / 128879839 / -2.0% 0.84 / 0.83 / +2.1%
clickbench_q31/duckdb:parquet 158184346 / 137442966 / +15.1% 🔴 173049314 / 200037281 / -13.5% 🟢 0.91 / 0.69 / +33.0%
clickbench_q32/duckdb:parquet 378318874 / 387764024 / -2.4% 407323781 / 422594307 / -3.6% 0.93 / 0.92 / +1.2%
clickbench_q33/duckdb:parquet 485804819 / 481923100 / +0.8% 467869899 / 445486292 / +5.0% 1.04 / 1.08 / -4.0%
clickbench_q34/duckdb:parquet 461489038 / 480762379 / -4.0% 458484792 / 443261587 / +3.4% 1.01 / 1.08 / -7.2%
clickbench_q35/duckdb:parquet 60977627 / 61683220 / -1.1% 75522960 / 75692813 / -0.2% 0.81 / 0.81 / -0.9%
clickbench_q36/duckdb:parquet 29816379 / 29878260 / -0.2% 35670446 / 35348035 / +0.9% 0.84 / 0.85 / -1.1%
clickbench_q37/duckdb:parquet 23493818 / 23721006 / -1.0% 29033315 / 30126702 / -3.6% 0.81 / 0.79 / +2.8%
clickbench_q38/duckdb:parquet 23663327 / 23689565 / -0.1% 29716424 / 29637380 / +0.3% 0.80 / 0.80 / -0.4%
clickbench_q39/duckdb:parquet 52819277 / 52928570 / -0.2% 60259530 / 59730518 / +0.9% 0.88 / 0.89 / -1.1%
clickbench_q40/duckdb:parquet 14780848 / 14915196 / -0.9% 20258986 / 19974619 / +1.4% 0.73 / 0.75 / -2.3%
clickbench_q41/duckdb:parquet 15469319 / 15471192 / -0.0% 20124500 / 20881832 / -3.6% 0.77 / 0.74 / +3.8%
clickbench_q42/duckdb:parquet 14108650 / 14106288 / +0.0% 20411264 / 20422534 / -0.1% 0.69 / 0.69 / +0.1%

@robert3005 robert3005 added the action/bench-random-access Run only the random-access benchmark on this PR label Nov 13, 2026
@github-actions github-actions Bot removed the action/bench-random-access Run only the random-access benchmark on this PR label Nov 13, 2026
@github-actions

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.0%, environment too noisy confidence) · DuckDB No clear signal (+0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.982x ➖ · cold 0.946x ➖
Parquet (geomean): hot 0.977x ➖ · cold 0.960x ➖
Shifts: Parquet (control) -2.3% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 217004758 / 213428676 / +1.7% 968737205 / 620829379 / +56.0% 🔴 0.22 / 0.34 / -34.8%
tpch_q02/datafusion:vortex-file-compressed 324640007 / 324659145 / -0.0% 649120902 / 572533022 / +13.4% 0.50 / 0.57 / -11.8%
tpch_q03/datafusion:vortex-file-compressed 314427982 / 317750818 / -1.0% 826215071 / 868142770 / -4.8% 0.38 / 0.37 / +4.0%
tpch_q04/datafusion:vortex-file-compressed 155021212 / 182343879 / -15.0% 389084227 / 428609160 / -9.2% 0.40 / 0.43 / -6.3%
tpch_q05/datafusion:vortex-file-compressed 336686071 / 362972881 / -7.2% 601885340 / 833210217 / -27.8% 0.56 / 0.44 / +28.4%
tpch_q06/datafusion:vortex-file-compressed 149653724 / 138862271 / +7.8% 310690678 / 518460696 / -40.1% 🟢 0.48 / 0.27 / +79.8%
tpch_q07/datafusion:vortex-file-compressed 402546130 / 419360998 / -4.0% 598531067 / 617367932 / -3.1% 0.67 / 0.68 / -1.0%
tpch_q08/datafusion:vortex-file-compressed 414223443 / 436240546 / -5.0% 530058931 / 637470006 / -16.8% 0.78 / 0.68 / +14.2%
tpch_q09/datafusion:vortex-file-compressed 435420119 / 304391651 / +43.0% 🔴 562614044 / 477161954 / +17.9% 0.77 / 0.64 / +21.3%
tpch_q10/datafusion:vortex-file-compressed 374580250 / 382897358 / -2.2% 819912890 / 557933394 / +47.0% 🔴 0.46 / 0.69 / -33.4%
tpch_q11/datafusion:vortex-file-compressed 277337983 / 290683596 / -4.6% 444421984 / 505299977 / -12.0% 0.62 / 0.58 / +8.5%
tpch_q12/datafusion:vortex-file-compressed 195749644 / 264614865 / -26.0% 332650781 / 512853986 / -35.1% 🟢 0.59 / 0.52 / +14.0%
tpch_q13/datafusion:vortex-file-compressed 103463021 / 116936050 / -11.5% 411557065 / 325531889 / +26.4% 0.25 / 0.36 / -30.0%
tpch_q14/datafusion:vortex-file-compressed 214009063 / 180695890 / +18.4% 418165523 / 398901662 / +4.8% 0.51 / 0.45 / +13.0%
tpch_q15/datafusion:vortex-file-compressed 311572372 / 286491300 / +8.8% 546575095 / 509003048 / +7.4% 0.57 / 0.56 / +1.3%
tpch_q16/datafusion:vortex-file-compressed 145528854 / 138952819 / +4.7% 301616224 / 325965128 / -7.5% 0.48 / 0.43 / +13.2%
tpch_q17/datafusion:vortex-file-compressed 266806933 / 254824019 / +4.7% 440092956 / 531052513 / -17.1% 0.61 / 0.48 / +26.3%
tpch_q18/datafusion:vortex-file-compressed 232846290 / 223285627 / +4.3% 483328300 / 510731629 / -5.4% 0.48 / 0.44 / +10.2%
tpch_q19/datafusion:vortex-file-compressed 221756496 / 238509049 / -7.0% 417630675 / 394729171 / +5.8% 0.53 / 0.60 / -12.1%
tpch_q20/datafusion:vortex-file-compressed 260251304 / 255454363 / +1.9% 446073181 / 491974673 / -9.3% 0.58 / 0.52 / +12.4%
tpch_q21/datafusion:vortex-file-compressed 412413035 / 431003952 / -4.3% 715512703 / 732646337 / -2.3% 0.58 / 0.59 / -2.0%
tpch_q22/datafusion:vortex-file-compressed 161146424 / 171270953 / -5.9% 410094803 / 394414266 / +4.0% 0.39 / 0.43 / -9.5%
datafusion / parquet / ns (0.983x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 152450359 / 150837867 / +1.1% 486895981 / 452640544 / +7.6% 0.31 / 0.33 / -6.0%
tpch_q02/datafusion:parquet 279751661 / 271268324 / +3.1% 457917499 / 570280127 / -19.7% 0.61 / 0.48 / +28.4%
tpch_q03/datafusion:parquet 235773197 / 251878961 / -6.4% 625212874 / 634767910 / -1.5% 0.38 / 0.40 / -5.0%
tpch_q04/datafusion:parquet 142223941 / 131551388 / +8.1% 251318780 / 381853222 / -34.2% 🟢 0.57 / 0.34 / +64.3%
tpch_q05/datafusion:parquet 326646985 / 326824311 / -0.1% 443237770 / 476602013 / -7.0% 0.74 / 0.69 / +7.5%
tpch_q06/datafusion:parquet 107171836 / 170891668 / -37.3% 🟢 289839469 / 235227363 / +23.2% 0.37 / 0.73 / -49.1%
tpch_q07/datafusion:parquet 328669193 / 328455570 / +0.1% 445245100 / 462831847 / -3.8% 0.74 / 0.71 / +4.0%
tpch_q08/datafusion:parquet 385538007 / 395483071 / -2.5% 537040869 / 531793134 / +1.0% 0.72 / 0.74 / -3.5%
tpch_q09/datafusion:parquet 380741824 / 382860145 / -0.6% 519329231 / 572557336 / -9.3% 0.73 / 0.67 / +9.6%
tpch_q10/datafusion:parquet 295199830 / 307260676 / -3.9% 523358919 / 457226430 / +14.5% 0.56 / 0.67 / -16.1%
tpch_q11/datafusion:parquet 251800496 / 245474666 / +2.6% 366516564 / 389695538 / -5.9% 0.69 / 0.63 / +9.1%
tpch_q12/datafusion:parquet 168847220 / 153118986 / +10.3% 315206924 / 292205747 / +7.9% 0.54 / 0.52 / +2.2%
tpch_q13/datafusion:parquet 271662012 / 273261480 / -0.6% 472289654 / 448559072 / +5.3% 0.58 / 0.61 / -5.6%
tpch_q14/datafusion:parquet 145926683 / 152241447 / -4.1% 335763368 / 393371670 / -14.6% 0.43 / 0.39 / +12.3%
tpch_q15/datafusion:parquet 298072128 / 294598429 / +1.2% 472584467 / 467707916 / +1.0% 0.63 / 0.63 / +0.1%
tpch_q16/datafusion:parquet 100184529 / 102565624 / -2.3% 210047167 / 235875583 / -11.0% 0.48 / 0.43 / +9.7%
tpch_q17/datafusion:parquet 329461905 / 280457837 / +17.5% 450181091 / 617044175 / -27.0% 0.73 / 0.45 / +61.0%
tpch_q18/datafusion:parquet 316800465 / 309833000 / +2.2% 483601312 / 520533357 / -7.1% 0.66 / 0.60 / +10.1%
tpch_q19/datafusion:parquet 155502683 / 174829590 / -11.1% 288757181 / 305696543 / -5.5% 0.54 / 0.57 / -5.8%
tpch_q20/datafusion:parquet 236213666 / 239340253 / -1.3% 352817135 / 386405283 / -8.7% 0.67 / 0.62 / +8.1%
tpch_q21/datafusion:parquet 287562460 / 286952424 / +0.2% 483304187 / 509563624 / -5.2% 0.59 / 0.56 / +5.7%
tpch_q22/datafusion:parquet 151845124 / 151900823 / -0.0% 359858883 / 337226713 / +6.7% 0.42 / 0.45 / -6.3%
duckdb / vortex-file-compressed / ns (0.972x ➖, 4↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 243909802 / 244577057 / -0.3% 255210605 / 283980742 / -10.1% 0.96 / 0.86 / +11.0%
tpch_q02/duckdb:vortex-file-compressed 414712520 / 638799979 / -35.1% 🟢 489976141 / 419828018 / +16.7% 0.85 / 1.52 / -44.4%
tpch_q03/duckdb:vortex-file-compressed 378066922 / 383513164 / -1.4% 440523977 / 450834956 / -2.3% 0.86 / 0.85 / +0.9%
tpch_q04/duckdb:vortex-file-compressed 385482161 / 282948380 / +36.2% 🔴 387659436 / 314781074 / +23.2% 0.99 / 0.90 / +10.6%
tpch_q05/duckdb:vortex-file-compressed 488098975 / 543843707 / -10.3% 573527014 / 615544792 / -6.8% 0.85 / 0.88 / -3.7%
tpch_q06/duckdb:vortex-file-compressed 601889294 / 187483497 / +221.0% 🔴 247299340 / 194311348 / +27.3% 2.43 / 0.96 / +152.2%
tpch_q07/duckdb:vortex-file-compressed 410428997 / 400826463 / +2.4% 433563109 / 447298928 / -3.1% 0.95 / 0.90 / +5.6%
tpch_q08/duckdb:vortex-file-compressed 555129988 / 799396598 / -30.6% 🟢 663582082 / 776149108 / -14.5% 0.84 / 1.03 / -18.8%
tpch_q09/duckdb:vortex-file-compressed 377343988 / 374339092 / +0.8% 467188077 / 476343885 / -1.9% 0.81 / 0.79 / +2.8%
tpch_q10/duckdb:vortex-file-compressed 514344388 / 513933980 / +0.1% 560840923 / 562294892 / -0.3% 0.92 / 0.91 / +0.3%
tpch_q11/duckdb:vortex-file-compressed 306293357 / 312593381 / -2.0% 375451757 / 306932513 / +22.3% 0.82 / 1.02 / -19.9%
tpch_q12/duckdb:vortex-file-compressed 219940148 / 239987418 / -8.4% 291360324 / 292180830 / -0.3% 0.75 / 0.82 / -8.1%
tpch_q13/duckdb:vortex-file-compressed 176261510 / 220922851 / -20.2% 244856962 / 200836105 / +21.9% 0.72 / 1.10 / -34.6%
tpch_q14/duckdb:vortex-file-compressed 371484369 / 225857931 / +64.5% 🔴 567335621 / 274891942 / +106.4% 🔴 0.65 / 0.82 / -20.3%
tpch_q15/duckdb:vortex-file-compressed 235463956 / 234736587 / +0.3% 262837035 / 431664705 / -39.1% 🟢 0.90 / 0.54 / +64.7%
tpch_q16/duckdb:vortex-file-compressed 211418378 / 240206161 / -12.0% 227926345 / 1037239522 / -78.0% 🟢 0.93 / 0.23 / +300.5%
tpch_q17/duckdb:vortex-file-compressed 281803822 / 480643922 / -41.4% 🟢 297258627 / 623996239 / -52.4% 🟢 0.95 / 0.77 / +23.1%
tpch_q18/duckdb:vortex-file-compressed 316417276 / 753283403 / -58.0% 🟢 339157536 / 772383149 / -56.1% 🟢 0.93 / 0.98 / -4.3%
tpch_q19/duckdb:vortex-file-compressed 299751119 / 281317382 / +6.6% 342369025 / 309315911 / +10.7% 0.88 / 0.91 / -3.7%
tpch_q20/duckdb:vortex-file-compressed 378682716 / 334971547 / +13.0% 600712727 / 468261315 / +28.3% 0.63 / 0.72 / -11.9%
tpch_q21/duckdb:vortex-file-compressed 553603820 / 569791843 / -2.8% 632934821 / 583228252 / +8.5% 0.87 / 0.98 / -10.5%
tpch_q22/duckdb:vortex-file-compressed 242012635 / 244021348 / -0.8% 300258471 / 290509281 / +3.4% 0.81 / 0.84 / -4.0%
duckdb / parquet / ns (0.971x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 189939299 / 178332156 / +6.5% 231954551 / 216660853 / +7.1% 0.82 / 0.82 / -0.5%
tpch_q02/duckdb:parquet 490889588 / 499498935 / -1.7% 523064066 / 572240146 / -8.6% 0.94 / 0.87 / +7.5%
tpch_q03/duckdb:parquet 355786582 / 363608148 / -2.2% 460638768 / 427933662 / +7.6% 0.77 / 0.85 / -9.1%
tpch_q04/duckdb:parquet 221063429 / 278505780 / -20.6% 338203945 / 300925656 / +12.4% 0.65 / 0.93 / -29.4%
tpch_q05/duckdb:parquet 482344527 / 534485837 / -9.8% 545539829 / 582641798 / -6.4% 0.88 / 0.92 / -3.6%
tpch_q06/duckdb:parquet 142252070 / 164720337 / -13.6% 186365174 / 176922816 / +5.3% 0.76 / 0.93 / -18.0%
tpch_q07/duckdb:parquet 463336920 / 624378483 / -25.8% 644658909 / 563622869 / +14.4% 0.72 / 1.11 / -35.1%
tpch_q08/duckdb:parquet 625934131 / 584987857 / +7.0% 805513465 / 1052611146 / -23.5% 0.78 / 0.56 / +39.8%
tpch_q09/duckdb:parquet 741892299 / 584539860 / +26.9% 726562975 / 650716361 / +11.7% 1.02 / 0.90 / +13.7%
tpch_q10/duckdb:parquet 615146952 / 556431812 / +10.6% 715657296 / 583732296 / +22.6% 0.86 / 0.95 / -9.8%
tpch_q11/duckdb:parquet 289107462 / 290128283 / -0.4% 277662767 / 280246733 / -0.9% 1.04 / 1.04 / +0.6%
tpch_q12/duckdb:parquet 259471486 / 251001618 / +3.4% 284953617 / 281251193 / +1.3% 0.91 / 0.89 / +2.0%
tpch_q13/duckdb:parquet 364036562 / 371501061 / -2.0% 549359249 / 490670365 / +12.0% 0.66 / 0.76 / -12.5%
tpch_q14/duckdb:parquet 247691373 / 254671246 / -2.7% 288829179 / 311586674 / -7.3% 0.86 / 0.82 / +4.9%
tpch_q15/duckdb:parquet 202640578 / 194715761 / +4.1% 225510094 / 280217194 / -19.5% 0.90 / 0.69 / +29.3%
tpch_q16/duckdb:parquet 281978814 / 284429564 / -0.9% 292590185 / 293126316 / -0.2% 0.96 / 0.97 / -0.7%
tpch_q17/duckdb:parquet 281181749 / 297906160 / -5.6% 432364960 / 659706294 / -34.5% 🟢 0.65 / 0.45 / +44.0%
tpch_q18/duckdb:parquet 347156557 / 358877235 / -3.3% 387356535 / 356659196 / +8.6% 0.90 / 1.01 / -10.9%
tpch_q19/duckdb:parquet 235474786 / 249853017 / -5.8% 264066274 / 310570261 / -15.0% 0.89 / 0.80 / +10.8%
tpch_q20/duckdb:parquet 397774154 / 473595158 / -16.0% 460079967 / 530388068 / -13.3% 0.86 / 0.89 / -3.2%
tpch_q21/duckdb:parquet 458709323 / 452437021 / +1.4% 499035941 / 495699416 / +0.7% 0.92 / 0.91 / +0.7%
tpch_q22/duckdb:parquet 278976694 / 281406216 / -0.9% 286307579 / 328007489 / -12.7% 0.97 / 0.86 / +13.6%

@github-actions

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 9e4c9ab4 vs base d81bd4ce
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.5%
Engines: DataFusion No clear signal (+8.0%, low confidence) · DuckDB No clear signal (+7.0%, low confidence)
Vortex (geomean): hot 1.072x ➖ · cold 1.057x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.3% · Median polish +2.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.082x ➖, 1↑ 30↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35534530 / 35687064 / -0.4% 60370289 / 59727902 / +1.1% 0.59 / 0.60 / -1.5%
tpcds_q02/datafusion:vortex-file-compressed 51409212 / 51071520 / +0.7% 74413008 / 73866370 / +0.7% 0.69 / 0.69 / -0.1%
tpcds_q03/datafusion:vortex-file-compressed 21734946 / 20122918 / +8.0% 45784305 / 45522240 / +0.6% 0.47 / 0.44 / +7.4%
tpcds_q04/datafusion:vortex-file-compressed 301887154 / 294488276 / +2.5% 363895232 / 348826657 / +4.3% 0.83 / 0.84 / -1.7%
tpcds_q05/datafusion:vortex-file-compressed 75519538 / 72186978 / +4.6% 103992163 / 98074801 / +6.0% 0.73 / 0.74 / -1.3%
tpcds_q06/datafusion:vortex-file-compressed 46931042 / 42034562 / +11.6% 🔴 72890699 / 71314146 / +2.2% 0.64 / 0.59 / +9.2%
tpcds_q07/datafusion:vortex-file-compressed 45274380 / 41936610 / +8.0% 79417032 / 81598206 / -2.7% 0.57 / 0.51 / +10.9%
tpcds_q08/datafusion:vortex-file-compressed 32444140 / 29293898 / +10.8% 🔴 59480478 / 54786660 / +8.6% 0.55 / 0.53 / +2.0%
tpcds_q09/datafusion:vortex-file-compressed 43435106 / 43492521 / -0.1% 77242984 / 75585378 / +2.2% 0.56 / 0.58 / -2.3%
tpcds_q10/datafusion:vortex-file-compressed 48790802 / 37575747 / +29.8% 🔴 76422811 / 65187408 / +17.2% 🔴 0.64 / 0.58 / +10.8%
tpcds_q11/datafusion:vortex-file-compressed 182485106 / 174078024 / +4.8% 219550763 / 212796053 / +3.2% 0.83 / 0.82 / +1.6%
tpcds_q12/datafusion:vortex-file-compressed 17739637 / 17602241 / +0.8% 36423210 / 36804611 / -1.0% 0.49 / 0.48 / +1.8%
tpcds_q13/datafusion:vortex-file-compressed 46349852 / 37777492 / +22.7% 🔴 87023227 / 82427050 / +5.6% 0.53 / 0.46 / +16.2%
tpcds_q14/datafusion:vortex-file-compressed 249577566 / 234215656 / +6.6% 289623611 / 269416137 / +7.5% 0.86 / 0.87 / -0.9%
tpcds_q15/datafusion:vortex-file-compressed 41131072 / 40700370 / +1.1% 60241964 / 59132696 / +1.9% 0.68 / 0.69 / -0.8%
tpcds_q16/datafusion:vortex-file-compressed 25559234 / 24140928 / +5.9% 43415340 / 41799402 / +3.9% 0.59 / 0.58 / +1.9%
tpcds_q17/datafusion:vortex-file-compressed 70077329 / 64613948 / +8.5% 96866667 / 96825489 / +0.0% 0.72 / 0.67 / +8.4%
tpcds_q18/datafusion:vortex-file-compressed 70754574 / 68135038 / +3.8% 99221716 / 96678626 / +2.6% 0.71 / 0.70 / +1.2%
tpcds_q19/datafusion:vortex-file-compressed 28519821 / 23065796 / +23.6% 🔴 55782811 / 53499164 / +4.3% 0.51 / 0.43 / +18.6%
tpcds_q20/datafusion:vortex-file-compressed 23227886 / 23434874 / -0.9% 39588856 / 39490521 / +0.2% 0.59 / 0.59 / -1.1%
tpcds_q21/datafusion:vortex-file-compressed 47847196 / 46991756 / +1.8% 82277691 / 77561336 / +6.1% 0.58 / 0.61 / -4.0%
tpcds_q22/datafusion:vortex-file-compressed 438525397 / 436213066 / +0.5% 458611333 / 456238601 / +0.5% 0.96 / 0.96 / +0.0%
tpcds_q23/datafusion:vortex-file-compressed 307672180 / 295445526 / +4.1% 365714235 / 350238393 / +4.4% 0.84 / 0.84 / -0.3%
tpcds_q24/datafusion:vortex-file-compressed 125493940 / 118209681 / +6.2% 157746307 / 163532003 / -3.5% 0.80 / 0.72 / +10.1%
tpcds_q25/datafusion:vortex-file-compressed 67859689 / 58404091 / +16.2% 🔴 108824956 / 100148037 / +8.7% 0.62 / 0.58 / +6.9%
tpcds_q26/datafusion:vortex-file-compressed 38452722 / 37624965 / +2.2% 62199192 / 59590326 / +4.4% 0.62 / 0.63 / -2.1%
tpcds_q27/datafusion:vortex-file-compressed 83312698 / 71638275 / +16.3% 🔴 114612058 / 105343615 / +8.8% 0.73 / 0.68 / +6.9%
tpcds_q28/datafusion:vortex-file-compressed 42957070 / 42371952 / +1.4% 93255622 / 87727130 / +6.3% 0.46 / 0.48 / -4.6%
tpcds_q29/datafusion:vortex-file-compressed 69461580 / 66811756 / +4.0% 110011676 / 102564955 / +7.3% 0.63 / 0.65 / -3.1%
tpcds_q30/datafusion:vortex-file-compressed 51773800 / 51119143 / +1.3% 83030461 / 75743723 / +9.6% 0.62 / 0.67 / -7.6%
tpcds_q31/datafusion:vortex-file-compressed 218927101 / 200218175 / +9.3% 246479991 / 233152597 / +5.7% 0.89 / 0.86 / +3.4%
tpcds_q32/datafusion:vortex-file-compressed 15278877 / 15152590 / +0.8% 31594674 / 31036644 / +1.8% 0.48 / 0.49 / -0.9%
tpcds_q33/datafusion:vortex-file-compressed 40656704 / 33166894 / +22.6% 🔴 71882788 / 66312007 / +8.4% 0.57 / 0.50 / +13.1%
tpcds_q34/datafusion:vortex-file-compressed 48030027 / 40800963 / +17.7% 🔴 78275986 / 69572930 / +12.5% 🔴 0.61 / 0.59 / +4.6%
tpcds_q35/datafusion:vortex-file-compressed 100053674 / 92953752 / +7.6% 128708655 / 118717623 / +8.4% 0.78 / 0.78 / -0.7%
tpcds_q36/datafusion:vortex-file-compressed 74360106 / 66188984 / +12.3% 🔴 101868378 / 100548488 / +1.3% 0.73 / 0.66 / +10.9%
tpcds_q37/datafusion:vortex-file-compressed 23585664 / 28659362 / -17.7% 🟢 45220469 / 39142184 / +15.5% 🔴 0.52 / 0.73 / -28.8%
tpcds_q38/datafusion:vortex-file-compressed 85942796 / 79029305 / +8.7% 111296466 / 106760595 / +4.2% 0.77 / 0.74 / +4.3%
tpcds_q39/datafusion:vortex-file-compressed 885047157 / 884718834 / +0.0% 897591503 / 908976999 / -1.3% 0.99 / 0.97 / +1.3%
tpcds_q40/datafusion:vortex-file-compressed 28757654 / 28530688 / +0.8% 48802345 / 48600430 / +0.4% 0.59 / 0.59 / +0.4%
tpcds_q41/datafusion:vortex-file-compressed 20123460 / 19016106 / +5.8% 32358618 / 31973918 / +1.2% 0.62 / 0.59 / +4.6%
tpcds_q42/datafusion:vortex-file-compressed 17606512 / 14446512 / +21.9% 🔴 38097637 / 37086223 / +2.7% 0.46 / 0.39 / +18.6%
tpcds_q43/datafusion:vortex-file-compressed 19360494 / 17062690 / +13.5% 🔴 43019872 / 37710185 / +14.1% 🔴 0.45 / 0.45 / -0.5%
tpcds_q44/datafusion:vortex-file-compressed 45061890 / 43352470 / +3.9% 73046483 / 72038897 / +1.4% 0.62 / 0.60 / +2.5%
tpcds_q45/datafusion:vortex-file-compressed 43946215 / 44364085 / -0.9% 65368660 / 59556323 / +9.8% 0.67 / 0.74 / -9.7%
tpcds_q46/datafusion:vortex-file-compressed 82908886 / 70145033 / +18.2% 🔴 113709461 / 104029608 / +9.3% 0.73 / 0.67 / +8.1%
tpcds_q47/datafusion:vortex-file-compressed 183279103 / 173539465 / +5.6% 228749777 / 216035492 / +5.9% 0.80 / 0.80 / -0.3%
tpcds_q48/datafusion:vortex-file-compressed 42948238 / 35623834 / +20.6% 🔴 74769024 / 70644306 / +5.8% 0.57 / 0.50 / +13.9%
tpcds_q49/datafusion:vortex-file-compressed 80778353 / 77255316 / +4.6% 118158302 / 116737222 / +1.2% 0.68 / 0.66 / +3.3%
tpcds_q50/datafusion:vortex-file-compressed 59473715 / 55980736 / +6.2% 89999460 / 86230008 / +4.4% 0.66 / 0.65 / +1.8%
tpcds_q51/datafusion:vortex-file-compressed 245469403 / 247038673 / -0.6% 273192843 / 280421401 / -2.6% 0.90 / 0.88 / +2.0%
tpcds_q52/datafusion:vortex-file-compressed 17913726 / 14714848 / +21.7% 🔴 43159606 / 38389598 / +12.4% 🔴 0.42 / 0.38 / +8.3%
tpcds_q53/datafusion:vortex-file-compressed 24931280 / 22346742 / +11.6% 🔴 51591233 / 49846122 / +3.5% 0.48 / 0.45 / +7.8%
tpcds_q54/datafusion:vortex-file-compressed 65489744 / 57426460 / +14.0% 🔴 96395645 / 92580497 / +4.1% 0.68 / 0.62 / +9.5%
tpcds_q55/datafusion:vortex-file-compressed 17031728 / 13973340 / +21.9% 🔴 41146674 / 38808883 / +6.0% 0.41 / 0.36 / +15.0%
tpcds_q56/datafusion:vortex-file-compressed 39817184 / 33761524 / +17.9% 🔴 69251631 / 63265036 / +9.5% 0.57 / 0.53 / +7.7%
tpcds_q57/datafusion:vortex-file-compressed 136964012 / 131113802 / +4.5% 165374706 / 161410678 / +2.5% 0.83 / 0.81 / +2.0%
tpcds_q58/datafusion:vortex-file-compressed 51409332 / 48391922 / +6.2% 86517590 / 84580372 / +2.3% 0.59 / 0.57 / +3.9%
tpcds_q59/datafusion:vortex-file-compressed 59544809 / 55056536 / +8.2% 84319019 / 81170032 / +3.9% 0.71 / 0.68 / +4.1%
tpcds_q60/datafusion:vortex-file-compressed 41120924 / 34937748 / +17.7% 🔴 67688314 / 63120098 / +7.2% 0.61 / 0.55 / +9.8%
tpcds_q61/datafusion:vortex-file-compressed 53562204 / 45353798 / +18.1% 🔴 74360766 / 72493548 / +2.6% 0.72 / 0.63 / +15.1%
tpcds_q62/datafusion:vortex-file-compressed 19480349 / 18948984 / +2.8% 41615086 / 40635590 / +2.4% 0.47 / 0.47 / +0.4%
tpcds_q63/datafusion:vortex-file-compressed 24578957 / 22886570 / +7.4% 50751253 / 51245739 / -1.0% 0.48 / 0.45 / +8.4%
tpcds_q64/datafusion:vortex-file-compressed 348413114 / 331770842 / +5.0% 413923502 / 405661127 / +2.0% 0.84 / 0.82 / +2.9%
tpcds_q65/datafusion:vortex-file-compressed 77024494 / 74188341 / +3.8% 112202049 / 106874319 / +5.0% 0.69 / 0.69 / -1.1%
tpcds_q66/datafusion:vortex-file-compressed 53793306 / 51726748 / +4.0% 78081717 / 75217399 / +3.8% 0.69 / 0.69 / +0.2%
tpcds_q67/datafusion:vortex-file-compressed 422916852 / 425404384 / -0.6% 523178773 / 518487417 / +0.9% 0.81 / 0.82 / -1.5%
tpcds_q68/datafusion:vortex-file-compressed 74765110 / 67065476 / +11.5% 🔴 102835680 / 99957636 / +2.9% 0.73 / 0.67 / +8.4%
tpcds_q69/datafusion:vortex-file-compressed 48952186 / 36411572 / +34.4% 🔴 70929389 / 61245093 / +15.8% 🔴 0.69 / 0.59 / +16.1%
tpcds_q70/datafusion:vortex-file-compressed 198586664 / 195234258 / +1.7% 227341407 / 223353634 / +1.8% 0.87 / 0.87 / -0.1%
tpcds_q71/datafusion:vortex-file-compressed 31093004 / 24846620 / +25.1% 🔴 61101347 / 57873035 / +5.6% 0.51 / 0.43 / +18.5%
tpcds_q72/datafusion:vortex-file-compressed 1602534729 / 1613070819 / -0.7% 1655141712 / 1672817704 / -1.1% 0.97 / 0.96 / +0.4%
tpcds_q73/datafusion:vortex-file-compressed 44025676 / 37798150 / +16.5% 🔴 72917397 / 63097488 / +15.6% 🔴 0.60 / 0.60 / +0.8%
tpcds_q74/datafusion:vortex-file-compressed 141562198 / 134609600 / +5.2% 174346694 / 169107950 / +3.1% 0.81 / 0.80 / +2.0%
tpcds_q75/datafusion:vortex-file-compressed 161575138 / 157283038 / +2.7% 207486768 / 199539779 / +4.0% 0.78 / 0.79 / -1.2%
tpcds_q76/datafusion:vortex-file-compressed 36062658 / 34141944 / +5.6% 73726179 / 76790189 / -4.0% 0.49 / 0.44 / +10.0%
tpcds_q77/datafusion:vortex-file-compressed 58209844 / 54578544 / +6.7% 91219434 / 87907886 / +3.8% 0.64 / 0.62 / +2.8%
tpcds_q78/datafusion:vortex-file-compressed 145536083 / 139945221 / +4.0% 196414379 / 191111158 / +2.8% 0.74 / 0.73 / +1.2%
tpcds_q79/datafusion:vortex-file-compressed 64711234 / 54551104 / +18.6% 🔴 90878522 / 83695427 / +8.6% 0.71 / 0.65 / +9.2%
tpcds_q80/datafusion:vortex-file-compressed 84235793 / 81251883 / +3.7% 131101599 / 126092347 / +4.0% 0.64 / 0.64 / -0.3%
tpcds_q81/datafusion:vortex-file-compressed 56263514 / 57217203 / -1.7% 83872335 / 83290839 / +0.7% 0.67 / 0.69 / -2.3%
tpcds_q82/datafusion:vortex-file-compressed 32518100 / 29527786 / +10.1% 🔴 46847136 / 46344112 / +1.1% 0.69 / 0.64 / +8.9%
tpcds_q83/datafusion:vortex-file-compressed 42715394 / 42234106 / +1.1% 66977904 / 65316165 / +2.5% 0.64 / 0.65 / -1.4%
tpcds_q84/datafusion:vortex-file-compressed 12753741 / 12318387 / +3.5% 31299664 / 31461444 / -0.5% 0.41 / 0.39 / +4.1%
tpcds_q85/datafusion:vortex-file-compressed 60418200 / 60351388 / +0.1% 89362402 / 89165946 / +0.2% 0.68 / 0.68 / -0.1%
tpcds_q86/datafusion:vortex-file-compressed 18681578 / 18635084 / +0.2% 38368653 / 40794939 / -5.9% 0.49 / 0.46 / +6.6%
tpcds_q87/datafusion:vortex-file-compressed 84626024 / 77726270 / +8.9% 115303487 / 106793331 / +8.0% 0.73 / 0.73 / +0.8%
tpcds_q88/datafusion:vortex-file-compressed 94305549 / 54134854 / +74.2% 🔴 129345952 / 91920123 / +40.7% 🔴 0.73 / 0.59 / +23.8%
tpcds_q89/datafusion:vortex-file-compressed 29121768 / 27705445 / +5.1% 55561451 / 52989044 / +4.9% 0.52 / 0.52 / +0.2%
tpcds_q90/datafusion:vortex-file-compressed 13835295 / 12876262 / +7.4% 32993059 / 31193191 / +5.8% 0.42 / 0.41 / +1.6%
tpcds_q91/datafusion:vortex-file-compressed 19545653 / 19841934 / -1.5% 41186144 / 40517298 / +1.7% 0.47 / 0.49 / -3.1%
tpcds_q92/datafusion:vortex-file-compressed 15927736 / 15586140 / +2.2% 36215857 / 35022452 / +3.4% 0.44 / 0.45 / -1.2%
tpcds_q93/datafusion:vortex-file-compressed 56735784 / 54479092 / +4.1% 93131948 / 91110634 / +2.2% 0.61 / 0.60 / +1.9%
tpcds_q94/datafusion:vortex-file-compressed 21952440 / 21721248 / +1.1% 45687476 / 43008447 / +6.2% 0.48 / 0.51 / -4.9%
tpcds_q95/datafusion:vortex-file-compressed 95642800 / 96025348 / -0.4% 123664719 / 125556657 / -1.5% 0.77 / 0.76 / +1.1%
tpcds_q96/datafusion:vortex-file-compressed 17766815 / 11669502 / +52.2% 🔴 38618547 / 29013229 / +33.1% 🔴 0.46 / 0.40 / +14.4%
tpcds_q97/datafusion:vortex-file-compressed 43142277 / 39740562 / +8.6% 70410759 / 64433312 / +9.3% 0.61 / 0.62 / -0.7%
tpcds_q98/datafusion:vortex-file-compressed 22916071 / 20279683 / +13.0% 🔴 52684726 / 49580667 / +6.3% 0.43 / 0.41 / +6.3%
tpcds_q99/datafusion:vortex-file-compressed 31824586 / 28990486 / +9.8% 49465920 / 46237709 / +7.0% 0.64 / 0.63 / +2.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59676764 / 59467470 / +0.4% 78184950 / 78629990 / -0.6% 0.76 / 0.76 / +0.9%
tpcds_q02/datafusion:parquet 68567355 / 68841136 / -0.4% 93602536 / 92247774 / +1.5% 0.73 / 0.75 / -1.8%
tpcds_q03/datafusion:parquet 28436046 / 28412717 / +0.1% 52025209 / 51484914 / +1.0% 0.55 / 0.55 / -1.0%
tpcds_q04/datafusion:parquet 644408220 / 642280600 / +0.3% 713552037 / 713442164 / +0.0% 0.90 / 0.90 / +0.3%
tpcds_q05/datafusion:parquet 82603152 / 80587203 / +2.5% 110288351 / 114099796 / -3.3% 0.75 / 0.71 / +6.0%
tpcds_q06/datafusion:parquet 90985630 / 91299202 / -0.3% 114128370 / 111123421 / +2.7% 0.80 / 0.82 / -3.0%
tpcds_q07/datafusion:parquet 101218532 / 100516129 / +0.7% 141137383 / 140439595 / +0.5% 0.72 / 0.72 / +0.2%
tpcds_q08/datafusion:parquet 48476232 / 47906314 / +1.2% 75836799 / 77683939 / -2.4% 0.64 / 0.62 / +3.7%
tpcds_q09/datafusion:parquet 76912176 / 75858005 / +1.4% 108201547 / 103150303 / +4.9% 0.71 / 0.74 / -3.3%
tpcds_q10/datafusion:parquet 59705148 / 59911058 / -0.3% 87156642 / 85891230 / +1.5% 0.69 / 0.70 / -1.8%
tpcds_q11/datafusion:parquet 410632616 / 410249982 / +0.1% 451610198 / 453298906 / -0.4% 0.91 / 0.91 / +0.5%
tpcds_q12/datafusion:parquet 39732935 / 40180548 / -1.1% 56774600 / 57554919 / -1.4% 0.70 / 0.70 / +0.2%
tpcds_q13/datafusion:parquet 87387748 / 84877392 / +3.0% 127433530 / 129583250 / -1.7% 0.69 / 0.66 / +4.7%
tpcds_q14/datafusion:parquet 374625266 / 390641226 / -4.1% 415833810 / 422522225 / -1.6% 0.90 / 0.92 / -2.6%
tpcds_q15/datafusion:parquet 51130276 / 51004075 / +0.2% 70277268 / 70096169 / +0.3% 0.73 / 0.73 / -0.0%
tpcds_q16/datafusion:parquet 45544638 / 45319756 / +0.5% 63219487 / 62344760 / +1.4% 0.72 / 0.73 / -0.9%
tpcds_q17/datafusion:parquet 137870168 / 140124091 / -1.6% 170759144 / 173293414 / -1.5% 0.81 / 0.81 / -0.1%
tpcds_q18/datafusion:parquet 109864074 / 110049167 / -0.2% 142835405 / 141644863 / +0.8% 0.77 / 0.78 / -1.0%
tpcds_q19/datafusion:parquet 48072564 / 47382432 / +1.5% 76431048 / 74454407 / +2.7% 0.63 / 0.64 / -1.2%
tpcds_q20/datafusion:parquet 41822443 / 41140804 / +1.7% 54903443 / 53422774 / +2.8% 0.76 / 0.77 / -1.1%
tpcds_q21/datafusion:parquet 61279263 / 60585280 / +1.1% 73631257 / 72359261 / +1.8% 0.83 / 0.84 / -0.6%
tpcds_q22/datafusion:parquet 467514036 / 464956066 / +0.6% 477623177 / 480116418 / -0.5% 0.98 / 0.97 / +1.1%
tpcds_q23/datafusion:parquet 367697720 / 362030230 / +1.6% 420215918 / 423236940 / -0.7% 0.88 / 0.86 / +2.3%
tpcds_q24/datafusion:parquet 241467419 / 238522424 / +1.2% 276690434 / 280988941 / -1.5% 0.87 / 0.85 / +2.8%
tpcds_q25/datafusion:parquet 144918300 / 145856299 / -0.6% 188337393 / 180939258 / +4.1% 0.77 / 0.81 / -4.5%
tpcds_q26/datafusion:parquet 55365044 / 54371764 / +1.8% 80871720 / 78855738 / +2.6% 0.68 / 0.69 / -0.7%
tpcds_q27/datafusion:parquet 206848724 / 208670172 / -0.9% 236127520 / 244008894 / -3.2% 0.88 / 0.86 / +2.4%
tpcds_q28/datafusion:parquet 88218799 / 88438947 / -0.2% 119475831 / 115489704 / +3.5% 0.74 / 0.77 / -3.6%
tpcds_q29/datafusion:parquet 142045360 / 143202262 / -0.8% 178417797 / 175795941 / +1.5% 0.80 / 0.81 / -2.3%
tpcds_q30/datafusion:parquet 97154483 / 99031156 / -1.9% 121987009 / 119707182 / +1.9% 0.80 / 0.83 / -3.7%
tpcds_q31/datafusion:parquet 319577649 / 318865238 / +0.2% 344470549 / 342248409 / +0.6% 0.93 / 0.93 / -0.4%
tpcds_q32/datafusion:parquet 29090932 / 29268206 / -0.6% 45439872 / 43049951 / +5.6% 0.64 / 0.68 / -5.8%
tpcds_q33/datafusion:parquet 53386265 / 54279188 / -1.6% 78153996 / 73291711 / +6.6% 0.68 / 0.74 / -7.8%
tpcds_q34/datafusion:parquet 63320013 / 62880984 / +0.7% 86933547 / 85677254 / +1.5% 0.73 / 0.73 / -0.8%
tpcds_q35/datafusion:parquet 124422104 / 124024507 / +0.3% 152599084 / 152510309 / +0.1% 0.82 / 0.81 / +0.3%
tpcds_q36/datafusion:parquet 100707270 / 96065436 / +4.8% 126942298 / 130472892 / -2.7% 0.79 / 0.74 / +7.7%
tpcds_q37/datafusion:parquet 50510136 / 50326967 / +0.4% 68099066 / 62106792 / +9.6% 0.74 / 0.81 / -8.5%
tpcds_q38/datafusion:parquet 122222638 / 121809162 / +0.3% 144292373 / 148143097 / -2.6% 0.85 / 0.82 / +3.0%
tpcds_q39/datafusion:parquet 846416066 / 850365260 / -0.5% 860688579 / 858244795 / +0.3% 0.98 / 0.99 / -0.7%
tpcds_q40/datafusion:parquet 35352556 / 34460206 / +2.6% 54280746 / 55082629 / -1.5% 0.65 / 0.63 / +4.1%
tpcds_q41/datafusion:parquet 31028815 / 32074791 / -3.3% 43708296 / 42604832 / +2.6% 0.71 / 0.75 / -5.7%
tpcds_q42/datafusion:parquet 26622400 / 26668796 / -0.2% 47805700 / 44471155 / +7.5% 0.56 / 0.60 / -7.1%
tpcds_q43/datafusion:parquet 27145168 / 27798290 / -2.3% 48618969 / 48667153 / -0.1% 0.56 / 0.57 / -2.3%
tpcds_q44/datafusion:parquet 65286990 / 66005414 / -1.1% 87874834 / 85489645 / +2.8% 0.74 / 0.77 / -3.8%
tpcds_q45/datafusion:parquet 66150314 / 66367192 / -0.3% 87666005 / 87700095 / -0.0% 0.75 / 0.76 / -0.3%
tpcds_q46/datafusion:parquet 108934041 / 108262468 / +0.6% 150200398 / 147281576 / +2.0% 0.73 / 0.74 / -1.3%
tpcds_q47/datafusion:parquet 237419370 / 235616338 / +0.8% 276686108 / 274771942 / +0.7% 0.86 / 0.86 / +0.1%
tpcds_q48/datafusion:parquet 77678325 / 79003310 / -1.7% 108144047 / 104369134 / +3.6% 0.72 / 0.76 / -5.1%
tpcds_q49/datafusion:parquet 113797359 / 117557337 / -3.2% 153705396 / 168445239 / -8.8% 0.74 / 0.70 / +6.1%
tpcds_q50/datafusion:parquet 90499904 / 91455979 / -1.0% 126056298 / 121449330 / +3.8% 0.72 / 0.75 / -4.7%
tpcds_q51/datafusion:parquet 256440398 / 257462208 / -0.4% 286833841 / 275612309 / +4.1% 0.89 / 0.93 / -4.3%
tpcds_q52/datafusion:parquet 26818680 / 26582131 / +0.9% 49012867 / 46713825 / +4.9% 0.55 / 0.57 / -3.8%
tpcds_q53/datafusion:parquet 36632409 / 35857856 / +2.2% 57233383 / 60285453 / -5.1% 0.64 / 0.59 / +7.6%
tpcds_q54/datafusion:parquet 87029286 / 84979193 / +2.4% 108481032 / 106622915 / +1.7% 0.80 / 0.80 / +0.7%
tpcds_q55/datafusion:parquet 26747771 / 25716791 / +4.0% 45376980 / 47255907 / -4.0% 0.59 / 0.54 / +8.3%
tpcds_q56/datafusion:parquet 53008153 / 52634930 / +0.7% 78934558 / 72550483 / +8.8% 0.67 / 0.73 / -7.4%
tpcds_q57/datafusion:parquet 171538554 / 171481192 / +0.0% 195904787 / 193556759 / +1.2% 0.88 / 0.89 / -1.2%
tpcds_q58/datafusion:parquet 98205504 / 97417717 / +0.8% 124470901 / 116545953 / +6.8% 0.79 / 0.84 / -5.6%
tpcds_q59/datafusion:parquet 103972274 / 105187850 / -1.2% 130958153 / 128553486 / +1.9% 0.79 / 0.82 / -3.0%
tpcds_q60/datafusion:parquet 56757833 / 53716710 / +5.7% 75409941 / 72468178 / +4.1% 0.75 / 0.74 / +1.5%
tpcds_q61/datafusion:parquet 75520642 / 74726424 / +1.1% 103716115 / 100897235 / +2.8% 0.73 / 0.74 / -1.7%
tpcds_q62/datafusion:parquet 27625892 / 27394960 / +0.8% 45105119 / 44704350 / +0.9% 0.61 / 0.61 / -0.1%
tpcds_q63/datafusion:parquet 36569454 / 36109236 / +1.3% 59765321 / 58190337 / +2.7% 0.61 / 0.62 / -1.4%
tpcds_q64/datafusion:parquet 661229973 / 658028547 / +0.5% 745657501 / 727112413 / +2.6% 0.89 / 0.90 / -2.0%
tpcds_q65/datafusion:parquet 101844728 / 100883629 / +1.0% 133331430 / 133391313 / -0.0% 0.76 / 0.76 / +1.0%
tpcds_q66/datafusion:parquet 76455966 / 77524761 / -1.4% 102256651 / 104064088 / -1.7% 0.75 / 0.74 / +0.4%
tpcds_q67/datafusion:parquet 432785150 / 432898548 / -0.0% 502035118 / 500774321 / +0.3% 0.86 / 0.86 / -0.3%
tpcds_q68/datafusion:parquet 108040038 / 107972369 / +0.1% 160091321 / 153393827 / +4.4% 0.67 / 0.70 / -4.1%
tpcds_q69/datafusion:parquet 59026104 / 59031088 / -0.0% 83871180 / 81368763 / +3.1% 0.70 / 0.73 / -3.0%
tpcds_q70/datafusion:parquet 211002971 / 211356872 / -0.2% 243324133 / 243628971 / -0.1% 0.87 / 0.87 / -0.0%
tpcds_q71/datafusion:parquet 38394942 / 39988372 / -4.0% 63589887 / 63580905 / +0.0% 0.60 / 0.63 / -4.0%
tpcds_q72/datafusion:parquet 1755361326 / 1766291258 / -0.6% 1876831161 / 1717685799 / +9.3% 0.94 / 1.03 / -9.0%
tpcds_q73/datafusion:parquet 63654402 / 62604856 / +1.7% 85977147 / 85382876 / +0.7% 0.74 / 0.73 / +1.0%
tpcds_q74/datafusion:parquet 294206796 / 293543952 / +0.2% 325835692 / 333014708 / -2.2% 0.90 / 0.88 / +2.4%
tpcds_q75/datafusion:parquet 194943864 / 195570109 / -0.3% 238696823 / 227532670 / +4.9% 0.82 / 0.86 / -5.0%
tpcds_q76/datafusion:parquet 50155406 / 50790492 / -1.3% 80106450 / 80279383 / -0.2% 0.63 / 0.63 / -1.0%
tpcds_q77/datafusion:parquet 71770492 / 71696114 / +0.1% 100956854 / 102466534 / -1.5% 0.71 / 0.70 / +1.6%
tpcds_q78/datafusion:parquet 209414375 / 210078458 / -0.3% 275194989 / 262635746 / +4.8% 0.76 / 0.80 / -4.9%
tpcds_q79/datafusion:parquet 75810012 / 78772706 / -3.8% 120512926 / 113848428 / +5.9% 0.63 / 0.69 / -9.1%
tpcds_q80/datafusion:parquet 148328764 / 143215239 / +3.6% 187926513 / 198385628 / -5.3% 0.79 / 0.72 / +9.3%
tpcds_q81/datafusion:parquet 107580966 / 108666647 / -1.0% 126336965 / 126675306 / -0.3% 0.85 / 0.86 / -0.7%
tpcds_q82/datafusion:parquet 54761556 / 54589676 / +0.3% 71100512 / 72577165 / -2.0% 0.77 / 0.75 / +2.4%
tpcds_q83/datafusion:parquet 66585510 / 66004765 / +0.9% 79183538 / 80766410 / -2.0% 0.84 / 0.82 / +2.9%
tpcds_q84/datafusion:parquet 35718580 / 35067368 / +1.9% 50739673 / 49217980 / +3.1% 0.70 / 0.71 / -1.2%
tpcds_q85/datafusion:parquet 107444542 / 106118258 / +1.2% 129814266 / 126965208 / +2.2% 0.83 / 0.84 / -1.0%
tpcds_q86/datafusion:parquet 21629762 / 21856744 / -1.0% 40496113 / 38801034 / +4.4% 0.53 / 0.56 / -5.2%
tpcds_q87/datafusion:parquet 122511844 / 121427887 / +0.9% 142745242 / 146352765 / -2.5% 0.86 / 0.83 / +3.4%
tpcds_q88/datafusion:parquet 85531604 / 85112720 / +0.5% 107618230 / 111247316 / -3.3% 0.79 / 0.77 / +3.9%
tpcds_q89/datafusion:parquet 38634868 / 38253917 / +1.0% 63078120 / 64696968 / -2.5% 0.61 / 0.59 / +3.6%
tpcds_q90/datafusion:parquet 17015652 / 17095194 / -0.5% 30665488 / 32500458 / -5.6% 0.55 / 0.53 / +5.5%
tpcds_q91/datafusion:parquet 42444846 / 41649029 / +1.9% 59954548 / 57973405 / +3.4% 0.71 / 0.72 / -1.5%
tpcds_q92/datafusion:parquet 29405896 / 28701521 / +2.5% 47772092 / 45914012 / +4.0% 0.62 / 0.63 / -1.5%
tpcds_q93/datafusion:parquet 61089886 / 61105564 / -0.0% 91205161 / 86368626 / +5.6% 0.67 / 0.71 / -5.3%
tpcds_q94/datafusion:parquet 38143042 / 38133748 / +0.0% 57696680 / 57944474 / -0.4% 0.66 / 0.66 / +0.5%
tpcds_q95/datafusion:parquet 126335574 / 129222804 / -2.2% 148270604 / 153739120 / -3.6% 0.85 / 0.84 / +1.4%
tpcds_q96/datafusion:parquet 20843245 / 21737938 / -4.1% 37085651 / 38315607 / -3.2% 0.56 / 0.57 / -0.9%
tpcds_q97/datafusion:parquet 55318552 / 54900939 / +0.8% 81225261 / 80044710 / +1.5% 0.68 / 0.69 / -0.7%
tpcds_q98/datafusion:parquet 61908658 / 62068014 / -0.3% 86970547 / 84935164 / +2.4% 0.71 / 0.73 / -2.6%
tpcds_q99/datafusion:parquet 42607946 / 42547334 / +0.1% 58134751 / 57947364 / +0.3% 0.73 / 0.73 / -0.2%
duckdb / vortex-file-compressed / ns (1.062x ➖, 0↑ 29↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32423172 / 32666622 / -0.7% 45368996 / 44442032 / +2.1% 0.71 / 0.74 / -2.8%
tpcds_q02/duckdb:vortex-file-compressed 31092955 / 31019078 / +0.2% 43011857 / 42210494 / +1.9% 0.72 / 0.73 / -1.6%
tpcds_q03/duckdb:vortex-file-compressed 15386802 / 13791742 / +11.6% 🔴 30902556 / 29378226 / +5.2% 0.50 / 0.47 / +6.1%
tpcds_q04/duckdb:vortex-file-compressed 133107437 / 129471634 / +2.8% 149923637 / 151903616 / -1.3% 0.89 / 0.85 / +4.2%
tpcds_q05/duckdb:vortex-file-compressed 57486740 / 54650877 / +5.2% 72715338 / 73147246 / -0.6% 0.79 / 0.75 / +5.8%
tpcds_q06/duckdb:vortex-file-compressed 62515110 / 58713689 / +6.5% 80465444 / 75959131 / +5.9% 0.78 / 0.77 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 33784604 / 30579528 / +10.5% 🔴 56646600 / 52049505 / +8.8% 0.60 / 0.59 / +1.5%
tpcds_q08/duckdb:vortex-file-compressed 32399406 / 30914874 / +4.8% 44354715 / 40665146 / +9.1% 0.73 / 0.76 / -3.9%
tpcds_q09/duckdb:vortex-file-compressed 56615536 / 56913068 / -0.5% 80339529 / 74998255 / +7.1% 0.70 / 0.76 / -7.1%
tpcds_q10/duckdb:vortex-file-compressed 44248616 / 39635552 / +11.6% 🔴 65385953 / 57816076 / +13.1% 🔴 0.68 / 0.69 / -1.3%
tpcds_q11/duckdb:vortex-file-compressed 98259137 / 95253860 / +3.2% 114865852 / 113706380 / +1.0% 0.86 / 0.84 / +2.1%
tpcds_q12/duckdb:vortex-file-compressed 18036510 / 17712503 / +1.8% 31131131 / 29984002 / +3.8% 0.58 / 0.59 / -1.9%
tpcds_q13/duckdb:vortex-file-compressed 46680838 / 37991460 / +22.9% 🔴 73632913 / 69301429 / +6.3% 0.63 / 0.55 / +15.6%
tpcds_q14/duckdb:vortex-file-compressed 127202540 / 121384720 / +4.8% 147433948 / 134734274 / +9.4% 0.86 / 0.90 / -4.2%
tpcds_q15/duckdb:vortex-file-compressed 62415338 / 61299576 / +1.8% 74749687 / 72388428 / +3.3% 0.83 / 0.85 / -1.4%
tpcds_q16/duckdb:vortex-file-compressed 35052940 / 34690472 / +1.0% 53486116 / 52266117 / +2.3% 0.66 / 0.66 / -1.3%
tpcds_q17/duckdb:vortex-file-compressed 60982204 / 57332318 / +6.4% 81280721 / 79066911 / +2.8% 0.75 / 0.73 / +3.5%
tpcds_q18/duckdb:vortex-file-compressed 83910702 / 82923020 / +1.2% 102767929 / 101023706 / +1.7% 0.82 / 0.82 / -0.5%
tpcds_q19/duckdb:vortex-file-compressed 49131643 / 43597316 / +12.7% 🔴 66836215 / 62263780 / +7.3% 0.74 / 0.70 / +5.0%
tpcds_q20/duckdb:vortex-file-compressed 22198528 / 22262395 / -0.3% 36521055 / 35610939 / +2.6% 0.61 / 0.63 / -2.8%
tpcds_q21/duckdb:vortex-file-compressed 35669184 / 34748561 / +2.6% 65420494 / 61670816 / +6.1% 0.55 / 0.56 / -3.2%
tpcds_q22/duckdb:vortex-file-compressed 158505189 / 161348692 / -1.8% 179569862 / 172593381 / +4.0% 0.88 / 0.93 / -5.6%
tpcds_q23/duckdb:vortex-file-compressed 194203344 / 183560942 / +5.8% 209978235 / 197879336 / +6.1% 0.92 / 0.93 / -0.3%
tpcds_q24/duckdb:vortex-file-compressed 54016520 / 52262054 / +3.4% 78511032 / 70571615 / +11.3% 🔴 0.69 / 0.74 / -7.1%
tpcds_q25/duckdb:vortex-file-compressed 57508676 / 52927888 / +8.7% 77579191 / 72882457 / +6.4% 0.74 / 0.73 / +2.1%
tpcds_q26/duckdb:vortex-file-compressed 28084654 / 26933009 / +4.3% 42633702 / 40955560 / +4.1% 0.66 / 0.66 / +0.2%
tpcds_q27/duckdb:vortex-file-compressed 36905880 / 32187006 / +14.7% 🔴 57798954 / 51949183 / +11.3% 🔴 0.64 / 0.62 / +3.1%
tpcds_q28/duckdb:vortex-file-compressed 41952482 / 42552663 / -1.4% 66039542 / 61657569 / +7.1% 0.64 / 0.69 / -8.0%
tpcds_q29/duckdb:vortex-file-compressed 54295530 / 52233606 / +3.9% 76592943 / 71810623 / +6.7% 0.71 / 0.73 / -2.5%
tpcds_q30/duckdb:vortex-file-compressed 37950582 / 38885226 / -2.4% 51072856 / 50464856 / +1.2% 0.74 / 0.77 / -3.6%
tpcds_q31/duckdb:vortex-file-compressed 42926944 / 38098196 / +12.7% 🔴 58660001 / 53564287 / +9.5% 0.73 / 0.71 / +2.9%
tpcds_q32/duckdb:vortex-file-compressed 14502781 / 13744550 / +5.5% 30536594 / 29352103 / +4.0% 0.47 / 0.47 / +1.4%
tpcds_q33/duckdb:vortex-file-compressed 39834772 / 34677902 / +14.9% 🔴 62876266 / 56234127 / +11.8% 🔴 0.63 / 0.62 / +2.7%
tpcds_q34/duckdb:vortex-file-compressed 27727910 / 22969670 / +20.7% 🔴 43965026 / 38109259 / +15.4% 🔴 0.63 / 0.60 / +4.6%
tpcds_q35/duckdb:vortex-file-compressed 74689197 / 67973400 / +9.9% 97263995 / 87774818 / +10.8% 🔴 0.77 / 0.77 / -0.8%
tpcds_q36/duckdb:vortex-file-compressed 31502736 / 29798050 / +5.7% 51499284 / 50744981 / +1.5% 0.61 / 0.59 / +4.2%
tpcds_q37/duckdb:vortex-file-compressed 27218350 / 27056984 / +0.6% 73746613 / 63501341 / +16.1% 🔴 0.37 / 0.43 / -13.4%
tpcds_q38/duckdb:vortex-file-compressed 64266719 / 65418466 / -1.8% 87991925 / 79214533 / +11.1% 🔴 0.73 / 0.83 / -11.6%
tpcds_q39/duckdb:vortex-file-compressed 57434695 / 59507598 / -3.5% 87114905 / 85059050 / +2.4% 0.66 / 0.70 / -5.8%
tpcds_q40/duckdb:vortex-file-compressed 18770584 / 18871024 / -0.5% 35062257 / 33673544 / +4.1% 0.54 / 0.56 / -4.5%
tpcds_q41/duckdb:vortex-file-compressed 19267102 / 19805286 / -2.7% 26547752 / 29362971 / -9.6% 0.73 / 0.67 / +7.6%
tpcds_q42/duckdb:vortex-file-compressed 16985636 / 13899774 / +22.2% 🔴 33275853 / 29210586 / +13.9% 🔴 0.51 / 0.48 / +7.3%
tpcds_q43/duckdb:vortex-file-compressed 21360663 / 19246490 / +11.0% 🔴 37352901 / 32560191 / +14.7% 🔴 0.57 / 0.59 / -3.3%
tpcds_q44/duckdb:vortex-file-compressed 28218810 / 28025286 / +0.7% 50637132 / 48655091 / +4.1% 0.56 / 0.58 / -3.3%
tpcds_q45/duckdb:vortex-file-compressed 47641761 / 47072534 / +1.2% 58798605 / 59554822 / -1.3% 0.81 / 0.79 / +2.5%
tpcds_q46/duckdb:vortex-file-compressed 55799296 / 50438530 / +10.6% 🔴 79921111 / 74694605 / +7.0% 0.70 / 0.68 / +3.4%
tpcds_q47/duckdb:vortex-file-compressed 82121948 / 80023928 / +2.6% 103682331 / 94571206 / +9.6% 0.79 / 0.85 / -6.4%
tpcds_q48/duckdb:vortex-file-compressed 61930941 / 54686811 / +13.2% 🔴 85233038 / 74230374 / +14.8% 🔴 0.73 / 0.74 / -1.4%
tpcds_q49/duckdb:vortex-file-compressed 40206220 / 37594846 / +6.9% 81439068 / 74467492 / +9.4% 0.49 / 0.50 / -2.2%
tpcds_q50/duckdb:vortex-file-compressed 40557350 / 32781100 / +23.7% 🔴 59093554 / 53162237 / +11.2% 🔴 0.69 / 0.62 / +11.3%
tpcds_q51/duckdb:vortex-file-compressed 204581558 / 203964206 / +0.3% 221489276 / 219753980 / +0.8% 0.92 / 0.93 / -0.5%
tpcds_q52/duckdb:vortex-file-compressed 16385640 / 14677496 / +11.6% 🔴 32900853 / 31526862 / +4.4% 0.50 / 0.47 / +7.0%
tpcds_q53/duckdb:vortex-file-compressed 25199581 / 22186665 / +13.6% 🔴 41353023 / 37074470 / +11.5% 🔴 0.61 / 0.60 / +1.8%
tpcds_q54/duckdb:vortex-file-compressed 51021214 / 44656646 / +14.3% 🔴 66683923 / 64461201 / +3.4% 0.77 / 0.69 / +10.4%
tpcds_q55/duckdb:vortex-file-compressed 16825260 / 14576306 / +15.4% 🔴 32717462 / 29207984 / +12.0% 🔴 0.51 / 0.50 / +3.0%
tpcds_q56/duckdb:vortex-file-compressed 36694157 / 33782552 / +8.6% 59119254 / 55297615 / +6.9% 0.62 / 0.61 / +1.6%
tpcds_q57/duckdb:vortex-file-compressed 65077932 / 65424170 / -0.5% 78862871 / 78631941 / +0.3% 0.83 / 0.83 / -0.8%
tpcds_q58/duckdb:vortex-file-compressed 39384476 / 38898298 / +1.2% 60147659 / 55844701 / +7.7% 0.65 / 0.70 / -6.0%
tpcds_q59/duckdb:vortex-file-compressed 56803221 / 53884934 / +5.4% 69861491 / 64106634 / +9.0% 0.81 / 0.84 / -3.3%
tpcds_q60/duckdb:vortex-file-compressed 40055829 / 35946234 / +11.4% 🔴 62340571 / 56917888 / +9.5% 0.64 / 0.63 / +1.7%
tpcds_q61/duckdb:vortex-file-compressed 38427620 / 35361596 / +8.7% 57317803 / 54931615 / +4.3% 0.67 / 0.64 / +4.1%
tpcds_q62/duckdb:vortex-file-compressed 15228066 / 15642241 / -2.6% 26578668 / 26437775 / +0.5% 0.57 / 0.59 / -3.2%
tpcds_q63/duckdb:vortex-file-compressed 23979492 / 21535454 / +11.3% 🔴 41300427 / 37891582 / +9.0% 0.58 / 0.57 / +2.2%
tpcds_q64/duckdb:vortex-file-compressed 128971084 / 118554184 / +8.8% 158355244 / 155152310 / +2.1% 0.81 / 0.76 / +6.6%
tpcds_q65/duckdb:vortex-file-compressed 53038236 / 51795274 / +2.4% 69038296 / 58381044 / +18.3% 🔴 0.77 / 0.89 / -13.4%
tpcds_q66/duckdb:vortex-file-compressed 42648178 / 43175862 / -1.2% 59269450 / 58144026 / +1.9% 0.72 / 0.74 / -3.1%
tpcds_q67/duckdb:vortex-file-compressed 278352500 / 279697525 / -0.5% 288356331 / 286952006 / +0.5% 0.97 / 0.97 / -1.0%
tpcds_q68/duckdb:vortex-file-compressed 49909196 / 43855412 / +13.8% 🔴 74679005 / 70889380 / +5.3% 0.67 / 0.62 / +8.0%
tpcds_q69/duckdb:vortex-file-compressed 49308142 / 38928932 / +26.7% 🔴 67332705 / 58818393 / +14.5% 🔴 0.73 / 0.66 / +10.6%
tpcds_q70/duckdb:vortex-file-compressed 27954892 / 25463294 / +9.8% 44452323 / 40384021 / +10.1% 🔴 0.63 / 0.63 / -0.3%
tpcds_q71/duckdb:vortex-file-compressed 32795634 / 28420039 / +15.4% 🔴 56419550 / 50106346 / +12.6% 🔴 0.58 / 0.57 / +2.5%
tpcds_q72/duckdb:vortex-file-compressed 139939572 / 139979520 / -0.0% 165138288 / 158903169 / +3.9% 0.85 / 0.88 / -3.8%
tpcds_q73/duckdb:vortex-file-compressed 25515175 / 20585262 / +23.9% 🔴 42074416 / 34351793 / +22.5% 🔴 0.61 / 0.60 / +1.2%
tpcds_q74/duckdb:vortex-file-compressed 85658140 / 82954312 / +3.3% 105557142 / 96750254 / +9.1% 0.81 / 0.86 / -5.4%
tpcds_q75/duckdb:vortex-file-compressed 113877832 / 111812181 / +1.8% 141393010 / 134642468 / +5.0% 0.81 / 0.83 / -3.0%
tpcds_q76/duckdb:vortex-file-compressed 29412706 / 28565848 / +3.0% 58157516 / 50818005 / +14.4% 🔴 0.51 / 0.56 / -10.0%
tpcds_q77/duckdb:vortex-file-compressed 38932678 / 37119674 / +4.9% 64160044 / 58001525 / +10.6% 🔴 0.61 / 0.64 / -5.2%
tpcds_q78/duckdb:vortex-file-compressed 139979311 / 134376332 / +4.2% 162011092 / 156253992 / +3.7% 0.86 / 0.86 / +0.5%
tpcds_q79/duckdb:vortex-file-compressed 42860738 / 37226774 / +15.1% 🔴 64400134 / 64984627 / -0.9% 0.67 / 0.57 / +16.2%
tpcds_q80/duckdb:vortex-file-compressed 61134692 / 60631832 / +0.8% 90917002 / 87730396 / +3.6% 0.67 / 0.69 / -2.7%
tpcds_q81/duckdb:vortex-file-compressed 57105370 / 56945055 / +0.3% 69241823 / 69412304 / -0.2% 0.82 / 0.82 / +0.5%
tpcds_q82/duckdb:vortex-file-compressed 29167708 / 29310453 / -0.5% 76062022 / 66476381 / +14.4% 🔴 0.38 / 0.44 / -13.0%
tpcds_q83/duckdb:vortex-file-compressed 21840170 / 22220825 / -1.7% 31080164 / 31287098 / -0.7% 0.70 / 0.71 / -1.1%
tpcds_q84/duckdb:vortex-file-compressed 13620103 / 13235808 / +2.9% 24700148 / 23242568 / +6.3% 0.55 / 0.57 / -3.2%
tpcds_q85/duckdb:vortex-file-compressed 37535595 / 36925374 / +1.7% 55673123 / 51546008 / +8.0% 0.67 / 0.72 / -5.9%
tpcds_q86/duckdb:vortex-file-compressed 17567178 / 17513178 / +0.3% 29876689 / 27253205 / +9.6% 0.59 / 0.64 / -8.5%
tpcds_q87/duckdb:vortex-file-compressed 83703324 / 77864842 / +7.5% 92003423 / 89463261 / +2.8% 0.91 / 0.87 / +4.5%
tpcds_q88/duckdb:vortex-file-compressed 43416376 / 38263800 / +13.5% 🔴 55154169 / 48154818 / +14.5% 🔴 0.79 / 0.79 / -0.9%
tpcds_q89/duckdb:vortex-file-compressed 27240902 / 24642745 / +10.5% 🔴 45208987 / 39097340 / +15.6% 🔴 0.60 / 0.63 / -4.4%
tpcds_q90/duckdb:vortex-file-compressed 10197130 / 9989277 / +2.1% 21380617 / 19596667 / +9.1% 0.48 / 0.51 / -6.4%
tpcds_q91/duckdb:vortex-file-compressed 19931854 / 19631830 / +1.5% 29251037 / 28502784 / +2.6% 0.68 / 0.69 / -1.1%
tpcds_q92/duckdb:vortex-file-compressed 13896514 / 13669336 / +1.7% 27687367 / 27546971 / +0.5% 0.50 / 0.50 / +1.1%
tpcds_q93/duckdb:vortex-file-compressed 28660485 / 25614763 / +11.9% 🔴 54758592 / 48903940 / +12.0% 🔴 0.52 / 0.52 / -0.1%
tpcds_q94/duckdb:vortex-file-compressed 32147860 / 32556908 / -1.3% 46640802 / 46308520 / +0.7% 0.69 / 0.70 / -2.0%
tpcds_q95/duckdb:vortex-file-compressed 100402124 / 94847437 / +5.9% 106372230 / 106019934 / +0.3% 0.94 / 0.89 / +5.5%
tpcds_q96/duckdb:vortex-file-compressed 17384799 / 11913750 / +45.9% 🔴 30127097 / 24940175 / +20.8% 🔴 0.58 / 0.48 / +20.8%
tpcds_q97/duckdb:vortex-file-compressed 66693972 / 61212860 / +9.0% 89505160 / 78071460 / +14.6% 🔴 0.75 / 0.78 / -5.0%
tpcds_q98/duckdb:vortex-file-compressed 29320203 / 27621885 / +6.1% 45788449 / 43376439 / +5.6% 0.64 / 0.64 / +0.6%
tpcds_q99/duckdb:vortex-file-compressed 21931180 / 22726621 / -3.5% 36014185 / 35480133 / +1.5% 0.61 / 0.64 / -4.9%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41302064 / 41754509 / -1.1% 50258483 / 49716420 / +1.1% 0.82 / 0.84 / -2.2%
tpcds_q02/duckdb:parquet 37986883 / 39320498 / -3.4% 48111534 / 48014421 / +0.2% 0.79 / 0.82 / -3.6%
tpcds_q03/duckdb:parquet 25196306 / 25927457 / -2.8% 37543167 / 36544174 / +2.7% 0.67 / 0.71 / -5.4%
tpcds_q04/duckdb:parquet 204520506 / 204404258 / +0.1% 219517800 / 225527266 / -2.7% 0.93 / 0.91 / +2.8%
tpcds_q05/duckdb:parquet 70817188 / 69257976 / +2.3% 85518743 / 85239338 / +0.3% 0.83 / 0.81 / +1.9%
tpcds_q06/duckdb:parquet 74254494 / 75009952 / -1.0% 88884467 / 86459760 / +2.8% 0.84 / 0.87 / -3.7%
tpcds_q07/duckdb:parquet 59705836 / 61347346 / -2.7% 76822344 / 78900270 / -2.6% 0.78 / 0.78 / -0.0%
tpcds_q08/duckdb:parquet 38396715 / 39528259 / -2.9% 45988801 / 47045239 / -2.2% 0.83 / 0.84 / -0.6%
tpcds_q09/duckdb:parquet 87037340 / 85242190 / +2.1% 102638142 / 99107059 / +3.6% 0.85 / 0.86 / -1.4%
tpcds_q10/duckdb:parquet 52109234 / 51215596 / +1.7% 61588007 / 60545042 / +1.7% 0.85 / 0.85 / +0.0%
tpcds_q11/duckdb:parquet 157122927 / 157115754 / +0.0% 167207372 / 167096251 / +0.1% 0.94 / 0.94 / -0.1%
tpcds_q12/duckdb:parquet 40548570 / 40352013 / +0.5% 47000106 / 47141692 / -0.3% 0.86 / 0.86 / +0.8%
tpcds_q13/duckdb:parquet 71853998 / 70020372 / +2.6% 85748130 / 85638270 / +0.1% 0.84 / 0.82 / +2.5%
tpcds_q14/duckdb:parquet 187852150 / 184880045 / +1.6% 195966700 / 198443193 / -1.2% 0.96 / 0.93 / +2.9%
tpcds_q15/duckdb:parquet 60645174 / 60771048 / -0.2% 68913976 / 67619690 / +1.9% 0.88 / 0.90 / -2.1%
tpcds_q16/duckdb:parquet 37850258 / 37994630 / -0.4% 46087110 / 45727616 / +0.8% 0.82 / 0.83 / -1.2%
tpcds_q17/duckdb:parquet 83389718 / 83160258 / +0.3% 91156853 / 89114981 / +2.3% 0.91 / 0.93 / -2.0%
tpcds_q18/duckdb:parquet 88207046 / 87879957 / +0.4% 97517887 / 95836133 / +1.8% 0.90 / 0.92 / -1.4%
tpcds_q19/duckdb:parquet 48811802 / 47515380 / +2.7% 59789502 / 61000663 / -2.0% 0.82 / 0.78 / +4.8%
tpcds_q20/duckdb:parquet 40853994 / 43268675 / -5.6% 48653294 / 53319914 / -8.8% 0.84 / 0.81 / +3.5%
tpcds_q21/duckdb:parquet 23615990 / 23792717 / -0.7% 28010231 / 30200345 / -7.3% 0.84 / 0.79 / +7.0%
tpcds_q22/duckdb:parquet 161461949 / 166859429 / -3.2% 163164599 / 164973195 / -1.1% 0.99 / 1.01 / -2.2%
tpcds_q23/duckdb:parquet 185945724 / 185062354 / +0.5% 193297428 / 194317115 / -0.5% 0.96 / 0.95 / +1.0%
tpcds_q24/duckdb:parquet 71754846 / 73795194 / -2.8% 86446329 / 81539892 / +6.0% 0.83 / 0.91 / -8.3%
tpcds_q25/duckdb:parquet 50679793 / 50609986 / +0.1% 60220692 / 59253909 / +1.6% 0.84 / 0.85 / -1.5%
tpcds_q26/duckdb:parquet 42303859 / 42341269 / -0.1% 51698202 / 50367988 / +2.6% 0.82 / 0.84 / -2.7%
tpcds_q27/duckdb:parquet 55765763 / 59273806 / -5.9% 73921402 / 74915572 / -1.3% 0.75 / 0.79 / -4.7%
tpcds_q28/duckdb:parquet 92694156 / 92538077 / +0.2% 110805791 / 108311955 / +2.3% 0.84 / 0.85 / -2.1%
tpcds_q29/duckdb:parquet 83552504 / 85143526 / -1.9% 97807270 / 97322888 / +0.5% 0.85 / 0.87 / -2.4%
tpcds_q30/duckdb:parquet 71230851 / 71883182 / -0.9% 80429463 / 79235601 / +1.5% 0.89 / 0.91 / -2.4%
tpcds_q31/duckdb:parquet 98708748 / 98352300 / +0.4% 111274131 / 110050281 / +1.1% 0.89 / 0.89 / -0.7%
tpcds_q32/duckdb:parquet 18227234 / 18136707 / +0.5% 25091734 / 25667997 / -2.2% 0.73 / 0.71 / +2.8%
tpcds_q33/duckdb:parquet 62434596 / 63106814 / -1.1% 76651824 / 75700594 / +1.3% 0.81 / 0.83 / -2.3%
tpcds_q34/duckdb:parquet 30875561 / 33253224 / -7.2% 41288874 / 39802094 / +3.7% 0.75 / 0.84 / -10.5%
tpcds_q35/duckdb:parquet 77072046 / 75987730 / +1.4% 84175226 / 90314190 / -6.8% 0.92 / 0.84 / +8.8%
tpcds_q36/duckdb:parquet 96653668 / 96353316 / +0.3% 112195817 / 111385494 / +0.7% 0.86 / 0.87 / -0.4%
tpcds_q37/duckdb:parquet 41464404 / 42209048 / -1.8% 46536014 / 47786871 / -2.6% 0.89 / 0.88 / +0.9%
tpcds_q38/duckdb:parquet 75455822 / 77958424 / -3.2% 79539798 / 85349165 / -6.8% 0.95 / 0.91 / +3.9%
tpcds_q39/duckdb:parquet 61441843 / 61486491 / -0.1% 66497983 / 68395844 / -2.8% 0.92 / 0.90 / +2.8%
tpcds_q40/duckdb:parquet 28003605 / 28074760 / -0.3% 35437549 / 35471051 / -0.1% 0.79 / 0.79 / -0.2%
tpcds_q41/duckdb:parquet 19958652 / 20300412 / -1.7% 26797999 / 27039573 / -0.9% 0.74 / 0.75 / -0.8%
tpcds_q42/duckdb:parquet 26076766 / 25832600 / +0.9% 37416618 / 37396731 / +0.1% 0.70 / 0.69 / +0.9%
tpcds_q43/duckdb:parquet 27217510 / 27833256 / -2.2% 37189670 / 37569548 / -1.0% 0.73 / 0.74 / -1.2%
tpcds_q44/duckdb:parquet 59535969 / 61917711 / -3.8% 73174374 / 76056446 / -3.8% 0.81 / 0.81 / -0.1%
tpcds_q45/duckdb:parquet 60831521 / 60935476 / -0.2% 66720483 / 66445419 / +0.4% 0.91 / 0.92 / -0.6%
tpcds_q46/duckdb:parquet 72130218 / 74233802 / -2.8% 84909277 / 85326401 / -0.5% 0.85 / 0.87 / -2.4%
tpcds_q47/duckdb:parquet 90557975 / 91376278 / -0.9% 102814519 / 100561337 / +2.2% 0.88 / 0.91 / -3.1%
tpcds_q48/duckdb:parquet 64347012 / 65415782 / -1.6% 80166626 / 77089178 / +4.0% 0.80 / 0.85 / -5.4%
tpcds_q49/duckdb:parquet 69989994 / 68736560 / +1.8% 82824509 / 88271949 / -6.2% 0.85 / 0.78 / +8.5%
tpcds_q50/duckdb:parquet 43666214 / 44405659 / -1.7% 55921992 / 50047873 / +11.7% 🔴 0.78 / 0.89 / -12.0%
tpcds_q51/duckdb:parquet 218238526 / 215203352 / +1.4% 222575904 / 225668772 / -1.4% 0.98 / 0.95 / +2.8%
tpcds_q52/duckdb:parquet 26115287 / 26929999 / -3.0% 36575349 / 37851845 / -3.4% 0.71 / 0.71 / +0.4%
tpcds_q53/duckdb:parquet 33649936 / 35085957 / -4.1% 48519777 / 45697835 / +6.2% 0.69 / 0.77 / -9.7%
tpcds_q54/duckdb:parquet 56001102 / 55066050 / +1.7% 62233024 / 62823873 / -0.9% 0.90 / 0.88 / +2.7%
tpcds_q55/duckdb:parquet 26047546 / 27167385 / -4.1% 37228175 / 36846878 / +1.0% 0.70 / 0.74 / -5.1%
tpcds_q56/duckdb:parquet 66852747 / 69810094 / -4.2% 82922577 / 78191395 / +6.1% 0.81 / 0.89 / -9.7%
tpcds_q57/duckdb:parquet 68687563 / 67924052 / +1.1% 75393329 / 75378836 / +0.0% 0.91 / 0.90 / +1.1%
tpcds_q58/duckdb:parquet 56364777 / 55636208 / +1.3% 66692926 / 67771566 / -1.6% 0.85 / 0.82 / +2.9%
tpcds_q59/duckdb:parquet 60558908 / 60888385 / -0.5% 69308514 / 69281606 / +0.0% 0.87 / 0.88 / -0.6%
tpcds_q60/duckdb:parquet 80234473 / 82995592 / -3.3% 96529626 / 93609037 / +3.1% 0.83 / 0.89 / -6.3%
tpcds_q61/duckdb:parquet 81792766 / 79843582 / +2.4% 95363340 / 96209480 / -0.9% 0.86 / 0.83 / +3.4%
tpcds_q62/duckdb:parquet 21628432 / 22427732 / -3.6% 27570490 / 26553261 / +3.8% 0.78 / 0.84 / -7.1%
tpcds_q63/duckdb:parquet 33362806 / 32945599 / +1.3% 42420692 / 44810985 / -5.3% 0.79 / 0.74 / +7.0%
tpcds_q64/duckdb:parquet 136060220 / 137730810 / -1.2% 146807597 / 162467301 / -9.6% 0.93 / 0.85 / +9.3%
tpcds_q65/duckdb:parquet 91428405 / 90841106 / +0.6% 107007895 / 98758923 / +8.4% 0.85 / 0.92 / -7.1%
tpcds_q66/duckdb:parquet 45026120 / 46229679 / -2.6% 57575108 / 52011770 / +10.7% 🔴 0.78 / 0.89 / -12.0%
tpcds_q67/duckdb:parquet 297083606 / 296484754 / +0.2% 302554888 / 300794460 / +0.6% 0.98 / 0.99 / -0.4%
tpcds_q68/duckdb:parquet 62786082 / 62271290 / +0.8% 75904327 / 79884988 / -5.0% 0.83 / 0.78 / +6.1%
tpcds_q69/duckdb:parquet 65785982 / 66823133 / -1.6% 78294723 / 75751375 / +3.4% 0.84 / 0.88 / -4.8%
tpcds_q70/duckdb:parquet 43131186 / 43502914 / -0.9% 50646879 / 51876494 / -2.4% 0.85 / 0.84 / +1.6%
tpcds_q71/duckdb:parquet 40483608 / 40235578 / +0.6% 52715552 / 53331431 / -1.2% 0.77 / 0.75 / +1.8%
tpcds_q72/duckdb:parquet 171988277 / 171234634 / +0.4% 185656907 / 185887233 / -0.1% 0.93 / 0.92 / +0.6%
tpcds_q73/duckdb:parquet 28825520 / 28539550 / +1.0% 36704088 / 38525179 / -4.7% 0.79 / 0.74 / +6.0%
tpcds_q74/duckdb:parquet 215900074 / 214701141 / +0.6% 222839375 / 226612264 / -1.7% 0.97 / 0.95 / +2.3%
tpcds_q75/duckdb:parquet 132745566 / 136513298 / -2.8% 157709063 / 144305040 / +9.3% 0.84 / 0.95 / -11.0%
tpcds_q76/duckdb:parquet 50883360 / 52107498 / -2.3% 68343127 / 66393995 / +2.9% 0.74 / 0.78 / -5.1%
tpcds_q77/duckdb:parquet 55458595 / 53680122 / +3.3% 71184372 / 68802211 / +3.5% 0.78 / 0.78 / -0.1%
tpcds_q78/duckdb:parquet 146479062 / 146481247 / -0.0% 169881665 / 173928138 / -2.3% 0.86 / 0.84 / +2.4%
tpcds_q79/duckdb:parquet 52036645 / 52912912 / -1.7% 70342611 / 69766888 / +0.8% 0.74 / 0.76 / -2.5%
tpcds_q80/duckdb:parquet 84448408 / 84091399 / +0.4% 101135879 / 101467325 / -0.3% 0.83 / 0.83 / +0.8%
tpcds_q81/duckdb:parquet 98262330 / 96942804 / +1.4% 106579763 / 105070620 / +1.4% 0.92 / 0.92 / -0.1%
tpcds_q82/duckdb:parquet 46233722 / 46487240 / -0.5% 55561740 / 53044060 / +4.7% 0.83 / 0.88 / -5.1%
tpcds_q83/duckdb:parquet 28025605 / 28126860 / -0.4% 32947816 / 33556853 / -1.8% 0.85 / 0.84 / +1.5%
tpcds_q84/duckdb:parquet 22672612 / 22718850 / -0.2% 29463742 / 28854283 / +2.1% 0.77 / 0.79 / -2.3%
tpcds_q85/duckdb:parquet 51952556 / 51569898 / +0.7% 62130800 / 60972055 / +1.9% 0.84 / 0.85 / -1.1%
tpcds_q86/duckdb:parquet 24915884 / 25653376 / -2.9% 30475709 / 32290498 / -5.6% 0.82 / 0.79 / +2.9%
tpcds_q87/duckdb:parquet 88219048 / 86041585 / +2.5% 93056745 / 96073615 / -3.1% 0.95 / 0.90 / +5.9%
tpcds_q88/duckdb:parquet 101842158 / 104156077 / -2.2% 109702228 / 113708809 / -3.5% 0.93 / 0.92 / +1.3%
tpcds_q89/duckdb:parquet 37056654 / 37221714 / -0.4% 47909836 / 52543843 / -8.8% 0.77 / 0.71 / +9.2%
tpcds_q90/duckdb:parquet 15565450 / 15320644 / +1.6% 19142220 / 19638004 / -2.5% 0.81 / 0.78 / +4.2%
tpcds_q91/duckdb:parquet 25636836 / 25533825 / +0.4% 33201808 / 32629028 / +1.8% 0.77 / 0.78 / -1.3%
tpcds_q92/duckdb:parquet 21763976 / 22457040 / -3.1% 29852148 / 29600706 / +0.8% 0.73 / 0.76 / -3.9%
tpcds_q93/duckdb:parquet 35400786 / 36522483 / -3.1% 48169720 / 49556338 / -2.8% 0.73 / 0.74 / -0.3%
tpcds_q94/duckdb:parquet 38566849 / 38221661 / +0.9% 46585548 / 47915670 / -2.8% 0.83 / 0.80 / +3.8%
tpcds_q95/duckdb:parquet 82661774 / 80753512 / +2.4% 87273324 / 88826826 / -1.7% 0.95 / 0.91 / +4.2%
tpcds_q96/duckdb:parquet 16901146 / 17701885 / -4.5% 22330960 / 22852748 / -2.3% 0.76 / 0.77 / -2.3%
tpcds_q97/duckdb:parquet 72183845 / 72195042 / -0.0% 80570803 / 85867593 / -6.2% 0.90 / 0.84 / +6.6%
tpcds_q98/duckdb:parquet 55653830 / 54526654 / +2.1% 65377623 / 67784295 / -3.6% 0.85 / 0.80 / +5.8%
tpcds_q99/duckdb:parquet 24145919 / 25590772 / -5.6% 32636508 / 32382010 / +0.8% 0.74 / 0.79 / -6.4%

@github-actions

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 9e4c9ab4 vs base 25f4349a


vortex / vortex-file-compressed / ns (1.065x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 458676272 / 456423998 / +0.5% 455300619 / 455881811 / -0.1% 1.01 / 1.00 / +0.6%
compress time/bimbo 2371784748 / 2361432287 / +0.4% 2323609555 / 2338552732 / -0.6% 1.02 / 1.01 / +1.1%
compress time/cmsprovider 1068994292 / 1060785218 / +0.8% 1053083573 / 1052642269 / +0.0% 1.02 / 1.01 / +0.7%
compress time/euro2016 179611560 / 168401018 / +6.7% 178609874 / 168981151 / +5.7% 1.01 / 1.00 / +0.9%
compress time/food 208785592 / 207635497 / +0.6% 213144864 / 213017018 / +0.1% 0.98 / 0.97 / +0.5%
compress time/hashtags 376142587 / 360321280 / +4.4% 368723685 / 359700133 / +2.5% 1.02 / 1.00 / +1.8%
compress time/sparse-wide-flat-runs 93209221 / 87704386 / +6.3% 91610095 / 91603823 / +0.0% 1.02 / 0.96 / +6.3%
compress time/sparse-wide-lists-runs 664595173 / 666220166 / -0.2% 668090228 / 664556793 / +0.5% 0.99 / 1.00 / -0.8%
compress time/sparse-wide-lists-shuffled 291426582 / 298723352 / -2.4% 307871729 / 284939998 / +8.0% 0.95 / 1.05 / -9.7%
compress time/sparse-wide-nested-child-nulls 612684330 / 623853358 / -1.8% 611565628 / 620403487 / -1.4% 1.00 / 1.01 / -0.4%
compress time/sparse-wide-nested-runs 622436221 / 628534260 / -1.0% 611049768 / 632783030 / -3.4% 1.02 / 0.99 / +2.6%
compress time/statpopgen 3327907348 / 546155416 / +509.3% 🔴 3327364697 / 548827012 / +506.3% 🔴 1.00 / 1.00 / +0.5%
compress time/taxi 210642409 / 206629999 / +1.9% 209079770 / 209357347 / -0.1% 1.01 / 0.99 / +2.1%
compress time/tpc-h l_comment canonical 109165876 / 106812123 / +2.2% 111204878 / 109194293 / +1.8% 0.98 / 0.98 / +0.4%
compress time/tpc-h l_comment chunked 109123397 / 106955972 / +2.0% 110687705 / 109039298 / +1.5% 0.99 / 0.98 / +0.5%
compress time/tpc-h sf1 lineitem 404334455 / 401917843 / +0.6% 401128228 / 399646402 / +0.4% 1.01 / 1.01 / +0.2%
compress time/tpc-h sf1 orders 88679807 / 86317888 / +2.7% 89126842 / 86957947 / +2.5% 0.99 / 0.99 / +0.2%
compress time/tpc-h sf1 partsupp 59921258 / 58264406 / +2.8% 61665931 / 60536416 / +1.9% 0.97 / 0.96 / +1.0%
compress time/wide table cols=100 chunks=1 rows=1000 5675240 / 5734572 / -1.0% 8536826 / 8045806 / +6.1% 0.66 / 0.71 / -6.7%
compress time/wide table cols=100 chunks=50 rows=1000 5700719 / 5657540 / +0.8% 7986442 / 7931440 / +0.7% 0.71 / 0.71 / +0.1%
compress time/wide table cols=1000 chunks=1 rows=1000 56767739 / 56856522 / -0.2% 58659545 / 62231993 / -5.7% 0.97 / 0.91 / +5.9%
compress time/wide table cols=1000 chunks=50 rows=1000 56135773 / 56309134 / -0.3% 58888531 / 59074125 / -0.3% 0.95 / 0.95 / +0.0%
compress time/wide table cols=10000 chunks=1 rows=1000 639707924 / 643930840 / -0.7% 635119955 / 648373854 / -2.0% 1.01 / 0.99 / +1.4%
compress time/wide table cols=10000 chunks=50 rows=1000 641006464 / 638244609 / +0.4% 629852210 / 648741560 / -2.9% 1.02 / 0.98 / +3.4%
decompress time/arade 15370167 / 14656608 / +4.9% 17469397 / 16046485 / +8.9% 0.88 / 0.91 / -3.7%
decompress time/bimbo 69917564 / 66924590 / +4.5% 76600756 / 66633976 / +15.0% 🔴 0.91 / 1.00 / -9.1%
decompress time/cmsprovider 40483260 / 38565898 / +5.0% 42149915 / 46192796 / -8.8% 0.96 / 0.83 / +15.0%
decompress time/euro2016 12877924 / 11886517 / +8.3% 13715606 / 12438625 / +10.3% 🔴 0.94 / 0.96 / -1.7%
decompress time/food 4439918 / 3827430 / +16.0% 🔴 6142299 / 4784268 / +28.4% 🔴 0.72 / 0.80 / -9.6%
decompress time/hashtags 61454853 / 42383106 / +45.0% 🔴 61615572 / 42543511 / +44.8% 🔴 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-flat-runs 12837750 / 12990394 / -1.2% 13372696 / 12094252 / +10.6% 🔴 0.96 / 1.07 / -10.6%
decompress time/sparse-wide-lists-runs 17011514 / 16368102 / +3.9% 16810348 / 16810371 / -0.0% 1.01 / 0.97 / +3.9%
decompress time/sparse-wide-lists-shuffled 26627832 / 26373687 / +1.0% 27791725 / 27533789 / +0.9% 0.96 / 0.96 / +0.0%
decompress time/sparse-wide-nested-child-nulls 16269978 / 17382508 / -6.4% 18675408 / 16334676 / +14.3% 🔴 0.87 / 1.06 / -18.1%
decompress time/sparse-wide-nested-runs 17860378 / 16724202 / +6.8% 15835026 / 15857456 / -0.1% 1.13 / 1.05 / +6.9%
decompress time/statpopgen 916614595 / 901899086 / +1.6% 924759162 / 905745619 / +2.1% 0.99 / 1.00 / -0.5%
decompress time/taxi 10325496 / 10002943 / +3.2% 12425320 / 11107996 / +11.9% 🔴 0.83 / 0.90 / -7.7%
decompress time/tpc-h l_comment canonical 5195555 / 5088120 / +2.1% 5248462 / 5423863 / -3.2% 0.99 / 0.94 / +5.5%
decompress time/tpc-h l_comment chunked 5168910 / 5106314 / +1.2% 5265207 / 5829589 / -9.7% 0.98 / 0.88 / +12.1%
decompress time/tpc-h sf1 lineitem 15676714 / 15502896 / +1.1% 16623524 / 15831608 / +5.0% 0.94 / 0.98 / -3.7%
decompress time/tpc-h sf1 orders 4151871 / 4076023 / +1.9% 4224796 / 4445236 / -5.0% 0.98 / 0.92 / +7.2%
decompress time/tpc-h sf1 partsupp 3329777 / 3247908 / +2.5% 3806665 / 3419813 / +11.3% 🔴 0.87 / 0.95 / -7.9%
decompress time/wide table cols=100 chunks=1 rows=1000 1523955 / 1520498 / +0.2% 1637358 / 1703449 / -3.9% 0.93 / 0.89 / +4.3%
decompress time/wide table cols=100 chunks=50 rows=1000 1558078 / 1534864 / +1.5% 1802009 / 1646086 / +9.5% 0.86 / 0.93 / -7.3%
decompress time/wide table cols=1000 chunks=1 rows=1000 13807698 / 13775812 / +0.2% 14380082 / 14124754 / +1.8% 0.96 / 0.98 / -1.5%
decompress time/wide table cols=1000 chunks=50 rows=1000 13951458 / 13498746 / +3.4% 14404564 / 14554024 / -1.0% 0.97 / 0.93 / +4.4%
decompress time/wide table cols=10000 chunks=1 rows=1000 144783685 / 143195756 / +1.1% 146248404 / 144503930 / +1.2% 0.99 / 0.99 / -0.1%
decompress time/wide table cols=10000 chunks=50 rows=1000 144576422 / 142510886 / +1.4% 146340507 / 143780943 / +1.8% 0.99 / 0.99 / -0.3%
vortex / vortex-file-compressed / bytes (0.957x ➖, 4↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/arade 141323236 / 142108908 / -0.6%
vortex-file-compressed size/bimbo 410263628 / 425251924 / -3.5%
vortex-file-compressed size/cmsprovider 413118820 / 416254308 / -0.8%
vortex-file-compressed size/euro2016 156505100 / 164044652 / -4.6%
vortex-file-compressed size/food 37247664 / 38951184 / -4.4%
vortex-file-compressed size/hashtags 169690108 / 183585892 / -7.6%
vortex-file-compressed size/sparse-wide-flat-runs 1552424 / 1552392 / +0.0%
vortex-file-compressed size/sparse-wide-lists-runs 3933548 / 3991596 / -1.5%
vortex-file-compressed size/sparse-wide-lists-shuffled 6436508 / 6436476 / +0.0%
vortex-file-compressed size/sparse-wide-nested-child-nulls 1687396 / 1687364 / +0.0%
vortex-file-compressed size/sparse-wide-nested-runs 1298452 / 1298420 / +0.0%
vortex-file-compressed size/statpopgen 230798780 / 251914932 / -8.4%
vortex-file-compressed size/taxi 48554716 / 49091836 / -1.1%
vortex-file-compressed size/tpc-h l_comment canonical 64987212 / 75050436 / -13.4% 🟢
vortex-file-compressed size/tpc-h l_comment chunked 64987212 / 75050436 / -13.4% 🟢
vortex-file-compressed size/tpc-h sf1 lineitem 154809520 / 173478160 / -10.8% 🟢
vortex-file-compressed size/tpc-h sf1 orders 33372820 / 42977780 / -22.3% 🟢
vortex-file-compressed size/tpc-h sf1 partsupp 24526824 / 25940480 / -5.4%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934888 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934888 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9333688 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9333688 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93357688 / 93357656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93357688 / 93357656 / +0.0%
vortex / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 1154679000 / 1157979572 / -0.3% 1163291332 / 1166800952 / -0.3% 0.99 / 0.99 / +0.0%
compress time/bimbo 2133737331 / 2142935242 / -0.4% 2145444575 / 2145722720 / -0.0% 0.99 / 1.00 / -0.4%
compress time/cmsprovider 1665955602 / 1669593497 / -0.2% 1673458808 / 1674131035 / -0.0% 1.00 / 1.00 / -0.2%
compress time/euro2016 992391620 / 996374720 / -0.4% 1033653962 / 997315839 / +3.6% 0.96 / 1.00 / -3.9%
compress time/food 405742040 / 406727279 / -0.2% 409009462 / 409186347 / -0.0% 0.99 / 0.99 / -0.2%
compress time/hashtags 536062171 / 541496991 / -1.0% 543564514 / 549339482 / -1.1% 0.99 / 0.99 / +0.0%
compress time/sparse-wide-flat-runs 41925262 / 41780884 / +0.3% 41571290 / 42394430 / -1.9% 1.01 / 0.99 / +2.3%
compress time/sparse-wide-lists-runs 80942550 / 81818742 / -1.1% 80521707 / 82219670 / -2.1% 1.01 / 1.00 / +1.0%
compress time/sparse-wide-lists-shuffled 157841046 / 156295890 / +1.0% 154557913 / 155974678 / -0.9% 1.02 / 1.00 / +1.9%
compress time/sparse-wide-nested-child-nulls 53699922 / 54604874 / -1.7% 54598916 / 54931460 / -0.6% 0.98 / 0.99 / -1.1%
compress time/sparse-wide-nested-runs 54728852 / 55415896 / -1.2% 55636187 / 55908185 / -0.5% 0.98 / 0.99 / -0.8%
compress time/statpopgen 1028873794 / 1030944899 / -0.2% 1042046654 / 1042703292 / -0.1% 0.99 / 0.99 / -0.1%
compress time/taxi 238360248 / 239616076 / -0.5% 239004890 / 244417723 / -2.2% 1.00 / 0.98 / +1.7%
compress time/tpc-h l_comment canonical 721152915 / 721890366 / -0.1% 723142345 / 723926372 / -0.1% 1.00 / 1.00 / +0.0%
compress time/tpc-h l_comment chunked 720907496 / 721525386 / -0.1% 723401803 / 722459683 / +0.1% 1.00 / 1.00 / -0.2%
compress time/tpc-h sf1 lineitem 1199483504 / 1211617471 / -1.0% 1204773647 / 1203019468 / +0.1% 1.00 / 1.01 / -1.1%
compress time/tpc-h sf1 orders 338536391 / 339442686 / -0.3% 340045111 / 342769415 / -0.8% 1.00 / 0.99 / +0.5%
compress time/tpc-h sf1 partsupp 306431546 / 306990840 / -0.2% 305659978 / 313737967 / -2.6% 1.00 / 0.98 / +2.5%
compress time/wide table cols=100 chunks=1 rows=1000 3844385 / 3903900 / -1.5% 4652150 / 4264149 / +9.1% 0.83 / 0.92 / -9.7%
compress time/wide table cols=100 chunks=50 rows=1000 3623864 / 3800416 / -4.6% 4901496 / 4316267 / +13.6% 🔴 0.74 / 0.88 / -16.0%
compress time/wide table cols=1000 chunks=1 rows=1000 37660602 / 37818097 / -0.4% 39305763 / 39272115 / +0.1% 0.96 / 0.96 / -0.5%
compress time/wide table cols=1000 chunks=50 rows=1000 37349704 / 37455668 / -0.3% 39308033 / 38799886 / +1.3% 0.95 / 0.97 / -1.6%
compress time/wide table cols=10000 chunks=1 rows=1000 376991720 / 376882760 / +0.0% 386882955 / 389283793 / -0.6% 0.97 / 0.97 / +0.6%
compress time/wide table cols=10000 chunks=50 rows=1000 376342342 / 378556572 / -0.6% 381739714 / 385381193 / -0.9% 0.99 / 0.98 / +0.4%
decompress time/arade 54539552 / 54685554 / -0.3% 54613266 / 55337072 / -1.3% 1.00 / 0.99 / +1.1%
decompress time/bimbo 92258564 / 92467654 / -0.2% 92498195 / 92986612 / -0.5% 1.00 / 0.99 / +0.3%
decompress time/cmsprovider 103314087 / 103505467 / -0.2% 102948152 / 104005187 / -1.0% 1.00 / 1.00 / +0.8%
decompress time/euro2016 159321750 / 159698812 / -0.2% 159603506 / 160603031 / -0.6% 1.00 / 0.99 / +0.4%
decompress time/food 26533452 / 26657156 / -0.5% 26721279 / 27251911 / -1.9% 0.99 / 0.98 / +1.5%
decompress time/hashtags 445973128 / 447102080 / -0.3% 446477021 / 447827764 / -0.3% 1.00 / 1.00 / +0.0%
decompress time/sparse-wide-flat-runs 14989055 / 14933264 / +0.4% 15447353 / 15490494 / -0.3% 0.97 / 0.96 / +0.7%
decompress time/sparse-wide-lists-runs 276940613 / 277412638 / -0.2% 277073474 / 277961407 / -0.3% 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-lists-shuffled 318709304 / 318743812 / -0.0% 318901330 / 319365241 / -0.1% 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-nested-child-nulls 52908458 / 52907174 / +0.0% 53058384 / 53276968 / -0.4% 1.00 / 0.99 / +0.4%
decompress time/sparse-wide-nested-runs 52886167 / 52872612 / +0.0% 53326050 / 53027750 / +0.6% 0.99 / 1.00 / -0.5%
decompress time/statpopgen 2900256948 / 2903372838 / -0.1% 2927060058 / 2938119556 / -0.4% 0.99 / 0.99 / +0.3%
decompress time/taxi 60618823 / 60757236 / -0.2% 60950052 / 60855272 / +0.2% 0.99 / 1.00 / -0.4%
decompress time/tpc-h l_comment canonical 35933966 / 36044851 / -0.3% 36070216 / 36098811 / -0.1% 1.00 / 1.00 / -0.2%
decompress time/tpc-h l_comment chunked 35963514 / 36045853 / -0.2% 36085553 / 36153344 / -0.2% 1.00 / 1.00 / -0.0%
decompress time/tpc-h sf1 lineitem 82230837 / 82464266 / -0.3% 82591299 / 83371929 / -0.9% 1.00 / 0.99 / +0.7%
decompress time/tpc-h sf1 orders 87950380 / 88223106 / -0.3% 88310807 / 88937105 / -0.7% 1.00 / 0.99 / +0.4%
decompress time/tpc-h sf1 partsupp 111097438 / 111453671 / -0.3% 111400960 / 112277448 / -0.8% 1.00 / 0.99 / +0.5%
decompress time/wide table cols=100 chunks=1 rows=1000 1946236 / 1957316 / -0.6% 2156374 / 2151503 / +0.2% 0.90 / 0.91 / -0.8%
decompress time/wide table cols=100 chunks=50 rows=1000 1939203 / 1949374 / -0.5% 2241042 / 2099320 / +6.8% 0.87 / 0.93 / -6.8%
decompress time/wide table cols=1000 chunks=1 rows=1000 22709498 / 22622680 / +0.4% 23263546 / 23337309 / -0.3% 0.98 / 0.97 / +0.7%
decompress time/wide table cols=1000 chunks=50 rows=1000 22044814 / 22559106 / -2.3% 22684440 / 22984718 / -1.3% 0.97 / 0.98 / -1.0%
decompress time/wide table cols=10000 chunks=1 rows=1000 234454800 / 232428408 / +0.9% 237934670 / 234009450 / +1.7% 0.99 / 0.99 / -0.8%
decompress time/wide table cols=10000 chunks=50 rows=1000 236037328 / 232893412 / +1.3% 239580944 / 237035361 / +1.1% 0.99 / 0.98 / +0.3%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/arade 210020851 / 210020851 / +0.0%
parquet size/bimbo 376187078 / 376187078 / +0.0%
parquet size/cmsprovider 364268159 / 364268159 / +0.0%
parquet size/euro2016 111035158 / 111035158 / +0.0%
parquet size/food 34903783 / 34903783 / +0.0%
parquet size/hashtags 126189203 / 126189203 / +0.0%
parquet size/sparse-wide-flat-runs 1388944 / 1388944 / +0.0%
parquet size/sparse-wide-lists-runs 4327813 / 4327813 / +0.0%
parquet size/sparse-wide-lists-shuffled 5710569 / 5710569 / +0.0%
parquet size/sparse-wide-nested-child-nulls 1266042 / 1266042 / +0.0%
parquet size/sparse-wide-nested-runs 1388944 / 1388944 / +0.0%
parquet size/statpopgen 81284006 / 81284006 / +0.0%
parquet size/taxi 52142534 / 52142534 / +0.0%
parquet size/tpc-h l_comment canonical 52204116 / 52204116 / +0.0%
parquet size/tpc-h l_comment chunked 52204116 / 52204116 / +0.0%
parquet size/tpc-h sf1 lineitem 153403836 / 153403836 / +0.0%
parquet size/tpc-h sf1 orders 37029542 / 37029542 / +0.0%
parquet size/tpc-h sf1 partsupp 29200612 / 29200612 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 94797276 / 95323156 / -0.6% 119480158 / 119219675 / +0.2% 0.79 / 0.80 / -0.8%
compress time/bimbo 598336708 / 603171370 / -0.8% 660705358 / 668627273 / -1.2% 0.91 / 0.90 / +0.4%
compress time/cmsprovider 375347882 / 379997100 / -1.2% 437594246 / 444051807 / -1.5% 0.86 / 0.86 / +0.2%
compress time/euro2016 38017392 / 38330015 / -0.8% 51827703 / 52439692 / -1.2% 0.73 / 0.73 / +0.4%
compress time/food 40092421 / 40337670 / -0.6% 53012391 / 54060682 / -1.9% 0.76 / 0.75 / +1.4%
compress time/hashtags 78764556 / 78243778 / +0.7% 107424703 / 106535834 / +0.8% 0.73 / 0.73 / -0.2%
compress time/sparse-wide-flat-runs 27772316 / 28118544 / -1.2% 36657098 / 37165827 / -1.4% 0.76 / 0.76 / +0.1%
compress time/sparse-wide-lists-runs 44744799 / 44977111 / -0.5% 51016935 / 51596481 / -1.1% 0.88 / 0.87 / +0.6%
compress time/sparse-wide-lists-shuffled 45192948 / 44891183 / +0.7% 49702784 / 49785464 / -0.2% 0.91 / 0.90 / +0.8%
compress time/sparse-wide-nested-child-nulls 40110750 / 40941438 / -2.0% 49670907 / 50958606 / -2.5% 0.81 / 0.80 / +0.5%
compress time/sparse-wide-nested-runs 40286139 / 40878688 / -1.4% 49744862 / 50841132 / -2.2% 0.81 / 0.80 / +0.7%
compress time/statpopgen 216290118 / 216444472 / -0.1% 262295427 / 262683417 / -0.1% 0.82 / 0.82 / +0.1%
compress time/taxi 58517112 / 59015930 / -0.8% 74461718 / 75461324 / -1.3% 0.79 / 0.78 / +0.5%
compress time/tpc-h l_comment canonical 22864502 / 22669383 / +0.9% 30443311 / 31042006 / -1.9% 0.75 / 0.73 / +2.8%
compress time/tpc-h l_comment chunked 22782305 / 22629498 / +0.7% 30587600 / 30871381 / -0.9% 0.74 / 0.73 / +1.6%
compress time/tpc-h sf1 lineitem 128205391 / 128743000 / -0.4% 163527777 / 164820422 / -0.8% 0.78 / 0.78 / +0.4%
compress time/tpc-h sf1 orders 24462380 / 24736920 / -1.1% 34070713 / 34547391 / -1.4% 0.72 / 0.72 / +0.3%
compress time/tpc-h sf1 partsupp 13081322 / 13146598 / -0.5% 18988674 / 19238428 / -1.3% 0.69 / 0.68 / +0.8%
compress time/wide table cols=100 chunks=1 rows=1000 199362.5 / 197050 / +1.2% 608367 / 535302 / +13.6% 🔴 0.33 / 0.37 / -11.0%
compress time/wide table cols=100 chunks=50 rows=1000 194048.5 / 212305.5 / -8.6% 378831 / 503282 / -24.7% 🟢 0.51 / 0.42 / +21.4%
compress time/wide table cols=1000 chunks=1 rows=1000 2313278 / 2361844 / -2.1% 2747303 / 3118994 / -11.9% 🟢 0.84 / 0.76 / +11.2%
compress time/wide table cols=1000 chunks=50 rows=1000 2294816 / 2339860 / -1.9% 2801774 / 2984212 / -6.1% 0.82 / 0.78 / +4.5%
compress time/wide table cols=10000 chunks=1 rows=1000 24915802 / 25208098 / -1.2% 30955124 / 31479871 / -1.7% 0.80 / 0.80 / +0.5%
compress time/wide table cols=10000 chunks=50 rows=1000 24921274 / 25177360 / -1.0% 31136171 / 31570056 / -1.4% 0.80 / 0.80 / +0.4%
decompress time/arade 216814591 / 217945279 / -0.5% 217202148 / 217995086 / -0.4% 1.00 / 1.00 / -0.2%
decompress time/bimbo 404822710 / 412945306 / -2.0% 405716457 / 412552534 / -1.7% 1.00 / 1.00 / -0.3%
decompress time/cmsprovider 693792086 / 695082002 / -0.2% 695929859 / 695634135 / +0.0% 1.00 / 1.00 / -0.2%
decompress time/euro2016 85470986 / 85814024 / -0.4% 85800011 / 86054190 / -0.3% 1.00 / 1.00 / -0.1%
decompress time/food 67371287 / 67164404 / +0.3% 67453301 / 67345897 / +0.2% 1.00 / 1.00 / +0.1%
decompress time/hashtags 164348564 / 168028988 / -2.2% 165038763 / 168350485 / -2.0% 1.00 / 1.00 / -0.2%
decompress time/sparse-wide-flat-runs 18536928 / 18960537 / -2.2% 21054421 / 20254373 / +4.0% 0.88 / 0.94 / -5.9%
decompress time/sparse-wide-lists-runs 81012384 / 81859899 / -1.0% 81279643 / 81928952 / -0.8% 1.00 / 1.00 / -0.2%
decompress time/sparse-wide-lists-shuffled 81476730 / 82086688 / -0.7% 81565767 / 82188151 / -0.8% 1.00 / 1.00 / +0.0%
decompress time/sparse-wide-nested-child-nulls 26232901 / 26656652 / -1.6% 26724696 / 28137828 / -5.0% 0.98 / 0.95 / +3.6%
decompress time/sparse-wide-nested-runs 26331844 / 26662758 / -1.2% 28323034 / 26985920 / +5.0% 0.93 / 0.99 / -5.9%
decompress time/statpopgen 462600638 / 462654874 / -0.0% 463418293 / 463444993 / -0.0% 1.00 / 1.00 / -0.0%
decompress time/taxi 50750412 / 51389889 / -1.2% 50937216 / 51795475 / -1.7% 1.00 / 0.99 / +0.4%
decompress time/tpc-h l_comment canonical 40011516 / 39760598 / +0.6% 40459967 / 40102098 / +0.9% 0.99 / 0.99 / -0.3%
decompress time/tpc-h l_comment chunked 40082723 / 39836664 / +0.6% 40416071 / 40115710 / +0.7% 0.99 / 0.99 / -0.1%
decompress time/tpc-h sf1 lineitem 188836324 / 189416942 / -0.3% 189291297 / 189468657 / -0.1% 1.00 / 1.00 / -0.2%
decompress time/tpc-h sf1 orders 38474720 / 38434252 / +0.1% 38613729 / 38603657 / +0.0% 1.00 / 1.00 / +0.1%
decompress time/tpc-h sf1 partsupp 13658121 / 13619506 / +0.3% 13824984 / 13746894 / +0.6% 0.99 / 0.99 / -0.3%
decompress time/wide table cols=100 chunks=1 rows=1000 322547 / 318098 / +1.4% 342056 / 345002 / -0.9% 0.94 / 0.92 / +2.3%
decompress time/wide table cols=100 chunks=50 rows=1000 320641 / 319035 / +0.5% 343369 / 342576 / +0.2% 0.93 / 0.93 / +0.3%
decompress time/wide table cols=1000 chunks=1 rows=1000 3505686 / 3654408 / -4.1% 3581563 / 3716768 / -3.6% 0.98 / 0.98 / -0.4%
decompress time/wide table cols=1000 chunks=50 rows=1000 3723572 / 3457578 / +7.7% 3873244 / 3623190 / +6.9% 0.96 / 0.95 / +0.7%
decompress time/wide table cols=10000 chunks=1 rows=1000 36113346 / 35711130 / +1.1% 36639240 / 36179773 / +1.3% 0.99 / 0.99 / -0.1%
decompress time/wide table cols=10000 chunks=50 rows=1000 36107775 / 35808237 / +0.8% 36849898 / 36164448 / +1.9% 0.98 / 0.99 / -1.0%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/arade 680639722 / 680639722 / +0.0%
arrow-ipc size/bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/cmsprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/food 252069442 / 252069442 / +0.0%
arrow-ipc size/hashtags 700364562 / 700364562 / +0.0%
arrow-ipc size/sparse-wide-flat-runs 245220370 / 245220370 / +0.0%
arrow-ipc size/sparse-wide-lists-runs 142046306 / 142046306 / +0.0%
arrow-ipc size/sparse-wide-lists-shuffled 142870882 / 142870882 / +0.0%
arrow-ipc size/sparse-wide-nested-child-nulls 251527506 / 251527506 / +0.0%
arrow-ipc size/sparse-wide-nested-runs 251527122 / 251527122 / +0.0%
arrow-ipc size/statpopgen 1890451826 / 1890451826 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/tpc-h l_comment canonical 184829074 / 184829074 / +0.0%
arrow-ipc size/tpc-h l_comment chunked 184829074 / 184829074 / +0.0%
arrow-ipc size/tpc-h sf1 lineitem 1021072290 / 1021072290 / +0.0%
arrow-ipc size/tpc-h sf1 orders 194812026 / 194812026 / +0.0%
arrow-ipc size/tpc-h sf1 partsupp 131286562 / 131286562 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@github-actions

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 9e4c9ab4 vs base 25f4349a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Engines: random-access No clear signal (+2.3%, low confidence)
Vortex (geomean): hot 1.014x ➖ · cold 1.065x ➖
Parquet (geomean): hot 0.991x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.028x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/arrow-ipc-cached 3127602 / 2036252 / +53.6% 🔴 3132158 / 2063924 / +51.8% 🔴 1.00 / 0.99 / +1.2%
random-access/feature-vectors/correlated/arrow-ipc-reopen 3401848 / 3279381 / +3.7% 11209552 / 13479992 / -16.8% 🟢 0.30 / 0.24 / +24.7%
random-access/feature-vectors/uniform/arrow-ipc-cached 54338234 / 54760360 / -0.8% 54971170 / 54647585 / +0.6% 0.99 / 1.00 / -1.4%
random-access/feature-vectors/uniform/arrow-ipc-reopen 54356987 / 54391155 / -0.1% 175121692 / 169516546 / +3.3% 0.31 / 0.32 / -3.3%
random-access/nested-lists/correlated/arrow-ipc-cached 61357 / 61771.5 / -0.7% 59781 / 66007 / -9.4% 1.03 / 0.94 / +9.7%
random-access/nested-lists/correlated/arrow-ipc-reopen 100609 / 100618 / -0.0% 3189796 / 3122019 / +2.2% 0.03 / 0.03 / -2.1%
random-access/nested-lists/uniform/arrow-ipc-cached 1055864 / 1039366 / +1.6% 1039325 / 1028753 / +1.0% 1.02 / 1.01 / +0.6%
random-access/nested-lists/uniform/arrow-ipc-reopen 1112454 / 1114767 / -0.2% 24339908 / 26837730 / -9.3% 0.05 / 0.04 / +10.0%
random-access/nested-structs/correlated/arrow-ipc-cached 50343 / 49711 / +1.3% 51245 / 48683 / +5.3% 0.98 / 1.02 / -3.8%
random-access/nested-structs/correlated/arrow-ipc-reopen 90487 / 90844 / -0.4% 3053738 / 3002136 / +1.7% 0.03 / 0.03 / -2.1%
random-access/nested-structs/uniform/arrow-ipc-cached 855880 / 838432 / +2.1% 862436 / 832579 / +3.6% 0.99 / 1.01 / -1.5%
random-access/nested-structs/uniform/arrow-ipc-reopen 860134 / 853951 / +0.7% 19168721 / 19403387 / -1.2% 0.04 / 0.04 / +2.0%
random-access/taxi/arrow-ipc-cached 68329 / 68320 / +0.0% 81301 / 69079 / +17.7% 🔴 0.84 / 0.99 / -15.0%
random-access/taxi/arrow-ipc-reopen 163304 / 165472.5 / -1.3% 3055203 / 2804580 / +8.9% 0.05 / 0.06 / -9.4%
random-access/taxi/correlated/arrow-ipc-cached 116776 / 120674 / -3.2% 118256 / 119720 / -1.2% 0.99 / 1.01 / -2.0%
random-access/taxi/correlated/arrow-ipc-reopen 217540 / 219166 / -0.7% 1640086 / 1799691 / -8.9% 0.13 / 0.12 / +8.9%
random-access/taxi/uniform/arrow-ipc-cached 2857960 / 2784172 / +2.7% 2904622 / 2792184 / +4.0% 0.98 / 1.00 / -1.3%
random-access/taxi/uniform/arrow-ipc-reopen 2968986 / 2912702 / +1.9% 35666128 / 33686977 / +5.9% 0.08 / 0.09 / -3.7%
random-access / vortex-file-compressed / ns (1.014x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-cached 107510 / 111203 / -3.3% 111292 / 113639 / -2.1% 0.97 / 0.98 / -1.3%
random-access/feature-vectors/correlated/vortex-reopen 1918442 / 1909274 / +0.5% 4426135 / 4089752 / +8.2% 0.43 / 0.47 / -7.2%
random-access/feature-vectors/uniform/vortex-cached 1001174 / 1000153 / +0.1% 1014636 / 1048184 / -3.2% 0.99 / 0.95 / +3.4%
random-access/feature-vectors/uniform/vortex-reopen 2970442 / 3012286 / -1.4% 11494858 / 11695501 / -1.7% 0.26 / 0.26 / +0.3%
random-access/nested-lists/correlated/vortex-cached 101178 / 98955 / +2.2% 103150 / 95040 / +8.5% 0.98 / 1.04 / -5.8%
random-access/nested-lists/correlated/vortex-reopen 365490 / 360360.5 / +1.4% 2499697 / 2248141 / +11.2% 🔴 0.15 / 0.16 / -8.8%
random-access/nested-lists/uniform/vortex-cached 427444 / 445894 / -4.1% 428397 / 314232 / +36.3% 🔴 1.00 / 1.42 / -29.7%
random-access/nested-lists/uniform/vortex-reopen 1013344 / 911578 / +11.2% 🔴 8799119 / 7932182 / +10.9% 🔴 0.12 / 0.11 / +0.2%
random-access/nested-structs/correlated/vortex-cached 119093 / 121642 / -2.1% 114824 / 120490 / -4.7% 1.04 / 1.01 / +2.7%
random-access/nested-structs/correlated/vortex-reopen 430471 / 436339 / -1.3% 3987479 / 3916080 / +1.8% 0.11 / 0.11 / -3.1%
random-access/nested-structs/uniform/vortex-cached 242614 / 251315 / -3.5% 225646 / 241571 / -6.6% 1.08 / 1.04 / +3.4%
random-access/nested-structs/uniform/vortex-reopen 642592 / 663055 / -3.1% 6099033 / 4975703 / +22.6% 🔴 0.11 / 0.13 / -20.9%
random-access/taxi/correlated/vortex-cached 332241 / 292739 / +13.5% 🔴 328208 / 287053 / +14.3% 🔴 1.01 / 1.02 / -0.7%
random-access/taxi/correlated/vortex-reopen 1258008 / 1240683 / +1.4% 2955651 / 2921306 / +1.2% 0.43 / 0.42 / +0.2%
random-access/taxi/uniform/vortex-cached 901787.5 / 871796 / +3.4% 917060 / 867169 / +5.8% 0.98 / 1.01 / -2.2%
random-access/taxi/uniform/vortex-reopen 3074196 / 3059064 / +0.5% 6172508 / 5251336 / +17.5% 🔴 0.50 / 0.58 / -14.5%
random-access/taxi/vortex-cached 269850 / 246074 / +9.7% 270266 / 256884 / +5.2% 1.00 / 0.96 / +4.2%
random-access/taxi/vortex-reopen 1060035 / 1036428 / +2.3% 3345561 / 3315364 / +0.9% 0.32 / 0.31 / +1.4%
random-access / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-cached 10186602 / 10233058 / -0.5% 10177626 / 10248153 / -0.7% 1.00 / 1.00 / +0.2%
random-access/feature-vectors/correlated/parquet-reopen 10448611 / 10506828 / -0.6% 18195760 / 18026033 / +0.9% 0.57 / 0.58 / -1.5%
random-access/feature-vectors/uniform/parquet-cached 131681660 / 132370664 / -0.5% 131663878 / 132397338 / -0.6% 1.00 / 1.00 / +0.0%
random-access/feature-vectors/uniform/parquet-reopen 132385411 / 132711280 / -0.2% 201316317 / 204086636 / -1.4% 0.66 / 0.65 / +1.1%
random-access/nested-lists/correlated/parquet-cached 4534148 / 4566336 / -0.7% 4522267 / 4581270 / -1.3% 1.00 / 1.00 / +0.6%
random-access/nested-lists/correlated/parquet-reopen 4631594 / 4638219 / -0.1% 11561942 / 11377660 / +1.6% 0.40 / 0.41 / -1.7%
random-access/nested-lists/uniform/parquet-cached 36872034 / 38908934 / -5.2% 36843289 / 39228121 / -6.1% 1.00 / 0.99 / +0.9%
random-access/nested-lists/uniform/parquet-reopen 38685354 / 39743209 / -2.7% 61759240 / 62129040 / -0.6% 0.63 / 0.64 / -2.1%
random-access/nested-structs/correlated/parquet-cached 9004026 / 9033619 / -0.3% 8998726 / 9129816 / -1.4% 1.00 / 0.99 / +1.1%
random-access/nested-structs/correlated/parquet-reopen 9126192 / 9126354 / -0.0% 20751921 / 20648541 / +0.5% 0.44 / 0.44 / -0.5%
random-access/nested-structs/uniform/parquet-cached 36670553 / 36688773 / -0.0% 36851881 / 36672646 / +0.5% 1.00 / 1.00 / -0.5%
random-access/nested-structs/uniform/parquet-reopen 36759757 / 36877589 / -0.3% 47149554 / 46719399 / +0.9% 0.78 / 0.79 / -1.2%
random-access/taxi/correlated/parquet-cached 23427956 / 23790546 / -1.5% 23384400 / 23778605 / -1.7% 1.00 / 1.00 / +0.1%
random-access/taxi/correlated/parquet-reopen 23896730 / 23852491 / +0.2% 27723697 / 27186259 / +2.0% 0.86 / 0.88 / -1.8%
random-access/taxi/parquet-cached 16422530 / 16714688 / -1.7% 16426971 / 16543498 / -0.7% 1.00 / 1.01 / -1.1%
random-access/taxi/parquet-reopen 16856862 / 17251030 / -2.3% 23213530 / 22202953 / +4.6% 0.73 / 0.78 / -6.5%
random-access/taxi/uniform/parquet-cached 37593258 / 37535402 / +0.2% 37721324 / 37364350 / +1.0% 1.00 / 1.00 / -0.8%
random-access/taxi/uniform/parquet-reopen 37858980 / 37826369 / +0.1% 41333461 / 41197826 / +0.3% 0.92 / 0.92 / -0.2%
random-access / lance / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/lance-cached 154669.5 / 152998.5 / +1.1% 158490 / 145882 / +8.6% 0.98 / 1.05 / -6.9%
random-access/feature-vectors/correlated/lance-reopen 938713 / 951453 / -1.3% 6932862 / 6872781 / +0.9% 0.14 / 0.14 / -2.2%
random-access/feature-vectors/uniform/lance-cached 1006472 / 995090 / +1.1% 1026953 / 1020113 / +0.7% 0.98 / 0.98 / +0.5%
random-access/feature-vectors/uniform/lance-reopen 1798039 / 1783141 / +0.8% 9192037 / 9563561 / -3.9% 0.20 / 0.19 / +4.9%
random-access/nested-lists/correlated/lance-cached 118130 / 117747 / +0.3% 115028 / 119096 / -3.4% 1.03 / 0.99 / +3.9%
random-access/nested-lists/correlated/lance-reopen 436925.5 / 437171 / -0.1% 5875472 / 6134743 / -4.2% 0.07 / 0.07 / +4.4%
random-access/nested-lists/uniform/lance-cached 834914 / 834570 / +0.0% 857006 / 822190 / +4.2% 0.97 / 1.02 / -4.0%
random-access/nested-lists/uniform/lance-reopen 1335165 / 1334592 / +0.0% 9132330 / 9627208 / -5.1% 0.15 / 0.14 / +5.5%
random-access/nested-structs/correlated/lance-cached 216092.5 / 214808 / +0.6% 206515 / 221397 / -6.7% 1.05 / 0.97 / +7.8%
random-access/nested-structs/correlated/lance-reopen 488453.5 / 492935 / -0.9% 5872924 / 5814960 / +1.0% 0.08 / 0.08 / -1.9%
random-access/nested-structs/uniform/lance-cached 2236167 / 2219418 / +0.8% 2276835 / 2287160 / -0.5% 0.98 / 0.97 / +1.2%
random-access/nested-structs/uniform/lance-reopen 2508301 / 2469563 / +1.6% 15039055 / 15002887 / +0.2% 0.17 / 0.16 / +1.3%
random-access/taxi/correlated/lance-cached 633840 / 625948 / +1.3% 617567 / 648191 / -4.7% 1.03 / 0.97 / +6.3%
random-access/taxi/correlated/lance-reopen 1614058 / 1645640 / -1.9% 2755465 / 3104789 / -11.3% 🟢 0.59 / 0.53 / +10.5%
random-access/taxi/lance-cached 435942 / 427882 / +1.9% 438547 / 416717 / +5.2% 0.99 / 1.03 / -3.2%
random-access/taxi/lance-reopen 1249971 / 1259931 / -0.8% 7536028 / 7827849 / -3.7% 0.17 / 0.16 / +3.1%
random-access/taxi/uniform/lance-cached 6941030 / 6727218 / +3.2% 6887404 / 6728442 / +2.4% 1.01 / 1.00 / +0.8%
random-access/taxi/uniform/lance-reopen 7895214 / 7947359 / -0.7% 24854475 / 24703324 / +0.6% 0.32 / 0.32 / -1.3%
random-access / litdata / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/litdata-cached 726464.5 / 742326.5 / -2.1% 720218 / 741776 / -2.9% 1.01 / 1.00 / +0.8%
random-access/feature-vectors/correlated/litdata-reopen 3022541 / 3052439 / -1.0% 3728588 / 3735769 / -0.2% 0.81 / 0.82 / -0.8%
random-access/feature-vectors/uniform/litdata-cached 1092223 / 1094508 / -0.2% 1139593 / 1126926 / +1.1% 0.96 / 0.97 / -1.3%
random-access/feature-vectors/uniform/litdata-reopen 16071082 / 16061726 / +0.1% 35254387 / 31461675 / +12.1% 🔴 0.46 / 0.51 / -10.7%
random-access/nested-lists/correlated/litdata-cached 568784 / 572949 / -0.7% 566480 / 573870 / -1.3% 1.00 / 1.00 / +0.6%
random-access/nested-lists/correlated/litdata-reopen 17269586 / 17313528 / -0.3% 23730686 / 23945033 / -0.9% 0.73 / 0.72 / +0.6%
random-access/nested-lists/uniform/litdata-cached 600650 / 601244 / -0.1% 601934 / 599096 / +0.5% 1.00 / 1.00 / -0.6%
random-access/nested-lists/uniform/litdata-reopen 17256428 / 17199419 / +0.3% 24001975 / 24125549 / -0.5% 0.72 / 0.71 / +0.8%
random-access/nested-structs/correlated/litdata-cached 666209 / 666146 / +0.0% 669708 / 666071 / +0.5% 0.99 / 1.00 / -0.5%
random-access/nested-structs/correlated/litdata-reopen 18061162 / 18289710 / -1.2% 21952101 / 21877703 / +0.3% 0.82 / 0.84 / -1.6%
random-access/nested-structs/uniform/litdata-cached 717363 / 720854 / -0.5% 722599 / 717860 / +0.7% 0.99 / 1.00 / -1.1%
random-access/nested-structs/uniform/litdata-reopen 16185048 / 15911085 / +1.7% 24779501 / 24821160 / -0.2% 0.65 / 0.64 / +1.9%
random-access/taxi/correlated/litdata-cached 1154534 / 1178772 / -2.1% 1158709 / 1178483 / -1.7% 1.00 / 1.00 / -0.4%
random-access/taxi/correlated/litdata-reopen 19957858 / 20156294 / -1.0% 29413029 / 29379963 / +0.1% 0.68 / 0.69 / -1.1%
random-access/taxi/litdata-cached 80801 / 81065 / -0.3% 81072 / 83092 / -2.4% 1.00 / 0.98 / +2.2%
random-access/taxi/litdata-reopen 11066996 / 11102419 / -0.3% 14623504 / 14350993 / +1.9% 0.76 / 0.77 / -2.2%
random-access/taxi/uniform/litdata-cached 1296578 / 1311314 / -1.1% 1301408 / 1321898 / -1.6% 1.00 / 0.99 / +0.4%
random-access/taxi/uniform/litdata-reopen 66599268 / 67864970 / -1.9% 82674654 / 82261059 / +0.5% 0.81 / 0.82 / -2.4%

@joseph-isaacs

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

can you pull out the edition change.

otherwise we are good to go

@robert3005

ghost commented Nov 13, 2026

Copy link
Copy Markdown
Contributor Author

It's here 9e4c9ab

Robert Kruszewski and others added 9 commits November 13, 2026 14:14
Delta arrays whose deltas child is BitPacked (offset 0, no patches, global
or blocked bit widths) now decode with fastlanes' `Delta::undelta_pack`
kernel, which unpacks and prefix-sums each lane in one pass instead of
first materializing the unpacked deltas.

BitPacking is order-preserving (`unpack(pack(x)) == x`); its interleaved
layout lives only inside the packed words. Delta's transpose is therefore
the only transpose in the composition: the fused kernel yields the same
transposed chunk as unpack followed by undelta, and each chunk is
untransposed once, as before. The on-disk format is unchanged.

Untransposing was ~85% of decode time, so both decode paths now use a
gather-ordered untranspose that is ~5x faster than
`fastlanes::Transpose::untranspose` and produces identical output.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
The fused unpack and undelta decode now accepts any BitPacked deltas, or
lazy slice of BitPacked deltas, whose first delta starts on a packed
block. Delta slices its deltas at chunk boundaries, so this covers every
slice Delta produces: whole packed blocks are decoded and the Delta
offset is applied by slicing at the end.

A patch changes every later value of its lane, so a chunk with patches
is unpacked, patched and then prefix-summed; chunks without patches keep
the fused kernel. Deltas that start inside a packed block still decode
through the unfused path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
Delta compression and decompression pick fastlanes' transpose and
untranspose variants once per array from the fearless_simd level:
AVX-512 for u8 and u16, AVX2, SSE2, NEON, and the scalar loops
otherwise. At the AVX-512 level u32 and u64 go through fastlanes' own
dispatch, which keeps AVX2 on Zen 4 where AVX-512 is slower for those
widths. This replaces the local gather-ordered untranspose.

The fused decode now calls fastlanes' Delta::unchecked_undelta_pack in
place of the local runtime bit-width dispatch.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
A Delta value depends on every earlier delta of its lane in its chunk,
so a read decodes the row's 1024-value chunk. A repeated probe keeps the
last decoded chunk, so reads within a chunk decode it once. Decoding a
chunk goes through the fused path when the deltas are bit-packed.

Reading the first 4096 rows of a u32 array over bit-packed deltas in
order (probe_once and probe_repeated in the delta_decode bench):

               before    after
    one-off    7.6 ms    6.7 ms
    repeated   7.9 ms    0.15 ms

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
Delta decoding goes through a new DeltaChunks decoder, which prepares the
bases, the deltas and, for bit-packed deltas, the packed blocks and
per-chunk patches once, and then decodes any chunk on demand. Full
decoding writes every chunk straight into the output.

DeltaChunks implements ChunkDecoder, so the filter kernel reuses
filter_chunked: it decodes only the chunks that hold selected rows and
compacts each one while it is in cache. The take kernel groups the
valid indices by chunk with a counting sort and decodes each taken chunk
once; above one index per eight rows it decodes the whole array first,
as BitPacked does. Null indices read nothing, and out-of-bounds indices
are an error.

Filtering 512 KiB of u32 over bit-packed deltas (filter_decoded and
filter in the delta_decode bench):

    selected rows    decode, then filter    filter kernel
    1 in 64          27.9 us                19.5 us
    1 in 4096        25.9 us                 4.7 us

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
An array with nulls is constant only if every value is null, which
validity decides. Otherwise every value is its lane's base plus the
earlier deltas of the lane, so zero deltas and equal bases make the
array constant without decoding it.

The converse holds only when the children hold exactly the visible
values: a slice's first and last chunks can hold values outside it. So
when the children are not constant, the kernel leaves the answer to the
generic path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
Only the first and last chunks of a slice can hold values outside it.
The chunks between them are wholly visible, so zero deltas and equal
bases decide them exactly. The kernel now checks those chunks on the
children, decodes just the visible rows of the partial first and last
chunks, and compares them with the constant. A slice with no full chunk
spans at most two partial chunks and is decoded. The kernel no longer
leaves any all-valid array to the generic path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
Both encodings decode in 1024-value chunks through a ChunkDecoder, so
their take now goes through one module, take_chunks. Positions that fall
in one chunk are decoded together, through decode_indices when there are
at most a sparse limit of them and otherwise by decoding the chunk:

- take_in_order follows the positions as given. BitPacked uses it, as it
  did with its own loop, for indices and for the short runs of its range
  path; its PackedChunks decoder, so far used only by filter, now serves
  take too.
- take_grouped groups the positions by chunk first, so each chunk is
  decoded once. Delta uses it, since reading any value of a chunk decodes
  all of it.

Null indices read the array's first value instead of whatever their slot
holds; the taken validity masks them. Delta checks that valid indices are
in bounds. BitPacked still trusts its caller for that: a check costs as
much as the take for small batches of u64 indices, which baseline x86-64
cannot compare in vectors.

bitpacking_take is unchanged within noise, and Delta's take of 1024
scattered rows of 512 KiB of u32 takes 25 us.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
robert3005 force-pushed the claude/stoic-brahmagupta-p44si2 branch from 9e4c9ab to 8136498 Compare November 13, 2026 15:01

ghost left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove the edition change and good to go

Robert Kruszewski and others added 2 commits November 13, 2026 15:49
delta_compress filled nulls forward across chunk boundaries, so a chunk
that starts with nulls began from the previous chunk's last value. For
values that restart in every chunk, such as RLE indices, those leading
slots became bases far above the next values, the residuals wrapped, and
the compressor's span estimate rejected Delta. Nullable RLE indices then
fell back to plain bit-packing or RunEnd.

Fill a chunk's leading nulls with its first valid value instead. Their
residuals are zero whether the values continue across chunks or restart.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
RLE indices count up within each 1024-value chunk, so Delta packs them
into a few bits. With RunEnd allowed on them, the compressor picked
RLE(indices = RunEnd(ends = Delta)), which every decode and filter has to
expand twice. Enable the exclusion for the indices child.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErHBxmZXBVmmLcAbLD
@robert3005 robert3005 changed the title Make DeltaArray great again Fast FastLanes Delta: fused decode, SIMD transposes, probe, filter, take and is_constant kernels Nov 13, 2026
@robert3005
robert3005 force-pushed the claude/stoic-brahmagupta-p44si2 branch from 8136498 to c005092 Compare November 13, 2026 15:51
@robert3005
robert3005 enabled auto-merge (squash) November 13, 2026 15:56
@robert3005
robert3005 merged commit 482212b into develop Nov 13, 2026
@robert3005
robert3005 deleted the claude/stoic-brahmagupta-p44si2 branch November 13, 2026 16:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants