Skip to content

Store plan children in fixed-position slots - #11178

Merged
joseph-isaacs merged 4 commits into
developfrom
ji/loving-bohr-tw0ypy
Nov 4, 2026
Merged

joseph-isaacs merged 4 commits into
developfrom
ji/loving-bohr-tw0ypy

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Physical plan children used to be a packed list (PlanChildren). An absent child, such as the validity of a non-nullable struct, shifted the positions of the children after it, so lowering had to remap layout slots to plan indices for each layout kind.

Plans now store children in fixed-position slots, the same way arrays and layouts already do. An absent child is a None slot, so a child's position never depends on which other children are present.

Changes

Slots replace children (slots.rs, replacing children.rs)

  • PlanSlots is a SmallVec<[Option<LazyPlanRef>; 4]> newtype.
  • LazyPlanRef is one Arc holding a OnceCell<PlanRef> and an unsized Fn initializer.
    • It replaces the single list-level initializer: each slot is built on first access, independently of the others.
    • Clones share the built plan, so with_slots and Concat::map_chunks never lower a child twice.
    • A failed build leaves the slot unbuilt, and the next access retries it.

Plan children now live in `PlanSlots`: fixed positions where an absent
child is a `None` slot, as in array slots. Each slot is a `LazyPlanRef`,
built on first access and shared by clones, which replaces the
list-level `PlanChildren` initializer.

- `Pack` slots are `[validity?, fields...]` and `ListPack` slots are
  `[elements, offsets, validity?]`, matching their layouts and arrays.
  A pruning `Zoned` plan keeps `[None, zones]`.
- Lowering maps layout slots to plan slots in one helper, removing the
  per-layout index remapping.
- `PlanRef::children()` yields the present slots in order. Compiling
  uses it, so pipeline inlets stay dense: inlet `i` reads the `i`-th
  present slot. `PackSource` now reads validity from its first inlet.
- `with_children`/`child`/`child_name` become `with_slots`/`slot`/
  `slot_name`.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBCykJX86RM9UASFrjC
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs marked this pull request as ready for review November 3, 2026 19:58
`PlanSlots::present()` yields the present slots with their positions and
is now the only place absent slots are dropped: `children()`, display,
the optimizer's parent rules, the slot count Pack compiles, and Debug
all go through it instead of filtering slots themselves.

Eager slots are built by collecting `Option<PlanRef>`, so Pack and
ListPack construct theirs in one expression. The optimizer maps every
slot and keeps the result only when a child changed, replacing the
copy-on-first-change loop. `reduce_parent` takes the child it rewrites
instead of looking the slot up again, and PackSource takes validity off
the front of its inlet arrays.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBCykJX86RM9UASFrjC
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed

ghost commented Nov 3, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 14.07%

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 1 improved benchmark
✅ 1764 untouched benchmarks
⏩ 130 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ CPU Simulation scan[1] 85 µs 74.5 µs +14.07%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/loving-bohr-tw0ypy (5d87d96) with develop (4724b9e)

Open in CodSpeed

Footnotes

  1. 130 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 4, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 4, 2026
`arrays.remove(0)` moved every field array down once per struct batch.
Read inlet 0 straight into the validity and collect the fields from the
remaining inlets instead.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBCykJX86RM9UASFrjC
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@robert3005 robert3005 added the changelog/performance A performance improvement label Nov 4, 2026
@github-actions

ghost commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done bfa8559 vortex-queries 1 Explore Profiling Data
🟢 Done bfa8559 clickbench-nvme 1 Explore Profiling Data
🟢 Done bfa8559 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done bfa8559 fineweb-s3 1 Explore Profiling Data
🟢 Done bfa8559 fineweb 1 Explore Profiling Data
🟢 Done bfa8559 tpch-s3-10 1 Explore Profiling Data
🟢 Done bfa8559 tpch-nvme-10 1 Explore Profiling Data
🟢 Done bfa8559 job-nvme 1 Explore Profiling Data
🟢 Done bfa8559 appian-nvme 1 Explore Profiling Data
🟢 Done bfa8559 polarsignals 1 Explore Profiling Data
🟢 Done bfa8559 statpopgen 1 Explore Profiling Data
🟢 Done bfa8559 tpch-s3 1 Explore Profiling Data
🟢 Done bfa8559 tpch-nvme 1 Explore Profiling Data
🟢 Done bfa8559 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR bfa85598 vs base 41dec206
Vortex (geomean): hot 0.956x ➖ · cold 1.047x ➖


datafusion / vortex-file-compressed / ns (0.956x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44391382 / 44071932 / +0.7% 89100522 / 87824232 / +1.5% 0.50 / 0.50 / -0.7%
polarsignals_q01/datafusion:vortex-file-compressed 53400136 / 69979988 / -23.7% 🟢 113863084 / 134632654 / -15.4% 🟢 0.47 / 0.52 / -9.8%
polarsignals_q02/datafusion:vortex-file-compressed 11678849 / 13989476 / -16.5% 🟢 45559360 / 42645531 / +6.8% 0.26 / 0.33 / -21.9%
polarsignals_q03/datafusion:vortex-file-compressed 54513968 / 54262720 / +0.5% 115790360 / 110641677 / +4.7% 0.47 / 0.49 / -4.0%
polarsignals_q04/datafusion:vortex-file-compressed 9192129 / 9163394 / +0.3% 43057884 / 40250942 / +7.0% 0.21 / 0.23 / -6.2%
polarsignals_q05/datafusion:vortex-file-compressed 11375118 / 11377704 / -0.0% 46268463 / 42246092 / +9.5% 0.25 / 0.27 / -8.7%
polarsignals_q06/datafusion:vortex-file-compressed 22813869 / 22914065 / -0.4% 57392785 / 53653832 / +7.0% 0.40 / 0.43 / -6.9%
polarsignals_q07/datafusion:vortex-file-compressed 10740486 / 10822038 / -0.8% 45986471 / 40873971 / +12.5% 🔴 0.23 / 0.26 / -11.8%
polarsignals_q08/datafusion:vortex-file-compressed 98322518 / 97914473 / +0.4% 158666627 / 158082997 / +0.4% 0.62 / 0.62 / +0.0%
polarsignals_q09/datafusion:vortex-file-compressed 9871488 / 9919912 / -0.5% 44848241 / 38284601 / +17.1% 🔴 0.22 / 0.26 / -15.1%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 1.017x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.024x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.977x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6105800 / 6189037 / -1.3% 20395106 / 20147406 / +1.2% 0.30 / 0.31 / -2.5%
fineweb_q01/datafusion:vortex-file-compressed 9624016 / 9519876 / +1.1% 41717597 / 41036377 / +1.7% 0.23 / 0.23 / -0.6%
fineweb_q02/datafusion:vortex-file-compressed 11726124 / 11141983 / +5.2% 42581134 / 38958071 / +9.3% 0.28 / 0.29 / -3.7%
fineweb_q03/datafusion:vortex-file-compressed 16541573 / 18006990 / -8.1% 111498958 / 96745314 / +15.2% 🔴 0.15 / 0.19 / -20.3%
fineweb_q04/datafusion:vortex-file-compressed 66112090 / 63281826 / +4.5% 143494456 / 138667477 / +3.5% 0.46 / 0.46 / +1.0%
fineweb_q05/datafusion:vortex-file-compressed 61805269 / 61525664 / +0.5% 143091239 / 140583895 / +1.8% 0.43 / 0.44 / -1.3%
fineweb_q06/datafusion:vortex-file-compressed 16570689 / 18158620 / -8.7% 103956423 / 99819644 / +4.1% 0.16 / 0.18 / -12.4%
fineweb_q07/datafusion:vortex-file-compressed 18742514 / 17402776 / +7.7% 105209855 / 99903551 / +5.3% 0.18 / 0.17 / +2.3%
fineweb_q08/datafusion:vortex-file-compressed 7740386 / 9480268 / -18.4% 🟢 34204891 / 31151251 / +9.8% 0.23 / 0.30 / -25.6%
datafusion / vortex-compact / ns (1.048x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6106774 / 6085116 / +0.4% 19726043 / 20331345 / -3.0% 0.31 / 0.30 / +3.4%
fineweb_q01/datafusion:vortex-compact 101735754 / 102487741 / -0.7% 134130476 / 135050596 / -0.7% 0.76 / 0.76 / -0.1%
fineweb_q02/datafusion:vortex-compact 103231660 / 103437471 / -0.2% 135121056 / 134039271 / +0.8% 0.76 / 0.77 / -1.0%
fineweb_q03/datafusion:vortex-compact 180780720 / 188221461 / -4.0% 269347193 / 253971776 / +6.1% 0.67 / 0.74 / -9.4%
fineweb_q04/datafusion:vortex-compact 206384262 / 190859646 / +8.1% 260429522 / 258802102 / +0.6% 0.79 / 0.74 / +7.5%
fineweb_q05/datafusion:vortex-compact 180387309 / 180501266 / -0.1% 260632527 / 256767113 / +1.5% 0.69 / 0.70 / -1.5%
fineweb_q06/datafusion:vortex-compact 130728499 / 123314017 / +6.0% 197162931 / 194446782 / +1.4% 0.66 / 0.63 / +4.6%
fineweb_q07/datafusion:vortex-compact 129167959 / 128678756 / +0.4% 195474776 / 191929147 / +1.8% 0.66 / 0.67 / -1.4%
fineweb_q08/datafusion:vortex-compact 10992314 / 7937066 / +38.5% 🔴 26039461 / 24215499 / +7.5% 0.42 / 0.33 / +28.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9352870 / 9517378 / -1.7% 32201180 / 34479443 / -6.6% 0.29 / 0.28 / +5.2%
fineweb_q01/datafusion:parquet 73236830 / 73899958 / -0.9% 156406865 / 148543793 / +5.3% 0.47 / 0.50 / -5.9%
fineweb_q02/datafusion:parquet 74398933 / 75233750 / -1.1% 156662893 / 151679398 / +3.3% 0.47 / 0.50 / -4.3%
fineweb_q03/datafusion:parquet 74275772 / 73316386 / +1.3% 154609419 / 141036557 / +9.6% 0.48 / 0.52 / -7.6%
fineweb_q04/datafusion:parquet 81196433 / 81113150 / +0.1% 146850663 / 148687940 / -1.2% 0.55 / 0.55 / +1.4%
fineweb_q05/datafusion:parquet 81333574 / 80976510 / +0.4% 149021969 / 142609716 / +4.5% 0.55 / 0.57 / -3.9%
fineweb_q06/datafusion:parquet 76084436 / 75704658 / +0.5% 155214627 / 144836945 / +7.2% 0.49 / 0.52 / -6.2%
fineweb_q07/datafusion:parquet 74824730 / 74186732 / +0.9% 153481539 / 142006248 / +8.1% 0.49 / 0.52 / -6.7%
fineweb_q08/datafusion:parquet 74849322 / 74289954 / +0.8% 146222272 / 140768812 / +3.9% 0.51 / 0.53 / -3.0%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2061968 / 2040918 / +1.0% 7595188 / 8073488 / -5.9% 0.27 / 0.25 / +7.4%
fineweb_q01/duckdb:vortex-file-compressed 7789202 / 7929758 / -1.8% 28147213 / 25894578 / +8.7% 0.28 / 0.31 / -9.6%
fineweb_q02/duckdb:vortex-file-compressed 9028198 / 9423240 / -4.2% 30177002 / 27148175 / +11.2% 🔴 0.30 / 0.35 / -13.8%
fineweb_q03/duckdb:vortex-file-compressed 18943179 / 18931688 / +0.1% 98883084 / 87611060 / +12.9% 🔴 0.19 / 0.22 / -11.3%
fineweb_q04/duckdb:vortex-file-compressed 65999186 / 65517062 / +0.7% 102969048 / 105038449 / -2.0% 0.64 / 0.62 / +2.8%
fineweb_q05/duckdb:vortex-file-compressed 65297319 / 64900566 / +0.6% 102964477 / 102361085 / +0.6% 0.63 / 0.63 / +0.0%
fineweb_q06/duckdb:vortex-file-compressed 18549626 / 18220768 / +1.8% 87420184 / 86689777 / +0.8% 0.21 / 0.21 / +1.0%
fineweb_q07/duckdb:vortex-file-compressed 17639182 / 17870862 / -1.3% 90976679 / 87660818 / +3.8% 0.19 / 0.20 / -4.9%
fineweb_q08/duckdb:vortex-file-compressed 4681876 / 4786042 / -2.2% 12686596 / 13360193 / -5.0% 0.37 / 0.36 / +3.0%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2357559 / 2243772 / +5.1% 7299120 / 8348133 / -12.6% 🟢 0.32 / 0.27 / +20.2%
fineweb_q01/duckdb:vortex-compact 38272010 / 38705788 / -1.1% 55894327 / 56351954 / -0.8% 0.68 / 0.69 / -0.3%
fineweb_q02/duckdb:vortex-compact 39786914 / 39213376 / +1.5% 57229654 / 60083587 / -4.7% 0.70 / 0.65 / +6.5%
fineweb_q03/duckdb:vortex-compact 151277113 / 150444926 / +0.6% 180922342 / 180762660 / +0.1% 0.84 / 0.83 / +0.5%
fineweb_q04/duckdb:vortex-compact 158680614 / 165177604 / -3.9% 188870066 / 197931740 / -4.6% 0.84 / 0.83 / +0.7%
fineweb_q05/duckdb:vortex-compact 150952712 / 151690654 / -0.5% 184754556 / 185397529 / -0.3% 0.82 / 0.82 / -0.1%
fineweb_q06/duckdb:vortex-compact 82104346 / 82017918 / +0.1% 124117666 / 125317601 / -1.0% 0.66 / 0.65 / +1.1%
fineweb_q07/duckdb:vortex-compact 84532351 / 84426056 / +0.1% 127604397 / 124607189 / +2.4% 0.66 / 0.68 / -2.2%
fineweb_q08/duckdb:vortex-compact 4670770 / 4511304 / +3.5% 10591641 / 11074805 / -4.4% 0.44 / 0.41 / +8.3%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23901978 / 23809605 / +0.4% 27908075 / 28673966 / -2.7% 0.86 / 0.83 / +3.1%
fineweb_q01/duckdb:parquet 54224632 / 54135540 / +0.2% 75661001 / 73823694 / +2.5% 0.72 / 0.73 / -2.3%
fineweb_q02/duckdb:parquet 58398731 / 58204588 / +0.3% 77264559 / 74595882 / +3.6% 0.76 / 0.78 / -3.1%
fineweb_q03/duckdb:parquet 119454722 / 118300829 / +1.0% 181999633 / 175697275 / +3.6% 0.66 / 0.67 / -2.5%
fineweb_q04/duckdb:parquet 163084017 / 162616357 / +0.3% 209112990 / 202890836 / +3.1% 0.78 / 0.80 / -2.7%
fineweb_q05/duckdb:parquet 162598659 / 158539637 / +2.6% 199168139 / 204264404 / -2.5% 0.82 / 0.78 / +5.2%
fineweb_q06/duckdb:parquet 86753272 / 88901372 / -2.4% 147792517 / 146085014 / +1.2% 0.59 / 0.61 / -3.5%
fineweb_q07/duckdb:parquet 88937054 / 89685488 / -0.8% 145645217 / 141721372 / +2.8% 0.61 / 0.63 / -3.5%
fineweb_q08/duckdb:parquet 28669198 / 28886594 / -0.8% 29956621 / 30053262 / -0.3% 0.96 / 0.96 / -0.4%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+3.5%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.046x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 168661394 / 173372484 / -2.7% 562361817 / 547262389 / +2.8% 0.30 / 0.32 / -5.3%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10636038 / 10047516 / +5.9% 55331342 / 53505419 / +3.4% 0.19 / 0.19 / +2.4%
clickbench-sorted_q26/datafusion:vortex-file-compressed 10217573 / 10448292 / -2.2% 56959889 / 52673024 / +8.1% 0.18 / 0.20 / -9.6%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23523880 / 22688986 / +3.7% 68590880 / 68655207 / -0.1% 0.34 / 0.33 / +3.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18940217 / 18337240 / +3.3% 65632491 / 56936648 / +15.3% 🔴 0.29 / 0.32 / -10.4%
clickbench-sorted_q38/datafusion:vortex-file-compressed 12756148 / 13142994 / -2.9% 64437534 / 60221363 / +7.0% 0.20 / 0.22 / -9.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 37798474 / 37497880 / +0.8% 95247064 / 93020197 / +2.4% 0.40 / 0.40 / -1.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed 10864474 / 11009770 / -1.3% 44273312 / 40545785 / +9.2% 0.25 / 0.27 / -9.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed 10641860 / 11217749 / -5.1% 46139887 / 41470554 / +11.3% 🔴 0.23 / 0.27 / -14.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9342326 / 9295356 / +0.5% 37830441 / 33846503 / +11.8% 🔴 0.25 / 0.27 / -10.1%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 747791204 / 748145160 / -0.0% 952048290 / 965188052 / -1.4% 0.79 / 0.78 / +1.3%
clickbench-sorted_q24/datafusion:parquet 8636958 / 8813569 / -2.0% 72380696 / 70894098 / +2.1% 0.12 / 0.12 / -4.0%
clickbench-sorted_q26/datafusion:parquet 9365788 / 8878688 / +5.5% 71750820 / 71904897 / -0.2% 0.13 / 0.12 / +5.7%
clickbench-sorted_q36/datafusion:parquet 89938984 / 90287500 / -0.4% 166013192 / 162978082 / +1.9% 0.54 / 0.55 / -2.2%
clickbench-sorted_q37/datafusion:parquet 61257586 / 60971894 / +0.5% 127627824 / 128224273 / -0.5% 0.48 / 0.48 / +0.9%
clickbench-sorted_q38/datafusion:parquet 83465400 / 83364866 / +0.1% 158694137 / 155587905 / +2.0% 0.53 / 0.54 / -1.8%
clickbench-sorted_q39/datafusion:parquet 152308102 / 153051894 / -0.5% 228805514 / 226553672 / +1.0% 0.67 / 0.68 / -1.5%
clickbench-sorted_q40/datafusion:parquet 41654706 / 41711746 / -0.1% 111187816 / 106939161 / +4.0% 0.37 / 0.39 / -4.0%
clickbench-sorted_q41/datafusion:parquet 39478605 / 39202925 / +0.7% 108284755 / 105400915 / +2.7% 0.36 / 0.37 / -2.0%
clickbench-sorted_q42/datafusion:parquet 25068416 / 25049087 / +0.1% 85152625 / 84265669 / +1.1% 0.29 / 0.30 / -1.0%
duckdb / vortex-file-compressed / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 37098947 / 35419716 / +4.7% 73694295 / 73385036 / +0.4% 0.50 / 0.48 / +4.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed 9698780 / 9356290 / +3.7% 29091789 / 29784129 / -2.3% 0.33 / 0.31 / +6.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed 8299872 / 8390878 / -1.1% 30495708 / 29722808 / +2.6% 0.27 / 0.28 / -3.6%
clickbench-sorted_q36/duckdb:vortex-file-compressed 22133408 / 21992026 / +0.6% 48377407 / 47575747 / +1.7% 0.46 / 0.46 / -1.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 17748126 / 17602262 / +0.8% 44856277 / 42969265 / +4.4% 0.40 / 0.41 / -3.4%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18132074 / 18165494 / -0.2% 48975363 / 45761272 / +7.0% 0.37 / 0.40 / -6.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 42449160 / 42107472 / +0.8% 86109911 / 77492700 / +11.1% 🔴 0.49 / 0.54 / -9.3%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10709832 / 10695676 / +0.1% 34470233 / 34367976 / +0.3% 0.31 / 0.31 / -0.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11986766 / 11750741 / +2.0% 36023144 / 35557112 / +1.3% 0.33 / 0.33 / +0.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 9196732 / 8864029 / +3.8% 30384469 / 31335129 / -3.0% 0.30 / 0.28 / +7.0%
duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 142240617 / 145821099 / -2.5% 179497226 / 171006441 / +5.0% 0.79 / 0.85 / -7.1%
clickbench-sorted_q24/duckdb:parquet 15863111 / 15715839 / +0.9% 18199212 / 17596449 / +3.4% 0.87 / 0.89 / -2.4%
clickbench-sorted_q26/duckdb:parquet 15018704 / 16014884 / -6.2% 17905252 / 23832029 / -24.9% 🟢 0.84 / 0.67 / +24.8%
clickbench-sorted_q36/duckdb:parquet 47443170 / 46482445 / +2.1% 57852428 / 58545771 / -1.2% 0.82 / 0.79 / +3.3%
clickbench-sorted_q37/duckdb:parquet 37118152 / 36974080 / +0.4% 43991812 / 44993484 / -2.2% 0.84 / 0.82 / +2.7%
clickbench-sorted_q38/duckdb:parquet 42600470 / 43433963 / -1.9% 56588726 / 54661776 / +3.5% 0.75 / 0.79 / -5.3%
clickbench-sorted_q39/duckdb:parquet 74507773 / 75452842 / -1.3% 82873472 / 82699337 / +0.2% 0.90 / 0.91 / -1.5%
clickbench-sorted_q40/duckdb:parquet 22323044 / 22283022 / +0.2% 29503709 / 29071619 / +1.5% 0.76 / 0.77 / -1.3%
clickbench-sorted_q41/duckdb:parquet 22427467 / 22864512 / -1.9% 29821133 / 29398165 / +1.4% 0.75 / 0.78 / -3.3%
clickbench-sorted_q42/duckdb:parquet 16436888 / 17293182 / -5.0% 23139229 / 25226319 / -8.3% 0.71 / 0.69 / +3.6%
duckdb / duckdb / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 68665522 / 67917746 / +1.1% 119833983 / 116377449 / +3.0% 0.57 / 0.58 / -1.8%
clickbench-sorted_q24/duckdb:duckdb 23014902 / 22821285 / +0.8% 30825275 / 28365994 / +8.7% 0.75 / 0.80 / -7.2%
clickbench-sorted_q26/duckdb:duckdb 24304727 / 23960867 / +1.4% 32225458 / 29900054 / +7.8% 0.75 / 0.80 / -5.9%
clickbench-sorted_q36/duckdb:duckdb 40115172 / 37385382 / +7.3% 71936819 / 70264542 / +2.4% 0.56 / 0.53 / +4.8%
clickbench-sorted_q37/duckdb:duckdb 39294403 / 37547611 / +4.7% 78806003 / 74541912 / +5.7% 0.50 / 0.50 / -1.0%
clickbench-sorted_q38/duckdb:duckdb 30497358 / 30029310 / +1.6% 64215654 / 59588322 / +7.8% 0.47 / 0.50 / -5.8%
clickbench-sorted_q39/duckdb:duckdb 58121958 / 54784731 / +6.1% 109957152 / 104836961 / +4.9% 0.53 / 0.52 / +1.2%
clickbench-sorted_q40/duckdb:duckdb 21799816 / 21564510 / +1.1% 45453921 / 43277490 / +5.0% 0.48 / 0.50 / -3.7%
clickbench-sorted_q41/duckdb:duckdb 20647746 / 20571972 / +0.4% 39395987 / 35556381 / +10.8% 🔴 0.52 / 0.58 / -9.4%
clickbench-sorted_q42/duckdb:duckdb 16867182 / 16940974 / -0.4% 28566232 / 27608462 / +3.5% 0.59 / 0.61 / -3.8%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.976x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15853861 / 15509449 / +2.2% 40124987 / 41731066 / -3.8% 0.40 / 0.37 / +6.3%
tpch_q02/datafusion:vortex-file-compressed 16779701 / 16637983 / +0.9% 32862622 / 35190396 / -6.6% 0.51 / 0.47 / +8.0%
tpch_q03/datafusion:vortex-file-compressed 20086024 / 19731114 / +1.8% 44965563 / 47039560 / -4.4% 0.45 / 0.42 / +6.5%
tpch_q04/datafusion:vortex-file-compressed 10275804 / 11004561 / -6.6% 30519134 / 33065614 / -7.7% 0.34 / 0.33 / +1.2%
tpch_q05/datafusion:vortex-file-compressed 36702412 / 36918765 / -0.6% 63737733 / 69010576 / -7.6% 0.58 / 0.53 / +7.6%
tpch_q06/datafusion:vortex-file-compressed 7227042 / 6320145 / +14.3% 🔴 22342627 / 26502662 / -15.7% 🟢 0.32 / 0.24 / +35.6%
tpch_q07/datafusion:vortex-file-compressed 51406117 / 51612464 / -0.4% 77000029 / 79519391 / -3.2% 0.67 / 0.65 / +2.9%
tpch_q08/datafusion:vortex-file-compressed 50944175 / 51853043 / -1.8% 69512951 / 76648467 / -9.3% 0.73 / 0.68 / +8.3%
tpch_q09/datafusion:vortex-file-compressed 47664426 / 48051485 / -0.8% 74334199 / 77068964 / -3.5% 0.64 / 0.62 / +2.8%
tpch_q10/datafusion:vortex-file-compressed 16682283 / 17642720 / -5.4% 46866591 / 51053881 / -8.2% 0.36 / 0.35 / +3.0%
tpch_q11/datafusion:vortex-file-compressed 14459100 / 14072319 / +2.7% 31488304 / 33103899 / -4.9% 0.46 / 0.43 / +8.0%
tpch_q12/datafusion:vortex-file-compressed 18220962 / 18702432 / -2.6% 42038110 / 43413971 / -3.2% 0.43 / 0.43 / +0.6%
tpch_q13/datafusion:vortex-file-compressed 19341820 / 19553966 / -1.1% 35739970 / 41057258 / -13.0% 🟢 0.54 / 0.48 / +13.6%
tpch_q14/datafusion:vortex-file-compressed 13976964 / 14445469 / -3.2% 34900697 / 38326450 / -8.9% 0.40 / 0.38 / +6.3%
tpch_q15/datafusion:vortex-file-compressed 18313684 / 19003707 / -3.6% 40802030 / 42503457 / -4.0% 0.45 / 0.45 / +0.4%
tpch_q16/datafusion:vortex-file-compressed 18318735 / 18038650 / +1.6% 35555668 / 39087513 / -9.0% 0.52 / 0.46 / +11.6%
tpch_q17/datafusion:vortex-file-compressed 28507871 / 28299206 / +0.7% 57195185 / 58475528 / -2.2% 0.50 / 0.48 / +3.0%
tpch_q18/datafusion:vortex-file-compressed 35686457 / 35745784 / -0.2% 57573839 / 58783399 / -2.1% 0.62 / 0.61 / +1.9%
tpch_q19/datafusion:vortex-file-compressed 12759517 / 10963157 / +16.4% 🔴 33982188 / 36775636 / -7.6% 0.38 / 0.30 / +26.0%
tpch_q20/datafusion:vortex-file-compressed 20155920 / 20074421 / +0.4% 40865894 / 44876672 / -8.9% 0.49 / 0.45 / +10.3%
tpch_q21/datafusion:vortex-file-compressed 39740547 / 38732340 / +2.6% 69142623 / 69622006 / -0.7% 0.57 / 0.56 / +3.3%
tpch_q22/datafusion:vortex-file-compressed 10585751 / 10996663 / -3.7% 28166869 / 30994082 / -9.1% 0.38 / 0.35 / +5.9%
datafusion / vortex-compact / ns (1.021x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16895513 / 16356897 / +3.3% 40043284 / 43172577 / -7.2% 0.42 / 0.38 / +11.4%
tpch_q02/datafusion:vortex-compact 18113026 / 18209928 / -0.5% 35048144 / 35190597 / -0.4% 0.52 / 0.52 / -0.1%
tpch_q03/datafusion:vortex-compact 20492598 / 20517124 / -0.1% 42467018 / 45761096 / -7.2% 0.48 / 0.45 / +7.6%
tpch_q04/datafusion:vortex-compact 12203314 / 10937935 / +11.6% 🔴 31652466 / 33958890 / -6.8% 0.39 / 0.32 / +19.7%
tpch_q05/datafusion:vortex-compact 37561232 / 37275438 / +0.8% 62946375 / 66934792 / -6.0% 0.60 / 0.56 / +7.2%
tpch_q06/datafusion:vortex-compact 8078798 / 6634460 / +21.8% 🔴 24959469 / 30729996 / -18.8% 🟢 0.32 / 0.22 / +49.9%
tpch_q07/datafusion:vortex-compact 52654197 / 52944612 / -0.5% 70894762 / 78850284 / -10.1% 🟢 0.74 / 0.67 / +10.6%
tpch_q08/datafusion:vortex-compact 52050529 / 52422095 / -0.7% 78453321 / 79701254 / -1.6% 0.66 / 0.66 / +0.9%
tpch_q09/datafusion:vortex-compact 48450485 / 48633455 / -0.4% 75641689 / 77210776 / -2.0% 0.64 / 0.63 / +1.7%
tpch_q10/datafusion:vortex-compact 18487983 / 19278140 / -4.1% 45451332 / 48950917 / -7.1% 0.41 / 0.39 / +3.3%
tpch_q11/datafusion:vortex-compact 14528388 / 14481973 / +0.3% 31796626 / 36160489 / -12.1% 🟢 0.46 / 0.40 / +14.1%
tpch_q12/datafusion:vortex-compact 20208019 / 19467933 / +3.8% 39697531 / 44461790 / -10.7% 🟢 0.51 / 0.44 / +16.3%
tpch_q13/datafusion:vortex-compact 20624864 / 19390998 / +6.4% 38070547 / 40374458 / -5.7% 0.54 / 0.48 / +12.8%
tpch_q14/datafusion:vortex-compact 15267699 / 15436984 / -1.1% 37449928 / 39283209 / -4.7% 0.41 / 0.39 / +3.7%
tpch_q15/datafusion:vortex-compact 20062839 / 20271717 / -1.0% 44685437 / 47091093 / -5.1% 0.45 / 0.43 / +4.3%
tpch_q16/datafusion:vortex-compact 18848152 / 18523570 / +1.8% 37523526 / 37126414 / +1.1% 0.50 / 0.50 / +0.7%
tpch_q17/datafusion:vortex-compact 29033692 / 29157730 / -0.4% 59003372 / 58741370 / +0.4% 0.49 / 0.50 / -0.9%
tpch_q18/datafusion:vortex-compact 35763687 / 35393689 / +1.0% 54895814 / 60408399 / -9.1% 0.65 / 0.59 / +11.2%
tpch_q19/datafusion:vortex-compact 14104503 / 13347016 / +5.7% 37017329 / 39160673 / -5.5% 0.38 / 0.34 / +11.8%
tpch_q20/datafusion:vortex-compact 21443207 / 20944033 / +2.4% 44123168 / 45356823 / -2.7% 0.49 / 0.46 / +5.2%
tpch_q21/datafusion:vortex-compact 40101002 / 40232473 / -0.3% 71472049 / 71203964 / +0.4% 0.56 / 0.57 / -0.7%
tpch_q22/datafusion:vortex-compact 11023301 / 10978372 / +0.4% 28278652 / 31074500 / -9.0% 0.39 / 0.35 / +10.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72061282 / 71821763 / +0.3% 87223590 / 89262352 / -2.3% 0.83 / 0.80 / +2.7%
tpch_q02/datafusion:parquet 75875664 / 76764011 / -1.2% 90314402 / 91732316 / -1.5% 0.84 / 0.84 / +0.4%
tpch_q03/datafusion:parquet 81852504 / 81512668 / +0.4% 97029345 / 103334733 / -6.1% 0.84 / 0.79 / +6.9%
tpch_q04/datafusion:parquet 39260711 / 39956594 / -1.7% 55723568 / 56775594 / -1.9% 0.70 / 0.70 / +0.1%
tpch_q05/datafusion:parquet 109645717 / 110574301 / -0.8% 133604863 / 136310304 / -2.0% 0.82 / 0.81 / +1.2%
tpch_q06/datafusion:parquet 31000847 / 31303679 / -1.0% 45290673 / 48620723 / -6.8% 0.68 / 0.64 / +6.3%
tpch_q07/datafusion:parquet 112318732 / 112629426 / -0.3% 134759806 / 140087647 / -3.8% 0.83 / 0.80 / +3.7%
tpch_q08/datafusion:parquet 117023932 / 116521023 / +0.4% 138235531 / 144089339 / -4.1% 0.85 / 0.81 / +4.7%
tpch_q09/datafusion:parquet 137289392 / 137009157 / +0.2% 163437764 / 166573785 / -1.9% 0.84 / 0.82 / +2.1%
tpch_q10/datafusion:parquet 103869338 / 103441657 / +0.4% 124039606 / 128333507 / -3.3% 0.84 / 0.81 / +3.9%
tpch_q11/datafusion:parquet 62316650 / 62464701 / -0.2% 78865708 / 83221881 / -5.2% 0.79 / 0.75 / +5.3%
tpch_q12/datafusion:parquet 63621486 / 64181455 / -0.9% 81056254 / 85290984 / -5.0% 0.78 / 0.75 / +4.3%
tpch_q13/datafusion:parquet 143189353 / 143983654 / -0.6% 161026400 / 163151811 / -1.3% 0.89 / 0.88 / +0.8%
tpch_q14/datafusion:parquet 47615682 / 47588574 / +0.1% 64922726 / 69169761 / -6.1% 0.73 / 0.69 / +6.6%
tpch_q15/datafusion:parquet 73673566 / 73908687 / -0.3% 91578494 / 93428817 / -2.0% 0.80 / 0.79 / +1.7%
tpch_q16/datafusion:parquet 43381550 / 43428633 / -0.1% 58499700 / 65394012 / -10.5% 🟢 0.74 / 0.66 / +11.7%
tpch_q17/datafusion:parquet 123210687 / 123908874 / -0.6% 142622776 / 147966930 / -3.6% 0.86 / 0.84 / +3.2%
tpch_q18/datafusion:parquet 120488935 / 120713719 / -0.2% 139363714 / 142175320 / -2.0% 0.86 / 0.85 / +1.8%
tpch_q19/datafusion:parquet 58205832 / 57520786 / +1.2% 77789915 / 83307225 / -6.6% 0.75 / 0.69 / +8.4%
tpch_q20/datafusion:parquet 78243849 / 79378317 / -1.4% 100370809 / 102750864 / -2.3% 0.78 / 0.77 / +0.9%
tpch_q21/datafusion:parquet 113349205 / 113647531 / -0.3% 138518152 / 139370836 / -0.6% 0.82 / 0.82 / +0.4%
tpch_q22/datafusion:parquet 51740858 / 51888761 / -0.3% 65803890 / 67293690 / -2.2% 0.79 / 0.77 / +2.0%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9132656 / 9448659 / -3.3% 20253256 / 20422738 / -0.8% 0.45 / 0.46 / -2.5%
tpch_q02/duckdb:vortex-file-compressed 15258489 / 15229720 / +0.2% 25324622 / 24226657 / +4.5% 0.60 / 0.63 / -4.2%
tpch_q03/duckdb:vortex-file-compressed 18641049 / 18818848 / -0.9% 34856963 / 34234766 / +1.8% 0.53 / 0.55 / -2.7%
tpch_q04/duckdb:vortex-file-compressed 12454146 / 12852487 / -3.1% 25764742 / 26781860 / -3.8% 0.48 / 0.48 / +0.7%
tpch_q05/duckdb:vortex-file-compressed 20280236 / 20473449 / -0.9% 35413271 / 35243049 / +0.5% 0.57 / 0.58 / -1.4%
tpch_q06/duckdb:vortex-file-compressed 4919264 / 4751421 / +3.5% 14344856 / 14380344 / -0.2% 0.34 / 0.33 / +3.8%
tpch_q07/duckdb:vortex-file-compressed 24582331 / 24310697 / +1.1% 41274769 / 39516880 / +4.4% 0.60 / 0.62 / -3.2%
tpch_q08/duckdb:vortex-file-compressed 20924322 / 21159693 / -1.1% 37483539 / 36551313 / +2.6% 0.56 / 0.58 / -3.6%
tpch_q09/duckdb:vortex-file-compressed 22321364 / 22800134 / -2.1% 36297925 / 39100116 / -7.2% 0.61 / 0.58 / +5.5%
tpch_q10/duckdb:vortex-file-compressed 27180391 / 27180263 / +0.0% 42908404 / 44011408 / -2.5% 0.63 / 0.62 / +2.6%
tpch_q11/duckdb:vortex-file-compressed 8182431 / 8234047 / -0.6% 16668804 / 17115419 / -2.6% 0.49 / 0.48 / +2.0%
tpch_q12/duckdb:vortex-file-compressed 14794908 / 14728556 / +0.5% 25943390 / 28083115 / -7.6% 0.57 / 0.52 / +8.7%
tpch_q13/duckdb:vortex-file-compressed 19558106 / 19154820 / +2.1% 32426960 / 31604049 / +2.6% 0.60 / 0.61 / -0.5%
tpch_q14/duckdb:vortex-file-compressed 11380279 / 11202288 / +1.6% 23540024 / 23261140 / +1.2% 0.48 / 0.48 / +0.4%
tpch_q15/duckdb:vortex-file-compressed 8652866 / 8743332 / -1.0% 19956363 / 19929369 / +0.1% 0.43 / 0.44 / -1.2%
tpch_q16/duckdb:vortex-file-compressed 16567160 / 16544994 / +0.1% 22821951 / 23535537 / -3.0% 0.73 / 0.70 / +3.3%
tpch_q17/duckdb:vortex-file-compressed 12510280 / 12556432 / -0.4% 27519446 / 27115078 / +1.5% 0.45 / 0.46 / -1.8%
tpch_q18/duckdb:vortex-file-compressed 24180564 / 24014967 / +0.7% 33472545 / 35076742 / -4.6% 0.72 / 0.68 / +5.5%
tpch_q19/duckdb:vortex-file-compressed 12018408 / 11798529 / +1.9% 27007916 / 28904291 / -6.6% 0.44 / 0.41 / +9.0%
tpch_q20/duckdb:vortex-file-compressed 14649393 / 14318602 / +2.3% 29010666 / 31737862 / -8.6% 0.50 / 0.45 / +11.9%
tpch_q21/duckdb:vortex-file-compressed 49253485 / 49390402 / -0.3% 64831216 / 65030807 / -0.3% 0.76 / 0.76 / +0.0%
tpch_q22/duckdb:vortex-file-compressed 16790163 / 16647469 / +0.9% 26020365 / 26421248 / -1.5% 0.65 / 0.63 / +2.4%
duckdb / vortex-compact / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 11264110 / 9466012 / +19.0% 🔴 20831613 / 21671923 / -3.9% 0.54 / 0.44 / +23.8%
tpch_q02/duckdb:vortex-compact 17686412 / 18337524 / -3.6% 26736427 / 27738976 / -3.6% 0.66 / 0.66 / +0.1%
tpch_q03/duckdb:vortex-compact 20080905 / 19761881 / +1.6% 34389563 / 34072731 / +0.9% 0.58 / 0.58 / +0.7%
tpch_q04/duckdb:vortex-compact 13315598 / 12660032 / +5.2% 24741475 / 24986699 / -1.0% 0.54 / 0.51 / +6.2%
tpch_q05/duckdb:vortex-compact 20676515 / 20692855 / -0.1% 35507668 / 34704645 / +2.3% 0.58 / 0.60 / -2.3%
tpch_q06/duckdb:vortex-compact 5448862 / 5394237 / +1.0% 14513192 / 14032198 / +3.4% 0.38 / 0.38 / -2.3%
tpch_q07/duckdb:vortex-compact 25938012 / 25622745 / +1.2% 39569580 / 42605627 / -7.1% 0.66 / 0.60 / +9.0%
tpch_q08/duckdb:vortex-compact 21447130 / 21635438 / -0.9% 37228882 / 37296204 / -0.2% 0.58 / 0.58 / -0.7%
tpch_q09/duckdb:vortex-compact 23658888 / 23888194 / -1.0% 37789422 / 39522072 / -4.4% 0.63 / 0.60 / +3.6%
tpch_q10/duckdb:vortex-compact 30261117 / 30196034 / +0.2% 44229293 / 46036487 / -3.9% 0.68 / 0.66 / +4.3%
tpch_q11/duckdb:vortex-compact 8734485 / 8598808 / +1.6% 17461963 / 17596052 / -0.8% 0.50 / 0.49 / +2.4%
tpch_q12/duckdb:vortex-compact 17288203 / 17687405 / -2.3% 27119652 / 28813271 / -5.9% 0.64 / 0.61 / +3.8%
tpch_q13/duckdb:vortex-compact 19738557 / 19944222 / -1.0% 31452537 / 31698889 / -0.8% 0.63 / 0.63 / -0.3%
tpch_q14/duckdb:vortex-compact 12385813 / 12522509 / -1.1% 26540085 / 25056830 / +5.9% 0.47 / 0.50 / -6.6%
tpch_q15/duckdb:vortex-compact 9540927 / 9610343 / -0.7% 20284297 / 21518432 / -5.7% 0.47 / 0.45 / +5.3%
tpch_q16/duckdb:vortex-compact 17286272 / 17117463 / +1.0% 23142667 / 23111486 / +0.1% 0.75 / 0.74 / +0.9%
tpch_q17/duckdb:vortex-compact 13761744 / 13698347 / +0.5% 28105871 / 28869619 / -2.6% 0.49 / 0.47 / +3.2%
tpch_q18/duckdb:vortex-compact 24513013 / 24699536 / -0.8% 32432900 / 34218616 / -5.2% 0.76 / 0.72 / +4.7%
tpch_q19/duckdb:vortex-compact 14952755 / 15025574 / -0.5% 29362210 / 31378030 / -6.4% 0.51 / 0.48 / +6.3%
tpch_q20/duckdb:vortex-compact 17281992 / 17071352 / +1.2% 31436325 / 31964719 / -1.7% 0.55 / 0.53 / +2.9%
tpch_q21/duckdb:vortex-compact 49943059 / 49210446 / +1.5% 63624394 / 64755462 / -1.7% 0.78 / 0.76 / +3.3%
tpch_q22/duckdb:vortex-compact 19694092 / 19487332 / +1.1% 27892657 / 28909682 / -3.5% 0.71 / 0.67 / +4.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47402999 / 47740887 / -0.7% 53680914 / 54108634 / -0.8% 0.88 / 0.88 / +0.1%
tpch_q02/duckdb:parquet 48146014 / 48537703 / -0.8% 54681978 / 55509473 / -1.5% 0.88 / 0.87 / +0.7%
tpch_q03/duckdb:parquet 60250495 / 60264137 / -0.0% 67147998 / 68991268 / -2.7% 0.90 / 0.87 / +2.7%
tpch_q04/duckdb:parquet 34559832 / 34824425 / -0.8% 41956859 / 42584373 / -1.5% 0.82 / 0.82 / +0.7%
tpch_q05/duckdb:parquet 67118795 / 67069396 / +0.1% 76995313 / 76873177 / +0.2% 0.87 / 0.87 / -0.1%
tpch_q06/duckdb:parquet 21896113 / 21879709 / +0.1% 26543232 / 27353173 / -3.0% 0.82 / 0.80 / +3.1%
tpch_q07/duckdb:parquet 63873647 / 63865728 / +0.0% 71952169 / 73640563 / -2.3% 0.89 / 0.87 / +2.4%
tpch_q08/duckdb:parquet 75452474 / 75603843 / -0.2% 86295191 / 86434841 / -0.2% 0.87 / 0.87 / -0.0%
tpch_q09/duckdb:parquet 107607992 / 107683150 / -0.1% 118199179 / 119146553 / -0.8% 0.91 / 0.90 / +0.7%
tpch_q10/duckdb:parquet 105609312 / 105861611 / -0.2% 116262976 / 118484755 / -1.9% 0.91 / 0.89 / +1.7%
tpch_q11/duckdb:parquet 29389835 / 29402435 / -0.0% 34423921 / 34772823 / -1.0% 0.85 / 0.85 / +1.0%
tpch_q12/duckdb:parquet 37075546 / 37048894 / +0.1% 43268143 / 44341834 / -2.4% 0.86 / 0.84 / +2.6%
tpch_q13/duckdb:parquet 174743738 / 175137528 / -0.2% 180061137 / 183113226 / -1.7% 0.97 / 0.96 / +1.5%
tpch_q14/duckdb:parquet 42326467 / 42195543 / +0.3% 51060678 / 50463428 / +1.2% 0.83 / 0.84 / -0.9%
tpch_q15/duckdb:parquet 32416096 / 32524202 / -0.3% 40453861 / 40813914 / -0.9% 0.80 / 0.80 / +0.6%
tpch_q16/duckdb:parquet 47044044 / 47100016 / -0.1% 51905928 / 52894036 / -1.9% 0.91 / 0.89 / +1.8%
tpch_q17/duckdb:parquet 47786304 / 47948496 / -0.3% 56698527 / 56744211 / -0.1% 0.84 / 0.84 / -0.3%
tpch_q18/duckdb:parquet 74062918 / 74084689 / -0.0% 80178857 / 79669427 / +0.6% 0.92 / 0.93 / -0.7%
tpch_q19/duckdb:parquet 48486310 / 48022665 / +1.0% 62524341 / 60165361 / +3.9% 0.78 / 0.80 / -2.8%
tpch_q20/duckdb:parquet 63403073 / 63480342 / -0.1% 72091009 / 73591120 / -2.0% 0.88 / 0.86 / +2.0%
tpch_q21/duckdb:parquet 106349405 / 106800137 / -0.4% 114470974 / 115798875 / -1.1% 0.93 / 0.92 / +0.7%
tpch_q22/duckdb:parquet 50404432 / 50534717 / -0.3% 57774216 / 58670955 / -1.5% 0.87 / 0.86 / +1.3%
duckdb / duckdb / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6238199 / 6249581 / -0.2% 13259740 / 14207230 / -6.7% 0.47 / 0.44 / +7.0%
tpch_q02/duckdb:duckdb 8649934 / 8580219 / +0.8% 16225694 / 16107550 / +0.7% 0.53 / 0.53 / +0.1%
tpch_q03/duckdb:duckdb 15408547 / 15608208 / -1.3% 23942014 / 24943232 / -4.0% 0.64 / 0.63 / +2.8%
tpch_q04/duckdb:duckdb 11194789 / 11231256 / -0.3% 20240482 / 21274548 / -4.9% 0.55 / 0.53 / +4.8%
tpch_q05/duckdb:duckdb 15459239 / 15585949 / -0.8% 24851796 / 27880789 / -10.9% 🟢 0.62 / 0.56 / +11.3%
tpch_q06/duckdb:duckdb 3134021 / 3178960 / -1.4% 8742565 / 10005824 / -12.6% 🟢 0.36 / 0.32 / +12.8%
tpch_q07/duckdb:duckdb 18248978 / 18206042 / +0.2% 26794101 / 29624984 / -9.6% 0.68 / 0.61 / +10.8%
tpch_q08/duckdb:duckdb 17087917 / 17468064 / -2.2% 27674742 / 30464946 / -9.2% 0.62 / 0.57 / +7.7%
tpch_q09/duckdb:duckdb 23863449 / 23845546 / +0.1% 34135475 / 35833965 / -4.7% 0.70 / 0.67 / +5.1%
tpch_q10/duckdb:duckdb 28511884 / 28790794 / -1.0% 39039987 / 42389946 / -7.9% 0.73 / 0.68 / +7.5%
tpch_q11/duckdb:duckdb 5767845 / 5681989 / +1.5% 11428446 / 11655861 / -2.0% 0.50 / 0.49 / +3.5%
tpch_q12/duckdb:duckdb 10673740 / 10733060 / -0.6% 19531292 / 20530324 / -4.9% 0.55 / 0.52 / +4.5%
tpch_q13/duckdb:duckdb 32170459 / 31880600 / +0.9% 39684778 / 39758251 / -0.2% 0.81 / 0.80 / +1.1%
tpch_q14/duckdb:duckdb 12490780 / 12418885 / +0.6% 19737065 / 21267355 / -7.2% 0.63 / 0.58 / +8.4%
tpch_q15/duckdb:duckdb 6926245 / 6882417 / +0.6% 15207138 / 17090828 / -11.0% 🟢 0.46 / 0.40 / +13.1%
tpch_q16/duckdb:duckdb 18882163 / 18893062 / -0.1% 24083775 / 24769490 / -2.8% 0.78 / 0.76 / +2.8%
tpch_q17/duckdb:duckdb 8360196 / 8466863 / -1.3% 16659939 / 17550913 / -5.1% 0.50 / 0.48 / +4.0%
tpch_q18/duckdb:duckdb 18129511 / 18286851 / -0.9% 24886944 / 26403866 / -5.7% 0.73 / 0.69 / +5.2%
tpch_q19/duckdb:duckdb 12547564 / 12757207 / -1.6% 20763534 / 21129676 / -1.7% 0.60 / 0.60 / +0.1%
tpch_q20/duckdb:duckdb 14334917 / 14415971 / -0.6% 24859462 / 27539610 / -9.7% 0.58 / 0.52 / +10.2%
tpch_q21/duckdb:duckdb 21868239 / 21873536 / -0.0% 31360688 / 32292871 / -2.9% 0.70 / 0.68 / +2.9%
tpch_q22/duckdb:duckdb 23155693 / 23415623 / -1.1% 30889096 / 31577529 / -2.2% 0.75 / 0.74 / +1.1%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.015x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.013x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1833408 / 1780810 / +3.0% 6643724 / 6911711 / -3.9% 0.28 / 0.26 / +7.1%
statpopgen_q01/datafusion:vortex-file-compressed 4128421 / 4682928 / -11.8% 🟢 11987865 / 12260676 / -2.2% 0.34 / 0.38 / -9.8%
statpopgen_q02/datafusion:vortex-file-compressed 39604051 / 39257810 / +0.9% 64633663 / 65545797 / -1.4% 0.61 / 0.60 / +2.3%
statpopgen_q03/datafusion:vortex-file-compressed 115307730 / 117447336 / -1.8% 155722293 / 154108568 / +1.0% 0.74 / 0.76 / -2.8%
statpopgen_q04/datafusion:vortex-file-compressed 115774442 / 118165043 / -2.0% 152386862 / 155543060 / -2.0% 0.76 / 0.76 / +0.0%
statpopgen_q05/datafusion:vortex-file-compressed 69779431 / 70212412 / -0.6% 106315801 / 108905343 / -2.4% 0.66 / 0.64 / +1.8%
statpopgen_q06/datafusion:vortex-file-compressed 195374782 / 194389236 / +0.5% 232909037 / 231330907 / +0.7% 0.84 / 0.84 / -0.2%
statpopgen_q07/datafusion:vortex-file-compressed 277777611 / 274941214 / +1.0% 311359589 / 310904045 / +0.1% 0.89 / 0.88 / +0.9%
statpopgen_q08/datafusion:vortex-file-compressed 299969214 / 279355968 / +7.4% 312224191 / 317093092 / -1.5% 0.96 / 0.88 / +9.1%
statpopgen_q09/datafusion:vortex-file-compressed 97401430 / 97739175 / -0.3% 131781753 / 132720699 / -0.7% 0.74 / 0.74 / +0.4%
statpopgen_q10/datafusion:vortex-file-compressed 253251758 / 254341866 / -0.4% 299376328 / 302374346 / -1.0% 0.85 / 0.84 / +0.6%
datafusion / vortex-compact / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1793457 / 1807724 / -0.8% 6664718 / 6941109 / -4.0% 0.27 / 0.26 / +3.3%
statpopgen_q01/datafusion:vortex-compact 4639698 / 4409932 / +5.2% 13173614 / 12306181 / +7.0% 0.35 / 0.36 / -1.7%
statpopgen_q02/datafusion:vortex-compact 44081499 / 43146198 / +2.2% 63471098 / 66118507 / -4.0% 0.69 / 0.65 / +6.4%
statpopgen_q03/datafusion:vortex-compact 121337720 / 120810956 / +0.4% 154335270 / 153909328 / +0.3% 0.79 / 0.78 / +0.2%
statpopgen_q04/datafusion:vortex-compact 120834395 / 120043718 / +0.7% 151743676 / 154876410 / -2.0% 0.80 / 0.78 / +2.7%
statpopgen_q05/datafusion:vortex-compact 72321518 / 72673626 / -0.5% 103332238 / 105736262 / -2.3% 0.70 / 0.69 / +1.8%
statpopgen_q06/datafusion:vortex-compact 199204400 / 196545449 / +1.4% 232293067 / 268595006 / -13.5% 🟢 0.86 / 0.73 / +17.2%
statpopgen_q07/datafusion:vortex-compact 350061000 / 346796983 / +0.9% 369141291 / 373060294 / -1.1% 0.95 / 0.93 / +2.0%
statpopgen_q08/datafusion:vortex-compact 367606528 / 352504406 / +4.3% 378000298 / 415839638 / -9.1% 0.97 / 0.85 / +14.7%
statpopgen_q09/datafusion:vortex-compact 100176413 / 100496552 / -0.3% 130468469 / 130443096 / +0.0% 0.77 / 0.77 / -0.3%
statpopgen_q10/datafusion:vortex-compact 257441780 / 255617699 / +0.7% 296277400 / 305172158 / -2.9% 0.87 / 0.84 / +3.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1934488 / 1946765 / -0.6% 88654753 / 91236064 / -2.8% 0.02 / 0.02 / +2.3%
statpopgen_q01/datafusion:parquet 165177676 / 162755413 / +1.5% 172944475 / 175456106 / -1.4% 0.96 / 0.93 / +3.0%
statpopgen_q02/datafusion:parquet 281464612 / 284351614 / -1.0% 423439304 / 429418195 / -1.4% 0.66 / 0.66 / +0.4%
statpopgen_q03/datafusion:parquet 392795165 / 392300380 / +0.1% 502263453 / 536338230 / -6.4% 0.78 / 0.73 / +6.9%
statpopgen_q04/datafusion:parquet 390263194 / 391950653 / -0.4% 505374397 / 538385621 / -6.1% 0.77 / 0.73 / +6.1%
statpopgen_q05/datafusion:parquet 329024042 / 323316862 / +1.8% 457244409 / 466109185 / -1.9% 0.72 / 0.69 / +3.7%
statpopgen_q06/datafusion:parquet 486249885 / 487393791 / -0.2% 630981793 / 629470720 / +0.2% 0.77 / 0.77 / -0.5%
statpopgen_q07/datafusion:parquet 419279246 / 418937776 / +0.1% 539689485 / 544871356 / -1.0% 0.78 / 0.77 / +1.0%
statpopgen_q08/datafusion:parquet 419482410 / 419520166 / -0.0% 611070222 / 548759579 / +11.4% 🔴 0.69 / 0.76 / -10.2%
statpopgen_q09/datafusion:parquet 356911736 / 363374058 / -1.8% 486225824 / 494390043 / -1.7% 0.73 / 0.73 / -0.1%
statpopgen_q10/datafusion:parquet 540239797 / 542660346 / -0.4% 667318868 / 695457895 / -4.0% 0.81 / 0.78 / +3.8%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 13075235 / 12845762 / +1.8% 15178073 / 14934290 / +1.6% 0.86 / 0.86 / +0.2%
statpopgen_q01/duckdb:vortex-file-compressed 14082950 / 13911916 / +1.2% 18501082 / 17774082 / +4.1% 0.76 / 0.78 / -2.7%
statpopgen_q02/duckdb:vortex-file-compressed 143271526 / 131161124 / +9.2% 163365776 / 152533969 / +7.1% 0.88 / 0.86 / +2.0%
statpopgen_q03/duckdb:vortex-file-compressed 326331660 / 326486836 / -0.0% 353579907 / 338454930 / +4.5% 0.92 / 0.96 / -4.3%
statpopgen_q04/duckdb:vortex-file-compressed 323203778 / 326646485 / -1.1% 344396223 / 349744045 / -1.5% 0.94 / 0.93 / +0.5%
statpopgen_q05/duckdb:vortex-file-compressed 97962230 / 97822066 / +0.1% 117680681 / 120947679 / -2.7% 0.83 / 0.81 / +2.9%
statpopgen_q06/duckdb:vortex-file-compressed 227039019 / 227733555 / -0.3% 248818826 / 247428970 / +0.6% 0.91 / 0.92 / -0.9%
statpopgen_q07/duckdb:vortex-file-compressed 141332975 / 141104552 / +0.2% 159481174 / 158653266 / +0.5% 0.89 / 0.89 / -0.4%
statpopgen_q08/duckdb:vortex-file-compressed 151319256 / 147767445 / +2.4% 171842277 / 170121675 / +1.0% 0.88 / 0.87 / +1.4%
statpopgen_q09/duckdb:vortex-file-compressed 287888944 / 296691148 / -3.0% 312481349 / 312450749 / +0.0% 0.92 / 0.95 / -3.0%
statpopgen_q10/duckdb:vortex-file-compressed 799115339 / 782325713 / +2.1% 799870829 / 790313956 / +1.2% 1.00 / 0.99 / +0.9%
duckdb / vortex-compact / ns (1.043x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 13181958 / 12889517 / +2.3% 15376673 / 14884299 / +3.3% 0.86 / 0.87 / -1.0%
statpopgen_q01/duckdb:vortex-compact 14117210 / 13944440 / +1.2% 18461498 / 17812484 / +3.6% 0.76 / 0.78 / -2.3%
statpopgen_q02/duckdb:vortex-compact 139994955 / 124058586 / +12.8% 🔴 155006565 / 155371626 / -0.2% 0.90 / 0.80 / +13.1%
statpopgen_q03/duckdb:vortex-compact 319968606 / 307804364 / +4.0% 349745217 / 364616664 / -4.1% 0.91 / 0.84 / +8.4%
statpopgen_q04/duckdb:vortex-compact 332326010 / 281038424 / +18.2% 🔴 361371628 / 343420914 / +5.2% 0.92 / 0.82 / +12.4%
statpopgen_q05/duckdb:vortex-compact 100032500 / 99638190 / +0.4% 120229870 / 118933163 / +1.1% 0.83 / 0.84 / -0.7%
statpopgen_q06/duckdb:vortex-compact 231123990 / 230384556 / +0.3% 251133507 / 249267914 / +0.7% 0.92 / 0.92 / -0.4%
statpopgen_q07/duckdb:vortex-compact 201156628 / 199254523 / +1.0% 215401737 / 211332084 / +1.9% 0.93 / 0.94 / -1.0%
statpopgen_q08/duckdb:vortex-compact 214030978 / 213659314 / +0.2% 228381324 / 223401446 / +2.2% 0.94 / 0.96 / -2.0%
statpopgen_q09/duckdb:vortex-compact 293482168 / 295339254 / -0.6% 313279913 / 315576647 / -0.7% 0.94 / 0.94 / +0.1%
statpopgen_q10/duckdb:vortex-compact 759999321 / 695229317 / +9.3% 801583221 / 819138312 / -2.1% 0.95 / 0.85 / +11.7%
duckdb / parquet / ns (1.027x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245870377 / 237324009 / +3.6% 246576648 / 236624667 / +4.2% 1.00 / 1.00 / -0.6%
statpopgen_q01/duckdb:parquet 304717884 / 296899016 / +2.6% 305783049 / 298223452 / +2.5% 1.00 / 1.00 / +0.1%
statpopgen_q02/duckdb:parquet 555320486 / 542585022 / +2.3% 562688646 / 537814424 / +4.6% 0.99 / 1.01 / -2.2%
statpopgen_q03/duckdb:parquet 738545272 / 747693098 / -1.2% 808912940 / 792842345 / +2.0% 0.91 / 0.94 / -3.2%
statpopgen_q04/duckdb:parquet 764830403 / 787116636 / -2.8% 843130438 / 838371552 / +0.6% 0.91 / 0.94 / -3.4%
statpopgen_q05/duckdb:parquet 544008390 / 517573115 / +5.1% 579472039 / 557766423 / +3.9% 0.94 / 0.93 / +1.2%
statpopgen_q06/duckdb:parquet 627389572 / 620996534 / +1.0% 679296181 / 674909205 / +0.7% 0.92 / 0.92 / +0.4%
statpopgen_q07/duckdb:parquet 565455342 / 553956570 / +2.1% 560796288 / 553814809 / +1.3% 1.01 / 1.00 / +0.8%
statpopgen_q08/duckdb:parquet 569696745 / 562391896 / +1.3% 570752052 / 556463873 / +2.6% 1.00 / 1.01 / -1.2%
statpopgen_q09/duckdb:parquet 732132822 / 682979355 / +7.2% 788806304 / 728067756 / +8.3% 0.93 / 0.94 / -1.1%
statpopgen_q10/duckdb:parquet 1080381916 / 996025090 / +8.5% 1073474246 / 1060598034 / +1.2% 1.01 / 0.94 / +7.2%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.9%
Engines: DataFusion No clear signal (+11.3%, environment too noisy confidence) · DuckDB No clear signal (-5.0%, environment too noisy confidence)
Vortex (geomean): hot 0.888x ➖ · cold 0.886x ➖
Parquet (geomean): hot 0.863x ➖ · cold 0.851x ➖
Shifts: Parquet (control) -13.7% · Median polish -9.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.824x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 35021538 / 48920048 / -28.4% 124299587 / 131082409 / -5.2% 0.28 / 0.37 / -24.5%
fineweb_q01/datafusion:vortex-file-compressed 235408954 / 376938806 / -37.5% 🟢 704370980 / 815531355 / -13.6% 0.33 / 0.46 / -27.7%
fineweb_q02/datafusion:vortex-file-compressed 288300596 / 371008794 / -22.3% 381433610 / 517338111 / -26.3% 0.76 / 0.72 / +5.4%
fineweb_q03/datafusion:vortex-file-compressed 455062260 / 655429164 / -30.6% 🟢 463699956 / 939939434 / -50.7% 🟢 0.98 / 0.70 / +40.7%
fineweb_q04/datafusion:vortex-file-compressed 403923130 / 448682241 / -10.0% 458488570 / 434195705 / +5.6% 0.88 / 1.03 / -14.7%
fineweb_q05/datafusion:vortex-file-compressed 412654570 / 432431568 / -4.6% 482574578 / 524910797 / -8.1% 0.86 / 0.82 / +3.8%
fineweb_q06/datafusion:vortex-file-compressed 529426456 / 623136746 / -15.0% 514597886 / 583755516 / -11.8% 1.03 / 1.07 / -3.6%
fineweb_q07/datafusion:vortex-file-compressed 595180371 / 543085364 / +9.6% 492671426 / 581456189 / -15.3% 1.21 / 0.93 / +29.3%
fineweb_q08/datafusion:vortex-file-compressed 174600889 / 192183531 / -9.1% 186109645 / 190380209 / -2.2% 0.94 / 1.01 / -7.1%
datafusion / vortex-compact / ns (0.857x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 37030452 / 43987826 / -15.8% 117105484 / 137277764 / -14.7% 0.32 / 0.32 / -1.3%
fineweb_q01/datafusion:vortex-compact 378538448 / 443553075 / -14.7% 723390505 / 1032953965 / -30.0% 0.52 / 0.43 / +21.9%
fineweb_q02/datafusion:vortex-compact 331724910 / 404304976 / -18.0% 351404831 / 523720727 / -32.9% 🟢 0.94 / 0.77 / +22.3%
fineweb_q03/datafusion:vortex-compact 522369750 / 499653085 / +4.5% 730762475 / 713266786 / +2.5% 0.71 / 0.70 / +2.0%
fineweb_q04/datafusion:vortex-compact 494905888 / 546578875 / -9.5% 535187905 / 627310091 / -14.7% 0.92 / 0.87 / +6.1%
fineweb_q05/datafusion:vortex-compact 474072096 / 474901936 / -0.2% 524635672 / 500063231 / +4.9% 0.90 / 0.95 / -4.9%
fineweb_q06/datafusion:vortex-compact 565077756 / 766567332 / -26.3% 537191374 / 688860995 / -22.0% 1.05 / 1.11 / -5.5%
fineweb_q07/datafusion:vortex-compact 526891584 / 576907140 / -8.7% 610941899 / 617711567 / -1.1% 0.86 / 0.93 / -7.7%
fineweb_q08/datafusion:vortex-compact 140831542 / 212627420 / -33.8% 🟢 243892647 / 264331536 / -7.7% 0.58 / 0.80 / -28.2%
datafusion / parquet / ns (0.755x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 430083310 / 507079256 / -15.2% 739214515 / 997310869 / -25.9% 0.58 / 0.51 / +14.4%
fineweb_q01/datafusion:parquet 715894151 / 870831028 / -17.8% 682014491 / 886155000 / -23.0% 1.05 / 0.98 / +6.8%
fineweb_q02/datafusion:parquet 775930924 / 1339379230 / -42.1% 🟢 690938586 / 970996488 / -28.8% 1.12 / 1.38 / -18.6%
fineweb_q03/datafusion:parquet 726453754 / 939958616 / -22.7% 736910287 / 1066416816 / -30.9% 🟢 0.99 / 0.88 / +11.8%
fineweb_q04/datafusion:parquet 805680771 / 803840503 / +0.2% 816163076 / 835353453 / -2.3% 0.99 / 0.96 / +2.6%
fineweb_q05/datafusion:parquet 699000082 / 1251748882 / -44.2% 🟢 758451430 / 1659693345 / -54.3% 🟢 0.92 / 0.75 / +22.2%
fineweb_q06/datafusion:parquet 725272330 / 957051716 / -24.2% 657301893 / 898898114 / -26.9% 1.10 / 1.06 / +3.6%
fineweb_q07/datafusion:parquet 712146890 / 821632929 / -13.3% 779795752 / 856540109 / -9.0% 0.91 / 0.96 / -4.8%
fineweb_q08/datafusion:parquet 701904954 / 1011898226 / -30.6% 🟢 651138246 / 817357786 / -20.3% 1.08 / 1.24 / -12.9%
duckdb / vortex-file-compressed / ns (0.925x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 69558644 / 72617712 / -4.2% 106760739 / 108524637 / -1.6% 0.65 / 0.67 / -2.6%
fineweb_q01/duckdb:vortex-file-compressed 344195956 / 334846544 / +2.8% 394166430 / 496427257 / -20.6% 0.87 / 0.67 / +29.5%
fineweb_q02/duckdb:vortex-file-compressed 400075065 / 514945435 / -22.3% 405833787 / 555196935 / -26.9% 0.99 / 0.93 / +6.3%
fineweb_q03/duckdb:vortex-file-compressed 894300734 / 1028350110 / -13.0% 954040314 / 967697442 / -1.4% 0.94 / 1.06 / -11.8%
fineweb_q04/duckdb:vortex-file-compressed 969566868 / 1120607321 / -13.5% 1061538090 / 1018080998 / +4.3% 0.91 / 1.10 / -17.0%
fineweb_q05/duckdb:vortex-file-compressed 973142428 / 954871069 / +1.9% 1192928122 / 1016428294 / +17.4% 0.82 / 0.94 / -13.2%
fineweb_q06/duckdb:vortex-file-compressed 920266104 / 960936883 / -4.2% 1065921148 / 1064961679 / +0.1% 0.86 / 0.90 / -4.3%
fineweb_q07/duckdb:vortex-file-compressed 854792126 / 952939168 / -10.3% 1001479536 / 968387083 / +3.4% 0.85 / 0.98 / -13.3%
fineweb_q08/duckdb:vortex-file-compressed 201818565 / 205277578 / -1.7% 242005619 / 238157961 / +1.6% 0.83 / 0.86 / -3.2%
duckdb / vortex-compact / ns (0.953x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 78094688 / 74432776 / +4.9% 77118928 / 109436545 / -29.5% 1.01 / 0.68 / +48.9%
fineweb_q01/duckdb:vortex-compact 312320740 / 338094109 / -7.6% 333841983 / 457714435 / -27.1% 0.94 / 0.74 / +26.7%
fineweb_q02/duckdb:vortex-compact 328251102 / 412584258 / -20.4% 330571257 / 396276713 / -16.6% 0.99 / 1.04 / -4.6%
fineweb_q03/duckdb:vortex-compact 818955066 / 827333244 / -1.0% 989637716 / 965475274 / +2.5% 0.83 / 0.86 / -3.4%
fineweb_q04/duckdb:vortex-compact 869507976 / 912959876 / -4.8% 964441313 / 955473536 / +0.9% 0.90 / 0.96 / -5.6%
fineweb_q05/duckdb:vortex-compact 830361932 / 856914435 / -3.1% 935678859 / 1088744178 / -14.1% 0.89 / 0.79 / +12.8%
fineweb_q06/duckdb:vortex-compact 864626853 / 829457429 / +4.2% 1010381146 / 892485644 / +13.2% 0.86 / 0.93 / -7.9%
fineweb_q07/duckdb:vortex-compact 816575006 / 859041609 / -4.9% 871393253 / 875957637 / -0.5% 0.94 / 0.98 / -4.4%
fineweb_q08/duckdb:vortex-compact 231542322 / 249847424 / -7.3% 197623358 / 264461180 / -25.3% 1.17 / 0.94 / +24.0%
duckdb / parquet / ns (0.988x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 303802372 / 347757633 / -12.6% 399952488 / 387717723 / +3.2% 0.76 / 0.90 / -15.3%
fineweb_q01/duckdb:parquet 582525810 / 599438256 / -2.8% 568761314 / 855186256 / -33.5% 🟢 1.02 / 0.70 / +46.1%
fineweb_q02/duckdb:parquet 885277822 / 504451562 / +75.5% 🔴 794287430 / 629143961 / +26.2% 1.11 / 0.80 / +39.0%
fineweb_q03/duckdb:parquet 761735128 / 835054534 / -8.8% 855387378 / 867063180 / -1.3% 0.89 / 0.96 / -7.5%
fineweb_q04/duckdb:parquet 731536149 / 967710675 / -24.4% 775271646 / 849503149 / -8.7% 0.94 / 1.14 / -17.2%
fineweb_q05/duckdb:parquet 786434163 / 780866307 / +0.7% 783497008 / 802820304 / -2.4% 1.00 / 0.97 / +3.2%
fineweb_q06/duckdb:parquet 915294722 / 875789337 / +4.5% 1185717097 / 1017407312 / +16.5% 0.77 / 0.86 / -10.3%
fineweb_q07/duckdb:parquet 752319360 / 789883171 / -4.8% 834813038 / 742233550 / +12.5% 0.90 / 1.06 / -15.3%
fineweb_q08/duckdb:parquet 303268735 / 349300902 / -13.2% 346561321 / 422744286 / -18.0% 0.88 / 0.83 / +5.9%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93726750 / 92043500 / +1.8% 147870679 / 151580194 / -2.4% 0.63 / 0.61 / +4.4%
tpch_q02/datafusion:vortex-file-compressed 65641333 / 63682077 / +3.1% 95294573 / 96184174 / -0.9% 0.69 / 0.66 / +4.0%
tpch_q03/datafusion:vortex-file-compressed 63998839 / 63090347 / +1.4% 113016429 / 115394422 / -2.1% 0.57 / 0.55 / +3.6%
tpch_q04/datafusion:vortex-file-compressed 34856406 / 33985186 / +2.6% 75555680 / 71982526 / +5.0% 0.46 / 0.47 / -2.3%
tpch_q05/datafusion:vortex-file-compressed 118262980 / 118395123 / -0.1% 180729132 / 177436591 / +1.9% 0.65 / 0.67 / -1.9%
tpch_q06/datafusion:vortex-file-compressed 11245426 / 10308630 / +9.1% 59255598 / 56554682 / +4.8% 0.19 / 0.18 / +4.1%
tpch_q07/datafusion:vortex-file-compressed 134573997 / 134794510 / -0.2% 197905178 / 203764829 / -2.9% 0.68 / 0.66 / +2.8%
tpch_q08/datafusion:vortex-file-compressed 145464631 / 142437478 / +2.1% 216502980 / 210086476 / +3.1% 0.67 / 0.68 / -0.9%
tpch_q09/datafusion:vortex-file-compressed 186056821 / 183267619 / +1.5% 269737725 / 261723375 / +3.1% 0.69 / 0.70 / -1.5%
tpch_q10/datafusion:vortex-file-compressed 70471391 / 69671223 / +1.1% 139649407 / 136571368 / +2.3% 0.50 / 0.51 / -1.1%
tpch_q11/datafusion:vortex-file-compressed 43529625 / 43510396 / +0.0% 69544398 / 71136207 / -2.2% 0.63 / 0.61 / +2.3%
tpch_q12/datafusion:vortex-file-compressed 35479192 / 35026620 / +1.3% 80325606 / 76689305 / +4.7% 0.44 / 0.46 / -3.3%
tpch_q13/datafusion:vortex-file-compressed 47907404 / 47218359 / +1.5% 85813732 / 81717942 / +5.0% 0.56 / 0.58 / -3.4%
tpch_q14/datafusion:vortex-file-compressed 21406127 / 21304760 / +0.5% 88306215 / 85035332 / +3.8% 0.24 / 0.25 / -3.2%
tpch_q15/datafusion:vortex-file-compressed 34586620 / 34217194 / +1.1% 89042759 / 94268973 / -5.5% 0.39 / 0.36 / +7.0%
tpch_q16/datafusion:vortex-file-compressed 37332736 / 37056897 / +0.7% 63474134 / 70164773 / -9.5% 0.59 / 0.53 / +11.4%
tpch_q17/datafusion:vortex-file-compressed 175130009 / 178925133 / -2.1% 227904360 / 230330290 / -1.1% 0.77 / 0.78 / -1.1%
tpch_q18/datafusion:vortex-file-compressed 206317312 / 205091737 / +0.6% 276299496 / 266419558 / +3.7% 0.75 / 0.77 / -3.0%
tpch_q19/datafusion:vortex-file-compressed 30812440 / 29990915 / +2.7% 87154136 / 88705275 / -1.7% 0.35 / 0.34 / +4.6%
tpch_q20/datafusion:vortex-file-compressed 61301995 / 61069141 / +0.4% 117165841 / 119103087 / -1.6% 0.52 / 0.51 / +2.0%
tpch_q21/datafusion:vortex-file-compressed 179832099 / 181405270 / -0.9% 243970997 / 242806190 / +0.5% 0.74 / 0.75 / -1.3%
tpch_q22/datafusion:vortex-file-compressed 24963790 / 25066248 / -0.4% 55440282 / 53068617 / +4.5% 0.45 / 0.47 / -4.7%
datafusion / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 102222142 / 102061140 / +0.2% 150729946 / 153306481 / -1.7% 0.68 / 0.67 / +1.9%
tpch_q02/datafusion:vortex-compact 65668574 / 65603404 / +0.1% 93921281 / 97823608 / -4.0% 0.70 / 0.67 / +4.3%
tpch_q03/datafusion:vortex-compact 67865172 / 68350918 / -0.7% 115636696 / 116010810 / -0.3% 0.59 / 0.59 / -0.4%
tpch_q04/datafusion:vortex-compact 38789210 / 38389236 / +1.0% 70785021 / 64775422 / +9.3% 0.55 / 0.59 / -7.5%
tpch_q05/datafusion:vortex-compact 119875982 / 119258835 / +0.5% 176887114 / 176325778 / +0.3% 0.68 / 0.68 / +0.2%
tpch_q06/datafusion:vortex-compact 15894303 / 15789179 / +0.7% 50684541 / 54491516 / -7.0% 0.31 / 0.29 / +8.2%
tpch_q07/datafusion:vortex-compact 140797871 / 139820391 / +0.7% 192445802 / 193572122 / -0.6% 0.73 / 0.72 / +1.3%
tpch_q08/datafusion:vortex-compact 144742757 / 146440063 / -1.2% 210574860 / 214282297 / -1.7% 0.69 / 0.68 / +0.6%
tpch_q09/datafusion:vortex-compact 185638482 / 187419887 / -1.0% 246353398 / 259381958 / -5.0% 0.75 / 0.72 / +4.3%
tpch_q10/datafusion:vortex-compact 78768234 / 78480937 / +0.4% 124932083 / 123814360 / +0.9% 0.63 / 0.63 / -0.5%
tpch_q11/datafusion:vortex-compact 44063406 / 43419800 / +1.5% 68841866 / 65838958 / +4.6% 0.64 / 0.66 / -2.9%
tpch_q12/datafusion:vortex-compact 47774377 / 47326478 / +0.9% 78411120 / 78259931 / +0.2% 0.61 / 0.60 / +0.8%
tpch_q13/datafusion:vortex-compact 56639990 / 56568555 / +0.1% 97467823 / 87383030 / +11.5% 🔴 0.58 / 0.65 / -10.2%
tpch_q14/datafusion:vortex-compact 25390692 / 24695726 / +2.8% 85813231 / 85830957 / -0.0% 0.30 / 0.29 / +2.8%
tpch_q15/datafusion:vortex-compact 47146722 / 46973182 / +0.4% 104833585 / 98810091 / +6.1% 0.45 / 0.48 / -5.4%
tpch_q16/datafusion:vortex-compact 39462211 / 38597892 / +2.2% 67994352 / 64819329 / +4.9% 0.58 / 0.60 / -2.5%
tpch_q17/datafusion:vortex-compact 179504373 / 177049486 / +1.4% 222339796 / 219589787 / +1.3% 0.81 / 0.81 / +0.1%
tpch_q18/datafusion:vortex-compact 206264391 / 205857367 / +0.2% 262006580 / 259438234 / +1.0% 0.79 / 0.79 / -0.8%
tpch_q19/datafusion:vortex-compact 36402527 / 35225840 / +3.3% 85652288 / 79411832 / +7.9% 0.43 / 0.44 / -4.2%
tpch_q20/datafusion:vortex-compact 65927759 / 66012544 / -0.1% 111668320 / 121915372 / -8.4% 0.59 / 0.54 / +9.0%
tpch_q21/datafusion:vortex-compact 188008842 / 187196940 / +0.4% 246119555 / 235820731 / +4.4% 0.76 / 0.79 / -3.8%
tpch_q22/datafusion:vortex-compact 26875921 / 26251373 / +2.4% 53233724 / 55330306 / -3.8% 0.50 / 0.47 / +6.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87441907 / 87632170 / -0.2% 127461133 / 128273777 / -0.6% 0.69 / 0.68 / +0.4%
tpch_q02/datafusion:parquet 174044854 / 173211101 / +0.5% 200238669 / 195238956 / +2.6% 0.87 / 0.89 / -2.0%
tpch_q03/datafusion:parquet 135140792 / 135453832 / -0.2% 186460702 / 184631115 / +1.0% 0.72 / 0.73 / -1.2%
tpch_q04/datafusion:parquet 57453168 / 57498808 / -0.1% 94488651 / 90362330 / +4.6% 0.61 / 0.64 / -4.4%
tpch_q05/datafusion:parquet 167586389 / 167540255 / +0.0% 226471959 / 226749324 / -0.1% 0.74 / 0.74 / +0.2%
tpch_q06/datafusion:parquet 36712840 / 36707943 / +0.0% 76960772 / 81069623 / -5.1% 0.48 / 0.45 / +5.4%
tpch_q07/datafusion:parquet 215715116 / 218240015 / -1.2% 270577313 / 274945104 / -1.6% 0.80 / 0.79 / +0.4%
tpch_q08/datafusion:parquet 218831216 / 217902120 / +0.4% 288680764 / 286562565 / +0.7% 0.76 / 0.76 / -0.3%
tpch_q09/datafusion:parquet 308254823 / 309583230 / -0.4% 384458067 / 381929801 / +0.7% 0.80 / 0.81 / -1.1%
tpch_q10/datafusion:parquet 312254797 / 312690134 / -0.1% 369251178 / 382661300 / -3.5% 0.85 / 0.82 / +3.5%
tpch_q11/datafusion:parquet 127346821 / 127135469 / +0.2% 151976128 / 152249834 / -0.2% 0.84 / 0.84 / +0.3%
tpch_q12/datafusion:parquet 82884518 / 82689034 / +0.2% 123683832 / 123234118 / +0.4% 0.67 / 0.67 / -0.1%
tpch_q13/datafusion:parquet 211236681 / 210539929 / +0.3% 240550217 / 241726482 / -0.5% 0.88 / 0.87 / +0.8%
tpch_q14/datafusion:parquet 86032588 / 86951222 / -1.1% 183733785 / 193461915 / -5.0% 0.47 / 0.45 / +4.2%
tpch_q15/datafusion:parquet 107018400 / 106487691 / +0.5% 159515415 / 161158776 / -1.0% 0.67 / 0.66 / +1.5%
tpch_q16/datafusion:parquet 96605513 / 96580623 / +0.0% 120401194 / 124423167 / -3.2% 0.80 / 0.78 / +3.4%
tpch_q17/datafusion:parquet 212711445 / 215228793 / -1.2% 272716722 / 263224528 / +3.6% 0.78 / 0.82 / -4.6%
tpch_q18/datafusion:parquet 271526790 / 265637520 / +2.2% 312548441 / 315609818 / -1.0% 0.87 / 0.84 / +3.2%
tpch_q19/datafusion:parquet 108650808 / 108694843 / -0.0% 164864252 / 165435345 / -0.3% 0.66 / 0.66 / +0.3%
tpch_q20/datafusion:parquet 186090126 / 186123494 / -0.0% 248701520 / 239617039 / +3.8% 0.75 / 0.78 / -3.7%
tpch_q21/datafusion:parquet 244790953 / 246309755 / -0.6% 302437113 / 309883794 / -2.4% 0.81 / 0.79 / +1.8%
tpch_q22/datafusion:parquet 149701593 / 150369965 / -0.4% 174690193 / 175092754 / -0.2% 0.86 / 0.86 / -0.2%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33648901 / 33663907 / -0.0% 71081110 / 71878420 / -1.1% 0.47 / 0.47 / +1.1%
tpch_q02/duckdb:vortex-file-compressed 28531268 / 28854168 / -1.1% 41432599 / 42462103 / -2.4% 0.69 / 0.68 / +1.3%
tpch_q03/duckdb:vortex-file-compressed 53058618 / 53095755 / -0.1% 103162641 / 104948653 / -1.7% 0.51 / 0.51 / +1.7%
tpch_q04/duckdb:vortex-file-compressed 51706855 / 52429609 / -1.4% 90278978 / 88433550 / +2.1% 0.57 / 0.59 / -3.4%
tpch_q05/duckdb:vortex-file-compressed 69502142 / 68546889 / +1.4% 113981582 / 112384460 / +1.4% 0.61 / 0.61 / -0.0%
tpch_q06/duckdb:vortex-file-compressed 15547236 / 15363881 / +1.2% 50983586 / 52612171 / -3.1% 0.30 / 0.29 / +4.4%
tpch_q07/duckdb:vortex-file-compressed 56290808 / 55802225 / +0.9% 110949212 / 105982204 / +4.7% 0.51 / 0.53 / -3.6%
tpch_q08/duckdb:vortex-file-compressed 84579959 / 84981315 / -0.5% 132251733 / 134910394 / -2.0% 0.64 / 0.63 / +1.5%
tpch_q09/duckdb:vortex-file-compressed 102763704 / 103464523 / -0.7% 157441039 / 149489392 / +5.3% 0.65 / 0.69 / -5.7%
tpch_q10/duckdb:vortex-file-compressed 95312197 / 95872096 / -0.6% 149263489 / 149685599 / -0.3% 0.64 / 0.64 / -0.3%
tpch_q11/duckdb:vortex-file-compressed 13106776 / 13947525 / -6.0% 29490792 / 28970039 / +1.8% 0.44 / 0.48 / -7.7%
tpch_q12/duckdb:vortex-file-compressed 45309367 / 45021755 / +0.6% 83506375 / 80236732 / +4.1% 0.54 / 0.56 / -3.3%
tpch_q13/duckdb:vortex-file-compressed 72228867 / 71235191 / +1.4% 103238038 / 101404887 / +1.8% 0.70 / 0.70 / -0.4%
tpch_q14/duckdb:vortex-file-compressed 28429390 / 28845682 / -1.4% 71274105 / 74248737 / -4.0% 0.40 / 0.39 / +2.7%
tpch_q15/duckdb:vortex-file-compressed 25479580 / 25092367 / +1.5% 63047132 / 63770461 / -1.1% 0.40 / 0.39 / +2.7%
tpch_q16/duckdb:vortex-file-compressed 49064848 / 49351462 / -0.6% 58763099 / 59196287 / -0.7% 0.83 / 0.83 / +0.2%
tpch_q17/duckdb:vortex-file-compressed 35626149 / 35794576 / -0.5% 68845250 / 69138237 / -0.4% 0.52 / 0.52 / -0.0%
tpch_q18/duckdb:vortex-file-compressed 107335921 / 107642757 / -0.3% 123166114 / 120815989 / +1.9% 0.87 / 0.89 / -2.2%
tpch_q19/duckdb:vortex-file-compressed 28634405 / 28095874 / +1.9% 74441825 / 75185721 / -1.0% 0.38 / 0.37 / +2.9%
tpch_q20/duckdb:vortex-file-compressed 42356213 / 42170201 / +0.4% 91623008 / 91323135 / +0.3% 0.46 / 0.46 / +0.1%
tpch_q21/duckdb:vortex-file-compressed 94589361 / 95069178 / -0.5% 148780877 / 151187861 / -1.6% 0.64 / 0.63 / +1.1%
tpch_q22/duckdb:vortex-file-compressed 32995260 / 32731075 / +0.8% 48290092 / 48512257 / -0.5% 0.68 / 0.67 / +1.3%
duckdb / vortex-compact / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 47857125 / 47141814 / +1.5% 76432623 / 77714110 / -1.6% 0.63 / 0.61 / +3.2%
tpch_q02/duckdb:vortex-compact 31514324 / 30894149 / +2.0% 45498833 / 44811240 / +1.5% 0.69 / 0.69 / +0.5%
tpch_q03/duckdb:vortex-compact 58827009 / 58389511 / +0.7% 97481087 / 97036963 / +0.5% 0.60 / 0.60 / +0.3%
tpch_q04/duckdb:vortex-compact 54059261 / 54093167 / -0.1% 82561459 / 84186467 / -1.9% 0.65 / 0.64 / +1.9%
tpch_q05/duckdb:vortex-compact 71133014 / 70938564 / +0.3% 105055718 / 102564168 / +2.4% 0.68 / 0.69 / -2.1%
tpch_q06/duckdb:vortex-compact 20279918 / 20041960 / +1.2% 51422430 / 51531278 / -0.2% 0.39 / 0.39 / +1.4%
tpch_q07/duckdb:vortex-compact 64048895 / 63169962 / +1.4% 109719768 / 106032679 / +3.5% 0.58 / 0.60 / -2.0%
tpch_q08/duckdb:vortex-compact 89243704 / 87836636 / +1.6% 123886364 / 123736119 / +0.1% 0.72 / 0.71 / +1.5%
tpch_q09/duckdb:vortex-compact 109273311 / 109008464 / +0.2% 154195819 / 149730313 / +3.0% 0.71 / 0.73 / -2.7%
tpch_q10/duckdb:vortex-compact 104656641 / 104096918 / +0.5% 145651001 / 142767756 / +2.0% 0.72 / 0.73 / -1.5%
tpch_q11/duckdb:vortex-compact 13985193 / 14547827 / -3.9% 29224455 / 27621753 / +5.8% 0.48 / 0.53 / -9.1%
tpch_q12/duckdb:vortex-compact 59933508 / 59192449 / +1.3% 84070990 / 80624960 / +4.3% 0.71 / 0.73 / -2.9%
tpch_q13/duckdb:vortex-compact 78182883 / 76408336 / +2.3% 102263549 / 105545992 / -3.1% 0.76 / 0.72 / +5.6%
tpch_q14/duckdb:vortex-compact 32913480 / 33098290 / -0.6% 71449030 / 69445180 / +2.9% 0.46 / 0.48 / -3.3%
tpch_q15/duckdb:vortex-compact 31539252 / 31252223 / +0.9% 65998849 / 65934878 / +0.1% 0.48 / 0.47 / +0.8%
tpch_q16/duckdb:vortex-compact 50621795 / 50669650 / -0.1% 59220008 / 59031823 / +0.3% 0.85 / 0.86 / -0.4%
tpch_q17/duckdb:vortex-compact 36944870 / 36764467 / +0.5% 64552883 / 65075451 / -0.8% 0.57 / 0.56 / +1.3%
tpch_q18/duckdb:vortex-compact 109885286 / 107253998 / +2.5% 119065698 / 120473311 / -1.2% 0.92 / 0.89 / +3.7%
tpch_q19/duckdb:vortex-compact 35892398 / 34065760 / +5.4% 74440130 / 80010645 / -7.0% 0.48 / 0.43 / +13.2%
tpch_q20/duckdb:vortex-compact 52273160 / 51650823 / +1.2% 96482730 / 97885747 / -1.4% 0.54 / 0.53 / +2.7%
tpch_q21/duckdb:vortex-compact 105861273 / 106375003 / -0.5% 150148802 / 147793253 / +1.6% 0.71 / 0.72 / -2.0%
tpch_q22/duckdb:vortex-compact 35764057 / 35585248 / +0.5% 50858276 / 51262915 / -0.8% 0.70 / 0.69 / +1.3%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67693652 / 67858199 / -0.2% 88113909 / 88201534 / -0.1% 0.77 / 0.77 / -0.1%
tpch_q02/duckdb:parquet 87151927 / 87302111 / -0.2% 96875039 / 97048535 / -0.2% 0.90 / 0.90 / +0.0%
tpch_q03/duckdb:parquet 110403678 / 110197077 / +0.2% 139027055 / 139956987 / -0.7% 0.79 / 0.79 / +0.9%
tpch_q04/duckdb:parquet 76845321 / 76472178 / +0.5% 97511342 / 98598449 / -1.1% 0.79 / 0.78 / +1.6%
tpch_q05/duckdb:parquet 123227481 / 123390735 / -0.1% 156936261 / 157758624 / -0.5% 0.79 / 0.78 / +0.4%
tpch_q06/duckdb:parquet 35750747 / 35245348 / +1.4% 58295574 / 58749263 / -0.8% 0.61 / 0.60 / +2.2%
tpch_q07/duckdb:parquet 117422908 / 118054396 / -0.5% 153036685 / 152945410 / +0.1% 0.77 / 0.77 / -0.6%
tpch_q08/duckdb:parquet 147118877 / 147787853 / -0.5% 184932679 / 190960413 / -3.2% 0.80 / 0.77 / +2.8%
tpch_q09/duckdb:parquet 237229267 / 237421107 / -0.1% 275068509 / 279631150 / -1.6% 0.86 / 0.85 / +1.6%
tpch_q10/duckdb:parquet 312304801 / 312650409 / -0.1% 340385121 / 337540860 / +0.8% 0.92 / 0.93 / -0.9%
tpch_q11/duckdb:parquet 43655250 / 43469706 / +0.4% 50539189 / 51621698 / -2.1% 0.86 / 0.84 / +2.6%
tpch_q12/duckdb:parquet 70161988 / 70191502 / -0.0% 89088104 / 91333964 / -2.5% 0.79 / 0.77 / +2.5%
tpch_q13/duckdb:parquet 293717167 / 293014775 / +0.2% 309269722 / 309438557 / -0.1% 0.95 / 0.95 / +0.3%
tpch_q14/duckdb:parquet 101322906 / 101043705 / +0.3% 133988815 / 137303290 / -2.4% 0.76 / 0.74 / +2.8%
tpch_q15/duckdb:parquet 58352600 / 57637561 / +1.2% 85012957 / 86791381 / -2.0% 0.69 / 0.66 / +3.4%
tpch_q16/duckdb:parquet 99979029 / 100691410 / -0.7% 107217899 / 106782139 / +0.4% 0.93 / 0.94 / -1.1%
tpch_q17/duckdb:parquet 80727890 / 89149489 / -9.4% 109625583 / 117883071 / -7.0% 0.74 / 0.76 / -2.6%
tpch_q18/duckdb:parquet 155986953 / 158933954 / -1.9% 178216651 / 174214078 / +2.3% 0.88 / 0.91 / -4.1%
tpch_q19/duckdb:parquet 98349218 / 95757751 / +2.7% 126265555 / 129362173 / -2.4% 0.78 / 0.74 / +5.2%
tpch_q20/duckdb:parquet 146464612 / 146530463 / -0.0% 182053176 / 184126150 / -1.1% 0.80 / 0.80 / +1.1%
tpch_q21/duckdb:parquet 254565669 / 252190147 / +0.9% 276706289 / 277913851 / -0.4% 0.92 / 0.91 / +1.4%
tpch_q22/duckdb:parquet 168407316 / 168477561 / -0.0% 179801996 / 181374538 / -0.9% 0.94 / 0.93 / +0.8%
duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 23631686 / 23521616 / +0.5% 54393307 / 53710441 / +1.3% 0.43 / 0.44 / -0.8%
tpch_q02/duckdb:duckdb 20121701 / 20893128 / -3.7% 34391640 / 33999571 / +1.2% 0.59 / 0.61 / -4.8%
tpch_q03/duckdb:duckdb 46284603 / 45356701 / +2.0% 77443865 / 78626636 / -1.5% 0.60 / 0.58 / +3.6%
tpch_q04/duckdb:duckdb 56053868 / 55489704 / +1.0% 80499547 / 81180810 / -0.8% 0.70 / 0.68 / +1.9%
tpch_q05/duckdb:duckdb 59724406 / 59635661 / +0.1% 94168254 / 94605310 / -0.5% 0.63 / 0.63 / +0.6%
tpch_q06/duckdb:duckdb 14656622 / 14509452 / +1.0% 43985881 / 44230849 / -0.6% 0.33 / 0.33 / +1.6%
tpch_q07/duckdb:duckdb 43199361 / 43415300 / -0.5% 79795917 / 80213056 / -0.5% 0.54 / 0.54 / +0.0%
tpch_q08/duckdb:duckdb 66365845 / 65495698 / +1.3% 105702849 / 106091884 / -0.4% 0.63 / 0.62 / +1.7%
tpch_q09/duckdb:duckdb 77746980 / 77136099 / +0.8% 116155291 / 115500281 / +0.6% 0.67 / 0.67 / +0.2%
tpch_q10/duckdb:duckdb 91497958 / 92396752 / -1.0% 123896920 / 123041729 / +0.7% 0.74 / 0.75 / -1.7%
tpch_q11/duckdb:duckdb 9791005 / 9874854 / -0.8% 19075348 / 17648389 / +8.1% 0.51 / 0.56 / -8.3%
tpch_q12/duckdb:duckdb 39061092 / 39561700 / -1.3% 68887569 / 68051807 / +1.2% 0.57 / 0.58 / -2.5%
tpch_q13/duckdb:duckdb 99599183 / 101707046 / -2.1% 113073927 / 114372396 / -1.1% 0.88 / 0.89 / -0.9%
tpch_q14/duckdb:duckdb 32363454 / 32292707 / +0.2% 67485030 / 63464471 / +6.3% 0.48 / 0.51 / -5.8%
tpch_q15/duckdb:duckdb 24473632 / 25185016 / -2.8% 55587141 / 56173206 / -1.0% 0.44 / 0.45 / -1.8%
tpch_q16/duckdb:duckdb 44809176 / 44865498 / -0.1% 52726906 / 51738791 / +1.9% 0.85 / 0.87 / -2.0%
tpch_q17/duckdb:duckdb 25925197 / 26171140 / -0.9% 58356077 / 58541084 / -0.3% 0.44 / 0.45 / -0.6%
tpch_q18/duckdb:duckdb 72585707 / 72738363 / -0.2% 92195462 / 91777872 / +0.5% 0.79 / 0.79 / -0.7%
tpch_q19/duckdb:duckdb 29040073 / 29345575 / -1.0% 66884265 / 64763575 / +3.3% 0.43 / 0.45 / -4.2%
tpch_q20/duckdb:duckdb 37757372 / 37495432 / +0.7% 79384137 / 80748698 / -1.7% 0.48 / 0.46 / +2.4%
tpch_q21/duckdb:duckdb 63920724 / 63766074 / +0.2% 94207498 / 94181546 / +0.0% 0.68 / 0.68 / +0.2%
tpch_q22/duckdb:duckdb 35535466 / 35461097 / +0.2% 46244767 / 46175065 / +0.2% 0.77 / 0.77 / +0.1%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 51907794 / 51881849 / +0.1% 77339798 / 76675639 / +0.9% 0.67 / 0.68 / -0.8%
appian_q02/datafusion:vortex-file-compressed 226803277 / 226719195 / +0.0% 266868225 / 272440953 / -2.0% 0.85 / 0.83 / +2.1%
appian_q03/datafusion:vortex-file-compressed 142806886 / 141924574 / +0.6% 194807694 / 188337212 / +3.4% 0.73 / 0.75 / -2.7%
appian_q04/datafusion:vortex-file-compressed 9598445204 / 9628010187 / -0.3% 9708322711 / 9668042261 / +0.4% 0.99 / 1.00 / -0.7%
appian_q05/datafusion:vortex-file-compressed 133142985 / 133496342 / -0.3% 170582837 / 169533877 / +0.6% 0.78 / 0.79 / -0.9%
appian_q06/datafusion:vortex-file-compressed 139300138 / 138680340 / +0.4% 162976463 / 170263377 / -4.3% 0.85 / 0.81 / +4.9%
appian_q07/datafusion:vortex-file-compressed 153211319 / 157737223 / -2.9% 199880471 / 193216020 / +3.4% 0.77 / 0.82 / -6.1%
appian_q08/datafusion:vortex-file-compressed 522447554 / 518421159 / +0.8% 575903579 / 571836393 / +0.7% 0.91 / 0.91 / +0.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72689964 / 72196406 / +0.7% 93697451 / 89895670 / +4.2% 0.78 / 0.80 / -3.4%
appian_q02/datafusion:parquet 290214398 / 288784600 / +0.5% 334504929 / 334245366 / +0.1% 0.87 / 0.86 / +0.4%
appian_q03/datafusion:parquet 185087761 / 183695110 / +0.8% 229258166 / 230473737 / -0.5% 0.81 / 0.80 / +1.3%
appian_q04/datafusion:parquet 9667957172 / 9675041101 / -0.1% 9786549410 / 9713593083 / +0.8% 0.99 / 1.00 / -0.8%
appian_q05/datafusion:parquet 191033927 / 191593677 / -0.3% 223320401 / 223024401 / +0.1% 0.86 / 0.86 / -0.4%
appian_q06/datafusion:parquet 165356362 / 165455388 / -0.1% 190065250 / 189926631 / +0.1% 0.87 / 0.87 / -0.1%
appian_q07/datafusion:parquet 203922731 / 204852899 / -0.5% 237105541 / 240717968 / -1.5% 0.86 / 0.85 / +1.1%
appian_q08/datafusion:parquet 629775649 / 626689930 / +0.5% 682813644 / 690921419 / -1.2% 0.92 / 0.91 / +1.7%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 84275547 / 83412506 / +1.0% 96681296 / 98672871 / -2.0% 0.87 / 0.85 / +3.1%
appian_q02/duckdb:vortex-file-compressed 230704720 / 230829246 / -0.1% 259417576 / 255719900 / +1.4% 0.89 / 0.90 / -1.5%
appian_q03/duckdb:vortex-file-compressed 113658331 / 112862542 / +0.7% 134831150 / 131095702 / +2.8% 0.84 / 0.86 / -2.1%
appian_q04/duckdb:vortex-file-compressed 614874425 / 598686654 / +2.7% 605364812 / 598834037 / +1.1% 1.02 / 1.00 / +1.6%
appian_q05/duckdb:vortex-file-compressed 116413381 / 119722750 / -2.8% 132852230 / 136434446 / -2.6% 0.88 / 0.88 / -0.1%
appian_q06/duckdb:vortex-file-compressed 200196008 / 196634648 / +1.8% 200402978 / 209171341 / -4.2% 1.00 / 0.94 / +6.3%
appian_q07/duckdb:vortex-file-compressed 116493497 / 117412550 / -0.8% 131133260 / 131560183 / -0.3% 0.89 / 0.89 / -0.5%
appian_q08/duckdb:vortex-file-compressed 336460990 / 342343570 / -1.7% 347993672 / 350191039 / -0.6% 0.97 / 0.98 / -1.1%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 94396819 / 96118806 / -1.8% 101285190 / 101650526 / -0.4% 0.93 / 0.95 / -1.4%
appian_q02/duckdb:parquet 242870309 / 245841042 / -1.2% 252164785 / 251755562 / +0.2% 0.96 / 0.98 / -1.4%
appian_q03/duckdb:parquet 130193676 / 130858906 / -0.5% 143740576 / 135384857 / +6.2% 0.91 / 0.97 / -6.3%
appian_q04/duckdb:parquet 484788676 / 489545687 / -1.0% 485848837 / 484306934 / +0.3% 1.00 / 1.01 / -1.3%
appian_q05/duckdb:parquet 132156796 / 130302088 / +1.4% 136100363 / 141597742 / -3.9% 0.97 / 0.92 / +5.5%
appian_q06/duckdb:parquet 114741455 / 114749091 / -0.0% 122979150 / 125651679 / -2.1% 0.93 / 0.91 / +2.2%
appian_q07/duckdb:parquet 106848425 / 108300366 / -1.3% 116281052 / 114874743 / +1.2% 0.92 / 0.94 / -2.5%
appian_q08/duckdb:parquet 360099767 / 362054321 / -0.5% 344611249 / 353886131 / -2.6% 1.04 / 1.02 / +2.1%
duckdb / duckdb / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 77966413 / 79347572 / -1.7% 90569752 / 92028944 / -1.6% 0.86 / 0.86 / -0.2%
appian_q02/duckdb:duckdb 214645327 / 217159814 / -1.2% 229583259 / 232283354 / -1.2% 0.93 / 0.93 / +0.0%
appian_q03/duckdb:duckdb 83282449 / 84110870 / -1.0% 93181151 / 92878914 / +0.3% 0.89 / 0.91 / -1.3%
appian_q04/duckdb:duckdb 549201316 / 549498076 / -0.1% 571080633 / 556300959 / +2.7% 0.96 / 0.99 / -2.6%
appian_q05/duckdb:duckdb 107081852 / 107990727 / -0.8% 122133373 / 120414975 / +1.4% 0.88 / 0.90 / -2.2%
appian_q06/duckdb:duckdb 185417170 / 188035784 / -1.4% 196067223 / 191375022 / +2.5% 0.95 / 0.98 / -3.8%
appian_q07/duckdb:duckdb 86850057 / 88414067 / -1.8% 100937485 / 100774549 / +0.2% 0.86 / 0.88 / -1.9%
appian_q08/duckdb:duckdb 318605325 / 306390622 / +4.0% 318786845 / 328853086 / -3.1% 1.00 / 0.93 / +7.3%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Engines: DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 14806938 / 14512896 / +2.0% 30213813 / 30585190 / -1.2% 0.49 / 0.47 / +3.3%
job_q02/duckdb:vortex-file-compressed 25547535 / 25279009 / +1.1% 39118489 / 39180390 / -0.2% 0.65 / 0.65 / +1.2%
job_q03/duckdb:vortex-file-compressed 16174340 / 15684984 / +3.1% 31151967 / 29642376 / +5.1% 0.52 / 0.53 / -1.9%
job_q04/duckdb:vortex-file-compressed 27812124 / 27355156 / +1.7% 41651260 / 41736345 / -0.2% 0.67 / 0.66 / +1.9%
job_q05/duckdb:vortex-file-compressed 20021439 / 19132450 / +4.6% 36000884 / 35108023 / +2.5% 0.56 / 0.54 / +2.1%
job_q06/duckdb:vortex-file-compressed 16336867 / 15881330 / +2.9% 32699544 / 32198335 / +1.6% 0.50 / 0.49 / +1.3%
job_q07/duckdb:vortex-file-compressed 9810282 / 9650630 / +1.7% 27223546 / 26137351 / +4.2% 0.36 / 0.37 / -2.4%
job_q08/duckdb:vortex-file-compressed 22076306 / 21520526 / +2.6% 37251491 / 37242104 / +0.0% 0.59 / 0.58 / +2.6%
job_q09/duckdb:vortex-file-compressed 66331190 / 66789266 / -0.7% 98017121 / 100323227 / -2.3% 0.68 / 0.67 / +1.7%
job_q10/duckdb:vortex-file-compressed 43161222 / 43256803 / -0.2% 75188105 / 75170494 / +0.0% 0.57 / 0.58 / -0.2%
job_q100/duckdb:vortex-file-compressed 40659746 / 39713810 / +2.4% 78756107 / 77702186 / +1.4% 0.52 / 0.51 / +1.0%
job_q101/duckdb:vortex-file-compressed 38683325 / 38693264 / -0.0% 75203495 / 75617109 / -0.5% 0.51 / 0.51 / +0.5%
job_q102/duckdb:vortex-file-compressed 72589856 / 72015755 / +0.8% 114093939 / 113839951 / +0.2% 0.64 / 0.63 / +0.6%
job_q103/duckdb:vortex-file-compressed 50365168 / 50619990 / -0.5% 89824180 / 89840414 / -0.0% 0.56 / 0.56 / -0.5%
job_q104/duckdb:vortex-file-compressed 39287874 / 39034404 / +0.6% 76684763 / 77721989 / -1.3% 0.51 / 0.50 / +2.0%
job_q105/duckdb:vortex-file-compressed 70406974 / 69870598 / +0.8% 109243438 / 107085272 / +2.0% 0.64 / 0.65 / -1.2%
job_q106/duckdb:vortex-file-compressed 64110820 / 63079404 / +1.6% 97236420 / 98619196 / -1.4% 0.66 / 0.64 / +3.1%
job_q107/duckdb:vortex-file-compressed 44133513 / 43619196 / +1.2% 85603696 / 85352295 / +0.3% 0.52 / 0.51 / +0.9%
job_q108/duckdb:vortex-file-compressed 64798392 / 64288212 / +0.8% 103787056 / 102795763 / +1.0% 0.62 / 0.63 / -0.2%
job_q109/duckdb:vortex-file-compressed 11238239 / 10920684 / +2.9% 24991113 / 24272020 / +3.0% 0.45 / 0.45 / -0.1%
job_q11/duckdb:vortex-file-compressed 38946382 / 38407476 / +1.4% 72782225 / 69137300 / +5.3% 0.54 / 0.56 / -3.7%
job_q110/duckdb:vortex-file-compressed 17867793 / 17568040 / +1.7% 32001857 / 31188232 / +2.6% 0.56 / 0.56 / -0.9%
job_q111/duckdb:vortex-file-compressed 29064778 / 29363232 / -1.0% 47846645 / 45709746 / +4.7% 0.61 / 0.64 / -5.4%
job_q112/duckdb:vortex-file-compressed 28703438 / 29020490 / -1.1% 47448358 / 47112762 / +0.7% 0.60 / 0.62 / -1.8%
job_q113/duckdb:vortex-file-compressed 32264627 / 31617095 / +2.0% 49778485 / 50970425 / -2.3% 0.65 / 0.62 / +4.5%
job_q12/duckdb:vortex-file-compressed 38010120 / 38190184 / -0.5% 55950757 / 55799058 / +0.3% 0.68 / 0.68 / -0.7%
job_q13/duckdb:vortex-file-compressed 13996378 / 13687295 / +2.3% 31873260 / 32060310 / -0.6% 0.44 / 0.43 / +2.9%
job_q14/duckdb:vortex-file-compressed 47883888 / 47904960 / -0.0% 67452803 / 66261933 / +1.8% 0.71 / 0.72 / -1.8%
job_q15/duckdb:vortex-file-compressed 25275951 / 25107385 / +0.7% 58120982 / 56342180 / +3.2% 0.43 / 0.45 / -2.4%
job_q16/duckdb:vortex-file-compressed 24329742 / 24882933 / -2.2% 55603280 / 55949933 / -0.6% 0.44 / 0.44 / -1.6%
job_q17/duckdb:vortex-file-compressed 35636907 / 34495162 / +3.3% 67134000 / 67077142 / +0.1% 0.53 / 0.51 / +3.2%
job_q18/duckdb:vortex-file-compressed 37992444 / 38715610 / -1.9% 55272633 / 53867212 / +2.6% 0.69 / 0.72 / -4.4%
job_q19/duckdb:vortex-file-compressed 19032192 / 18831204 / +1.1% 41198814 / 41497145 / -0.7% 0.46 / 0.45 / +1.8%
job_q20/duckdb:vortex-file-compressed 18033656 / 19522933 / -7.6% 41594424 / 42075687 / -1.1% 0.43 / 0.46 / -6.6%
job_q21/duckdb:vortex-file-compressed 38847882 / 39291897 / -1.1% 62745704 / 65005258 / -3.5% 0.62 / 0.60 / +2.4%
job_q22/duckdb:vortex-file-compressed 30416074 / 29840622 / +1.9% 55493335 / 54535854 / +1.8% 0.55 / 0.55 / +0.2%
job_q23/duckdb:vortex-file-compressed 67002100 / 67980514 / -1.4% 97866580 / 95014517 / +3.0% 0.68 / 0.72 / -4.3%
job_q24/duckdb:vortex-file-compressed 41495576 / 41452676 / +0.1% 73327964 / 72313870 / +1.4% 0.57 / 0.57 / -1.3%
job_q25/duckdb:vortex-file-compressed 34985690 / 34882639 / +0.3% 64556283 / 64711341 / -0.2% 0.54 / 0.54 / +0.5%
job_q26/duckdb:vortex-file-compressed 87656410 / 87771516 / -0.1% 120766353 / 122973548 / -1.8% 0.73 / 0.71 / +1.7%
job_q27/duckdb:vortex-file-compressed 28537448 / 28412061 / +0.4% 54574122 / 54835452 / -0.5% 0.52 / 0.52 / +0.9%
job_q28/duckdb:vortex-file-compressed 24020960 / 22946250 / +4.7% 52326858 / 51229149 / +2.1% 0.46 / 0.45 / +2.5%
job_q29/duckdb:vortex-file-compressed 84282600 / 84509524 / -0.3% 103846537 / 102702698 / +1.1% 0.81 / 0.82 / -1.4%
job_q30/duckdb:vortex-file-compressed 68745468 / 68224150 / +0.8% 85219681 / 83850202 / +1.6% 0.81 / 0.81 / -0.9%
job_q31/duckdb:vortex-file-compressed 61134600 / 59965494 / +1.9% 96762137 / 95589224 / +1.2% 0.63 / 0.63 / +0.7%
job_q32/duckdb:vortex-file-compressed 47767373 / 46789252 / +2.1% 84545613 / 82616179 / +2.3% 0.56 / 0.57 / -0.2%
job_q33/duckdb:vortex-file-compressed 62321070 / 62069352 / +0.4% 89116644 / 89910287 / -0.9% 0.70 / 0.69 / +1.3%
job_q34/duckdb:vortex-file-compressed 126630884 / 126312092 / +0.3% 155058756 / 155214927 / -0.1% 0.82 / 0.81 / +0.4%
job_q35/duckdb:vortex-file-compressed 26900576 / 26658052 / +0.9% 54879836 / 52079890 / +5.4% 0.49 / 0.51 / -4.2%
job_q36/duckdb:vortex-file-compressed 20898744 / 21094538 / -0.9% 47850369 / 47233499 / +1.3% 0.44 / 0.45 / -2.2%
job_q37/duckdb:vortex-file-compressed 50183565 / 50099854 / +0.2% 83504638 / 83696141 / -0.2% 0.60 / 0.60 / +0.4%
job_q38/duckdb:vortex-file-compressed 18667550 / 18751450 / -0.4% 35771522 / 35866469 / -0.3% 0.52 / 0.52 / -0.2%
job_q39/duckdb:vortex-file-compressed 15721580 / 15601520 / +0.8% 32166750 / 30388497 / +5.9% 0.49 / 0.51 / -4.8%
job_q40/duckdb:vortex-file-compressed 95713871 / 94873914 / +0.9% 115820786 / 112976605 / +2.5% 0.83 / 0.84 / -1.6%
job_q41/duckdb:vortex-file-compressed 264727180 / 254178044 / +4.2% 284095967 / 276713148 / +2.7% 0.93 / 0.92 / +1.4%
job_q42/duckdb:vortex-file-compressed 30969961 / 30554256 / +1.4% 51598672 / 49864310 / +3.5% 0.60 / 0.61 / -2.0%
job_q43/duckdb:vortex-file-compressed 17825439 / 17472152 / +2.0% 38232950 / 37110980 / +3.0% 0.47 / 0.47 / -1.0%
job_q44/duckdb:vortex-file-compressed 46576058 / 45564116 / +2.2% 68652501 / 67865197 / +1.2% 0.68 / 0.67 / +1.0%
job_q45/duckdb:vortex-file-compressed 67905765 / 67584052 / +0.5% 87523400 / 88471148 / -1.1% 0.78 / 0.76 / +1.6%
job_q46/duckdb:vortex-file-compressed 22003849 / 22033661 / -0.1% 41994442 / 40026305 / +4.9% 0.52 / 0.55 / -4.8%
job_q47/duckdb:vortex-file-compressed 18842218 / 19049664 / -1.1% 37350459 / 38660384 / -3.4% 0.50 / 0.49 / +2.4%
job_q48/duckdb:vortex-file-compressed 72657960 / 72139874 / +0.7% 87169701 / 90079001 / -3.2% 0.83 / 0.80 / +4.1%
job_q49/duckdb:vortex-file-compressed 50591833 / 50832452 / -0.5% 71058153 / 70231172 / +1.2% 0.71 / 0.72 / -1.6%
job_q50/duckdb:vortex-file-compressed 37090701 / 37472100 / -1.0% 55081188 / 57073422 / -3.5% 0.67 / 0.66 / +2.6%
job_q51/duckdb:vortex-file-compressed 57572934 / 56597268 / +1.7% 77059596 / 78400731 / -1.7% 0.75 / 0.72 / +3.5%
job_q52/duckdb:vortex-file-compressed 47549548 / 47188576 / +0.8% 71527174 / 72156069 / -0.9% 0.66 / 0.65 / +1.7%
job_q53/duckdb:vortex-file-compressed 44557306 / 43708835 / +1.9% 70668151 / 69342287 / +1.9% 0.63 / 0.63 / +0.0%
job_q54/duckdb:vortex-file-compressed 59178791 / 57068233 / +3.7% 79353714 / 81459369 / -2.6% 0.75 / 0.70 / +6.4%
job_q55/duckdb:vortex-file-compressed 56405836 / 55981494 / +0.8% 79114150 / 79524878 / -0.5% 0.71 / 0.70 / +1.3%
job_q56/duckdb:vortex-file-compressed 36469734 / 36463347 / +0.0% 65507166 / 66040375 / -0.8% 0.56 / 0.55 / +0.8%
job_q57/duckdb:vortex-file-compressed 84026082 / 83856324 / +0.2% 104055919 / 105608376 / -1.5% 0.81 / 0.79 / +1.7%
job_q58/duckdb:vortex-file-compressed 65390024 / 65572341 / -0.3% 94461817 / 95994598 / -1.6% 0.69 / 0.68 / +1.3%
job_q59/duckdb:vortex-file-compressed 61539631 / 61104180 / +0.7% 91595563 / 90507606 / +1.2% 0.67 / 0.68 / -0.5%
job_q60/duckdb:vortex-file-compressed 41539044 / 41830715 / -0.7% 66483748 / 67083533 / -0.9% 0.62 / 0.62 / +0.2%
job_q61/duckdb:vortex-file-compressed 33091414 / 32807488 / +0.9% 60303969 / 59235705 / +1.8% 0.55 / 0.55 / -0.9%
job_q62/duckdb:vortex-file-compressed 31483172 / 31053755 / +1.4% 60773683 / 59645441 / +1.9% 0.52 / 0.52 / -0.5%
job_q63/duckdb:vortex-file-compressed 34638263 / 34483736 / +0.4% 62579618 / 62896176 / -0.5% 0.55 / 0.55 / +1.0%
job_q64/duckdb:vortex-file-compressed 56694910 / 56891057 / -0.3% 86317303 / 86776333 / -0.5% 0.66 / 0.66 / +0.2%
job_q65/duckdb:vortex-file-compressed 48361748 / 49707278 / -2.7% 75361335 / 77040494 / -2.2% 0.64 / 0.65 / -0.5%
job_q66/duckdb:vortex-file-compressed 48253594 / 48386506 / -0.3% 80256706 / 80395662 / -0.2% 0.60 / 0.60 / -0.1%
job_q67/duckdb:vortex-file-compressed 35371625 / 34877657 / +1.4% 65657582 / 69764241 / -5.9% 0.54 / 0.50 / +7.8%
job_q68/duckdb:vortex-file-compressed 55384124 / 54549090 / +1.5% 92113932 / 91443431 / +0.7% 0.60 / 0.60 / +0.8%
job_q69/duckdb:vortex-file-compressed 75050314 / 74488950 / +0.8% 109255701 / 109717675 / -0.4% 0.69 / 0.68 / +1.2%
job_q70/duckdb:vortex-file-compressed 43502960 / 42861708 / +1.5% 75651636 / 74625526 / +1.4% 0.58 / 0.57 / +0.1%
job_q71/duckdb:vortex-file-compressed 65864460 / 65184605 / +1.0% 97832075 / 98825748 / -1.0% 0.67 / 0.66 / +2.1%
job_q72/duckdb:vortex-file-compressed 139341000 / 137970708 / +1.0% 166812741 / 169801068 / -1.8% 0.84 / 0.81 / +2.8%
job_q73/duckdb:vortex-file-compressed 84155644 / 80286808 / +4.8% 119980169 / 118080393 / +1.6% 0.70 / 0.68 / +3.2%
job_q74/duckdb:vortex-file-compressed 66660830 / 66982660 / -0.5% 109621988 / 109061899 / +0.5% 0.61 / 0.61 / -1.0%
job_q75/duckdb:vortex-file-compressed 65273404 / 64895620 / +0.6% 106896100 / 109274423 / -2.2% 0.61 / 0.59 / +2.8%
job_q76/duckdb:vortex-file-compressed 26236099 / 25570408 / +2.6% 51333575 / 50709593 / +1.2% 0.51 / 0.50 / +1.4%
job_q77/duckdb:vortex-file-compressed 25382350 / 25242733 / +0.6% 52049287 / 50478534 / +3.1% 0.49 / 0.50 / -2.5%
job_q78/duckdb:vortex-file-compressed 27392826 / 27040738 / +1.3% 51076002 / 51520862 / -0.9% 0.54 / 0.52 / +2.2%
job_q79/duckdb:vortex-file-compressed 60475323 / 59906057 / +1.0% 85147506 / 84736686 / +0.5% 0.71 / 0.71 / +0.5%
job_q80/duckdb:vortex-file-compressed 46923903 / 46901645 / +0.0% 72409591 / 71090617 / +1.9% 0.65 / 0.66 / -1.8%
job_q81/duckdb:vortex-file-compressed 90523764 / 90024628 / +0.6% 116730578 / 113502962 / +2.8% 0.78 / 0.79 / -2.2%
job_q82/duckdb:vortex-file-compressed 136900460 / 137423708 / -0.4% 160725303 / 161904227 / -0.7% 0.85 / 0.85 / +0.3%
job_q83/duckdb:vortex-file-compressed 40165438 / 39326000 / +2.1% 62643342 / 61532590 / +1.8% 0.64 / 0.64 / +0.3%
job_q84/duckdb:vortex-file-compressed 38355091 / 38279581 / +0.2% 60742812 / 63884941 / -4.9% 0.63 / 0.60 / +5.4%
job_q85/duckdb:vortex-file-compressed 45676352 / 45898196 / -0.5% 68857370 / 69350837 / -0.7% 0.66 / 0.66 / +0.2%
job_q86/duckdb:vortex-file-compressed 65142079 / 63393848 / +2.8% 100489153 / 104226969 / -3.6% 0.65 / 0.61 / +6.6%
job_q87/duckdb:vortex-file-compressed 59508204 / 59078709 / +0.7% 95298932 / 95449465 / -0.2% 0.62 / 0.62 / +0.9%
job_q88/duckdb:vortex-file-compressed 58830808 / 58323748 / +0.9% 92854540 / 94821711 / -2.1% 0.63 / 0.62 / +3.0%
job_q89/duckdb:vortex-file-compressed 47089208 / 47857594 / -1.6% 84727291 / 82324977 / +2.9% 0.56 / 0.58 / -4.4%
job_q90/duckdb:vortex-file-compressed 70977796 / 69547343 / +2.1% 102435875 / 103451690 / -1.0% 0.69 / 0.67 / +3.1%
job_q91/duckdb:vortex-file-compressed 60226388 / 60628780 / -0.7% 104980053 / 102108593 / +2.8% 0.57 / 0.59 / -3.4%
job_q92/duckdb:vortex-file-compressed 43794872 / 43344889 / +1.0% 81384905 / 83301756 / -2.3% 0.54 / 0.52 / +3.4%
job_q93/duckdb:vortex-file-compressed 69511270 / 69282965 / +0.3% 109503960 / 109458209 / +0.0% 0.63 / 0.63 / +0.3%
job_q94/duckdb:vortex-file-compressed 26947975 / 26991646 / -0.2% 49704375 / 50595255 / -1.8% 0.54 / 0.53 / +1.6%
job_q95/duckdb:vortex-file-compressed 25460260 / 25450014 / +0.0% 47659565 / 47661215 / -0.0% 0.53 / 0.53 / +0.0%
job_q96/duckdb:vortex-file-compressed 28005240 / 28387748 / -1.3% 51257062 / 51124398 / +0.3% 0.55 / 0.56 / -1.6%
job_q97/duckdb:vortex-file-compressed 85229695 / 84622460 / +0.7% 127383478 / 125876793 / +1.2% 0.67 / 0.67 / -0.5%
job_q98/duckdb:vortex-file-compressed 56469482 / 55591692 / +1.6% 96521654 / 96460375 / +0.1% 0.59 / 0.58 / +1.5%
job_q99/duckdb:vortex-file-compressed 79676638 / 79366916 / +0.4% 118096971 / 120661174 / -2.1% 0.67 / 0.66 / +2.6%
duckdb / parquet / ns (1.008x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 60176340 / 60204166 / -0.0% 66684632 / 68783536 / -3.1% 0.90 / 0.88 / +3.1%
job_q02/duckdb:parquet 148501170 / 153443024 / -3.2% 163564704 / 163782174 / -0.1% 0.91 / 0.94 / -3.1%
job_q03/duckdb:parquet 90247358 / 90478986 / -0.3% 98778073 / 98803475 / -0.0% 0.91 / 0.92 / -0.2%
job_q04/duckdb:parquet 169045040 / 169499190 / -0.3% 178858624 / 177625121 / +0.7% 0.95 / 0.95 / -1.0%
job_q05/duckdb:parquet 77052266 / 76690082 / +0.5% 88542141 / 88290855 / +0.3% 0.87 / 0.87 / +0.2%
job_q06/duckdb:parquet 73305643 / 73256673 / +0.1% 84308605 / 84451539 / -0.2% 0.87 / 0.87 / +0.2%
job_q07/duckdb:parquet 31371581 / 31073013 / +1.0% 42720366 / 44064750 / -3.1% 0.73 / 0.71 / +4.1%
job_q08/duckdb:parquet 93110266 / 93454606 / -0.4% 105868951 / 105933539 / -0.1% 0.88 / 0.88 / -0.3%
job_q09/duckdb:parquet 291924179 / 296847527 / -1.7% 300048167 / 321808789 / -6.8% 0.97 / 0.92 / +5.5%
job_q10/duckdb:parquet 234434407 / 236760356 / -1.0% 269955521 / 263555981 / +2.4% 0.87 / 0.90 / -3.3%
job_q100/duckdb:parquet 232804402 / 227935060 / +2.1% 261880642 / 255574464 / +2.5% 0.89 / 0.89 / -0.3%
job_q101/duckdb:parquet 223996576 / 230588552 / -2.9% 256945961 / 257745881 / -0.3% 0.87 / 0.89 / -2.6%
job_q102/duckdb:parquet 269160813 / 266798690 / +0.9% 301355775 / 298154990 / +1.1% 0.89 / 0.89 / -0.2%
job_q103/duckdb:parquet 199285742 / 204241854 / -2.4% 307477659 / 248944309 / +23.5% 🔴 0.65 / 0.82 / -21.0%
job_q104/duckdb:parquet 154577532 / 156401644 / -1.2% 187837377 / 203018854 / -7.5% 0.82 / 0.77 / +6.8%
job_q105/duckdb:parquet 196881521 / 205194559 / -4.1% 237928180 / 247417160 / -3.8% 0.83 / 0.83 / -0.2%
job_q106/duckdb:parquet 230437934 / 227160942 / +1.4% 260566382 / 260079294 / +0.2% 0.88 / 0.87 / +1.3%
job_q107/duckdb:parquet 188916010 / 186269467 / +1.4% 246422515 / 238818232 / +3.2% 0.77 / 0.78 / -1.7%
job_q108/duckdb:parquet 229784234 / 215661764 / +6.5% 279195236 / 260087101 / +7.3% 0.82 / 0.83 / -0.7%
job_q109/duckdb:parquet 29854800 / 29714148 / +0.5% 36807893 / 36232779 / +1.6% 0.81 / 0.82 / -1.1%
job_q11/duckdb:parquet 328312618 / 327248627 / +0.3% 347507878 / 352204012 / -1.3% 0.94 / 0.93 / +1.7%
job_q110/duckdb:parquet 78333076 / 78540014 / -0.3% 86550963 / 86669349 / -0.1% 0.91 / 0.91 / -0.1%
job_q111/duckdb:parquet 109597736 / 109277466 / +0.3% 120238558 / 118700470 / +1.3% 0.91 / 0.92 / -1.0%
job_q112/duckdb:parquet 106324544 / 105914744 / +0.4% 116306190 / 115588310 / +0.6% 0.91 / 0.92 / -0.2%
job_q113/duckdb:parquet 117532921 / 117324062 / +0.2% 128941100 / 128943343 / -0.0% 0.91 / 0.91 / +0.2%
job_q12/duckdb:parquet 106749136 / 105797072 / +0.9% 117465910 / 119538727 / -1.7% 0.91 / 0.89 / +2.7%
job_q13/duckdb:parquet 60264687 / 60461366 / -0.3% 70660979 / 69811037 / +1.2% 0.85 / 0.87 / -1.5%
job_q14/duckdb:parquet 125263909 / 125005096 / +0.2% 135698885 / 136107326 / -0.3% 0.92 / 0.92 / +0.5%
job_q15/duckdb:parquet 362890508 / 363636666 / -0.2% 382404451 / 387875030 / -1.4% 0.95 / 0.94 / +1.2%
job_q16/duckdb:parquet 314862278 / 193715478 / +62.5% 🔴 208348734 / 339070284 / -38.6% 🟢 1.51 / 0.57 / +164.5%
job_q17/duckdb:parquet 338742268 / 357775185 / -5.3% 380574264 / 385663026 / -1.3% 0.89 / 0.93 / -4.1%
job_q18/duckdb:parquet 86248202 / 85639429 / +0.7% 100806934 / 100651257 / +0.2% 0.86 / 0.85 / +0.6%
job_q19/duckdb:parquet 72645520 / 72565790 / +0.1% 84067050 / 85234937 / -1.4% 0.86 / 0.85 / +1.5%
job_q20/duckdb:parquet 72554744 / 72367437 / +0.3% 82988529 / 84365534 / -1.6% 0.87 / 0.86 / +1.9%
job_q21/duckdb:parquet 115830474 / 115577288 / +0.2% 131071997 / 133929145 / -2.1% 0.88 / 0.86 / +2.4%
job_q22/duckdb:parquet 111253944 / 110846295 / +0.4% 127401497 / 127170249 / +0.2% 0.87 / 0.87 / +0.2%
job_q23/duckdb:parquet 198400236 / 198408710 / -0.0% 220434062 / 225743492 / -2.4% 0.90 / 0.88 / +2.4%
job_q24/duckdb:parquet 166481197 / 165268515 / +0.7% 186656342 / 188832879 / -1.2% 0.89 / 0.88 / +1.9%
job_q25/duckdb:parquet 132528518 / 132896422 / -0.3% 154135201 / 156210942 / -1.3% 0.86 / 0.85 / +1.1%
job_q26/duckdb:parquet 325061904 / 322511082 / +0.8% 349111953 / 353696019 / -1.3% 0.93 / 0.91 / +2.1%
job_q27/duckdb:parquet 132818632 / 133161922 / -0.3% 149816002 / 152856305 / -2.0% 0.89 / 0.87 / +1.8%
job_q28/duckdb:parquet 144282524 / 144218674 / +0.0% 164152758 / 162697871 / +0.9% 0.88 / 0.89 / -0.8%
job_q29/duckdb:parquet 391558542 / 389908664 / +0.4% 408719894 / 404513489 / +1.0% 0.96 / 0.96 / -0.6%
job_q30/duckdb:parquet 204468182 / 207613838 / -1.5% 217529637 / 216573032 / +0.4% 0.94 / 0.96 / -1.9%
job_q31/duckdb:parquet 312030370 / 312470188 / -0.1% 334491124 / 334830407 / -0.1% 0.93 / 0.93 / -0.0%
job_q32/duckdb:parquet 273129556 / 271071592 / +0.8% 295268678 / 299838495 / -1.5% 0.93 / 0.90 / +2.3%
job_q33/duckdb:parquet 264440355 / 260771094 / +1.4% 278227729 / 278767688 / -0.2% 0.95 / 0.94 / +1.6%
job_q34/duckdb:parquet 415569362 / 408545591 / +1.7% 440883191 / 434882881 / +1.4% 0.94 / 0.94 / +0.3%
job_q35/duckdb:parquet 142852688 / 142064538 / +0.6% 158766372 / 160509731 / -1.1% 0.90 / 0.89 / +1.7%
job_q36/duckdb:parquet 86148110 / 85576221 / +0.7% 103768628 / 103096878 / +0.7% 0.83 / 0.83 / +0.0%
job_q37/duckdb:parquet 249061134 / 247757899 / +0.5% 267735444 / 272701580 / -1.8% 0.93 / 0.91 / +2.4%
job_q38/duckdb:parquet 67115304 / 65690374 / +2.2% 79480352 / 79740784 / -0.3% 0.84 / 0.82 / +2.5%
job_q39/duckdb:parquet 62824389 / 61471903 / +2.2% 73523829 / 76686196 / -4.1% 0.85 / 0.80 / +6.6%
job_q40/duckdb:parquet 81999872 / 80928521 / +1.3% 91402707 / 89062827 / +2.6% 0.90 / 0.91 / -1.3%
job_q41/duckdb:parquet 92327783 / 92160960 / +0.2% 105954402 / 103656290 / +2.2% 0.87 / 0.89 / -2.0%
job_q42/duckdb:parquet 147885830 / 159012034 / -7.0% 178772054 / 168485750 / +6.1% 0.83 / 0.94 / -12.3%
job_q43/duckdb:parquet 55204002 / 55075446 / +0.2% 69246396 / 70647476 / -2.0% 0.80 / 0.78 / +2.3%
job_q44/duckdb:parquet 208913857 / 186383132 / +12.1% 🔴 199660482 / 205821697 / -3.0% 1.05 / 0.91 / +15.5%
job_q45/duckdb:parquet 178199676 / 176999957 / +0.7% 192133178 / 188124071 / +2.1% 0.93 / 0.94 / -1.4%
job_q46/duckdb:parquet 114985171 / 112967190 / +1.8% 126619605 / 125353158 / +1.0% 0.91 / 0.90 / +0.8%
job_q47/duckdb:parquet 91594592 / 91846106 / -0.3% 104377062 / 104310423 / +0.1% 0.88 / 0.88 / -0.3%
job_q48/duckdb:parquet 172073812 / 171375170 / +0.4% 187281334 / 184609699 / +1.4% 0.92 / 0.93 / -1.0%
job_q49/duckdb:parquet 157309732 / 182364193 / -13.7% 🟢 245019231 / 203310726 / +20.5% 🔴 0.64 / 0.90 / -28.4%
job_q50/duckdb:parquet 138841489 / 124851624 / +11.2% 🔴 157038898 / 152492572 / +3.0% 0.88 / 0.82 / +8.0%
job_q51/duckdb:parquet 202273285 / 207043140 / -2.3% 204549900 / 215884120 / -5.3% 0.99 / 0.96 / +3.1%
job_q52/duckdb:parquet 178504231 / 181785066 / -1.8% 204152468 / 206909312 / -1.3% 0.87 / 0.88 / -0.5%
job_q53/duckdb:parquet 175335701 / 172495852 / +1.6% 205705579 / 192050375 / +7.1% 0.85 / 0.90 / -5.1%
job_q54/duckdb:parquet 179609928 / 183193434 / -2.0% 185222772 / 185491680 / -0.1% 0.97 / 0.99 / -1.8%
job_q55/duckdb:parquet 173802468 / 172400406 / +0.8% 190382557 / 189847814 / +0.3% 0.91 / 0.91 / +0.5%
job_q56/duckdb:parquet 154813562 / 155619020 / -0.5% 183305088 / 181634686 / +0.9% 0.84 / 0.86 / -1.4%
job_q57/duckdb:parquet 206358462 / 205169749 / +0.6% 229432399 / 228257431 / +0.5% 0.90 / 0.90 / +0.1%
job_q58/duckdb:parquet 233641938 / 238223164 / -1.9% 266335770 / 262167087 / +1.6% 0.88 / 0.91 / -3.5%
job_q59/duckdb:parquet 226670176 / 225545723 / +0.5% 252177280 / 252876513 / -0.3% 0.90 / 0.89 / +0.8%
job_q60/duckdb:parquet 93951810 / 93599301 / +0.4% 113195054 / 108369255 / +4.5% 0.83 / 0.86 / -3.9%
job_q61/duckdb:parquet 76817446 / 76785866 / +0.0% 92537630 / 92479893 / +0.1% 0.83 / 0.83 / -0.0%
job_q62/duckdb:parquet 73712654 / 73584232 / +0.2% 89888369 / 89336706 / +0.6% 0.82 / 0.82 / -0.4%
job_q63/duckdb:parquet 90545373 / 90229196 / +0.4% 108932748 / 108659190 / +0.3% 0.83 / 0.83 / +0.1%
job_q64/duckdb:parquet 160523696 / 158943754 / +1.0% 182811121 / 185121396 / -1.2% 0.88 / 0.86 / +2.3%
job_q65/duckdb:parquet 111147043 / 111810954 / -0.6% 129247529 / 129346971 / -0.1% 0.86 / 0.86 / -0.5%
job_q66/duckdb:parquet 190139856 / 185905578 / +2.3% 212256969 / 210696187 / +0.7% 0.90 / 0.88 / +1.5%
job_q67/duckdb:parquet 166840261 / 166396837 / +0.3% 213320184 / 194015498 / +10.0% 0.78 / 0.86 / -8.8%
job_q68/duckdb:parquet 238590058 / 176142156 / +35.5% 🔴 226951723 / 226718072 / +0.1% 1.05 / 0.78 / +35.3%
job_q69/duckdb:parquet 309554502 / 305943914 / +1.2% 343454927 / 326594820 / +5.2% 0.90 / 0.94 / -3.8%
job_q70/duckdb:parquet 233109205 / 237412340 / -1.8% 263736969 / 261976270 / +0.7% 0.88 / 0.91 / -2.5%
job_q71/duckdb:parquet 207511021 / 197115050 / +5.3% 229668309 / 222103209 / +3.4% 0.90 / 0.89 / +1.8%
job_q72/duckdb:parquet 290491077 / 290820980 / -0.1% 307243853 / 308656584 / -0.5% 0.95 / 0.94 / +0.3%
job_q73/duckdb:parquet 198141473 / 195718095 / +1.2% 221946628 / 222363615 / -0.2% 0.89 / 0.88 / +1.4%
job_q74/duckdb:parquet 194819692 / 194494704 / +0.2% 221825131 / 224449763 / -1.2% 0.88 / 0.87 / +1.4%
job_q75/duckdb:parquet 226533856 / 225263608 / +0.6% 254284471 / 248892779 / +2.2% 0.89 / 0.91 / -1.6%
job_q76/duckdb:parquet 135195122 / 136325376 / -0.8% 149055185 / 162417241 / -8.2% 0.91 / 0.84 / +8.1%
job_q77/duckdb:parquet 124253200 / 133178673 / -6.7% 144581908 / 143272760 / +0.9% 0.86 / 0.93 / -7.5%
job_q78/duckdb:parquet 128795402 / 132742198 / -3.0% 158768667 / 166572295 / -4.7% 0.81 / 0.80 / +1.8%
job_q79/duckdb:parquet 262259236 / 250087562 / +4.9% 277131578 / 275588738 / +0.6% 0.95 / 0.91 / +4.3%
job_q80/duckdb:parquet 245035847 / 242064476 / +1.2% 295758244 / 250807132 / +17.9% 🔴 0.83 / 0.97 / -14.2%
job_q81/duckdb:parquet 371927983 / 382943388 / -2.9% 379262265 / 380203566 / -0.2% 0.98 / 1.01 / -2.6%
job_q82/duckdb:parquet 281065088 / 290874406 / -3.4% 303366065 / 294713258 / +2.9% 0.93 / 0.99 / -6.1%
job_q83/duckdb:parquet 142858895 / 127469248 / +12.1% 🔴 142597495 / 151294988 / -5.7% 1.00 / 0.84 / +18.9%
job_q84/duckdb:parquet 130895754 / 124251480 / +5.3% 140987073 / 155676414 / -9.4% 0.93 / 0.80 / +16.3%
job_q85/duckdb:parquet 130878240 / 142439670 / -8.1% 148074367 / 185018425 / -20.0% 🟢 0.88 / 0.77 / +14.8%
job_q86/duckdb:parquet 236031505 / 226471052 / +4.2% 257224592 / 263362611 / -2.3% 0.92 / 0.86 / +6.7%
job_q87/duckdb:parquet 204430238 / 204143050 / +0.1% 238278247 / 224061029 / +6.3% 0.86 / 0.91 / -5.8%
job_q88/duckdb:parquet 197247616 / 192709410 / +2.4% 238786644 / 232150601 / +2.9% 0.83 / 0.83 / -0.5%
job_q89/duckdb:parquet 167185508 / 174321958 / -4.1% 199080060 / 200204135 / -0.6% 0.84 / 0.87 / -3.6%
job_q90/duckdb:parquet 230444820 / 232696958 / -1.0% 260825123 / 263829873 / -1.1% 0.88 / 0.88 / +0.2%
job_q91/duckdb:parquet 256954900 / 256604422 / +0.1% 287025564 / 287614831 / -0.2% 0.90 / 0.89 / +0.3%
job_q92/duckdb:parquet 199720057 / 200252666 / -0.3% 226610005 / 228003131 / -0.6% 0.88 / 0.88 / +0.3%
job_q93/duckdb:parquet 242860214 / 241662380 / +0.5% 269249419 / 271118965 / -0.7% 0.90 / 0.89 / +1.2%
job_q94/duckdb:parquet 139211086 / 143452078 / -3.0% 155564060 / 178471934 / -12.8% 🟢 0.89 / 0.80 / +11.3%
job_q95/duckdb:parquet 120892030 / 127509332 / -5.2% 152840959 / 161715230 / -5.5% 0.79 / 0.79 / +0.3%
job_q96/duckdb:parquet 141761186 / 140363245 / +1.0% 172162216 / 163283433 / +5.4% 0.82 / 0.86 / -4.2%
job_q97/duckdb:parquet 277717814 / 279448250 / -0.6% 274593594 / 280457959 / -2.1% 1.01 / 1.00 / +1.5%
job_q98/duckdb:parquet 216706660 / 204189598 / +6.1% 329681108 / 227119411 / +45.2% 🔴 0.66 / 0.90 / -26.9%
job_q99/duckdb:parquet 270121520 / 257467628 / +4.9% 276215654 / 295637564 / -6.6% 0.98 / 0.87 / +12.3%
duckdb / duckdb / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7683035 / 7657348 / +0.3% 17080844 / 16652146 / +2.6% 0.45 / 0.46 / -2.2%
job_q02/duckdb:duckdb 5651562 / 5715540 / -1.1% 13633371 / 13269811 / +2.7% 0.41 / 0.43 / -3.8%
job_q03/duckdb:duckdb 6311363 / 6372794 / -1.0% 14490709 / 13992401 / +3.6% 0.44 / 0.46 / -4.4%
job_q04/duckdb:duckdb 6034780 / 5738666 / +5.2% 13397603 / 12988127 / +3.2% 0.45 / 0.44 / +1.9%
job_q05/duckdb:duckdb 14448643 / 14833230 / -2.6% 25592348 / 26442962 / -3.2% 0.56 / 0.56 / +0.6%
job_q06/duckdb:duckdb 14217699 / 14610183 / -2.7% 25314034 / 25444828 / -0.5% 0.56 / 0.57 / -2.2%
job_q07/duckdb:duckdb 11080226 / 11002232 / +0.7% 20246272 / 19977328 / +1.3% 0.55 / 0.55 / -0.6%
job_q08/duckdb:duckdb 16583928 / 16644776 / -0.4% 26920665 / 27864524 / -3.4% 0.62 / 0.60 / +3.1%
job_q09/duckdb:duckdb 62529964 / 63193904 / -1.1% 91747264 / 91601251 / +0.2% 0.68 / 0.69 / -1.2%
job_q10/duckdb:duckdb 41110355 / 41265776 / -0.4% 73023834 / 68683457 / +6.3% 0.56 / 0.60 / -6.3%
job_q100/duckdb:duckdb 23879740 / 24432276 / -2.3% 46548448 / 44468213 / +4.7% 0.51 / 0.55 / -6.6%
job_q101/duckdb:duckdb 26484502 / 25705234 / +3.0% 48661318 / 52451072 / -7.2% 0.54 / 0.49 / +11.1%
job_q102/duckdb:duckdb 43898078 / 44951312 / -2.3% 70294249 / 72967772 / -3.7% 0.62 / 0.62 / +1.4%
job_q103/duckdb:duckdb 54783625 / 54519560 / +0.5% 85516548 / 85635105 / -0.1% 0.64 / 0.64 / +0.6%
job_q104/duckdb:duckdb 46638098 / 46378418 / +0.6% 72349938 / 72040006 / +0.4% 0.64 / 0.64 / +0.1%
job_q105/duckdb:duckdb 73607566 / 74701033 / -1.5% 104160978 / 105692465 / -1.4% 0.71 / 0.71 / -0.0%
job_q106/duckdb:duckdb 64862074 / 64259000 / +0.9% 94749475 / 95467945 / -0.8% 0.68 / 0.67 / +1.7%
job_q107/duckdb:duckdb 59462043 / 59664624 / -0.3% 88427243 / 87815240 / +0.7% 0.67 / 0.68 / -1.0%
job_q108/duckdb:duckdb 75188078 / 75029693 / +0.2% 106967881 / 107809482 / -0.8% 0.70 / 0.70 / +1.0%
job_q109/duckdb:duckdb 7161812 / 7065257 / +1.4% 16020268 / 15502092 / +3.3% 0.45 / 0.46 / -1.9%
job_q11/duckdb:duckdb 47664235 / 48152349 / -1.0% 87765677 / 82365367 / +6.6% 0.54 / 0.58 / -7.1%
job_q110/duckdb:duckdb 13828814 / 13991740 / -1.2% 23356023 / 24513119 / -4.7% 0.59 / 0.57 / +3.7%
job_q111/duckdb:duckdb 16517187 / 16699334 / -1.1% 28227901 / 28894891 / -2.3% 0.59 / 0.58 / +1.2%
job_q112/duckdb:duckdb 22034288 / 22147996 / -0.5% 34427563 / 36109774 / -4.7% 0.64 / 0.61 / +4.3%
job_q113/duckdb:duckdb 18492884 / 18256827 / +1.3% 31432593 / 30527663 / +3.0% 0.59 / 0.60 / -1.6%
job_q12/duckdb:duckdb 27828308 / 28196304 / -1.3% 38996900 / 38200633 / +2.1% 0.71 / 0.74 / -3.3%
job_q13/duckdb:duckdb 10129332 / 10029008 / +1.0% 19943153 / 18650683 / +6.9% 0.51 / 0.54 / -5.5%
job_q14/duckdb:duckdb 35850254 / 36128860 / -0.8% 46895499 / 46457542 / +0.9% 0.76 / 0.78 / -1.7%
job_q15/duckdb:duckdb 56165600 / 56088338 / +0.1% 89666098 / 87557433 / +2.4% 0.63 / 0.64 / -2.2%
job_q16/duckdb:duckdb 46780648 / 44928178 / +4.1% 76366349 / 73634780 / +3.7% 0.61 / 0.61 / +0.4%
job_q17/duckdb:duckdb 55075420 / 55736241 / -1.2% 85615677 / 84693385 / +1.1% 0.64 / 0.66 / -2.3%
job_q18/duckdb:duckdb 22253084 / 21525864 / +3.4% 43614358 / 43110817 / +1.2% 0.51 / 0.50 / +2.2%
job_q19/duckdb:duckdb 12008315 / 12127162 / -1.0% 20863723 / 21388972 / -2.5% 0.58 / 0.57 / +1.5%
job_q20/duckdb:duckdb 15444792 / 15453222 / -0.1% 32735165 / 32770361 / -0.1% 0.47 / 0.47 / +0.1%
job_q21/duckdb:duckdb 22629304 / 22425057 / +0.9% 33506413 / 32924626 / +1.8% 0.68 / 0.68 / -0.8%
job_q22/duckdb:duckdb 22400478 / 21708402 / +3.2% 42975922 / 44080859 / -2.5% 0.52 / 0.49 / +5.8%
job_q23/duckdb:duckdb 40999748 / 40488495 / +1.3% 57853867 / 58185745 / -0.6% 0.71 / 0.70 / +1.8%
job_q24/duckdb:duckdb 17177388 / 17199342 / -0.1% 34382683 / 33199132 / +3.6% 0.50 / 0.52 / -3.6%
job_q25/duckdb:duckdb 15455405 / 15657234 / -1.3% 29477899 / 30723258 / -4.1% 0.52 / 0.51 / +2.9%
job_q26/duckdb:duckdb 77802976 / 77813725 / -0.0% 131415683 / 127716766 / +2.9% 0.59 / 0.61 / -2.8%
job_q27/duckdb:duckdb 26289629 / 26573592 / -1.1% 42499314 / 42912247 / -1.0% 0.62 / 0.62 / -0.1%
job_q28/duckdb:duckdb 25872602 / 24904235 / +3.9% 41800813 / 41298496 / +1.2% 0.62 / 0.60 / +2.6%
job_q29/duckdb:duckdb 86152275 / 86125850 / +0.0% 97705588 / 99685368 / -2.0% 0.88 / 0.86 / +2.1%
job_q30/duckdb:duckdb 56553452 / 56402464 / +0.3% 69907251 / 71325111 / -2.0% 0.81 / 0.79 / +2.3%
job_q31/duckdb:duckdb 67357444 / 67569131 / -0.3% 89057784 / 89732847 / -0.8% 0.76 / 0.75 / +0.4%
job_q32/duckdb:duckdb 48534852 / 48271037 / +0.5% 71842264 / 72669905 / -1.1% 0.68 / 0.66 / +1.7%
job_q33/duckdb:duckdb 57741650 / 56228917 / +2.7% 78779908 / 79564365 / -1.0% 0.73 / 0.71 / +3.7%
job_q34/duckdb:duckdb 92943859 / 92607212 / +0.4% 112509379 / 113182285 / -0.6% 0.83 / 0.82 / +1.0%
job_q35/duckdb:duckdb 21526032 / 22116481 / -2.7% 39510958 / 40163211 / -1.6% 0.54 / 0.55 / -1.1%
job_q36/duckdb:duckdb 15905340 / 15911469 / -0.0% 31239396 / 32622412 / -4.2% 0.51 / 0.49 / +4.4%
job_q37/duckdb:duckdb 53045470 / 51536696 / +2.9% 76532250 / 77131689 / -0.8% 0.69 / 0.67 / +3.7%
job_q38/duckdb:duckdb 18410540 / 18569790 / -0.9% 31950545 / 30178777 / +5.9% 0.58 / 0.62 / -6.4%
job_q39/duckdb:duckdb 14437696 / 14186682 / +1.8% 26011302 / 25940325 / +0.3% 0.56 / 0.55 / +1.5%
job_q40/duckdb:duckdb 25633119 / 25172932 / +1.8% 36648398 / 37435426 / -2.1% 0.70 / 0.67 / +4.0%
job_q41/duckdb:duckdb 40401030 / 40479214 / -0.2% 52212681 / 50903230 / +2.6% 0.77 / 0.80 / -2.7%
job_q42/duckdb:duckdb 20442594 / 20845622 / -1.9% 32187978 / 32448749 / -0.8% 0.64 / 0.64 / -1.1%
job_q43/duckdb:duckdb 24157162 / 23935370 / +0.9% 35974467 / 37627713 / -4.4% 0.67 / 0.64 / +5.6%
job_q44/duckdb:duckdb 29424286 / 29482909 / -0.2% 40111220 / 40550461 / -1.1% 0.73 / 0.73 / +0.9%
job_q45/duckdb:duckdb 22340282 / 22419152 / -0.4% 34474642 / 35479260 / -2.8% 0.65 / 0.63 / +2.6%
job_q46/duckdb:duckdb 34651542 / 34489336 / +0.5% 47069086 / 46252671 / +1.8% 0.74 / 0.75 / -1.3%
job_q47/duckdb:duckdb 32408973 / 31829321 / +1.8% 44243629 / 44371271 / -0.3% 0.73 / 0.72 / +2.1%
job_q48/duckdb:duckdb 59729889 / 58731451 / +1.7% 70882330 / 70445558 / +0.6% 0.84 / 0.83 / +1.1%
job_q49/duckdb:duckdb 52861582 / 53213181 / -0.7% 68033060 / 68050275 / -0.0% 0.78 / 0.78 / -0.6%
job_q50/duckdb:duckdb 27190204 / 27280552 / -0.3% 39356147 / 38452485 / +2.4% 0.69 / 0.71 / -2.6%
job_q51/duckdb:duckdb 39078039 / 39264416 / -0.5% 50803185 / 51108918 / -0.6% 0.77 / 0.77 / +0.1%
job_q52/duckdb:duckdb 34576078 / 34510874 / +0.2% 52774297 / 52469741 / +0.6% 0.66 / 0.66 / -0.4%
job_q53/duckdb:duckdb 22118434 / 22268676 / -0.7% 38025026 / 38944736 / -2.4% 0.58 / 0.57 / +1.7%
job_q54/duckdb:duckdb 58634596 / 59285096 / -1.1% 75533647 / 74990735 / +0.7% 0.78 / 0.79 / -1.8%
job_q55/duckdb:duckdb 66510366 / 66293362 / +0.3% 83169810 / 82349667 / +1.0% 0.80 / 0.81 / -0.7%
job_q56/duckdb:duckdb 25133514 / 25098706 / +0.1% 47385321 / 47189492 / +0.4% 0.53 / 0.53 / -0.3%
job_q57/duckdb:duckdb 112356148 / 111491953 / +0.8% 133625269 / 133092150 / +0.4% 0.84 / 0.84 / +0.4%
job_q58/duckdb:duckdb 45610168 / 45501965 / +0.2% 68038487 / 66870091 / +1.7% 0.67 / 0.68 / -1.5%
job_q59/duckdb:duckdb 42687023 / 42565342 / +0.3% 64944688 / 64516840 / +0.7% 0.66 / 0.66 / -0.4%
job_q60/duckdb:duckdb 47855106 / 47120570 / +1.6% 66190518 / 65096679 / +1.7% 0.72 / 0.72 / -0.1%
job_q61/duckdb:duckdb 53095480 / 54939738 / -3.4% 73080181 / 71251596 / +2.6% 0.73 / 0.77 / -5.8%
job_q62/duckdb:duckdb 54700702 / 52846516 / +3.5% 69946457 / 69850404 / +0.1% 0.78 / 0.76 / +3.4%
job_q63/duckdb:duckdb 58239344 / 59975747 / -2.9% 77020429 / 77159829 / -0.2% 0.76 / 0.78 / -2.7%
job_q64/duckdb:duckdb 47044284 / 46000838 / +2.3% 65956846 / 66627576 / -1.0% 0.71 / 0.69 / +3.3%
job_q65/duckdb:duckdb 74457046 / 74904282 / -0.6% 92823370 / 91719073 / +1.2% 0.80 / 0.82 / -1.8%
job_q66/duckdb:duckdb 53378796 / 54515576 / -2.1% 82406058 / 85206167 / -3.3% 0.65 / 0.64 / +1.2%
job_q67/duckdb:duckdb 24038632 / 24569005 / -2.2% 49101194 / 49450064 / -0.7% 0.49 / 0.50 / -1.5%
job_q68/duckdb:duckdb 52924784 / 53207370 / -0.5% 76640012 / 79257311 / -3.3% 0.69 / 0.67 / +2.9%
job_q69/duckdb:duckdb 76044220 / 76788676 / -1.0% 98106757 / 99219935 / -1.1% 0.78 / 0.77 / +0.2%
job_q70/duckdb:duckdb 47484692 / 46127786 / +2.9% 66630476 / 66363971 / +0.4% 0.71 / 0.70 / +2.5%
job_q71/duckdb:duckdb 81772868 / 79177847 / +3.3% 100813398 / 100336913 / +0.5% 0.81 / 0.79 / +2.8%
job_q72/duckdb:duckdb 110540679 / 108713122 / +1.7% 127993663 / 130144579 / -1.7% 0.86 / 0.84 / +3.4%
job_q73/duckdb:duckdb 65370047 / 64987273 / +0.6% 86998414 / 88270847 / -1.4% 0.75 / 0.74 / +2.1%
job_q74/duckdb:duckdb 62176774 / 62820211 / -1.0% 86365279 / 88020297 / -1.9% 0.72 / 0.71 / +0.9%
job_q75/duckdb:duckdb 55002202 / 55055069 / -0.1% 76735568 / 79460069 / -3.4% 0.72 / 0.69 / +3.5%
job_q76/duckdb:duckdb 25359068 / 23830314 / +6.4% 43264481 / 42786422 / +1.1% 0.59 / 0.56 / +5.2%
job_q77/duckdb:duckdb 22457102 / 21404794 / +4.9% 36406391 / 36699384 / -0.8% 0.62 / 0.58 / +5.8%
job_q78/duckdb:duckdb 23830538 / 23769184 / +0.3% 45085289 / 42143728 / +7.0% 0.53 / 0.56 / -6.3%
job_q79/duckdb:duckdb 63048262 / 63019415 / +0.0% 80397087 / 80711241 / -0.4% 0.78 / 0.78 / +0.4%
job_q80/duckdb:duckdb 46993650 / 46835350 / +0.3% 64637344 / 63693973 / +1.5% 0.73 / 0.74 / -1.1%
job_q81/duckdb:duckdb 102462286 / 102735515 / -0.3% 121045873 / 122038593 / -0.8% 0.85 / 0.84 / +0.6%
job_q82/duckdb:duckdb 144105619 / 143568666 / +0.4% 162722580 / 161357837 / +0.8% 0.89 / 0.89 / -0.5%
job_q83/duckdb:duckdb 47854316 / 48210637 / -0.7% 64469366 / 65915831 / -2.2% 0.74 / 0.73 / +1.5%
job_q84/duckdb:duckdb 26499184 / 26631639 / -0.5% 42071126 / 41177738 / +2.2% 0.63 / 0.65 / -2.6%
job_q85/duckdb:duckdb 49235603 / 50172172 / -1.9% 65452181 / 64949617 / +0.8% 0.75 / 0.77 / -2.6%
job_q86/duckdb:duckdb 55173678 / 55254424 / -0.1% 79235669 / 80058748 / -1.0% 0.70 / 0.69 / +0.9%
job_q87/duckdb:duckdb 32030372 / 32891474 / -2.6% 56996720 / 54533121 / +4.5% 0.56 / 0.60 / -6.8%
job_q88/duckdb:duckdb 48430705 / 49302954 / -1.8% 77503458 / 77928578 / -0.5% 0.62 / 0.63 / -1.2%
job_q89/duckdb:duckdb 25384802 / 25721068 / -1.3% 49152844 / 47319733 / +3.9% 0.52 / 0.54 / -5.0%
job_q90/duckdb:duckdb 59624762 / 59239652 / +0.7% 86285005 / 89280493 / -3.4% 0.69 / 0.66 / +4.1%
job_q91/duckdb:duckdb 54196860 / 54441465 / -0.4% 83738791 / 85224611 / -1.7% 0.65 / 0.64 / +1.3%
job_q92/duckdb:duckdb 34792257 / 34558420 / +0.7% 61467781 / 59723408 / +2.9% 0.57 / 0.58 / -2.2%
job_q93/duckdb:duckdb 79309384 / 80388180 / -1.3% 106990448 / 111687815 / -4.2% 0.74 / 0.72 / +3.0%
job_q94/duckdb:duckdb 22626500 / 21823967 / +3.7% 41017475 / 39905538 / +2.8% 0.55 / 0.55 / +0.9%
job_q95/duckdb:duckdb 21579892 / 20299152 / +6.3% 37580115 / 36330375 / +3.4% 0.57 / 0.56 / +2.8%
job_q96/duckdb:duckdb 22604287 / 22446350 / +0.7% 39456777 / 39811734 / -0.9% 0.57 / 0.56 / +1.6%
job_q97/duckdb:duckdb 86421000 / 86044803 / +0.4% 107083577 / 105665114 / +1.3% 0.81 / 0.81 / -0.9%
job_q98/duckdb:duckdb 45689094 / 45876470 / -0.4% 63788005 / 64056375 / -0.4% 0.72 / 0.72 / +0.0%
job_q99/duckdb:duckdb 77741290 / 77213042 / +0.7% 95624333 / 97586421 / -2.0% 0.81 / 0.79 / +2.8%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.979x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1228188 / 1235524 / -0.6% 22169856 / 23247687 / -4.6% 0.06 / 0.05 / +4.2%
clickbench_q01/datafusion:vortex-file-compressed 5992382 / 5940966 / +0.9% 28997072 / 30324982 / -4.4% 0.21 / 0.20 / +5.5%
clickbench_q02/datafusion:vortex-file-compressed 10906736 / 10531176 / +3.6% 46141337 / 44456285 / +3.8% 0.24 / 0.24 / -0.2%
clickbench_q03/datafusion:vortex-file-compressed 13300648 / 12984230 / +2.4% 53538901 / 56865524 / -5.8% 0.25 / 0.23 / +8.8%
clickbench_q04/datafusion:vortex-file-compressed 58214585 / 57234726 / +1.7% 103909623 / 105770566 / -1.8% 0.56 / 0.54 / +3.5%
clickbench_q05/datafusion:vortex-file-compressed 79386061 / 77269834 / +2.7% 127643056 / 129049748 / -1.1% 0.62 / 0.60 / +3.9%
clickbench_q06/datafusion:vortex-file-compressed 1250582 / 1250239 / +0.0% 22000147 / 23514464 / -6.4% 0.06 / 0.05 / +6.9%
clickbench_q07/datafusion:vortex-file-compressed 9665530 / 9898601 / -2.4% 33574829 / 33610485 / -0.1% 0.29 / 0.29 / -2.3%
clickbench_q08/datafusion:vortex-file-compressed 80371304 / 81258432 / -1.1% 127512422 / 119991156 / +6.3% 0.63 / 0.68 / -6.9%
clickbench_q09/datafusion:vortex-file-compressed 173593726 / 172845984 / +0.4% 205250543 / 215629365 / -4.8% 0.85 / 0.80 / +5.5%
clickbench_q10/datafusion:vortex-file-compressed 22994128 / 23918958 / -3.9% 65933054 / 72753803 / -9.4% 0.35 / 0.33 / +6.1%
clickbench_q11/datafusion:vortex-file-compressed 25843142 / 26278074 / -1.7% 71410642 / 71521358 / -0.2% 0.36 / 0.37 / -1.5%
clickbench_q12/datafusion:vortex-file-compressed 72574864 / 74227621 / -2.2% 120269158 / 129379094 / -7.0% 0.60 / 0.57 / +5.2%
clickbench_q13/datafusion:vortex-file-compressed 119947014 / 118047738 / +1.6% 177839895 / 185746994 / -4.3% 0.67 / 0.64 / +6.1%
clickbench_q14/datafusion:vortex-file-compressed 74374200 / 75471834 / -1.5% 129528554 / 126570562 / +2.3% 0.57 / 0.60 / -3.7%
clickbench_q15/datafusion:vortex-file-compressed 65368748 / 63492424 / +3.0% 101933768 / 99410017 / +2.5% 0.64 / 0.64 / +0.4%
clickbench_q16/datafusion:vortex-file-compressed 153927642 / 154503588 / -0.4% 212555083 / 215583149 / -1.4% 0.72 / 0.72 / +1.0%
clickbench_q17/datafusion:vortex-file-compressed 153239846 / 156577370 / -2.1% 224791774 / 225814323 / -0.5% 0.68 / 0.69 / -1.7%
clickbench_q18/datafusion:vortex-file-compressed 295329610 / 294502724 / +0.3% 378882320 / 393899196 / -3.8% 0.78 / 0.75 / +4.3%
clickbench_q19/datafusion:vortex-file-compressed 8359216 / 8396311 / -0.4% 44828512 / 49799860 / -10.0% 0.19 / 0.17 / +10.6%
clickbench_q20/datafusion:vortex-file-compressed 69367235 / 67364797 / +3.0% 243130705 / 243387333 / -0.1% 0.29 / 0.28 / +3.1%
clickbench_q21/datafusion:vortex-file-compressed 79154105 / 84795340 / -6.7% 290527603 / 285923721 / +1.6% 0.27 / 0.30 / -8.1%
clickbench_q22/datafusion:vortex-file-compressed 95298033 / 91274917 / +4.4% 397791887 / 397370664 / +0.1% 0.24 / 0.23 / +4.3%
clickbench_q23/datafusion:vortex-file-compressed 185463151 / 189176162 / -2.0% 557981987 / 555974294 / +0.4% 0.33 / 0.34 / -2.3%
clickbench_q24/datafusion:vortex-file-compressed 17079429 / 16425044 / +4.0% 66619451 / 73731691 / -9.6% 0.26 / 0.22 / +15.1%
clickbench_q25/datafusion:vortex-file-compressed 18911520 / 18754506 / +0.8% 61650494 / 65144609 / -5.4% 0.31 / 0.29 / +6.6%
clickbench_q26/datafusion:vortex-file-compressed 16361191 / 17610243 / -7.1% 69291737 / 76415329 / -9.3% 0.24 / 0.23 / +2.5%
clickbench_q27/datafusion:vortex-file-compressed 101279244 / 103029553 / -1.7% 254500040 / 259689865 / -2.0% 0.40 / 0.40 / +0.3%
clickbench_q28/datafusion:vortex-file-compressed 567558642 / 557782774 / +1.8% 639711683 / 641186649 / -0.2% 0.89 / 0.87 / +2.0%
clickbench_q29/datafusion:vortex-file-compressed 24426023 / 23991816 / +1.8% 54969155 / 55740808 / -1.4% 0.44 / 0.43 / +3.2%
clickbench_q30/datafusion:vortex-file-compressed 57167574 / 57092090 / +0.1% 107495421 / 113387801 / -5.2% 0.53 / 0.50 / +5.6%
clickbench_q31/datafusion:vortex-file-compressed 65158636 / 65990409 / -1.3% 152758205 / 157304758 / -2.9% 0.43 / 0.42 / +1.7%
clickbench_q32/datafusion:vortex-file-compressed 283410777 / 287017928 / -1.3% 396107858 / 386855420 / +2.4% 0.72 / 0.74 / -3.6%
clickbench_q33/datafusion:vortex-file-compressed 323702980 / 327822001 / -1.3% 436056707 / 436542009 / -0.1% 0.74 / 0.75 / -1.1%
clickbench_q34/datafusion:vortex-file-compressed 322774778 / 322921256 / -0.0% 436200897 / 435529401 / +0.2% 0.74 / 0.74 / -0.2%
clickbench_q35/datafusion:vortex-file-compressed 57145850 / 55747298 / +2.5% 89810062 / 88176197 / +1.9% 0.64 / 0.63 / +0.6%
clickbench_q36/datafusion:vortex-file-compressed 38773904 / 37863076 / +2.4% 65811894 / 68264008 / -3.6% 0.59 / 0.55 / +6.2%
clickbench_q37/datafusion:vortex-file-compressed 20843302 / 21121466 / -1.3% 46225412 / 48131611 / -4.0% 0.45 / 0.44 / +2.8%
clickbench_q38/datafusion:vortex-file-compressed 13502472 / 13014864 / +3.7% 39792908 / 42502839 / -6.4% 0.34 / 0.31 / +10.8%
clickbench_q39/datafusion:vortex-file-compressed 79031248 / 78528108 / +0.6% 112211901 / 114801246 / -2.3% 0.70 / 0.68 / +3.0%
clickbench_q40/datafusion:vortex-file-compressed 10589153 / 10654862 / -0.6% 34788349 / 38002009 / -8.5% 0.30 / 0.28 / +8.6%
clickbench_q41/datafusion:vortex-file-compressed 10122034 / 10160080 / -0.4% 33891031 / 35374265 / -4.2% 0.30 / 0.29 / +4.0%
clickbench_q42/datafusion:vortex-file-compressed 10234160 / 10668386 / -4.1% 34481375 / 36275665 / -4.9% 0.30 / 0.29 / +0.9%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1226450 / 1242040 / -1.3% 49969953 / 52218923 / -4.3% 0.02 / 0.02 / +3.2%
clickbench_q01/datafusion:parquet 16120390 / 15783666 / +2.1% 67644610 / 65980084 / +2.5% 0.24 / 0.24 / -0.4%
clickbench_q02/datafusion:parquet 18755957 / 18586790 / +0.9% 82451553 / 79090888 / +4.2% 0.23 / 0.24 / -3.2%
clickbench_q03/datafusion:parquet 16915090 / 17365636 / -2.6% 79764007 / 79577826 / +0.2% 0.21 / 0.22 / -2.8%
clickbench_q04/datafusion:parquet 63787396 / 62895599 / +1.4% 130541114 / 125687642 / +3.9% 0.49 / 0.50 / -2.4%
clickbench_q05/datafusion:parquet 88074688 / 88999822 / -1.0% 155947590 / 157634140 / -1.1% 0.56 / 0.56 / +0.0%
clickbench_q06/datafusion:parquet 1265150 / 1247266 / +1.4% 49056707 / 49191372 / -0.3% 0.03 / 0.03 / +1.7%
clickbench_q07/datafusion:parquet 16492863 / 17033792 / -3.2% 68735835 / 66667825 / +3.1% 0.24 / 0.26 / -6.1%
clickbench_q08/datafusion:parquet 84680734 / 85863090 / -1.4% 163867599 / 160808545 / +1.9% 0.52 / 0.53 / -3.2%
clickbench_q09/datafusion:parquet 187762873 / 189777935 / -1.1% 271799594 / 268541898 / +1.2% 0.69 / 0.71 / -2.2%
clickbench_q10/datafusion:parquet 36694146 / 37070360 / -1.0% 101190907 / 102434090 / -1.2% 0.36 / 0.36 / +0.2%
clickbench_q11/datafusion:parquet 43158942 / 43457744 / -0.7% 110531030 / 110380477 / +0.1% 0.39 / 0.39 / -0.8%
clickbench_q12/datafusion:parquet 96638520 / 95990594 / +0.7% 160119234 / 162550151 / -1.5% 0.60 / 0.59 / +2.2%
clickbench_q13/datafusion:parquet 146029966 / 148904918 / -1.9% 227523931 / 226376529 / +0.5% 0.64 / 0.66 / -2.4%
clickbench_q14/datafusion:parquet 101205919 / 102608102 / -1.4% 169623559 / 174187043 / -2.6% 0.60 / 0.59 / +1.3%
clickbench_q15/datafusion:parquet 69772178 / 73719608 / -5.4% 130209413 / 137420905 / -5.2% 0.54 / 0.54 / -0.1%
clickbench_q16/datafusion:parquet 157542208 / 158349930 / -0.5% 235076730 / 237105659 / -0.9% 0.67 / 0.67 / +0.3%
clickbench_q17/datafusion:parquet 155648402 / 158220134 / -1.6% 232189067 / 242254157 / -4.2% 0.67 / 0.65 / +2.6%
clickbench_q18/datafusion:parquet 312152002 / 314454532 / -0.7% 415104909 / 409646584 / +1.3% 0.75 / 0.77 / -2.0%
clickbench_q19/datafusion:parquet 18907861 / 18806986 / +0.5% 76211511 / 75858232 / +0.5% 0.25 / 0.25 / +0.1%
clickbench_q20/datafusion:parquet 178862886 / 179158122 / -0.2% 275972721 / 282772837 / -2.4% 0.65 / 0.63 / +2.3%
clickbench_q21/datafusion:parquet 174576786 / 175865264 / -0.7% 291327821 / 304381745 / -4.3% 0.60 / 0.58 / +3.7%
clickbench_q22/datafusion:parquet 262751204 / 263212563 / -0.2% 417894203 / 426812163 / -2.1% 0.63 / 0.62 / +2.0%
clickbench_q23/datafusion:parquet 1008333834 / 1010303224 / -0.2% 1182460516 / 1168615826 / +1.2% 0.85 / 0.86 / -1.4%
clickbench_q24/datafusion:parquet 30130505 / 30959201 / -2.7% 87097014 / 89724545 / -2.9% 0.35 / 0.35 / +0.3%
clickbench_q25/datafusion:parquet 36244622 / 37492312 / -3.3% 99696175 / 103518863 / -3.7% 0.36 / 0.36 / +0.4%
clickbench_q26/datafusion:parquet 30177410 / 30930832 / -2.4% 87394756 / 90232437 / -3.1% 0.35 / 0.34 / +0.7%
clickbench_q27/datafusion:parquet 193858866 / 194313128 / -0.2% 284626957 / 293811688 / -3.1% 0.68 / 0.66 / +3.0%
clickbench_q28/datafusion:parquet 620457128 / 620215339 / +0.0% 703947976 / 703226809 / +0.1% 0.88 / 0.88 / -0.1%
clickbench_q29/datafusion:parquet 28943220 / 29053162 / -0.4% 89292289 / 90228679 / -1.0% 0.32 / 0.32 / +0.7%
clickbench_q30/datafusion:parquet 90927850 / 90634953 / +0.3% 166903795 / 172512329 / -3.3% 0.54 / 0.53 / +3.7%
clickbench_q31/datafusion:parquet 104372934 / 102978612 / +1.4% 189142990 / 201811298 / -6.3% 0.55 / 0.51 / +8.1%
clickbench_q32/datafusion:parquet 304964953 / 307592859 / -0.9% 430942912 / 430005908 / +0.2% 0.71 / 0.72 / -1.1%
clickbench_q33/datafusion:parquet 376300458 / 377503658 / -0.3% 486008751 / 473498767 / +2.6% 0.77 / 0.80 / -2.9%
clickbench_q34/datafusion:parquet 378846606 / 378456778 / +0.1% 472709996 / 492172087 / -4.0% 0.80 / 0.77 / +4.2%
clickbench_q35/datafusion:parquet 63058004 / 64363142 / -2.0% 126365133 / 125183922 / +0.9% 0.50 / 0.51 / -2.9%
clickbench_q36/datafusion:parquet 74156374 / 74432110 / -0.4% 134964468 / 137638720 / -1.9% 0.55 / 0.54 / +1.6%
clickbench_q37/datafusion:parquet 35804998 / 35830694 / -0.1% 91409783 / 90497244 / +1.0% 0.39 / 0.40 / -1.1%
clickbench_q38/datafusion:parquet 48501998 / 48120156 / +0.8% 106338865 / 110070324 / -3.4% 0.46 / 0.44 / +4.3%
clickbench_q39/datafusion:parquet 143942160 / 144489486 / -0.4% 207311023 / 211492075 / -2.0% 0.69 / 0.68 / +1.6%
clickbench_q40/datafusion:parquet 19817367 / 20187438 / -1.8% 76505918 / 77776539 / -1.6% 0.26 / 0.26 / -0.2%
clickbench_q41/datafusion:parquet 18825440 / 18652492 / +0.9% 75535361 / 75419442 / +0.2% 0.25 / 0.25 / +0.8%
clickbench_q42/datafusion:parquet 19304854 / 19107080 / +1.0% 74741427 / 74210395 / +0.7% 0.26 / 0.26 / +0.3%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2164640 / 2247960 / -3.7% 26546696 / 24932904 / +6.5% 0.08 / 0.09 / -9.6%
clickbench_q01/duckdb:vortex-file-compressed 7742262 / 7392491 / +4.7% 31326263 / 27828689 / +12.6% 🔴 0.25 / 0.27 / -7.0%
clickbench_q02/duckdb:vortex-file-compressed 9085144 / 9009470 / +0.8% 34325020 / 35181087 / -2.4% 0.26 / 0.26 / +3.4%
clickbench_q03/duckdb:vortex-file-compressed 13900448 / 14043704 / -1.0% 46554073 / 49596812 / -6.1% 0.30 / 0.28 / +5.4%
clickbench_q04/duckdb:vortex-file-compressed 56116540 / 56182325 / -0.1% 85012174 / 89998343 / -5.5% 0.66 / 0.62 / +5.7%
clickbench_q05/duckdb:vortex-file-compressed 64042266 / 63575476 / +0.7% 91779960 / 95159321 / -3.6% 0.70 / 0.67 / +4.4%
clickbench_q06/duckdb:vortex-file-compressed 2618574 / 2618598 / -0.0% 31284223 / 31355421 / -0.2% 0.08 / 0.08 / +0.2%
clickbench_q07/duckdb:vortex-file-compressed 9710696 / 9422074 / +3.1% 31359749 / 29729488 / +5.5% 0.31 / 0.32 / -2.3%
clickbench_q08/duckdb:vortex-file-compressed 68733854 / 69704770 / -1.4% 102181736 / 108099489 / -5.5% 0.67 / 0.64 / +4.3%
clickbench_q09/duckdb:vortex-file-compressed 93103697 / 93513635 / -0.4% 127108264 / 131186545 / -3.1% 0.73 / 0.71 / +2.8%
clickbench_q10/duckdb:vortex-file-compressed 27508348 / 27778896 / -1.0% 64486766 / 71135992 / -9.3% 0.43 / 0.39 / +9.2%
clickbench_q11/duckdb:vortex-file-compressed 30810215 / 30924558 / -0.4% 67917075 / 73926014 / -8.1% 0.45 / 0.42 / +8.4%
clickbench_q12/duckdb:vortex-file-compressed 72562952 / 70863344 / +2.4% 103686911 / 104711007 / -1.0% 0.70 / 0.68 / +3.4%
clickbench_q13/duckdb:vortex-file-compressed 126451926 / 124513079 / +1.6% 160695436 / 169965456 / -5.5% 0.79 / 0.73 / +7.4%
clickbench_q14/duckdb:vortex-file-compressed 73860988 / 73895026 / -0.0% 102616285 / 107543096 / -4.6% 0.72 / 0.69 / +4.8%
clickbench_q15/duckdb:vortex-file-compressed 76843414 / 77399760 / -0.7% 111431285 / 112955060 / -1.3% 0.69 / 0.69 / +0.6%
clickbench_q16/duckdb:vortex-file-compressed 135756818 / 135535088 / +0.2% 175012529 / 176998328 / -1.1% 0.78 / 0.77 / +1.3%
clickbench_q17/duckdb:vortex-file-compressed 139145083 / 139949440 / -0.6% 171307664 / 170349256 / +0.6% 0.81 / 0.82 / -1.1%
clickbench_q18/duckdb:vortex-file-compressed 255166846 / 258700648 / -1.4% 311969284 / 298309151 / +4.6% 0.82 / 0.87 / -5.7%
clickbench_q19/duckdb:vortex-file-compressed 9646814 / 9344642 / +3.2% 38327660 / 37642224 / +1.8% 0.25 / 0.25 / +1.4%
clickbench_q20/duckdb:vortex-file-compressed 68182081 / 67569126 / +0.9% 160787391 / 172983499 / -7.1% 0.42 / 0.39 / +8.6%
clickbench_q21/duckdb:vortex-file-compressed 84620314 / 84668047 / -0.1% 181978041 / 198893768 / -8.5% 0.47 / 0.43 / +9.2%
clickbench_q22/duckdb:vortex-file-compressed 173633738 / 171808943 / +1.1% 330592278 / 356937644 / -7.4% 0.53 / 0.48 / +9.1%
clickbench_q23/duckdb:vortex-file-compressed 41913090 / 41035220 / +2.1% 87514797 / 82659548 / +5.9% 0.48 / 0.50 / -3.5%
clickbench_q24/duckdb:vortex-file-compressed 14082860 / 14173911 / -0.6% 37560563 / 37578837 / -0.0% 0.37 / 0.38 / -0.6%
clickbench_q25/duckdb:vortex-file-compressed 19354786 / 19163314 / +1.0% 52590521 / 55520292 / -5.3% 0.37 / 0.35 / +6.6%
clickbench_q26/duckdb:vortex-file-compressed 11319830 / 11660942 / -2.9% 35611095 / 38514781 / -7.5% 0.32 / 0.30 / +5.0%
clickbench_q27/duckdb:vortex-file-compressed 54887304 / 54038429 / +1.6% 167348643 / 171840254 / -2.6% 0.33 / 0.31 / +4.3%
clickbench_q28/duckdb:vortex-file-compressed 512437704 / 510159272 / +0.4% 557351740 / 564426106 / -1.3% 0.92 / 0.90 / +1.7%
clickbench_q29/duckdb:vortex-file-compressed 17194801 / 17041976 / +0.9% 47179683 / 43792914 / +7.7% 0.36 / 0.39 / -6.3%
clickbench_q30/duckdb:vortex-file-compressed 60613523 / 60465225 / +0.2% 102693408 / 110288308 / -6.9% 0.59 / 0.55 / +7.7%
clickbench_q31/duckdb:vortex-file-compressed 110845810 / 112141066 / -1.2% 164681489 / 178786348 / -7.9% 0.67 / 0.63 / +7.3%
clickbench_q32/duckdb:vortex-file-compressed 358093968 / 361645762 / -1.0% 397472458 / 396159902 / +0.3% 0.90 / 0.91 / -1.3%
clickbench_q33/duckdb:vortex-file-compressed 351237028 / 342859654 / +2.4% 399279618 / 408319898 / -2.2% 0.88 / 0.84 / +4.8%
clickbench_q34/duckdb:vortex-file-compressed 354030392 / 348005220 / +1.7% 409140612 / 411892586 / -0.7% 0.87 / 0.84 / +2.4%
clickbench_q35/duckdb:vortex-file-compressed 57173424 / 57337200 / -0.3% 87069480 / 90332191 / -3.6% 0.66 / 0.63 / +3.5%
clickbench_q36/duckdb:vortex-file-compressed 11964320 / 11476549 / +4.3% 31631823 / 32668305 / -3.2% 0.38 / 0.35 / +7.7%
clickbench_q37/duckdb:vortex-file-compressed 8338586 / 8343448 / -0.1% 29993831 / 29246437 / +2.6% 0.28 / 0.29 / -2.5%
clickbench_q38/duckdb:vortex-file-compressed 8783534 / 9018570 / -2.6% 31334724 / 27269848 / +14.9% 🔴 0.28 / 0.33 / -15.2%
clickbench_q39/duckdb:vortex-file-compressed 18821688 / 19119884 / -1.6% 38082559 / 38814118 / -1.9% 0.49 / 0.49 / +0.3%
clickbench_q40/duckdb:vortex-file-compressed 7375338 / 7634609 / -3.4% 28469255 / 28473036 / -0.0% 0.26 / 0.27 / -3.4%
clickbench_q41/duckdb:vortex-file-compressed 8377534 / 8454632 / -0.9% 29379143 / 29874423 / -1.7% 0.29 / 0.28 / +0.8%
clickbench_q42/duckdb:vortex-file-compressed 7495890 / 7662188 / -2.2% 28573318 / 26542348 / +7.7% 0.26 / 0.29 / -9.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9385045 / 9479664 / -1.0% 14744860 / 14549053 / +1.3% 0.64 / 0.65 / -2.3%
clickbench_q01/duckdb:parquet 15680398 / 15480456 / +1.3% 20560364 / 20313038 / +1.2% 0.76 / 0.76 / +0.1%
clickbench_q02/duckdb:parquet 22415282 / 23082528 / -2.9% 31385522 / 36230161 / -13.4% 🟢 0.71 / 0.64 / +12.1%
clickbench_q03/duckdb:parquet 23152822 / 22680276 / +2.1% 35549617 / 36705535 / -3.1% 0.65 / 0.62 / +5.4%
clickbench_q04/duckdb:parquet 61632888 / 61864322 / -0.4% 72461534 / 73685903 / -1.7% 0.85 / 0.84 / +1.3%
clickbench_q05/duckdb:parquet 83205012 / 83650073 / -0.5% 98169297 / 98818925 / -0.7% 0.85 / 0.85 / +0.1%
clickbench_q06/duckdb:parquet 20215853 / 19938186 / +1.4% 28283240 / 28174374 / +0.4% 0.71 / 0.71 / +1.0%
clickbench_q07/duckdb:parquet 17184310 / 16934032 / +1.5% 22302273 / 24350763 / -8.4% 0.77 / 0.70 / +10.8%
clickbench_q08/duckdb:parquet 73911236 / 74934672 / -1.4% 90869645 / 92465002 / -1.7% 0.81 / 0.81 / +0.4%
clickbench_q09/duckdb:parquet 102340197 / 102960190 / -0.6% 119759467 / 120168779 / -0.3% 0.85 / 0.86 / -0.3%
clickbench_q10/duckdb:parquet 40775382 / 41546404 / -1.9% 55355703 / 57013023 / -2.9% 0.74 / 0.73 / +1.1%
clickbench_q11/duckdb:parquet 46186604 / 46775910 / -1.3% 61213345 / 61644367 / -0.7% 0.75 / 0.76 / -0.6%
clickbench_q12/duckdb:parquet 90886560 / 92406382 / -1.6% 104128790 / 106531454 / -2.3% 0.87 / 0.87 / +0.6%
clickbench_q13/duckdb:parquet 150663052 / 151449332 / -0.5% 167791248 / 169020370 / -0.7% 0.90 / 0.90 / +0.2%
clickbench_q14/duckdb:parquet 100499172 / 101649784 / -1.1% 119641729 / 118398626 / +1.0% 0.84 / 0.86 / -2.2%
clickbench_q15/duckdb:parquet 86358890 / 87357042 / -1.1% 97986171 / 99409166 / -1.4% 0.88 / 0.88 / +0.3%
clickbench_q16/duckdb:parquet 162788798 / 167993034 / -3.1% 177301900 / 175370351 / +1.1% 0.92 / 0.96 / -4.2%
clickbench_q17/duckdb:parquet 160366165 / 166245328 / -3.5% 183029612 / 181437471 / +0.9% 0.88 / 0.92 / -4.4%
clickbench_q18/duckdb:parquet 295916594 / 298883344 / -1.0% 316725542 / 317512545 / -0.2% 0.93 / 0.94 / -0.7%
clickbench_q19/duckdb:parquet 19751726 / 20372058 / -3.0% 26244329 / 27769726 / -5.5% 0.75 / 0.73 / +2.6%
clickbench_q20/duckdb:parquet 189527906 / 190906295 / -0.7% 229150710 / 235569269 / -2.7% 0.83 / 0.81 / +2.1%
clickbench_q21/duckdb:parquet 218634108 / 217507922 / +0.5% 265769013 / 271042297 / -1.9% 0.82 / 0.80 / +2.5%
clickbench_q22/duckdb:parquet 313181312 / 318953918 / -1.8% 356924141 / 366174241 / -2.5% 0.88 / 0.87 / +0.7%
clickbench_q23/duckdb:parquet 177432088 / 171124714 / +3.7% 226385879 / 241552078 / -6.3% 0.78 / 0.71 / +10.6%
clickbench_q24/duckdb:parquet 29617900 / 31151053 / -4.9% 43509221 / 36576613 / +19.0% 🔴 0.68 / 0.85 / -20.1%
clickbench_q25/duckdb:parquet 42222188 / 41867650 / +0.8% 55581553 / 57553100 / -3.4% 0.76 / 0.73 / +4.4%
clickbench_q26/duckdb:parquet 30010598 / 31091940 / -3.5% 48096969 / 46718871 / +2.9% 0.62 / 0.67 / -6.2%
clickbench_q27/duckdb:parquet 181679742 / 187403334 / -3.1% 232349037 / 231000531 / +0.6% 0.78 / 0.81 / -3.6%
clickbench_q28/duckdb:parquet 968234654 / 964320583 / +0.4% 947918160 / 975247971 / -2.8% 1.02 / 0.99 / +3.3%
clickbench_q29/duckdb:parquet 23846598 / 23983915 / -0.6% 30913569 / 32775294 / -5.7% 0.77 / 0.73 / +5.4%
clickbench_q30/duckdb:parquet 105760756 / 104766142 / +0.9% 124807630 / 126640231 / -1.4% 0.85 / 0.83 / +2.4%
clickbench_q31/duckdb:parquet 157229725 / 135742720 / +15.8% 🔴 172866933 / 174670286 / -1.0% 0.91 / 0.78 / +17.0%
clickbench_q32/duckdb:parquet 387460558 / 385160262 / +0.6% 411443203 / 412653630 / -0.3% 0.94 / 0.93 / +0.9%
clickbench_q33/duckdb:parquet 469799412 / 476984610 / -1.5% 447376333 / 479616380 / -6.7% 1.05 / 0.99 / +5.6%
clickbench_q34/duckdb:parquet 469653900 / 468792807 / +0.2% 460574102 / 448441912 / +2.7% 1.02 / 1.05 / -2.5%
clickbench_q35/duckdb:parquet 60779268 / 60762410 / +0.0% 73373659 / 71329636 / +2.9% 0.83 / 0.85 / -2.8%
clickbench_q36/duckdb:parquet 30500371 / 30526270 / -0.1% 35627106 / 35587940 / +0.1% 0.86 / 0.86 / -0.2%
clickbench_q37/duckdb:parquet 23375718 / 23190664 / +0.8% 29475644 / 29749075 / -0.9% 0.79 / 0.78 / +1.7%
clickbench_q38/duckdb:parquet 23615444 / 23140644 / +2.1% 29634204 / 29711566 / -0.3% 0.80 / 0.78 / +2.3%
clickbench_q39/duckdb:parquet 52097371 / 52695854 / -1.1% 59660337 / 61165763 / -2.5% 0.87 / 0.86 / +1.4%
clickbench_q40/duckdb:parquet 14496069 / 14388685 / +0.7% 20576864 / 20727782 / -0.7% 0.70 / 0.69 / +1.5%
clickbench_q41/duckdb:parquet 15785436 / 15359968 / +2.8% 21115661 / 20501214 / +3.0% 0.75 / 0.75 / -0.2%
clickbench_q42/duckdb:parquet 14739962 / 14277115 / +3.2% 19868005 / 20748548 / -4.2% 0.74 / 0.69 / +7.8%
duckdb / duckdb / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11352460 / 11000095 / +3.2% 13991954 / 13562219 / +3.2% 0.81 / 0.81 / +0.0%
clickbench_q01/duckdb:duckdb 26364806 / 26019414 / +1.3% 44076942 / 42841899 / +2.9% 0.60 / 0.61 / -1.5%
clickbench_q02/duckdb:duckdb 22509304 / 22584854 / -0.3% 48057580 / 46891706 / +2.5% 0.47 / 0.48 / -2.8%
clickbench_q03/duckdb:duckdb 21423976 / 21105561 / +1.5% 45510420 / 44807489 / +1.6% 0.47 / 0.47 / -0.1%
clickbench_q04/duckdb:duckdb 74567892 / 74940750 / -0.5% 97035938 / 98506734 / -1.5% 0.77 / 0.76 / +1.0%
clickbench_q05/duckdb:duckdb 79043871 / 80029222 / -1.2% 101017861 / 101202930 / -0.2% 0.78 / 0.79 / -1.1%
clickbench_q06/duckdb:duckdb 21573170 / 21589180 / -0.1% 30268839 / 28718595 / +5.4% 0.71 / 0.75 / -5.2%
clickbench_q07/duckdb:duckdb 17773248 / 17511178 / +1.5% 34207690 / 31876352 / +7.3% 0.52 / 0.55 / -5.4%
clickbench_q08/duckdb:duckdb 88690194 / 88260287 / +0.5% 115501231 / 117617788 / -1.8% 0.77 / 0.75 / +2.3%
clickbench_q09/duckdb:duckdb 97255096 / 97522262 / -0.3% 133710613 / 136718058 / -2.2% 0.73 / 0.71 / +2.0%
clickbench_q10/duckdb:duckdb 52526552 / 52379437 / +0.3% 90411575 / 90494082 / -0.1% 0.58 / 0.58 / +0.4%
clickbench_q11/duckdb:duckdb 55268322 / 55973504 / -1.3% 96312540 / 98954214 / -2.7% 0.57 / 0.57 / +1.4%
clickbench_q12/duckdb:duckdb 82377675 / 82808934 / -0.5% 105844676 / 105104513 / +0.7% 0.78 / 0.79 / -1.2%
clickbench_q13/duckdb:duckdb 145559020 / 144621890 / +0.6% 177695126 / 178724891 / -0.6% 0.82 / 0.81 / +1.2%
clickbench_q14/duckdb:duckdb 90807747 / 91186485 / -0.4% 114751558 / 113457672 / +1.1% 0.79 / 0.80 / -1.5%
clickbench_q15/duckdb:duckdb 83435218 / 83353568 / +0.1% 104427213 / 104993628 / -0.5% 0.80 / 0.79 / +0.6%
clickbench_q16/duckdb:duckdb 166202635 / 175599390 / -5.4% 184052145 / 186695713 / -1.4% 0.90 / 0.94 / -4.0%
clickbench_q17/duckdb:duckdb 152642787 / 153923782 / -0.8% 184707376 / 186261171 / -0.8% 0.83 / 0.83 / +0.0%
clickbench_q18/duckdb:duckdb 303992939 / 302449345 / +0.5% 343813353 / 348514694 / -1.3% 0.88 / 0.87 / +1.9%
clickbench_q19/duckdb:duckdb 17626742 / 17837960 / -1.2% 33218476 / 33569312 / -1.0% 0.53 / 0.53 / -0.1%
clickbench_q20/duckdb:duckdb 181199925 / 191117102 / -5.2% 415145673 / 456373301 / -9.0% 0.44 / 0.42 / +4.2%
clickbench_q21/duckdb:duckdb 173484576 / 177010768 / -2.0% 439026331 / 482679343 / -9.0% 0.40 / 0.37 / +7.8%
clickbench_q22/duckdb:duckdb 186110352 / 186210162 / -0.1% 419513860 / 459811751 / -8.8% 0.44 / 0.40 / +9.5%
clickbench_q23/duckdb:duckdb 68814535 / 70268326 / -2.1% 134060214 / 147730950 / -9.3% 0.51 / 0.48 / +7.9%
clickbench_q24/duckdb:duckdb 30197018 / 30534210 / -1.1% 44346820 / 44624002 / -0.6% 0.68 / 0.68 / -0.5%
clickbench_q25/duckdb:duckdb 40921350 / 40905456 / +0.0% 74692624 / 76605001 / -2.5% 0.55 / 0.53 / +2.6%
clickbench_q26/duckdb:duckdb 30775750 / 30571634 / +0.7% 46895674 / 47036223 / -0.3% 0.66 / 0.65 / +1.0%
clickbench_q27/duckdb:duckdb 152178738 / 158209586 / -3.8% 406967414 / 436315571 / -6.7% 0.37 / 0.36 / +3.1%
clickbench_q28/duckdb:duckdb 845687567 / 820800419 / +3.0% 918334986 / 891437690 / +3.0% 0.92 / 0.92 / +0.0%
clickbench_q29/duckdb:duckdb 27359799 / 27379888 / -0.1% 44368150 / 44557424 / -0.4% 0.62 / 0.61 / +0.4%
clickbench_q30/duckdb:duckdb 100809440 / 100958996 / -0.1% 165426481 / 170560519 / -3.0% 0.61 / 0.59 / +3.0%
clickbench_q31/duckdb:duckdb 170645242 / 172020262 / -0.8% 234864021 / 237631966 / -1.2% 0.73 / 0.72 / +0.4%
clickbench_q32/duckdb:duckdb 469818234 / 483086952 / -2.7% 482965344 / 500076876 / -3.4% 0.97 / 0.97 / +0.7%
clickbench_q33/duckdb:duckdb 439796597 / 450059470 / -2.3% 575703863 / 595122244 / -3.3% 0.76 / 0.76 / +1.0%
clickbench_q34/duckdb:duckdb 484524526 / 484762874 / -0.0% 592349687 / 611118608 / -3.1% 0.82 / 0.79 / +3.1%
clickbench_q35/duckdb:duckdb 74652956 / 75627256 / -1.3% 95696928 / 95212788 / +0.5% 0.78 / 0.79 / -1.8%
clickbench_q36/duckdb:duckdb 32295240 / 33078009 / -2.4% 45270502 / 48151803 / -6.0% 0.71 / 0.69 / +3.8%
clickbench_q37/duckdb:duckdb 16809135 / 17079869 / -1.6% 25628846 / 26664357 / -3.9% 0.66 / 0.64 / +2.4%
clickbench_q38/duckdb:duckdb 19468536 / 18833733 / +3.4% 33158229 / 33400745 / -0.7% 0.59 / 0.56 / +4.1%
clickbench_q39/duckdb:duckdb 54473944 / 54911824 / -0.8% 75538332 / 79207487 / -4.6% 0.72 / 0.69 / +4.0%
clickbench_q40/duckdb:duckdb 16284542 / 16162337 / +0.8% 28253105 / 28607273 / -1.2% 0.58 / 0.56 / +2.0%
clickbench_q41/duckdb:duckdb 15767458 / 15578270 / +1.2% 25598656 / 24598084 / +4.1% 0.62 / 0.63 / -2.7%
clickbench_q42/duckdb:duckdb 16049551 / 15827016 / +1.4% 25679322 / 24401118 / +5.2% 0.62 / 0.65 / -3.6%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20952032 / 21114744 / -0.8% 38023902 / 38409865 / -1.0% 0.55 / 0.55 / +0.2%
tpcds_q02/datafusion:vortex-file-compressed 44176072 / 43632181 / +1.2% 66199124 / 67210666 / -1.5% 0.67 / 0.65 / +2.8%
tpcds_q03/datafusion:vortex-file-compressed 11240620 / 11048232 / +1.7% 27962329 / 27484286 / +1.7% 0.40 / 0.40 / +0.0%
tpcds_q04/datafusion:vortex-file-compressed 86352806 / 86453188 / -0.1% 116489966 / 114152145 / +2.0% 0.74 / 0.76 / -2.1%
tpcds_q05/datafusion:vortex-file-compressed 58211610 / 56672283 / +2.7% 76746598 / 78220338 / -1.9% 0.76 / 0.72 / +4.7%
tpcds_q06/datafusion:vortex-file-compressed 22236564 / 22191532 / +0.2% 43489528 / 43264508 / +0.5% 0.51 / 0.51 / -0.3%
tpcds_q07/datafusion:vortex-file-compressed 28724432 / 28756780 / -0.1% 51749533 / 51231600 / +1.0% 0.56 / 0.56 / -1.1%
tpcds_q08/datafusion:vortex-file-compressed 24944407 / 24582527 / +1.5% 43044961 / 44795475 / -3.9% 0.58 / 0.55 / +5.6%
tpcds_q09/datafusion:vortex-file-compressed 21879718 / 20358276 / +7.5% 38559164 / 37042069 / +4.1% 0.57 / 0.55 / +3.2%
tpcds_q10/datafusion:vortex-file-compressed 26863113 / 26804897 / +0.2% 50322743 / 49947748 / +0.8% 0.53 / 0.54 / -0.5%
tpcds_q11/datafusion:vortex-file-compressed 52755146 / 52094460 / +1.3% 79126974 / 81398378 / -2.8% 0.67 / 0.64 / +4.2%
tpcds_q12/datafusion:vortex-file-compressed 14652167 / 14635482 / +0.1% 32178965 / 31987422 / +0.6% 0.46 / 0.46 / -0.5%
tpcds_q13/datafusion:vortex-file-compressed 31931470 / 31200948 / +2.3% 57383237 / 56250825 / +2.0% 0.56 / 0.55 / +0.3%
tpcds_q14/datafusion:vortex-file-compressed 485636654 / 491264615 / -1.1% 549593342 / 547770191 / +0.3% 0.88 / 0.90 / -1.5%
tpcds_q15/datafusion:vortex-file-compressed 12565214 / 12385456 / +1.5% 33393420 / 34709239 / -3.8% 0.38 / 0.36 / +5.4%
tpcds_q16/datafusion:vortex-file-compressed 18454508 / 18130340 / +1.8% 38173656 / 37508151 / +1.8% 0.48 / 0.48 / +0.0%
tpcds_q17/datafusion:vortex-file-compressed 54491128 / 54848480 / -0.7% 68114340 / 78091082 / -12.8% 🟢 0.80 / 0.70 / +13.9%
tpcds_q18/datafusion:vortex-file-compressed 61830402 / 62688726 / -1.4% 86346814 / 88325380 / -2.2% 0.72 / 0.71 / +0.9%
tpcds_q19/datafusion:vortex-file-compressed 16711884 / 16831512 / -0.7% 37452380 / 38383310 / -2.4% 0.45 / 0.44 / +1.8%
tpcds_q20/datafusion:vortex-file-compressed 16267756 / 16508493 / -1.5% 34543563 / 36121293 / -4.4% 0.47 / 0.46 / +3.0%
tpcds_q21/datafusion:vortex-file-compressed 16693542 / 16495961 / +1.2% 39320806 / 36572617 / +7.5% 0.42 / 0.45 / -5.9%
tpcds_q22/datafusion:vortex-file-compressed 49461374 / 49413880 / +0.1% 70170404 / 73459950 / -4.5% 0.70 / 0.67 / +4.8%
tpcds_q23/datafusion:vortex-file-compressed 69615765 / 69273986 / +0.5% 95183967 / 94914175 / +0.3% 0.73 / 0.73 / +0.2%
tpcds_q24/datafusion:vortex-file-compressed 65063592 / 64756166 / +0.5% 87316751 / 89103679 / -2.0% 0.75 / 0.73 / +2.5%
tpcds_q25/datafusion:vortex-file-compressed 47354506 / 44274453 / +7.0% 77155781 / 75474251 / +2.2% 0.61 / 0.59 / +4.6%
tpcds_q26/datafusion:vortex-file-compressed 25668520 / 25595340 / +0.3% 46454004 / 46365539 / +0.2% 0.55 / 0.55 / +0.1%
tpcds_q27/datafusion:vortex-file-compressed 58952290 / 59770224 / -1.4% 79561019 / 78800172 / +1.0% 0.74 / 0.76 / -2.3%
tpcds_q28/datafusion:vortex-file-compressed 24065780 / 23727618 / +1.4% 42279779 / 44049589 / -4.0% 0.57 / 0.54 / +5.7%
tpcds_q29/datafusion:vortex-file-compressed 49487474 / 54094391 / -8.5% 75719689 / 67031462 / +13.0% 🔴 0.65 / 0.81 / -19.0%
tpcds_q30/datafusion:vortex-file-compressed 25954550 / 26111108 / -0.6% 43933199 / 43417699 / +1.2% 0.59 / 0.60 / -1.8%
tpcds_q31/datafusion:vortex-file-compressed 57689990 / 58121420 / -0.7% 83686503 / 84210946 / -0.6% 0.69 / 0.69 / -0.1%
tpcds_q32/datafusion:vortex-file-compressed 12485684 / 12631842 / -1.2% 30263987 / 30439910 / -0.6% 0.41 / 0.41 / -0.6%
tpcds_q33/datafusion:vortex-file-compressed 27260986 / 27660298 / -1.4% 50088126 / 50174483 / -0.2% 0.54 / 0.55 / -1.3%
tpcds_q34/datafusion:vortex-file-compressed 17353066 / 17569824 / -1.2% 36335787 / 34471423 / +5.4% 0.48 / 0.51 / -6.3%
tpcds_q35/datafusion:vortex-file-compressed 30230394 / 30155204 / +0.2% 54335983 / 56202786 / -3.3% 0.56 / 0.54 / +3.7%
tpcds_q36/datafusion:vortex-file-compressed 46575282 / 47226767 / -1.4% 70041310 / 70418062 / -0.5% 0.66 / 0.67 / -0.8%
tpcds_q37/datafusion:vortex-file-compressed 11478142 / 11561194 / -0.7% 32901530 / 35007745 / -6.0% 0.35 / 0.33 / +5.6%
tpcds_q38/datafusion:vortex-file-compressed 25438400 / 25993867 / -2.1% 47409930 / 47391780 / +0.0% 0.54 / 0.55 / -2.2%
tpcds_q39/datafusion:vortex-file-compressed 65235784 / 64273918 / +1.5% 88342964 / 88645635 / -0.3% 0.74 / 0.73 / +1.8%
tpcds_q40/datafusion:vortex-file-compressed 23261230 / 23018222 / +1.1% 41178187 / 43084523 / -4.4% 0.56 / 0.53 / +5.7%
tpcds_q41/datafusion:vortex-file-compressed 20793757 / 20518272 / +1.3% 33296527 / 32831131 / +1.4% 0.62 / 0.62 / -0.1%
tpcds_q42/datafusion:vortex-file-compressed 10851559 / 11005685 / -1.4% 26928366 / 26734024 / +0.7% 0.40 / 0.41 / -2.1%
tpcds_q43/datafusion:vortex-file-compressed 12282571 / 12359108 / -0.6% 31381710 / 34284935 / -8.5% 0.39 / 0.36 / +8.6%
tpcds_q44/datafusion:vortex-file-compressed 29182604 / 29087842 / +0.3% 51841895 / 56254628 / -7.8% 0.56 / 0.52 / +8.9%
tpcds_q45/datafusion:vortex-file-compressed 16046454 / 16039858 / +0.0% 34724836 / 34730179 / -0.0% 0.46 / 0.46 / +0.1%
tpcds_q46/datafusion:vortex-file-compressed 23062950 / 23118404 / -0.2% 46369592 / 47444792 / -2.3% 0.50 / 0.49 / +2.1%
tpcds_q47/datafusion:vortex-file-compressed 75106346 / 73681461 / +1.9% 103816771 / 107663041 / -3.6% 0.72 / 0.68 / +5.7%
tpcds_q48/datafusion:vortex-file-compressed 28978528 / 28639812 / +1.2% 51996277 / 51657968 / +0.7% 0.56 / 0.55 / +0.5%
tpcds_q49/datafusion:vortex-file-compressed 57299150 / 56566381 / +1.3% 78994663 / 79623564 / -0.8% 0.73 / 0.71 / +2.1%
tpcds_q50/datafusion:vortex-file-compressed 29898315 / 29940949 / -0.1% 52413560 / 53490600 / -2.0% 0.57 / 0.56 / +1.9%
tpcds_q51/datafusion:vortex-file-compressed 66176996 / 66522430 / -0.5% 87978497 / 86959911 / +1.2% 0.75 / 0.76 / -1.7%
tpcds_q52/datafusion:vortex-file-compressed 11392314 / 11252302 / +1.2% 27548380 / 28090707 / -1.9% 0.41 / 0.40 / +3.2%
tpcds_q53/datafusion:vortex-file-compressed 17865024 / 17798998 / +0.4% 37876507 / 39648076 / -4.5% 0.47 / 0.45 / +5.1%
tpcds_q54/datafusion:vortex-file-compressed 31787200 / 31171447 / +2.0% 54800994 / 53922052 / +1.6% 0.58 / 0.58 / +0.3%
tpcds_q55/datafusion:vortex-file-compressed 10916404 / 10767798 / +1.4% 26079074 / 27996221 / -6.8% 0.42 / 0.38 / +8.8%
tpcds_q56/datafusion:vortex-file-compressed 26094370 / 26331356 / -0.9% 47118766 / 49668106 / -5.1% 0.55 / 0.53 / +4.5%
tpcds_q57/datafusion:vortex-file-compressed 62124712 / 60944028 / +1.9% 85875106 / 87918114 / -2.3% 0.72 / 0.69 / +4.4%
tpcds_q58/datafusion:vortex-file-compressed 38579925 / 38180804 / +1.0% 63082757 / 63014721 / +0.1% 0.61 / 0.61 / +0.9%
tpcds_q59/datafusion:vortex-file-compressed 29935790 / 29958256 / -0.1% 55644416 / 55565819 / +0.1% 0.54 / 0.54 / -0.2%
tpcds_q60/datafusion:vortex-file-compressed 26415815 / 26666662 / -0.9% 45914692 / 48317803 / -5.0% 0.58 / 0.55 / +4.2%
tpcds_q61/datafusion:vortex-file-compressed 21366547 / 21867937 / -2.3% 42829334 / 43771362 / -2.2% 0.50 / 0.50 / -0.1%
tpcds_q62/datafusion:vortex-file-compressed 16236652 / 16724903 / -2.9% 34231935 / 35187374 / -2.7% 0.47 / 0.48 / -0.2%
tpcds_q63/datafusion:vortex-file-compressed 17801851 / 17534703 / +1.5% 38806159 / 38287992 / +1.4% 0.46 / 0.46 / +0.2%
tpcds_q64/datafusion:vortex-file-compressed 211139655 / 209993546 / +0.5% 246499554 / 247770248 / -0.5% 0.86 / 0.85 / +1.1%
tpcds_q65/datafusion:vortex-file-compressed 71870206 / 72986140 / -1.5% 95041790 / 93462321 / +1.7% 0.76 / 0.78 / -3.2%
tpcds_q66/datafusion:vortex-file-compressed 50280240 / 50701423 / -0.8% 72146678 / 74582712 / -3.3% 0.70 / 0.68 / +2.5%
tpcds_q67/datafusion:vortex-file-compressed 50914217 / 51026438 / -0.2% 82014037 / 82637586 / -0.8% 0.62 / 0.62 / +0.5%
tpcds_q68/datafusion:vortex-file-compressed 22954852 / 22871673 / +0.4% 46630835 / 47744355 / -2.3% 0.49 / 0.48 / +2.8%
tpcds_q69/datafusion:vortex-file-compressed 25189938 / 25172484 / +0.1% 47042322 / 48955112 / -3.9% 0.54 / 0.51 / +4.1%
tpcds_q70/datafusion:vortex-file-compressed 71162576 / 71335496 / -0.2% 92697406 / 95031973 / -2.5% 0.77 / 0.75 / +2.3%
tpcds_q71/datafusion:vortex-file-compressed 19088208 / 18269662 / +4.5% 38867034 / 41443902 / -6.2% 0.49 / 0.44 / +11.4%
tpcds_q72/datafusion:vortex-file-compressed 355956538 / 339411435 / +4.9% 392962676 / 385872260 / +1.8% 0.91 / 0.88 / +3.0%
tpcds_q73/datafusion:vortex-file-compressed 16291047 / 16098136 / +1.2% 35480030 / 35018217 / +1.3% 0.46 / 0.46 / -0.1%
tpcds_q74/datafusion:vortex-file-compressed 40554478 / 40421686 / +0.3% 68146993 / 69159616 / -1.5% 0.60 / 0.58 / +1.8%
tpcds_q75/datafusion:vortex-file-compressed 134016885 / 135810188 / -1.3% 167475457 / 164109779 / +2.1% 0.80 / 0.83 / -3.3%
tpcds_q76/datafusion:vortex-file-compressed 29297820 / 29355768 / -0.2% 45049345 / 48613591 / -7.3% 0.65 / 0.60 / +7.7%
tpcds_q77/datafusion:vortex-file-compressed 44760371 / 43864489 / +2.0% 67586271 / 67452035 / +0.2% 0.66 / 0.65 / +1.8%
tpcds_q78/datafusion:vortex-file-compressed 63695442 / 64102202 / -0.6% 91937054 / 91390517 / +0.6% 0.69 / 0.70 / -1.2%
tpcds_q79/datafusion:vortex-file-compressed 19650410 / 19626097 / +0.1% 41949104 / 42828685 / -2.1% 0.47 / 0.46 / +2.2%
tpcds_q80/datafusion:vortex-file-compressed 72711550 / 72963011 / -0.3% 100695321 / 106505204 / -5.5% 0.72 / 0.69 / +5.4%
tpcds_q81/datafusion:vortex-file-compressed 26393564 / 26282650 / +0.4% 43958991 / 44292838 / -0.8% 0.60 / 0.59 / +1.2%
tpcds_q82/datafusion:vortex-file-compressed 11641310 / 12243290 / -4.9% 34168545 / 34755450 / -1.7% 0.34 / 0.35 / -3.3%
tpcds_q83/datafusion:vortex-file-compressed 33069806 / 32872388 / +0.6% 53075060 / 52144861 / +1.8% 0.62 / 0.63 / -1.2%
tpcds_q84/datafusion:vortex-file-compressed 10140317 / 10063871 / +0.8% 25322068 / 26306807 / -3.7% 0.40 / 0.38 / +4.7%
tpcds_q85/datafusion:vortex-file-compressed 53361902 / 52648506 / +1.4% 79730157 / 78477264 / +1.6% 0.67 / 0.67 / -0.2%
tpcds_q86/datafusion:vortex-file-compressed 15609874 / 15839204 / -1.4% 33521506 / 33263288 / +0.8% 0.47 / 0.48 / -2.2%
tpcds_q87/datafusion:vortex-file-compressed 26006094 / 26089162 / -0.3% 48666758 / 49005543 / -0.7% 0.53 / 0.53 / +0.4%
tpcds_q88/datafusion:vortex-file-compressed 31407289 / 31561049 / -0.5% 50376896 / 53448448 / -5.7% 0.62 / 0.59 / +5.6%
tpcds_q89/datafusion:vortex-file-compressed 20939126 / 20862739 / +0.4% 40118457 / 41426472 / -3.2% 0.52 / 0.50 / +3.6%
tpcds_q90/datafusion:vortex-file-compressed 10026068 / 9868787 / +1.6% 24206135 / 24516636 / -1.3% 0.41 / 0.40 / +2.9%
tpcds_q91/datafusion:vortex-file-compressed 16000086 / 16654137 / -3.9% 37408616 / 37528665 / -0.3% 0.43 / 0.44 / -3.6%
tpcds_q92/datafusion:vortex-file-compressed 13022772 / 12873310 / +1.2% 28270924 / 28862649 / -2.1% 0.46 / 0.45 / +3.3%
tpcds_q93/datafusion:vortex-file-compressed 20199469 / 20214380 / -0.1% 39950738 / 39768709 / +0.5% 0.51 / 0.51 / -0.5%
tpcds_q94/datafusion:vortex-file-compressed 18367540 / 18184276 / +1.0% 37378646 / 38070283 / -1.8% 0.49 / 0.48 / +2.9%
tpcds_q95/datafusion:vortex-file-compressed 42702494 / 41778124 / +2.2% 64148646 / 62984799 / +1.8% 0.67 / 0.66 / +0.4%
tpcds_q96/datafusion:vortex-file-compressed 7562380 / 7635702 / -1.0% 25248588 / 25399014 / -0.6% 0.30 / 0.30 / -0.4%
tpcds_q97/datafusion:vortex-file-compressed 16921598 / 17188747 / -1.6% 36402117 / 38369433 / -5.1% 0.46 / 0.45 / +3.8%
tpcds_q98/datafusion:vortex-file-compressed 16403894 / 16553432 / -0.9% 35538728 / 37482292 / -5.2% 0.46 / 0.44 / +4.5%
tpcds_q99/datafusion:vortex-file-compressed 15819196 / 15926305 / -0.7% 34567675 / 34719945 / -0.4% 0.46 / 0.46 / -0.2%
datafusion / vortex-compact / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21186531 / 21370229 / -0.9% 38567454 / 38863011 / -0.8% 0.55 / 0.55 / -0.1%
tpcds_q02/datafusion:vortex-compact 43804234 / 44352166 / -1.2% 66103282 / 65797155 / +0.5% 0.66 / 0.67 / -1.7%
tpcds_q03/datafusion:vortex-compact 11725229 / 11408496 / +2.8% 32576034 / 31667064 / +2.9% 0.36 / 0.36 / -0.1%
tpcds_q04/datafusion:vortex-compact 93140106 / 92356457 / +0.8% 124303903 / 122535318 / +1.4% 0.75 / 0.75 / -0.6%
tpcds_q05/datafusion:vortex-compact 56192028 / 56561886 / -0.7% 78339837 / 78848186 / -0.6% 0.72 / 0.72 / -0.0%
tpcds_q06/datafusion:vortex-compact 23962788 / 23832422 / +0.5% 45062870 / 45775002 / -1.6% 0.53 / 0.52 / +2.1%
tpcds_q07/datafusion:vortex-compact 31258592 / 31006980 / +0.8% 51793829 / 51734319 / +0.1% 0.60 / 0.60 / +0.7%
tpcds_q08/datafusion:vortex-compact 27251792 / 27259778 / -0.0% 48927354 / 48896535 / +0.1% 0.56 / 0.56 / -0.1%
tpcds_q09/datafusion:vortex-compact 25112310 / 23210498 / +8.2% 43237392 / 46705484 / -7.4% 0.58 / 0.50 / +16.9%
tpcds_q10/datafusion:vortex-compact 29764802 / 29440834 / +1.1% 52308299 / 51273557 / +2.0% 0.57 / 0.57 / -0.9%
tpcds_q11/datafusion:vortex-compact 55831229 / 57017766 / -2.1% 86196914 / 82027827 / +5.1% 0.65 / 0.70 / -6.8%
tpcds_q12/datafusion:vortex-compact 18525442 / 18800689 / -1.5% 37663946 / 37675704 / -0.0% 0.49 / 0.50 / -1.4%
tpcds_q13/datafusion:vortex-compact 47038404 / 46899445 / +0.3% 67399874 / 68322699 / -1.4% 0.70 / 0.69 / +1.7%
tpcds_q14/datafusion:vortex-compact 633737496 / 633714432 / +0.0% 695349296 / 690609243 / +0.7% 0.91 / 0.92 / -0.7%
tpcds_q15/datafusion:vortex-compact 14430420 / 14030350 / +2.9% 35376760 / 34136164 / +3.6% 0.41 / 0.41 / -0.8%
tpcds_q16/datafusion:vortex-compact 19412662 / 19423296 / -0.1% 40734062 / 39875954 / +2.2% 0.48 / 0.49 / -2.2%
tpcds_q17/datafusion:vortex-compact 57854187 / 57989252 / -0.2% 83278229 / 82451628 / +1.0% 0.69 / 0.70 / -1.2%
tpcds_q18/datafusion:vortex-compact 60732481 / 60281084 / +0.7% 81225163 / 81581423 / -0.4% 0.75 / 0.74 / +1.2%
tpcds_q19/datafusion:vortex-compact 18490896 / 19181674 / -3.6% 40740806 / 40307861 / +1.1% 0.45 / 0.48 / -4.6%
tpcds_q20/datafusion:vortex-compact 20378345 / 19927211 / +2.3% 42453137 / 41214134 / +3.0% 0.48 / 0.48 / -0.7%
tpcds_q21/datafusion:vortex-compact 17460486 / 18062114 / -3.3% 41467603 / 39852117 / +4.1% 0.42 / 0.45 / -7.1%
tpcds_q22/datafusion:vortex-compact 49422055 / 50666976 / -2.5% 73919042 / 75468186 / -2.1% 0.67 / 0.67 / -0.4%
tpcds_q23/datafusion:vortex-compact 73575622 / 71248646 / +3.3% 97658324 / 99212735 / -1.6% 0.75 / 0.72 / +4.9%
tpcds_q24/datafusion:vortex-compact 72442062 / 71377824 / +1.5% 92994410 / 97183011 / -4.3% 0.78 / 0.73 / +6.1%
tpcds_q25/datafusion:vortex-compact 52531697 / 52645832 / -0.2% 83144229 / 69573481 / +19.5% 🔴 0.63 / 0.76 / -16.5%
tpcds_q26/datafusion:vortex-compact 27860289 / 27960713 / -0.4% 49214096 / 47466538 / +3.7% 0.57 / 0.59 / -3.9%
tpcds_q27/datafusion:vortex-compact 60851707 / 58922784 / +3.3% 77932563 / 79265052 / -1.7% 0.78 / 0.74 / +5.0%
tpcds_q28/datafusion:vortex-compact 29191852 / 28980316 / +0.7% 48242854 / 46530998 / +3.7% 0.61 / 0.62 / -2.8%
tpcds_q29/datafusion:vortex-compact 49363012 / 56211740 / -12.2% 🟢 78415172 / 79651115 / -1.6% 0.63 / 0.71 / -10.8%
tpcds_q30/datafusion:vortex-compact 27468671 / 27975284 / -1.8% 47847799 / 45433835 / +5.3% 0.57 / 0.62 / -6.8%
tpcds_q31/datafusion:vortex-compact 61816712 / 61277806 / +0.9% 87504451 / 86384308 / +1.3% 0.71 / 0.71 / -0.4%
tpcds_q32/datafusion:vortex-compact 13708094 / 13623252 / +0.6% 33289571 / 33276389 / +0.0% 0.41 / 0.41 / +0.6%
tpcds_q33/datafusion:vortex-compact 27593950 / 28217454 / -2.2% 52617197 / 53851876 / -2.3% 0.52 / 0.52 / +0.1%
tpcds_q34/datafusion:vortex-compact 18840160 / 18805503 / +0.2% 36648827 / 37440449 / -2.1% 0.51 / 0.50 / +2.3%
tpcds_q35/datafusion:vortex-compact 33597296 / 33976093 / -1.1% 57666231 / 57711973 / -0.1% 0.58 / 0.59 / -1.0%
tpcds_q36/datafusion:vortex-compact 49081401 / 48908544 / +0.4% 74147054 / 75483291 / -1.8% 0.66 / 0.65 / +2.2%
tpcds_q37/datafusion:vortex-compact 14134780 / 14507832 / -2.6% 37058817 / 37766183 / -1.9% 0.38 / 0.38 / -0.7%
tpcds_q38/datafusion:vortex-compact 26020844 / 26167428 / -0.6% 48809602 / 49419257 / -1.2% 0.53 / 0.53 / +0.7%
tpcds_q39/datafusion:vortex-compact 66016912 / 66497957 / -0.7% 92437959 / 87991351 / +5.1% 0.71 / 0.76 / -5.5%
tpcds_q40/datafusion:vortex-compact 24014605 / 24161410 / -0.6% 45336050 / 46807451 / -3.1% 0.53 / 0.52 / +2.6%
tpcds_q41/datafusion:vortex-compact 21267350 / 20805936 / +2.2% 35897079 / 36575093 / -1.9% 0.59 / 0.57 / +4.1%
tpcds_q42/datafusion:vortex-compact 11131870 / 11358892 / -2.0% 30984648 / 31207178 / -0.7% 0.36 / 0.36 / -1.3%
tpcds_q43/datafusion:vortex-compact 12897792 / 13205810 / -2.3% 32434328 / 31520819 / +2.9% 0.40 / 0.42 / -5.1%
tpcds_q44/datafusion:vortex-compact 29877759 / 30248250 / -1.2% 51326763 / 51162876 / +0.3% 0.58 / 0.59 / -1.5%
tpcds_q45/datafusion:vortex-compact 17722028 / 17832215 / -0.6% 37188316 / 37424743 / -0.6% 0.48 / 0.48 / +0.0%
tpcds_q46/datafusion:vortex-compact 25055634 / 25072438 / -0.1% 45304510 / 48263349 / -6.1% 0.55 / 0.52 / +6.5%
tpcds_q47/datafusion:vortex-compact 78879599 / 78610392 / +0.3% 109909357 / 115284884 / -4.7% 0.72 / 0.68 / +5.3%
tpcds_q48/datafusion:vortex-compact 42941564 / 43953624 / -2.3% 62152576 / 62710003 / -0.9% 0.69 / 0.70 / -1.4%
tpcds_q49/datafusion:vortex-compact 59710572 / 59713398 / -0.0% 82750688 / 82814675 / -0.1% 0.72 / 0.72 / +0.1%
tpcds_q50/datafusion:vortex-compact 31271676 / 31720909 / -1.4% 52628639 / 51452178 / +2.3% 0.59 / 0.62 / -3.6%
tpcds_q51/datafusion:vortex-compact 66714908 / 66818835 / -0.2% 86779531 / 88032318 / -1.4% 0.77 / 0.76 / +1.3%
tpcds_q52/datafusion:vortex-compact 11452852 / 11672758 / -1.9% 30042935 / 31215413 / -3.8% 0.38 / 0.37 / +1.9%
tpcds_q53/datafusion:vortex-compact 20587244 / 20752026 / -0.8% 42922919 / 43444539 / -1.2% 0.48 / 0.48 / +0.4%
tpcds_q54/datafusion:vortex-compact 33628830 / 34124154 / -1.5% 60102779 / 60303411 / -0.3% 0.56 / 0.57 / -1.1%
tpcds_q55/datafusion:vortex-compact 11112748 / 10983358 / +1.2% 29450687 / 31007799 / -5.0% 0.38 / 0.35 / +6.5%
tpcds_q56/datafusion:vortex-compact 26630442 / 25966672 / +2.6% 49613006 / 49917222 / -0.6% 0.54 / 0.52 / +3.2%
tpcds_q57/datafusion:vortex-compact 65787668 / 66005270 / -0.3% 93081666 / 96098326 / -3.1% 0.71 / 0.69 / +2.9%
tpcds_q58/datafusion:vortex-compact 42026611 / 41712031 / +0.8% 68829685 / 68990357 / -0.2% 0.61 / 0.60 / +1.0%
tpcds_q59/datafusion:vortex-compact 32483502 / 32390769 / +0.3% 56175456 / 55285126 / +1.6% 0.58 / 0.59 / -1.3%
tpcds_q60/datafusion:vortex-compact 26245280 / 26186923 / +0.2% 49584324 / 49098706 / +1.0% 0.53 / 0.53 / -0.8%
tpcds_q61/datafusion:vortex-compact 23709592 / 22658020 / +4.6% 42784940 / 46505747 / -8.0% 0.55 / 0.49 / +13.7%
tpcds_q62/datafusion:vortex-compact 17018017 / 16635905 / +2.3% 35833906 / 36943807 / -3.0% 0.47 / 0.45 / +5.5%
tpcds_q63/datafusion:vortex-compact 20769498 / 20671932 / +0.5% 40501113 / 42367782 / -4.4% 0.51 / 0.49 / +5.1%
tpcds_q64/datafusion:vortex-compact 301950572 / 301299912 / +0.2% 332435009 / 334217070 / -0.5% 0.91 / 0.90 / +0.8%
tpcds_q65/datafusion:vortex-compact 75632246 / 74948016 / +0.9% 99124669 / 99284827 / -0.2% 0.76 / 0.75 / +1.1%
tpcds_q66/datafusion:vortex-compact 50567884 / 50552214 / +0.0% 73357280 / 73726127 / -0.5% 0.69 / 0.69 / +0.5%
tpcds_q67/datafusion:vortex-compact 51861890 / 51906718 / -0.1% 84898941 / 85871069 / -1.1% 0.61 / 0.60 / +1.1%
tpcds_q68/datafusion:vortex-compact 25214340 / 24866970 / +1.4% 47740653 / 48518263 / -1.6% 0.53 / 0.51 / +3.0%
tpcds_q69/datafusion:vortex-compact 29173458 / 29253098 / -0.3% 53665416 / 52128201 / +2.9% 0.54 / 0.56 / -3.1%
tpcds_q70/datafusion:vortex-compact 71230590 / 72164986 / -1.3% 94152945 / 93433045 / +0.8% 0.76 / 0.77 / -2.0%
tpcds_q71/datafusion:vortex-compact 18408973 / 19970280 / -7.8% 39546609 / 40426309 / -2.2% 0.47 / 0.49 / -5.8%
tpcds_q72/datafusion:vortex-compact 353878375 / 362603836 / -2.4% 422276986 / 380283016 / +11.0% 🔴 0.84 / 0.95 / -12.1%
tpcds_q73/datafusion:vortex-compact 17588272 / 17359854 / +1.3% 37999672 / 38068351 / -0.2% 0.46 / 0.46 / +1.5%
tpcds_q74/datafusion:vortex-compact 41912742 / 41534497 / +0.9% 67330328 / 68792585 / -2.1% 0.62 / 0.60 / +3.1%
tpcds_q75/datafusion:vortex-compact 136737403 / 142644585 / -4.1% 170166565 / 164664045 / +3.3% 0.80 / 0.87 / -7.2%
tpcds_q76/datafusion:vortex-compact 30135724 / 30223192 / -0.3% 49727800 / 51223867 / -2.9% 0.61 / 0.59 / +2.7%
tpcds_q77/datafusion:vortex-compact 45493100 / 45573311 / -0.2% 66586752 / 67306209 / -1.1% 0.68 / 0.68 / +0.9%
tpcds_q78/datafusion:vortex-compact 65849961 / 66190370 / -0.5% 93731940 / 93064410 / +0.7% 0.70 / 0.71 / -1.2%
tpcds_q79/datafusion:vortex-compact 21640394 / 21519586 / +0.6% 41428568 / 42355186 / -2.2% 0.52 / 0.51 / +2.8%
tpcds_q80/datafusion:vortex-compact 74506508 / 73693060 / +1.1% 107269524 / 106658245 / +0.6% 0.69 / 0.69 / +0.5%
tpcds_q81/datafusion:vortex-compact 26923220 / 27631474 / -2.6% 45426264 / 43914485 / +3.4% 0.59 / 0.63 / -5.8%
tpcds_q82/datafusion:vortex-compact 13366352 / 14046627 / -4.8% 35754669 / 36450862 / -1.9% 0.37 / 0.39 / -3.0%
tpcds_q83/datafusion:vortex-compact 33189168 / 33964153 / -2.3% 54381672 / 54617283 / -0.4% 0.61 / 0.62 / -1.9%
tpcds_q84/datafusion:vortex-compact 11608622 / 11274943 / +3.0% 26187035 / 26660698 / -1.8% 0.44 / 0.42 / +4.8%
tpcds_q85/datafusion:vortex-compact 95695420 / 94615409 / +1.1% 122037577 / 121066026 / +0.8% 0.78 / 0.78 / +0.3%
tpcds_q86/datafusion:vortex-compact 15536391 / 15760078 / -1.4% 33486391 / 34264605 / -2.3% 0.46 / 0.46 / +0.9%
tpcds_q87/datafusion:vortex-compact 26518055 / 26208790 / +1.2% 48247008 / 47594003 / +1.4% 0.55 / 0.55 / -0.2%
tpcds_q88/datafusion:vortex-compact 36408734 / 36279142 / +0.4% 57251926 / 59622192 / -4.0% 0.64 / 0.61 / +4.5%
tpcds_q89/datafusion:vortex-compact 22873698 / 22613943 / +1.1% 45409768 / 46575885 / -2.5% 0.50 / 0.49 / +3.7%
tpcds_q90/datafusion:vortex-compact 10311792 / 10299466 / +0.1% 26942906 / 26701162 / +0.9% 0.38 / 0.39 / -0.8%
tpcds_q91/datafusion:vortex-compact 24804084 / 24608196 / +0.8% 43760423 / 44356927 / -1.3% 0.57 / 0.55 / +2.2%
tpcds_q92/datafusion:vortex-compact 13857606 / 13899352 / -0.3% 30385981 / 30674357 / -0.9% 0.46 / 0.45 / +0.6%
tpcds_q93/datafusion:vortex-compact 20977380 / 20342396 / +3.1% 42421108 / 41720818 / +1.7% 0.49 / 0.49 / +1.4%
tpcds_q94/datafusion:vortex-compact 19274062 / 19206160 / +0.4% 39336345 / 38414414 / +2.4% 0.49 / 0.50 / -2.0%
tpcds_q95/datafusion:vortex-compact 42262844 / 42823149 / -1.3% 64087263 / 64111113 / -0.0% 0.66 / 0.67 / -1.3%
tpcds_q96/datafusion:vortex-compact 8814464 / 8562048 / +2.9% 26487781 / 27308278 / -3.0% 0.33 / 0.31 / +6.1%
tpcds_q97/datafusion:vortex-compact 17170048 / 17134060 / +0.2% 37117843 / 37723313 / -1.6% 0.46 / 0.45 / +1.8%
tpcds_q98/datafusion:vortex-compact 20672416 / 20488018 / +0.9% 42467531 / 43104986 / -1.5% 0.49 / 0.48 / +2.4%
tpcds_q99/datafusion:vortex-compact 16743529 / 16653472 / +0.5% 35676100 / 36137417 / -1.3% 0.47 / 0.46 / +1.8%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42532602 / 43421452 / -2.0% 60245017 / 62073504 / -2.9% 0.71 / 0.70 / +0.9%
tpcds_q02/datafusion:parquet 54476042 / 54449617 / +0.0% 69590918 / 70975775 / -2.0% 0.78 / 0.77 / +2.0%
tpcds_q03/datafusion:parquet 18734145 / 19375196 / -3.3% 29972534 / 30038755 / -0.2% 0.63 / 0.65 / -3.1%
tpcds_q04/datafusion:parquet 177925269 / 178138866 / -0.1% 206777681 / 208240289 / -0.7% 0.86 / 0.86 / +0.6%
tpcds_q05/datafusion:parquet 68526438 / 68440962 / +0.1% 88889524 / 90582667 / -1.9% 0.77 / 0.76 / +2.0%
tpcds_q06/datafusion:parquet 34011064 / 33722628 / +0.9% 46520317 / 48928351 / -4.9% 0.73 / 0.69 / +6.1%
tpcds_q07/datafusion:parquet 46601958 / 46773416 / -0.4% 64922116 / 65414777 / -0.8% 0.72 / 0.72 / +0.4%
tpcds_q08/datafusion:parquet 31262464 / 31398046 / -0.4% 48167084 / 49887160 / -3.4% 0.65 / 0.63 / +3.1%
tpcds_q09/datafusion:parquet 32195242 / 31362460 / +2.7% 38690976 / 46081430 / -16.0% 🟢 0.83 / 0.68 / +22.3%
tpcds_q10/datafusion:parquet 43943388 / 44895212 / -2.1% 59154298 / 61179345 / -3.3% 0.74 / 0.73 / +1.2%
tpcds_q11/datafusion:parquet 95609764 / 98182134 / -2.6% 119012415 / 116524274 / +2.1% 0.80 / 0.84 / -4.7%
tpcds_q12/datafusion:parquet 23540276 / 23708872 / -0.7% 35398655 / 36136475 / -2.0% 0.67 / 0.66 / +1.4%
tpcds_q13/datafusion:parquet 46201008 / 46132512 / +0.1% 67401621 / 67216183 / +0.3% 0.69 / 0.69 / -0.1%
tpcds_q14/datafusion:parquet 535304271 / 534540110 / +0.1% 577394067 / 584604125 / -1.2% 0.93 / 0.91 / +1.4%
tpcds_q15/datafusion:parquet 23551582 / 23764986 / -0.9% 38046191 / 39404323 / -3.4% 0.62 / 0.60 / +2.6%
tpcds_q16/datafusion:parquet 36988894 / 36905866 / +0.2% 49357185 / 52006060 / -5.1% 0.75 / 0.71 / +5.6%
tpcds_q17/datafusion:parquet 73473252 / 73383685 / +0.1% 98940658 / 95955306 / +3.1% 0.74 / 0.76 / -2.9%
tpcds_q18/datafusion:parquet 67018541 / 65306157 / +2.6% 93429456 / 91680756 / +1.9% 0.72 / 0.71 / +0.7%
tpcds_q19/datafusion:parquet 29336368 / 29555548 / -0.7% 42653494 / 43371536 / -1.7% 0.69 / 0.68 / +0.9%
tpcds_q20/datafusion:parquet 25296536 / 25354283 / -0.2% 35533331 / 38116765 / -6.8% 0.71 / 0.67 / +7.0%
tpcds_q21/datafusion:parquet 20318760 / 20292198 / +0.1% 32472119 / 30472915 / +6.6% 0.63 / 0.67 / -6.0%
tpcds_q22/datafusion:parquet 77656582 / 77756046 / -0.1% 87498799 / 89169997 / -1.9% 0.89 / 0.87 / +1.8%
tpcds_q23/datafusion:parquet 91852284 / 94205582 / -2.5% 112715989 / 115281375 / -2.2% 0.81 / 0.82 / -0.3%
tpcds_q24/datafusion:parquet 90665354 / 90001920 / +0.7% 115007868 / 114437562 / +0.5% 0.79 / 0.79 / +0.2%
tpcds_q25/datafusion:parquet 80737988 / 80810192 / -0.1% 98541855 / 101351509 / -2.8% 0.82 / 0.80 / +2.8%
tpcds_q26/datafusion:parquet 44142820 / 43411055 / +1.7% 59665632 / 62497579 / -4.5% 0.74 / 0.69 / +6.5%
tpcds_q27/datafusion:parquet 74240720 / 75179473 / -1.2% 101350921 / 93943976 / +7.9% 0.73 / 0.80 / -8.5%
tpcds_q28/datafusion:parquet 28452130 / 28777717 / -1.1% 42356426 / 45350910 / -6.6% 0.67 / 0.63 / +5.9%
tpcds_q29/datafusion:parquet 76310922 / 75045236 / +1.7% 97250525 / 97961242 / -0.7% 0.78 / 0.77 / +2.4%
tpcds_q30/datafusion:parquet 45312310 / 45551915 / -0.5% 56784908 / 59317738 / -4.3% 0.80 / 0.77 / +3.9%
tpcds_q31/datafusion:parquet 81008018 / 81905615 / -1.1% 96461872 / 100636327 / -4.1% 0.84 / 0.81 / +3.2%
tpcds_q32/datafusion:parquet 26763371 / 26139234 / +2.4% 40861517 / 39710750 / +2.9% 0.65 / 0.66 / -0.5%
tpcds_q33/datafusion:parquet 37384093 / 37148874 / +0.6% 51809127 / 53797597 / -3.7% 0.72 / 0.69 / +4.5%
tpcds_q34/datafusion:parquet 24237279 / 24172736 / +0.3% 35567041 / 35823880 / -0.7% 0.68 / 0.67 / +1.0%
tpcds_q35/datafusion:parquet 50687520 / 51194224 / -1.0% 63467946 / 65463508 / -3.0% 0.80 / 0.78 / +2.1%
tpcds_q36/datafusion:parquet 51925720 / 52839460 / -1.7% 71050098 / 74957889 / -5.2% 0.73 / 0.70 / +3.7%
tpcds_q37/datafusion:parquet 21404090 / 21464966 / -0.3% 33770360 / 35167535 / -4.0% 0.63 / 0.61 / +3.8%
tpcds_q38/datafusion:parquet 45201691 / 44737682 / +1.0% 60757546 / 63079769 / -3.7% 0.74 / 0.71 / +4.9%
tpcds_q39/datafusion:parquet 67921083 / 68137348 / -0.3% 86356082 / 86739691 / -0.4% 0.79 / 0.79 / +0.1%
tpcds_q40/datafusion:parquet 31286941 / 31197494 / +0.3% 48979068 / 51175944 / -4.3% 0.64 / 0.61 / +4.8%
tpcds_q41/datafusion:parquet 19656194 / 20060249 / -2.0% 32248901 / 32335532 / -0.3% 0.61 / 0.62 / -1.8%
tpcds_q42/datafusion:parquet 18088966 / 18254584 / -0.9% 28516346 / 30288929 / -5.9% 0.63 / 0.60 / +5.3%
tpcds_q43/datafusion:parquet 19155890 / 19069470 / +0.5% 31306876 / 32719507 / -4.3% 0.61 / 0.58 / +5.0%
tpcds_q44/datafusion:parquet 35923562 / 35332067 / +1.7% 50518524 / 51546202 / -2.0% 0.71 / 0.69 / +3.7%
tpcds_q45/datafusion:parquet 27841146 / 28207856 / -1.3% 45816535 / 41057626 / +11.6% 🔴 0.61 / 0.69 / -11.6%
tpcds_q46/datafusion:parquet 28657315 / 28902842 / -0.8% 45558614 / 45997352 / -1.0% 0.63 / 0.63 / +0.1%
tpcds_q47/datafusion:parquet 96826997 / 95956306 / +0.9% 119360249 / 119483634 / -0.1% 0.81 / 0.80 / +1.0%
tpcds_q48/datafusion:parquet 42017178 / 41802790 / +0.5% 57756605 / 62310810 / -7.3% 0.73 / 0.67 / +8.4%
tpcds_q49/datafusion:parquet 71361600 / 72109845 / -1.0% 98501573 / 92777951 / +6.2% 0.72 / 0.78 / -6.8%
tpcds_q50/datafusion:parquet 46702492 / 46673753 / +0.1% 67535397 / 66022257 / +2.3% 0.69 / 0.71 / -2.2%
tpcds_q51/datafusion:parquet 75313074 / 74910860 / +0.5% 93845896 / 94213072 / -0.4% 0.80 / 0.80 / +0.9%
tpcds_q52/datafusion:parquet 18792388 / 18800656 / -0.0% 29236361 / 29334676 / -0.3% 0.64 / 0.64 / +0.3%
tpcds_q53/datafusion:parquet 22828204 / 23258509 / -1.9% 38120475 / 39184896 / -2.7% 0.60 / 0.59 / +0.9%
tpcds_q54/datafusion:parquet 53601526 / 53209036 / +0.7% 68389017 / 67393454 / +1.5% 0.78 / 0.79 / -0.7%
tpcds_q55/datafusion:parquet 17899685 / 18266064 / -2.0% 28555973 / 30746111 / -7.1% 0.63 / 0.59 / +5.5%
tpcds_q56/datafusion:parquet 40394302 / 41111550 / -1.7% 53596410 / 58664390 / -8.6% 0.75 / 0.70 / +7.5%
tpcds_q57/datafusion:parquet 100701438 / 101080120 / -0.4% 119512935 / 118766000 / +0.6% 0.84 / 0.85 / -1.0%
tpcds_q58/datafusion:parquet 65793180 / 65241866 / +0.8% 83339769 / 83138947 / +0.2% 0.79 / 0.78 / +0.6%
tpcds_q59/datafusion:parquet 47820868 / 47482010 / +0.7% 63288509 / 63273300 / +0.0% 0.76 / 0.75 / +0.7%
tpcds_q60/datafusion:parquet 41777700 / 39090972 / +6.9% 53059091 / 54416623 / -2.5% 0.79 / 0.72 / +9.6%
tpcds_q61/datafusion:parquet 36403258 / 37572550 / -3.1% 51685255 / 52030541 / -0.7% 0.70 / 0.72 / -2.5%
tpcds_q62/datafusion:parquet 24944378 / 25458044 / -2.0% 36670930 / 38025130 / -3.6% 0.68 / 0.67 / +1.6%
tpcds_q63/datafusion:parquet 22207788 / 22164552 / +0.2% 37887898 / 39090215 / -3.1% 0.59 / 0.57 / +3.4%
tpcds_q64/datafusion:parquet 286488856 / 285136522 / +0.5% 322271184 / 324107615 / -0.6% 0.89 / 0.88 / +1.0%
tpcds_q65/datafusion:parquet 122436004 / 119637958 / +2.3% 133742894 / 138485106 / -3.4% 0.92 / 0.86 / +6.0%
tpcds_q66/datafusion:parquet 61101584 / 60031762 / +1.8% 76146916 / 75485952 / +0.9% 0.80 / 0.80 / +0.9%
tpcds_q67/datafusion:parquet 68515939 / 68264340 / +0.4% 92077905 / 91246185 / +0.9% 0.74 / 0.75 / -0.5%
tpcds_q68/datafusion:parquet 29164670 / 28679824 / +1.7% 47764350 / 47951341 / -0.4% 0.61 / 0.60 / +2.1%
tpcds_q69/datafusion:parquet 44125850 / 44962947 / -1.9% 56231843 / 56394629 / -0.3% 0.78 / 0.80 / -1.6%
tpcds_q70/datafusion:parquet 81831634 / 80529276 / +1.6% 98137595 / 98649068 / -0.5% 0.83 / 0.82 / +2.1%
tpcds_q71/datafusion:parquet 25748699 / 25311658 / +1.7% 36234578 / 37459886 / -3.3% 0.71 / 0.68 / +5.2%
tpcds_q72/datafusion:parquet 523114529 / 526711474 / -0.7% 551961665 / 583139600 / -5.3% 0.95 / 0.90 / +4.9%
tpcds_q73/datafusion:parquet 23887843 / 23972488 / -0.4% 36062014 / 36111435 / -0.1% 0.66 / 0.66 / -0.2%
tpcds_q74/datafusion:parquet 68962586 / 69821189 / -1.2% 84608504 / 90676890 / -6.7% 0.82 / 0.77 / +5.9%
tpcds_q75/datafusion:parquet 151648490 / 150984613 / +0.4% 184044879 / 180216469 / +2.1% 0.82 / 0.84 / -1.6%
tpcds_q76/datafusion:parquet 32473454 / 33664553 / -3.5% 46421887 / 47280722 / -1.8% 0.70 / 0.71 / -1.8%
tpcds_q77/datafusion:parquet 57119946 / 56075236 / +1.9% 71106798 / 74208551 / -4.2% 0.80 / 0.76 / +6.3%
tpcds_q78/datafusion:parquet 86412749 / 85978481 / +0.5% 117866823 / 119554693 / -1.4% 0.73 / 0.72 / +1.9%
tpcds_q79/datafusion:parquet 26763747 / 26866693 / -0.4% 41595957 / 42361918 / -1.8% 0.64 / 0.63 / +1.5%
tpcds_q80/datafusion:parquet 78883634 / 78784007 / +0.1% 108594319 / 111184707 / -2.3% 0.73 / 0.71 / +2.5%
tpcds_q81/datafusion:parquet 39881078 / 38700898 / +3.0% 50859954 / 50684261 / +0.3% 0.78 / 0.76 / +2.7%
tpcds_q82/datafusion:parquet 22326483 / 22988496 / -2.9% 34541806 / 35883866 / -3.7% 0.65 / 0.64 / +0.9%
tpcds_q83/datafusion:parquet 57178428 / 59450345 / -3.8% 77999978 / 74251041 / +5.0% 0.73 / 0.80 / -8.4%
tpcds_q84/datafusion:parquet 26145694 / 27058650 / -3.4% 38821810 / 39697494 / -2.2% 0.67 / 0.68 / -1.2%
tpcds_q85/datafusion:parquet 81177370 / 79684544 / +1.9% 102861243 / 103569843 / -0.7% 0.79 / 0.77 / +2.6%
tpcds_q86/datafusion:parquet 20863230 / 20741338 / +0.6% 32196755 / 33483246 / -3.8% 0.65 / 0.62 / +4.6%
tpcds_q87/datafusion:parquet 43884091 / 44880500 / -2.2% 62683354 / 58993581 / +6.3% 0.70 / 0.76 / -8.0%
tpcds_q88/datafusion:parquet 36780832 / 36904559 / -0.3% 50173093 / 50894855 / -1.4% 0.73 / 0.73 / +1.1%
tpcds_q89/datafusion:parquet 25986462 / 25720790 / +1.0% 41996248 / 41024801 / +2.4% 0.62 / 0.63 / -1.3%
tpcds_q90/datafusion:parquet 15863218 / 15258062 / +4.0% 25689307 / 26825581 / -4.2% 0.62 / 0.57 / +8.6%
tpcds_q91/datafusion:parquet 32457646 / 33057671 / -1.8% 46223776 / 46819501 / -1.3% 0.70 / 0.71 / -0.5%
tpcds_q92/datafusion:parquet 26813997 / 27280790 / -1.7% 40262223 / 40697814 / -1.1% 0.67 / 0.67 / -0.6%
tpcds_q93/datafusion:parquet 27282126 / 26963096 / +1.2% 46685704 / 46760017 / -0.2% 0.58 / 0.58 / +1.3%
tpcds_q94/datafusion:parquet 35108369 / 35152912 / -0.1% 47771230 / 49029032 / -2.6% 0.73 / 0.72 / +2.5%
tpcds_q95/datafusion:parquet 64661829 / 63506566 / +1.8% 79642134 / 77391175 / +2.9% 0.81 / 0.82 / -1.1%
tpcds_q96/datafusion:parquet 12843032 / 12645352 / +1.6% 23905226 / 23523277 / +1.6% 0.54 / 0.54 / -0.1%
tpcds_q97/datafusion:parquet 35416412 / 34969416 / +1.3% 48610521 / 50246371 / -3.3% 0.73 / 0.70 / +4.7%
tpcds_q98/datafusion:parquet 24715158 / 24627630 / +0.4% 38085530 / 38223584 / -0.4% 0.65 / 0.64 / +0.7%
tpcds_q99/datafusion:parquet 29716404 / 29844964 / -0.4% 42070311 / 42355654 / -0.7% 0.71 / 0.70 / +0.2%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16313108 / 16329432 / -0.1% 25222590 / 25487239 / -1.0% 0.65 / 0.64 / +0.9%
tpcds_q02/duckdb:vortex-file-compressed 17118304 / 16834640 / +1.7% 22824743 / 21756952 / +4.9% 0.75 / 0.77 / -3.1%
tpcds_q03/duckdb:vortex-file-compressed 7206188 / 7246950 / -0.6% 16603840 / 15828812 / +4.9% 0.43 / 0.46 / -5.2%
tpcds_q04/duckdb:vortex-file-compressed 59194711 / 59894144 / -1.2% 70414312 / 72230558 / -2.5% 0.84 / 0.83 / +1.4%
tpcds_q05/duckdb:vortex-file-compressed 22993356 / 22988419 / +0.0% 32742934 / 32673975 / +0.2% 0.70 / 0.70 / -0.2%
tpcds_q06/duckdb:vortex-file-compressed 24322662 / 24741192 / -1.7% 38939773 / 39574017 / -1.6% 0.62 / 0.63 / -0.1%
tpcds_q07/duckdb:vortex-file-compressed 22483990 / 22651950 / -0.7% 35395498 / 34385836 / +2.9% 0.64 / 0.66 / -3.6%
tpcds_q08/duckdb:vortex-file-compressed 17417948 / 17638310 / -1.2% 25122121 / 25997022 / -3.4% 0.69 / 0.68 / +2.2%
tpcds_q09/duckdb:vortex-file-compressed 18999424 / 19304672 / -1.6% 30652052 / 29430492 / +4.2% 0.62 / 0.66 / -5.5%
tpcds_q10/duckdb:vortex-file-compressed 27526548 / 27657991 / -0.5% 41183275 / 40890087 / +0.7% 0.67 / 0.68 / -1.2%
tpcds_q11/duckdb:vortex-file-compressed 36481126 / 36486727 / -0.0% 45866864 / 45404395 / +1.0% 0.80 / 0.80 / -1.0%
tpcds_q12/duckdb:vortex-file-compressed 9955537 / 9841154 / +1.2% 16863072 / 16691128 / +1.0% 0.59 / 0.59 / +0.1%
tpcds_q13/duckdb:vortex-file-compressed 21019546 / 21035183 / -0.1% 34242629 / 33955703 / +0.8% 0.61 / 0.62 / -0.9%
tpcds_q14/duckdb:vortex-file-compressed 54738292 / 55289389 / -1.0% 65941074 / 65532659 / +0.6% 0.83 / 0.84 / -1.6%
tpcds_q15/duckdb:vortex-file-compressed 11152686 / 11372860 / -1.9% 18884004 / 18913139 / -0.2% 0.59 / 0.60 / -1.8%
tpcds_q16/duckdb:vortex-file-compressed 24533240 / 24883874 / -1.4% 35627505 / 36042415 / -1.2% 0.69 / 0.69 / -0.3%
tpcds_q17/duckdb:vortex-file-compressed 20845594 / 20696326 / +0.7% 33604152 / 32772426 / +2.5% 0.62 / 0.63 / -1.8%
tpcds_q18/duckdb:vortex-file-compressed 33018416 / 32543955 / +1.5% 44584562 / 42894044 / +3.9% 0.74 / 0.76 / -2.4%
tpcds_q19/duckdb:vortex-file-compressed 20652848 / 20874909 / -1.1% 29849572 / 30151951 / -1.0% 0.69 / 0.69 / -0.1%
tpcds_q20/duckdb:vortex-file-compressed 10664632 / 10727268 / -0.6% 18066969 / 17544086 / +3.0% 0.59 / 0.61 / -3.5%
tpcds_q21/duckdb:vortex-file-compressed 9198237 / 9569384 / -3.9% 21221309 / 21267333 / -0.2% 0.43 / 0.45 / -3.7%
tpcds_q22/duckdb:vortex-file-compressed 17653474 / 17872148 / -1.2% 30055653 / 29852536 / +0.7% 0.59 / 0.60 / -1.9%
tpcds_q23/duckdb:vortex-file-compressed 38073925 / 37371344 / +1.9% 48552427 / 49449908 / -1.8% 0.78 / 0.76 / +3.8%
tpcds_q24/duckdb:vortex-file-compressed 26975465 / 26442407 / +2.0% 37900134 / 36982965 / +2.5% 0.71 / 0.71 / -0.5%
tpcds_q25/duckdb:vortex-file-compressed 19569945 / 19980530 / -2.1% 32924976 / 32960098 / -0.1% 0.59 / 0.61 / -2.0%
tpcds_q26/duckdb:vortex-file-compressed 21780744 / 22018196 / -1.1% 32556801 / 32494985 / +0.2% 0.67 / 0.68 / -1.3%
tpcds_q27/duckdb:vortex-file-compressed 25169052 / 25111022 / +0.2% 37886190 / 36825249 / +2.9% 0.66 / 0.68 / -2.6%
tpcds_q28/duckdb:vortex-file-compressed 15228134 / 15640586 / -2.6% 26734149 / 26802601 / -0.3% 0.57 / 0.58 / -2.4%
tpcds_q29/duckdb:vortex-file-compressed 19165379 / 19100140 / +0.3% 31085793 / 31939059 / -2.7% 0.62 / 0.60 / +3.1%
tpcds_q30/duckdb:vortex-file-compressed 18729563 / 18652409 / +0.4% 26593859 / 28086564 / -5.3% 0.70 / 0.66 / +6.0%
tpcds_q31/duckdb:vortex-file-compressed 17926399 / 18348336 / -2.3% 26528933 / 27137053 / -2.2% 0.68 / 0.68 / -0.1%
tpcds_q32/duckdb:vortex-file-compressed 10177477 / 10387594 / -2.0% 18566952 / 18778015 / -1.1% 0.55 / 0.55 / -0.9%
tpcds_q33/duckdb:vortex-file-compressed 17555322 / 17722630 / -0.9% 28016377 / 28439151 / -1.5% 0.63 / 0.62 / +0.6%
tpcds_q34/duckdb:vortex-file-compressed 13199668 / 13250426 / -0.4% 22185934 / 22100552 / +0.4% 0.59 / 0.60 / -0.8%
tpcds_q35/duckdb:vortex-file-compressed 31896348 / 31592025 / +1.0% 45038615 / 44594581 / +1.0% 0.71 / 0.71 / -0.0%
tpcds_q36/duckdb:vortex-file-compressed 14051548 / 14165818 / -0.8% 24253180 / 24752821 / -2.0% 0.58 / 0.57 / +1.2%
tpcds_q37/duckdb:vortex-file-compressed 9369118 / 9477481 / -1.1% 24277479 / 23222936 / +4.5% 0.39 / 0.41 / -5.4%
tpcds_q38/duckdb:vortex-file-compressed 24298009 / 24528450 / -0.9% 31350328 / 32113453 / -2.4% 0.78 / 0.76 / +1.5%
tpcds_q39/duckdb:vortex-file-compressed 18633732 / 18898110 / -1.4% 31070026 / 32820195 / -5.3% 0.60 / 0.58 / +4.2%
tpcds_q40/duckdb:vortex-file-compressed 10963664 / 11282582 / -2.8% 19993463 / 19508765 / +2.5% 0.55 / 0.58 / -5.2%
tpcds_q41/duckdb:vortex-file-compressed 18720672 / 18791562 / -0.4% 26147473 / 25581887 / +2.2% 0.72 / 0.73 / -2.5%
tpcds_q42/duckdb:vortex-file-compressed 7040814 / 7061490 / -0.3% 15948528 / 15818359 / +0.8% 0.44 / 0.45 / -1.1%
tpcds_q43/duckdb:vortex-file-compressed 9660499 / 9683731 / -0.2% 19252488 / 19428700 / -0.9% 0.50 / 0.50 / +0.7%
tpcds_q44/duckdb:vortex-file-compressed 12702955 / 12669166 / +0.3% 23904327 / 24267461 / -1.5% 0.53 / 0.52 / +1.8%
tpcds_q45/duckdb:vortex-file-compressed 23549736 / 23895114 / -1.4% 31137233 / 31020962 / +0.4% 0.76 / 0.77 / -1.8%
tpcds_q46/duckdb:vortex-file-compressed 31789612 / 32229987 / -1.4% 45338716 / 44558420 / +1.8% 0.70 / 0.72 / -3.1%
tpcds_q47/duckdb:vortex-file-compressed 31321948 / 31224326 / +0.3% 40628000 / 41246621 / -1.5% 0.77 / 0.76 / +1.8%
tpcds_q48/duckdb:vortex-file-compressed 23708889 / 23439554 / +1.1% 35496793 / 36610795 / -3.0% 0.67 / 0.64 / +4.3%
tpcds_q49/duckdb:vortex-file-compressed 18907089 / 18960264 / -0.3% 30026771 / 31424590 / -4.4% 0.63 / 0.60 / +4.4%
tpcds_q50/duckdb:vortex-file-compressed 15459283 / 15667585 / -1.3% 26935232 / 25168403 / +7.0% 0.57 / 0.62 / -7.8%
tpcds_q51/duckdb:vortex-file-compressed 49040304 / 49446285 / -0.8% 77224140 / 77700129 / -0.6% 0.64 / 0.64 / -0.2%
tpcds_q52/duckdb:vortex-file-compressed 7112042 / 7346850 / -3.2% 16277919 / 16124043 / +1.0% 0.44 / 0.46 / -4.1%
tpcds_q53/duckdb:vortex-file-compressed 11718942 / 11743601 / -0.2% 21562063 / 21208382 / +1.7% 0.54 / 0.55 / -1.8%
tpcds_q54/duckdb:vortex-file-compressed 20028646 / 20182972 / -0.8% 30359389 / 30245892 / +0.4% 0.66 / 0.67 / -1.1%
tpcds_q55/duckdb:vortex-file-compressed 6983008 / 6996254 / -0.2% 16148545 / 15259952 / +5.8% 0.43 / 0.46 / -5.7%
tpcds_q56/duckdb:vortex-file-compressed 17917439 / 17794158 / +0.7% 29181206 / 28768703 / +1.4% 0.61 / 0.62 / -0.7%
tpcds_q57/duckdb:vortex-file-compressed 26003200 / 26053272 / -0.2% 34939975 / 33651596 / +3.8% 0.74 / 0.77 / -3.9%
tpcds_q58/duckdb:vortex-file-compressed 20630288 / 20730617 / -0.5% 30871961 / 31695507 / -2.6% 0.67 / 0.65 / +2.2%
tpcds_q59/duckdb:vortex-file-compressed 19825747 / 19518764 / +1.6% 27029679 / 26423621 / +2.3% 0.73 / 0.74 / -0.7%
tpcds_q60/duckdb:vortex-file-compressed 18280410 / 18630556 / -1.9% 28509441 / 29991648 / -4.9% 0.64 / 0.62 / +3.2%
tpcds_q61/duckdb:vortex-file-compressed 20032227 / 20052564 / -0.1% 30687691 / 29980536 / +2.4% 0.65 / 0.67 / -2.4%
tpcds_q62/duckdb:vortex-file-compressed 11102353 / 11166046 / -0.6% 17575089 / 17983818 / -2.3% 0.63 / 0.62 / +1.7%
tpcds_q63/duckdb:vortex-file-compressed 11078990 / 11264105 / -1.6% 20384746 / 19856493 / +2.7% 0.54 / 0.57 / -4.2%
tpcds_q64/duckdb:vortex-file-compressed 53814541 / 53629824 / +0.3% 69731431 / 68272570 / +2.1% 0.77 / 0.79 / -1.8%
tpcds_q65/duckdb:vortex-file-compressed 13287120 / 13301358 / -0.1% 24125495 / 22946270 / +5.1% 0.55 / 0.58 / -5.0%
tpcds_q66/duckdb:vortex-file-compressed 31580651 / 31256114 / +1.0% 39374166 / 39120424 / +0.6% 0.80 / 0.80 / +0.4%
tpcds_q67/duckdb:vortex-file-compressed 55433269 / 55851634 / -0.7% 65314948 / 66748047 / -2.1% 0.85 / 0.84 / +1.4%
tpcds_q68/duckdb:vortex-file-compressed 23008666 / 23181610 / -0.7% 36359517 / 36279368 / +0.2% 0.63 / 0.64 / -1.0%
tpcds_q69/duckdb:vortex-file-compressed 22869460 / 23200644 / -1.4% 36882255 / 37614802 / -1.9% 0.62 / 0.62 / +0.5%
tpcds_q70/duckdb:vortex-file-compressed 14895296 / 15011216 / -0.8% 25841820 / 25795902 / +0.2% 0.58 / 0.58 / -0.9%
tpcds_q71/duckdb:vortex-file-compressed 13304104 / 13385093 / -0.6% 23089893 / 23843287 / -3.2% 0.58 / 0.56 / +2.6%
tpcds_q72/duckdb:vortex-file-compressed 43804192 / 43284092 / +1.2% 57365107 / 55811477 / +2.8% 0.76 / 0.78 / -1.5%
tpcds_q73/duckdb:vortex-file-compressed 12044048 / 12078334 / -0.3% 20955166 / 20703654 / +1.2% 0.57 / 0.58 / -1.5%
tpcds_q74/duckdb:vortex-file-compressed 31188575 / 31171368 / +0.1% 39456994 / 39142089 / +0.8% 0.79 / 0.80 / -0.7%
tpcds_q75/duckdb:vortex-file-compressed 37603772 / 37815198 / -0.6% 50094883 / 49808538 / +0.6% 0.75 / 0.76 / -1.1%
tpcds_q76/duckdb:vortex-file-compressed 12891444 / 12895882 / -0.0% 22412661 / 22021393 / +1.8% 0.58 / 0.59 / -1.8%
tpcds_q77/duckdb:vortex-file-compressed 20408804 / 20608048 / -1.0% 32227510 / 32671490 / -1.4% 0.63 / 0.63 / +0.4%
tpcds_q78/duckdb:vortex-file-compressed 43329170 / 43880126 / -1.3% 53253339 / 54113915 / -1.6% 0.81 / 0.81 / +0.3%
tpcds_q79/duckdb:vortex-file-compressed 17373396 / 17332587 / +0.2% 27216799 / 27943339 / -2.6% 0.64 / 0.62 / +2.9%
tpcds_q80/duckdb:vortex-file-compressed 29805594 / 30088241 / -0.9% 44361980 / 44504984 / -0.3% 0.67 / 0.68 / -0.6%
tpcds_q81/duckdb:vortex-file-compressed 21502842 / 21315104 / +0.9% 30122574 / 30722209 / -2.0% 0.71 / 0.69 / +2.9%
tpcds_q82/duckdb:vortex-file-compressed 10012614 / 9765874 / +2.5% 24850409 / 23687744 / +4.9% 0.40 / 0.41 / -2.3%
tpcds_q83/duckdb:vortex-file-compressed 17766813 / 17597274 / +1.0% 25235362 / 25067304 / +0.7% 0.70 / 0.70 / +0.3%
tpcds_q84/duckdb:vortex-file-compressed 15580407 / 15516949 / +0.4% 23351816 / 22554803 / +3.5% 0.67 / 0.69 / -3.0%
tpcds_q85/duckdb:vortex-file-compressed 26194630 / 26143156 / +0.2% 37787933 / 38688398 / -2.3% 0.69 / 0.68 / +2.6%
tpcds_q86/duckdb:vortex-file-compressed 9718990 / 9876464 / -1.6% 16636968 / 16604637 / +0.2% 0.58 / 0.59 / -1.8%
tpcds_q87/duckdb:vortex-file-compressed 25923056 / 26027270 / -0.4% 33821547 / 34638328 / -2.4% 0.77 / 0.75 / +2.0%
tpcds_q88/duckdb:vortex-file-compressed 30508096 / 31073838 / -1.8% 37985798 / 38154378 / -0.4% 0.80 / 0.81 / -1.4%
tpcds_q89/duckdb:vortex-file-compressed 11825802 / 12245324 / -3.4% 22202253 / 21790929 / +1.9% 0.53 / 0.56 / -5.2%
tpcds_q90/duckdb:vortex-file-compressed 8153626 / 8316050 / -2.0% 15521137 / 15576589 / -0.4% 0.53 / 0.53 / -1.6%
tpcds_q91/duckdb:vortex-file-compressed 15319396 / 15261945 / +0.4% 24314583 / 24140049 / +0.7% 0.63 / 0.63 / -0.3%
tpcds_q92/duckdb:vortex-file-compressed 10559576 / 10474458 / +0.8% 18039884 / 18396761 / -1.9% 0.59 / 0.57 / +2.8%
tpcds_q93/duckdb:vortex-file-compressed 10497656 / 10511844 / -0.1% 22294892 / 22510345 / -1.0% 0.47 / 0.47 / +0.8%
tpcds_q94/duckdb:vortex-file-compressed 22500530 / 22207286 / +1.3% 32284913 / 32729141 / -1.4% 0.70 / 0.68 / +2.7%
tpcds_q95/duckdb:vortex-file-compressed 60956505 / 61107714 / -0.2% 68540982 / 68782689 / -0.4% 0.89 / 0.89 / +0.1%
tpcds_q96/duckdb:vortex-file-compressed 7013042 / 6737562 / +4.1% 15443118 / 15261575 / +1.2% 0.45 / 0.44 / +2.9%
tpcds_q97/duckdb:vortex-file-compressed 23614058 / 23437010 / +0.8% 32363349 / 33492954 / -3.4% 0.73 / 0.70 / +4.3%
tpcds_q98/duckdb:vortex-file-compressed 11232202 / 11192874 / +0.4% 19699003 / 19762072 / -0.3% 0.57 / 0.57 / +0.7%
tpcds_q99/duckdb:vortex-file-compressed 14492339 / 14596140 / -0.7% 22669071 / 23112890 / -1.9% 0.64 / 0.63 / +1.2%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17711118 / 17849406 / -0.8% 25995365 / 26255464 / -1.0% 0.68 / 0.68 / +0.2%
tpcds_q02/duckdb:vortex-compact 18273332 / 18090078 / +1.0% 23707061 / 23986898 / -1.2% 0.77 / 0.75 / +2.2%
tpcds_q03/duckdb:vortex-compact 8644112 / 8723926 / -0.9% 17874801 / 17120539 / +4.4% 0.48 / 0.51 / -5.1%
tpcds_q04/duckdb:vortex-compact 62308933 / 62074402 / +0.4% 76328746 / 74932855 / +1.9% 0.82 / 0.83 / -1.5%
tpcds_q05/duckdb:vortex-compact 24928515 / 25210853 / -1.1% 34500231 / 35168371 / -1.9% 0.72 / 0.72 / +0.8%
tpcds_q06/duckdb:vortex-compact 26717628 / 26525565 / +0.7% 43033141 / 40866202 / +5.3% 0.62 / 0.65 / -4.3%
tpcds_q07/duckdb:vortex-compact 27187388 / 27418681 / -0.8% 39240239 / 39017379 / +0.6% 0.69 / 0.70 / -1.4%
tpcds_q08/duckdb:vortex-compact 22363336 / 22256323 / +0.5% 30044881 / 29588053 / +1.5% 0.74 / 0.75 / -1.0%
tpcds_q09/duckdb:vortex-compact 22071556 / 22268036 / -0.9% 31346487 / 31032009 / +1.0% 0.70 / 0.72 / -1.9%
tpcds_q10/duckdb:vortex-compact 32024466 / 32160532 / -0.4% 45403266 / 46140374 / -1.6% 0.71 / 0.70 / +1.2%
tpcds_q11/duckdb:vortex-compact 38512248 / 38428190 / +0.2% 48620841 / 48760498 / -0.3% 0.79 / 0.79 / +0.5%
tpcds_q12/duckdb:vortex-compact 12582569 / 12655864 / -0.6% 18154636 / 19328652 / -6.1% 0.69 / 0.65 / +5.9%
tpcds_q13/duckdb:vortex-compact 36974146 / 37280274 / -0.8% 48703227 / 47505861 / +2.5% 0.76 / 0.78 / -3.3%
tpcds_q14/duckdb:vortex-compact 59898062 / 59663825 / +0.4% 69440287 / 67680216 / +2.6% 0.86 / 0.88 / -2.2%
tpcds_q15/duckdb:vortex-compact 14989928 / 15070336 / -0.5% 22401351 / 22699674 / -1.3% 0.67 / 0.66 / +0.8%
tpcds_q16/duckdb:vortex-compact 26127496 / 28178863 / -7.3% 36133517 / 36878184 / -2.0% 0.72 / 0.76 / -5.4%
tpcds_q17/duckdb:vortex-compact 24129665 / 24388082 / -1.1% 35872329 / 36347313 / -1.3% 0.67 / 0.67 / +0.3%
tpcds_q18/duckdb:vortex-compact 38428636 / 38041261 / +1.0% 50463805 / 49604613 / +1.7% 0.76 / 0.77 / -0.7%
tpcds_q19/duckdb:vortex-compact 25401139 / 24309392 / +4.5% 32381090 / 32768875 / -1.2% 0.78 / 0.74 / +5.7%
tpcds_q20/duckdb:vortex-compact 13096922 / 13338883 / -1.8% 20408070 / 19736511 / +3.4% 0.64 / 0.68 / -5.0%
tpcds_q21/duckdb:vortex-compact 11441462 / 11574781 / -1.2% 23236278 / 24347187 / -4.6% 0.49 / 0.48 / +3.6%
tpcds_q22/duckdb:vortex-compact 19921838 / 19645824 / +1.4% 31452745 / 31799885 / -1.1% 0.63 / 0.62 / +2.5%
tpcds_q23/duckdb:vortex-compact 41387276 / 42742024 / -3.2% 52662352 / 53405677 / -1.4% 0.79 / 0.80 / -1.8%
tpcds_q24/duckdb:vortex-compact 28749759 / 28776998 / -0.1% 37059448 / 38313181 / -3.3% 0.78 / 0.75 / +3.3%
tpcds_q25/duckdb:vortex-compact 23606314 / 23328675 / +1.2% 36536664 / 36953079 / -1.1% 0.65 / 0.63 / +2.3%
tpcds_q26/duckdb:vortex-compact 27105384 / 26970050 / +0.5% 38294363 / 37569171 / +1.9% 0.71 / 0.72 / -1.4%
tpcds_q27/duckdb:vortex-compact 29913866 / 29592061 / +1.1% 40677045 / 40749143 / -0.2% 0.74 / 0.73 / +1.3%
tpcds_q28/duckdb:vortex-compact 22750406 / 22611745 / +0.6% 31207827 / 29963467 / +4.2% 0.73 / 0.75 / -3.4%
tpcds_q29/duckdb:vortex-compact 22891033 / 22986138 / -0.4% 34798199 / 35083661 / -0.8% 0.66 / 0.66 / +0.4%
tpcds_q30/duckdb:vortex-compact 22011162 / 22088604 / -0.4% 31675274 / 31721034 / -0.1% 0.69 / 0.70 / -0.2%
tpcds_q31/duckdb:vortex-compact 21405406 / 20829837 / +2.8% 28238960 / 28027828 / +0.8% 0.76 / 0.74 / +2.0%
tpcds_q32/duckdb:vortex-compact 11116190 / 11074874 / +0.4% 18794479 / 19403400 / -3.1% 0.59 / 0.57 / +3.6%
tpcds_q33/duckdb:vortex-compact 20827662 / 20470876 / +1.7% 30258296 / 29993649 / +0.9% 0.69 / 0.68 / +0.9%
tpcds_q34/duckdb:vortex-compact 14498584 / 14587773 / -0.6% 25372118 / 23771492 / +6.7% 0.57 / 0.61 / -6.9%
tpcds_q35/duckdb:vortex-compact 35070480 / 34783438 / +0.8% 46878393 / 47508309 / -1.3% 0.75 / 0.73 / +2.2%
tpcds_q36/duckdb:vortex-compact 15981812 / 15870080 / +0.7% 25579412 / 25158464 / +1.7% 0.62 / 0.63 / -1.0%
tpcds_q37/duckdb:vortex-compact 13616831 / 13654166 / -0.3% 27470307 / 27695391 / -0.8% 0.50 / 0.49 / +0.5%
tpcds_q38/duckdb:vortex-compact 25495414 / 25708333 / -0.8% 33176811 / 34052076 / -2.6% 0.77 / 0.75 / +1.8%
tpcds_q39/duckdb:vortex-compact 19856239 / 19898702 / -0.2% 33296536 / 32054833 / +3.9% 0.60 / 0.62 / -3.9%
tpcds_q40/duckdb:vortex-compact 12599708 / 12682065 / -0.6% 20996844 / 21846327 / -3.9% 0.60 / 0.58 / +3.4%
tpcds_q41/duckdb:vortex-compact 20698481 / 20471272 / +1.1% 27972278 / 28083457 / -0.4% 0.74 / 0.73 / +1.5%
tpcds_q42/duckdb:vortex-compact 8290844 / 8278009 / +0.2% 16453546 / 16454451 / -0.0% 0.50 / 0.50 / +0.2%
tpcds_q43/duckdb:vortex-compact 11081162 / 11205088 / -1.1% 19796584 / 19924393 / -0.6% 0.56 / 0.56 / -0.5%
tpcds_q44/duckdb:vortex-compact 16661777 / 15712918 / +6.0% 27130801 / 27027490 / +0.4% 0.61 / 0.58 / +5.6%
tpcds_q45/duckdb:vortex-compact 26625956 / 27099602 / -1.7% 33582954 / 33786404 / -0.6% 0.79 / 0.80 / -1.2%
tpcds_q46/duckdb:vortex-compact 33247274 / 33210723 / +0.1% 44658940 / 44472157 / +0.4% 0.74 / 0.75 / -0.3%
tpcds_q47/duckdb:vortex-compact 34999754 / 33138443 / +5.6% 42587463 / 42509015 / +0.2% 0.82 / 0.78 / +5.4%
tpcds_q48/duckdb:vortex-compact 38451827 / 38672133 / -0.6% 48612377 / 49319421 / -1.4% 0.79 / 0.78 / +0.9%
tpcds_q49/duckdb:vortex-compact 23262363 / 23690902 / -1.8% 33913240 / 33949065 / -0.1% 0.69 / 0.70 / -1.7%
tpcds_q50/duckdb:vortex-compact 17682038 / 17844184 / -0.9% 26705883 / 26706033 / -0.0% 0.66 / 0.67 / -0.9%
tpcds_q51/duckdb:vortex-compact 50276134 / 50080550 / +0.4% 60354899 / 78313381 / -22.9% 🟢 0.83 / 0.64 / +30.3%
tpcds_q52/duckdb:vortex-compact 8504208 / 8524190 / -0.2% 17000508 / 18048862 / -5.8% 0.50 / 0.47 / +5.9%
tpcds_q53/duckdb:vortex-compact 13799736 / 13587659 / +1.6% 23061803 / 23038598 / +0.1% 0.60 / 0.59 / +1.5%
tpcds_q54/duckdb:vortex-compact 21556732 / 22074324 / -2.3% 31664296 / 31634168 / +0.1% 0.68 / 0.70 / -2.4%
tpcds_q55/duckdb:vortex-compact 8297124 / 8360198 / -0.8% 16293614 / 16927145 / -3.7% 0.51 / 0.49 / +3.1%
tpcds_q56/duckdb:vortex-compact 21208468 / 22262302 / -4.7% 28942743 / 30175986 / -4.1% 0.73 / 0.74 / -0.7%
tpcds_q57/duckdb:vortex-compact 27514372 / 27814946 / -1.1% 34632968 / 35207246 / -1.6% 0.79 / 0.79 / +0.6%
tpcds_q58/duckdb:vortex-compact 22445379 / 22184874 / +1.2% 32548142 / 32584765 / -0.1% 0.69 / 0.68 / +1.3%
tpcds_q59/duckdb:vortex-compact 21194602 / 21165907 / +0.1% 28323007 / 28440238 / -0.4% 0.75 / 0.74 / +0.6%
tpcds_q60/duckdb:vortex-compact 22330088 / 21168551 / +5.5% 30522973 / 31424027 / -2.9% 0.73 / 0.67 / +8.6%
tpcds_q61/duckdb:vortex-compact 22492371 / 22446921 / +0.2% 32899097 / 33175047 / -0.8% 0.68 / 0.68 / +1.0%
tpcds_q62/duckdb:vortex-compact 12515268 / 12625839 / -0.9% 18938170 / 19146374 / -1.1% 0.66 / 0.66 / +0.2%
tpcds_q63/duckdb:vortex-compact 12964270 / 13140275 / -1.3% 21935119 / 22522295 / -2.6% 0.59 / 0.58 / +1.3%
tpcds_q64/duckdb:vortex-compact 63676864 / 64394064 / -1.1% 78901357 / 79001933 / -0.1% 0.81 / 0.82 / -1.0%
tpcds_q65/duckdb:vortex-compact 14651534 / 14677130 / -0.2% 25120903 / 24322334 / +3.3% 0.58 / 0.60 / -3.3%
tpcds_q66/duckdb:vortex-compact 33645865 / 32908694 / +2.2% 40530881 / 40572016 / -0.1% 0.83 / 0.81 / +2.3%
tpcds_q67/duckdb:vortex-compact 63762677 / 63838238 / -0.1% 67252604 / 67760611 / -0.7% 0.95 / 0.94 / +0.6%
tpcds_q68/duckdb:vortex-compact 24472293 / 24682573 / -0.9% 36126362 / 36376548 / -0.7% 0.68 / 0.68 / -0.2%
tpcds_q69/duckdb:vortex-compact 28812630 / 28831850 / -0.1% 42926718 / 43449802 / -1.2% 0.67 / 0.66 / +1.2%
tpcds_q70/duckdb:vortex-compact 16058775 / 16044452 / +0.1% 26588926 / 26455156 / +0.5% 0.60 / 0.61 / -0.4%
tpcds_q71/duckdb:vortex-compact 15488833 / 15335613 / +1.0% 25504000 / 25225295 / +1.1% 0.61 / 0.61 / -0.1%
tpcds_q72/duckdb:vortex-compact 48924176 / 48739190 / +0.4% 61858622 / 60745185 / +1.8% 0.79 / 0.80 / -1.4%
tpcds_q73/duckdb:vortex-compact 13410572 / 13467119 / -0.4% 22907271 / 22425804 / +2.1% 0.59 / 0.60 / -2.5%
tpcds_q74/duckdb:vortex-compact 32724706 / 32926010 / -0.6% 41472965 / 42415467 / -2.2% 0.79 / 0.78 / +1.6%
tpcds_q75/duckdb:vortex-compact 40184734 / 40575628 / -1.0% 52434452 / 52334174 / +0.2% 0.77 / 0.78 / -1.2%
tpcds_q76/duckdb:vortex-compact 14132543 / 14158718 / -0.2% 23163371 / 22596998 / +2.5% 0.61 / 0.63 / -2.6%
tpcds_q77/duckdb:vortex-compact 23932034 / 24183339 / -1.0% 32586628 / 34281403 / -4.9% 0.73 / 0.71 / +4.1%
tpcds_q78/duckdb:vortex-compact 44978586 / 45193225 / -0.5% 55853084 / 55337092 / +0.9% 0.81 / 0.82 / -1.4%
tpcds_q79/duckdb:vortex-compact 18142038 / 18378744 / -1.3% 28655662 / 29020847 / -1.3% 0.63 / 0.63 / -0.0%
tpcds_q80/duckdb:vortex-compact 33575480 / 34023648 / -1.3% 44849023 / 43652911 / +2.7% 0.75 / 0.78 / -3.9%
tpcds_q81/duckdb:vortex-compact 23344038 / 23490700 / -0.6% 32091894 / 32869187 / -2.4% 0.73 / 0.71 / +1.8%
tpcds_q82/duckdb:vortex-compact 12426564 / 12368824 / +0.5% 26581253 / 26145608 / +1.7% 0.47 / 0.47 / -1.2%
tpcds_q83/duckdb:vortex-compact 19074874 / 18999628 / +0.4% 25998456 / 25924502 / +0.3% 0.73 / 0.73 / +0.1%
tpcds_q84/duckdb:vortex-compact 17491378 / 17963746 / -2.6% 23532540 / 24526721 / -4.1% 0.74 / 0.73 / +1.5%
tpcds_q85/duckdb:vortex-compact 40946706 / 41089695 / -0.3% 54023361 / 52162743 / +3.6% 0.76 / 0.79 / -3.8%
tpcds_q86/duckdb:vortex-compact 11009973 / 11070190 / -0.5% 17825741 / 17671373 / +0.9% 0.62 / 0.63 / -1.4%
tpcds_q87/duckdb:vortex-compact 27222162 / 27230556 / -0.0% 35278279 / 35029009 / +0.7% 0.77 / 0.78 / -0.7%
tpcds_q88/duckdb:vortex-compact 32624994 / 32721612 / -0.3% 39149206 / 39671580 / -1.3% 0.83 / 0.82 / +1.0%
tpcds_q89/duckdb:vortex-compact 16442865 / 14109226 / +16.5% 🔴 24003021 / 23001215 / +4.4% 0.69 / 0.61 / +11.7%
tpcds_q90/duckdb:vortex-compact 8691068 / 8819055 / -1.5% 15714559 / 15736465 / -0.1% 0.55 / 0.56 / -1.3%
tpcds_q91/duckdb:vortex-compact 24227455 / 24212983 / +0.1% 32925029 / 32889079 / +0.1% 0.74 / 0.74 / -0.0%
tpcds_q92/duckdb:vortex-compact 11492328 / 11519590 / -0.2% 18792949 / 19300929 / -2.6% 0.61 / 0.60 / +2.5%
tpcds_q93/duckdb:vortex-compact 12740520 / 12528175 / +1.7% 24670493 / 25045570 / -1.5% 0.52 / 0.50 / +3.2%
tpcds_q94/duckdb:vortex-compact 24228127 / 23990429 / +1.0% 34160139 / 33720568 / +1.3% 0.71 / 0.71 / -0.3%
tpcds_q95/duckdb:vortex-compact 62924738 / 62445478 / +0.8% 71240518 / 71562144 / -0.4% 0.88 / 0.87 / +1.2%
tpcds_q96/duckdb:vortex-compact 8784537 / 8872021 / -1.0% 16580827 / 16611163 / -0.2% 0.53 / 0.53 / -0.8%
tpcds_q97/duckdb:vortex-compact 23760962 / 24154284 / -1.6% 32998367 / 32674647 / +1.0% 0.72 / 0.74 / -2.6%
tpcds_q98/duckdb:vortex-compact 13941906 / 13963616 / -0.2% 22763661 / 23016871 / -1.1% 0.61 / 0.61 / +1.0%
tpcds_q99/duckdb:vortex-compact 15989916 / 15529682 / +3.0% 23186927 / 23990984 / -3.4% 0.69 / 0.65 / +6.5%
duckdb / parquet / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24129706 / 23957740 / +0.7% 31210072 / 30964453 / +0.8% 0.77 / 0.77 / -0.1%
tpcds_q02/duckdb:parquet 18002818 / 17954854 / +0.3% 23900673 / 24320693 / -1.7% 0.75 / 0.74 / +2.0%
tpcds_q03/duckdb:parquet 9871964 / 9733887 / +1.4% 15545779 / 15715195 / -1.1% 0.64 / 0.62 / +2.5%
tpcds_q04/duckdb:parquet 117451376 / 118377328 / -0.8% 126263157 / 127605858 / -1.1% 0.93 / 0.93 / +0.3%
tpcds_q05/duckdb:parquet 28481512 / 28537368 / -0.2% 32738437 / 33458816 / -2.2% 0.87 / 0.85 / +2.0%
tpcds_q06/duckdb:parquet 26585482 / 26461082 / +0.5% 35629444 / 36186234 / -1.5% 0.75 / 0.73 / +2.0%
tpcds_q07/duckdb:parquet 30886672 / 30784538 / +0.3% 39343716 / 38701281 / +1.7% 0.79 / 0.80 / -1.3%
tpcds_q08/duckdb:parquet 19724533 / 19883222 / -0.8% 26221971 / 24952781 / +5.1% 0.75 / 0.80 / -5.6%
tpcds_q09/duckdb:parquet 27126401 / 26568724 / +2.1% 29749620 / 29759420 / -0.0% 0.91 / 0.89 / +2.1%
tpcds_q10/duckdb:parquet 32685325 / 32654802 / +0.1% 39928020 / 41019040 / -2.7% 0.82 / 0.80 / +2.8%
tpcds_q11/duckdb:parquet 68084362 / 68510758 / -0.6% 76528735 / 76424026 / +0.1% 0.89 / 0.90 / -0.8%
tpcds_q12/duckdb:parquet 14150796 / 14155074 / -0.0% 19318214 / 19309035 / +0.0% 0.73 / 0.73 / -0.1%
tpcds_q13/duckdb:parquet 31535566 / 32552776 / -3.1% 39467281 / 40027412 / -1.4% 0.80 / 0.81 / -1.7%
tpcds_q14/duckdb:parquet 64511300 / 63748782 / +1.2% 68053552 / 68438790 / -0.6% 0.95 / 0.93 / +1.8%
tpcds_q15/duckdb:parquet 16691116 / 16778006 / -0.5% 22292356 / 22873050 / -2.5% 0.75 / 0.73 / +2.1%
tpcds_q16/duckdb:parquet 30079158 / 30397939 / -1.0% 37440246 / 37276896 / +0.4% 0.80 / 0.82 / -1.5%
tpcds_q17/duckdb:parquet 34340959 / 34626401 / -0.8% 40068156 / 40033275 / +0.1% 0.86 / 0.86 / -0.9%
tpcds_q18/duckdb:parquet 47326549 / 47341013 / -0.0% 55164928 / 55777556 / -1.1% 0.86 / 0.85 / +1.1%
tpcds_q19/duckdb:parquet 20241031 / 18800788 / +7.7% 25433606 / 26071814 / -2.4% 0.80 / 0.72 / +10.4%
tpcds_q20/duckdb:parquet 14898802 / 15039372 / -0.9% 19661717 / 19511402 / +0.8% 0.76 / 0.77 / -1.7%
tpcds_q21/duckdb:parquet 10493732 / 10740417 / -2.3% 17229189 / 17252939 / -0.1% 0.61 / 0.62 / -2.2%
tpcds_q22/duckdb:parquet 20881526 / 20774246 / +0.5% 26487232 / 26680307 / -0.7% 0.79 / 0.78 / +1.2%
tpcds_q23/duckdb:parquet 43093746 / 41988964 / +2.6% 49424970 / 47901916 / +3.2% 0.87 / 0.88 / -0.5%
tpcds_q24/duckdb:parquet 31862007 / 30759436 / +3.6% 36808203 / 37645021 / -2.2% 0.87 / 0.82 / +5.9%
tpcds_q25/duckdb:parquet 30400124 / 30535354 / -0.4% 36917134 / 37611817 / -1.8% 0.82 / 0.81 / +1.4%
tpcds_q26/duckdb:parquet 28829256 / 29204220 / -1.3% 35063850 / 35303500 / -0.7% 0.82 / 0.83 / -0.6%
tpcds_q27/duckdb:parquet 34938604 / 35998506 / -2.9% 41858857 / 42640744 / -1.8% 0.83 / 0.84 / -1.1%
tpcds_q28/duckdb:parquet 25975951 / 26263608 / -1.1% 35428898 / 34886577 / +1.6% 0.73 / 0.75 / -2.6%
tpcds_q29/duckdb:parquet 31878798 / 32299014 / -1.3% 39281445 / 39490888 / -0.5% 0.81 / 0.82 / -0.8%
tpcds_q30/duckdb:parquet 35633382 / 35596958 / +0.1% 44174218 / 44969811 / -1.8% 0.81 / 0.79 / +1.9%
tpcds_q31/duckdb:parquet 35541009 / 35496878 / +0.1% 43473901 / 43193758 / +0.6% 0.82 / 0.82 / -0.5%
tpcds_q32/duckdb:parquet 14181284 / 14174308 / +0.0% 20793486 / 20909729 / -0.6% 0.68 / 0.68 / +0.6%
tpcds_q33/duckdb:parquet 23401707 / 23963953 / -2.3% 28701475 / 29104132 / -1.4% 0.82 / 0.82 / -1.0%
tpcds_q34/duckdb:parquet 16992382 / 17638896 / -3.7% 24511269 / 24400527 / +0.5% 0.69 / 0.72 / -4.1%
tpcds_q35/duckdb:parquet 34853856 / 35595840 / -2.1% 43729965 / 44777663 / -2.3% 0.80 / 0.79 / +0.3%
tpcds_q36/duckdb:parquet 39516450 / 39725088 / -0.5% 47678646 / 47968671 / -0.6% 0.83 / 0.83 / +0.1%
tpcds_q37/duckdb:parquet 12555928 / 12667642 / -0.9% 19440494 / 19841804 / -2.0% 0.65 / 0.64 / +1.2%
tpcds_q38/duckdb:parquet 29762840 / 29935459 / -0.6% 33336930 / 33563629 / -0.7% 0.89 / 0.89 / +0.1%
tpcds_q39/duckdb:parquet 23417378 / 23383453 / +0.1% 29994410 / 29566569 / +1.4% 0.78 / 0.79 / -1.3%
tpcds_q40/duckdb:parquet 15933957 / 15953516 / -0.1% 21242723 / 21197320 / +0.2% 0.75 / 0.75 / -0.3%
tpcds_q41/duckdb:parquet 12032056 / 12001089 / +0.3% 18443871 / 17955310 / +2.7% 0.65 / 0.67 / -2.4%
tpcds_q42/duckdb:parquet 9597500 / 9617460 / -0.2% 15287942 / 15586174 / -1.9% 0.63 / 0.62 / +1.7%
tpcds_q43/duckdb:parquet 12010708 / 12140110 / -1.1% 18010743 / 17906603 / +0.6% 0.67 / 0.68 / -1.6%
tpcds_q44/duckdb:parquet 20844430 / 21072478 / -1.1% 27505469 / 26952494 / +2.1% 0.76 / 0.78 / -3.1%
tpcds_q45/duckdb:parquet 20968828 / 21054972 / -0.4% 27609758 / 28381505 / -2.7% 0.76 / 0.74 / +2.4%
tpcds_q46/duckdb:parquet 35730896 / 37068808 / -3.6% 43416088 / 44254902 / -1.9% 0.82 / 0.84 / -1.7%
tpcds_q47/duckdb:parquet 34668108 / 34665012 / +0.0% 41075532 / 40988387 / +0.2% 0.84 / 0.85 / -0.2%
tpcds_q48/duckdb:parquet 29367581 / 29513803 / -0.5% 36845549 / 37639604 / -2.1% 0.80 / 0.78 / +1.6%
tpcds_q49/duckdb:parquet 30203348 / 30397232 / -0.6% 35774545 / 36230433 / -1.3% 0.84 / 0.84 / +0.6%
tpcds_q50/duckdb:parquet 19278043 / 19513627 / -1.2% 25311801 / 25583725 / -1.1% 0.76 / 0.76 / -0.1%
tpcds_q51/duckdb:parquet 52473962 / 52381832 / +0.2% 60505645 / 77681532 / -22.1% 🟢 0.87 / 0.67 / +28.6%
tpcds_q52/duckdb:parquet 9883818 / 9694494 / +2.0% 15569187 / 15681624 / -0.7% 0.63 / 0.62 / +2.7%
tpcds_q53/duckdb:parquet 13804737 / 13796540 / +0.1% 20999332 / 20958779 / +0.2% 0.66 / 0.66 / -0.1%
tpcds_q54/duckdb:parquet 24840966 / 25236244 / -1.6% 32001210 / 32136231 / -0.4% 0.78 / 0.79 / -1.2%
tpcds_q55/duckdb:parquet 9496353 / 9619712 / -1.3% 15399070 / 15326745 / +0.5% 0.62 / 0.63 / -1.7%
tpcds_q56/duckdb:parquet 25957567 / 25969908 / -0.0% 30572225 / 30317222 / +0.8% 0.85 / 0.86 / -0.9%
tpcds_q57/duckdb:parquet 30674420 / 30922044 / -0.8% 36020730 / 36472240 / -1.2% 0.85 / 0.85 / +0.4%
tpcds_q58/duckdb:parquet 23711658 / 24157351 / -1.8% 29590641 / 29908651 / -1.1% 0.80 / 0.81 / -0.8%
tpcds_q59/duckdb:parquet 22710430 / 22717168 / -0.0% 29421333 / 28916668 / +1.7% 0.77 / 0.79 / -1.7%
tpcds_q60/duckdb:parquet 26435122 / 27613709 / -4.3% 32065138 / 32243609 / -0.6% 0.82 / 0.86 / -3.7%
tpcds_q61/duckdb:parquet 25013376 / 24032788 / +4.1% 28469510 / 29186516 / -2.5% 0.88 / 0.82 / +6.7%
tpcds_q62/duckdb:parquet 12794842 / 12741046 / +0.4% 17809142 / 18190998 / -2.1% 0.72 / 0.70 / +2.6%
tpcds_q63/duckdb:parquet 13387044 / 13342404 / +0.3% 19692535 / 19885603 / -1.0% 0.68 / 0.67 / +1.3%
tpcds_q64/duckdb:parquet 70348934 / 71673034 / -1.8% 80201833 / 81653316 / -1.8% 0.88 / 0.88 / -0.1%
tpcds_q65/duckdb:parquet 20205458 / 20675864 / -2.3% 25560370 / 26286072 / -2.8% 0.79 / 0.79 / +0.5%
tpcds_q66/duckdb:parquet 33099104 / 33259238 / -0.5% 37886631 / 38125150 / -0.6% 0.87 / 0.87 / +0.1%
tpcds_q67/duckdb:parquet 61009735 / 61511792 / -0.8% 67548145 / 66802071 / +1.1% 0.90 / 0.92 / -1.9%
tpcds_q68/duckdb:parquet 29430908 / 28362459 / +3.8% 36494924 / 36656286 / -0.4% 0.81 / 0.77 / +4.2%
tpcds_q69/duckdb:parquet 25735636 / 25861372 / -0.5% 34394177 / 35333775 / -2.7% 0.75 / 0.73 / +2.2%
tpcds_q70/duckdb:parquet 19319601 / 19348212 / -0.1% 27091252 / 26807220 / +1.1% 0.71 / 0.72 / -1.2%
tpcds_q71/duckdb:parquet 17042572 / 16889906 / +0.9% 23886362 / 23841486 / +0.2% 0.71 / 0.71 / +0.7%
tpcds_q72/duckdb:parquet 52622218 / 52925906 / -0.6% 58912580 / 59850874 / -1.6% 0.89 / 0.88 / +1.0%
tpcds_q73/duckdb:parquet 15132582 / 14925358 / +1.4% 21764778 / 21830813 / -0.3% 0.70 / 0.68 / +1.7%
tpcds_q74/duckdb:parquet 84720758 / 85331065 / -0.7% 91307236 / 91690145 / -0.4% 0.93 / 0.93 / -0.3%
tpcds_q75/duckdb:parquet 45375330 / 44311504 / +2.4% 50174915 / 49626442 / +1.1% 0.90 / 0.89 / +1.3%
tpcds_q76/duckdb:parquet 16829437 / 19474918 / -13.6% 🟢 23484085 / 23702689 / -0.9% 0.72 / 0.82 / -12.8%
tpcds_q77/duckdb:parquet 26686292 / 26663806 / +0.1% 31102904 / 31517585 / -1.3% 0.86 / 0.85 / +1.4%
tpcds_q78/duckdb:parquet 78283867 / 79372297 / -1.4% 85446052 / 86851279 / -1.6% 0.92 / 0.91 / +0.3%
tpcds_q79/duckdb:parquet 21512592 / 21665430 / -0.7% 29345162 / 28922682 / +1.5% 0.73 / 0.75 / -2.1%
tpcds_q80/duckdb:parquet 36624290 / 38373572 / -4.6% 44132559 / 43644558 / +1.1% 0.83 / 0.88 / -5.6%
tpcds_q81/duckdb:parquet 36242860 / 36344695 / -0.3% 44475812 / 45437862 / -2.1% 0.81 / 0.80 / +1.9%
tpcds_q82/duckdb:parquet 13406318 / 13472437 / -0.5% 21058615 / 20432164 / +3.1% 0.64 / 0.66 / -3.5%
tpcds_q83/duckdb:parquet 20052342 / 20319181 / -1.3% 24940679 / 24942372 / -0.0% 0.80 / 0.81 / -1.3%
tpcds_q84/duckdb:parquet 22795147 / 23246030 / -1.9% 28930349 / 29372398 / -1.5% 0.79 / 0.79 / -0.4%
tpcds_q85/duckdb:parquet 32382390 / 32445382 / -0.2% 39384126 / 39904193 / -1.3% 0.82 / 0.81 / +1.1%
tpcds_q86/duckdb:parquet 11841556 / 11941491 / -0.8% 16977223 / 17473612 / -2.8% 0.70 / 0.68 / +2.1%
tpcds_q87/duckdb:parquet 31417046 / 31557450 / -0.4% 35393602 / 35786251 / -1.1% 0.89 / 0.88 / +0.7%
tpcds_q88/duckdb:parquet 38289084 / 38282734 / +0.0% 43310791 / 41750246 / +3.7% 0.88 / 0.92 / -3.6%
tpcds_q89/duckdb:parquet 14279576 / 14146028 / +0.9% 21273524 / 21161936 / +0.5% 0.67 / 0.67 / +0.4%
tpcds_q90/duckdb:parquet 10068741 / 10137442 / -0.7% 15120591 / 14936224 / +1.2% 0.67 / 0.68 / -1.9%
tpcds_q91/duckdb:parquet 20910438 / 21237164 / -1.5% 28594677 / 28731485 / -0.5% 0.73 / 0.74 / -1.1%
tpcds_q92/duckdb:parquet 15664746 / 15655891 / +0.1% 21943346 / 22001567 / -0.3% 0.71 / 0.71 / +0.3%
tpcds_q93/duckdb:parquet 14156040 / 14287298 / -0.9% 20289918 / 20843450 / -2.7% 0.70 / 0.69 / +1.8%
tpcds_q94/duckdb:parquet 25336332 / 25573318 / -0.9% 32541191 / 32652982 / -0.3% 0.78 / 0.78 / -0.6%
tpcds_q95/duckdb:parquet 43948732 / 43882485 / +0.2% 49493904 / 49936844 / -0.9% 0.89 / 0.88 / +1.0%
tpcds_q96/duckdb:parquet 8148640 / 8201094 / -0.6% 13574112 / 13903725 / -2.4% 0.60 / 0.59 / +1.8%
tpcds_q97/duckdb:parquet 27483963 / 27614574 / -0.5% 33631462 / 34399010 / -2.2% 0.82 / 0.80 / +1.8%
tpcds_q98/duckdb:parquet 16555264 / 16619417 / -0.4% 22989151 / 23433302 / -1.9% 0.72 / 0.71 / +1.5%
tpcds_q99/duckdb:parquet 18855096 / 18737266 / +0.6% 24918606 / 24899526 / +0.1% 0.76 / 0.75 / +0.6%
duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15691171 / 15831076 / -0.9% 24901963 / 25109404 / -0.8% 0.63 / 0.63 / -0.1%
tpcds_q02/duckdb:duckdb 12404004 / 12339510 / +0.5% 19248940 / 19256656 / -0.0% 0.64 / 0.64 / +0.6%
tpcds_q03/duckdb:duckdb 5042651 / 4951398 / +1.8% 13246897 / 11834027 / +11.9% 🔴 0.38 / 0.42 / -9.0%
tpcds_q04/duckdb:duckdb 48919822 / 48651379 / +0.6% 56485936 / 55465738 / +1.8% 0.87 / 0.88 / -1.3%
tpcds_q05/duckdb:duckdb 15620099 / 15588992 / +0.2% 22665911 / 21667642 / +4.6% 0.69 / 0.72 / -4.2%
tpcds_q06/duckdb:duckdb 17821291 / 18073418 / -1.4% 30024399 / 30077492 / -0.2% 0.59 / 0.60 / -1.2%
tpcds_q07/duckdb:duckdb 20992198 / 21314538 / -1.5% 31827038 / 32310343 / -1.5% 0.66 / 0.66 / -0.0%
tpcds_q08/duckdb:duckdb 18325325 / 18229258 / +0.5% 28943116 / 28020132 / +3.3% 0.63 / 0.65 / -2.7%
tpcds_q09/duckdb:duckdb 8597906 / 8633410 / -0.4% 13462011 / 13410017 / +0.4% 0.64 / 0.64 / -0.8%
tpcds_q10/duckdb:duckdb 17955264 / 17904838 / +0.3% 28813197 / 27949863 / +3.1% 0.62 / 0.64 / -2.7%
tpcds_q11/duckdb:duckdb 42095386 / 42271876 / -0.4% 50411640 / 49945183 / +0.9% 0.84 / 0.85 / -1.3%
tpcds_q12/duckdb:duckdb 8528137 / 9129860 / -6.6% 16539410 / 16787366 / -1.5% 0.52 / 0.54 / -5.2%
tpcds_q13/duckdb:duckdb 20251188 / 20336058 / -0.4% 32585274 / 33776833 / -3.5% 0.62 / 0.60 / +3.2%
tpcds_q14/duckdb:duckdb 39748339 / 39955406 / -0.5% 44739567 / 45516868 / -1.7% 0.89 / 0.88 / +1.2%
tpcds_q15/duckdb:duckdb 7913916 / 7915560 / -0.0% 14113657 / 13510993 / +4.5% 0.56 / 0.59 / -4.3%
tpcds_q16/duckdb:duckdb 12321992 / 12317982 / +0.0% 21630063 / 22096905 / -2.1% 0.57 / 0.56 / +2.2%
tpcds_q17/duckdb:duckdb 17845493 / 18432618 / -3.2% 30187508 / 29983252 / +0.7% 0.59 / 0.61 / -3.8%
tpcds_q18/duckdb:duckdb 31762212 / 32404197 / -2.0% 45047959 / 46050376 / -2.2% 0.71 / 0.70 / +0.2%
tpcds_q19/duckdb:duckdb 10818379 / 10619774 / +1.9% 20542599 / 19604468 / +4.8% 0.53 / 0.54 / -2.8%
tpcds_q20/duckdb:duckdb 9125139 / 9720990 / -6.1% 16751342 / 17335543 / -3.4% 0.54 / 0.56 / -2.9%
tpcds_q21/duckdb:duckdb 6136396 / 6103944 / +0.5% 10932247 / 11442635 / -4.5% 0.56 / 0.53 / +5.2%
tpcds_q22/duckdb:duckdb 17580809 / 17616202 / -0.2% 23368266 / 23049588 / +1.4% 0.75 / 0.76 / -1.6%
tpcds_q23/duckdb:duckdb 26596216 / 26798262 / -0.8% 35707466 / 34701048 / +2.9% 0.74 / 0.77 / -3.6%
tpcds_q24/duckdb:duckdb 15431009 / 15451792 / -0.1% 29419698 / 30474202 / -3.5% 0.52 / 0.51 / +3.4%
tpcds_q25/duckdb:duckdb 13779601 / 14088622 / -2.2% 27422910 / 26782495 / +2.4% 0.50 / 0.53 / -4.5%
tpcds_q26/duckdb:duckdb 18103866 / 18149837 / -0.3% 27945096 / 29472225 / -5.2% 0.65 / 0.62 / +5.2%
tpcds_q27/duckdb:duckdb 23429917 / 23730431 / -1.3% 34905924 / 35060187 / -0.4% 0.67 / 0.68 / -0.8%
tpcds_q28/duckdb:duckdb 11857054 / 11873108 / -0.1% 17940247 / 18587852 / -3.5% 0.66 / 0.64 / +3.5%
tpcds_q29/duckdb:duckdb 13922846 / 14058447 / -1.0% 26523132 / 25548870 / +3.8% 0.52 / 0.55 / -4.6%
tpcds_q30/duckdb:duckdb 17460674 / 17527942 / -0.4% 29141919 / 30856918 / -5.6% 0.60 / 0.57 / +5.5%
tpcds_q31/duckdb:duckdb 30123448 / 30319757 / -0.6% 39220526 / 39298966 / -0.2% 0.77 / 0.77 / -0.4%
tpcds_q32/duckdb:duckdb 5458649 / 5350896 / +2.0% 13169336 / 12971612 / +1.5% 0.41 / 0.41 / +0.5%
tpcds_q33/duckdb:duckdb 9143996 / 9058868 / +0.9% 16596552 / 16261293 / +2.1% 0.55 / 0.56 / -1.1%
tpcds_q34/duckdb:duckdb 10488950 / 10552538 / -0.6% 19633369 / 20145295 / -2.5% 0.53 / 0.52 / +2.0%
tpcds_q35/duckdb:duckdb 24304685 / 24262220 / +0.2% 34269174 / 34770689 / -1.4% 0.71 / 0.70 / +1.6%
tpcds_q36/duckdb:duckdb 12723592 / 12937752 / -1.7% 22673052 / 22734018 / -0.3% 0.56 / 0.57 / -1.4%
tpcds_q37/duckdb:duckdb 5628989 / 5287268 / +6.5% 14044255 / 13559447 / +3.6% 0.40 / 0.39 / +2.8%
tpcds_q38/duckdb:duckdb 22810140 / 22717384 / +0.4% 30199389 / 29241783 / +3.3% 0.76 / 0.78 / -2.8%
tpcds_q39/duckdb:duckdb 19347689 / 19333583 / +0.1% 24434747 / 24715463 / -1.1% 0.79 / 0.78 / +1.2%
tpcds_q40/duckdb:duckdb 8367734 / 8460472 / -1.1% 16391686 / 16488913 / -0.6% 0.51 / 0.51 / -0.5%
tpcds_q41/duckdb:duckdb 10054622 / 10206606 / -1.5% 16726758 / 17532579 / -4.6% 0.60 / 0.58 / +3.3%
tpcds_q42/duckdb:duckdb 4738460 / 4844091 / -2.2% 11616414 / 11526362 / +0.8% 0.41 / 0.42 / -2.9%
tpcds_q43/duckdb:duckdb 7603541 / 7548021 / +0.7% 15002763 / 14922096 / +0.5% 0.51 / 0.51 / +0.2%
tpcds_q44/duckdb:duckdb 9308228 / 9277172 / +0.3% 18973486 / 18116880 / +4.7% 0.49 / 0.51 / -4.2%
tpcds_q45/duckdb:duckdb 13669021 / 13623874 / +0.3% 23113924 / 23139749 / -0.1% 0.59 / 0.59 / +0.4%
tpcds_q46/duckdb:duckdb 24867968 / 25018194 / -0.6% 36248162 / 35898517 / +1.0% 0.69 / 0.70 / -1.6%
tpcds_q47/duckdb:duckdb 33756140 / 33359502 / +1.2% 42975129 / 41900960 / +2.6% 0.79 / 0.80 / -1.3%
tpcds_q48/duckdb:duckdb 27238134 / 27219838 / +0.1% 36813428 / 37492496 / -1.8% 0.74 / 0.73 / +1.9%
tpcds_q49/duckdb:duckdb 14455187 / 14667164 / -1.4% 25090561 / 25355216 / -1.0% 0.58 / 0.58 / -0.4%
tpcds_q50/duckdb:duckdb 10111878 / 9954688 / +1.6% 18564360 / 18076127 / +2.7% 0.54 / 0.55 / -1.1%
tpcds_q51/duckdb:duckdb 46854886 / 46525361 / +0.7% 53746992 / 56250096 / -4.4% 0.87 / 0.83 / +5.4%
tpcds_q52/duckdb:duckdb 5075098 / 5008062 / +1.3% 12073660 / 12346960 / -2.2% 0.42 / 0.41 / +3.6%
tpcds_q53/duckdb:duckdb 9380430 / 9444844 / -0.7% 17840367 / 17395780 / +2.6% 0.53 / 0.54 / -3.2%
tpcds_q54/duckdb:duckdb 11768031 / 11820233 / -0.4% 21782811 / 22359404 / -2.6% 0.54 / 0.53 / +2.2%
tpcds_q55/duckdb:duckdb 4868927 / 4790737 / +1.6% 11753604 / 12222668 / -3.8% 0.41 / 0.39 / +5.7%
tpcds_q56/duckdb:duckdb 10077790 / 10122444 / -0.4% 18222515 / 17992274 / +1.3% 0.55 / 0.56 / -1.7%
tpcds_q57/duckdb:duckdb 27972528 / 27821470 / +0.5% 35465764 / 34962484 / +1.4% 0.79 / 0.80 / -0.9%
tpcds_q58/duckdb:duckdb 10854971 / 10700472 / +1.4% 17679426 / 17925173 / -1.4% 0.61 / 0.60 / +2.9%
tpcds_q59/duckdb:duckdb 16827511 / 16840411 / -0.1% 24337178 / 24674720 / -1.4% 0.69 / 0.68 / +1.3%
tpcds_q60/duckdb:duckdb 11175734 / 11033991 / +1.3% 18630478 / 18271680 / +2.0% 0.60 / 0.60 / -0.7%
tpcds_q61/duckdb:duckdb 10061396 / 9913504 / +1.5% 19200629 / 19044902 / +0.8% 0.52 / 0.52 / +0.7%
tpcds_q62/duckdb:duckdb 8279820 / 8258114 / +0.3% 15250987 / 15248384 / +0.0% 0.54 / 0.54 / +0.2%
tpcds_q63/duckdb:duckdb 8960176 / 8864526 / +1.1% 17343326 / 17023848 / +1.9% 0.52 / 0.52 / -0.8%
tpcds_q64/duckdb:duckdb 38109642 / 38721924 / -1.6% 55940518 / 57396408 / -2.5% 0.68 / 0.67 / +1.0%
tpcds_q65/duckdb:duckdb 9797920 / 9933556 / -1.4% 19196197 / 19047375 / +0.8% 0.51 / 0.52 / -2.1%
tpcds_q66/duckdb:duckdb 24465810 / 24444407 / +0.1% 32908634 / 31954532 / +3.0% 0.74 / 0.76 / -2.8%
tpcds_q67/duckdb:duckdb 55190530 / 55417936 / -0.4% 66974053 / 65381648 / +2.4% 0.82 / 0.85 / -2.8%
tpcds_q68/duckdb:duckdb 15890396 / 15838488 / +0.3% 28130182 / 27468915 / +2.4% 0.56 / 0.58 / -2.0%
tpcds_q69/duckdb:duckdb 15293944 / 15274502 / +0.1% 24762321 / 25241585 / -1.9% 0.62 / 0.61 / +2.1%
tpcds_q70/duckdb:duckdb 10058924 / 10079914 / -0.2% 20343590 / 21532109 / -5.5% 0.49 / 0.47 / +5.6%
tpcds_q71/duckdb:duckdb 8059796 / 7919942 / +1.8% 15778844 / 15657574 / +0.8% 0.51 / 0.51 / +1.0%
tpcds_q72/duckdb:duckdb 36088148 / 36704120 / -1.7% 46998061 / 47628008 / -1.3% 0.77 / 0.77 / -0.4%
tpcds_q73/duckdb:duckdb 7868812 / 7962098 / -1.2% 16805421 / 16964106 / -0.9% 0.47 / 0.47 / -0.2%
tpcds_q74/duckdb:duckdb 36181010 / 36183282 / -0.0% 43525050 / 45427130 / -4.2% 0.83 / 0.80 / +4.4%
tpcds_q75/duckdb:duckdb 29855940 / 29831664 / +0.1% 41397748 / 41749106 / -0.8% 0.72 / 0.71 / +0.9%
tpcds_q76/duckdb:duckdb 8159608 / 8122402 / +0.5% 16859543 / 16672452 / +1.1% 0.48 / 0.49 / -0.7%
tpcds_q77/duckdb:duckdb 10598400 / 10484380 / +1.1% 20434221 / 21091814 / -3.1% 0.52 / 0.50 / +4.3%
tpcds_q78/duckdb:duckdb 64989714 / 64884932 / +0.2% 74824266 / 75844584 / -1.3% 0.87 / 0.86 / +1.5%
tpcds_q79/duckdb:duckdb 12117789 / 12185432 / -0.6% 21901922 / 22151559 / -1.1% 0.55 / 0.55 / +0.6%
tpcds_q80/duckdb:duckdb 16705360 / 16976839 / -1.6% 29532042 / 29661046 / -0.4% 0.57 / 0.57 / -1.2%
tpcds_q81/duckdb:duckdb 25175599 / 25479698 / -1.2% 37250656 / 37872864 / -1.6% 0.68 / 0.67 / +0.5%
tpcds_q82/duckdb:duckdb 6059606 / 5735178 / +5.7% 14715807 / 14352353 / +2.5% 0.41 / 0.40 / +3.0%
tpcds_q83/duckdb:duckdb 8939983 / 9001214 / -0.7% 15203540 / 15193521 / +0.1% 0.59 / 0.59 / -0.7%
tpcds_q84/duckdb:duckdb 9170209 / 9190154 / -0.2% 18120388 / 17937956 / +1.0% 0.51 / 0.51 / -1.2%
tpcds_q85/duckdb:duckdb 20906824 / 21350874 / -2.1% 34971668 / 36803590 / -5.0% 0.60 / 0.58 / +3.0%
tpcds_q86/duckdb:duckdb 8620006 / 8668134 / -0.6% 15215248 / 15265573 / -0.3% 0.57 / 0.57 / -0.2%
tpcds_q87/duckdb:duckdb 24647051 / 24815474 / -0.7% 31583287 / 31757866 / -0.5% 0.78 / 0.78 / -0.1%
tpcds_q88/duckdb:duckdb 18825155 / 18741660 / +0.4% 24976193 / 23979317 / +4.2% 0.75 / 0.78 / -3.6%
tpcds_q89/duckdb:duckdb 10413528 / 10361853 / +0.5% 19880956 / 18595626 / +6.9% 0.52 / 0.56 / -6.0%
tpcds_q90/duckdb:duckdb 4938808 / 4943040 / -0.1% 10408649 / 10745549 / -3.1% 0.47 / 0.46 / +3.1%
tpcds_q91/duckdb:duckdb 8950123 / 8906646 / +0.5% 18610562 / 18532206 / +0.4% 0.48 / 0.48 / +0.1%
tpcds_q92/duckdb:duckdb 6635642 / 6816346 / -2.7% 14917486 / 14858864 / +0.4% 0.44 / 0.46 / -3.0%
tpcds_q93/duckdb:duckdb 6880468 / 6933606 / -0.8% 14343527 / 15155531 / -5.4% 0.48 / 0.46 / +4.9%
tpcds_q94/duckdb:duckdb 11756282 / 11792288 / -0.3% 23062340 / 23373525 / -1.3% 0.51 / 0.50 / +1.0%
tpcds_q95/duckdb:duckdb 35354286 / 35831062 / -1.3% 44287017 / 44775248 / -1.1% 0.80 / 0.80 / -0.2%
tpcds_q96/duckdb:duckdb 3837644 / 3904904 / -1.7% 9885312 / 9440355 / +4.7% 0.39 / 0.41 / -6.1%
tpcds_q97/duckdb:duckdb 21692964 / 21641727 / +0.2% 28193192 / 28034034 / +0.6% 0.77 / 0.77 / -0.3%
tpcds_q98/duckdb:duckdb 9990072 / 10685965 / -6.5% 19084355 / 19569174 / -2.5% 0.52 / 0.55 / -4.1%
tpcds_q99/duckdb:duckdb 13079386 / 13117432 / -0.3% 20712344 / 19926946 / +3.9% 0.63 / 0.66 / -4.1%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.7%
Engines: DataFusion No clear signal (-3.8%, environment too noisy confidence) · DuckDB No clear signal (-5.6%, environment too noisy confidence)
Vortex (geomean): hot 0.809x ➖ · cold 0.845x ➖
Parquet (geomean): hot 0.848x ➖ · cold 0.830x ➖
Shifts: Parquet (control) -15.2% · Median polish -14.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.767x ➖, 9↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 218622774 / 218576193 / +0.0% 837682625 / 695346481 / +20.5% 0.26 / 0.31 / -17.0%
tpch_q02/datafusion:vortex-file-compressed 313265927 / 380301251 / -17.6% 589405146 / 788609133 / -25.3% 0.53 / 0.48 / +10.2%
tpch_q03/datafusion:vortex-file-compressed 363841132 / 381836227 / -4.7% 1070254929 / 1403701876 / -23.8% 0.34 / 0.27 / +25.0%
tpch_q04/datafusion:vortex-file-compressed 201337535 / 330349612 / -39.1% 🟢 487263476 / 681568313 / -28.5% 0.41 / 0.48 / -14.7%
tpch_q05/datafusion:vortex-file-compressed 400419854 / 712330783 / -43.8% 🟢 1013524577 / 1296332519 / -21.8% 0.40 / 0.55 / -28.1%
tpch_q06/datafusion:vortex-file-compressed 141650990 / 145238975 / -2.5% 298106633 / 304771030 / -2.2% 0.48 / 0.48 / -0.3%
tpch_q07/datafusion:vortex-file-compressed 389764591 / 757701721 / -48.6% 🟢 589833453 / 1000065431 / -41.0% 🟢 0.66 / 0.76 / -12.8%
tpch_q08/datafusion:vortex-file-compressed 458895043 / 566360697 / -19.0% 760594425 / 904804745 / -15.9% 0.60 / 0.63 / -3.6%
tpch_q09/datafusion:vortex-file-compressed 278049112 / 671237185 / -58.6% 🟢 476434521 / 937335491 / -49.2% 🟢 0.58 / 0.72 / -18.5%
tpch_q10/datafusion:vortex-file-compressed 335475630 / 523710508 / -35.9% 🟢 563453407 / 624833052 / -9.8% 0.60 / 0.84 / -29.0%
tpch_q11/datafusion:vortex-file-compressed 255452317 / 496360516 / -48.5% 🟢 453164825 / 550632003 / -17.7% 0.56 / 0.90 / -37.5%
tpch_q12/datafusion:vortex-file-compressed 235477832 / 338492582 / -30.4% 🟢 348204511 / 648310477 / -46.3% 🟢 0.68 / 0.52 / +29.5%
tpch_q13/datafusion:vortex-file-compressed 140913326 / 230043797 / -38.7% 🟢 420473601 / 457039522 / -8.0% 0.34 / 0.50 / -33.4%
tpch_q14/datafusion:vortex-file-compressed 169954611 / 205520722 / -17.3% 333467215 / 413118049 / -19.3% 0.51 / 0.50 / +2.4%
tpch_q15/datafusion:vortex-file-compressed 373480004 / 389299833 / -4.1% 775918235 / 716566408 / +8.3% 0.48 / 0.54 / -11.4%
tpch_q16/datafusion:vortex-file-compressed 140558694 / 125782046 / +11.7% 286841622 / 303664093 / -5.5% 0.49 / 0.41 / +18.3%
tpch_q17/datafusion:vortex-file-compressed 452134508 / 277211476 / +63.1% 🔴 712063521 / 513665973 / +38.6% 🔴 0.63 / 0.54 / +17.7%
tpch_q18/datafusion:vortex-file-compressed 256060168 / 323733710 / -20.9% 521139309 / 762305925 / -31.6% 🟢 0.49 / 0.42 / +15.7%
tpch_q19/datafusion:vortex-file-compressed 261424487 / 379438658 / -31.1% 🟢 412887482 / 619366875 / -33.3% 🟢 0.63 / 0.61 / +3.4%
tpch_q20/datafusion:vortex-file-compressed 270565374 / 318597034 / -15.1% 428904132 / 473819559 / -9.5% 0.63 / 0.67 / -6.2%
tpch_q21/datafusion:vortex-file-compressed 806477244 / 1019905456 / -20.9% 1249937278 / 806910404 / +54.9% 🔴 0.65 / 1.26 / -49.0%
tpch_q22/datafusion:vortex-file-compressed 147679032 / 170135558 / -13.2% 387624924 / 453252628 / -14.5% 0.38 / 0.38 / +1.5%
datafusion / vortex-compact / ns (0.817x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 237786845 / 277982742 / -14.5% 641353861 / 591574253 / +8.4% 0.37 / 0.47 / -21.1%
tpch_q02/datafusion:vortex-compact 329411152 / 358268556 / -8.1% 672450795 / 667189071 / +0.8% 0.49 / 0.54 / -8.8%
tpch_q03/datafusion:vortex-compact 318227835 / 341195540 / -6.7% 653645596 / 773847195 / -15.5% 0.49 / 0.44 / +10.4%
tpch_q04/datafusion:vortex-compact 147862465 / 157605860 / -6.2% 366519450 / 373209260 / -1.8% 0.40 / 0.42 / -4.5%
tpch_q05/datafusion:vortex-compact 334016680 / 373395398 / -10.5% 543861188 / 672679359 / -19.2% 0.61 / 0.56 / +10.6%
tpch_q06/datafusion:vortex-compact 162392432 / 171606575 / -5.4% 394649086 / 349425031 / +12.9% 0.41 / 0.49 / -16.2%
tpch_q07/datafusion:vortex-compact 426738203 / 482706920 / -11.6% 586396807 / 590634156 / -0.7% 0.73 / 0.82 / -11.0%
tpch_q08/datafusion:vortex-compact 367216157 / 1816833695 / -79.8% 🟢 612865564 / 3921803085 / -84.4% 🟢 0.60 / 0.46 / +29.3%
tpch_q09/datafusion:vortex-compact 281074572 / 394549839 / -28.8% 497320802 / 629987181 / -21.1% 0.57 / 0.63 / -9.8%
tpch_q10/datafusion:vortex-compact 344265785 / 446627271 / -22.9% 662703397 / 512661051 / +29.3% 0.52 / 0.87 / -40.4%
tpch_q11/datafusion:vortex-compact 260989401 / 394326798 / -33.8% 🟢 483746272 / 668222193 / -27.6% 0.54 / 0.59 / -8.6%
tpch_q12/datafusion:vortex-compact 165622577 / 191854929 / -13.7% 365328112 / 442979800 / -17.5% 0.45 / 0.43 / +4.7%
tpch_q13/datafusion:vortex-compact 110363082 / 146324395 / -24.6% 317837469 / 356618676 / -10.9% 0.35 / 0.41 / -15.4%
tpch_q14/datafusion:vortex-compact 186310993 / 178017718 / +4.7% 438671542 / 334431469 / +31.2% 🔴 0.42 / 0.53 / -20.2%
tpch_q15/datafusion:vortex-compact 299075975 / 305959944 / -2.2% 499309630 / 555129877 / -10.1% 0.60 / 0.55 / +8.7%
tpch_q16/datafusion:vortex-compact 133151509 / 151631885 / -12.2% 315065256 / 324860230 / -3.0% 0.42 / 0.47 / -9.5%
tpch_q17/datafusion:vortex-compact 508039330 / 303612921 / +67.3% 🔴 442174673 / 514821264 / -14.1% 1.15 / 0.59 / +94.8%
tpch_q18/datafusion:vortex-compact 239591056 / 409830152 / -41.5% 🟢 412857715 / 493486841 / -16.3% 0.58 / 0.83 / -30.1%
tpch_q19/datafusion:vortex-compact 254184468 / 266769738 / -4.7% 405125465 / 418018528 / -3.1% 0.63 / 0.64 / -1.7%
tpch_q20/datafusion:vortex-compact 258167211 / 288403906 / -10.5% 406149696 / 673001602 / -39.7% 🟢 0.64 / 0.43 / +48.3%
tpch_q21/datafusion:vortex-compact 380870054 / 586336055 / -35.0% 🟢 836536550 / 986285607 / -15.2% 0.46 / 0.59 / -23.4%
tpch_q22/datafusion:vortex-compact 166416832 / 171750105 / -3.1% 347734307 / 349380707 / -0.5% 0.48 / 0.49 / -2.6%
datafusion / parquet / ns (0.822x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 159703113 / 187453903 / -14.8% 469519937 / 522187764 / -10.1% 0.34 / 0.36 / -5.2%
tpch_q02/datafusion:parquet 280019135 / 279413320 / +0.2% 564365643 / 477084389 / +18.3% 0.50 / 0.59 / -15.3%
tpch_q03/datafusion:parquet 241841134 / 261895120 / -7.7% 890127817 / 828592026 / +7.4% 0.27 / 0.32 / -14.0%
tpch_q04/datafusion:parquet 137432285 / 600435370 / -77.1% 🟢 332737190 / 960037418 / -65.3% 🟢 0.41 / 0.63 / -34.0%
tpch_q05/datafusion:parquet 368655655 / 483877364 / -23.8% 539218885 / 964823632 / -44.1% 🟢 0.68 / 0.50 / +36.3%
tpch_q06/datafusion:parquet 105099921 / 122834179 / -14.4% 257222873 / 257704444 / -0.2% 0.41 / 0.48 / -14.3%
tpch_q07/datafusion:parquet 327641235 / 353431985 / -7.3% 464348433 / 510371318 / -9.0% 0.71 / 0.69 / +1.9%
tpch_q08/datafusion:parquet 424943348 / 502966582 / -15.5% 598541186 / 644941241 / -7.2% 0.71 / 0.78 / -9.0%
tpch_q09/datafusion:parquet 413430320 / 454988989 / -9.1% 736233770 / 654790588 / +12.4% 0.56 / 0.69 / -19.2%
tpch_q10/datafusion:parquet 341072452 / 374860769 / -9.0% 469724145 / 500655008 / -6.2% 0.73 / 0.75 / -3.0%
tpch_q11/datafusion:parquet 371359068 / 248487085 / +49.4% 🔴 887968330 / 476801373 / +86.2% 🔴 0.42 / 0.52 / -19.8%
tpch_q12/datafusion:parquet 165535399 / 157668434 / +5.0% 319519308 / 345215676 / -7.4% 0.52 / 0.46 / +13.4%
tpch_q13/datafusion:parquet 270665441 / 279923665 / -3.3% 446743791 / 437335517 / +2.2% 0.61 / 0.64 / -5.3%
tpch_q14/datafusion:parquet 160211242 / 175591244 / -8.8% 322068824 / 375648328 / -14.3% 0.50 / 0.47 / +6.4%
tpch_q15/datafusion:parquet 296286414 / 349104731 / -15.1% 521531909 / 706833080 / -26.2% 0.57 / 0.49 / +15.0%
tpch_q16/datafusion:parquet 101809639 / 105962638 / -3.9% 240071326 / 248791903 / -3.5% 0.42 / 0.43 / -0.4%
tpch_q17/datafusion:parquet 280630410 / 372398204 / -24.6% 435919530 / 528418842 / -17.5% 0.64 / 0.70 / -8.7%
tpch_q18/datafusion:parquet 325512267 / 421910110 / -22.8% 466422445 / 819041728 / -43.1% 🟢 0.70 / 0.52 / +35.5%
tpch_q19/datafusion:parquet 171292257 / 203845393 / -16.0% 352073437 / 333176939 / +5.7% 0.49 / 0.61 / -20.5%
tpch_q20/datafusion:parquet 221777644 / 567041312 / -60.9% 🟢 383181704 / 770145076 / -50.2% 🟢 0.58 / 0.74 / -21.4%
tpch_q21/datafusion:parquet 318846908 / 345532585 / -7.7% 494145037 / 557062599 / -11.3% 0.65 / 0.62 / +4.0%
tpch_q22/datafusion:parquet 152541376 / 170369057 / -10.5% 324122811 / 454229172 / -28.6% 0.47 / 0.38 / +25.5%
duckdb / vortex-file-compressed / ns (0.847x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 270172076 / 260068785 / +3.9% 270767766 / 307115276 / -11.8% 1.00 / 0.85 / +17.8%
tpch_q02/duckdb:vortex-file-compressed 472766144 / 427918102 / +10.5% 504070954 / 505052196 / -0.2% 0.94 / 0.85 / +10.7%
tpch_q03/duckdb:vortex-file-compressed 536354996 / 503452252 / +6.5% 566713137 / 474859860 / +19.3% 0.95 / 1.06 / -10.7%
tpch_q04/duckdb:vortex-file-compressed 359306782 / 287136442 / +25.1% 356436531 / 313352394 / +13.7% 1.01 / 0.92 / +10.0%
tpch_q05/duckdb:vortex-file-compressed 591767813 / 705483458 / -16.1% 883770868 / 659416008 / +34.0% 🔴 0.67 / 1.07 / -37.4%
tpch_q06/duckdb:vortex-file-compressed 172501643 / 175929077 / -1.9% 213961472 / 263131148 / -18.7% 0.81 / 0.67 / +20.6%
tpch_q07/duckdb:vortex-file-compressed 416155727 / 541057148 / -23.1% 433771867 / 609738149 / -28.9% 0.96 / 0.89 / +8.1%
tpch_q08/duckdb:vortex-file-compressed 625436245 / 710025264 / -11.9% 787691057 / 961059814 / -18.0% 0.79 / 0.74 / +7.5%
tpch_q09/duckdb:vortex-file-compressed 403010226 / 592907289 / -32.0% 🟢 454841703 / 466160817 / -2.4% 0.89 / 1.27 / -30.3%
tpch_q10/duckdb:vortex-file-compressed 586071139 / 639379840 / -8.3% 585318553 / 613222697 / -4.6% 1.00 / 1.04 / -4.0%
tpch_q11/duckdb:vortex-file-compressed 340596489 / 324058369 / +5.1% 429081016 / 384641628 / +11.6% 0.79 / 0.84 / -5.8%
tpch_q12/duckdb:vortex-file-compressed 238083631 / 278894880 / -14.6% 306417588 / 661486606 / -53.7% 🟢 0.78 / 0.42 / +84.3%
tpch_q13/duckdb:vortex-file-compressed 227466223 / 304447485 / -25.3% 248083493 / 507509395 / -51.1% 🟢 0.92 / 0.60 / +52.8%
tpch_q14/duckdb:vortex-file-compressed 220242454 / 234154869 / -5.9% 293009758 / 340033779 / -13.8% 0.75 / 0.69 / +9.2%
tpch_q15/duckdb:vortex-file-compressed 245648678 / 360978211 / -31.9% 🟢 296639046 / 467989479 / -36.6% 🟢 0.83 / 0.77 / +7.4%
tpch_q16/duckdb:vortex-file-compressed 214219761 / 220216344 / -2.7% 254799647 / 232645939 / +9.5% 0.84 / 0.95 / -11.2%
tpch_q17/duckdb:vortex-file-compressed 286165490 / 676068130 / -57.7% 🟢 333194957 / 577128579 / -42.3% 🟢 0.86 / 1.17 / -26.7%
tpch_q18/duckdb:vortex-file-compressed 360869415 / 462308484 / -21.9% 398724672 / 497387936 / -19.8% 0.91 / 0.93 / -2.6%
tpch_q19/duckdb:vortex-file-compressed 317093918 / 318862371 / -0.6% 361358481 / 384539990 / -6.0% 0.88 / 0.83 / +5.8%
tpch_q20/duckdb:vortex-file-compressed 353619307 / 753285988 / -53.1% 🟢 449596557 / 889195273 / -49.4% 🟢 0.79 / 0.85 / -7.2%
tpch_q21/duckdb:vortex-file-compressed 565008866 / 663825998 / -14.9% 622993864 / 684027732 / -8.9% 0.91 / 0.97 / -6.5%
tpch_q22/duckdb:vortex-file-compressed 263838796 / 294686799 / -10.5% 280507049 / 285924567 / -1.9% 0.94 / 1.03 / -8.7%
duckdb / vortex-compact / ns (0.807x ➖, 7↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 270805855 / 337922559 / -19.9% 234302580 / 356911303 / -34.4% 🟢 1.16 / 0.95 / +22.1%
tpch_q02/duckdb:vortex-compact 389968351 / 577183970 / -32.4% 🟢 446414919 / 515641254 / -13.4% 0.87 / 1.12 / -22.0%
tpch_q03/duckdb:vortex-compact 375057089 / 372582211 / +0.7% 413668230 / 440421418 / -6.1% 0.91 / 0.85 / +7.2%
tpch_q04/duckdb:vortex-compact 250005256 / 300841535 / -16.9% 281487865 / 300807445 / -6.4% 0.89 / 1.00 / -11.2%
tpch_q05/duckdb:vortex-compact 485075789 / 527282134 / -8.0% 539569255 / 654949498 / -17.6% 0.90 / 0.81 / +11.7%
tpch_q06/duckdb:vortex-compact 296509912 / 284845414 / +4.1% 339507112 / 225670925 / +50.4% 🔴 0.87 / 1.26 / -30.8%
tpch_q07/duckdb:vortex-compact 394270252 / 415037357 / -5.0% 491307254 / 561808394 / -12.5% 0.80 / 0.74 / +8.6%
tpch_q08/duckdb:vortex-compact 545576339 / 642071314 / -15.0% 602427184 / 735737693 / -18.1% 0.91 / 0.87 / +3.8%
tpch_q09/duckdb:vortex-compact 442277996 / 702474364 / -37.0% 🟢 486410840 / 631380900 / -23.0% 0.91 / 1.11 / -18.3%
tpch_q10/duckdb:vortex-compact 460021528 / 786133125 / -41.5% 🟢 530589161 / 663327654 / -20.0% 0.87 / 1.19 / -26.8%
tpch_q11/duckdb:vortex-compact 275164399 / 304052016 / -9.5% 311226287 / 328035590 / -5.1% 0.88 / 0.93 / -4.6%
tpch_q12/duckdb:vortex-compact 200420684 / 247590097 / -19.1% 308146692 / 308204747 / -0.0% 0.65 / 0.80 / -19.0%
tpch_q13/duckdb:vortex-compact 201669550 / 228204281 / -11.6% 273763615 / 273823203 / -0.0% 0.74 / 0.83 / -11.6%
tpch_q14/duckdb:vortex-compact 234346948 / 238476292 / -1.7% 267204492 / 286249318 / -6.7% 0.88 / 0.83 / +5.3%
tpch_q15/duckdb:vortex-compact 237976077 / 363455903 / -34.5% 🟢 275492130 / 357614235 / -23.0% 0.86 / 1.02 / -15.0%
tpch_q16/duckdb:vortex-compact 213296100 / 187742053 / +13.6% 214637360 / 234705708 / -8.6% 0.99 / 0.80 / +24.2%
tpch_q17/duckdb:vortex-compact 320049030 / 297768461 / +7.5% 427872636 / 470716760 / -9.1% 0.75 / 0.63 / +18.2%
tpch_q18/duckdb:vortex-compact 306868090 / 523490422 / -41.4% 🟢 348519999 / 487360507 / -28.5% 0.88 / 1.07 / -18.0%
tpch_q19/duckdb:vortex-compact 331618701 / 367965183 / -9.9% 345988282 / 391420322 / -11.6% 0.96 / 0.94 / +2.0%
tpch_q20/duckdb:vortex-compact 331915156 / 640849067 / -48.2% 🟢 450353679 / 720451931 / -37.5% 🟢 0.74 / 0.89 / -17.1%
tpch_q21/duckdb:vortex-compact 490329522 / 826215157 / -40.7% 🟢 559061544 / 1012849593 / -44.8% 🟢 0.88 / 0.82 / +7.5%
tpch_q22/duckdb:vortex-compact 241702860 / 291744076 / -17.2% 261296072 / 314815781 / -17.0% 0.93 / 0.93 / -0.2%
duckdb / parquet / ns (0.875x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 183886798 / 205664847 / -10.6% 240983096 / 268636139 / -10.3% 0.76 / 0.77 / -0.3%
tpch_q02/duckdb:parquet 434641833 / 441836154 / -1.6% 459401361 / 535729943 / -14.2% 0.95 / 0.82 / +14.7%
tpch_q03/duckdb:parquet 398063454 / 401341983 / -0.8% 500301565 / 593948425 / -15.8% 0.80 / 0.68 / +17.7%
tpch_q04/duckdb:parquet 275430867 / 476490031 / -42.2% 🟢 282512649 / 544832604 / -48.1% 🟢 0.97 / 0.87 / +11.5%
tpch_q05/duckdb:parquet 501676134 / 658716492 / -23.8% 500825467 / 763727410 / -34.4% 🟢 1.00 / 0.86 / +16.1%
tpch_q06/duckdb:parquet 140810353 / 195488632 / -28.0% 201473838 / 218887245 / -8.0% 0.70 / 0.89 / -21.7%
tpch_q07/duckdb:parquet 449527064 / 492156077 / -8.7% 539374707 / 603114667 / -10.6% 0.83 / 0.82 / +2.1%
tpch_q08/duckdb:parquet 670764504 / 636327910 / +5.4% 780119100 / 761291094 / +2.5% 0.86 / 0.84 / +2.9%
tpch_q09/duckdb:parquet 648069030 / 647154690 / +0.1% 649907590 / 641184605 / +1.4% 1.00 / 1.01 / -1.2%
tpch_q10/duckdb:parquet 568286185 / 654922054 / -13.2% 585404354 / 934845826 / -37.4% 🟢 0.97 / 0.70 / +38.6%
tpch_q11/duckdb:parquet 283339187 / 410408037 / -31.0% 🟢 277245191 / 479619045 / -42.2% 🟢 1.02 / 0.86 / +19.4%
tpch_q12/duckdb:parquet 230599471 / 243551860 / -5.3% 277069240 / 296083102 / -6.4% 0.83 / 0.82 / +1.2%
tpch_q13/duckdb:parquet 357875531 / 388738804 / -7.9% 425117719 / 538971113 / -21.1% 0.84 / 0.72 / +16.7%
tpch_q14/duckdb:parquet 254028495 / 293916127 / -13.6% 301749378 / 308206262 / -2.1% 0.84 / 0.95 / -11.7%
tpch_q15/duckdb:parquet 254178807 / 418556335 / -39.3% 🟢 283947782 / 383676158 / -26.0% 0.90 / 1.09 / -17.9%
tpch_q16/duckdb:parquet 263155611 / 262465235 / +0.3% 294477409 / 538919259 / -45.4% 🟢 0.89 / 0.49 / +83.5%
tpch_q17/duckdb:parquet 258560727 / 330643017 / -21.8% 284251523 / 363289028 / -21.8% 0.91 / 0.91 / -0.1%
tpch_q18/duckdb:parquet 357348981 / 331086875 / +7.9% 399124604 / 407093639 / -2.0% 0.90 / 0.81 / +10.1%
tpch_q19/duckdb:parquet 264634548 / 239944103 / +10.3% 316149877 / 313117121 / +1.0% 0.84 / 0.77 / +9.2%
tpch_q20/duckdb:parquet 441977840 / 460769615 / -4.1% 521925662 / 519867299 / +0.4% 0.85 / 0.89 / -4.5%
tpch_q21/duckdb:parquet 462446321 / 496102385 / -6.8% 482103920 / 514370707 / -6.3% 0.96 / 0.96 / -0.5%
tpch_q22/duckdb:parquet 293320164 / 334951489 / -12.4% 305826437 / 524820778 / -41.7% 🟢 0.96 / 0.64 / +50.3%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: Likely regression (low confidence)
Attributed Vortex impact: +26.4%
Engines: DataFusion Likely regression (+52.5%, medium confidence) · DuckDB No clear signal (+4.7%, low confidence)
Vortex (geomean): hot 1.260x ❌ · cold 0.991x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.3% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.521x ❌, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 179473371 / 129988733 / +38.1% 🔴 500913139 / 514703668 / -2.7% 0.36 / 0.25 / +41.9%
vortex_q01/datafusion:vortex-file-compressed 129591459 / 123436113 / +5.0% 288138003 / 279618085 / +3.0% 0.45 / 0.44 / +1.9%
vortex_q02/datafusion:vortex-file-compressed 331032060 / 136435919 / +142.6% 🔴 285888231 / 270752255 / +5.6% 1.16 / 0.50 / +129.8%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 136138385 / 135819832 / +0.2% 1150593059 / 1180914991 / -2.6% 0.12 / 0.12 / +2.9%
vortex_q01/datafusion:parquet 69067673 / 69457076 / -0.6% 119879755 / 118062507 / +1.5% 0.58 / 0.59 / -2.1%
vortex_q02/datafusion:parquet 288397838 / 289639567 / -0.4% 671398472 / 686453455 / -2.2% 0.43 / 0.42 / +1.8%
duckdb / vortex-file-compressed / ns (1.044x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 196246027 / 190168055 / +3.2% 944987488 / 921124223 / +2.6% 0.21 / 0.21 / +0.6%
vortex_q01/duckdb:vortex-file-compressed 93121659 / 90855349 / +2.5% 325570253 / 357836299 / -9.0% 0.29 / 0.25 / +12.7%
vortex_q02/duckdb:vortex-file-compressed 190050319 / 176601012 / +7.6% 498694230 / 521553825 / -4.4% 0.38 / 0.34 / +12.5%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 279799677 / 280439911 / -0.2% 811018952 / 817572451 / -0.8% 0.34 / 0.34 / +0.6%
vortex_q01/duckdb:parquet 163830212 / 164635119 / -0.5% 173402916 / 180864238 / -4.1% 0.94 / 0.91 / +3.8%
vortex_q02/duckdb:parquet 344901844 / 345677011 / -0.2% 643714573 / 633683415 / +1.6% 0.54 / 0.55 / -1.8%

@github-actions

ghost commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR bfa85598 vs base 41dec206
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.7%
Engines: DataFusion No clear signal (+0.1%, environment too noisy confidence) · DuckDB No clear signal (-7.3%, environment too noisy confidence)
Vortex (geomean): hot 0.869x ➖ · cold 0.854x ➖
Parquet (geomean): hot 0.903x ➖ · cold 0.845x ➖
Shifts: Parquet (control) -9.7% · Median polish -10.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.872x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 343998428 / 342749653 / +0.4% 1022774108 / 1038495756 / -1.5% 0.34 / 0.33 / +1.9%
tpch_q02/datafusion:vortex-file-compressed 482724798 / 1147083914 / -57.9% 🟢 1007468778 / 1658687816 / -39.3% 🟢 0.48 / 0.69 / -30.7%
tpch_q03/datafusion:vortex-file-compressed 556241562 / 802431164 / -30.7% 🟢 1479355896 / 1526605830 / -3.1% 0.38 / 0.53 / -28.5%
tpch_q04/datafusion:vortex-file-compressed 512456066 / 562559434 / -8.9% 613394048 / 799097165 / -23.2% 0.84 / 0.70 / +18.7%
tpch_q05/datafusion:vortex-file-compressed 716409198 / 762453999 / -6.0% 892757344 / 1005905634 / -11.2% 0.80 / 0.76 / +5.9%
tpch_q06/datafusion:vortex-file-compressed 386751260 / 352715311 / +9.6% 468271066 / 476791392 / -1.8% 0.83 / 0.74 / +11.6%
tpch_q07/datafusion:vortex-file-compressed 651957912 / 3565175755 / -81.7% 🟢 880757693 / 2663666547 / -66.9% 🟢 0.74 / 1.34 / -44.7%
tpch_q08/datafusion:vortex-file-compressed 1390870310 / 1227673816 / +13.3% 1192247019 / 1810943975 / -34.2% 🟢 1.17 / 0.68 / +72.1%
tpch_q09/datafusion:vortex-file-compressed 1052071092 / 827714768 / +27.1% 1144000605 / 1561757182 / -26.7% 0.92 / 0.53 / +73.5%
tpch_q10/datafusion:vortex-file-compressed 807249723 / 650344815 / +24.1% 935114858 / 1127967119 / -17.1% 0.86 / 0.58 / +49.7%
tpch_q11/datafusion:vortex-file-compressed 388736738 / 436395405 / -10.9% 688023646 / 854298773 / -19.5% 0.57 / 0.51 / +10.6%
tpch_q12/datafusion:vortex-file-compressed 522295132 / 457618474 / +14.1% 621255007 / 616494885 / +0.8% 0.84 / 0.74 / +13.3%
tpch_q13/datafusion:vortex-file-compressed 343028137 / 402040254 / -14.7% 515230322 / 656169122 / -21.5% 0.67 / 0.61 / +8.7%
tpch_q14/datafusion:vortex-file-compressed 428859792 / 340173638 / +26.1% 894082373 / 785688604 / +13.8% 0.48 / 0.43 / +10.8%
tpch_q15/datafusion:vortex-file-compressed 586305701 / 644586069 / -9.0% 883901164 / 893059564 / -1.0% 0.66 / 0.72 / -8.1%
tpch_q16/datafusion:vortex-file-compressed 235288405 / 300852945 / -21.8% 419211672 / 527268475 / -20.5% 0.56 / 0.57 / -1.6%
tpch_q17/datafusion:vortex-file-compressed 752898729 / 764116362 / -1.5% 991589936 / 989829826 / +0.2% 0.76 / 0.77 / -1.6%
tpch_q18/datafusion:vortex-file-compressed 1002669169 / 838699479 / +19.6% 1176214136 / 1039971476 / +13.1% 0.85 / 0.81 / +5.7%
tpch_q19/datafusion:vortex-file-compressed 847522560 / 496285832 / +70.8% 🔴 1104121949 / 972975346 / +13.5% 0.77 / 0.51 / +50.5%
tpch_q20/datafusion:vortex-file-compressed 568769047 / 675458246 / -15.8% 821789366 / 863615856 / -4.8% 0.69 / 0.78 / -11.5%
tpch_q21/datafusion:vortex-file-compressed 1036657055 / 1111533095 / -6.7% 1270695237 / 1448934016 / -12.3% 0.82 / 0.77 / +6.3%
tpch_q22/datafusion:vortex-file-compressed 253961410 / 564289331 / -55.0% 🟢 557154042 / 1026682638 / -45.7% 🟢 0.46 / 0.55 / -17.1%
datafusion / vortex-compact / ns (0.907x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 311588260 / 343783100 / -9.4% 836182859 / 1086640714 / -23.0% 0.37 / 0.32 / +17.8%
tpch_q02/datafusion:vortex-compact 454136300 / 491620135 / -7.6% 1032573085 / 953800918 / +8.3% 0.44 / 0.52 / -14.7%
tpch_q03/datafusion:vortex-compact 465482027 / 493445547 / -5.7% 1190117164 / 1680031267 / -29.2% 0.39 / 0.29 / +33.2%
tpch_q04/datafusion:vortex-compact 520975396 / 428670075 / +21.5% 827118274 / 753710883 / +9.7% 0.63 / 0.57 / +10.7%
tpch_q05/datafusion:vortex-compact 886599248 / 858107957 / +3.3% 963034912 / 1064460572 / -9.5% 0.92 / 0.81 / +14.2%
tpch_q06/datafusion:vortex-compact 211732141 / 246331932 / -14.0% 458005270 / 446177266 / +2.7% 0.46 / 0.55 / -16.3%
tpch_q07/datafusion:vortex-compact 653780362 / 963773282 / -32.2% 🟢 751059644 / 864500231 / -13.1% 0.87 / 1.11 / -21.9%
tpch_q08/datafusion:vortex-compact 1013477430 / 1053764097 / -3.8% 1104023678 / 1167794516 / -5.5% 0.92 / 0.90 / +1.7%
tpch_q09/datafusion:vortex-compact 673149290 / 975387014 / -31.0% 🟢 1061353410 / 1278696260 / -17.0% 0.63 / 0.76 / -16.9%
tpch_q10/datafusion:vortex-compact 674941288 / 963723275 / -30.0% 1001340748 / 1269333352 / -21.1% 0.67 / 0.76 / -11.2%
tpch_q11/datafusion:vortex-compact 349454862 / 474885077 / -26.4% 624108668 / 707535071 / -11.8% 0.56 / 0.67 / -16.6%
tpch_q12/datafusion:vortex-compact 355889076 / 300502808 / +18.4% 604172630 / 548987544 / +10.1% 0.59 / 0.55 / +7.6%
tpch_q13/datafusion:vortex-compact 351878977 / 331793885 / +6.1% 531798041 / 1057181497 / -49.7% 🟢 0.66 / 0.31 / +110.8%
tpch_q14/datafusion:vortex-compact 589671119 / 356805522 / +65.3% 🔴 635090842 / 595319248 / +6.7% 0.93 / 0.60 / +54.9%
tpch_q15/datafusion:vortex-compact 527881551 / 606394902 / -12.9% 848943726 / 927747757 / -8.5% 0.62 / 0.65 / -4.9%
tpch_q16/datafusion:vortex-compact 234943300 / 373526089 / -37.1% 🟢 430301067 / 580733145 / -25.9% 0.55 / 0.64 / -15.1%
tpch_q17/datafusion:vortex-compact 742487756 / 786273019 / -5.6% 955380044 / 1057413102 / -9.6% 0.78 / 0.74 / +4.5%
tpch_q18/datafusion:vortex-compact 710530422 / 727403930 / -2.3% 815206088 / 845093587 / -3.5% 0.87 / 0.86 / +1.3%
tpch_q19/datafusion:vortex-compact 450433612 / 464402981 / -3.0% 561359922 / 767377026 / -26.8% 0.80 / 0.61 / +32.6%
tpch_q20/datafusion:vortex-compact 764631280 / 1217623086 / -37.2% 🟢 1180216096 / 1042947998 / +13.2% 0.65 / 1.17 / -44.5%
tpch_q21/datafusion:vortex-compact 943879922 / 957282932 / -1.4% 1295281549 / 1349761474 / -4.0% 0.73 / 0.71 / +2.7%
tpch_q22/datafusion:vortex-compact 276068897 / 292577965 / -5.6% 584439850 / 692707208 / -15.6% 0.47 / 0.42 / +11.8%
datafusion / parquet / ns (0.889x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 314630018 / 237419294 / +32.5% 🔴 644888724 / 732510947 / -12.0% 0.49 / 0.32 / +50.5%
tpch_q02/datafusion:parquet 435982260 / 488680963 / -10.8% 1156320957 / 957304016 / +20.8% 0.38 / 0.51 / -26.1%
tpch_q03/datafusion:parquet 574073103 / 541114980 / +6.1% 1003760941 / 969739373 / +3.5% 0.57 / 0.56 / +2.5%
tpch_q04/datafusion:parquet 350543563 / 504017482 / -30.5% 🟢 530697142 / 747609135 / -29.0% 0.66 / 0.67 / -2.0%
tpch_q05/datafusion:parquet 575338406 / 703589551 / -18.2% 890871999 / 1164707225 / -23.5% 0.65 / 0.60 / +6.9%
tpch_q06/datafusion:parquet 170244073 / 182108009 / -6.5% 295438333 / 471724906 / -37.4% 🟢 0.58 / 0.39 / +49.3%
tpch_q07/datafusion:parquet 570676272 / 989746177 / -42.3% 🟢 805912588 / 1355875549 / -40.6% 🟢 0.71 / 0.73 / -3.0%
tpch_q08/datafusion:parquet 684907068 / 880331091 / -22.2% 901817662 / 1242990144 / -27.4% 0.76 / 0.71 / +7.2%
tpch_q09/datafusion:parquet 764069910 / 988992017 / -22.7% 1016515078 / 1127233843 / -9.8% 0.75 / 0.88 / -14.3%
tpch_q10/datafusion:parquet 1036839277 / 1109189802 / -6.5% 1285027880 / 1746942501 / -26.4% 0.81 / 0.63 / +27.1%
tpch_q11/datafusion:parquet 374403506 / 451611096 / -17.1% 635574179 / 691011739 / -8.0% 0.59 / 0.65 / -9.9%
tpch_q12/datafusion:parquet 383097605 / 420960224 / -9.0% 556210302 / 591454951 / -6.0% 0.69 / 0.71 / -3.2%
tpch_q13/datafusion:parquet 546853843 / 437945835 / +24.9% 1058998303 / 802292122 / +32.0% 🔴 0.52 / 0.55 / -5.4%
tpch_q14/datafusion:parquet 413082154 / 437678130 / -5.6% 725257160 / 1154441446 / -37.2% 🟢 0.57 / 0.38 / +50.2%
tpch_q15/datafusion:parquet 595160465 / 547236876 / +8.8% 873258864 / 980793119 / -11.0% 0.68 / 0.56 / +22.1%
tpch_q16/datafusion:parquet 245959676 / 225028630 / +9.3% 496341340 / 447146665 / +11.0% 0.50 / 0.50 / -1.5%
tpch_q17/datafusion:parquet 622127950 / 603705050 / +3.1% 782116942 / 932169161 / -16.1% 0.80 / 0.65 / +22.8%
tpch_q18/datafusion:parquet 537623948 / 1105453635 / -51.4% 🟢 844670851 / 1041401208 / -18.9% 0.64 / 1.06 / -40.0%
tpch_q19/datafusion:parquet 471756089 / 455595211 / +3.5% 457079828 / 510099121 / -10.4% 1.03 / 0.89 / +15.6%
tpch_q20/datafusion:parquet 691289155 / 732331248 / -5.6% 922736588 / 859354388 / +7.4% 0.75 / 0.85 / -12.1%
tpch_q21/datafusion:parquet 963157978 / 1352817969 / -28.8% 1056734602 / 1390178205 / -24.0% 0.91 / 0.97 / -6.3%
tpch_q22/datafusion:parquet 431150893 / 454650169 / -5.2% 667522841 / 968852765 / -31.1% 🟢 0.65 / 0.47 / +37.6%
duckdb / vortex-file-compressed / ns (0.822x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 931964538 / 1053021743 / -11.5% 1500751259 / 1532465442 / -2.1% 0.62 / 0.69 / -9.6%
tpch_q02/duckdb:vortex-file-compressed 503466469 / 609386748 / -17.4% 584991479 / 865677602 / -32.4% 🟢 0.86 / 0.70 / +22.3%
tpch_q03/duckdb:vortex-file-compressed 1206117149 / 1437611534 / -16.1% 1552686375 / 1875503356 / -17.2% 0.78 / 0.77 / +1.3%
tpch_q04/duckdb:vortex-file-compressed 1057792271 / 1183677120 / -10.6% 1558874664 / 1489992528 / +4.6% 0.68 / 0.79 / -14.6%
tpch_q05/duckdb:vortex-file-compressed 1256424372 / 1478800874 / -15.0% 1274536143 / 1872061724 / -31.9% 🟢 0.99 / 0.79 / +24.8%
tpch_q06/duckdb:vortex-file-compressed 746313467 / 920582090 / -18.9% 897799065 / 990445029 / -9.4% 0.83 / 0.93 / -10.6%
tpch_q07/duckdb:vortex-file-compressed 1127182240 / 1525150971 / -26.1% 1393775419 / 1701343373 / -18.1% 0.81 / 0.90 / -9.8%
tpch_q08/duckdb:vortex-file-compressed 1287588916 / 1325936843 / -2.9% 1407486670 / 1562255132 / -9.9% 0.91 / 0.85 / +7.8%
tpch_q09/duckdb:vortex-file-compressed 1273754630 / 1558992099 / -18.3% 1545427821 / 1740011321 / -11.2% 0.82 / 0.90 / -8.0%
tpch_q10/duckdb:vortex-file-compressed 1304694094 / 2703214267 / -51.7% 🟢 1594730929 / 2556395113 / -37.6% 🟢 0.82 / 1.06 / -22.6%
tpch_q11/duckdb:vortex-file-compressed 354739577 / 348100292 / +1.9% 443686968 / 509328666 / -12.9% 0.80 / 0.68 / +17.0%
tpch_q12/duckdb:vortex-file-compressed 898821791 / 1056050439 / -14.9% 1097950586 / 1479607336 / -25.8% 0.82 / 0.71 / +14.7%
tpch_q13/duckdb:vortex-file-compressed 1006700021 / 883077547 / +14.0% 1240185439 / 1355009277 / -8.5% 0.81 / 0.65 / +24.6%
tpch_q14/duckdb:vortex-file-compressed 939512002 / 1179257780 / -20.3% 1307990821 / 1144879141 / +14.2% 0.72 / 1.03 / -30.3%
tpch_q15/duckdb:vortex-file-compressed 803877372 / 1076894502 / -25.4% 960694323 / 1077629268 / -10.9% 0.84 / 1.00 / -16.3%
tpch_q16/duckdb:vortex-file-compressed 286066568 / 286533574 / -0.2% 375846985 / 369352315 / +1.8% 0.76 / 0.78 / -1.9%
tpch_q17/duckdb:vortex-file-compressed 1074430566 / 1492837888 / -28.0% 1509376037 / 1900869823 / -20.6% 0.71 / 0.79 / -9.4%
tpch_q18/duckdb:vortex-file-compressed 985991017 / 1523753904 / -35.3% 🟢 1193707695 / 1836528577 / -35.0% 🟢 0.83 / 0.83 / -0.4%
tpch_q19/duckdb:vortex-file-compressed 990607288 / 1230832010 / -19.5% 1181799734 / 1425070188 / -17.1% 0.84 / 0.86 / -3.0%
tpch_q20/duckdb:vortex-file-compressed 977250115 / 1393424961 / -29.9% 1178214937 / 1621752497 / -27.3% 0.83 / 0.86 / -3.5%
tpch_q21/duckdb:vortex-file-compressed 2313697032 / 2679640093 / -13.7% 2505934207 / 2732069420 / -8.3% 0.92 / 0.98 / -5.9%
tpch_q22/duckdb:vortex-file-compressed 581217982 / 611612750 / -5.0% 530697214 / 988335437 / -46.3% 🟢 1.10 / 0.62 / +77.0%
duckdb / vortex-compact / ns (0.876x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 891828065 / 1056880030 / -15.6% 1338057555 / 1687055161 / -20.7% 0.67 / 0.63 / +6.4%
tpch_q02/duckdb:vortex-compact 664830500 / 665277322 / -0.1% 734848198 / 836863261 / -12.2% 0.90 / 0.79 / +13.8%
tpch_q03/duckdb:vortex-compact 1112209006 / 1263021192 / -11.9% 1387042580 / 1903438622 / -27.1% 0.80 / 0.66 / +20.8%
tpch_q04/duckdb:vortex-compact 840830520 / 989291430 / -15.0% 1086922817 / 1323906969 / -17.9% 0.77 / 0.75 / +3.5%
tpch_q05/duckdb:vortex-compact 935826889 / 1824001919 / -48.7% 🟢 1214015736 / 2013801143 / -39.7% 🟢 0.77 / 0.91 / -14.9%
tpch_q06/duckdb:vortex-compact 730027409 / 837086614 / -12.8% 871227585 / 1100537858 / -20.8% 0.84 / 0.76 / +10.2%
tpch_q07/duckdb:vortex-compact 1181162992 / 1489037375 / -20.7% 1340234975 / 1946852771 / -31.2% 🟢 0.88 / 0.76 / +15.2%
tpch_q08/duckdb:vortex-compact 1197548760 / 1227661461 / -2.5% 1385809920 / 1626076877 / -14.8% 0.86 / 0.75 / +14.5%
tpch_q09/duckdb:vortex-compact 1310098446 / 1412908093 / -7.3% 1599802142 / 1772871724 / -9.8% 0.82 / 0.80 / +2.8%
tpch_q10/duckdb:vortex-compact 1424378281 / 1605465748 / -11.3% 1816231322 / 2070514628 / -12.3% 0.78 / 0.78 / +1.1%
tpch_q11/duckdb:vortex-compact 425492977 / 397274098 / +7.1% 502094459 / 597137433 / -15.9% 0.85 / 0.67 / +27.4%
tpch_q12/duckdb:vortex-compact 1015360320 / 1004824811 / +1.0% 1318112575 / 1227324235 / +7.4% 0.77 / 0.82 / -5.9%
tpch_q13/duckdb:vortex-compact 810234025 / 851872385 / -4.9% 1297232494 / 1057003193 / +22.7% 0.62 / 0.81 / -22.5%
tpch_q14/duckdb:vortex-compact 952899980 / 1081960408 / -11.9% 1120284196 / 1249091579 / -10.3% 0.85 / 0.87 / -1.8%
tpch_q15/duckdb:vortex-compact 842828634 / 1132662118 / -25.6% 995829016 / 1070552673 / -7.0% 0.85 / 1.06 / -20.0%
tpch_q16/duckdb:vortex-compact 311063256 / 341251240 / -8.8% 452626040 / 446570341 / +1.4% 0.69 / 0.76 / -10.1%
tpch_q17/duckdb:vortex-compact 1321037917 / 1126111099 / +17.3% 1519544870 / 1239276275 / +22.6% 0.87 / 0.91 / -4.3%
tpch_q18/duckdb:vortex-compact 1167146501 / 1243930828 / -6.2% 1292855642 / 1287251491 / +0.4% 0.90 / 0.97 / -6.6%
tpch_q19/duckdb:vortex-compact 1037088507 / 1210272325 / -14.3% 1281699143 / 1399723390 / -8.4% 0.81 / 0.86 / -6.4%
tpch_q20/duckdb:vortex-compact 1032118594 / 1682757088 / -38.7% 🟢 1319015668 / 1594733665 / -17.3% 0.78 / 1.06 / -25.8%
tpch_q21/duckdb:vortex-compact 2369550859 / 2695290145 / -12.1% 2786418315 / 2597533467 / +7.3% 0.85 / 1.04 / -18.0%
tpch_q22/duckdb:vortex-compact 541274008 / 553364045 / -2.2% 649098706 / 927782023 / -30.0% 🟢 0.83 / 0.60 / +39.8%
duckdb / parquet / ns (0.916x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 453832529 / 427188373 / +6.2% 366046812 / 548186842 / -33.2% 🟢 1.24 / 0.78 / +59.1%
tpch_q02/duckdb:parquet 576752886 / 600619946 / -4.0% 685190352 / 752932777 / -9.0% 0.84 / 0.80 / +5.5%
tpch_q03/duckdb:parquet 604306391 / 673114445 / -10.2% 957660205 / 1076978748 / -11.1% 0.63 / 0.63 / +1.0%
tpch_q04/duckdb:parquet 379450871 / 533343347 / -28.9% 535185458 / 773069338 / -30.8% 🟢 0.71 / 0.69 / +2.8%
tpch_q05/duckdb:parquet 1090998822 / 747516813 / +45.9% 🔴 1027699972 / 1189525722 / -13.6% 1.06 / 0.63 / +68.9%
tpch_q06/duckdb:parquet 241279340 / 302824197 / -20.3% 286819567 / 289773923 / -1.0% 0.84 / 1.05 / -19.5%
tpch_q07/duckdb:parquet 856903967 / 894744032 / -4.2% 923903954 / 889250014 / +3.9% 0.93 / 1.01 / -7.8%
tpch_q08/duckdb:parquet 958398422 / 1022053647 / -6.2% 1079368723 / 1314585750 / -17.9% 0.89 / 0.78 / +14.2%
tpch_q09/duckdb:parquet 979590014 / 1380308812 / -29.0% 1087950266 / 1632593512 / -33.4% 🟢 0.90 / 0.85 / +6.5%
tpch_q10/duckdb:parquet 782674178 / 966549308 / -19.0% 900990606 / 1263504093 / -28.7% 0.87 / 0.76 / +13.6%
tpch_q11/duckdb:parquet 333843237 / 385007369 / -13.3% 438923892 / 477597457 / -8.1% 0.76 / 0.81 / -5.6%
tpch_q12/duckdb:parquet 426099466 / 434243907 / -1.9% 532196928 / 635647597 / -16.3% 0.80 / 0.68 / +17.2%
tpch_q13/duckdb:parquet 560719560 / 628851566 / -10.8% 729794550 / 838697728 / -13.0% 0.77 / 0.75 / +2.5%
tpch_q14/duckdb:parquet 566054800 / 579790758 / -2.4% 605475253 / 573255575 / +5.6% 0.93 / 1.01 / -7.6%
tpch_q15/duckdb:parquet 365335363 / 519010269 / -29.6% 4351872804 / 2627420682 / +65.6% 🔴 0.08 / 0.20 / -57.5%
tpch_q16/duckdb:parquet 323368780 / 400162351 / -19.2% 363852118 / 520937785 / -30.2% 🟢 0.89 / 0.77 / +15.7%
tpch_q17/duckdb:parquet 441925361 / 464887288 / -4.9% 709706313 / 732550193 / -3.1% 0.62 / 0.63 / -1.9%
tpch_q18/duckdb:parquet 538809681 / 554243283 / -2.8% 608299290 / 776944410 / -21.7% 0.89 / 0.71 / +24.2%
tpch_q19/duckdb:parquet 605699483 / 602071205 / +0.6% 647563599 / 927582518 / -30.2% 🟢 0.94 / 0.65 / +44.1%
tpch_q20/duckdb:parquet 855485176 / 814354004 / +5.1% 747766092 / 801136655 / -6.7% 1.14 / 1.02 / +12.5%
tpch_q21/duckdb:parquet 864064466 / 780583076 / +10.7% 770276853 / 1727273645 / -55.4% 🟢 1.12 / 0.45 / +148.2%
tpch_q22/duckdb:parquet 523128895 / 637493863 / -17.9% 604110117 / 614402532 / -1.7% 0.87 / 1.04 / -16.5%

Plans with a fixed number of children built their slots from `vec![..]`,
allocating a vector only to copy it into the inline slots. Build them
from arrays instead, and reuse the vector's buffer when converting a
`Vec<PlanRef>` whose slots spill.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBCykJX86RM9UASFrjC
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 4, 2026 10:17
auto-merge was automatically disabled November 4, 2026 10:18

Head branch was modified

@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 4, 2026 10:23
auto-merge was automatically disabled November 4, 2026 10:24

Head branch was modified

@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 4, 2026 10:29
auto-merge was automatically disabled November 4, 2026 10:30

Head branch was modified

@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 4, 2026 11:20
@joseph-isaacs
joseph-isaacs merged commit 9c3cbbb into develop Nov 4, 2026
@robert3005
robert3005 deleted the ji/loving-bohr-tw0ypy branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants