Skip to content

build(deps): vortex-jni 0.91.0, with Rust 0.91's FSST training and file statistics - #715

Merged
dfa1 merged 1 commit into
mainfrom
dependabot/maven/dev.vortex-vortex-jni-0.91.0
Nov 8, 2026
Merged

dfa1 merged 1 commit into
mainfrom
dependabot/maven/dev.vortex-vortex-jni-0.91.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

Bumps dev.vortex:vortex-jni from 0.90.0 to 0.91.0, plus the three Rust 0.91 changes the interop tests caught:

  • FSST: fsst-rs 0.7 orders tied candidates by the symbol's bytes (Deterministic symbol table on both x86 and arm64 spiraldb/fsst#269). Java now trains Rust's table byte for byte; the parity test asserts equality.
  • File statistics: Rust 0.91's default aggregates drop the sum and add uncompressed_size_in_bytes; UTF-8/binary bounds are always inexact; an all-null batch keeps the max; a column without rows gets a zero null count and size. New cross-checks for list sizes and a file without batches.
  • Error messages: vortex-jni rewords two errors the tests match on.

Also: Rust 0.91 rejects decimals past their precision on Arrow import (vortex-data/vortex#10897), so docs/compatibility.md now marks the writer's check as parity.

Local: CI=true ./mvnw clean verify green, 3435 integration tests.

🤖 Generated with Claude Code

https://claude.ai/code/session_011fRbYsrGtpKHp9APhU8qDV

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file java Pull requests that update java code labels Nov 8, 2026
…le statistics

Bump dev.vortex:vortex-jni from 0.90.0 to 0.91.0 (Dependabot #715) and follow
the three Rust changes it brings that the interop tests caught:

- FSST: fsst-rs 0.7 breaks ties between candidates of equal gain and length by
  the symbol's bytes (spiraldb/fsst#269), so training no longer depends on the
  hash map. Java takes the candidates in that total order with a sort, and its
  symbol table and code stream are now Rust's byte for byte; the parity test
  asserts equality instead of a 1.5% band.
- File statistics: Rust 0.91's FileStatsAccumulator moves to aggregate
  functions. The default set drops the sum and adds uncompressed_size_in_bytes
  (new UncompressedSize, which Repartitioner now shares its validity rule
  with); a UTF-8/binary BoundedMin/BoundedMax is always inexact, and an
  all-null batch no longer drops the max; a column without rows gets a zero
  null count and size. New cross-checks for list, list-of-string and
  fixed-size-list sizes and for a file without batches.
- vortex-jni's error messages for duplicate struct fields and mismatched
  comparison dtypes changed wording.

Rust 0.91 also rejects decimal values beyond their precision on Arrow import
(vortex-data/vortex#10897), so the writer's check is now parity, not a
deliberate divergence.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011fRbYsrGtpKHp9APhU8qDV
@dfa1
dfa1 force-pushed the dependabot/maven/dev.vortex-vortex-jni-0.91.0 branch from 14a9540 to 4740c4f Compare November 8, 2026 17:25
@dfa1 dfa1 changed the title build(deps): Bump dev.vortex:vortex-jni from 0.90.0 to 0.91.0 build(deps): vortex-jni 0.91.0, with Rust 0.91's FSST training and file statistics Nov 8, 2026
@dfa1
dfa1 merged commit a368b9d into main Nov 8, 2026
6 checks passed
@dfa1
dfa1 deleted the dependabot/maven/dev.vortex-vortex-jni-0.91.0 branch November 8, 2026 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file java Pull requests that update java code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant