Repository navigation
build(deps): vortex-jni 0.91.0, with Rust 0.91's FSST training and file statistics - #715
Merged
Merged
Conversation
…le statistics Bump dev.vortex:vortex-jni from 0.90.0 to 0.91.0 (Dependabot #715) and follow the three Rust changes it brings that the interop tests caught: - FSST: fsst-rs 0.7 breaks ties between candidates of equal gain and length by the symbol's bytes (spiraldb/fsst#269), so training no longer depends on the hash map. Java takes the candidates in that total order with a sort, and its symbol table and code stream are now Rust's byte for byte; the parity test asserts equality instead of a 1.5% band. - File statistics: Rust 0.91's FileStatsAccumulator moves to aggregate functions. The default set drops the sum and adds uncompressed_size_in_bytes (new UncompressedSize, which Repartitioner now shares its validity rule with); a UTF-8/binary BoundedMin/BoundedMax is always inexact, and an all-null batch no longer drops the max; a column without rows gets a zero null count and size. New cross-checks for list, list-of-string and fixed-size-list sizes and for a file without batches. - vortex-jni's error messages for duplicate struct fields and mismatched comparison dtypes changed wording. Rust 0.91 also rejects decimal values beyond their precision on Arrow import (vortex-data/vortex#10897), so the writer's check is now parity, not a deliberate divergence. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_011fRbYsrGtpKHp9APhU8qDV
dfa1
force-pushed
the
dependabot/maven/dev.vortex-vortex-jni-0.91.0
branch
from
November 8, 2026 17:25
14a9540 to
4740c4f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bumps
dev.vortex:vortex-jnifrom 0.90.0 to 0.91.0, plus the three Rust 0.91 changes the interop tests caught:uncompressed_size_in_bytes; UTF-8/binary bounds are always inexact; an all-null batch keeps the max; a column without rows gets a zero null count and size. New cross-checks for list sizes and a file without batches.Also: Rust 0.91 rejects decimals past their precision on Arrow import (vortex-data/vortex#10897), so
docs/compatibility.mdnow marks the writer's check as parity.Local:
CI=true ./mvnw clean verifygreen, 3435 integration tests.🤖 Generated with Claude Code
https://claude.ai/code/session_011fRbYsrGtpKHp9APhU8qDV