You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
SparseEncodingDecoder drops nullability — null fill coerced to 0, nullable patch values stripped #226
Found by Raincloud triage round 4 (#205) on world-energy-consumption (16 f64? columns). Same silent-corruption class as #210. Two distinct facets in SparseEncodingDecoder:
(b1) Null fill scalar coerced to 0.biofuel_cons_change_pct: vortex.sparse(f64?, fill_value: null) — the 21,307 unpatched positions are null in Rust, 0.0 in Java.
longfillBits = scalarToLong(fillScalar); // returns 0L for a null scalar
...
caseF64 -> newLazySparseDoubleArray(..., Double.longBitsToDouble(fillBits) /* 0.0 */, ...);
scalarToLong falls through to return 0L for null; LazySparse*Array has no null-fill concept, so a null-fill sparse array decodes as non-nullable fill=0.0.
16,998 patched-but-null positions decode to raw 0 → Java emits 0.0; Rust reads null.
Fix direction: LazySparse*Array must model (a) a null fill value (whole unpatched region null) and (b) per-patch validity from a nullable patch_values child — build the combined row validity and wrap in MaskedArray, mirroring #210.
Activity
fix: propagate validity in Sparse utf8/binary (VarBin) columns (#232)
test: gate-running interop test for null-fill Sparse and null-run Run…
fix(reader): resolve sparse Utf8/Binary rows lazily, and stop droppin…