You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Importers return the WriteSummary of the file they write #728
Follow-up to #664. VortexWriter.finish() returns a WriteSummary (file size, row count, per-column compressed size and statistics), but every importer drops it and returns void:
So a caller that wants the size or statistics of what it just imported has to open the file again. The CLI's vortex import and scripts/RaincloudCompare.java both reopen files for exactly this.
Proposal: each importer returns the WriteSummary from finish(). Going from void to a return value is source-compatible for callers. A URI import that reads the source remotely still writes a local file, so it returns the summary the same way.
vortex import can print each column's compressed size.
Test: a vortex-jni cross-check that a Parquet import's returned summary matches what vortex-jni reads back from the file (fileSize, row count, per-column statistics), plus unit tests per importer.
Activity