matanper opened a new pull request, #1152: URL: https://github.com/apache/iceberg-go/pull/1152
- Adds ReassembleShreddedVariant — a named entry point that reconstructs a variant.Value from one row of a shredded Parquet variant column, delegating the spec walk to arrow-go's *extensions.VariantArray. - Adds WrapShreddedVariantReader, a RecordReader wrapper that transparently replaces shredded variant columns with their non-shredded equivalents on every batch, so the scanner always sees a uniform struct<metadata, value> layout regardless of how the Parquet file was written. - Wires WrapShreddedVariantReader into parquet_files.go's GetRecords path. - Vendors six Java-produced fixture files from apache/parquet-testing (pinned to a specific commit) and adds two tests — one exercising the pure per-row function, one exercising the full scan path — covering primitive shredding, flat objects, nested shredded objects, and partially-shredded objects (typed_value + residual merge). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
