amogh-jahagirdar opened a new pull request, #14362: URL: https://github.com/apache/iceberg/pull/14362
Currently Conversions to/fromByteBuffer will fail when trying to handle variant type. This issue primarily manifests in fromByteBuffer when querying metadata tables like the files table and there are stats on shredded fields; specifically, the failure surfaces when trying to [project the lower bounds/upper bounds in the results ](https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/MetricsUtil.java#L190) . This PR contains the following changes: 1. Support toByteBuffer, which will interpret the object as a Variant and produce a concatenated ByteBuffer of metadata and variant. This isn't quite exercised since we have a package private util in Parquet which is actually doing this for stats on shredded fields, but I do feel like it's reasonable to have this behavior in Conversions as well. 2. Support from byte buffer which will interpret the byte buffer into the in-memory Variant structure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
