parthchandra opened a new pull request, #2680:
URL: https://github.com/apache/datafusion-comet/pull/2680

   ## Which issue does this PR close?
   
   Part of the changes needed for 
https://github.com/apache/datafusion-comet/issues/2060 
   Mostly does cleanup of the `native_iceberg_compat` APIs so the they do not 
have Parquet classes. As a plus provides a utility class to allow 
ParquetMetadata to be serialized and deserialized to/from the Thrift format. 
This will also be useful in passing ParquetMetadata from JVM to native (for all 
native scan implementations). Currently the native scans end up reading Parquet 
metadata again (even though it has already been read in the JVM side) and this 
can be a costly operation in object stores. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to