etseidl commented on issue #9296: URL: https://github.com/apache/arrow-rs/issues/9296#issuecomment-4119978676
There's also #8818 to consider. My issue with doing the conversion here rather than using `StatisticsConverter` is that we then have an arrow dependency in the parquet metadata. I like @alamb's suggestion...skip parsing the page indexes via `ParquetMetaDataPushDecoder` and add functionality to the arrow reader to parse the column index straight to arrow arrays. This preserves the current form of the indexes for those not using the arrow reader at all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
