mapleFU commented on issue #8751: URL: https://github.com/apache/arrow-rs/issues/8751#issuecomment-3473598210
I've using a hacking way to solve this problem based on the current code: 1. `ParquetMetadataReader` call `PageIndexPolicy::Skip` 2. Construct a `ParquetMetadata` and do filtering with all row-groups, which filter out the row-groups I required 3. With the selected row-groups, I reconstruct a `ParquetMetadataReader` and read only "selected row-groups" and "selected columns". 4. Decoding them. Offset-index of every column we required would be decoded, Column Index only need decode the "filter columns" The way above still decode the row-group metadata, but it would be far more less than page indexes' metadata. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
