lidavidm commented on issue #7983: URL: https://github.com/apache/arrow-rs/issues/7983#issuecomment-3164236412
The parquet-cpp "row group coalescing" optimizations may be helpful as some prior art. This is the original thread which has a Google doc outlining the kinds of optimizations we were trying to enable (only coalescing actually made it in to parquet-cpp): https://lists.apache.org/thread/cdfkm8oflm2zvd25yn4k6gh2o7pc9z88 They had to be hacked into the C++ reader rather roughly. I've always wanted a push-based decoder like the one you have here; the ranges API looks perfect. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
