Ted-Jiang commented on issue #1955: URL: https://github.com/apache/arrow-rs/issues/1955#issuecomment-1168447364
> Why not just call get_read for each page instead of for the entire column chunk? There is no requirement for get_read to delimit column chunks, after all the same trait is used to read the footer, etc... make sense. > how this will all work with ParquetRecordBatchStream 😂 For now i only check page filter in `ParquetRecordBatchReader`, For `AsyncFileReader` i haven't check the code (because i found datafusion now use iterator mode). Is there any need to support in `ParquetRecordBatchReader`, or They reuse a lot of logic between them (support one is like almost support both). @tustvold How expert thinks 😊 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
