RatulDawar commented on PR #22857: URL: https://github.com/apache/datafusion/pull/22857#issuecomment-4662655594
A related question came up while implementing this, can we skip page index I/O per row group (e.g. load index only for RGs that aren't fully matched)? I checked arrow-rs (parquet 58.3.0 + latest main), but per RG page index apis doesn't seem to be avalible. We can take that implementation as a next setp to this(not sure though per page index skip would be that much beneficial or not). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
