zhuqi-lucas commented on PR #18112: URL: https://github.com/apache/datafusion/pull/18112#issuecomment-3419760426
This PR is still needed, because currently we split two part of page index, and the second one will not use reminder, so even we setting prefetch_hint now, we can't reduce the page index request without this PR. https://github.com/apache/datafusion/blob/f199b000861360aca01d4f1b9104bf73e9d831cc/datafusion/datasource-parquet/src/opener.rs#L705 ```rust /// Asynchronously fetch the page index structures when a [`ParquetMetaData`] has already /// been obtained. See [`Self::new_with_metadata()`]. #[cfg(all(feature = "async", feature = "arrow"))] pub async fn load_page_index<F: MetadataFetch>(&mut self, fetch: F) -> Result<()> { self.load_page_index_with_remainder(fetch, None).await } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
