RatulDawar commented on PR #22857: URL: https://github.com/apache/datafusion/pull/22857#issuecomment-4683901803
@kosiew can you please take a look at it again. Got stuck with the case where If the session cache already has footer-only metadata (e.g. from an opener Skip load) and a later fetch_metadata call wants page index (Optional), we incrementally load the index bytes and update the cache. This does not run on the normal scan path — the opener still loads page index via AsyncFileReader when row-group stats don’t fully match. Please take a look if incremental page read + cache is the correct thing to do here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
