friendlymatthew opened a new pull request, #20913: URL: https://github.com/apache/datafusion/pull/20913
Note: please review from the second commit. This PR is currently based off of #20854 ## Rationale for this change This PR extracts a reusable `build_parquet_read_plan` function and `ParquetReadPlan` struct from the row filter's `FilterCandidateBuilder::build` Today, struct-aware leaf projection only exists in the row filter path. The opener still uses `ProjectionMask::roots` which reads _all_ leaves of a struct even when only one field is needed. By pulling this logic into a shared abstraction, the opener can reduce unnecessary I/O for struct-heavy schemas -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
