majian1998 opened a new pull request, #10528: URL: https://github.com/apache/hudi/pull/10528
In HUDI-7291, I applied the partition pruning conditions to the column stats earlier, reducing the amount of data during the data skipping process. However, for non-partitioned tables, or partitioned tables where the query does not involve partition conditions, this optimization introduces additional unnecessary serialization overhead. Therefore, a check has been added here to avoid filtering in such cases. ### Change Logs None ### Impact None ### Risk level (write none, low medium or high below) None ### Documentation Update None ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
