Ma Jian created HUDI-7310:
-----------------------------

             Summary: Optimize Column Stats Partition Pruning for Non-Partition 
Pruning Queries
                 Key: HUDI-7310
                 URL: https://issues.apache.org/jira/browse/HUDI-7310
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Ma Jian


In HUDI-7291, I applied the partition pruning conditions to the column stats 
earlier, reducing the amount of data during the data skipping process. However, 
for non-partitioned tables, or partitioned tables where the query does not 
involve partition conditions, this optimization introduces additional 
unnecessary serialization overhead. Therefore, a check has been added here to 
avoid filtering in such cases.
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to