Xiao Li created SPARK-17603:

             Summary: Utilize Hive-generated Statistics For Partitioned Tables
                 Key: SPARK-17603
                 URL: https://issues.apache.org/jira/browse/SPARK-17603
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.0, 2.1.0
            Reporter: Xiao Li

For non-partitioned tables, Hive-generated statistics are stored in table 
properties. However, for partitioned tables, Hive-generated statistics are 
stored in partition properties. Thus, we are unable to utilize the 
Hive-generated statistics for partitioned tables. 

The statistics might not be gathered for all the partitions in Hive. For 
partial collection, we will not utilize the Hive-generated statistics.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to