[ 
https://issues.apache.org/jira/browse/SPARK-17603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Li updated SPARK-17603:
----------------------------
    Issue Type: Improvement  (was: Bug)

> Utilize Hive-generated Statistics For Partitioned Tables
> --------------------------------------------------------
>
>                 Key: SPARK-17603
>                 URL: https://issues.apache.org/jira/browse/SPARK-17603
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.0.0, 2.1.0
>            Reporter: Xiao Li
>
> For non-partitioned tables, Hive-generated statistics are stored in table 
> properties. However, for partitioned tables, Hive-generated statistics are 
> stored in partition properties. Thus, we are unable to utilize the 
> Hive-generated statistics for partitioned tables. 
> The statistics might not be gathered for all the partitions in Hive. For 
> partial collection, we will not utilize the Hive-generated statistics.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to