[
https://issues.apache.org/jira/browse/SPARK-31877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karuppayya resolved SPARK-31877.
--------------------------------
Resolution: Not A Problem
> Stats computed for HiveTable not used
> -------------------------------------
>
> Key: SPARK-31877
> URL: https://issues.apache.org/jira/browse/SPARK-31877
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Karuppayya
> Priority: Major
>
> When fixing SPAK-31850, I made the following observation
> As part of DetermineTableStats rule, we compute the stats for a
> HiveTableRelation.
> In most case(the flag for converting Parquet and Orc table is enabled by
> default), RelationConversion rule converts the HiveTableRelation to
> LogicalRelation.
> The stats computed as part of Hive Table relation does not get used.
> The stats compute should be avoided if the Hive Tbale is going to be
> converted to data source table
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
