qiuliang created SPARK-39073:
--------------------------------
Summary: keep rowCount after hive table partition pruning if only
have hive statistics
Key: SPARK-39073
URL: https://issues.apache.org/jira/browse/SPARK-39073
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.2.1
Reporter: qiuliang
If the partitioned table only has hive generated statistics, and the statistics
are stored in partition properties. HiveTableRelation cannot obtain rowCount
because the table statistics do not exist. We can generate rowCount based on
the statistics of these pruned partitions
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
