Github user wzhfy commented on a diff in the pull request:
https://github.com/apache/spark/pull/19932#discussion_r155936167
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala ---
@@ -353,15 +374,6 @@ class StatisticsSuite extends
StatisticsCollectionTestBase with TestHiveSingleto
createPartition("2010-01-02", 11,
"SELECT '1', 'A' from src UNION ALL SELECT '1', 'A' from src")
- sql(s"ANALYZE TABLE $tableName PARTITION (ds='2010-01-01') COMPUTE
STATISTICS NOSCAN")
-
- assertPartitionStats("2010-01-01", "10", rowCount = None,
sizeInBytes = 2000)
- assertPartitionStats("2010-01-01", "11", rowCount = None,
sizeInBytes = 2000)
- assert(queryStats("2010-01-02", "10") === None)
- assert(queryStats("2010-01-02", "11") === None)
--- End diff --
After the change, these checks are not right as we read hive stats. So I
remove them.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]