Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21004#discussion_r180745018
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala
---
@@ -81,7 +81,7 @@ class PartitionProviderCompatibilitySuite
HiveCatalogMetrics.reset()
assert(spark.sql("select * from test where partCol < 2").count()
== 2)
assert(HiveCatalogMetrics.METRIC_PARTITIONS_FETCHED.getCount()
== 2)
- assert(HiveCatalogMetrics.METRIC_FILES_DISCOVERED.getCount() ==
2)
+ assert(HiveCatalogMetrics.METRIC_FILES_DISCOVERED.getCount() ==
7)
--- End diff --
all the files should be parsed once for creating file index. So it is `5 +
2`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
