wangyum opened a new pull request #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584 ### What changes were proposed in this pull request? This PR makes `spark.sql.statistics.fallBackToHdfs` not support Hive partitioned tables. ### Why are the changes needed? The current implementation is incorrect for external partitions and it is expensive to support partitioned table with external partitions. ### Does this PR introduce any user-facing change? Yes. But I think it will not change the join strategy because partitioned table usually very large. ### How was this patch tested? unit test
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
