Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19547#discussion_r146110223
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
@@ -585,6 +585,35 @@ private[client] class Shim_v0_13 extends Shim_v0_12 {
* Unsupported predicates are skipped.
*/
def convertFilters(table: Table, filters: Seq[Expression]): String = {
+ if (SQLConf.get.advancedPartitionPredicatePushdownEnabled) {
+ convertComplexFilters(table, filters)
+ } else {
+ convertBasicFilters(table, filters)
+ }
--- End diff --
Thanks! We can do it when enhancing `convertComplexFilters `. Here, it is
just to keep the original codes (from Spark 2.2) untouched.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
