Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/20999#discussion_r223414695
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
---
@@ -1015,6 +1036,23 @@ class AstBuilder(conf: SQLConf) extends
SqlBaseBaseVisitor[AnyRef] with Logging
val left = expression(ctx.left)
val right = expression(ctx.right)
val operator =
ctx.comparisonOperator().getChild(0).asInstanceOf[TerminalNode]
+ buildComparison(left, right, operator)
+ }
+
+ /**
+ * Creates a comparison expression. The following comparison operators
are supported:
+ * - Equal: '=' or '=='
+ * - Null-safe Equal: '<=>'
--- End diff --
Seems we can't support null-safe equality because it is not supported by
Hive metastore partition predicate pushdown. See HiveShim.scala.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
