Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/19050#discussion_r137159884
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/subquery.scala
---
@@ -98,6 +122,7 @@ object RewritePredicateSubquery extends
Rule[LogicalPlan] with PredicateHelper {
val (newCond, inputPlan) =
rewriteExistentialExpr(Seq(predicate), p)
Project(p.output, Filter(newCond.get, inputPlan))
}
+ dedupJoin(rewritten)
--- End diff --
Fair point. Will follow it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
