Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/19050#discussion_r137159896
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/subquery.scala
---
@@ -49,6 +49,30 @@ object RewritePredicateSubquery extends
Rule[LogicalPlan] with PredicateHelper {
}
}
+ def dedupJoin(plan: LogicalPlan): LogicalPlan = {
+ plan transform {
+ case j @ Join(left, right, joinType, joinCond) =>
--- End diff --
Sure.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
