Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22250#discussion_r213557635
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1190,11 +1191,13 @@ object PushPredicateThroughJoin extends
Rule[LogicalPlan] with PredicateHelper {
// push down the join filter into sub query scanning if applicable
case j @ Join(left, right, joinType, joinCondition) =>
- val (leftJoinConditions, rightJoinConditions, commonJoinCondition) =
-
split(joinCondition.map(splitConjunctivePredicates).getOrElse(Nil), left, right)
+ val condition =
joinCondition.map(splitConjunctivePredicates).getOrElse(Nil)
+ val additionalCondition = inferAdditionalConstraints(condition.toSet)
--- End diff --
IIRC we can only do this in `InferFiltersFromConstraints`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
