GitHub user maryannxue opened a pull request:
https://github.com/apache/spark/pull/20816
SPARK-21479 Outer join filter pushdown in null supplying table when
condition is on one of the joined columns
## What changes were proposed in this pull request?
Added `TransitPredicateInOuterJoin` optimization rule that transits
constraints from the preserved side of an outer join to the null-supplying
side. The constraints of the join operator will remain unchanged.
## How was this patch tested?
Added 3 tests in `InferFiltersFromConstraintsSuite`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/maryannxue/spark spark-21479
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20816.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20816
----
commit ac17976fd2b024039ee6cd848b864d2d052ec573
Author: maryannxue <maryann.xue@...>
Date: 2018-03-13T21:05:37Z
SPARK-21479 Outer join filter pushdown in null supplying table when
condition is on one of the joined columns
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
