GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/10454
[SPARK-12505] [SQL] Pushdown a Limit on top of an Outer-Join
"Rule that applies to a Limit on top of an OUTER Join. The original Limit
won't go away after applying this rule, but additional Limit node(s) will be
created on top of the outer-side child (or children if it's a FULL OUTER Join).
"
â from https://issues.apache.org/jira/browse/CALCITE-832
Also, the same topic in Hive:
https://issues.apache.org/jira/browse/HIVE-11684
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark outerjoinLimit
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10454.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10454
----
commit 8df3e0dfe99a8428b0569ba9d50afbda1c3d1591
Author: gatorsmile <[email protected]>
Date: 2015-12-23T19:48:07Z
outerjoin limit pushdown.
commit 3779874f4e2add9f27b4bf64bd6f82668d7475ce
Author: gatorsmile <[email protected]>
Date: 2015-12-23T19:52:47Z
revert.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
