GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/10451
[SPARK-12503] [SQL] Pushing Limit Through Union
"Rule that applies to a Limit on top of a Union. The original Limit won't
go away after applying this rule, but additional Limit nodes will be created on
top of each child of Union, so that these children produce less rows and Limit
can be further optimized for children Relations."
â from https://issues.apache.org/jira/browse/CALCITE-832
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark unionLimit
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10451.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10451
----
commit 56fd78267618a3b3aab73ca01d682f4fb25a638c
Author: gatorsmile <[email protected]>
Date: 2015-12-23T18:08:03Z
union limit pushdown.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
