GitHub user yhuai opened a pull request:
https://github.com/apache/spark/pull/8252
[SPARK-7289] [SPARK-9949] [SQL] Backport SPARK-7289 and SPARK-9949 to
branch 1.4
The bug fixed by SPARK-7289 is a pretty serious one (Spark SQL generates
wrong results). We should backport the fix to branch 1.4
(https://github.com/apache/spark/pull/6780). Also, we need to backport the fix
of `TakeOrderedAndProject` as well (https://github.com/apache/spark/pull/8179).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yhuai/spark backport7289And9949
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8252.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8252
----
commit c5070b12557cd20a006a3f1c8b6b11b7887a0ba1
Author: Wenchen Fan <[email protected]>
Date: 2015-06-24T20:28:50Z
[SPARK-7289] handle project -> limit -> sort efficiently
make the `TakeOrdered` strategy and operator more general, such that it can
optionally handle a projection when necessary
Author: Wenchen Fan <[email protected]>
Closes #6780 from cloud-fan/limit and squashes the following commits:
34aa07b [Wenchen Fan] revert
07d5456 [Wenchen Fan] clean closure
20821ec [Wenchen Fan] fix
3676a82 [Wenchen Fan] address comments
b558549 [Wenchen Fan] address comments
214842b [Wenchen Fan] fix style
2d8be83 [Wenchen Fan] add LimitPushDown
948f740 [Wenchen Fan] fix existing
Conflicts:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala
sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala
commit 5925ad4bc33f07fb5033b183cd10a410d27fd0db
Author: Yin Huai <[email protected]>
Date: 2015-08-15T00:35:17Z
[SPARK-9949] [SQL] Fix TakeOrderedAndProject's output.
https://issues.apache.org/jira/browse/SPARK-9949
Author: Yin Huai <[email protected]>
Closes #8179 from yhuai/SPARK-9949.
(cherry picked from commit 932b24fd144232fb08184f0bd0a46369ecba164e)
Signed-off-by: Reynold Xin <[email protected]>
Conflicts:
sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
