GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/16381
[SPARK-18973][SQL] Remove SortPartitions and RedistributeData
## What changes were proposed in this pull request?
SortPartitions and RedistributeData logical operators are not actually used
and can be removed. Note that we do have a Sort operator (with global flag
false) that subsumed SortPartitions.
## How was this patch tested?
Also updated test cases to reflect the removal.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rxin/spark SPARK-18973
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16381.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16381
----
commit 9b4440d4a413dd245e04714b83bbca14b07e6c18
Author: Reynold Xin <[email protected]>
Date: 2016-12-22T04:20:47Z
[SPARK-18973][SQL] Remove SortPartitions and RedistributeData
commit b734cfa7124ca1185c3ef4476d5a07e564c0c7be
Author: Reynold Xin <[email protected]>
Date: 2016-12-22T04:22:04Z
Remove
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
