GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/1064
[SPARK-2124] Move aggregation into shuffle implementations
This PR is a sub-task of SPARK-2044 to move the execution of aggregation
into shuffle implementations.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark SPARK-2124
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1064.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1064
----
commit d97a0d88d8d1cb43e397d2b7b9db39080466f246
Author: jerryshao <[email protected]>
Date: 2014-06-09T08:50:16Z
initial works of move combiner to ShuffleManager's reader and writer
commit 4e6cecbc906d085ce03b29ce066e498fffde3eca
Author: jerryshao <[email protected]>
Date: 2014-06-10T05:36:58Z
Code modification related to the ShuffledRDD
commit 05ca59273fa582a6103ed0cab74f3655bd3fe0f6
Author: jerryshao <[email protected]>
Date: 2014-06-10T08:22:29Z
Fix test suite issue after moving aggregator to Shuffle reader and writer
commit e73e122105d7599b6d7da5808dc30a58adc225a0
Author: jerryshao <[email protected]>
Date: 2014-06-10T08:31:57Z
Style changes
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
