GitHub user uncleGen opened a pull request:
https://github.com/apache/spark/pull/1696
Spark Shuffleï¼use growth rate to predict if need to spill
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uncleGen/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1696.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1696
----
commit 0afb53d61e3e6d57b8cfee5b91e8b29587775edb
Author: uncleGen <[email protected]>
Date: 2014-07-31T17:17:34Z
Use growth rate to predict if need to spill
commit e458a301d439da7656bcdf1b81e22efc145a33e6
Author: uncleGen <[email protected]>
Date: 2014-07-31T17:20:28Z
set "spark.executor.cores" for the executor
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
