GitHub user tnachen opened a pull request:
https://github.com/apache/spark/pull/3861
Integrate external shuffle service to coarse grained Mesos mode
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tnachen/spark mesos_shuffle
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3861.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3861
----
commit 60df548387412ae12e6bd8439d48931aa564a22b
Author: Timothy Chen <[email protected]>
Date: 2014-12-05T05:55:42Z
Launch External Shuffle Service with mesos
commit 145bf5b9578d8087fb926e8fd73a8b04c34d07aa
Author: Timothy Chen <[email protected]>
Date: 2014-12-13T20:17:47Z
Support total and kill executors in coarse grained mesos mode.
commit 03ee4f79c86c846c923ec83e17dd5ea7805091f6
Author: Timothy Chen <[email protected]>
Date: 2014-12-17T01:36:56Z
Propogate the shuffle service setting.
commit 7434bb22858899a8808edee16c11c7bd68263828
Author: Timothy Chen <[email protected]>
Date: 2014-12-20T01:27:42Z
Implement a new executor for coarse grained mesos mode.
commit 25331b1216889a9abfb40e583b56657ba45f840e
Author: Timothy Chen <[email protected]>
Date: 2014-12-24T05:28:09Z
Launch executor with shell and add traces
commit 1aca094a1a20e961c76f65c98139ead4de8e4eab
Author: Timothy Chen <[email protected]>
Date: 2014-12-30T08:12:42Z
Fix destroying executor.
commit 5c9fd75b2ae48f8a2c8c0b6cf8ebd7ab58e84b18
Author: Timothy Chen <[email protected]>
Date: 2014-12-31T20:10:19Z
Only process status update if task is still tracked.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
