GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/7668
[SPARK-9352][SPARK-9353] Add tests for standalone scheduling code
This also fixes a small issue in the standalone Master that was uncovered
by the new tests. For more detail, read the description of SPARK-9353.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark standalone-scheduling-tests
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7668.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7668
----
commit d852faf102a96c1683e3be0271140bcf7dc8e0db
Author: Andrew Or <[email protected]>
Date: 2015-07-26T05:58:09Z
Add tests + fix scheduling with memory limits
Previously, if cores per executor is not set, because we assign
1 core at a time we end up requiring the worker to have enough
memory for N executors, where N is the number of cores assigned.
This is incorrect because in this mode we should have at most
1 executor per worker.
This is fixed in this commit with a regression test.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
