GitHub user hellertime opened a pull request:
https://github.com/apache/spark/pull/12933
[Spark-15155][Mesos] Selectively accept Mesos resources by role
Add new property `spark.mesos.acceptedResourceRoles`. When set, Spark will
only accept resources with roles that match. When unset, Spark operates as is,
accepting resources from `*` and `spark.mesos.role` if set.
## How was this patch tested?
Additional unit tests added to `MesosSchedulerBackendSuite`, extending the
original multi-role test suite.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hellertime/spark SPARK-15155
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12933.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12933
----
commit ec4a09667354ee5582bde35098499a9e26776a89
Author: Chris Heller <[email protected]>
Date: 2016-05-04T11:58:55Z
Limit resources to accepted roles
commit 83bc40d9b21022470e5f4b0473bc033f79aabfb1
Author: Chris Heller <[email protected]>
Date: 2016-05-04T12:53:12Z
Move defaultAcceptedRoles logic into Util
commit 66f7822fe7e5a9ad8eeef49d92e436548f46e2a6
Author: Chris Heller <[email protected]>
Date: 2016-05-05T11:45:13Z
Pre-filter resources
commit 4d2941ebab68b6380a52cd454ccd49bd4077f81b
Author: Chris Heller <[email protected]>
Date: 2016-05-05T11:52:07Z
Convert to scala list to use filter
commit fda6c713cdb66efd1fa1166168dfcc5620230ec4
Author: Chris Heller <[email protected]>
Date: 2016-05-05T12:59:36Z
Rework utility function
commit 86516c66777d5dbde377ef37d0d30e207de0fa21
Author: Chris Heller <[email protected]>
Date: 2016-05-05T13:00:14Z
Update docs
commit 77c0685b7a30f2a4d5f87794b30a683676571919
Author: Chris Heller <[email protected]>
Date: 2016-05-05T13:26:21Z
Remove double restrict
commit 48b472329036e62ef00973f912d54db7fc5d7872
Author: Chris Heller <[email protected]>
Date: 2016-05-05T13:26:30Z
Add testsuite
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
