GitHub user SleepyThread opened a pull request:
https://github.com/apache/spark/pull/8672
[SPARK-10514] [Mesos] waiting for min no of total cores acquired by Spark
by implementing the sufficientResourcesRegistered method
spark.scheduler.minRegisteredResourcesRatio configuration parameter works
for YARN mode but not for Mesos Coarse grained mode.
If the parameter specified default value of 0 will be set for
spark.scheduler.minRegisteredResourcesRatio in base class and this method will
always return true.
There are no existing test for YARN mode too. Hence not added test for the
same.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/SleepyThread/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8672.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8672
----
commit ced70f7b303dfef4cb62a9f2ac331e72bace6bb8
Author: Akash Mishra <[email protected]>
Date: 2015-09-09T12:54:06Z
[SPARK-10514] [Mesos] waiting for min no of total cores acquired by Spark
by implementing the sufficientResourcesRegistered method
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
