GitHub user KaiXinXiaoLei opened a pull request:
https://github.com/apache/spark/pull/7716
[SPARK-9375] Make sure the total number of executor(s) requested by the
driver is not negative
In the code:
if (!replace) {
doRequestTotalExecutors(numExistingExecutors + numPendingExecutors
- executorsPendingToRemove.size - knownExecutors.size)
}
The value of â(numExistingExecutors + numPendingExecutors -
executorsPendingToRemove.size - knownExecutors.size)â maybe negative if there
is the same executorId in knownExecutors and executorsPendingToRemove. And
knownExecutors and executorsPendingToRemove should not have the same executorId.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/KaiXinXiaoLei/spark negativeExecutor1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7716.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7716
----
commit a6fb8aa433d6506df2f5a3250da32f321c07d587
Author: KaiXinXiaoLei <[email protected]>
Date: 2015-07-28T03:55:34Z
change file
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
