GitHub user carsonwang opened a pull request:
https://github.com/apache/spark/pull/11813
[SPARK-13889][YARN][Branch-1.6]Fix the calculation of the max number of
executor failure
## What changes were proposed in this pull request?
Backport #11713 to 1.6.
The max number of executor failure before failing the application is
default to twice the maximum number of executors if dynamic allocation is
enabled. The default value for "spark.dynamicAllocation.maxExecutors" is
Int.MaxValue. The calculated value of the default max number of executor
failure should be Int.MaxValue instead of only 3.
## How was this patch tested?
It tests if the value is greater that Int.MaxValue / 2 to avoid the
overflow when it multiplies 2.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/carsonwang/spark branch-1.6-ExecutorFailNum
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11813.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11813
----
commit 17d8bc1f13c3b29e22ecbec6a9f08491e5970368
Author: Carson Wang <carson.w...@intel.com>
Date: 2016-03-18T05:15:40Z
Fix the calculation of the max number of executor failure
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
