[
https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201032#comment-15201032
]
Apache Spark commented on SPARK-13889:
--------------------------------------
User 'carsonwang' has created a pull request for this issue:
https://github.com/apache/spark/pull/11813
> Integer overflow when calculating the max number of executor failure
> --------------------------------------------------------------------
>
> Key: SPARK-13889
> URL: https://issues.apache.org/jira/browse/SPARK-13889
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0, 1.6.1
> Reporter: Carson Wang
> Assignee: Carson Wang
> Fix For: 2.0.0
>
>
> The max number of executor failure before failing the application is default
> to twice the maximum number of executors if dynamic allocation is enabled.
> The default value for "spark.dynamicAllocation.maxExecutors" is Int.MaxValue.
> So this causes an integer overflow and a wrong result.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
