GitHub user 10110346 opened a pull request:
https://github.com/apache/spark/pull/19303
[SPARK-22085][CORE]When the applicationhas no core leftï¼do not request
more executors from the cluster manager in ExecutorAllocationManager
## What changes were proposed in this pull request?
When the application has no core leftï¼we should not request more
executors from the cluster manager in `ExecutorAllocationManager`.
At this time, if not reach `spark.dynamicAllocation.maxExecutors`,
`spark.dynamicAllocation.maxExecutors`setting is invalid in fact, so we should
give a warning log.
## How was this patch tested?
Existing tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/10110346/spark executoralloc
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19303.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19303
----
commit dce30edfc746ef3fd8daa8693c0344c585f9031f
Author: liuxian <[email protected]>
Date: 2017-09-21T07:39:07Z
fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
