GitHub user yaooqinn opened a pull request:
https://github.com/apache/spark/pull/21290
[SPARK-24241][Submit]Do not fail fast when dynamic resource allocation
enabled with 0 executor
## What changes were proposed in this pull request?
```
~/spark-2.3.0-bin-hadoop2.7$ bin/spark-sql --num-executors 0 --conf
spark.dynamicAllocation.enabled=true
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=1024m;
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=1024m; support was removed in 8.0
Error: Number of executors must be a positive number
Run with --help for usage help or --verbose for debug output
```
Actually, we could start up with min executor number with 0 before if
dynamically
## How was this patch tested?
ut added
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yaooqinn/spark SPARK-24241
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21290.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21290
----
commit 844574bb4ce3e11b09d8bf52f4b15f52398e2605
Author: Kent Yao <yaooqinn@...>
Date: 2018-05-10T08:59:46Z
[SPARK-24241][Submit]Do not fail fast when dynamic resource allocation
enabled with 0 executor
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
