Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/18322
@jerryshao The problem is: If we start an app with the param
--total-executor-cores=4 and spark.executor.cores=3, the code
"app.coresLeft>0" is always true in
"org.apache.spark.deploy.master.startExecutorsOnWorkers" and it will try to
allocate executor for this app and it will allocate nothing, it is better to
compare the app.coresLeft whih coresPerExecutor, if the coresLeft less than
coresPerExecutor, it will return directly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
