Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/7532#issuecomment-125106455
> from the code, I think what will happen if an application requests (call
sc.requestTotalExecutors(x)) less resources than what it has been assigned is
that it will not get more resources but still runs with the resources in hand,
right?
I don't understand your question. Are you asking what happens if I request
more than what my cluster can support? Spark expects the cluster manager to
eventually fulfill the request, so once space frees up the Master will launch
executors that could not be launched before.
> However...killExecutors is pretty hard to use, because I need to get the
exact IDs of executors....can we bring a new API like
killExecutors(numExectors: Int)?
That is completely orthogonal to this patch. We can add that in a separate
issue if there is demand for it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
