Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21068
What do you mean by adding notification to the driver? Like I mentioned I'm
fine with removing the limit for now but I think we have to do something here
if the entire cluster gets blacklisted, otherwise users jobs will just hang.
Its one thing if resources aren't available at the moment (as that can happen
regardless of blacklisting) and the assumption is they will eventually come
available but if spark has blacklisted all the nodes in the cluster we should
just fail if we aren't going to run.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
