Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21068
well the downside to that and not just failing the application is similar
to what @squito was mentioning, if the cluster is just busy and you can't get
containers on those last few nodes, it could hang there for a long time. More
then likely all you are going to leave is a single node not blacklisted. But
I guess you can have that even with the BLACKLIST_RATIO, its just that you can
control that better. I guess perhaps for this pr we just leave as is like
@squito mentioned and have it off by default. Have a followup to add
notification into the driver.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
