Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21068
so specifically on the limit, I'm ok with removing it as long as we have
the basic check to fail. I guess perhaps you are saying the limit and that
check are essentially the same thing? I was thinking that they were different
in that if you remove the limit from yarn, then the driver and UI side wouldn't
get out of sync since the only thing the yarn side would do is fail if it hit
the condition that all nodes are blacklisted. If you leave the limit as is,
like you mention it could be a bit confusing to the user as it could acquire an
executor on the node that was blacklisted but on the yarn side we don't enforce
due to the limit.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
