stczwd commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures URL: https://github.com/apache/spark/pull/26433#issuecomment-553677278 > on how this change relates to blacklisting: yes, the distinction proposed here makes sense, blacklisting does not cover this case. Blacklisting is intended for when there is a problem with some subset of resources (eg. a bad disk on some nodes), not for complete application failure like this case. Yes, I agree with you. Blacklisting attempts to avoid abnormal nodes and ensure properly performed. This patch tries to limit the number of abnormal startups and throws exceptions in time.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
