buska88 commented on PR #47949: URL: https://github.com/apache/spark/pull/47949#issuecomment-2333271093
I find that sometimes a job cannot schedule a speculative task and if i exclude the only remaining host, the job will fail because resource pending and all existing executors are blacklisted.So i commit https://github.com/apache/spark/pull/47949/commits/d45eed7a371d7806a06aeeb50982ede3d7479746 to fix it.If no pending speculative left(maybe stage finish or regular task finish), revive the host and let new tasks can launch on it when it‘s difficult to ask for new executors due to resource pending. Hope your attention thanks cc @HyukjinKwon @mridulm @tgravescs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
