warrenzhu25 opened a new pull request, #40912: URL: https://github.com/apache/spark/pull/40912
### What changes were proposed in this pull request? Support only decommission idle workers in standalone ### Why are the changes needed? Currently, standalone master web ui supports kill/decommission workers. But when graceful decommission is enabled, running task, shuffle and rdd migration could take long time. While waiting for running task, shuffle and rdd migration, decommissioned workers can't run new executors and decommissioned executors can't run new tasks. This caused lot of resource waste. If only idle workers to be decommissioned, these workers could be shutdown and removed to save cost without waiting long decommissioning process. ### Does this PR introduce _any_ user-facing change? Yes. POST http://masterWebUI:port/workers/kill/idleOnly=true Default: false ### How was this patch tested? Added test in MasterSuite -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
