holdenk commented on issue #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-570011789 @vanzin I think in the first part recomissioning is something I considered out of scope. In the main situations with cloud providers and automated pre-emption I figured it wouldn't happen. And since the feature is manually enabled if someone turns it out and manually pre-empts and then un-pre-empts nodes it's an OK edge case to not support right away. What do you think? In the later phases we exit the executor once no more jobs are scheduled so I think the edge cases will be supported in the follow ups.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
