tgravescs commented on issue #26687: [SPARK-30055][k8s] Allow configuration of restart policy for Kubernetes pods URL: https://github.com/apache/spark/pull/26687#issuecomment-566296891 I'm somewhat still learning k8s details so it will take me a bit to review and we have holidays coming up so it might be at the new year before I get time. I am a little concerned with the side affects of this so that is why I need to make sure I understand. For instance if you have k8s restart the Driver is all the other code in place for it to really recover? ie you have running executors, so what happens to them, does it find them, does it kill them and restart, etc.. The executor side seems a little more straight forward as long as Spark handles it properly. Does it just show up as new executor and does it handle losing the other one properly? cc @mccheah
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
