mccheah commented on issue #26687: [SPARK-30055][k8s] Allow configuration of restart policy for Kubernetes pods URL: https://github.com/apache/spark/pull/26687#issuecomment-566323960 > If the driver process restarts, it will have the same app ID and will be able to locate the executors from the previous run. So the scary part here is that the driver will try to start more executors on its restart, right? So say we have 10 executors from the previous run - these 10 will attempt to contact the driver after it restarts - but won't the driver go to create 10 more on the restart, so now we have 20 executors for the application?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
