liyinan926 commented on issue #23382: [SPARK-26441][KUBERNETES] Add kind configuration of driver pod URL: https://github.com/apache/spark/pull/23382#issuecomment-450023226 There has been some discussions on using a `Job` to run the driver has been discussed before in https://github.com/apache/spark/pull/21067. We decided not to adopt that approach for the reasons discussed in the PR. A `Deployment` has the same problem with a `Job`, i.e., lack of exactly-once semantics. If you need high availability and auto restart/retry support for the driver, the [K8S Spark Operator](https://github.com/GoogleCloudPlatform/spark-on-k8s-operator) is worth taking a look.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
