[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user liyinan926 commented on the issue: https://github.com/apache/spark/pull/20722 @felixcheung I think we want to move resource management to the driver such that the life time of the resources is bound to the life time of the driver pod. This works regardless of if the user chooses to wait for the application to finish or not. One tricky thing is the creation of the headless driver service. It must be created before the executors are created as otherwise the executors wouldn't be able to connect to the driver. I'm trying to figure out how we can achieve this order guarantee in the `KubernetesSchedulerBackend`. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/20722 so where are we on this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20722 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1232/ --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20722 **[Test build #87903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87903/testReport)** for PR 20722 at commit [`9890ebc`](https://github.com/apache/spark/commit/9890ebc543eb226f395391fb14b877d4b1bf0560). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20722 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20722 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87903/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20722 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20722 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1232/ --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20722 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1241/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20722: [SPARK-23571][K8S] Delete auxiliary Kubernetes resources...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20722 **[Test build #87903 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87903/testReport)** for PR 20722 at commit [`9890ebc`](https://github.com/apache/spark/commit/9890ebc543eb226f395391fb14b877d4b1bf0560). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org