Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19848
@rezasafi What do you mean by "different copies of an rdd at different
times" ? If they are two different jobs to save, even if of the same rdd, they
are two different jobs (save rdd with
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19954
This is promising ! I will take look at it over the weekend, thanks for the
great work :-)
---
-
To unsubscribe, e-mail
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r157039537
--- Diff: docs/building-spark.md ---
@@ -49,7 +49,7 @@ To create a Spark distribution like those distributed by
the
to be runnable, use `./dev/make
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19848
@steveloughran Any thoughts on @squito's comment ? It might be a valid
corner case some committer might be leveraging ? (in context of a single user
session for example
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19848
@squito Is there a requirement that it should be globally unique ? I am not
sure whether (some?) committers make this assumption : and the few I did take a
look at did not seem to care
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156728882
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156728638
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156727858
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156675246
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156677468
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156672841
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156677077
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156683488
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156679139
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156674433
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156677643
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19946#discussion_r156678749
--- Diff: docs/running-on-kubernetes.md ---
@@ -0,0 +1,498 @@
+---
+layout: global
+title: Running Spark on Kubernetes
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19717
@liyinan926 I dont have any other comments. Given that I am not as familiar
with this part of the codebase as I would have liked to be, I will defer to
others on whether it is ready for merge
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154834535
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154834099
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -119,5 +139,60 @@ private[spark] object Config
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154833745
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,162
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154833630
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/DriverConfigurationStepsOrchestrator.scala
---
@@ -0,0
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19848
Thanks for fixing this @rezasafi !
This looks cleaner than my suggestion to generate a unique jobId. LGTM
@vanzin
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19468
Thanks for the changes, and all the great work !
The pr LGTM for merge.
@rxin and @felixcheung have already +1'ed it.
We can leave it open for a day or so in case others want to do
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153427945
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,115 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153375960
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala
---
@@ -0,0 +1,184
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153375735
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,219 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153359286
--- Diff: docs/configuration.md ---
@@ -1397,10 +1397,10 @@ Apart from these, the following properties are also
available, and may be useful
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153359040
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -111,5 +111,14 @@ private[spark] object Config
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153356659
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153350771
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153349685
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r15958
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153331617
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153330144
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153329128
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153327541
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153327654
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterManager.scala
---
@@ -0,0 +1,70
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153326260
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153325898
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,115 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153281970
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,219 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153281380
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,173 @@
+/*
+ * Licensed
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19388
Internally, spark can continue to use stageId for its commit protocol -
which is independent of what we expose as jobId to mapred/mapreduce committer.
As an implementation detail, we were making
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19388
I agree with @vanzin - this looks very complicated for a enforcing a fairly
simple constraint.
It would be easier to depend on a AtomicInteger in driver for the id - and
propagate
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153122738
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,173 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153092633
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -702,6 +715,18 @@ object SparkSubmit extends CommandLineUtils with
Logging
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153126963
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala
---
@@ -0,0 +1,184
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153093170
--- Diff: resource-managers/kubernetes/core/pom.xml ---
@@ -0,0 +1,102 @@
+
+
+http://maven.apache.org/POM/4.0.0;
xmlns:xsi="http://www.w
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153132562
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153093334
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,219 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153123413
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/DriverConfigurationStepsOrchestrator.scala
---
@@ -0,0 +1,84
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153098283
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,219 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r153131921
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,161
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19717
+CC @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153087493
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153088979
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterManager.scala
---
@@ -0,0 +1,70
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153088232
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153091143
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153084210
--- Diff: resource-managers/kubernetes/core/pom.xml ---
@@ -0,0 +1,94 @@
+
+
+http://maven.apache.org/POM/4.0.0;
xmlns:xsi="http://www.w
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153087234
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153089366
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153089805
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153089664
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153087550
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153084631
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,115 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153089121
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153084513
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -0,0 +1,115 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r153090634
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,226
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19468
I am actually quite swamped right now, hence the delay in getting to this
PR.
I will try to take a pass over the weekend; but if it does get merged if
@vanzin is ok with it, fine by me
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147025026
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147022826
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147022413
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147019065
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147018411
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147016710
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147016051
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147015733
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147015428
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147015304
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147015064
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147014681
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147014641
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147014477
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/config.scala
---
@@ -0,0 +1,137 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147013219
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -0,0 +1,103
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r147012530
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -0,0 +1,103
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146973714
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146989963
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146984527
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146985776
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146964469
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/config.scala
---
@@ -0,0 +1,137 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146972185
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146976161
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146959181
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -0,0 +1,103
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146974409
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146963731
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/config.scala
---
@@ -0,0 +1,137 @@
+/*
+ * Licensed
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146973841
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146979869
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146957225
--- Diff: resource-managers/kubernetes/core/pom.xml ---
@@ -0,0 +1,102 @@
+
+
+http://maven.apache.org/POM/4.0.0;
xmlns:xsi="http://www.w
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146979317
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
---
@@ -0,0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/19468#discussion_r146969639
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -0,0 +1,229
201 - 300 of 1286 matches
Mail list logo
