Github user yifeih commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212017571
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -51,7 +57,13 @@ private[spark] class KubernetesDriverBuilder(
provideJavaStep: (
KubernetesConf[KubernetesDriverSpecificConf]
=> JavaDriverFeatureStep) =
- new JavaDriverFeatureStep(_)) {
+ new JavaDriverFeatureStep(_),
+ provideTemplateVolumeStep: (KubernetesConf[_ <:
KubernetesRoleSpecificConf]
+ => TemplateVolumeStep) =
+ new TemplateVolumeStep(_),
+ provideInitialSpec: KubernetesConf[KubernetesDriverSpecificConf]
--- End diff --
I think it's because we need the `KubernetesDriverSpec` object instead of
just the pod? which includes things like the entire sparkConf map
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]