Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21092#discussion_r186237367
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -695,9 +693,17 @@ private[spark] class SparkSubmit extends Logging {
if (isKubernetesCluster) {
childMainClass = KUBERNETES_CLUSTER_SUBMIT_CLASS
if (args.primaryResource != SparkLauncher.NO_RESOURCE) {
- childArgs ++= Array("--primary-java-resource",
args.primaryResource)
+ if (args.isPython) {
--- End diff --
We chatted about this off-line and while its close its not exactly the same
so we can deal with minor parts of duplication for now.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
