[ https://issues.apache.org/jira/browse/SPARK-30979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dyno updated SPARK-30979: ------------------------- Summary: spark-submit - no need to resolve dependencies in kubernetes cluster mode (was: no need to resolve dependencies in kubernetes cluster mode) > spark-submit - no need to resolve dependencies in kubernetes cluster mode > ------------------------------------------------------------------------- > > Key: SPARK-30979 > URL: https://issues.apache.org/jira/browse/SPARK-30979 > Project: Spark > Issue Type: Bug > Components: Spark Submit > Affects Versions: 2.4.5 > Environment: spark-operator with spark-2.4.4 > Reporter: Dyno > Priority: Minor > > [https://github.com/apache/spark/blob/branch-2.4/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L301] > > when use spark-operator, observed that spark operator is trying to download > all the dependencies, but it is really not necessary as the driver will do it > again. > should the check be ``` > if (!isMesosCluster && !isStandAloneCluster && !isKubernetesCluster) { > } > ``` > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org