[
https://issues.apache.org/jira/browse/SPARK-12129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037915#comment-15037915
]
Sean Owen commented on SPARK-12129:
-----------------------------------
I'm not sure you're intended to set {{spark.submit.deployMode}} directly; use
{{--deploy-mode}}. At least, the former is undocumented and appears to be
internal, and setting it gets ignored. On those grounds, I'd close this.
> spark.submit.deployMode not being picked up in SparkSubmitArguments
> -------------------------------------------------------------------
>
> Key: SPARK-12129
> URL: https://issues.apache.org/jira/browse/SPARK-12129
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 1.3.1, 1.4.1, 1.5.2
> Environment: YARN, MESOS
> Reporter: Doug Balog
> Priority: Trivial
>
> In sparkSubmitArguments.scala
> {code}
> deployMode = Option(deployMode).orElse(env.get("DEPLOY_MODE")).orNull
> {code}
> This code should probably check to see if the env variable SPARK_SUBMIT is
> set and then look up `spark.submit.deployMode` in sparkProperties.
> To see this, run something like {code}spark-submit -v --conf
> spark.submit.deployMode=cluster --class org.apache.spark.examples.SparkPi
> $SPARK_HOME/lib/spark-examples-1.6.0-hadoop.2.6.0.jar{code}
> The last `spark.submit.deployMode` will be set to client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
