Doug Balog created SPARK-12129:
----------------------------------
Summary: spark.submit.deployMode not being picked up in
SparkSubmitArguments
Key: SPARK-12129
URL: https://issues.apache.org/jira/browse/SPARK-12129
Project: Spark
Issue Type: Bug
Components: Spark Submit
Affects Versions: 1.5.2, 1.4.1, 1.3.1
Environment: YARN, MESOS
Reporter: Doug Balog
Priority: Trivial
In sparkSubmitArguments.scala
{code}
deployMode = Option(deployMode).orElse(env.get("DEPLOY_MODE")).orNull
{code}
This code should probably check to see if the env variable SPARK_SUBMIT is set
and then look up `spark.submit.deployMode` in sparkProperties.
To see this, run something like {code}spark-submit -v --conf
spark.submit.deployMode=cluster --class org.apache.spark.examples.SparkPi
$SPARK_HOME/lib/spark-examples-1.6.0-hadoop.2.6.0.jar{code}
The last `spark.submit.deployMode` will be set to client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
