Andrew Or created SPARK-1896: -------------------------------- Summary: MASTER masks spark.master in spark-shell Key: SPARK-1896 URL: https://issues.apache.org/jira/browse/SPARK-1896 Project: Spark Issue Type: Bug Reporter: Andrew Or
For bin/spark-shell, the priority hierarchy is {code} MASTER > --master > spark.master (spark-defaults.conf) {code} Not sure if this was the intended behavior, but it was surprising to me when I tried to run the shell on local mode, and it didn't take effect. Note that this is inconsistent with running applications, where the hierarchy is {code} --master > spark.master (spark-defaults.conf) > MASTER {code} I think the MASTER is a good cluster default, but if the user explicitly specifies a master we should obey it, like we do in normal applications. -- This message was sent by Atlassian JIRA (v6.2#6252)