Genmao Yu created SPARK-19482:
---------------------------------
Summary: Fail it if 'spark.master' is set with different value
Key: SPARK-19482
URL: https://issues.apache.org/jira/browse/SPARK-19482
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.1.0, 2.0.2
Reporter: Genmao Yu
First, there is no need to set 'spark.master' multi-times with different
values. Second, It is possible for users to set the different 'spark.master' in
code with
`spark-submit` command, and will confuse users. So, we should do once check if
the 'spark.master' already exists in settings and if the previous value is the
same with current value. Throw a IllegalArgumentException when previous value
is different with current value.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
