GitHub user uncleGen opened a pull request:
https://github.com/apache/spark/pull/16827
[SPARK-19482][CORE] Fail it if 'spark.master' is set with different value
## What changes were proposed in this pull request?
First, there is no need to set 'spark.master' multi-times with different
values. Second, It is possible for users to set the different 'spark.master' in
code with
`spark-submit` command, and will confuse users. So, we should do once check
if the 'spark.master' already exists in settings and if the previous value is
the same with current value. Throw a IllegalArgumentException when previous
value is different with current value.
## How was this patch tested?
add new unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uncleGen/spark SPARK-19482
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16827.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16827
----
commit 0cc599708d213c6aeaf8ad1a748323980444eb15
Author: uncleGen <[email protected]>
Date: 2017-02-07T03:26:56Z
Fail it if 'spark.master' is set with different value
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
