GitHub user yaooqinn opened a pull request:
https://github.com/apache/spark/pull/19688
[SPARK-22466][Spark Submit]export SPARK_CONF_DIR while conf is default
## What changes were proposed in this pull request?
### Before
```
Kent@KentsMacBookPro î°
~/Documents/spark-packages/spark-2.3.0-SNAPSHOT-bin-master î° bin/spark-shell
--master local
Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
17/11/08 10:28:44 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
17/11/08 10:28:45 WARN Utils: Service 'SparkUI' could not bind on port
4040. Attempting port 4041.
Spark context Web UI available at http://169.254.168.63:4041
Spark context available as 'sc' (master = local, app id =
local-1510108125770).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.3.0-SNAPSHOT
/_/
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java
1.8.0_65)
Type in expressions to have them evaluated.
Type :help for more information.
scala> sys.env.get("SPARK_CONF_DIR")
res0: Option[String] = None
```
### After
```
scala> sys.env.get("SPARK_CONF_DIR")
res0: Option[String] = Some(/Users/Kent/Documents/spark/conf)
```
## How was this patch tested?
@vanzin
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yaooqinn/spark SPARK-22466
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19688.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19688
----
commit 19ac61cd6d8b4cca295a1f0d2f2988ee3ac20d8c
Author: Kent Yao <[email protected]>
Date: 2017-11-08T02:30:01Z
export SPARK_CONF_DIR while conf is default
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
