GitHub user Sherry302 opened a pull request:
https://github.com/apache/spark/pull/14556
[SPARK-16966][Core] Make App Name to the valid name instead of a randâ¦
## What changes were proposed in this pull request?
In the SparkSession, before setting "spark.app.name" to
"java.util.UUID.randomUUID().toString", sparkConf.contains("spark.app.name")
should be checked instead of options.contains("spark.app.name")
## How was this patch tested?
Manual.
E.g.:
./bin/spark-submit --name myApplicationTest --verbose --executor-cores 3
--num-executors 1 --master yarn --deploy-mode client --class
org.apache.spark.examples.SparkKMeans
examples/target/original-spark-examples_2.11-2.1.0-SNAPSHOT.jar
The application "org.apache.spark.examples.SparkKMeans" above did not
invoke ".appName()".
Before this commit, in the history server UI:
App Name was a randomUUID 70c06dc5-1b99-4b4a-a826-ea27497e977b.
Now, with this commit, the App Name is the valid name "myApplicationTest".
â¦omUUID when 'spark.app.name' exists
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Sherry302/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14556.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14556
----
commit a21937be7de24a353a3e8c9bbe7471b31a1f4719
Author: Weiqing Yang <[email protected]>
Date: 2016-08-09T06:42:39Z
[SPARK-16966][Core] Make App Name to the valid name instead of a randomUUID
when 'spark.app.name' exists
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
