GitHub user piaozhexiu opened a pull request:
https://github.com/apache/spark/pull/7610
[SPARK-9270] [PySpark] allow --name option in pyspark
This is continuation of #7512 which added `--name` option to spark-shell.
This PR adds the same option to pyspark.
Note that `--conf spark.app.name` in command-line has no effect in
spark-shell and pyspark. Instead, `--name` must be used. This is in fact
inconsistency with spark-sql which doesn't accept `--name` option while it
accepts `--conf spark.app.name`. I am not fixing this inconsistency in this PR.
IMO, one of `--name` and `--conf spark.app.name` is needed not both. But since
I cannot decide which to choose, I am not making any change here.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/piaozhexiu/spark SPARK-9270
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7610.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7610
----
commit 190638b4f695557a441fdfcb4add406d40c1cc01
Author: Cheolsoo Park <[email protected]>
Date: 2015-07-23T07:30:56Z
Allow --name option to pyspark
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
