GitHub user zjffdu opened a pull request:
https://github.com/apache/spark/pull/16906
[SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell
## What changes were proposed in this pull request?
SPARK-15236 do this for scala shell, this ticket is for pyspark shell. This
is not only for pyspark itself, but can also benefit downstream project like
livy which use shell.py for its interactive session. For now, livy has no
control of whether enable hive or not.
## How was this patch tested?
I didn't find a way to add test for it. Just manually test it.
Run `bin/pyspark --master local --conf
spark.sql.catalogImplementation=in-memory` and verify hive is not enabled.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zjffdu/spark SPARK-19570
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16906.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16906
----
commit 431bcf8d332afe9d971b1f44a51e5dd2ca32ff81
Author: Jeff Zhang <zjf...@apache.org>
Date: 2017-02-13T02:03:40Z
[SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
