GitHub user ericl opened a pull request:
https://github.com/apache/spark/pull/13309
[SPARK-15520] [SQL] Also set sparkContext confs when using SparkSession
builder in pyspark
## What changes were proposed in this pull request?
Also sets confs in the underlying sc when using
SparkSession.builder.getOrCreate(). This is a bug-fix from a post-merge comment
in https://github.com/apache/spark/pull/13289
## How was this patch tested?
Python doc-tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ericl/spark spark-15520-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13309.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13309
----
commit 636e5a6a904442bd53612f34d4271bc377f57884
Author: Eric Liang <[email protected]>
Date: 2016-05-25T01:22:18Z
Tue May 24 18:22:17 PDT 2016
commit d972a4ae90d5736c912a18aad9c1ce9543835b7e
Author: Eric Liang <[email protected]>
Date: 2016-05-25T01:49:18Z
fix python 3
commit ddd3b503c3ef5ce96e6f2c73229cdaa860794354
Author: Eric Liang <[email protected]>
Date: 2016-05-25T23:21:16Z
Wed May 25 16:21:16 PDT 2016
commit 80e385a0c2da92fbe9a34a2c977768866e22a850
Author: Eric Liang <[email protected]>
Date: 2016-05-25T23:27:01Z
Merge branch 'master' into spark-15520-1
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]