GitHub user mathieulongtin opened a pull request:
https://github.com/apache/spark/pull/12478
Pyfixgetconf
## What changes were proposed in this pull request?
In Python, sqlContext.getConf didn't allow getting the system default
(getConf with one parameter).
Now the following are supported:
```
sqlContext.getConf(confName) # System default if not locally set, this is
new
sqlContext.getConf(confName, myDefault) # myDefault if not locally set
```
I also added doctests to this function
## How was this patch tested?
Manually, but doctests were added.
Cherrypick commit 16a74ac7055bceca23163b60d58bc5a40318d0f9.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mathieulongtin/spark pyfixgetconf
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12478.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12478
----
commit 8f8f4f5073817bb0216da92a54c82ac102c829ac
Author: mathieu longtin <[email protected]>
Date: 2016-02-10T16:28:49Z
added spark-csv
commit 503ecc04a151dbcae9650146bc318b5743b5a3a9
Author: mathieu longtin <[email protected]>
Date: 2016-02-10T16:31:12Z
fix for bug https://issues.apache.org/jira/browse/SPARK-13266
commit 3ffb60d150a0c22e55f5f38dbaa44f397e479846
Author: mathieu longtin <[email protected]>
Date: 2016-02-17T02:27:00Z
more fix for bug https://issues.apache.org/jira/browse/SPARK-13266
commit f3b5579dd401c619a665952d4dc92699733958df
Author: mathieu longtin <[email protected]>
Date: 2016-03-29T19:03:28Z
Merge remote-tracking branch 'official/branch-1.6' into branch-1.6
commit f351d98fe49fc868a3aed17cb8eb2ef0af3c68ec
Author: mathieu longtin <[email protected]>
Date: 2016-03-30T12:59:10Z
up version of spark-csv to 1.4.0
commit 0def1f785d38c5c5a9e6dc71f1c760d2706905a1
Author: mathieu longtin <[email protected]>
Date: 2016-04-15T18:52:51Z
Merge remote-tracking branch 'official/branch-1.6' into branch-1.6
commit 16a74ac7055bceca23163b60d58bc5a40318d0f9
Author: mathieu longtin <[email protected]>
Date: 2016-04-15T20:37:37Z
Allow sqlContext.getConf to get system default
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
