GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/14678
[MINOR][SQL] Add missing functions for some options in SQLConf and use them
where applicable
## What changes were proposed in this pull request?
I first thought they are missing because they are kind of hidden options
but it seems they are just missing.
For example, `spark.sql.parquet.mergeSchema` is documented in
[sql-programming-guide.md](https://github.com/apache/spark/blob/master/docs/sql-programming-guide.md)
but this functions is missing whereas many options such as
`spark.sql.join.preferSortMergeJoin` are not documented but has its own
function.
So, this PR suggests make them consistent by adding the missing functions
for some options in `SQLConf` and use them where applicable.
## How was this patch tested?
Existing tests should cover this.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark sqlconf-cleanup
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14678.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14678
----
commit 27fbbd902dbfca34dd5edd5a219dc64abf9691cf
Author: hyukjinkwon <[email protected]>
Date: 2016-08-17T04:50:15Z
Add missing functions for some options and use them where applicable
commit c959f3b4e9ed23a9cee67db64b35fdc4d0e2301d
Author: hyukjinkwon <[email protected]>
Date: 2016-08-17T04:59:22Z
Fix typos
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
