GitHub user liancheng opened a pull request:
https://github.com/apache/spark/pull/14317
[SPARK-16380][EXAMPLES] Update SQL examples and programming guide for
Python language binding
This PR is based on PR #14098 authored by @wangmiao1981.
## What changes were proposed in this pull request?
This PR replaces the original Python Spark SQL example file with the
following three files:
- `sql/basic.py`
Demonstrates basic Spark SQL features.
- `sql/datasource.py`
Demonstrates various Spark SQL data sources.
- `sql/hive.py
Demonstrates Spark SQL Hive interaction.
This PR also removes hard-coded Python example snippets in the SQL
programming guide by extracting snippets from the above files using the
`include_example` Liquid template tag.
## How was this patch tested?
Manully tested.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liancheng/spark py-examples-update
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14317.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14317
----
commit fc9dc471c3fd7bb4e90c8948d4b0ddaee389b0f7
Author: [email protected] <[email protected]>
Date: 2016-07-07T20:04:48Z
add SQL example in python
commit b19384f8d97abfc34e9c8fcfcbe5f3565e5f7e9f
Author: [email protected] <[email protected]>
Date: 2016-07-07T23:21:43Z
add examples and change md file
commit cfceeb9232480a97ef842eb4a674a1df05ebcedd
Author: [email protected] <[email protected]>
Date: 2016-07-07T23:46:30Z
fix python style error
commit ed276187a69c2de796151955328426cc95650c82
Author: [email protected] <[email protected]>
Date: 2016-07-16T07:54:59Z
address review comments, part 1, not completed, WIP
commit c79a2b021afd2b6d4a3c88f477df747a3175c4ac
Author: [email protected] <[email protected]>
Date: 2016-07-16T20:52:40Z
fix python style error
commit a3c95e2760e62b613a20fad48f8b0f238ae5b83e
Author: [email protected] <[email protected]>
Date: 2016-07-16T21:32:09Z
update examples
commit 4375660a9edc729b8da149c86f2e7c55517d41a0
Author: [email protected] <[email protected]>
Date: 2016-07-16T21:43:20Z
move SQL example into sql folder
commit 584949726ad9dd3f146c49ea82657e8d6b41dabf
Author: Cheng Lian <[email protected]>
Date: 2016-07-22T11:32:59Z
Updates Python Spark SQL examples
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
