GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/12625
[SPARK-14861][SQL] Replace internal usages of SQLContext with SparkSession
## What changes were proposed in this pull request?
In Spark 2.0, `SparkSession` is the new thing. Internally we should stop
using `SQLContext` everywhere since that's supposed to be not the main
user-facing API anymore.
Reviewers: This is a big patch that may be difficult to review, but the
changes are really straightforward. If you prefer I can break it up into a few
smaller patches, but it will delay the progress of this issue a little.
## How was this patch tested?
No change in functionality intended.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark spark-session-refactor
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12625.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12625
----
commit 13cb587b9ef41aa1b6a66ceeabdaf600ee1bb9ed
Author: Andrew Or <[email protected]>
Date: 2016-04-22T20:32:31Z
Refactor Dataset and related APIs
commit 3faa3685f2d4b98999ff18b38b4ca4505c2a2b7b
Author: Andrew Or <[email protected]>
Date: 2016-04-22T20:52:56Z
Refactor SQL stream related classes
commit 6dac82c62e9a2a7028276def2ebd68efb63c7c9f
Author: Andrew Or <[email protected]>
Date: 2016-04-22T20:57:59Z
Refactor QueryExecution
commit b463debf9724be1c4f103df4cf5c2568169ef48d
Author: Andrew Or <[email protected]>
Date: 2016-04-22T21:13:41Z
Refactor RunnableCommand
commit f836fc05c2c08418a5590a51c1597f40a11b28d3
Author: Andrew Or <[email protected]>
Date: 2016-04-22T21:29:11Z
Refactor DataSource
commit 266a71fabbaadeffb2a56de631b5ec7ce51d99bc
Author: Andrew Or <[email protected]>
Date: 2016-04-22T21:37:30Z
Refactor SessionState
commit b3e9c5de7cf777da44b4a9ed05a1c90a41a8fa3e
Author: Andrew Or <[email protected]>
Date: 2016-04-22T21:41:26Z
Refactor HiveMetastoreCatalog
commit dbba104713e85f4bbd1976aa06851fc8bb4f03db
Author: Andrew Or <[email protected]>
Date: 2016-04-22T21:48:12Z
Refactor HiveStrategies
commit ce10d928e1dca25e3286a09a7d00c012ec74e461
Author: Andrew Or <[email protected]>
Date: 2016-04-22T22:28:15Z
Refactor FileFormat
commit 693c8d1cb7ffa947b02099beac59b2382c5ebbbe
Author: Andrew Or <[email protected]>
Date: 2016-04-22T22:31:03Z
Fix style
commit d1a6592f8cf2696541f422481a2ee16c019e0ed0
Author: Andrew Or <[email protected]>
Date: 2016-04-22T22:32:40Z
Merge branch 'master' of github.com:apache/spark into spark-session-refactor
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
