GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/11573
[SPARK-13139][SQL] Parse Hive DDL commands ourselves
## What changes were proposed in this pull request?
This patch is ported over from @viirya's changes in #11048. Currently for
most DDLs we just pass the query text directly to Hive. Instead, we should
parse these commands ourselves and in the future (not part of this patch) use
the `HiveCatalog` to process these DDLs. This is a pretext to merging
`SQLContext` and `HiveContext`.
Note: As of this patch we still pass the query text to Hive. The difference
is that we now parse the commands ourselves so in the future we can just use
our own catalog.
## How was this patch tested?
Jenkins, new `DDLCommandSuite`, which comprises of about 40% of the changes
here.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark parser-plus-plus
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11573.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11573
----
commit fc3c1684ad8e24ab9b05f0f7e02659ea2e365ebd
Author: Andrew Or <[email protected]>
Date: 2016-03-04T22:20:07Z
Move things into new ParserUtils object
commit adcb561a6bcb91a946448b8a5601155c9d714675
Author: Andrew Or <[email protected]>
Date: 2016-03-07T22:40:48Z
Merge branch 'master' of github.com:apache/spark into parser-plus-plus
commit 010afddf40d776b3009cee98057e74d499c45012
Author: Andrew Or <[email protected]>
Date: 2016-03-07T23:56:09Z
Port over viirya's changes in #11048
commit 007907460d72a3aa82b222567c08589c62efb614
Author: Andrew Or <[email protected]>
Date: 2016-03-08T04:43:31Z
Address comments from #11408 + fix style
commit 02de9b771cc74abb6f1971081411bd6d8c4c4b5f
Author: Andrew Or <[email protected]>
Date: 2016-03-08T04:45:43Z
Merge branch 'master' of github.com:apache/spark into parser-plus-plus
Conflicts:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/bucket.scala
commit 3766f83bb5551c0fd978117c3f41efb99257c984
Author: Andrew Or <[email protected]>
Date: 2016-03-08T04:49:22Z
Minor fixes
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
