GitHub user hvanhovell opened a pull request:
https://github.com/apache/spark/pull/10905
[SPARK-12865][SPARK-12866][SQL] Migrate SparkSQLParser/ExtendedHiveQlParser
commands to new Parser [WIP]
This PR moves all the functionality provided by the
SparkSQLParser/ExtendedHiveQlParser to the new Parser hierarchy
(SparkQl/HiveQl). This also improves the current SET command parsing: the
current implementation swallows ```set role ...``` and ```set autocommit ...```
commands, this PR respects these commands (and passes them on to Hive).
This PR and https://github.com/apache/spark/pull/10723 end the use of
Parser-Combinator parsers for SQL parsing. As a result we can also remove the
```AbstractSQLParser``` in Catalyst.
The PR is marked WIP as long as it doesn't pass all tests.
cc @rxin @viirya @winningsix (this touched
https://github.com/apache/spark/pull/10144)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hvanhovell/spark SPARK-12866
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10905.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10905
----
commit eaee5c1708899d8fbe5764559de5da0be8a755bb
Author: Herman van Hovell <[email protected]>
Date: 2016-01-17T20:00:29Z
Add ExtendedHiveQlParser and SparkSQLParser grammar to parser.
commit ff50b5266f4992a8503d069249f76d8447872ab7
Author: Herman van Hovell <[email protected]>
Date: 2016-01-18T00:24:07Z
Move SparkSQLParser functionality into the new parser.
commit 85eb26dbb3b3c61c8d5ae4872bc8b316af213c54
Author: Herman van Hovell <[email protected]>
Date: 2016-01-18T20:12:29Z
Move SparkSQLParser functionality into the new parser.
commit 7a21ea10c27b95b8d1e6a631a7c6c522941a070f
Author: Herman van Hovell <[email protected]>
Date: 2016-01-20T21:46:03Z
Add set/dfs/add partial commands
commit 3a3f32c090b7f680b147b6fdc51c8955c3a0f5dd
Author: Herman van Hovell <[email protected]>
Date: 2016-01-20T21:49:19Z
Merge remote-tracking branch 'spark/master' into SPARK-12866
# Conflicts:
#
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSQLParser.scala
commit 259027dda0de5abaa858306225b9eae7274b891c
Author: Herman van Hovell <[email protected]>
Date: 2016-01-25T23:22:21Z
Add proper 'set' command parsing.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
