GitHub user hvanhovell opened a pull request:
https://github.com/apache/spark/pull/11905
[SPARK-14086][SQL] Add DDL commands to ANTLR4 Parser [WIP]
## What changes were proposed in this pull request?
This PR is built on top of https://github.com/apache/spark/pull/11557. It
adds the DDL commands to the SQL/Core parser.
I'll add some more documentation later on.
## How was this patch tested?
Existing Unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hvanhovell/spark ngParser2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11905.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11905
----
commit 567032345603f445bbdea14a9f17c638119d93d6
Author: Herman van Hovell <[email protected]>
Date: 2016-02-23T16:30:10Z
Move Presto parser into spark
commit acac8f5233dcea16558c97853315a8f0ff677c74
Author: Herman van Hovell <[email protected]>
Date: 2016-02-23T22:21:13Z
Build parsers side-by-side
commit 1a98c0ccf6c9200a837d3800118128c94590de38
Author: Herman van Hovell <[email protected]>
Date: 2016-02-25T23:26:23Z
Add Expression Parsing
commit 3ebdeecc23a9eb63b7d1f4272b6bf43e234f9722
Author: Herman van Hovell <[email protected]>
Date: 2016-02-27T17:10:56Z
Add Expression Parsing
commit 555a959b7ac333a6f485b0097e532f122cb179e9
Author: Herman van Hovell <[email protected]>
Date: 2016-02-29T23:49:40Z
Add Basic Plan Parsing
commit a130429953713fbec3408e4b0e8db64ae4fa5c1c
Author: Herman van Hovell <[email protected]>
Date: 2016-03-06T00:25:26Z
Catalyst feature parity. Start with SQL/Core.
commit 384f10a4c106200ffc3dae9e0e60e8f3c15a2ee5
Author: Herman van Hovell <[email protected]>
Date: 2016-03-06T21:28:21Z
SQL/core feature parity.
commit d4461ae82316f16a5408eda5773be3502ea8d25d
Author: Herman van Hovell <[email protected]>
Date: 2016-03-06T21:34:21Z
Merge remote-tracking branch 'apache-github/master' into ngParser
# Conflicts:
# sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala
commit e991d20e2949ad25c7a26f15567105a52e5b0196
Author: Herman van Hovell <[email protected]>
Date: 2016-03-06T21:34:34Z
Merge remote-tracking branch 'apache-github/master' into ngParser
# Conflicts:
# sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala
commit 8ff792988d4b91fdfa0978c65368e560d79266ab
Author: Herman van Hovell <[email protected]>
Date: 2016-03-06T23:24:16Z
Make tests pass.
commit 06303bcc2801b3f7520c3174a982e21056e86386
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T06:52:36Z
Fix expand star
commit c105f83c12078adf2c3e3388f00797c43ee87dd5
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T15:48:27Z
Update deps
commit ff9e79643c302cdffa20333cbabab9ba71bea7cb
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T17:57:36Z
Revert intellij auto-style
commit f95840d00bcc2ba4324e9760907515e436b15edc
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T18:02:29Z
Fix wth in using/separate having processing from
commit 340522eeb37e36bc50d41152b4ec274c8ced3095
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T20:56:01Z
Fix decimal parsing/revert style/revert test typo.
commit 723edfba11c40e832916d90b5d1453c926317022
Author: Herman van Hovell <[email protected]>
Date: 2016-03-07T23:56:28Z
Improve error messages.
commit 2c9a092e2c3c944ecfeaa9dbdd55fd2665fb3d23
Author: Herman van Hovell <[email protected]>
Date: 2016-03-08T08:08:58Z
Add ParseException to pyspark.
commit 5d4e13f0a5161b6431936641649599e3f8f37134
Author: Herman van Hovell <[email protected]>
Date: 2016-03-12T20:48:02Z
Add extensive testing for expression parsing. Add doc to the AST builder
class.
commit 5d6f45151f54107979a7db2a26acb09137e0d84b
Author: Herman van Hovell <[email protected]>
Date: 2016-03-12T20:49:18Z
Merge remote-tracking branch 'apache-github/master' into ngParser
commit 303394f6c114eda0c085c871dd34b7ae70e9c81f
Author: Herman van Hovell <[email protected]>
Date: 2016-03-13T03:31:24Z
Fix SparkSqlParser
commit 460ef0d77a366602c89d87e9518fc94a8b721dd3
Author: Herman van Hovell <[email protected]>
Date: 2016-03-13T05:48:52Z
use new not equals symbol
commit a31a24d90644ca3d3094c6e8933287b40aeb7f0f
Author: Herman van Hovell <[email protected]>
Date: 2016-03-17T23:43:39Z
Add tests for plan parsing. Improve AST Builder.
commit b87f2b80e770f311326eeefb23e9d9b6ced62aa3
Author: Herman van Hovell <[email protected]>
Date: 2016-03-17T23:46:10Z
Merge remote-tracking branch 'apache-github/master' into ngParser
# Conflicts:
# sql/core/src/main/scala/org/apache/spark/sql/functions.scala
commit c5d0bcff0d41c1f302d842d6e111fa85a8baf74b
Author: Herman van Hovell <[email protected]>
Date: 2016-03-18T00:38:34Z
Add using. Fix merge conflicts.
commit 4f1da75388424c6d4169af900655c769524bee02
Author: Herman van Hovell <[email protected]>
Date: 2016-03-20T10:15:52Z
More tests small bug fixes
commit c29eceee0f8fc315988419d544fb6b08d861fe57
Author: Herman van Hovell <[email protected]>
Date: 2016-03-21T19:46:12Z
Add last expression and plan tests.
commit 3976f29c9c5acac2e88eb031108cc78f7eff3438
Author: Herman van Hovell <[email protected]>
Date: 2016-03-22T09:16:22Z
Split binary logical expression tests
commit bac8eeba96b89f93a55ee7ca256886f3556c254f
Author: Herman van Hovell <[email protected]>
Date: 2016-03-22T10:10:02Z
Add tests for errors/datatypes/tableidentifiers.
commit a5d12ba93a3c29194800d5e7de11704a96741833
Author: Herman van Hovell <[email protected]>
Date: 2016-03-22T10:10:37Z
Merge remote-tracking branch 'apache-github/master' into ngParser
commit 6c5f4053c5a3e58819a04b51276fa621f9d63e90
Author: Herman van Hovell <[email protected]>
Date: 2016-03-22T23:33:14Z
Move DDL commands in SparkSqlParser.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
