GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/11696
[SPARK-12719][SQL] SQL generation support for Generate
## What changes were proposed in this pull request?
This PR adds SQL generation support for `Generate` operator. It always
converts `Generate` operator into `LATERAL VIEW` format as there are many
limitations to put UDTF in project list.
This PR is based on https://github.com/apache/spark/pull/11658, please see
the last commit to review the real changes.
Takes over https://github.com/apache/spark/pull/11596
## How was this patch tested?
new tests in `LogicalPlanToSQLSuite`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cloud-fan/spark generate
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11696.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11696
----
commit f4b1ae8b30c2a572d4f44cd68b66c224aeee553b
Author: Wenchen Fan <[email protected]>
Date: 2016-03-11T06:29:45Z
tmp
commit 198b406a643d908483408ec6ccea26ffdc464aa9
Author: Wenchen Fan <[email protected]>
Date: 2016-03-11T14:35:50Z
assign globally unique names to all attributes to avoid ambiguity
commit 21a142d775b93f76dc16f2bf25af40f42f61774a
Author: Wenchen Fan <[email protected]>
Date: 2016-03-12T02:14:31Z
one more test and mionr cleanup
commit ade17d8b6c1cd31a961ac57597bc3a3ba91711ba
Author: Wenchen Fan <[email protected]>
Date: 2016-03-12T02:54:29Z
cleanup
commit 5b12aa08add3cf97c938ad6d7dd7de8e0118e55a
Author: Wenchen Fan <[email protected]>
Date: 2016-03-12T06:38:47Z
remove case Sample
commit cfc74ef29e666927b1e39c17f0c13264cfbc1051
Author: Wenchen Fan <[email protected]>
Date: 2016-03-14T13:26:59Z
sql generation for Generate
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
