GitHub user scwf opened a pull request:
https://github.com/apache/spark/pull/4353
[SPARK-5367][SQL] Support star expression in udfs
A follow up for #4163: support select array(key, *) from src
Since array(key, *) will not go into this case
```
case Alias(f @ UnresolvedFunction(_, args), name) if containsStar(args) =>
val expandedArgs = args.flatMap {
case s: Star => s.expand(child.output, resolver)
case o => o :: Nil
}
```
here added a case to cover the corner case of array.
/cc @liancheng
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/scwf/spark udf-star1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4353.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4353
----
commit eb93c1628247db169caa2581a61ac2a82cf5298d
Author: wangfei <[email protected]>
Date: 2015-01-22T09:26:35Z
fix star resolve issue in udf
commit 587bf7e951e0568f705200d452c7aa862ec6ef9d
Author: wangfei <[email protected]>
Date: 2015-01-22T09:28:21Z
compile fix
commit f87b5f90d53b93a8a6836ac9b007b8e24b1b5745
Author: scwf <[email protected]>
Date: 2015-01-22T15:32:42Z
added test case
commit da1da09f50b5adfed2965c892e9a00f792a63148
Author: scwf <[email protected]>
Date: 2015-01-22T15:33:43Z
minor fix
commit 6ae00db691c4d51c6b99904b4b1984382add313b
Author: wangfei <[email protected]>
Date: 2015-01-23T07:58:00Z
also fix problem with array
commit 0942fb19fdef76768eca7e505afa3d52b96ce7a5
Author: wangfei <[email protected]>
Date: 2015-02-04T03:30:11Z
follow up: support select array(key, *) from src
commit a7cd1919712fb3b8b8ccbf4851042e5a3da0e39c
Author: wangfei <[email protected]>
Date: 2015-02-04T03:33:19Z
minor fix
commit 4350d17de6e679a55d71a8f5842c5bd0cd075b28
Author: wangfei <[email protected]>
Date: 2015-02-04T03:34:35Z
minor fix
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
