GitHub user gczsjdy opened a pull request:
https://github.com/apache/spark/pull/16476
Implement expression field
This is an implementation of Hive's `field`.
field(str, str1, str2, ... ) is a variable-length(>=2) function which
returns the index of str in the list (str1, str2, ... ) or 0 if not found.
Every parameter is required to be subtype of AtomicType.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gczsjdy/spark udffield
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16476.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16476
----
commit 5f650641858653b42e08a73c87daf8af0b7cdd2b
Author: GuoChenzhao <[email protected]>
Date: 2016-12-21T12:30:17Z
Add field expression
commit b9d589f78c287c5155f668b726c257465a1e0327
Author: GuoChenzhao <[email protected]>
Date: 2016-12-21T12:33:13Z
Add field expression unit test
commit 0bb83282b36cee3e6edc15e991a65ffb7de54474
Author: GuoChenzhao <[email protected]>
Date: 2016-12-28T13:00:40Z
Add doGenCode and modify the function description
commit 255b177b7c1a81e3f79b175498c754e2c549791e
Author: GuoChenzhao <[email protected]>
Date: 2016-12-28T13:25:24Z
Add field expression unit test cases
commit bb5a3ef79ada230660ae867f07af7c8d3a58d43b
Author: GuoChenzhao <[email protected]>
Date: 2016-12-28T13:31:18Z
Modify function description
commit f291815544fac747cb26482ec2144d4f1bc91680
Author: GuoChenzhao <[email protected]>
Date: 2016-12-29T06:23:36Z
Add support for field children which is not List
commit f07ec52d745bc379153a56333638f957748139d1
Author: GuoChenzhao <[email protected]>
Date: 2016-12-29T06:29:30Z
Add field function API for DataFrame and unit test cases
commit 6319dc5e091a6b593e22a172397421955811c6b6
Author: GuoChenzhao <[email protected]>
Date: 2016-12-29T07:03:40Z
Modify @since version
commit df1038d6665c1c084a0ef0a1ac9efa0ec8f5d52d
Author: GuoChenzhao <[email protected]>
Date: 2016-12-29T07:04:19Z
Add Python API
commit 38fe71d90b85b2e8a3e0badda0a40ae411713b69
Author: GuoChenzhao <[email protected]>
Date: 2016-12-29T08:31:43Z
Add Apache License
commit 3fc66d5af7030baebbe14f0b21f2afd2ff9f231b
Author: GuoChenzhao <[email protected]>
Date: 2016-12-30T05:47:26Z
Modify import order
commit 5c55f42db084e5777704583d36d018da288e76f2
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T05:48:33Z
Move Field class def to ConditionalExpressions and modify the test
commit ce177f0f0c1ae9c21d72f2f9a4180718a74271e4
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T05:58:40Z
Modify the line feed's location
commit 57229a99baa2da09167a62291841eafada78f3e0
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T06:17:57Z
Move Field function test to ColumnExpressionSuite
commit 71e54da58f7ccaad187bf5c693111c2ce076faf2
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T08:56:21Z
Add null support and corresponding test cases
commit 83687c8c3bc38dc221dc42595ba83e992d0cf36e
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T09:09:40Z
Remove blank lines
commit 192fadc68a63552dad40a1fe40e664425cd55146
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T10:18:46Z
Modify field function definition to require >= 2 params
commit 08ab497582344158df7b0fbb95808f5444e1aa81
Author: GuoChenzhao <[email protected]>
Date: 2017-01-05T10:22:48Z
Add blank line
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
