GitHub user clarkyzl opened a pull request:
https://github.com/apache/flink/pull/3473
[FLINK-5833] [table] Support for Hive GenericUDF
Type: New Feature
Priority: Major
Components: table, udf
Problem definition: Make Flink call Hive User-Defined Functions, support
for simple hive Generic UDFs.
Design:
1. This patch is based on FLINK-5881 and FLINK-5832, we need variable
arguments to call hive udfs. We also need a HiveFunctionWrapper in FLINK-5832
to create Hive Generic UDFs.
1. Added a ScalarFunction called HiveGenericUDF to call Hive Generic UDFs.
Use primitive java object inspectors for the generic UDFs.
1. Moved the code to flink-hcatalog
Impact Analysis:
A new feature, had few impacts on exsting features. We updated hcatalog
dependencies from 0.12.0 to 0.13.0.
Test:
`mvn clean verify` is done on local.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/clarkyzl/flink flink-5833
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3473.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3473
----
commit 60b68fdd66f8021f6f090e7372987d43362d5ef3
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-22T10:53:34Z
[FLINK-5881] [table] ScalarFunction(UDF) should support variable types and
variable arguments
commit fe81a7d87d2620d19e5dd0fa569f139569b6c2aa
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-23T11:29:37Z
[FLINK-5881] [table] Modification as reviews
commit 21f8a4ec40a12828e59ff959b56d92c2c2629afd
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-20T06:04:12Z
[FLINK-5832] [table] Support for simple hive UDF
commit d734867874169ffd23f084fbdd7f8605208f2b37
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-27T05:24:33Z
[FLINK-5832] [table] Delete test code
commit 3b345f7d19054b7cbb961498d3f817fcaae128b5
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T07:54:39Z
[FLINK-5832] [table] Use scala to implement HiveSimpleUDF
commit 8838965d0add8ae1e47d216909e20ccd3d7fcd17
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T07:56:36Z
[FLINK-5832] [table] Remove unlicensed files
commit 260bf3b302e5753845ed30fe89b1516121bc3562
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T09:22:01Z
[FLINK-5832] [table] match the signature, varargs
commit fcda8546509cb755e101ef21a12b905f97cadf72
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T07:30:15Z
[FLINK-5881] [table] Modification as Jark's two comments
commit 1eca2a511de8eeb734f029887f2e0831f9092a7b
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T08:13:40Z
Merge branch 'flink-5881' into udf
commit 13b2039fcc8785b3b27a3d1537daec1c69aec944
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T10:40:58Z
[FLINK-5832] [table] still needs some ois
commit 80123fe9f82c989f74ec1d5194bc1609cfd207aa
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-02T03:28:38Z
[FLINK-5832] [table] Use FunctionRegistry to call HiveSimpleUDFs
commit b1cb548aa9f89f1ceef896bd8583a65054190795
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-02T08:00:31Z
[FLINK-5832] [table] Use PrimitiveObjectInspectors and add some unit tests
commit 97968fb86af105f0fc8b68e8083998dd0725deef
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-02T09:16:03Z
[FLINK-5832] [table] remove useless name variable and add more tests
commit 40ed7db039b86a5f39fc157fa36d8b55bf6f2bd4
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-03T08:15:30Z
[FLINK-5832] [table] move all the code to flink-hcatalog
commit 21f4c69e962ea8e4ca9083be4a6837dfa84df1cd
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-03T08:59:05Z
[FLINK-5832] [table] Remove newer version of hive udfs which does not exist
in flink-hcatalog
commit c86effa5cc9b23c7d058f7d01bf8f539c539a116
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-04T03:55:34Z
[FLINK-5833] [table] Support for Hive GenericUDF
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
