GitHub user clarkyzl opened a pull request:
https://github.com/apache/flink/pull/3456
[FLINK-5832] [table] Support for simple hive UDF
Type: New Feature
Priority: Major
Components: table, udf, hive
Problem definition: Make Flink call Hive User-Defined Functions, support
for simple hive UDFs.
Design:
1. This patch is based on FLINK-5881, we need variable arguments to call
hive udfs.
2. Added a HiveFunctionWrapper to create Hive simple UDFs.
3. Added a ScalarFunction called HiveSimpleUDF to call Hive Simple UDFs.
Use primitive java object inspectors for the simple UDFs.
4. A few modification of type comparation, make type of Object equal any
types.
5. Added a new method in TableEnvironment to rigister hive UDFs.
Impact Analysis:
A new feature, had few impacts on exsting features, except for the
comparation of types.
Test:
`mvn clean verify` is done on local.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/clarkyzl/flink udf
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3456.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3456
----
commit 60b68fdd66f8021f6f090e7372987d43362d5ef3
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-22T10:53:34Z
[FLINK-5881] [table] ScalarFunction(UDF) should support variable types and
variable arguments
commit fe81a7d87d2620d19e5dd0fa569f139569b6c2aa
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-23T11:29:37Z
[FLINK-5881] [table] Modification as reviews
commit 21f8a4ec40a12828e59ff959b56d92c2c2629afd
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-20T06:04:12Z
[FLINK-5832] [table] Support for simple hive UDF
commit d734867874169ffd23f084fbdd7f8605208f2b37
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-27T05:24:33Z
[FLINK-5832] [table] Delete test code
commit 3b345f7d19054b7cbb961498d3f817fcaae128b5
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T07:54:39Z
[FLINK-5832] [table] Use scala to implement HiveSimpleUDF
commit 8838965d0add8ae1e47d216909e20ccd3d7fcd17
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T07:56:36Z
[FLINK-5832] [table] Remove unlicensed files
commit 260bf3b302e5753845ed30fe89b1516121bc3562
Author: Zhuoluo Yang <[email protected]>
Date: 2017-02-28T09:22:01Z
[FLINK-5832] [table] match the signature, varargs
commit fcda8546509cb755e101ef21a12b905f97cadf72
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T07:30:15Z
[FLINK-5881] [table] Modification as Jark's two comments
commit 1eca2a511de8eeb734f029887f2e0831f9092a7b
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T08:13:40Z
Merge branch 'flink-5881' into udf
commit 13b2039fcc8785b3b27a3d1537daec1c69aec944
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-01T10:40:58Z
[FLINK-5832] [table] still needs some ois
commit 80123fe9f82c989f74ec1d5194bc1609cfd207aa
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-02T03:28:38Z
[FLINK-5832] [table] Use FunctionRegistry to call HiveSimpleUDFs
commit b1cb548aa9f89f1ceef896bd8583a65054190795
Author: Zhuoluo Yang <[email protected]>
Date: 2017-03-02T08:00:31Z
[FLINK-5832] [table] Use PrimitiveObjectInspectors and add some unit tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
