[
https://issues.apache.org/jira/browse/TAJO-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086663#comment-15086663
]
ASF GitHub Bot commented on TAJO-1686:
--------------------------------------
GitHub user eminency opened a pull request:
https://github.com/apache/tajo/pull/929
TAJO-1686: Allow Tajo to use Hive UDF
This patch consists of parts below.
#### Core Logic
1. **TajoMaster.java / HiveFunctionLoader.java** : in charge of finding
Hive UDFs and registering them.
2. **HiveFunctionInvoke.java** : to call Hive UDF
#### Utility
1. **WritableTypeConverter.java** : utility class, to convert from Writable
type to Datum and vice versa.
2. **FunctionDescBuilder.java** : helper/builder to build FunctionDesc more
conveniently.
and others.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/eminency/tajo hive_udf
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/929.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #929
----
commit 8e2cafb21f6d149dc3bec7a3c7a845d54e678672
Author: Jongyoung Park <[email protected]>
Date: 2015-10-23T08:21:31Z
base
commit 070f3610442199edaa55e7f76c5343c549a66a01
Author: Jongyoung Park <[email protected]>
Date: 2015-10-27T07:41:41Z
Method name refactoring
commit 7efc29eefe6d78837cc6a817d1f1c68d0f550fce
Author: Jongyoung Park <[email protected]>
Date: 2015-10-27T07:55:08Z
Remove a simple method
commit 3a803f19a7758b18d5a592a4f44d95c071cf6f14
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T03:21:41Z
get UDF classes
commit 0fdfa0903f5d4922bf5d1c484013ec079770dede
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T03:22:07Z
refactor for Java 8
commit 1cd0d5a04b88d6fc2b7bf11f7c85089a7eef375b
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T03:23:03Z
test for local
commit 98f65a6001b4619e12ee34bc95a13c367b5ad1a9
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T07:11:12Z
name and deterministic
commit 6a69fdd2eab72380535e5b959e26ced1b55b811a
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T07:11:28Z
variable name refactoring
commit a0fe3b21114ab67f710585485891ac787782e964
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T07:29:55Z
remove useless enum
commit 6dcd24b537a0b245a079ef8db1c411a0a7563b19
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T07:31:32Z
Revert "remove useless enum"
This reverts commit a8739670ffb688b3d2c2ea5b8e8422d21059cf92.
commit 055a6db84feeb185c279b1b41e61190ede0ca155
Author: Jongyoung Park <[email protected]>
Date: 2015-10-29T07:32:30Z
Remove useless enum
commit 64899ae7bdb6b2dad951c3d98d9282ecc83bd4cc
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T02:58:20Z
Weird variable name changed
commit 935cd2891d6810d466c12838cf0498f94eb47bb0
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T05:32:48Z
analyzeUDF test
commit 6bc4e1eba76f242ee26c0dff2143dff819accb1b
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T05:33:08Z
test code missed
commit e2c0d719fa5c707fa08775b756aff45eb7cd19c6
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T06:03:31Z
License added
commit e675e15067fbf1effdafb3bfa0fc76da895f6a36
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T06:12:19Z
deterministic added and test modified
commit 6df6409852fd324c9d83b02fbd0d077f3ee08d27
Author: Jongyoung Park <[email protected]>
Date: 2015-11-09T08:40:09Z
deterministic test
commit 110c5882eba1780e323412c4339b11154ad62ea8
Author: Jongyoung Park <[email protected]>
Date: 2015-11-10T07:59:37Z
More test and FunctionDescBuilder added
commit 2142e3a0dca128c64c81dc22c8fe437ac60f4167
Author: Jongyoung Park <[email protected]>
Date: 2015-11-11T09:28:12Z
test refactoring
commit 5fd2c9187ac137fd34f0e03d8bf59d8db9cc2ef9
Author: Jongyoung Park <[email protected]>
Date: 2015-11-11T09:30:04Z
setup sequence refined
commit b4a7015d485e253195c29657373519aad12880fd
Author: Jongyoung Park <[email protected]>
Date: 2015-11-12T08:57:40Z
Method names are changed
commit 96a8c72a5f59079a8f782b861f970bf77e588e97
Author: Jongyoung Park <[email protected]>
Date: 2015-11-12T08:59:33Z
Test problem fixed
commit 96b9294495d27cb098147765db7841816273aa27
Author: Jongyoung Park <[email protected]>
Date: 2015-11-16T03:28:52Z
AmbiguousFunctionException in loading function
commit 2b43dc1dd8fff8c6aee0d4badcaae4d10abfc345
Author: Jongyoung Park <[email protected]>
Date: 2015-11-16T05:36:56Z
Basic finding test
commit fd69123f7e0972f584c82f8bb5ccb9e783151972
Author: Jongyoung Park <[email protected]>
Date: 2015-11-16T06:08:03Z
process synonyms
commit b31a9180e19018b40db9599cc3f1f7c1512c143b
Author: Jongyoung Park <[email protected]>
Date: 2015-11-16T06:28:24Z
process description and example
commit 3c9a00c81a695530158e77d8f6938827df2c4d75
Author: Jongyoung Park <[email protected]>
Date: 2015-11-16T06:31:53Z
Non @Description UDF test added
commit 58172a6376622e7aef9dae2333f811b150214c1e
Author: Jongyoung Park <[email protected]>
Date: 2015-12-01T02:59:28Z
Change PythonUDF PB to UDF one
commit ee2790b82a59eccc6456c555e1474df0f5147401
Author: Jongyoung Park <[email protected]>
Date: 2015-12-01T02:59:49Z
runFunction test added
commit 6fb0ee44422540b5a1456745d4f56a7f6eb71b3e
Author: Jongyoung Park <[email protected]>
Date: 2015-12-01T06:16:04Z
Constructor modified
----
> Allow Tajo to use Hive UDF
> --------------------------
>
> Key: TAJO-1686
> URL: https://issues.apache.org/jira/browse/TAJO-1686
> Project: Tajo
> Issue Type: New Feature
> Components: Function/UDF
> Reporter: Jaehwa Jung
> Assignee: Jongyoung Park
>
> Hive has been widely used in this area. Many users have maintained lots of
> big tables through Hive metastore using HiveQL and UDFs. Currently, Tajo
> provides own UDF and Hive users can implement their UDFs in Tajo. But if we
> can wrap Hive UDF in Tajo, it seems that they would be able to use Tajo
> easily for their analysis infrastructure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
