[
https://issues.apache.org/jira/browse/HIVE-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174331#comment-13174331
]
Hudson commented on HIVE-2666:
------------------------------
Integrated in Hive-trunk-h0.23.0 #42 (See
[https://builds.apache.org/job/Hive-trunk-h0.23.0/42/])
HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)
Summary:
Resource files are now added to the class path as soon as they are added via the
CLI. This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.
Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created. Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.
When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed. This results in a stack
overflow error.
Test Plan:
I ran the unit tests to verify nothing was broken.
I ran several queries which used custom UDFs and involved a join which was
converted to a map join. I verified these completed successfully consistently
Reviewers: JIRA, heyongqiang
Reviewed By: heyongqiang
CC: heyongqiang, kevinwilfong
Differential Revision: 957
heyongqiang :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221830
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/AddResourceProcessor.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/DeleteResourceProcessor.java
* /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java
> StackOverflowError when using custom UDF in map join
> ----------------------------------------------------
>
> Key: HIVE-2666
> URL: https://issues.apache.org/jira/browse/HIVE-2666
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2666.D957.1.patch
>
>
> When a custom UDF is used as part of a join which is converted to a map join,
> the XMLEncoder enters an infinite loop when serializing the map reduce task
> for the second time, as part of sending it to be executed. This results in a
> stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
