[
https://issues.apache.org/jira/browse/PIG-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881596#comment-13881596
]
Aniket Mokashi commented on PIG-3722:
-------------------------------------
This happens because ObjectInputStream doesn't take into consideration Thread
ContextClassLoader when deserializing hence we get following stack trace in
local-mode backend-
{noformat}
2014-01-24 08:30:33,260 WARN org.apache.hadoop.mapred.LocalJobRunner:
job_local_0002
java.io.IOException: Deserialization error:
org.apache.hcatalog.data.schema.HCatSchema
at
org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:59)
at org.apache.pig.impl.util.UDFContext.deserialize(UDFContext.java:192)
at
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil.setupUDFContext(MapRedUtil.java:173)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:229)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getOutputCommitter(PigOutputFormat.java:275)
at org.apache.hadoop.mapred.Task.initialize(Task.java:511)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:306)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
{noformat}
To fix this, we can use
[ClassLoaderObjectInputStream|http://commons.apache.org/proper/commons-io/apidocs/org/apache/commons/io/input/ClassLoaderObjectInputStream.html].
> Udf deserialization for registered classes fails in local_mode
> --------------------------------------------------------------
>
> Key: PIG-3722
> URL: https://issues.apache.org/jira/browse/PIG-3722
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.13.0
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Fix For: 0.13.0
>
>
> Similar to https://issues.apache.org/jira/browse/PIG-2532, registered classes
> are not available if jobs are converted to local_mode.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
