[
https://issues.apache.org/jira/browse/PIG-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804600#action_12804600
]
Yan Zhou commented on PIG-1201:
-------------------------------
The point is to minimize the extra serialized size on disk. In other words,
the "configMap" serialized to disk in "writeObject" method is the one that
caused the problem. localConf is never serialized to disk.
We have tested this change and saw the serialized size on disk drops
significantly from around 140K to 1.2K, proving the correctness of the current
fix.
> [zebra] HDFS meta queries are issued by all mappers; Pig Loader serialize all
> JobConf contents including those unused by zebra
> ------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1201
> URL: https://issues.apache.org/jira/browse/PIG-1201
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Yan Zhou
> Assignee: Yan Zhou
> Priority: Minor
> Fix For: 0.6.0, 0.7.0
>
> Attachments: PIG-1201.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
