[
https://issues.apache.org/jira/browse/HADOOP-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12986122#action_12986122
]
Matt Foley commented on HADOOP-6949:
------------------------------------
Hi Todd, thanks for reading over this. Agree with the first three items, and
will include in next version of the patch. I'll wait a couple days to see if
other suggestions arise.
The fourth item is tempting, and I had considered running long arrays through a
zip filter, which achieves much the same goal. However, I'm told by folks
who've been around longer than I that the wire format was kept in "clear" on
purpose for simplicity and ease of maintenance. So I think we should leave it
that way, unless there is overwhelming support for a compressed format.
> Reduces RPC packet size for primitive arrays, especially long[], which is
> used at block reporting
> -------------------------------------------------------------------------------------------------
>
> Key: HADOOP-6949
> URL: https://issues.apache.org/jira/browse/HADOOP-6949
> Project: Hadoop Common
> Issue Type: Improvement
> Components: io
> Reporter: Navis
> Assignee: Matt Foley
> Fix For: 0.23.0
>
> Attachments: arrayprim.patch, ObjectWritable.diff
>
> Original Estimate: 0.17h
> Remaining Estimate: 0.17h
>
> Current implementation of oah.io.ObjectWritable marshals primitive array
> types as general object array ; array type string + array length + (element
> type string + value)*n
> It would not be needed to specify each element types for primitive arrays.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
