[
https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated TEZ-3140:
------------------------------------
Attachment: TEZ-3140-2.patch
Updated patch addressing review comments from [~sseth].
Did not switch to DataInputByteBuffer to avoid the unnecessary objects it
creates. There are couple more in DataInputByteBuffer.Buffer class (scratch,
buffers, bidx, pos, length) apart from ones in DataInputStream mentioned by
Jon. Though the sizes are negligible, decided to stick with the wrapper class
in the patch as that has zero object and size additional overhead.
> Reduce AM memory usage while serialization
> ------------------------------------------
>
> Key: TEZ-3140
> URL: https://issues.apache.org/jira/browse/TEZ-3140
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.7.1, 0.8.3
>
> Attachments: TEZ-3140-1.patch, TEZ-3140-2.patch
>
>
> There is an unnecessary copy of userpayload byte array during
> serialization.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)