[
https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167447#comment-15167447
]
Rohini Palaniswamy commented on TEZ-3140:
-----------------------------------------
It would have been easy if we can do bb.array(), but because it is a read only
ByteBuffer could do nothing about it. Started with changing UserPayLoad to
return payload.duplicate() instead of payload.asReadOnlyBuffer(), but that did
not work as the payload was already read only. UserPayLoad ByteBuffer is
constructed from ByteString.asReadOnlyByteBuffer() and there is no way to get
around that as ByteString does not expose the underlying array at all.
> Reduce AM memory usage while serialization
> ------------------------------------------
>
> Key: TEZ-3140
> URL: https://issues.apache.org/jira/browse/TEZ-3140
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.7.1, 0.8.3
>
> Attachments: TEZ-3140-1.patch
>
>
> There is an unnecessary copy of userpayload byte array during
> serialization.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)