[
https://issues.apache.org/jira/browse/TEZ-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186430#comment-17186430
]
László Bodor commented on TEZ-4135:
-----------------------------------
[~jeagles]: seems like buffers are not reused between streams
[this is where stream is
instantiated|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/SnappyCodec.java#L183],
and [this is where the buffer is created for every new
stream|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/DecompressorStream.java#L64]
> Improve memory allocation when executing in-memory reads
> --------------------------------------------------------
>
> Key: TEZ-4135
> URL: https://issues.apache.org/jira/browse/TEZ-4135
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: László Bodor
> Priority: Major
> Fix For: 0.10.0, 0.9.3
>
> Attachments: Screenshot 2020-03-16 at 6.34.42 PM.jpg,
> TEZ-4135.01.patch, TEZ-4135.02.patch, TEZ-4135.03.patch, TEZ-4135.04.patch
>
>
> !Screenshot 2020-03-16 at 6.34.42 PM.jpg|width=824,height=575!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
