[
https://issues.apache.org/jira/browse/TEZ-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903497#comment-14903497
]
Saikat commented on TEZ-2850:
-----------------------------
[~hitesh] I was going through Hadoop's IFileInputStream
implementation(hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/IFileInputStream.java
) and found that this implementation of buffer[4096] is not present in hadoop
but in Tez. I submitted a tentative patch in which IFileInputStream of Tez
behaves exactly as that of Hadoop. Can you please throw some light what does
this added buffer do?
> Tez MergeManager OOM for small Map Outputs
> ------------------------------------------
>
> Key: TEZ-2850
> URL: https://issues.apache.org/jira/browse/TEZ-2850
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Saikat
> Attachments: OOM_1.png, OOM_2.png, OOM_3.png, TEZ-2850_test.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
