[
https://issues.apache.org/jira/browse/TEZ-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738026#comment-14738026
]
Saikat commented on TEZ-2791:
-----------------------------
[~jeagles] I believe this is the same setitngs I was taking about which had
bloated the old gen heap space. Reducing this will ensure that fetched map
outputs are merged-spilled early to disk by the merge manager.
> Reduce tez.runtime.shuffle.fetch.buffer.percent default value to avoid corner
> case OOMs
> ---------------------------------------------------------------------------------------
>
> Key: TEZ-2791
> URL: https://issues.apache.org/jira/browse/TEZ-2791
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
>
> Default value for tez.runtime.shuffle.fetch.buffer.percent is set to 0.9. In
> corner cases & based on scheduling & data sizes, it is possible that JVM
> crosses old-gen threshold and ends up throwing OOM. It would be better to set
> the default value to 0.6.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
