[
https://issues.apache.org/jira/browse/TEZ-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149088#comment-15149088
]
Siddharth Seth commented on TEZ-3114:
-------------------------------------
It should be possible to change the counter update interval, heartbeat
interval, max-events etc on a per vertex basis - without restarting containers.
I don't think this has been addressed yet because it hasn't really been
required. Everything is marked as AM for now though. This property can be
marked as AM as well - and changed over once these properties are propagated to
tasks correctly.
> Shuffle OOM due to EventMetaData flood
> --------------------------------------
>
> Key: TEZ-3114
> URL: https://issues.apache.org/jira/browse/TEZ-3114
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Attachments: TEZ-3114.001.patch, TEZ-3114.002.patch
>
>
> A task encountered an OOM during shuffle, and investigation of the heap dump
> showed a lot of memory being consumed by almost 3.5 million EventMetaData
> objects. Auto-parallelism had reduced the number of tasks in the vertex to 1
> and there were 2000 upstream tasks to shuffle.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
