[
https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14001466#comment-14001466
]
Bikas Saha commented on TEZ-776:
--------------------------------
Is there an example describing how plugins would help reduce the memory
utilization?
If the events are in the (framework) VertexManager then why not keep them in
the Vertex itself? I think it will help in understanding if there is more clear
outline of the proposal. This may also affect the recovery pipeline. Event
fetching may be tricky to get right in the face of retries. All in all, IMO it
would be useful to discuss/brainstorm on these up front. Likely stage it into
separate jiras for event fetching etc.
> Reduce AM mem usage caused by storing TezEvents
> -----------------------------------------------
>
> Key: TEZ-776
> URL: https://issues.apache.org/jira/browse/TEZ-776
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
>
> This is open ended at the moment.
> A fair chunk of the AM heap is taken up by TezEvents (specifically
> DataMovementEvents - 64 bytes per event).
> Depending on the connection pattern - this puts limits on the number of tasks
> that can be processed.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
