[ 
https://issues.apache.org/jira/browse/TEZ-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Seth updated TEZ-3644:
--------------------------------
    Attachment: TEZ-3464.01.patch

Completed containers are removed from AMNode whenever a dag completes. They 
cannot be removed while a dag is running - since a failure of a node may 
require a node to re-run.
Containers which have not completed cannot be removed after dag completion to 
allow for re-use.

Fairly straight-forward implementation.
An event is sent out from AMContainer whenever it is entering a final state. 
AMNode tracks these. Removes completed containers when a dag completes.

[~rajesh.balamohan] - please review.

> Cleanup container list stored in AMNode
> ---------------------------------------
>
>                 Key: TEZ-3644
>                 URL: https://issues.apache.org/jira/browse/TEZ-3644
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: TEZ-3464.01.patch
>
>
> A node tracks containers that it has run, to send out notifications in case 
> of node failure. This list is only cleaned up when the node moves to an 
> unhealthy state / moves back into a healthy state.
> These containers need to be cleaned up at some point.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to