[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268546#comment-14268546 ] Jian He commented on YARN-2997: --- ah, I think the problem that container statuses whose

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268670#comment-14268670 ] Chengbing Liu commented on YARN-2997: - Yes, a HashMap should be enough. I will upload a

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268714#comment-14268714 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265865#comment-14265865 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-06 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267210#comment-14267210 ] Chengbing Liu commented on YARN-2997: - Once got an RESYNC, NM calls

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14266500#comment-14266500 ] Jian He commented on YARN-2997: --- thanks for updating. bq. also in RESYNC section to clear

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-05 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265572#comment-14265572 ] Chengbing Liu commented on YARN-2997: - {quote} I think this is not possible given that

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-05 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265663#comment-14265663 ] Chengbing Liu commented on YARN-2997: - [~jianhe] Can we perhaps deal with

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265637#comment-14265637 ] Jian He commented on YARN-2997: --- bq. except the containers whose application is not in NM

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264975#comment-14264975 ] Jian He commented on YARN-2997: --- bq. we may run into a situation where we report two

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263792#comment-14263792 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263656#comment-14263656 ] Jian He commented on YARN-2997: --- I think we can simplify the logic in getContainerStatuses as

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-03 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263747#comment-14263747 ] Chengbing Liu commented on YARN-2997: - {quote} I think we can simplify the logic in

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263236#comment-14263236 ] Jian He commented on YARN-2997: --- [~chengbing.liu], thanks for your explanation ! patch looks

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-02 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263389#comment-14263389 ] Chengbing Liu commented on YARN-2997: - {quote} for simplicity, we can use the addAll

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262134#comment-14262134 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261526#comment-14261526 ] Karthik Kambatla commented on YARN-2997: With work-preserving restart, the NM is

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261682#comment-14261682 ] Jian He commented on YARN-2997: --- bq. add code to identify them duplicates and then ignore. I

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-30 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261792#comment-14261792 ] Chengbing Liu commented on YARN-2997: - [~kasha] [~jianhe] Thanks for your review. I

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261797#comment-14261797 ] Jian He commented on YARN-2997: --- bq. The uploaded patch will let the normal heartbeat The

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-30 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261825#comment-14261825 ] Chengbing Liu commented on YARN-2997: - [~jianhe] The containers are not removed in this

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2014-12-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260882#comment-14260882 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of