[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697038#comment-14697038 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/284/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697061#comment-14697061 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2233 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2233/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697118#comment-14697118 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2214 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2214/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697140#comment-14697140 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #276 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/276/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java * hadoop-yarn-project/CHANGES.txt Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696823#comment-14696823 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #287 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/287/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696837#comment-14696837 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1017 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1017/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696078#comment-14696078 ] Hudson commented on YARN-4005: -- FAILURE: Integrated in Hadoop-trunk-Commit #8295 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8295/]) YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong (jianhe: rev 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696285#comment-14696285 ] Jun Gong commented on YARN-4005: Thanks [~jianhe] for the review and commit! Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Fix For: 2.8.0 Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652887#comment-14652887 ] Jun Gong commented on YARN-4005: [~jianhe], could you please help review it? Thanks. Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651834#comment-14651834 ] Jun Gong commented on YARN-4005: Yes, I think the result will be same. Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651833#comment-14651833 ] Jun Gong commented on YARN-4005: Yes, I think the result will be same. Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650644#comment-14650644 ] sandflee commented on YARN-4005: seems there's no need to add to recentlyStoppedContainers, we could just remove container info from NMStateStore if app is finished. Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not add it to 'recentlyStoppedContainers' when calling 'getContainerStatuses'. Then NM will not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649311#comment-14649311 ] Jun Gong commented on YARN-4005: NM only removes containers in 'recentlyStoppedContainers' from NMStateStore, so we need add completed containers to 'recentlyStoppedContainers'. Completed container whose app is finished is not removed from NMStateStore -- Key: YARN-4005 URL: https://issues.apache.org/jira/browse/YARN-4005 Project: Hadoop YARN Issue Type: Bug Reporter: Jun Gong Assignee: Jun Gong Attachments: YARN-4005.01.patch If a container is completed and its corresponding app is finished, NM only removes it from its context and does not remove it from NMStateStore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore
[
https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649411#comment-14649411
]
Hadoop QA commented on YARN-4005:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch | 15m 6s | Findbugs (version ) appears to
be broken on trunk. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 40s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 43s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 0m 20s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 21s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 14s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | yarn tests | 6m 8s | Tests passed in
hadoop-yarn-server-nodemanager. |
| | | 42m 30s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12748183/YARN-4005.01.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 93d50b7 |
| hadoop-yarn-server-nodemanager test log |
https://builds.apache.org/job/PreCommit-YARN-Build/8737/artifact/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/8737/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/8737/console |
This message was automatically generated.
Completed container whose app is finished is not removed from NMStateStore
--
Key: YARN-4005
URL: https://issues.apache.org/jira/browse/YARN-4005
Project: Hadoop YARN
Issue Type: Bug
Reporter: Jun Gong
Assignee: Jun Gong
Attachments: YARN-4005.01.patch
If a container is completed and its corresponding app is finished, NM only
removes it from its context and does not remove it from NMStateStore.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
