[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15484776#comment-15484776 ] Wangda Tan commented on YARN-5296: -- Already closed it, thanks for explanations! > NMs going OutOfMemory

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-09-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15483569#comment-15483569 ] Junping Du commented on YARN-5296: -- [~leftnoteasy], this is actually no need for branch-2.7 - as I

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-09-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474832#comment-15474832 ] Wangda Tan commented on YARN-5296: -- [~djp]/[~jianhe], I'm trying to understand why minimal of YARN-1643

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370816#comment-15370816 ] Junping Du commented on YARN-5296: -- Forget to mention, another issue could affect NM container metrics

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370779#comment-15370779 ] Junping Du commented on YARN-5296: -- Hi [~jlowe], I think the problem you mentioned above is already fixed

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368453#comment-15368453 ] Jason Lowe commented on YARN-5296: -- I just ran across a ContainerMetrics leak that I thought could be the

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363574#comment-15363574 ] Hudson commented on YARN-5296: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10053 (See

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363216#comment-15363216 ] Jian He commented on YARN-5296: --- lgtm, thanks for catching this ! > NMs going OutOfMemory because

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15361663#comment-15361663 ] Hadoop QA commented on YARN-5296: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360774#comment-15360774 ] Hadoop QA commented on YARN-5296: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360737#comment-15360737 ] Junping Du commented on YARN-5296: -- I just did some tests today. Actually, the first patch involve another

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359674#comment-15359674 ] Jian He commented on YARN-5296: --- No, this does not need to be in 2.7.3 > NMs going OutOfMemory because

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359649#comment-15359649 ] Vinod Kumar Vavilapalli commented on YARN-5296: --- ContainerMetrics went into 2.7.0 though the

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359636#comment-15359636 ] Jian He commented on YARN-5296: --- yep, we'll run more testing to verify if the oom is resolved. > NMs going

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359624#comment-15359624 ] Daniel Templeton commented on YARN-5296: If the fix resolves the issue, then LGTM. > NMs going

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-07-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359620#comment-15359620 ] Jian He commented on YARN-5296: --- I analyzed the memory heap dump together with Junping. This is indeed an

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354650#comment-15354650 ] Junping Du commented on YARN-5296: -- Not yet. But it is pretty clear that we need to fix things here just

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353373#comment-15353373 ] Daniel Templeton commented on YARN-5296: OK. Have you tested to see that this patch reduces the

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353351#comment-15353351 ] Junping Du commented on YARN-5296: -- bq. Looks like it will only be GCed when the container is GCed. Does

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353307#comment-15353307 ] Daniel Templeton commented on YARN-5296: Looks like it will only be GCed when the container is

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352032#comment-15352032 ] Junping Du commented on YARN-5296: -- Thanks [~templedf] for review and comments! I think

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351927#comment-15351927 ] Hadoop QA commented on YARN-5296: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351894#comment-15351894 ] Daniel Templeton commented on YARN-5296: Thanks for the patch, [~djp]. Looks to me like that patch

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351859#comment-15351859 ] Jian He commented on YARN-5296: --- lgtm > NMs going OutOfMemory because ContainerMetrics leak in

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351814#comment-15351814 ] Junping Du commented on YARN-5296: -- CC [~jianhe] > NMs going OutOfMemory because ContainerMetrics leak in

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351356#comment-15351356 ] Rajesh Balamohan commented on YARN-5296: Based on offline conversation with [~karams], i have

[jira] [Commented] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Karam Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351351#comment-15351351 ] Karam Singh commented on YARN-5296: --- >From offline discussion with [~djp] Root cause is in YARN-4811