[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-04-12 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965613#comment-15965613 ] vishal.rajan commented on YARN-6017: This doesn't seem like a java issue as we had updated java8u25 to

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-04-12 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965612#comment-15965612 ] vishal.rajan commented on YARN-6017: We are seeing a similar issue with yarn node managers. We have

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-17 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825870#comment-15825870 ] chenrongwei commented on YARN-6017: --- Thanks for Bibin A Chundatt 's answer. we used jdk 1.7u80 to run

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825841#comment-15825841 ] Bibin A Chundatt commented on YARN-6017: [~chenrongwei] Any update on issue after trying with new

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812167#comment-15812167 ] Bibin A Chundatt commented on YARN-6017: [~chenrongwei] This could be because of JDK bug. Found

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-09 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811175#comment-15811175 ] chenrongwei commented on YARN-6017: --- I think this problem is not the same with HADOOP-13362. because

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-09 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811170#comment-15811170 ] chenrongwei commented on YARN-6017: --- The [heap] shown in smaps output is not same as java heap, right.?

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811100#comment-15811100 ] Ajith S commented on YARN-6017: --- To clear my understanding, as per the smaps and jmap output, it looks like

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805348#comment-15805348 ] Junping Du commented on YARN-6017: -- As my suggestion in YARN-6062 also, can we use MAT or similar tools to

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-23 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772303#comment-15772303 ] chenrongwei commented on YARN-6017: --- we need relative long time to obsever this problem. > node manager

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-23 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772295#comment-15772295 ] chenrongwei commented on YARN-6017: --- we haven't try another jvm version as currently. but we had set the

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772254#comment-15772254 ] Rajesh Balamohan commented on YARN-6017: No. from JVM's accounting perspective it is still at 2048

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772233#comment-15772233 ] chenrongwei commented on YARN-6017: --- you are right. but native memory should be limited by MaxDirectSize

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772212#comment-15772212 ] Rajesh Balamohan commented on YARN-6017: "10193716 in [heap]" in smaps indicates that it is from

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772155#comment-15772155 ] chenrongwei commented on YARN-6017: --- thank you for reply, i already post,please check the attach file. >

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772139#comment-15772139 ] chenrongwei commented on YARN-6017: --- we hadn't set "yarn.nodemanager.recovery.enabled" in our config

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772116#comment-15772116 ] Rajesh Balamohan commented on YARN-6017: Usage seems to be from native side. Can you also post

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772106#comment-15772106 ] Rohith Sharma K S commented on YARN-6017: - Is this NodeManager running with work preserving restart

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread chenrongwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772031#comment-15772031 ] chenrongwei commented on YARN-6017: --- $ jmap -heap 31169 Attaching to process ID 31169, please wait...

[jira] [Commented] (YARN-6017) node manager physical memory leak

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771984#comment-15771984 ] Rajesh Balamohan commented on YARN-6017: Can you share the details of {noformat} jmap -heap