[
https://issues.apache.org/jira/browse/YARN-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vishal.rajan updated YARN-6470:
-------------------------------
Description:
In our production environment we are seeing NM process leaking memory, this is
off heap memory.NM jvm seems to be using memory within xmx limits.
output of top
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
32668 yarn 20 0 18.1g 16g 7244 S 19 17.0 55659:03 java
output of ps
yarn 32668 1 33 2016 ? 38-15:39:18
/usr/lib/jvm/jdk-8-oracle-x64/bin/java -Dproc_nodemanager -Xmx4096m
-Dhdp.version=2.4.0.0-169 -Dhadoop.log.dir=/grid/1/log/hadoop-yarn/yarn
OS:debian7
java version: oracle java8u25.
Yarn nodemanager-recovery is enabled.
The process needs to run for a month for this leak to occur.Please let us know
if more stats/info are required.
Have attached smaps and heapdump file.
was:
In our production environment we are seeing NM process leaking memory, this is
off heap memory.NM jvm seems to be using memory within xmx limits.
output of top
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
32668 yarn 20 0 18.1g 16g 7244 S 19 17.0 55659:03 java
output of ps
yarn 32668 1 33 2016 ? 38-15:39:18
/usr/lib/jvm/jdk-8-oracle-x64/bin/java -Dproc_nodemanager -Xmx4096m
-Dhdp.version=2.4.0.0-169 -Dhadoop.log.dir=/grid/1/log/hadoop-yarn/yarn
we use debian 7 OS and our java version is java8u25.
Yarn nodemanager-recovery is enabled.
The process needs to run for a month for this leak to occur.Please let us know
if more stats/info are required.
Have attached smaps and heapdump file.
> node manager offheap memory leak
> --------------------------------
>
> Key: YARN-6470
> URL: https://issues.apache.org/jira/browse/YARN-6470
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
> Affects Versions: 2.7.1
> Reporter: vishal.rajan
> Attachments: heap, test
>
>
> In our production environment we are seeing NM process leaking memory, this
> is off heap memory.NM jvm seems to be using memory within xmx limits.
> output of top
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
>
> 32668 yarn 20 0 18.1g 16g 7244 S 19 17.0 55659:03 java
> output of ps
> yarn 32668 1 33 2016 ? 38-15:39:18
> /usr/lib/jvm/jdk-8-oracle-x64/bin/java -Dproc_nodemanager -Xmx4096m
> -Dhdp.version=2.4.0.0-169 -Dhadoop.log.dir=/grid/1/log/hadoop-yarn/yarn
> OS:debian7
> java version: oracle java8u25.
> Yarn nodemanager-recovery is enabled.
> The process needs to run for a month for this leak to occur.Please let us
> know if more stats/info are required.
> Have attached smaps and heapdump file.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
