[
https://issues.apache.org/jira/browse/HBASE-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162596#comment-13162596
]
gaojinchao commented on HBASE-4633:
-----------------------------------
I have tested, Memory does not increase when specified MaxDirectMemorySize with
moderate value.
In my cluster, nearly one hours , trigger a full GC. look this logs:
10022.210: [Full GC (System) 10022.210: [Tenured: 577566K->257349K(1048576K),
1.7515610 secs] 9651924K->257349K(14260672K), [Perm : 19161K->19161K(65536K)],
1.7518350 secs] [Times: user=1.75 sys=0.00, real=1.75 secs] .........
.........
13532.930: [GC 13532.931: [ParNew: 12801558K->981626K(13212096K), 0.1414370
secs] 13111752K->1291828K(14260672K), 0.1416880 secs] [Times: user=1.90
sys=0.01, real=0.14 secs]
13624.630: [Full GC (System) 13624.630: [Tenured: 310202K->175378K(1048576K),
1.9529280 secs] 11581276K->175378K(14260672K), [Perm : 19225K->19225K(65536K)],
1.9531660 secs]
[Times: user=1.94 sys=0.00, real=1.96 secs]
I monitored the memory. It is stable.
7543 root 20 0 16.9g 15g 9892 S 1 33.0 1258:59 java
7543 root 20 0 16.9g 15g 9892 S 0 33.0 1258:59 java
7543 root 20 0 16.9g 15g 9892 S 1 33.0 1258:59 java
7543 root 20 0 16.9g 15g 9892 S 0 33.0 1258:59 java
7543 root 20 0 16.9g 15g 9892 S 1 33.0 1258:59 java
7543 root 20 0 16.9g 15g 9892 S 1 33.0 1259:00 java
> Potential memory leak in client RPC timeout mechanism
> -----------------------------------------------------
>
> Key: HBASE-4633
> URL: https://issues.apache.org/jira/browse/HBASE-4633
> Project: HBase
> Issue Type: Bug
> Components: client
> Affects Versions: 0.90.3
> Environment: HBase version: 0.90.3 + Patches , Hadoop version: CDH3u0
> Reporter: Shrijeet Paliwal
> Attachments: HBaseclientstack.png
>
>
> Relevant Jiras: https://issues.apache.org/jira/browse/HBASE-2937,
> https://issues.apache.org/jira/browse/HBASE-4003
> We have been using the 'hbase.client.operation.timeout' knob
> introduced in 2937 for quite some time now. It helps us enforce SLA.
> We have two HBase clusters and two HBase client clusters. One of them
> is much busier than the other.
> We have seen a deterministic behavior of clients running in busy
> cluster. Their (client's) memory footprint increases consistently
> after they have been up for roughly 24 hours.
> This memory footprint almost doubles from its usual value (usual case
> == RPC timeout disabled). After much investigation nothing concrete
> came out and we had to put a hack
> which keep heap size in control even when RPC timeout is enabled. Also
> note , the same behavior is not observed in 'not so busy
> cluster.
> The patch is here : https://gist.github.com/1288023
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
