[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928672#comment-16928672 ] Sakthi commented on HBASE-19320: I think we should get this one in.  > document the mysterious direct

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924533#comment-16924533 ] Karthik Palanisamy commented on HBASE-19320: Thanks, [~huaxiang] for the note.  Users

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834885#comment-16834885 ] Sean Busbey commented on HBASE-19320: - current patch doesn't include any of the good advice from our

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834349#comment-16834349 ] Biju Nair commented on HBASE-19320: --- Looks like there few +1s for the patch. Can this be merged? >

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736707#comment-16736707 ] Sean Busbey commented on HBASE-19320: - sounds like a great addition to the ref guide, at least for

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736706#comment-16736706 ] wengliemiao commented on HBASE-19320: - Thank you [~stack] for the review. For the users whom are

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736119#comment-16736119 ] stack commented on HBASE-19320: --- Thank you [~wengliemiao] for the analysis. What you suggest? Turn off use

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735638#comment-16735638 ] wengliemiao commented on HBASE-19320: - Our hbase client version is 1.2.3. Recently we run into

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636322#comment-16636322 ] huaxiang sun commented on HBASE-19320: -- Let me update the doc a bit. With hbase 2.0, it is

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560458#comment-16560458 ] huaxiang sun commented on HBASE-19320: -- I am going to commit the patch, thanks [~stack]. >

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364523#comment-16364523 ] stack commented on HBASE-19320: --- Is it harmless if it is in place? Can be different issue. +1 on committing

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364473#comment-16364473 ] huaxiang sun commented on HBASE-19320: -- thanks [~saint@gmail.com] for review. It needs some

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364451#comment-16364451 ] stack commented on HBASE-19320: --- It is beautiful [~huaxiang] +1 How about enabling it by default? >

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295416#comment-16295416 ] huaxiang sun commented on HBASE-19320: -- Yeah, I was searching for the max count in NIO and did not

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292061#comment-16292061 ] Anoop Sam John commented on HBASE-19320: And 'maxCacheSize ' for NIO is 5 I believe. Forgot any

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292059#comment-16292059 ] Anoop Sam John commented on HBASE-19320: I see.. This is per BB size. hmm bq. So the max

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291236#comment-16291236 ] huaxiang sun commented on HBASE-19320: -- -Djdk.nio.maxCachedBufferSize sets the maximum size for

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290672#comment-16290672 ] Anoop Sam John commented on HBASE-19320: Patch LGTM. To clarify- '-Djdk.nio.maxCachedBufferSize'

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290093#comment-16290093 ] huaxiang sun commented on HBASE-19320: -- [~saint@gmail.com], [~Apache9], [~anoop.hbase], mind

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279220#comment-16279220 ] huaxiang sun commented on HBASE-19320: -- The initial result from our testing result looks positive.

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269052#comment-16269052 ] huaxiang sun commented on HBASE-19320: -- Thanks [~anoop.hbase] for confirm. Hi [~ashishujjain],

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268142#comment-16268142 ] Ashish Singhi commented on HBASE-19320: --- We have faced this issue couple of times in our clusters

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268124#comment-16268124 ] Anoop Sam John commented on HBASE-19320: bq. I think Anoop mentioned the read path, how about the

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267824#comment-16267824 ] huaxiang sun commented on HBASE-19320: -- I went through the off-heap docs briefly. I think the answer

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267189#comment-16267189 ] huaxiang sun commented on HBASE-19320: -- Sorry for the late response, [~anoop.hbase] and

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263379#comment-16263379 ] stack commented on HBASE-19320: --- [~huaxiang] (when you back), how did this manifest in the situation you

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262909#comment-16262909 ] Anoop Sam John commented on HBASE-19320: Ya 2.0 only work with DBBs. 1.x by default work with on

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262815#comment-16262815 ] stack commented on HBASE-19320: --- [~anoop.hbase] Yeah. This would be hbase2 only, right? What [~huaxiang] is

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262006#comment-16262006 ] Anoop Sam John commented on HBASE-19320: In 2.0 we have direct BB pool to which we read reqs

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261955#comment-16261955 ] stack commented on HBASE-19320: --- bq, Yes, I thought this was the plan... Its not default [1]. Filed

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261878#comment-16261878 ] Yu Li commented on HBASE-19320: --- bq. Can we also make the netty rpc server default for 2.0? Yes, I thought

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261862#comment-16261862 ] Duo Zhang commented on HBASE-19320: --- OK a config to limit the size, better than nothing... And for the

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261852#comment-16261852 ] huaxiang sun commented on HBASE-19320: -- The fix is in jdk8u102 and jdk9, FYI.

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261849#comment-16261849 ] huaxiang sun commented on HBASE-19320: -- That is great to learn [~Apache9]! Netty by default for 2.0?

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261796#comment-16261796 ] Duo Zhang commented on HBASE-19320: --- I observed this problem years ago in java6, so until now the Java

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261779#comment-16261779 ] huaxiang sun commented on HBASE-19320: -- Attach two screenshots for this issue. The first one is

[jira] [Commented] (HBASE-19320) document the mysterious direct memory leak in hbase

[ https://issues.apache.org/jira/browse/HBASE-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261769#comment-16261769 ] stack commented on HBASE-19320: --- @fyi [~anoop.hbase] This is a good one sir. > document the mysterious