[
https://issues.apache.org/jira/browse/HBASE-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209387#comment-13209387
]
ramkrishna.s.vasudevan commented on HBASE-5387:
-----------------------------------------------
We are facing the same problem in the 0.90 also when using GZIP. Below is a
snapshot of the 'top' command
{code}
13236 root 20 0 21.9g 21g 12m S 1 68.4 450:56.37 /opt/nn/jdk1.6.0_22
13236 root 20 0 21.9g 21g 12m S 1 68.4 450:56.71 /opt/nn/jdk1.6.0_22
13236 root 20 0 21.9g 21g 12m S 1 68.4 450:57.06 /opt/nn/jdk1.6.0_22
{code}
Configured heap is 4G for RS.
> Reuse compression streams in HFileBlock.Writer
> ----------------------------------------------
>
> Key: HBASE-5387
> URL: https://issues.apache.org/jira/browse/HBASE-5387
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0
> Reporter: Mikhail Bautin
> Assignee: Mikhail Bautin
> Priority: Critical
> Fix For: 0.94.0
>
> Attachments: 5387.txt, D1719.1.patch, D1719.2.patch, D1719.3.patch,
> D1719.4.patch, D1719.5.patch, D1725.1.patch,
> Fix-deflater-leak-2012-02-10_18_48_45.patch,
> Fix-deflater-leak-2012-02-11_17_13_10.patch,
> Fix-deflater-leak-2012-02-12_00_37_27.patch
>
>
> We need to to reuse compression streams in HFileBlock.Writer instead of
> allocating them every time. The motivation is that when using Java's built-in
> implementation of Gzip, we allocate a new GZIPOutputStream object and an
> associated native data structure every time we create a compression stream.
> The native data structure is only deallocated in the finalizer. This is one
> suspected cause of recent TestHFileBlock failures on Hadoop QA:
> https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
