[ 
https://issues.apache.org/jira/browse/HBASE-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dave Latham resolved HBASE-4055.
--------------------------------

    Resolution: Duplicate

Ah, that should probably do it, Stack.  Thanks for the work.  Sorry for the 
duplicate issue.

It seems like too risky a change for the branch to me.  I look forward to 
seeing 0.92.

> Client region location caches redundant HTableDescriptor's
> ----------------------------------------------------------
>
>                 Key: HBASE-4055
>                 URL: https://issues.apache.org/jira/browse/HBASE-4055
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.3
>            Reporter: Dave Latham
>             Fix For: 0.92.0
>
>
> While examining the heap of a map task in a MapReduce job that writes 
> directly to HBase, I noticed that the HRegionLocation instances were taking 
> up 90 MB (out of a 700 MB heap for each map task) to cache the locations for 
> 15K regions.  As the number of regions in the cluster continues to grow, this 
> continues to grow as well.
> Of that, it appears that about 80 MB were going to 15K HTableDescriptor 
> instances.  There are only 5 tables that it's writing to, so it seems to be 
> wasting a great deal of memory with a separate copy of the table descriptor 
> for each region.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to