[
https://issues.apache.org/jira/browse/HBASE-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13037816#comment-13037816
]
jian zhang commented on HBASE-3906:
-----------------------------------
1, Ted, This patch is only for branch.
2, Andrew, In my hmaster dump, there are 1481 HServerInfo and HServerLoad
objects,24,423,058 RegionLoad objects,one RegionLoad occupy 136B.I'm not native
speaker,so i'm not very sure that i understand your question correctly. Can i
understand "live objects" as the objects which cann't be garbage collected by
jvm?if so,i think all these objects are live.
3,stack, I tested serveral senarios,the patch can work correctly,no issues
found about synchronize blocks.
Indeed,refreshing hserverinfo is not grace enough. and balancing don't use the
load of the HSI in regions map i think. according to your suggestion, i cleared
the load and patched on my cluster to test,until now,it works ok.i will try to
test more senarios and then provide the new patch to you for reviewing again.
BTW,one hserverinfo object occupy about 350B memory though cleared the load,if
we don't use my ugly refreshing solution, in worst case,one region need one
hserverinfo object,if a big hbase cluster have 500,000 regions,the hserverinfo
objects will occupy about 175,000,000B memory.do you think this can be
acceptable?
> When HMaster is running,there are a lot of RegionLoad instances（far greater
> than the regions）,it has risk of OOME.
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-3906
> URL: https://issues.apache.org/jira/browse/HBASE-3906
> Project: HBase
> Issue Type: Improvement
> Components: master
> Affects Versions: 0.90.2, 0.90.3
> Environment: 1 hmaster,4 regionserver,about 100,000 regions.
> Reporter: jian zhang
> Fix For: 0.90.4
>
> Attachments: HBASE-3906.patch
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> 1、Start hbase cluster;
> 2、After hmaster finish regions assignement,use jmap to dump the memory of
> hmaster;
> 3、Use MAT to analyse the dump file,there are too many RegionLoad
> instances,and these instances occupy more than 3G memory;
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
