[
https://issues.apache.org/jira/browse/HBASE-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649174#action_12649174
]
stack commented on HBASE-1009:
------------------------------
Tried to figure this one. We try to do the reassignment every 3 seconds which
jibes with regionserver doing its regular report. The 10 is the maximum number
of regions a hrs will volunteer in its message of most loaded. Why does the
master think these are closing yet the regionserver keeps passing them in the
message is odd. Around this time we had some hungup regionservers. Maybe the
regions were closing but not yet closed on the HRS. Need to check. If so,
then might make sense reintroducing a closing flag on regions and then do not
return region if its already passed into closing state.
Will check these regions out on regionservers to verify this is indeed the case.
> Master stuck in loop wanting to assign but regions are closing
> --------------------------------------------------------------
>
> Key: HBASE-1009
> URL: https://issues.apache.org/jira/browse/HBASE-1009
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: stack
> Priority: Blocker
> Fix For: 0.19.0
>
>
> From streamy logs.
> {code}
> 2008-11-19 10:36:58,933 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:01,315 DEBUG org.apache.hadoop.hbase.master.ServerManager:
> Total Load: 138, Num Servers: 9, Avg Load: 16.0
> 2008-11-19 10:37:01,935 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Server XX.XX.XX.212:60020 is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:01,935 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Choosing to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:04,939 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Server XX.XX.XX.212:60020 is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:04,939 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Choosing to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:07,941 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Server XX.XX.XX.212:60020 is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:07,941 DEBUG org.apache.hadoop.hbase.master.RegionManager:
> Choosing to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:07,941 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:07,941 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager:
> Skipping region streamitems,�,1225411057556 because it is already closing.
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
