[
https://issues.apache.org/jira/browse/HBASE-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12658809#action_12658809
]
Andrew Purtell commented on HBASE-543:
--------------------------------------
2008-12-23 04:43:03,882 INFO org.apache.hadoop.hbase.master.ServerManager:
Received MSG_REPORT_SPLIT:
content,aac240d1215a044b865e0faad888f048,1230019268119:
content,aac240d1215a044b865e0faad888f048,1230019268119 split; daughters:
content,aac240d1215a044b865e0faad888f048,1230025378559,
content,ac7d850812026fa41ea8f31fe3a0b509,1230025378559 from 10.30.94.40:60020
2008-12-23 04:43:03,883 INFO org.apache.hadoop.hbase.master.RegionManager: assig
ning region content,aac240d1215a044b865e0faad888f048,1230025378559 to server 10.
30.94.40:60020
2008-12-23 04:43:03,884 INFO org.apache.hadoop.hbase.master.RegionManager:
assigning region content,ac7d850812026fa41ea8f31fe3a0b509,1230025378559 to
server 10.30.94.40:60020
2008-12-23 04:43:06,896 INFO org.apache.hadoop.hbase.master.ServerManager:
Received MSG_REPORT_PROCESS_OPEN:
content,ac7d850812026fa41ea8f31fe3a0b509,1230025378559 from 10.30.94.40:60020
2008-12-23 04:43:06,896 INFO org.apache.hadoop.hbase.master.ServerManager:
Received MSG_REPORT_OPEN:
content,aac240d1215a044b865e0faad888f048,1230025378559 from 10.30.94.40:60020
2008-12-23 04:43:06,896 INFO org.apache.hadoop.hbase.master.ServerManager:
Received MSG_REPORT_OPEN:
content,ac7d850812026fa41ea8f31fe3a0b509,1230025378559 from 10.30.94.40:60020
2008-12-23 04:43:06,896 DEBUG org.apache.hadoop.hbase.master.HMaster: Main
processing loop: PendingOpenOperation from 10.30.94.40:60020
2008-12-23 04:43:06,896 DEBUG org.apache.hadoop.hbase.master.RegionManager:
Server 10.30.94.40:60020 is overloaded. Server load: 7 avg: 6.0, slop: 0.1
2008-12-23 04:43:06,896 DEBUG org.apache.hadoop.hbase.master.RegionManager:
Choosing to reassign 1 regions. mostLoadedRegions has 7 regions in it.
2008-12-23 04:43:06,896 INFO
org.apache.hadoop.hbase.master.ProcessRegionOpen$1:
content,aac240d1215a044b865e0faad888f048,1230025378559 open on 10.30.94.40:60020
2008-12-23 04:43:06,896 DEBUG org.apache.hadoop.hbase.master.RegionManager:
Going to close region content,aac240d1215a044b865e0faad888f048,1230025378559
2008-12-23 04:43:06,896 INFO
org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
content,aac240d1215a044b865e0faad888f048,1230025378559 in region .META.,,1 with
startcode 1230014187119 and server 10.30.94.40:60020
2008-12-23 04:43:06,897 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 0 on 60000, call regionServerReport(address: 10.30.94.40:60020,
startcode: 1230014187119, load: (requests=3, regions=7, usedHeap=713,
maxHeap=1777), [Lorg.apache.hadoop.hbase.HMsg;@55c0d3a3,
[Lorg.apache.hadoop.hbase.HRegionInfo;@66869e5
0) from 10.30.94.40:41999: error: java.io.IOException:
java.lang.IllegalStateException: Cannot transition to closing from any other
state. Region: content,aac240d1215a044b865e0faad888f048,1230025378559
java.io.IOException: java.lang.IllegalStateException: Cannot transition to
closing from any other state. Region:
content,aac240d1215a044b865e0faad888f048,1230025378559
at
org.apache.hadoop.hbase.master.RegionManager.setClosing(RegionManager.java:785)
at
org.apache.hadoop.hbase.master.RegionManager.unassignSomeRegions(RegionManager.java:439)
at
org.apache.hadoop.hbase.master.RegionManager.assignRegions(RegionManager.java:192)
at
org.apache.hadoop.hbase.master.ServerManager.processMsgs(ServerManager.java:381)
at
org.apache.hadoop.hbase.master.ServerManager.processRegionServerAllsWell(ServerManager.java:327)
at
org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:240)
at
org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:570)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:632)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:894)
> A region's state is kept in several places in the master opening the
> possibility for race conditions
> ----------------------------------------------------------------------------------------------------
>
> Key: HBASE-543
> URL: https://issues.apache.org/jira/browse/HBASE-543
> Project: Hadoop HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.1.0, 0.1.1, 0.2.0
> Reporter: Jim Kellerman
> Assignee: Jim Kellerman
> Fix For: 0.19.0
>
> Attachments: 543.patch, 543.patch, 543.patch, 543.patch-4,
> 543.patch-5, recent-changes.patch, regionstate.txt
>
>
> A region's state exists in multiple maps in the RegionManager:
> unassignedRegions, pendingRegions, regionsToClose, closingRegions,
> regionsToDelete, etc.
> One of these race conditions was found in HBASE-534.
> For HBase-0.1.x, we should just patch the holes we find.
> The ultimate solution (which requires a lot of changes in HMaster) should be
> applied to HBase trunk.
> Proposed solution:
> Create a class that encapsulates a region's state and provide synchronized
> access to the class that validates state changes.
> There should be a single structure that holds regions in these transitional
> states and it should be a synchronized collection of some kind.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
