[
https://issues.apache.org/jira/browse/HBASE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793485#action_12793485
]
Jean-Daniel Cryans commented on HBASE-2065:
-------------------------------------------
Different instance of the bug:
{code}
2009-12-21 19:29:15,425 INFO [IPC Server handler 4 on 60000]
master.ServerManager(421): Processing MSG_REPORT_OPEN: table122,,1261452520421
from 10.10.1.54,49932,1261452340816; 2 of 2
2009-12-21 19:29:15,426 INFO [main] client.HBaseAdmin(302): Deleted table121
2009-12-21 19:29:15,427 DEBUG [master] master.HMaster(479): Processing todo:
PendingOpenOperation from 10.10.1.54,49932,1261452340816
2009-12-21 19:29:15,427 INFO [master] master.ProcessRegionOpen(70):
table122,,1261452520421 open on 10.10.1.54:49932
2009-12-21 19:29:15,427 DEBUG [IPC Server handler 2 on 60000]
master.ChangeTableState(70): Processing unserved regions
2009-12-21 19:29:15,427 DEBUG [IPC Server handler 2 on 60000]
master.ChangeTableState(107): Processing regions currently being served
2009-12-21 19:29:15,428 DEBUG [IPC Server handler 2 on 60000]
master.ChangeTableState(121): Adding region table122,,1261452520421 to
setClosing list
2009-12-21 19:29:15,428 INFO [master] master.ProcessRegionOpen(80): Updated
row table122,,1261452520421 in region .META.,,1 with startcode=1261452340816,
server=10.10.1.54:49932
{code}
Under 3 milliseconds the region was opening, it was disabled, and then the
master removed it from regions in transition (after that last line). Table was
hosed.
> Cannot disable a table if any of its region is opening at the same time
> -----------------------------------------------------------------------
>
> Key: HBASE-2065
> URL: https://issues.apache.org/jira/browse/HBASE-2065
> Project: Hadoop HBase
> Issue Type: Sub-task
> Affects Versions: 0.20.2
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Fix For: 0.20.3, 0.21.0
>
>
> Also found with the test in the parent jira:
> {code}
> 2009-12-21 18:31:44,411 INFO [IPC Server handler 0 on 60000]
> master.RegionManager(331): Assigning region table113,,1261449026166 to
> 10.10.1.54,60853,1261448823301
> 2009-12-21 18:31:44,411 INFO [IPC Server handler 0 on 60000]
> master.RegionManager(331): Assigning region table121,,1261449041385 to
> 10.10.1.54,60853,1261448823301
> 2009-12-21 18:31:44,411 INFO [RegionServer:1]
> regionserver.HRegionServer(475): MSG_REGION_OPEN: table113,,1261449026166
> 2009-12-21 18:31:44,411 INFO [RegionServer:1]
> regionserver.HRegionServer(475): MSG_REGION_OPEN: table121,,1261449041385
> ...
> 2009-12-21 18:31:44,418 INFO [RegionServer:1.worker]
> regionserver.HRegion(343): region table113,,1261449026166/21044806 available;
> sequence id is 0
> ...
> 2009-12-21 18:31:44,445 DEBUG [IPC Server handler 4 on 60000]
> master.ChangeTableState(121): Adding region table113,,1261449026166 to
> setClosing list
> 2009-12-21 18:31:44,446 DEBUG [main] zookeeper.ZooKeeperWrapper(392): Read
> ZNode /hbase/root-region-server got 10.10.1.54:608532009-12-21 18:31:44,447
> DEBUG [main] client.HConnectionManager$TableServers(990): Found ROOT at
> 10.10.1.54:60853
> 2009-12-21 18:31:44,447 DEBUG [main]
> client.HConnectionManager$TableServers(899): Cached location for .META.,,1 is
> 10.10.1.54:608552009-12-21 18:31:44,453 DEBUG [main]
> client.HConnectionManager$TableServers(554): Rowscanned=1, rowsOffline=0
> 2009-12-21 18:31:44,454 DEBUG [main] client.HBaseAdmin(397): Sleep. Waiting
> for all regions to be disabled from table1132009-12-21 18:31:44,554 DEBUG
> [main] client.HBaseAdmin(406): Wake. Waiting for all regions to be disabled
> from table113
> ...
> 2009-12-21 18:31:44,642 INFO [RegionServer:0]
> regionserver.HRegionServer(475): MSG_REGION_CLOSE: table113,,1261449026166
> ...
> 2009-12-21 18:31:44,642 INFO [RegionServer:0.worker]
> regionserver.HRegionServer$Worker(1332): Worker: MSG_REGION_CLOSE:
> table113,,1261449026166
> ...
> 2009-12-21 18:31:44,664 INFO [IPC Server handler 0 on 60000]
> master.ServerManager(421): Processing MSG_REPORT_PROCESS_OPEN:
> table113,,1261449026166 from 10.10.1.54,60853,1261448823301; 1 of 4
> ...
> 2009-12-21 18:31:44,664 INFO [IPC Server handler 0 on 60000]
> master.ServerManager(421): Processing MSG_REPORT_OPEN:
> table113,,1261449026166 from 10.10.1.54,60853,1261448823301; 3 of 4
> 2009-12-21 18:31:44,664 DEBUG [IPC Server handler 0 on 60000]
> master.ServerManager(562): region server 10.10.1.54:60853 should not have
> opened region table113,,1261449026166
> 2009-12-21 18:31:44,666 INFO [RegionServer:1]
> regionserver.HRegionServer(475): MSG_REGION_CLOSE_WITHOUT_REPORT:
> table113,,1261449026166: Duplicate assignment
> 2009-12-21 18:31:44,666 INFO [RegionServer:1.worker]
> regionserver.HRegionServer$Worker(1332): Worker:
> MSG_REGION_CLOSE_WITHOUT_REPORT: table113,,1261449026166: Duplicate assignment
> {code}
> Here the master reassigned table13 and told the old region server to close
> the region before the new one was able to report that it opened it. At the
> end the new region server (good one) is also told to close it After that my
> test times out, table13 is not disabled neither it is deployed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
