See <http://hudson.zones.apache.org/hudson/job/HBase-Patch/983/changes>
Changes: [stack] HBASE-1928 ROOT and META tables stay in transition state (making the system not usable) if the designated regionServer dies before the assignment is complete ------------------------------------------ [...truncated 73886 lines...] [junit] 09/11/08 00:51:34 INFO zookeeper.ClientCnxn: EventThread shut down [junit] 09/11/08 00:51:34 INFO zookeeper.ZooKeeper: Session: 0x124d145e0560002 closed [junit] 09/11/08 00:51:34 DEBUG zookeeper.ZooKeeperWrapper: Closed connection with ZooKeeper [junit] 09/11/08 00:51:34 INFO regionserver.HRegionServer: RegionServer:1 exiting [junit] 09/11/08 00:51:34 INFO transactional.TestTHLogRecovery: RegionServer:1 has been aborted [junit] 09/11/08 00:51:34 DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName table1: location server 67.195.138.9:57338, location region name table1,,1257641478564 [junit] 09/11/08 00:51:34 DEBUG client.HTable$ClientScanner: Creating scanner over table1 starting at key '' [junit] 09/11/08 00:51:34 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at '' [junit] 09/11/08 00:51:34 DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName table1: location server 67.195.138.9:57338, location region name table1,,1257641478564 [junit] 09/11/08 00:51:35 INFO hbase.Leases: RegionServer:1.leaseChecker closing leases [junit] 09/11/08 00:51:35 INFO hbase.Leases: RegionServer:1.leaseChecker closed leases [junit] 09/11/08 00:51:35 INFO master.RegionManager: Assigning region -ROOT-,,0 to vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:35 INFO regionserver.HRegionServer: MSG_REGION_OPEN: -ROOT-,,0 [junit] 09/11/08 00:51:35 INFO regionserver.HRegionServer: Worker: MSG_REGION_OPEN: -ROOT-,,0 [junit] 09/11/08 00:51:35 DEBUG regionserver.HRegion: Opening region -ROOT-,,0, encoded=70236052 [junit] 09/11/08 00:51:35 DEBUG regionserver.Store: loaded /tmp/hbase-hudson/hbase/-ROOT-/70236052/info/8661255602319463589, isReference=false, sequence id=2, length=810, majorCompaction=false [junit] 09/11/08 00:51:35 INFO regionserver.HRegion: region -ROOT-,,0/70236052 available; sequence id is 3 [junit] 09/11/08 00:51:36 INFO master.ServerManager: Processing MSG_REPORT_PROCESS_OPEN: -ROOT-,,0 from vesta.apache.org,48799,1257641469472; 1 of 2 [junit] 09/11/08 00:51:36 INFO master.ServerManager: Processing MSG_REPORT_OPEN: -ROOT-,,0 from vesta.apache.org,48799,1257641469472; 2 of 2 [junit] 09/11/08 00:51:36 WARN server.PrepRequestProcessor: Got exception when processing sessionid:0x124d145e0560000 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown n/a [junit] org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists [junit] at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequestProcessor.java:245) [junit] at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:114) [junit] 09/11/08 00:51:36 DEBUG zookeeper.ZooKeeperWrapper: SetData of ZNode /hbase/root-region-server with 67.195.138.9:48799 [junit] 09/11/08 00:51:36 DEBUG master.HMaster: Processing todo: ProcessServerShutdown of vesta.apache.org,57338,1257641468476 [junit] 09/11/08 00:51:36 INFO master.RegionServerOperation: process shutdown of server vesta.apache.org,57338,1257641468476: logSplit: true, rootRescanned: false, numberOfMetaRegions: 1, onlineMetaRegions.size(): 1 [junit] 09/11/08 00:51:36 INFO master.RegionServerOperation: Log split complete, meta reassignment and scanning: [junit] 09/11/08 00:51:36 DEBUG master.ProcessServerShutdown$ScanRootRegion: process server shutdown scanning root region on 67.195.138.9 [junit] 09/11/08 00:51:36 DEBUG master.RegionServerOperation: process server shutdown scanning root region on 67.195.138.9 finished master [junit] 09/11/08 00:51:36 DEBUG master.ProcessServerShutdown$ScanMetaRegions: process server shutdown scanning .META.,,1 on 67.195.138.9:48799 [junit] 09/11/08 00:51:36 DEBUG master.RegionServerOperation: Shutdown scanner for vesta.apache.org,57338,1257641468476 processing table1,,1257641478564 [junit] 09/11/08 00:51:36 DEBUG master.RegionServerOperation: process server shutdown finished scanning .META.,,1 on 67.195.138.9:48799 [junit] 09/11/08 00:51:36 DEBUG master.RegionServerOperation: Removed vesta.apache.org,57338,1257641468476 from deadservers Map [junit] 09/11/08 00:51:37 INFO master.RegionManager: Assigning region table1,,1257641478564 to vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:37 INFO regionserver.HRegionServer: MSG_REGION_OPEN: table1,,1257641478564 [junit] 09/11/08 00:51:37 INFO regionserver.HRegionServer: Worker: MSG_REGION_OPEN: table1,,1257641478564 [junit] 09/11/08 00:51:37 DEBUG regionserver.HRegion: Opening region table1,,1257641478564, encoded=446705331 [junit] 09/11/08 00:51:37 DEBUG regionserver.Store: loaded /tmp/hbase-hudson/hbase/table1/446705331/family/4239498277406883130, isReference=false, sequence id=11, length=529, majorCompaction=false [junit] 09/11/08 00:51:37 INFO regionserver.HRegion: region table1,,1257641478564/446705331 available; sequence id is 12 [junit] 09/11/08 00:51:38 INFO master.ServerManager: 1 region servers, 0 dead, average load 3.0 [junit] 09/11/08 00:51:38 INFO master.BaseScanner: RegionManager.rootScanner scanning meta region {server: 67.195.138.9:48799, regionname: -ROOT-,,0, startKey: <>} [junit] 09/11/08 00:51:38 DEBUG master.BaseScanner: Current assignment of .META.,,1 is not valid; serverAddress=, startCode=0 unknown. [junit] 09/11/08 00:51:38 INFO master.BaseScanner: RegionManager.rootScanner scan of 1 row(s) of meta region {server: 67.195.138.9:48799, regionname: -ROOT-,,0, startKey: <>} complete [junit] 09/11/08 00:51:38 INFO master.BaseScanner: RegionManager.metaScanner scanning meta region {server: 67.195.138.9:48799, regionname: .META.,,1, startKey: <>} [junit] 09/11/08 00:51:38 INFO master.BaseScanner: RegionManager.metaScanner scan of 2 row(s) of meta region {server: 67.195.138.9:48799, regionname: .META.,,1, startKey: <>} complete [junit] 09/11/08 00:51:38 INFO master.BaseScanner: All 1 .META. region(s) scanned [junit] 09/11/08 00:51:38 INFO master.ServerManager: Processing MSG_REPORT_PROCESS_OPEN: table1,,1257641478564 from vesta.apache.org,48799,1257641469472; 1 of 2 [junit] 09/11/08 00:51:38 INFO master.ServerManager: Processing MSG_REPORT_OPEN: table1,,1257641478564 from vesta.apache.org,48799,1257641469472; 2 of 2 [junit] 09/11/08 00:51:38 INFO master.RegionManager: Assigning region .META.,,1 to vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:38 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:38 DEBUG master.RegionServerOperation: numberOfMetaRegions: 1, onlineMetaRegions.size(): 1 [junit] 09/11/08 00:51:38 DEBUG master.RegionServerOperation: Requeuing because not all meta regions are online [junit] 09/11/08 00:51:38 INFO regionserver.HRegionServer: MSG_REGION_OPEN: .META.,,1 [junit] 09/11/08 00:51:38 INFO regionserver.HRegionServer: Worker: MSG_REGION_OPEN: .META.,,1 [junit] 09/11/08 00:51:39 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:39 DEBUG master.RegionServerOperation: numberOfMetaRegions: 1, onlineMetaRegions.size(): 1 [junit] 09/11/08 00:51:39 DEBUG master.RegionServerOperation: Requeuing because not all meta regions are online [junit] 09/11/08 00:51:39 INFO master.ServerManager: Processing MSG_REPORT_PROCESS_OPEN: .META.,,1 from vesta.apache.org,48799,1257641469472; 1 of 2 [junit] 09/11/08 00:51:39 INFO master.ServerManager: Processing MSG_REPORT_OPEN: .META.,,1 from vesta.apache.org,48799,1257641469472; 2 of 2 [junit] 09/11/08 00:51:39 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:39 INFO master.RegionServerOperation: .META.,,1 open on 67.195.138.9:48799 [junit] 09/11/08 00:51:39 INFO master.RegionServerOperation: Updated row .META.,,1 in region -ROOT-,,0 with startcode=1257641469472, server=67.195.138.9:48799 [junit] 09/11/08 00:51:39 DEBUG master.RegionServerOperation: Adding to onlineMetaRegions: {server: 67.195.138.9:48799, regionname: .META.,,1, startKey: <>} [junit] 09/11/08 00:51:40 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: table1,,1257641478564 open on 67.195.138.9:48799 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: Updated row table1,,1257641478564 in region .META.,,1 with startcode=1257641469472, server=67.195.138.9:48799 [junit] 09/11/08 00:51:40 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: table1,,1257641478564 open on 67.195.138.9:48799 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: Updated row table1,,1257641478564 in region .META.,,1 with startcode=1257641469472, server=67.195.138.9:48799 [junit] 09/11/08 00:51:40 DEBUG master.HMaster: Processing todo: PendingOpenOperation from vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: table1,,1257641478564 open on 67.195.138.9:48799 [junit] 09/11/08 00:51:40 INFO master.RegionServerOperation: Updated row table1,,1257641478564 in region .META.,,1 with startcode=1257641469472, server=67.195.138.9:48799 [junit] Exception in thread "Thread-136" junit.framework.AssertionFailedError: expected:<8> but was:<10> [junit] at junit.framework.Assert.fail(Assert.java:47) [junit] at junit.framework.Assert.failNotEquals(Assert.java:277) [junit] at junit.framework.Assert.assertEquals(Assert.java:64) [junit] at junit.framework.Assert.assertEquals(Assert.java:195) [junit] at junit.framework.Assert.assertEquals(Assert.java:201) [junit] at org.apache.hadoop.hbase.regionserver.transactional.TestTHLogRecovery.verify(TestTHLogRecovery.java:212) [junit] at org.apache.hadoop.hbase.regionserver.transactional.TestTHLogRecovery.access$300(TestTHLogRecovery.java:51) [junit] at org.apache.hadoop.hbase.regionserver.transactional.TestTHLogRecovery$1.run(TestTHLogRecovery.java:279) [junit] at java.lang.Thread.run(Thread.java:619) [junit] 09/11/08 00:51:45 DEBUG hbase.LocalHBaseCluster: Shutting down HBase Cluster [junit] 09/11/08 00:51:45 INFO master.HMaster: Cluster shutdown requested. Starting to quiesce servers [junit] 09/11/08 00:51:45 WARN server.PrepRequestProcessor: Got exception when processing sessionid:0x124d145e0560000 type:create cxid:0x13 zxid:0xfffffffffffffffe txntype:unknown n/a [junit] org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists [junit] at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequestProcessor.java:245) [junit] at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:114) [junit] 09/11/08 00:51:45 DEBUG zookeeper.ZooKeeperWrapper: State node deleted in ZooKeeper [junit] 09/11/08 00:51:46 DEBUG master.RegionManager: telling root scanner to stop [junit] 09/11/08 00:51:46 DEBUG master.RegionManager: telling meta scanner to stop [junit] 09/11/08 00:51:46 DEBUG master.RegionManager: meta and root scanners notified [junit] 09/11/08 00:51:46 INFO master.MetaScanner: RegionManager.metaScanner exiting [junit] 09/11/08 00:51:46 INFO master.RootScanner: RegionManager.rootScanner exiting [junit] 09/11/08 00:51:46 INFO regionserver.HRegionServer: MSG_REGIONSERVER_QUIESCE [junit] 09/11/08 00:51:46 INFO regionserver.HRegionServer: Worker: MSG_REGIONSERVER_QUIESCE [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegionServer: Closing region table1,,1257641478564 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegionServer: Closing region __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:46 INFO transactional.TransactionalRegion: Preparing to close region table1,,1257641478564 [junit] 09/11/08 00:51:46 INFO transactional.TransactionalRegion: Preparing to close region __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Closing table1,,1257641478564: compactions & flushes disabled [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Closing __GLOBAL_TRX_LOG__,,1257641488713: compactions & flushes disabled [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Updates disabled for region, no outstanding scanners on table1,,1257641478564 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Updates disabled for region, no outstanding scanners on __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: No more row locks outstanding on region table1,,1257641478564 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: No more row locks outstanding on region __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Started memstore flush for region __GLOBAL_TRX_LOG__,,1257641488713. Current region memstore size 128 [junit] 09/11/08 00:51:46 DEBUG regionserver.Store: closed family [junit] 09/11/08 00:51:46 INFO regionserver.HRegion: Closed table1,,1257641478564 [junit] 09/11/08 00:51:46 DEBUG regionserver.Store: Added file:/tmp/hbase-hudson/hbase/__GLOBAL_TRX_LOG__/470474125/Info/3473493566320010065, entries=1, sequenceid=21, memsize=128, filesize=407 to __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:46 DEBUG regionserver.HRegion: Finished memstore flush of ~128 for region __GLOBAL_TRX_LOG__,,1257641488713 in 62ms, sequence id=21, compaction requested=false [junit] 09/11/08 00:51:46 DEBUG regionserver.Store: closed Info [junit] 09/11/08 00:51:46 INFO regionserver.HRegion: Closed __GLOBAL_TRX_LOG__,,1257641488713 [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: telling root scanner to stop [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: telling meta scanner to stop [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: meta and root scanners notified [junit] 09/11/08 00:51:47 INFO master.ServerManager: Region server vesta.apache.org,48799,1257641469472 quiesced [junit] 09/11/08 00:51:47 INFO master.ServerManager: All user tables quiesced. Proceeding with shutdown [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: telling root scanner to stop [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: telling meta scanner to stop [junit] 09/11/08 00:51:47 DEBUG master.RegionManager: meta and root scanners notified [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer: MSG_REGIONSERVER_STOP [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: Stopping server on 48799 [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: IPC Server handler 0 on 48799: exiting [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: Stopping IPC Server listener on 48799 [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: IPC Server handler 4 on 48799: exiting [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: IPC Server handler 3 on 48799: exiting [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: IPC Server handler 2 on 48799: exiting [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: IPC Server handler 1 on 48799: exiting [junit] 09/11/08 00:51:47 INFO ipc.HBaseServer: Stopping IPC Server Responder [junit] 09/11/08 00:51:47 INFO regionserver.MemStoreFlusher: RegionServer:0.cacheFlusher exiting [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegionServer: closing region .META.,,1 [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer$MajorCompactionChecker: RegionServer:0.majorCompactionChecker exiting [junit] 09/11/08 00:51:47 INFO transactional.TransactionalRegion: Preparing to close region .META.,,1 [junit] 09/11/08 00:51:47 INFO regionserver.LogRoller: LogRoller exiting. [junit] 09/11/08 00:51:47 INFO regionserver.CompactSplitThread: RegionServer:0.compactor exiting [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Closing .META.,,1: compactions & flushes disabled [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Updates disabled for region, no outstanding scanners on .META.,,1 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: No more row locks outstanding on region .META.,,1 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Started memstore flush for region .META.,,1. Current region memstore size 2.3k [junit] 09/11/08 00:51:47 DEBUG regionserver.Store: Added file:/tmp/hbase-hudson/hbase/.META./1028785192/info/3876917394709440198, entries=12, sequenceid=22, memsize=2.3k, filesize=1.7k to .META.,,1 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Finished memstore flush of ~2.3k for region .META.,,1 in 23ms, sequence id=22, compaction requested=false [junit] 09/11/08 00:51:47 DEBUG regionserver.Store: closed historian [junit] 09/11/08 00:51:47 DEBUG regionserver.Store: closed info [junit] 09/11/08 00:51:47 INFO regionserver.HRegion: Closed .META.,,1 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegionServer: closing region -ROOT-,,0 [junit] 09/11/08 00:51:47 INFO transactional.TransactionalRegion: Preparing to close region -ROOT-,,0 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Closing -ROOT-,,0: compactions & flushes disabled [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Updates disabled for region, no outstanding scanners on -ROOT-,,0 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: No more row locks outstanding on region -ROOT-,,0 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Started memstore flush for region -ROOT-,,0. Current region memstore size 272 [junit] 09/11/08 00:51:47 DEBUG regionserver.Store: Added file:/tmp/hbase-hudson/hbase/-ROOT-/70236052/info/7247877593677535517, entries=2, sequenceid=23, memsize=272, filesize=461 to -ROOT-,,0 [junit] 09/11/08 00:51:47 DEBUG regionserver.HRegion: Finished memstore flush of ~272 for region -ROOT-,,0 in 24ms, sequence id=23, compaction requested=false [junit] 09/11/08 00:51:47 DEBUG regionserver.Store: closed info [junit] 09/11/08 00:51:47 INFO regionserver.HRegion: Closed -ROOT-,,0 [junit] 09/11/08 00:51:47 DEBUG wal.HLog: RegionServer:0.logSyncerinterrupted while waiting for sync requests [junit] 09/11/08 00:51:47 INFO wal.HLog: RegionServer:0.logSyncer exiting [junit] 09/11/08 00:51:47 DEBUG wal.HLog: closing hlog writer in file:/tmp/hbase-hudson/hbase/.logs/vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer: telling master that region server is shutting down at: 67.195.138.9:48799 [junit] 09/11/08 00:51:47 INFO master.ServerManager: Removing server's info vesta.apache.org,48799,1257641469472 [junit] 09/11/08 00:51:47 INFO master.RegionManager: Offlined ROOT server: 67.195.138.9:48799 [junit] 09/11/08 00:51:47 INFO master.RegionManager: -ROOT- region unset (but not set to be reassigned) [junit] 09/11/08 00:51:47 INFO master.RegionManager: Offlining META region: {server: 67.195.138.9:48799, regionname: .META.,,1, startKey: <>} [junit] 09/11/08 00:51:47 INFO master.RegionManager: META region removed from onlineMetaRegions [junit] 09/11/08 00:51:47 INFO master.ServerManager: Region server vesta.apache.org,48799,1257641469472: MSG_REPORT_EXITING [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer: stopping server at: 67.195.138.9:48799 [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer: worker thread exiting [junit] 09/11/08 00:51:47 INFO zookeeper.ZooKeeper: Closing session: 0x124d145e0560001 [junit] 09/11/08 00:51:47 INFO zookeeper.ClientCnxn: Closing ClientCnxn for session: 0x124d145e0560001 [junit] 09/11/08 00:51:47 INFO server.PrepRequestProcessor: Processed session termination request for id: 0x124d145e0560001 [junit] 09/11/08 00:51:47 INFO master.ServerManager: vesta.apache.org,48799,1257641469472 znode expired [junit] 09/11/08 00:51:47 INFO server.NIOServerCnxn: closing session:0x124d145e0560001 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/127.0.0.1:21810 remote=/127.0.0.1:49334] [junit] 09/11/08 00:51:47 INFO zookeeper.ClientCnxn: Exception while closing send thread for session 0x124d145e0560001 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] [junit] 09/11/08 00:51:47 INFO zookeeper.ClientCnxn: Disconnecting ClientCnxn for session: 0x124d145e0560001 [junit] 09/11/08 00:51:47 INFO zookeeper.ZooKeeper: Session: 0x124d145e0560001 closed [junit] 09/11/08 00:51:47 INFO zookeeper.ClientCnxn: EventThread shut down [junit] 09/11/08 00:51:47 DEBUG zookeeper.ZooKeeperWrapper: Closed connection with ZooKeeper [junit] 09/11/08 00:51:47 INFO regionserver.HRegionServer: RegionServer:0 exiting [junit] 09/11/08 00:51:48 INFO master.ServerManager$ServerMonitor: Thread-82 exiting [junit] 09/11/08 00:51:48 INFO hbase.Leases: RegionServer:0.leaseChecker closing leases [junit] 09/11/08 00:51:48 INFO hbase.Leases: RegionServer:0.leaseChecker closed leases [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: Stopping server on 60000 [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: IPC Server handler 0 on 60000: exiting [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: IPC Server handler 3 on 60000: exiting [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: Stopping IPC Server listener on 60000 [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: IPC Server handler 4 on 60000: exiting [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: Stopping IPC Server Responder [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: IPC Server handler 1 on 60000: exiting [junit] 09/11/08 00:51:48 INFO ipc.HBaseServer: IPC Server handler 2 on 60000: exiting [junit] 09/11/08 00:51:48 INFO zookeeper.ZooKeeper: Closing session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Closing ClientCnxn for session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO server.PrepRequestProcessor: Processed session termination request for id: 0x124d145e0560000 [junit] 09/11/08 00:51:48 DEBUG master.ZKMasterAddressWatcher: Got event NodeDeleted with path /hbase/master [junit] 09/11/08 00:51:48 DEBUG master.ZKMasterAddressWatcher: Master address ZNode deleted, notifying waiting masters [junit] 09/11/08 00:51:48 INFO server.NIOServerCnxn: closing session:0x124d145e0560000 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/127.0.0.1:21810 remote=/127.0.0.1:49333] [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Exception while closing send thread for session 0x124d145e0560000 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Disconnecting ClientCnxn for session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO zookeeper.ZooKeeper: Session: 0x124d145e0560000 closed [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: EventThread shut down [junit] 09/11/08 00:51:48 DEBUG zookeeper.ZooKeeperWrapper: Closed connection with ZooKeeper [junit] 09/11/08 00:51:48 INFO zookeeper.ZooKeeper: Closing session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Closing ClientCnxn for session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Disconnecting ClientCnxn for session: 0x124d145e0560000 [junit] 09/11/08 00:51:48 INFO zookeeper.ZooKeeper: Session: 0x124d145e0560000 closed [junit] 09/11/08 00:51:48 DEBUG zookeeper.ZooKeeperWrapper: Closed connection with ZooKeeper [junit] 09/11/08 00:51:48 INFO master.HMaster: HMaster main thread exiting [junit] 09/11/08 00:51:48 INFO hbase.LocalHBaseCluster: Shutdown 1 region server(s) [junit] 09/11/08 00:51:48 INFO zookeeper.ZooKeeper: Closing session: 0x124d145e0560003 [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Closing ClientCnxn for session: 0x124d145e0560003 [junit] 09/11/08 00:51:48 INFO server.PrepRequestProcessor: Processed session termination request for id: 0x124d145e0560003 [junit] 09/11/08 00:51:48 INFO server.NIOServerCnxn: closing session:0x124d145e0560003 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/127.0.0.1:21810 remote=/127.0.0.1:49337] [junit] 09/11/08 00:51:48 INFO zookeeper.ClientCnxn: Exception while closing send thread for session 0x124d145e0560003 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] [junit] 09/11/08 00:51:49 INFO zookeeper.ClientCnxn: Disconnecting ClientCnxn for session: 0x124d145e0560003 [junit] 09/11/08 00:51:49 INFO zookeeper.ZooKeeper: Session: 0x124d145e0560003 closed [junit] 09/11/08 00:51:49 INFO zookeeper.ClientCnxn: EventThread shut down [junit] 09/11/08 00:51:49 DEBUG zookeeper.ZooKeeperWrapper: Closed connection with ZooKeeper [junit] 09/11/08 00:51:49 INFO server.NIOServerCnxn: NIOServerCnxn factory exited run method [junit] 09/11/08 00:51:49 INFO server.FinalRequestProcessor: shutdown of request processor complete [junit] 09/11/08 00:51:49 INFO server.SyncRequestProcessor: SyncRequestProcessor exited! [junit] 09/11/08 00:51:49 INFO server.PrepRequestProcessor: PrepRequestProcessor exited loop! [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 82.898 sec [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Starting shutdown thread [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Starting shutdown thread [junit] Exception in thread "Thread-44" java.lang.IllegalStateException: Shutdown in progress [junit] at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:55) [junit] at java.lang.Runtime.removeShutdownHook(Runtime.java:220) [junit] at org.apache.hadoop.fs.FileSystem$Cache.remove(FileSystem.java:1799) [junit] at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:1831) [junit] at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:1808) [junit] at org.apache.hadoop.fs.FileSystem.closeAll(FileSystem.java:246) [junit] at org.apache.hadoop.hbase.regionserver.HRegionServer$ShutdownThread.run(HRegionServer.java:890) [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Shutdown thread complete [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Starting shutdown thread [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Shutdown thread complete [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Starting shutdown thread [junit] 09/11/08 00:51:49 INFO regionserver.HRegionServer: Shutdown thread complete BUILD FAILED <http://hudson.zones.apache.org/hudson/job/HBase-Patch/ws/trunk/build.xml>:515: The following error occurred while executing this line: <http://hudson.zones.apache.org/hudson/job/HBase-Patch/ws/trunk/src/contrib/build.xml>:54: The following error occurred while executing this line: <http://hudson.zones.apache.org/hudson/job/HBase-Patch/ws/trunk/src/contrib/build-contrib.xml>:283: Tests failed! Total time: 32 minutes 3 seconds [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Archiving artifacts Recording test results Publishing Clover coverage report... No Clover report will be published due to a Build Failure