bq. 2014-01-20 16:03:02,216 INFO [RegionOpenAndInitThread-hello_world-1] regionserver.HRegion: Closed
region was closed, not the region server. Cheers On Mon, Jan 20, 2014 at 8:14 AM, Fernando Iwamoto - Plannej < [email protected]> wrote: > I found this debug, this might the problem? Whenever i created a table, it > closes the region server, any thoughts? > > 2014-01-20 16:03:02,118 INFO [RpcServer.handler=12,port=16000] > master.HMaster: Client=ubuntu//50.50.1.4 create 'hello_world', {NAME > => 'test', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', > REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', > MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => > 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => > 'true'} > 2014-01-20 16:03:02,139 DEBUG [RpcServer.handler=12,port=16000] > lock.ZKInterProcessLockBase: Acquired a lock for > /hbase/table-lock/hello_world/write-master:160000000000000 > 2014-01-20 16:03:02,164 INFO > [MASTER_TABLE_OPERATIONS-hadoop-master:16000-0] > handler.CreateTableHandler: Create table hello_world > 2014-01-20 16:03:02,195 DEBUG > [MASTER_TABLE_OPERATIONS-hadoop-master:16000-0] > util.FSTableDescriptors: Wrote descriptor into: > > hdfs://hadoop-master:8020/hbase/.tmp/data/default/hello_world/.tabledesc/.tableinfo.0000000001 > 2014-01-20 16:03:02,197 INFO [RegionOpenAndInitThread-hello_world-1] > regionserver.HRegion: creating HRegion hello_world HTD == > 'hello_world', {NAME => 'test', DATA_BLOCK_ENCODING => 'NONE', > BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', > COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', > KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => > 'false', BLOCKCACHE => 'true'} RootDir = > hdfs://hadoop-master:8020/hbase/.tmp Table name == hello_world > 2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1] > regionserver.HRegion: Instantiated > hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35. > 2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1] > regionserver.HRegion: Closing > hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35.: > disabling compactions & flushes > 2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1] > regionserver.HRegion: Updates disabled for region > hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35. > 2014-01-20 16:03:02,216 INFO [RegionOpenAndInitThread-hello_world-1] > regionserver.HRegion: Closed > hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35. > > > > 2014/1/20 Fernando Iwamoto - Plannej <[email protected]> > > > anybody can explain the causes of "unable to find region xxxx after 10 > > tries?". For example, one of the cause is that table is not create. So i > > can troubleshoot my problem. > > > > > > 2014/1/16 Fernando Iwamoto - Plannej <[email protected]> > > > >> I have fixed the e-mail sent and RegionServers logs are OK, but this Log > >> from MasterLog, I saw this, might be a problem no? The RegionState are > >> Offline, should be Online? And about my resources issue, they have > >> 20gb/40gb, 2vcpu, 4-8gb ram. > >> > >> 2014-01-16 14:23:59,024 DEBUG [master:hadoop-master:60000] > master.AssignmentManager: Assigning 1 region(s) to > hadoop-master,60020,1389882230619 > >> 2014-01-16 14:23:59,026 DEBUG [master:hadoop-master:60000] > zookeeper.ZKAssign: master:60000-0x1439b6fb8830000, > quorum=hadoop-master:2181, baseZNode=/hbase Async create of unassigned node > 393d3f4076738246c1c1e3c3d93f22c4 with OFFLINE state > >> 2014-01-16 14:23:59,037 DEBUG [main-EventThread] > master.OfflineCallback: rs={393d3f4076738246c1c1e3c3d93f22c4 state=OFFLINE, > ts=1389882238951, server=null}, server=hadoop-master,60020,1389882230619 > >> 2014-01-16 14:23:59,038 DEBUG [main-EventThread] > master.OfflineCallback$ExistCallback: rs={393d3f4076738246c1c1e3c3d93f22c4 > state=OFFLINE, ts=1389882238951, server=null}, > server=hadoop-master,60020,1389882230619 > >> 2014-01-16 14:23:59,043 INFO [master:hadoop-master:60000] > master.AssignmentManager: hadoop-master,60020,1389882230619 unassigned > znodes=1 of total=1 > >> 2014-01-16 14:23:59,044 INFO [master:hadoop-master:60000] > master.RegionStates: Transitioned {393d3f4076738246c1c1e3c3d93f22c4 > state=OFFLINE, ts=1389882239026, server=null} to > {393d3f4076738246c1c1e3c3d93f22c4 state=PENDING_OPEN, ts=1389882239044, > server=hadoop-master,60020,1389882230619} > >> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000] > master.AssignmentManager: Bulk assigning done for > hadoop-master,60020,1389882230619 > >> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000] > master.AssignmentManager: Assigning 1 region(s) to > ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921 > >> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000] > zookeeper.ZKAssign: master:60000-0x1439b6fb8830000, > quorum=hadoop-master:2181, baseZNode=/hbase Async create of unassigned node > 127f07b410d994595c51728cbac8b19f with OFFLINE state > >> 2014-01-16 14:23:59,091 DEBUG [main-EventThread] > master.OfflineCallback: rs={127f07b410d994595c51728cbac8b19f state=OFFLINE, > ts=1389882238927, server=null}, > server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921 > >> 2014-01-16 14:23:59,093 DEBUG [main-EventThread] > master.OfflineCallback$ExistCallback: rs={127f07b410d994595c51728cbac8b19f > state=OFFLINE, ts=1389882238927, server=null}, > server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921 > >> 2014-01-16 14:23:59,098 INFO [master:hadoop-master:60000] > master.AssignmentManager: > ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921 unassigned > znodes=1 of total=1 > >> 2014-01-16 14:23:59,098 INFO [master:hadoop-master:60000] > master.RegionStates: Transitioned {127f07b410d994595c51728cbac8b19f > state=OFFLINE, ts=1389882239086, server=null} to > {127f07b410d994595c51728cbac8b19f state=PENDING_OPEN, ts=1389882239098, > server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921} > >> > >> > >> > >> 2014/1/16 Samir Ahmic <[email protected]> > >> > >>> Hi Fernando, > >>> > >>> Check logs on RegionServers there should be explanation why you got > >>> NotServingRegionException. > >>> You said that you got error after 10 min of running script ? It could > be > >>> that you have some resources issue, memory disk, cpu. > >>> > >>> Cheers > >>> > >>> > >>> On Thu, Jan 16, 2014 at 2:28 PM, Fernando Iwamoto - Plannej < > >>> [email protected]> wrote: > >>> > >>> > Sorry for duplicating the thread, I didn't subscribe to the hbase > mail > >>> > list. > >>> > > >>> > Continuing from this thread: > >>> > > >>> > > >>> > http://mail-archives.apache.org/mod_mbox/hbase-user/201401.mbox/%3CCAAmoe2sM_%3DH-w4k3RwN3UbyMv932g0CEUgwELST_0j9VvD4GcQ%40mail.gmail.com%3E > >>> > > >>> > The only error show me this: > >>> > > >>> > 2014-01-16 13:27:44,234 INFO [master:hadoop-master:60000] > >>> > catalog.CatalogTracker: Failed verification of hbase:meta,,1 at > >>> > > >>> > address=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389876721606, > >>> > exception=org.apache.hadoop.hbase.NotServingRegionException: > >>> > org.apache.hadoop.hbase.NotServingRegionException: Region > >>> > hbase:meta,,1 is not online > >>> > at > >>> > > >>> > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2585) > >>> > at > >>> > > >>> > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3952) > >>> > at > >>> > > >>> > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionInfo(HRegionServer.java:3369) > >>> > at > >>> > > >>> > org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:19789) > >>> > at > >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175) > >>> > at > >>> > > org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879) > >>> > > >>> > >> > >> > > >
