I found this debug, this might the problem? Whenever i created a table, it
closes the region server, any thoughts?
2014-01-20 16:03:02,118 INFO [RpcServer.handler=12,port=16000]
master.HMaster: Client=ubuntu//50.50.1.4 create 'hello_world', {NAME
=> 'test', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW',
REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE',
MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS =>
'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}
2014-01-20 16:03:02,139 DEBUG [RpcServer.handler=12,port=16000]
lock.ZKInterProcessLockBase: Acquired a lock for
/hbase/table-lock/hello_world/write-master:160000000000000
2014-01-20 16:03:02,164 INFO
[MASTER_TABLE_OPERATIONS-hadoop-master:16000-0]
handler.CreateTableHandler: Create table hello_world
2014-01-20 16:03:02,195 DEBUG
[MASTER_TABLE_OPERATIONS-hadoop-master:16000-0]
util.FSTableDescriptors: Wrote descriptor into:
hdfs://hadoop-master:8020/hbase/.tmp/data/default/hello_world/.tabledesc/.tableinfo.0000000001
2014-01-20 16:03:02,197 INFO [RegionOpenAndInitThread-hello_world-1]
regionserver.HRegion: creating HRegion hello_world HTD ==
'hello_world', {NAME => 'test', DATA_BLOCK_ENCODING => 'NONE',
BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1',
COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647',
KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'} RootDir =
hdfs://hadoop-master:8020/hbase/.tmp Table name == hello_world
2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1]
regionserver.HRegion: Instantiated
hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35.
2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1]
regionserver.HRegion: Closing
hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35.:
disabling compactions & flushes
2014-01-20 16:03:02,216 DEBUG [RegionOpenAndInitThread-hello_world-1]
regionserver.HRegion: Updates disabled for region
hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35.
2014-01-20 16:03:02,216 INFO [RegionOpenAndInitThread-hello_world-1]
regionserver.HRegion: Closed
hello_world,,1390233782116.9d0df5ae0304a27571904f8a76441e35.
2014/1/20 Fernando Iwamoto - Plannej <[email protected]>
> anybody can explain the causes of "unable to find region xxxx after 10
> tries?". For example, one of the cause is that table is not create. So i
> can troubleshoot my problem.
>
>
> 2014/1/16 Fernando Iwamoto - Plannej <[email protected]>
>
>> I have fixed the e-mail sent and RegionServers logs are OK, but this Log
>> from MasterLog, I saw this, might be a problem no? The RegionState are
>> Offline, should be Online? And about my resources issue, they have
>> 20gb/40gb, 2vcpu, 4-8gb ram.
>>
>> 2014-01-16 14:23:59,024 DEBUG [master:hadoop-master:60000]
>> master.AssignmentManager: Assigning 1 region(s) to
>> hadoop-master,60020,1389882230619
>> 2014-01-16 14:23:59,026 DEBUG [master:hadoop-master:60000]
>> zookeeper.ZKAssign: master:60000-0x1439b6fb8830000,
>> quorum=hadoop-master:2181, baseZNode=/hbase Async create of unassigned node
>> 393d3f4076738246c1c1e3c3d93f22c4 with OFFLINE state
>> 2014-01-16 14:23:59,037 DEBUG [main-EventThread] master.OfflineCallback:
>> rs={393d3f4076738246c1c1e3c3d93f22c4 state=OFFLINE, ts=1389882238951,
>> server=null}, server=hadoop-master,60020,1389882230619
>> 2014-01-16 14:23:59,038 DEBUG [main-EventThread]
>> master.OfflineCallback$ExistCallback: rs={393d3f4076738246c1c1e3c3d93f22c4
>> state=OFFLINE, ts=1389882238951, server=null},
>> server=hadoop-master,60020,1389882230619
>> 2014-01-16 14:23:59,043 INFO [master:hadoop-master:60000]
>> master.AssignmentManager: hadoop-master,60020,1389882230619 unassigned
>> znodes=1 of total=1
>> 2014-01-16 14:23:59,044 INFO [master:hadoop-master:60000]
>> master.RegionStates: Transitioned {393d3f4076738246c1c1e3c3d93f22c4
>> state=OFFLINE, ts=1389882239026, server=null} to
>> {393d3f4076738246c1c1e3c3d93f22c4 state=PENDING_OPEN, ts=1389882239044,
>> server=hadoop-master,60020,1389882230619}
>> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000]
>> master.AssignmentManager: Bulk assigning done for
>> hadoop-master,60020,1389882230619
>> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000]
>> master.AssignmentManager: Assigning 1 region(s) to
>> ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921
>> 2014-01-16 14:23:59,086 DEBUG [master:hadoop-master:60000]
>> zookeeper.ZKAssign: master:60000-0x1439b6fb8830000,
>> quorum=hadoop-master:2181, baseZNode=/hbase Async create of unassigned node
>> 127f07b410d994595c51728cbac8b19f with OFFLINE state
>> 2014-01-16 14:23:59,091 DEBUG [main-EventThread] master.OfflineCallback:
>> rs={127f07b410d994595c51728cbac8b19f state=OFFLINE, ts=1389882238927,
>> server=null},
>> server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921
>> 2014-01-16 14:23:59,093 DEBUG [main-EventThread]
>> master.OfflineCallback$ExistCallback: rs={127f07b410d994595c51728cbac8b19f
>> state=OFFLINE, ts=1389882238927, server=null},
>> server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921
>> 2014-01-16 14:23:59,098 INFO [master:hadoop-master:60000]
>> master.AssignmentManager:
>> ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921 unassigned
>> znodes=1 of total=1
>> 2014-01-16 14:23:59,098 INFO [master:hadoop-master:60000]
>> master.RegionStates: Transitioned {127f07b410d994595c51728cbac8b19f
>> state=OFFLINE, ts=1389882239086, server=null} to
>> {127f07b410d994595c51728cbac8b19f state=PENDING_OPEN, ts=1389882239098,
>> server=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389882231921}
>>
>>
>>
>> 2014/1/16 Samir Ahmic <[email protected]>
>>
>>> Hi Fernando,
>>>
>>> Check logs on RegionServers there should be explanation why you got
>>> NotServingRegionException.
>>> You said that you got error after 10 min of running script ? It could be
>>> that you have some resources issue, memory disk, cpu.
>>>
>>> Cheers
>>>
>>>
>>> On Thu, Jan 16, 2014 at 2:28 PM, Fernando Iwamoto - Plannej <
>>> [email protected]> wrote:
>>>
>>> > Sorry for duplicating the thread, I didn't subscribe to the hbase mail
>>> > list.
>>> >
>>> > Continuing from this thread:
>>> >
>>> >
>>> http://mail-archives.apache.org/mod_mbox/hbase-user/201401.mbox/%3CCAAmoe2sM_%3DH-w4k3RwN3UbyMv932g0CEUgwELST_0j9VvD4GcQ%40mail.gmail.com%3E
>>> >
>>> > The only error show me this:
>>> >
>>> > 2014-01-16 13:27:44,234 INFO [master:hadoop-master:60000]
>>> > catalog.CatalogTracker: Failed verification of hbase:meta,,1 at
>>> >
>>> address=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389876721606,
>>> > exception=org.apache.hadoop.hbase.NotServingRegionException:
>>> > org.apache.hadoop.hbase.NotServingRegionException: Region
>>> > hbase:meta,,1 is not online
>>> > at
>>> >
>>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2585)
>>> > at
>>> >
>>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3952)
>>> > at
>>> >
>>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionInfo(HRegionServer.java:3369)
>>> > at
>>> >
>>> org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:19789)
>>> > at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
>>> > at
>>> > org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
>>> >
>>>
>>
>>
>
