Hi,
When I run a program including some basic operations on HBase tables for
several hours,Hbase stops.My hadoop version is 0.20.203.0 and Hbase
version is 0.90.4.
The Hbase log is as follows:
2012-04-25 00:03:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335282353563,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335282353505}
2012-04-25 00:08:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335282353563,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335282353505}
2012-04-25 00:13:44,191 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335282353563,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335282353505}
2012-04-25 00:15:55,056 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: .META.,,1.1028785192 state=OFFLINE, ts=1335282353563
2012-04-25 00:15:55,057 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning .META.,,1.1028785192 to a random server
2012-04-25 00:15:55,057 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: -ROOT-,,0.70236052 state=OFFLINE, ts=1335282353505
2012-04-25 00:15:55,057 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning -ROOT-,,0.70236052 to a random server
2012-04-25 00:15:55,057 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=.META.,,1.1028785192 state=OFFLINE, ts=1335282353563
2012-04-25 00:15:55,058 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=-ROOT-,,0.70236052 state=OFFLINE, ts=1335282353505
2012-04-25 00:18:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:23:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:28:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:33:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:38:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:43:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078}
2012-04-25 00:45:55,073 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: .META.,,1.1028785192 state=OFFLINE, ts=1335284155057
2012-04-25 00:45:55,074 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning .META.,,1.1028785192 to a random server
2012-04-25 00:45:55,074 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=.META.,,1.1028785192 state=OFFLINE, ts=1335284155057
2012-04-25 00:46:05,073 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: -ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078
2012-04-25 00:46:05,073 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning -ROOT-,,0.70236052 to a random server
2012-04-25 00:46:05,073 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=-ROOT-,,0.70236052 state=OFFLINE, ts=1335284155078
2012-04-25 00:48:44,191 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 00:53:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 00:58:44,191 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 01:03:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 01:08:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 01:13:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073}
2012-04-25 01:15:55,094 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: .META.,,1.1028785192 state=OFFLINE, ts=1335285955074
2012-04-25 01:15:55,094 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning .META.,,1.1028785192 to a random server
2012-04-25 01:15:55,094 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=.META.,,1.1028785192 state=OFFLINE, ts=1335285955074
2012-04-25 01:16:05,093 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: -ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073
2012-04-25 01:16:05,093 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Region has been OFFLINE
for too long, reassigning -ROOT-,,0.70236052 to a random server
2012-04-25 01:16:05,093 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=-ROOT-,,0.70236052 state=OFFLINE, ts=1335285965073
2012-04-25 01:18:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:23:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:28:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:33:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:38:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:43:44,191 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2 region(s) in transition:
{1028785192=.META.,,1.1028785192 state=OFFLINE, ts=1335287755094,
70236052=-ROOT-,,0.70236052 state=OFFLINE, ts=1335287765093}
2012-04-25 01:45:55,114 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition
timed out: .META.,,1.1028785192 state=OFFLINE, ts=1335287755094
When I was asked about this I had no answer about why it happened and how
to resolve it .
Hopefully you can bring light into this! Thank you!
Kind regards,
wen yang
