ok so I used to run hbase 0.94.4 before i realized that i had to
downgrade. my zookeeper hbase directory had the files from that version
before. once I cleaned the zookeeper directory using zkCli, master node
came up. and after that i checked and all the data directories on the
cluster are empty (there was no data in hbase). but now when i
start-hbase the master node log file just keeps saying this :
2013-02-20 15:45:39,518 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing
plan for region -ROOT-,,0.70236052; plan=hri=-ROOT-,,0.70236052, src=,
dest=d1r1n19.prod.plutoz.com,60020,1361403838824
2013-02-20 15:45:39,518 INFO
org.apache.hadoop.hbase.master.AssignmentManager: Assigning region
-ROOT-,,0.70236052 to d1r1n19.prod.plutoz.com,60020,1361403838824
2013-02-20 15:45:39,524 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_OPENING,
server=d1r1n19.prod.plutoz.com,60020,1361403838824, region=70236052/-ROOT-
2013-02-20 15:45:39,532 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_FAILED_OPEN,
server=d1r1n19.prod.plutoz.com,60020,1361403838824, region=70236052/-ROOT-
2013-02-20 15:45:39,532 DEBUG
org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling
CLOSED event for 70236052
2013-02-20 15:45:39,532 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
was=-ROOT-,,0.70236052 state=CLOSED, ts=1361403939527
2013-02-20 15:45:39,532 DEBUG
org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13cc3f3bcdc00b9 Creating (or updating) unassigned node
for 70236052 with OFFLINE state
again and again until i kill the java process.
any idea what this means ?
On 02/20/2013 03:16 PM, kaveh minooie wrote:
I can't upgrade. I need hbase for nutch and it currently only supports
0.90.x ( i am using 0.90.6)
the zookeeper log is:
2013-02-20 14:25:59,035 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] -
Accepted socket connection from /10.0.0.66:49971
2013-02-20 14:25:59,040 [myid:] - WARN
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@793] -
Connection request from old client /10.0.0.66:49971; will be dropped if
server
is in r-o mode
2013-02-20 14:25:59,040 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@839] - Client
attempting to establish new session at /10.0.0.66:49971
2013-02-20 14:25:59,054 [myid:] - INFO
[SyncThread:0:ZooKeeperServer@595] - Established session
0x13cc3f3bcdc0094 with negotiated timeout 40000 for client /10.0.0.66:49971
2013-02-20 14:25:59,554 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] -
Accepted socket connection from /10.0.0.66:49984
2013-02-20 14:25:59,554 [myid:] - WARN
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@793] -
Connection request from old client /10.0.0.66:49984; will be dropped if
server is in r-o mode
2013-02-20 14:25:59,554 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@839] - Client
attempting to establish new session at /10.0.0.66:49984
2013-02-20 14:25:59,556 [myid:] - INFO
[SyncThread:0:ZooKeeperServer@595] - Established session
0x13cc3f3bcdc0095 with negotiated timeout 40000 for client /10.0.0.66:49984
2013-02-20 14:25:59,598 [myid:] - INFO [ProcessThread(sid:0
cport:-1)::PrepRequestProcessor@476] - Processed session termination for
sessionid: 0x13cc3f3bcdc0095
2013-02-20 14:25:59,599 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1001] - Closed
socket connection for client /10.0.0.66:49984 which had sessionid
0x13cc3f3bcdc0095
2013-02-20 14:25:59,600 [myid:] - INFO [ProcessThread(sid:0
cport:-1)::PrepRequestProcessor@476] - Processed session termination for
sessionid: 0x13cc3f3bcdc0094
2013-02-20 14:25:59,601 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1001] - Closed
socket connection for client /10.0.0.66:49971 which had sessionid
0x13cc3f3bcdc0094
2013-02-20 14:26:00,218 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] -
Accepted socket connection from /10.0.0.13:48286
2013-02-20 14:26:00,220 [myid:] - WARN
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@793] -
Connection request from old client /10.0.0.13:48286; will be dropped if
server is in r-o mode
2013-02-20 14:26:00,221 [myid:] - INFO
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@839] - Client
attempting to establish new session at /10.0.0.13:48286
2013-02-20 14:26:00,222 [myid:] - INFO
[SyncThread:0:ZooKeeperServer@595] - Established session
0x13cc3f3bcdc0096 with negotiated timeout 40000 for client /10.0.0.13:48286
10.0.0.13 is one of the regionservers.
thanks,
On 02/20/2013 02:48 PM, Ted Yu wrote:
The error seemed to be related to zookeeper.
Can you post log from zk1 around 14:25:59 ?
BTW stable release is 0.94.5, can you upgrade ?
Cheers
On Wed, Feb 20, 2013 at 2:46 PM, kaveh minooie <[email protected]> wrote:
Hello everyone
I was wondering if any one has tried to run hbase 0.90.x on a hadoop
1.1.1 cluster? I have replaced a few of the jar files with the ones that
came with the packages that I am using in my cluster:
commons-configuration-1.6.jar
hadoop-core-1.1.1.jar
slf4j-api-1.6.1.jar
slf4j-log4j12-1.6.1.jar
zookeeper-3.4.5.jar (tried with both 3.3.2 and 3.4.5. same result)
after these changes I am able to run the region servers but the master
node still crashes when I try to start it:
2013-02-20 14:25:59,554 INFO org.apache.zookeeper.**ClientCnxn: Socket
connection established to zk1/10.0.0.66:2181, initiating session
2013-02-20 14:25:59,556 INFO org.apache.zookeeper.**ClientCnxn: Session
establishment complete on server zk1/10.0.0.66:2181, sessionid =
0x13cc3f3bcdc0095, negotiated timeout = 40000
2013-02-20 14:25:59,569 DEBUG
org.apache.hadoop.hbase.**catalog.CatalogTracker:
Starting catalog tracker org.apache.hadoop.hbase.**
catalog.CatalogTracker@**151205ab
2013-02-20 14:25:59,587 FATAL org.apache.hadoop.hbase.**master.HMaster:
Unhandled exception. Starting shutdown.
java.lang.**IllegalArgumentException: �^@^@^@^\[email protected].**
plutoz.comENABLED
at org.apache.hadoop.hbase.**zookeeper.ZKTable.**
getTableState(ZKTable.java:**119)
at org.apache.hadoop.hbase.**zookeeper.ZKTable.**
populateTableStates(ZKTable.**java:94)
at org.apache.hadoop.hbase.**zookeeper.ZKTable.<init>(**
ZKTable.java:79)
at org.apache.hadoop.hbase.**master.AssignmentManager.<**
init>(AssignmentManager.java:**171)
at org.apache.hadoop.hbase.**master.HMaster.**
finishInitialization(HMaster.**java:353)
at org.apache.hadoop.hbase.**master.HMaster.run(HMaster.**
java:281)
2013-02-20 14:25:59,590 INFO org.apache.hadoop.hbase.**master.HMaster:
Aborting
2013-02-20 14:25:59,590 DEBUG org.apache.hadoop.hbase.**master.HMaster:
Stopping service threads
2013-02-20 14:25:59,590 INFO org.apache.hadoop.ipc.**HBaseServer:
Stopping server on 60000
2013-02-20 14:25:59,591 INFO org.apache.hadoop.ipc.**HBaseServer: IPC
Server handler 0 on 60000: exiting
does anyone have any idea or suggestion about what I can do to be
able to
run a hbase 0.90.x on hadoop 1.1.1?
thanks,
Kaveh Minooie
www.plutoz.com
--
Kaveh Minooie
www.plutoz.com