This is the log from
check-meta.rb run:
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client
environment:os.version=2.6.18-274.3.1.el5
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/hadoop
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/opt/msip/clients/CIQ-Performance/m2mDeployment/trunk.181-307704/hbase-0.90.1/bin
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=us01-ciqps1-name01.carrieriq.com:2181 sessionTimeout=490000
watcher=hconnection
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Opening socket connection to
server us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Socket connection established to
us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181, initiating session
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Session establishment complete on
server us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181, sessionid =
0x134aa18d2ef001f, negotiated timeout = 490000
12/01/04 19:08:05 DEBUG client.HConnectionManager$HConnectionImplementation:
Lookedup root region location,
connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7178b64b;
hsa=us01-ciqps1-grid04.carrieriq.com:60020
12/01/04 19:08:05 DEBUG client.HConnectionManager$HConnectionImplementation:
locateRegionInMeta parentTable=-ROOT-, metaLocation=address:
us01-ciqps1-grid04.carrieriq.com:60020, regioninfo: -ROOT-,,0.70236052,
attempt=0 of 20 failed; retrying after sleep of 8000 because:
org.apache.hadoop.hbase.NotServingRegionException: Region is not online:
-ROOT-,,0
at
org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2359)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1645)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
We got the issue before with one of our nodes (looks like hardware failure) and
I tried to stop HBase cluster using regular script.
It got stuck in the middle and I had to kill RSs manually.
Now I can not start the cluster - I am getting this : Region is not online:
-ROOT-,,0
What can be done in this situation to restore the cluster? I hate telling
people that their data will be lost (fortunately it is not in production).
Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: [email protected]
________________________________________
From: Andrew Purtell [[email protected]]
Sent: Wednesday, January 04, 2012 10:23 AM
To: [email protected]
Subject: Re: HBase Hackathon @ EBay
The 19th works for me.
Whatever the format.
Hearing what is going on with the Cassini project ops wise would be reason
enough to attend.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein (via
Tom White)
>________________________________
> From: Ted Yu <[email protected]>
>To: [email protected]
>Sent: Tuesday, January 3, 2012 3:29 PM
>Subject: HBase Hackathon @ EBay
>
>Hi,
>HBase 0.92 is about to be released.
>Todd Lipcon once asked how high our confidence was going through the cases
>in HBASE-4925 on HBase 0.92
>
>Well, let's find out the answer to Todd's question on Jan. 19th @ EBay :-)
>
>The theme for this Hackathon is on 0.92 stability.
>
>A meetup invitation would go out soon.
>
>Cheers
>
>
>
Confidentiality Notice: The information contained in this message, including
any attachments hereto, may be confidential and is intended to be read only by
the individual or entity to whom this message is addressed. If the reader of
this message is not the intended recipient or an agent or designee of the
intended recipient, please note that any review, use, disclosure or
distribution of this message or its attachments, in any form, is strictly
prohibited. If you have received this message in error, please immediately
notify the sender and/or [email protected] and delete or destroy any
copy of this message and its attachments.
