Hi Laxmi,

It didnt come me. I understand, your RegionServer is gone away. Because of this problem is your Hbase heap size or xceivers count is not enough. I had same issue. I set up my xceivers count. I am not sure what it will be count.But you should check your heaps size usage. If it is enough you can set up your property. This article[1] very good about this property.

[1] http://blog.cloudera.com/blog/2012/03/hbase-hadoop-xceivers/

Talat

17-10-2013 22:20 tarihinde, A Laxmi yazd?:
Hi Talat,

I hope all is well. Could you please advise me on this issue?

Thanks for your help!

---------- Forwarded message ----------
From: *A Laxmi* <[email protected] <mailto:[email protected]>>
Date: Tue, Oct 15, 2013 at 12:07 PM
Subject: HBase Pseudo mode - RegionServer disconnects after some time
To: [email protected] <mailto:[email protected]>


Hi -

Please find the below log of HBase-master. I have tried all sorts of fixes mentioned in various threads yet I could not overcome this issue. I made sure I dont have 127.0.1.1 in /etc/hosts file. I pinged my localhost (hostname) which gives back the actual IP and not 127.0.0.1 using ping -c 1 localhost. I have 'localhost' in my /etc/hostname and actual IP address mapped to localhost.localdomain and localhost as alias - something like

/etc/hosts -

192.***.*.*** localhost.localdomain localhost

/etc/hostname -

localhost

I am using *Hadoop 0.20.205.0 and HBase 0.90.6 in Pseudo mode* for storing crawled data from a crawler - Apache Nutch 2.2.1. I can start Hadoop and HBase and when I do jps it shows all good, then after that when I start Nutch crawl after about 40mins of crawling or so, I can see Nutch hanging up while in about 4th iteration of parsing and at the same time when I do jps in HBase, I can see everything except HRegionServer. Below is the log.

I tried all possible ways but couldn't overcome this issue. I really need someone from HBase list to help me with this issue.


2013-10-15 02:02:08,285 DEBUG org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Pushed=56 entries from hdfs://localhost:8020/hbase/.logs/127.0.0.1 <http://127.0.0.1>,60020,1381814216471/127.0.0.1 <http://127.0.0.1>%3A60020.1381816329235 2013-10-15 02:02:08,285 DEBUG org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Splitting hlog 28 of 29: hdfs://localhost:8020/hbase/.logs/127.0.0.1 <http://127.0.0.1>,60020,1381814216471/127.0.0.1 <http://127.0.0.1>%3A60020.1381816367672, length=64818440 2013-10-15 02:02:08,285 WARN org.apache.hadoop.hbase.util.FSUtils: Running on HDFS without append enabled may result in data loss 2013-10-15 02:02:08,554 DEBUG org.apache.*hadoop.hbase.master.HMaster: Not running balancer because processing dead regionserver(s): [127.0.0.1,60020*,1381814216471] 2013-10-15 02:02:08,556 INFO org.apache.hadoop.hbase.catalo*g.CatalogTracker: Failed verification of .META.,,1 at address=127.0.0.1:60020 <http://127.0.0.1:60020>; java.net.ConnectException: Connection refused* 2013-10-15 02:02:08,559 INFO org.apache.hadoop.hbase.catalog.*CatalogTracker: Current cached META location is not valid*, resetting 2013-10-15 02:02:08,601 WARN org.apache.hadoop.*hbase.master.CatalogJanitor: Failed scan of catalog table org.apache.hadoop.hbase.NotAllMetaRegionsOnlineException: Timed out (2147483647ms)* at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMeta(CatalogTracker.java:390) at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMetaServerConnectionDefault(CatalogTracker.java:422) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:255) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:237) at org.apache.hadoop.hbase.master.CatalogJanitor.scan(CatalogJanitor.java:120) at org.apache.hadoop.hbase.master.CatalogJanitor.chore(CatalogJanitor.java:88)
        at org.apache.hadoop.hbase.Chore.run(Chore.java:66)
2013-10-15 02:02:08,842 INFO org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter: syncFs -- HDFS-200 -- not available, dfs.support.append=false 2013-10-15 02:02:08,842 DEBUG org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Creating writer path=hdfs://localhost:8020/hbase/1_webpage/853ef78be7c0853208e865a9ff13d5fb/recovered.edits/0000000000000001556.temp region=853ef78be7c0853208e865a9ff13d5fb 2013-10-15 02:02:09,443 DEBUG org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Pushed=39 entries from hdfs://localhost:8020/hbase/.logs/127.0.0.1 <http://127.0.0.1>,60020,1381814216471/127.0.0.1 <http://127.0.0.1>%3A60020.1381816367672 2013-10-15 02:02:09,444 DEBUG org.apache.hadoop.hbase.regionserver.wal.HLogSplitter: Splitting hlog 29 of 29: hdfs://localhost:8020/hbase/.logs/127.0.0.1 <http://127.0.0.1>,60020,1381814216471/127.0.0.1 <http://127.0.0.1>%3A60020.1381816657239, length=0

Thanks for your help!



Reply via email to