Yes, it is normal and expected to get some NSREs if your regions are splitting or there is rebalancing going on.
They should not fail the task unless for some reason the client is never able to locate the region. If this is the case, something is wrong with the cluster. JG > -----Original Message----- > From: Hari Sreekumar [mailto:[email protected]] > Sent: Monday, November 08, 2010 8:26 PM > To: [email protected] > Subject: Re: Hbase insertion process cause to region server down. > > Hi Jonathan, > > I have faced the exact same issue as Oleg and it seems to > happen randomly. Sometimes I get this exception and the task fails, > sometimes I don't and it succeeds. Do you mean that this is normal > behavior? > > hari > > On Tue, Nov 9, 2010 at 12:25 AM, Jonathan Gray <[email protected]> > wrote: > > > NSRE is normal, this happens when regions move around and your client > needs > > to update the location. > > > > That seems like an awful lot of mappers/reducers on a 5 server / dual > core > > setup... You have only 2 cores per server but you have a DataNode, > > RegionServer, and 4 map tasks and 3 reduce tasks? That may be over > > extending things a bit. > > > > JG > > > > > -----Original Message----- > > > From: Oleg Ruchovets [mailto:[email protected]] > > > Sent: Monday, November 08, 2010 7:52 AM > > > To: [email protected] > > > Subject: Hbase insertion process cause to region server down. > > > > > > Hi , > > > > > > I run map/reduce job which from reducers writes to hbase. I have to > > > write > > > 8-9 million raws. > > > > > > My environment: > > > 5 servers dual core , 8G ram. > > > HDFS -- 9TB > > > > > > hadoop has 1000 heap_size , > > > hbase has 2000 heap_size > > > zookeeper has 1000 heap_size > > > 20 map / 16 reducers while running the job > > > > > > Allmost all the time get such exception > > > > > > org.apache.hadoop.hbase.NotServingRegionException: > > > org.apache.hadoop.hbase.NotServingRegionException: Region > URLs_sanity, > > > 20101106_www.homemade-chinese-soups.com/conch- > soup.html,1289163460337 > > > closed > > > at > > > > org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java > > > :1607) > > > at > > > > org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1671) > > > at > > > org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:2380) > > > at > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.ja > > > va:1731) > > > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source) > > > at > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > > > rImpl.java:25) > > > at java.lang.reflect.Method.invoke(Method.java:597) > > > at > > > org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:657) > > > at > > > > org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:91 > > > 5) > > > > > > > > > > > > Thanks in advance. > >
