Hi Ted - You should benefit from using this link [0] to follow Nutch and HBase integration. Link [1] would be the one you can download a production release version of Nutch 2.2.1 that has HBase dependency.
Link [0] http://wiki.apache.org/nutch/Nutch2Tutorial Link [1] http://www.eng.lsu.edu/mirrors/apache/nutch/2.2.1/ All the best! On Fri, Oct 25, 2013 at 7:33 PM, Ted Yu <[email protected]> wrote: > I cloned http://svn.apache.org/repos/asf/nutch/trunk but couldn't find > dependency on HBase > > The following command turned up nothing: > $ find . -name '*.java' -exec grep hbase {} \; -print > > Laxmi: > Mind telling me what I was missing ? > > > > On Sun, Oct 20, 2013 at 6:01 PM, A Laxmi <[email protected]> wrote: > > > Thanks Jean! But the problem is I am using a crawler "Apache Nutch" that > > supports a HBase version 0.90.6 so I have no option than to restrict to > > 0.90.6 version. :( > > > > I am also getting an out of memory error: heap space while using HBase. I > > am using default 1GB heap setting in hbase-en.sh. I have 6GB RAM. Please > > advise. > > > > I have set - > > > > *hbase.client.scanner.caching* to 1. * > > hbase.client.scanner.timeout.period *to* 120000 > > hbase.regionserver.handler.count* to 10. * > > hbase.rpc.timeout *to 900000 > > *hbase.regionserver.lease.period* to 900000 > > *hbase.client.write.buffer* to 2097152 > > > > Please advise what can be done to avoid out of memory error: heap space. > > > > > > > > On Sun, Oct 20, 2013 at 8:49 PM, Jean-Marc Spaggiari < > > [email protected]> wrote: > > > > > Also, Laxmi, if possible, I will highly recommend you to migrate to a > > more > > > recent version. 0.90 is VERY old... > > > > > > > > > 2013/10/20 lars hofhansl <[email protected]> > > > > > > > In any version < 0.96 it is 1. So in 0.90.6 it would be 1. > > > > > > > > -- Lars > > > > > > > > > > > > > > > > ----- Original Message ----- > > > > From: A Laxmi <[email protected]> > > > > To: [email protected] > > > > Cc: > > > > Sent: Sunday, October 20, 2013 11:17 AM > > > > Subject: 'hbase.client.scanner.caching' default value for HBase > 0.90.6? > > > > > > > > Hi, > > > > > > > > What is the default value of '*hbase.client.scanner.caching*' for > > *HBase > > > > 0.90.6* version in particular? Is it 1 or 100? > > > > > > > > Thanks > > > > > > > > > > > > > >
