1/2 - 2/3 of your available RAM should be a good place to start.
________________________________ From: A Laxmi <[email protected]> To: [email protected] Sent: Sunday, October 20, 2013 8:01 PM Subject: Re: 'hbase.client.scanner.caching' default value for HBase 0.90.6? Thanks Vladimar! I am using 6GB RAM so I have set 1GB for HBase. Please suggest an appropriate heap size for HBase for a 6GB RAM. The reason I am using older version of HBase is because the web crawler I am using Apache Nutch supports only 0.90.x version of HBase as a backend to store crawled data. On Sun, Oct 20, 2013 at 10:37 PM, Vladimir Rodionov <[email protected] > wrote: > HBase bible (book) have answers on *almost* all questions (1GB default > heap is too low for many applications - that is why you see OOME). > HBase book: > http://hbase.apache.org/book.html > > +1 on version upgrade. > > Is there any particular reason for so old version of HBase? The current is > 0.94.12. > > Best regards, > Vladimir Rodionov > Principal Platform Engineer > Carrier IQ, www.carrieriq.com > e-mail: [email protected] > > ________________________________________ > From: A Laxmi [[email protected]] > Sent: Sunday, October 20, 2013 6:01 PM > To: [email protected] > Subject: Re: 'hbase.client.scanner.caching' default value for HBase 0.90.6? > > Thanks Jean! But the problem is I am using a crawler "Apache Nutch" that > supports a HBase version 0.90.6 so I have no option than to restrict to > 0.90.6 version. :( > > I am also getting an out of memory error: heap space while using HBase. I > am using default 1GB heap setting in hbase-en.sh. I have 6GB RAM. Please > advise. > > I have set - > > *hbase.client.scanner.caching* to 1. * > hbase.client.scanner.timeout.period *to* 120000 > hbase.regionserver.handler.count* to 10. * > hbase.rpc.timeout *to 900000 > *hbase.regionserver.lease.period* to 900000 > *hbase.client.write.buffer* to 2097152 > > Please advise what can be done to avoid out of memory error: heap space. > > > > On Sun, Oct 20, 2013 at 8:49 PM, Jean-Marc Spaggiari < > [email protected]> wrote: > > > Also, Laxmi, if possible, I will highly recommend you to migrate to a > more > > recent version. 0.90 is VERY old... > > > > > > 2013/10/20 lars hofhansl <[email protected]> > > > > > In any version < 0.96 it is 1. So in 0.90.6 it would be 1. > > > > > > -- Lars > > > > > > > > > > > > ----- Original Message ----- > > > From: A Laxmi <[email protected]> > > > To: [email protected] > > > Cc: > > > Sent: Sunday, October 20, 2013 11:17 AM > > > Subject: 'hbase.client.scanner.caching' default value for HBase 0.90.6? > > > > > > Hi, > > > > > > What is the default value of '*hbase.client.scanner.caching*' for > *HBase > > > 0.90.6* version in particular? Is it 1 or 100? > > > > > > Thanks > > > > > > > > > > Confidentiality Notice: The information contained in this message, > including any attachments hereto, may be confidential and is intended to be > read only by the individual or entity to whom this message is addressed. If > the reader of this message is not the intended recipient or an agent or > designee of the intended recipient, please note that any review, use, > disclosure or distribution of this message or its attachments, in any form, > is strictly prohibited. If you have received this message in error, please > immediately notify the sender and/or [email protected] and > delete or destroy any copy of this message and its attachments. >
