Re: base running JVM6 and application server running JVM7

2012-06-19 Thread Dave Revell
You're likely to get a better response if you post your error messages and example code that reproduces the problem. :) Best, Dave On Tue, Jun 19, 2012 at 12:27 AM, Ben Cuthbert bencuthb...@ymail.comwrote: All We have our application server running in Java 7 and hbase started and running on

Re: memstoreSizeMB=0

2012-06-13 Thread Dave Revell
Here's a good starting point: http://hbase.apache.org/book.html#store.memstore , I think you misunderstand what a memstore is. Good luck! -Dave On Wed, Jun 13, 2012 at 10:50 AM, ashdamle a...@medgle.com wrote: Hello. This is my first post here. I've setup hbase with 2 column families 2GB

Re: Occasional regionserver crashes following socket errors writing to HDFS

2012-05-25 Thread Dave Revell
Have you verified that your nodes are not swapping? This has caused serious issues for many people, including me. Swapping can occur even if you have lots of available memory, for complicated reasons. Best, Dave On Thu, May 24, 2012 at 4:39 PM, Stack st...@duboce.net wrote: On Thu, May 24,

Re: HBase and MapReduce

2012-05-23 Thread Dave Revell
1. HBase guarantees data locality of store files and Regionserver only if it stays up for long. If there are too many region movements or the server has been recycled recently, there is a high probability that store file blocks are not local to the region server. But the getSplits command

Re: Restrictions during compactions

2012-05-23 Thread Dave Revell
On Wed, May 23, 2012 at 6:15 AM, Takahiko Kawasaki takahiko.kawas...@jibemobile.jp wrote: Hello, I'm a newbie and wondering whether or not there is any restriction during HBase minor/major compactions. I read the online document but could not find any explicit mention about restrictions.

Re: EndPoint Coprocessor could be dealocked?

2012-05-16 Thread Dave Revell
Many people will probably try to use coprocessors as a way of implementing app logic on top of HBase without the headaches of writing a daemon. Sometimes client-side approaches are inadvisable; for example, there may be several client languages/runtimes and the app logic should not be

Re: MR job for creating splits

2012-05-14 Thread Dave Revell
Re: your question #1, you won't be able to pass information from mappers to reducers by using static variables. Since map tasks run in different JVM instances than reduce tasks, the value of the static variable will never be sent from the mapper JVM to the reducer JVM. It might work in standalone

Re: Manager Zookeeper Client Connections

2012-05-11 Thread Dave Revell
Hi Narenda, There are some shared static data structures inside the HBase client that are keyed on Configuration objects. Do you reuse the same Configuration object everytime you instantiate an HTable? By reusing the same Configuration objects you may cause ZooKeeper connections to be reused.

Re: Occasional regionserver crashes following socket errors writing to HDFS

2012-05-10 Thread Dave Revell
to sort your input in to HBase and if that's really a good thing? Oops!... :-) On May 10, 2012, at 12:31 PM, Dave Revell wrote: This you don't need a reducer conversation is distracting from the real problem and is false. Many mapreduce algorithms require a reduce phase (e.g. sorting

Re: Storing extremely large size file

2012-04-17 Thread Dave Revell
I think this is a popular topic that might deserve a section in The Book. By this topic I mean storing big binary chunks. -Dave On Tue, Apr 17, 2012 at 11:07 AM, kim young ill khi...@googlemail.comwrote: i plan to move some data from relational-db to hbase, most of them are binary with some

Re: merge regions?

2011-09-09 Thread Dave Revell
Bam! http://ofps.oreilly.com/titles/9781449396107/performance.html , search for merging regions Zamo! https://issues.apache.org/jira/browse/HBASE-1621 Cheers, Dave On Fri, Sep 9, 2011 at 9:54 AM, Geoff Hendrey ghend...@decarta.com wrote: Hi - I think we're in a situation where we have too