Re: How to install Snappy?

2012-12-02 Thread surfer
hope it helps. this is what I do on apache hadoop 1.0.x and hbase 0.92.y: in hbase-site.xml add: hbase.regionserver.codecs snappy copy that file into the hadoop conf directory. in hbase-env.sh: export HBASE_LIBRARY_PATH=/pathtoyourhadoop/lib/native/Linux-amd64-64 ( In hbase-env.sh I set also

Re: How to install Snappy?

2012-12-02 Thread Arati Patro
Hey, Which version of Hadoop are you using? I wasn't able to enable snappy compression with hadoop 1.0.1 had to move to 1.0.3. Arati

Re: Put while move or split

2012-12-02 Thread ramkrishna vasudevan
Hi Jean Incase of Puts and Scans if the split is in progress it will retry. Suppose before the client gets to know about the split, still if the put is directed with the parent region row key, internally HBase directs it to the correct daughter region. But i am not clear in what you mean by Regio

Re: Put while move or split

2012-12-02 Thread Jean-Marc Spaggiari
Ok. so if on the client side I'm "simply" using Puts, scans and gets fron the HTableInterface, I don't have to worry about that since it will retry. But I still should consider catching exceptions when regions are not available because the region server is down for less than 3 minutes, right? Tha

Re: Coprocessor slow down problem!

2012-12-02 Thread Anoop John
Hi You can take thread dumps? -Anoop- On Mon, Dec 3, 2012 at 1:29 AM, yonghu wrote: > Hi Anoop, > > Can you give me a more detailed information about how can I take a > look at RS threads doing? > > Thanks! > > Yong > > On Sat, Dec 1, 2012 at 9:23 AM, ramkrishna vasudevan > wrote: > >

Re: How to install Snappy?

2012-12-02 Thread Håvard Wahl Kongsgård
are you using cloudera CD3, if so you only need to install hadoop-0.20-native On Sun, Dec 2, 2012 at 12:57 AM, Jean-Marc Spaggiari wrote: > Sorry, I forgot to paste few maybe useful lines. I have the lib in > /usr/local/lib copied properly, and I have the HBASE_LIBRARY_PATH set > correctly. Do I

Re: How to install Snappy?

2012-12-02 Thread a...@hsk.hk
Hi, In $HBASE_HOME/conf/hbase-env.sh, have you added the following line? (assume that you are using 64-bit) export HBASE_LIBRARY_PATH=/usr/lib/hadoop/lib/native/Linux-amd64-64 If yes, I guess you should try to restart HBase. Thanks ac On 2 Dec 2012, at 7:57 AM, Jean-Marc Spaggiari wrote: > S

Re: Put while move or split

2012-12-02 Thread Nicolas Liochon
It's not accessible, but it's more or less transparent (latency impact aside) for the end user: the hbase client will retry the operation. On Sun, Dec 2, 2012 at 11:10 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > ?

Put while move or split

2012-12-02 Thread Jean-Marc Spaggiari
Hi, When a region is moving or splitting, is it still accessible? Or the region is offline until the operation ends? Thanks, JM

Re: Coprocessor slow down problem!

2012-12-02 Thread yonghu
Hi Anoop, Can you give me a more detailed information about how can I take a look at RS threads doing? Thanks! Yong On Sat, Dec 1, 2012 at 9:23 AM, ramkrishna vasudevan wrote: > Ok...fine...Ya seeing what is happening in postPut should give an idea. > > Regards > Ram > > On Sat, Dec 1, 2012 at

Meaure server time of Get/Scan - through RPC logging?

2012-12-02 Thread Wei Tan
Hi I am using YCSB to measure the performance of some complex Get/Scan, i.e., with some filters. I found that I got weird high latency from YCSB client but both HBase server and YCSB client are NOT saturated (in terms of network, I/O, CPU). So I want to measure the server time a single Get/Scan

Re: How to install Snappy?

2012-12-02 Thread Jean-Marc Spaggiari
So. I spent few hours on that yesterday with no luck. Here is what I did: - Install the google tar, untared, configured, maked and installed it. - Copied the .so files all over my fs in the os lib dir, HBase/lib/native and subdirs, Hadoop/lib/native and subdirs. - Installed all debian packages wit