Re: High OS Load Numbers when idle

2010-08-18 Thread Cosmin Lehene
George, Did you try to monitor the CPU in real-time to see any patterns? Does it do any CPU spikes? Even so, the load averages should be matched against the number of cores/hyper threads. How many cores do you see in top? (I personally prefer htop to get a cluster overview in realtime). If

adding compression to a table

2010-08-18 Thread Justin Cohen
Can I add record level compression to a preexisting table? Will old rows be compressed or only new rows? For example, if I use the hbase shell and disable, alter {...COMPRESSION = 'gz'}, enable Do I need to run a compaction as well? Or do I need to create a new table? -justin

Re: Classpath problem when running Java scanner

2010-08-18 Thread Jean-Daniel Cryans
It looks like the hbase jar isn't on your classpath, else it would find HBaseConfiguration. J-D On Wed, Aug 18, 2010 at 3:08 AM, Wojciech Langiewicz wlangiew...@gmail.com wrote: Hello, I tried to write custom HBase scanner in Java. It compiles successfully, but I have problem with running it.

Re: Classpath problem when running Java scanner

2010-08-18 Thread Jean-Daniel Cryans
If it really is, can you access other HBase classes like HTable or HBaseAdmin? J-D On Wed, Aug 18, 2010 at 6:56 AM, Wojciech Langiewicz wlangiew...@gmail.com wrote: Of course this looks like HBase jar is not on the classpath, but it is - my source file compiles with the same classpath

Re: adding compression to a table

2010-08-18 Thread Jean-Daniel Cryans
Justin, You don't need to explicitly call a compaction, conversion will be done over time. But if you do want to have them converted right away, call a major_compaction. J-D On Wed, Aug 18, 2010 at 6:35 AM, Justin Cohen justin.co...@teamaol.com wrote: Can I add record level compression to a

Re: Classpath problem when running Java scanner

2010-08-18 Thread Wojciech Langiewicz
No, I can't. But I have successfully run this code inside eclipse, and I don't know what is wrong. This is my classpath for this case: /usr/lib/hbase/*:/usr/lib/hadoop/*:. all jars are there since installation, what should I do? W dniu 18.08.2010 16:05, Jean-Daniel Cryans pisze: If it really

META table recovery

2010-08-18 Thread Luke Forehand
Hello, We are trying to recover a corrupt META table over here. The region server holding the META table went down, and since then our table scans cannot complete because of this error which happens consistently on the same region: org.apache.hadoop.hbase.client.RetriesExhaustedException:

Re: Classpath problem when running Java scanner

2010-08-18 Thread Jean-Daniel Cryans
See http://stackoverflow.com/questions/219585/setting-multiple-jars-in-java-classpath J-D On Wed, Aug 18, 2010 at 7:50 AM, Wojciech Langiewicz wlangiew...@gmail.com wrote: No, I can't. But I have successfully run this code inside eclipse, and I don't know what is wrong. This is my classpath

Re: META table recovery

2010-08-18 Thread Luke Forehand
Luke Forehand luke.foreh...@... writes: Hello, We are trying to recover a corrupt META table over here. The region server holding the META table went down, and since then our table scans cannot complete because of this error which happens consistently on the same region: I believe

Re: META table recovery

2010-08-18 Thread Dan Harvey
We've fixed issues with the META being out of sync with the region severs and I've put what we did in this post :- http://www.mail-archive.com/user@hbase.apache.org/msg00187.html Hope that helps! On 18 August 2010 17:13, Luke Forehand luke.foreh...@networkedinsights.comwrote: Luke Forehand

Re: major differences with Cassandra

2010-08-18 Thread Ryan Rawson
Thanks for that bit of feedback. Right now stumbleupon operates a cluster that handles 20,000 requests a second 24/7 for about a year now. Even though we have hbase developers I don't think there is any special sauce and anyone could replicate the successes we've had. Mozilla is one candidate.

Re: major differences with Cassandra

2010-08-18 Thread Edward Capriolo
On Wed, Aug 18, 2010 at 2:17 PM, Ryan Rawson ryano...@gmail.com wrote: Thanks for that bit of feedback. Right now stumbleupon operates a cluster that handles 20,000 requests a second 24/7 for about a year now. Even though we have hbase developers I don't think there is any special sauce and

Implementation of Star Schema/Dimensional Model in HBase

2010-08-18 Thread Shuja Rehman
Hi I am new to Hbase and wondering if anybody share his thoughts about the star schema implementation in Hbase. I have to process terabytes of data daily and then generate reports and analytical views from them. So I am planning to build data warehouse solution using HBase. If anybody has done

Stream interface to cell Data? Was - Re: Avoiding OutOfMemory Java heap space in region servers

2010-08-18 Thread Stuart Smith
Hello, I was wondering if there are any plans for a stream interface to Cell data. I saw this: or they are using large client write buffers so big payloads are being passed to the server in each RPC request. Our RPC is not streaming. So I'm guessing there's not one now (and I