hmaster and regionserver died

2012-10-13 Thread Xiang Hua
Hi, the HMaster died as well as regionservers, below is hmaster's log. could you please find what's problem? 2012-10-12 00:14:19,444 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to bj-ecsxhm4f3I-r3-5-r810-2-hbase-stor-3/ 10.20.16.34:2181, initiating session 2012-10-12

is it possible to control physical deletion of data in hbase?

2012-10-13 Thread Richard Tang
Hi, I want to manually control the number of versions of data physically stored in hbase. I am aware that physically deleting a record in hbase occurs only in major compaction (linkhttp://hadoop-hbase.blogspot.com/2011/12/deletion-in-hbase.html), and want to know if it's possible to physically

Re: more regionservers does not improve performance

2012-10-13 Thread Jonathan Bishop
Suraj, Yes, things seem to slow down, but this is a noisy cluster with other jobs running so it is hard to tell. Certainly, I did see speed ups when going from 1 to 2, and 2 to 4 regionservers. Just no change, or even a slowdown when going from 4 to 8 regionservers. What I am most concerned

Re: more regionservers does not improve performance

2012-10-13 Thread Jonathan Bishop
Suraj, I bumped my regionservers all the way up to 32g from 8g. They are running on 64g and 128g machines on our cluster. Unfortunately, the machines all have various states of loading (usually high) from other users. In ganglia I do not see any swapping, but that has been known to happen from

Re: is it possible to control physical deletion of data in hbase?

2012-10-13 Thread Stack
On Sat, Oct 13, 2012 at 6:27 AM, Richard Tang tristartom.t...@gmail.com wrote: Hi, I want to manually control the number of versions of data physically stored in hbase. I am aware that physically deleting a record in hbase occurs only in major compaction

Re: Problem with Rest Java Client

2012-10-13 Thread Erman Pattuk
This link was very helpful. Thank you all guys. Erman On 10/12/2012 4:45 PM, Jerry Lam wrote: Hi Erman: I think this post summed up very well about deletion in hbase ( http://hadoop-hbase.blogspot.ca/2011/12/deletion-in-hbase.html) Please have a look. If you need to delete a specific

Re: Remove the row in MR job?

2012-10-13 Thread Jean-Marc Spaggiari
I think I get the idea. I can't do it like that because Job1 might try to access the table as the same time as Job2 is trying to rename it, or other same kind off issues, but I will work on something similar. Thanks, I will start another thread for another delete question I have ;) JM

Delete by timestamp?

2012-10-13 Thread Jean-Marc Spaggiari
Hi, Is there a way to delete all rows older than a certain date? In the delete object we can specify a timestamp but we have to specify a row too. I can still do a MR job and delete all row older than the given date, but is there another option? Thanks, JM

Re: setAutoFlush in HTableDescriptor

2012-10-13 Thread Michael Segel
Not really a good idea. JDC hit the nail on the head. You want to handle the setting on the HTable instance and not on the pool. Just saying... On Oct 10, 2012, at 3:09 AM, Jeroen Hoek jer...@lable.org wrote: If you want to disable auto-flush in 0.92.1, one approach is to override the

Re: Delete by timestamp?

2012-10-13 Thread yuzhihong
Please take a look at HBASE-6942 where you can achieve the following using an endpoint. Cheers On Oct 13, 2012, at 4:26 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi, Is there a way to delete all rows older than a certain date? In the delete object we can specify a

Re: Delete by timestamp?

2012-10-13 Thread Jean-Marc Spaggiari
Wow. Seems it's coming right on time ;) Is there any code example on the way to call an endpoint? Thanks, JM 2012/10/13 yuzhih...@gmail.com: Please take a look at HBASE-6942 where you can achieve the following using an endpoint. Cheers On Oct 13, 2012, at 4:26 PM, Jean-Marc Spaggiari

Re: Delete by timestamp?

2012-10-13 Thread Ted Yu
In the latest patch, you should see this class which can be used as example for client: src/test/java/org/apache/hadoop/hbase/coprocessor/example/TestBulkDeleteProtocol.java Cheers On Sat, Oct 13, 2012 at 5:30 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Wow. Seems it's coming right