Re: stop-hbase.sh bug or feature?

2011-03-03 Thread Igor Ranitovic
What about adding a simple message box using bash's whiptail? For example: rs=$(cat ${HBASE_CONF_DIR}/regionservers | xargs) if ( whiptail --yesno Do you want to shutdown the cluster with the following regionserver $rs\n[y/n] 10 40 ) then # proceed with the shutdown else #

Re: Region loadbalancing

2011-01-12 Thread Igor Ranitovic
Hi J-D, If 1GB region size and about 1K regions per server is recommended, does that mean that a region node should server about 1TB of compressed data at most? If that is the case than having more than 2TB (1TB for data and 1TB of spare free space) is wasteful for data nodes that are part

Re: Region loadbalancing

2010-12-15 Thread Igor Ranitovic
Hi Stack, OK, I will up it to 1GB. Do I need to do a full restart or rolling RS restarts will do? I have been happy with 0.20.3 even though it is an ancient release. Given that we have a 0.3-man team dedicated to HBase it is hard to find time for upgrades. It will have to wait for 0.90 or

Re: Region loadbalancing

2010-12-14 Thread Igor Ranitovic
Hi Stack, We have been running a small cluster (name node + 5 rs) on 0.20.3 for a long time now. We are currently at 1100 regions per RS. As far as I can tell, I have not seen any problems or changes in behavior due this. What kind of problems can I expect with 1K+ regions per RS? What is a

MultiGet benchmarking

2010-10-26 Thread Igor Ranitovic
We want to start benchmarking the mutliget feature (HTable.batch). However, I don't see it in the latest 0.89 :( Is this something that we need to test against the trunk? Thanks. i.

hbase lso question

2010-10-06 Thread Igor Ranitovic
Has anybody had experience upgrading to the patched version of the native connector library by twitter: http://github.com/kevinweil/hadoop-lzo http://www.cloudera.com/blog/2009/11/hadoop-at-twitter-part-1-splittable-lzo-compression/ We want to add the splittable lzo support for our MR jobs,

Re: thrift for hbase in CDH3 broken ?

2010-09-08 Thread Igor Ranitovic
. -- From: Igor Ranitovic irani...@gmail.com Sent: Tuesday, September 07, 2010 8:18 PM To: user@hbase.apache.org Subject: Re: thrift for hbase in CDH3 broken ? Jinsong Hu wrote: I tried, this doesn't work. I noticed $transport-open(); is missing in this code. so I added

Re: thrift for hbase in CDH3 broken ?

2010-09-07 Thread Igor Ranitovic
a RS. Are there any firewalls in place ? Are you running thrift servers on the same nodes as region servers? What kind of exception do you get? i. -- From: Igor Ranitovic irani...@gmail.com Sent: Friday, September 03, 2010 11:45 AM To: user

Re: how to get the row before this one?

2010-05-30 Thread Igor Ranitovic
One thing that I can think of is to sort measurements from the newest to oldest: DevA,12pm,150W DevA,9am,100W Now instead of scanning from-to date, start with the to date and keep scanning until you find a row with a date that is older than the from date. To use your example, start the scan