Re: HBase client hangs after upgrade to 0.20.4 when used from reducer

Hi, I was kind of hoping that this was a known thing and I was just overlooking something. Apparently it requires more investigation. I reproduced the situation and gathered some more info. I still have to look through everything myself a bit more (today is a national holiday in The

HBase has entered Debian (unstable)

Hi, HBase 0.20.4 has entered Debian unstable, should slide into testing after the usual 14 day period and will therefor most likely be included in the upcomming Debian Squeeze. http://packages.debian.org/source/sid/hbase Please note, that this packaging effort is still very much

GSoC 2010: ZooKeeper Monitoring Recipes and Web-based Administrative Interface

Hi all, My name is Andrei Savu and I am on of the GSoC2010 accepted students. My mentor is Patrick Hunt. My objective in the next 4 months is to write tools and recipes for monitoring ZooKeeper and to implement a web-based administrative interface. I have created a wiki page for this project:

Re: Enabling IHbase

Hi Renato, IHBASE is currently broken. I expect to have it fixed tomorrow or the day after. When it's fixed, I'll publish a release under http://github.com/ykulbak/ihbase and add a wiki page explaining how to get started. I'll also send a note to the mailing list. Please feel free to contact me

Re: Using HBase on other file systems

On Thu, May 13, 2010 at 12:26 AM, Jeff Hammerbacher ham...@cloudera.comwrote: Some projects sacrifice stability and manageability for performance (see, e.g., http://gluster.org/pipermail/gluster-users/2009-October/003193.html ). On Wed, May 12, 2010 at 11:15 AM, Edward Capriolo

Re: GSoC 2010: ZooKeeper Monitoring Recipes and Web-based Administrative Interface

On Thu, May 13, 2010 at 2:30 AM, Andrei Savu savu.and...@gmail.com wrote: Hi all, My name is Andrei Savu and I am on of the GSoC2010 accepted students. My mentor is Patrick Hunt. Good to meet you Andrei. Are there any HBase  / Hadoop  specific ZooKeeper monitoring requirements? In the

Re: HBase has entered Debian (unstable)

You are a good man Thomas. Thanks for pushing this through. St.Ack On Thu, May 13, 2010 at 1:59 AM, Thomas Koch tho...@koch.ro wrote: Hi, HBase 0.20.4 has entered Debian unstable, should slide into testing after the usual 14 day period and will therefor most likely be included in the

Re: HBase client hangs after upgrade to 0.20.4 when used from reducer

Hi Friso, When did you take the jstack dumps of the region servers? Was it when the reduce tasks were still hanging? Do all of the reduce tasks hang or is it just one that gets stuck? If, once the reduce tasks are hung, you open the hbase shell and run count 'mytable', 10 does it

Re: Regionservers crash with an OutOfMemoryException after a data-intensive map reduce job..

Hello Vidhyashankar: How many regionservers? What version of hbase and hadoop? How much RAM on these machines in total? Can you give HBase more RAM? Also check that you don't have an exceptional cell in your input -- one that is very much larger than the 14KB you not below. 12 column

Re: Regionservers crash with an OutOfMemoryException after a data-intensive map reduce job..

Thanks for the prompt response.. Oops, forgot the specifics: I ran the whole thing on five region servers that also run hadoop's data node and task trackers: Each machine has 6 TB disk space (5TB available for the data node and 1 TB for MR and hbase temps), 24Gigs RAM, 3 gigs Hbase-heap size..

Re: Regionservers crash with an OutOfMemoryException after a data-intensive map reduce job..

Looks like my conf file wasn't attached: So here goes some of (what I though were relevant) config values: Obviously, I am not asking anyone to go through every one of them but can someone cursorily eyeball them to see if something seems off? But as of now, it looks like I had too many

Re: Using HBase on other file systems

Hey, I think one of the key features of HDFS is its ability to be run on standard hardware and integrate nicely in a standardized datacenter environment. I never would have got my project off the ground if I had to convince my company to invest in infiniband switches. So in the situation you

RE: Using HBase on other file systems

Yo I feel the need to speak up. GlusterFS is pretty configurable. It doesn't rely on HBAs but it does support them. Gig or 10G ethernet are also supported options. I would love to see HBase become GlusterFS aware, because the architecture is, frankly, more flexible than HDFS with fewer SPoF

RE: Using HBase on other file systems

You really want to run HBase backed by Eucalyptus' Walrus? What do you have behind that? From: Gibbon, Robert, VF-Group Subject: RE: Using HBase on other file systems [...] NB. I checked out running HBase over Walrus (an AWS S3 clone): bork - you want me to file a Jira on that?

tables disappearing after upgrading 0.20.3 = 0.20.4

Hi, after upgrading from 0.20.3 to 0.20.4 a list of tables almost immediately becomes inconsistent - master.jsp shows no tables even after creating test table in hbase shell, tables which were available before start randomly appearing and disappearing, etc. Upgrading was done by stopping,

Re: tables disappearing after upgrading 0.20.3 = 0.20.4

Whats the shelll say? Does it see the tables consistently? Can you count your content consistently? St.Ack On Thu, May 13, 2010 at 4:53 PM, Viktors Rotanovs viktors.rotan...@gmail.com wrote: Hi, after upgrading from 0.20.3 to 0.20.4 a list of tables almost immediately becomes inconsistent -