Thanks all for your help. If Todd can do most of his HBase work on a laptop, then I should be able to, too :) Per Andy and Jonathan, I will take a look at Andy's EC2 scripts as well.
Mike ---- Original Message ---- From: Todd Lipcon <[email protected]> To: user <[email protected]> Sent: Tue, Oct 26, 2010 10:05 pm Subject: Re: Contributing to hbase but test with less hardware +1 to unit tests and pseudo-distributed testing. I do the majority of my work on a laptop as well. I only move to my 5 or 6 node test clusters when working on failure testing, load testing, or benchmarks. -Todd On Tue, Oct 26, 2010 at 3:11 PM, Jonathan Gray <[email protected]> wrote: > One option is to use EC2 to spin up a cluster for a short period of time > and test on it, but that brings along its own set of complications. > > What kind of things are you hoping to contribute? I would say the best way > to do things if you don't have large clusters to test on is write lots of > good unit tests. > > A vast majority of the testing I do is either through unit tests or smaller > (5 or so) node clusters. After things work there, then there's the > long-running large cluster tests, but things go through lots of other > testing prior to that. > > If you have specific things you'd like to work on but feel that it requires > a lot of large cluster load testing, then try to convince someone from SU, > Cloudera, or FB to help you test it :) Easiest way to do that is with cool > features and good unit testing. > > JG > > > -----Original Message----- > > From: [email protected] [mailto:[email protected]] > > Sent: Tuesday, October 26, 2010 3:01 PM > > To: [email protected] > > Subject: Contributing to hbase but test with less hardware > > > > > > Dear HBase devs, > > > > > > I am reading the HBase sources and have also read the > > http://wiki.apache.org/hadoop/Hbase/HowToContribute wiki page including > > the jira "noob" label suggestion. If I do not have 4 or 5 machines at > > home with sufficient RAM to test changes on a meaningful HBase cluster, > > what are my other alternatives? Apart from companies with large > > deployments (su, cloudera, y!) and where devs can remotely test their > > changes, is there a free/cheap cluster for the less fortunate others > > who own laptops with 2GB RAM? Thanks for your help. > > > > Mike > > > > > > > > > > > -- Todd Lipcon Software Engineer, Cloudera
