Re: [ANNOUNCE] Apache Hadoop 0.21.0 released

2010-09-15 Thread Stephen Watt
Hi Farhan Scale testing happens over time when there is larger uptake of the release by the community (or when Yahoo rolls out an Apache release). This is not something that has a set schedule with someone owning a deliverable. Regards Steve Watt From: Farhan Husain

Re: Hadoop for accounting?

2010-03-24 Thread Stephen Watt
Hi Marcos People are doing very similar things, but its not immediately clear from the way the use cases are described in the PoweredBy page (I believe the company Visible Measures may be one example). If you are storing API usage information in a log, you can use Hadoop to examine the logs,

Austin Hadoop Users Group - Tomorrow Evening (Thursday)

2010-03-17 Thread Stephen Watt
Hi Folks The Austin HUG is meeting tomorrow night. I hope to see you there. We have speakers from Rackspace (Stu Hood on Cassandra) and IBM (Gino Bustelo on BigSheets). Detailed Information is available at http://austinhug.blogspot.com/ Kind regards Steve Watt

Tracking Metrics in Hadoop by User

2010-03-09 Thread Stephen Watt
I'm interested in the ability to track metrics (such as CPU time, storage used per machine, across the cluster) in Hadoop by User. I've taken a look at the Fair and Capacity Schedulers and they seem oriented towards ensuring fair use between users' jobs rather than providing a feature which

Hadoop on a Virtualized O/S vs. the Real O/S

2010-02-08 Thread Stephen Watt
Hi Folks I need to be able to certify that Hadoop works on various operating systems. I do this by running a series it through a series of tests. As I'm sure you can empathize, obtaining all the machines for each test run can sometimes be tricky. It would be easier for me if I can spin up

First Official Austin Hadoop User Group - March 18th

2010-02-01 Thread Stephen Watt
Hi Folks This note is to let you know that we'll be kicking off the inaugural Austin Hadoop User Group on March the 18th. At present, we have speakers lined up from IBM and Rackspace and will cover quite a wide variety of topics along with a few demos. This event will follow directly on the

Re: Eclipse Plugin for Hadoop

2010-01-18 Thread Stephen Watt
I use it all the time. See http://wiki.apache.org/hadoop/EclipsePlugIn Kind regards Steve Watt From: aa...@buffalo.edu To: core-u...@hadoop.apache.org Date: 01/17/2010 01:52 AM Subject: Eclipse Plugin for Hadoop Hi all, I was just looking around and I stumbled across the Eclipse

Re: Bible Code and some input format ideas

2010-01-12 Thread Stephen Watt
Neat ! Please keep the list appraised when you have something to demo. Kind regards Steve Watt From: Edward Capriolo edlinuxg...@gmail.com To: common-user@hadoop.apache.org Date: 01/11/2010 01:55 PM Subject: Bible Code and some input format ideas Hey all, I saw a special on discovery about

Re: Hadoop on EC2

2009-11-24 Thread Stephen Watt
Hi Mark Are you starting the clusters from the contrib/ec2 scripts ? These scripts have a special way of bringing up the cluster where they are passing in the hostnames of the slaves as they are being assigned from ec2, thus I think stop-all and start-all will not work as they both assume the

Re: Error trying to build hadoop eclipse plugin

2009-11-23 Thread Stephen Watt
You'll need to be more specific about which version of Hadoop and Eclipse you're using. There are known issues building the plugin on Hadoop 0.20.1. I am in the process of providing a patch for this, in the interim, you can try using the plugin jar attached at

Re: Error trying to build hadoop eclipse plugin

2009-11-23 Thread Stephen Watt
, it's hadoop-0.20.1 and eclipse Ganymede. I did try that prebuilt plugin over the weekend but no luck with that on Windows. Thank you. --- On Mon, 11/23/09, Stephen Watt sw...@us.ibm.com wrote: From: Stephen Watt sw...@us.ibm.com Subject: Re: Error trying to build hadoop eclipse plugin

Re: Where to ask questions about Nutch?

2009-11-16 Thread Stephen Watt
http://lucene.apache.org/nutch/mailing_lists.html Regards Steve Watt From: Mark Kerzner markkerz...@gmail.com To: core-u...@hadoop.apache.org, tika-u...@lucene.apache.org Date: 11/16/2009 01:39 PM Subject: Where to ask questions about Nutch? Hi, is there a separate list for Nutch? Thank

Re: Building Hadoop from Source ?

2009-11-12 Thread Stephen Watt
Hi Sid Check out the Building section in this link - http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight forward. If you choose to not remove the test targets expect the build to take upwards of 2 hours as it runs through all the unit tests. Kind regards Steve Watt From: Siddu

Re: error setting up hdfs?

2009-11-10 Thread Stephen Watt
You need to specify a path. Try bin/hadoop dfs -ls / Steve Watt From: zenkalia zenka...@gmail.com To: core-u...@hadoop.apache.org Date: 11/10/2009 03:04 PM Subject: error setting up hdfs? had...@hadoop1:/usr/local/hadoop$ bin/hadoop dfs -ls ls: Cannot access .: No such file or directory.

Re: Hadoop NameNode not starting up

2009-11-10 Thread Stephen Watt
You need to go to your logs directory and have a look at what is going on in the namenode log. What version are you using ? I'm going to take a guess at your issue here and say that you used the /tmp as a path for some of your hadoop conf settings and you have rebooted lately. The /tmp dir is

Anyone using Hadoop in Austin, Texas ?

2009-11-10 Thread Stephen Watt
Just curious to see if there are any hadoop compatriots around and if there are, maybe we could organize a meetup. Regards Steve Watt

Re: hadoop eclipse plugin

2009-11-03 Thread Stephen Watt
tried to recompile the patched plugin, but no success. Stephen Watt wrote: Hi Le I am actually taking a look at it right now. My intent is to identify any issues with it and resolve them as well as to solicit new requirements from the community and implement them. JIRA is down to today