Re: Append to Files..

2008-12-02 Thread Steve Loughran
Sandeep Dhawan, Noida wrote: Hello, I am currently using hadoop-0.18.0. I am not able to append files in DFS. I came across a fix which was done on version 0.19.0 (http://issues.apache.org/jira/browse/HADOOP-1700). But I cannot migrate to 0.19.0 version because it runs on JDK 1.6 and I have

Re: killJob method in JobClient

2008-12-02 Thread Steve Loughran
Robert Goodman wrote: I have some code where I create my own Hadoop job and the use the JobClient to submit the Hadoop job. I noticed that the JobClient class has a killJob() method. I was planning to play around and try to kill a running Hadoop job. Does anybody know status the killJob method?

talk: My other computer is a datacentre

2008-12-02 Thread Steve Loughran
Here's a presentation on datacentres and MR my colleague and I gave to the local university this week, My other computer is a datacentre. MapReduce was demoed on a different dataset from normal (scanned bluetooth devices from a static location) and implemented in Erlang, because the students

Re: Map/Reduce from web servers

2008-12-02 Thread Steve Loughran
Allen, Jeffrey wrote: Hi, I have an existing enterprise system using web services. I'd like to have an event in the web service eventually result in a map/reduce being performed. It would be very desirable to be able to package up the map reduce classes into a jar that gets deployed inside

Re: Which replica?

2008-12-02 Thread Jim Cipar
I'm looking at alternative policies for task and data placement. As a first step, I'd like to be able to observe what Hadoop is doing without modifying our cluster's software. We saw that the datanodes log every block that is read from them, but we didn't see any way to map from those block

Re: Hadoop and .tgz files

2008-12-02 Thread John Heidemann
On Mon, 01 Dec 2008 12:16:28 EST, Ryan LeCompte wrote: I believe I spoke a little too soon. Looks like Hadoop supports .gz files, not .tgz. :-) On Mon, Dec 1, 2008 at 10:46 AM, Ryan LeCompte [EMAIL PROTECTED] wrote: Hello all, I'm using Hadoop 0.19 and just discovered that it has no problems

[NYC Hadoop meetup] 12/17 Cascading by Chris Wensel

2008-12-02 Thread Alex Dorman
The next New York Hadoop User Group meeting is scheduled for Wednesday, December 17th at ContextWeb, 6:30pm. Join us for a talk on Cascading, an API for defining and executing complex and fault tolerant data processing workflows on a Hadoop cluster. Chris will specifically cover what the