Re: extracting input to a task from a (streaming) job?

2008-09-26 Thread Yuri Pradkin
I've create a jira describing my problems running under IsolationRunner. https://issues.apache.org/jira/browse/HADOOP-4041 If anyone is using I.R. successfully to re-run failed tasks in a single JVM, can you please, pretty please, describe on how you do that? Thank you, -Yuri On Friday 08

IsolationRunner [was Re: extracting input to a task from a (streaming) job?]

2008-08-27 Thread Yuri Pradkin
I posted this a while back and have been wondering whether I missed something and the doc is out of date or this is a bug and I should file a jira. Is there anyone out there who is successfully using IsolationRunner? Please let me know. Thanks, -Yuri On Friday 08 August 2008 10:09:48

Re: extracting input to a task from a (streaming) job?

2008-08-08 Thread Yuri Pradkin
On Thursday 07 August 2008 16:43:10 John Heidemann wrote: On Thu, 07 Aug 2008 19:42:05 +0200, Leon Mergen wrote: Hello John, On Thu, Aug 7, 2008 at 6:30 PM, John Heidemann [EMAIL PROTECTED] wrote: I have a large Hadoop streaming job that generally works fine, but a few (2-4) of the ~3000

extracting input to a task from a (streaming) job?

2008-08-07 Thread John Heidemann
I have a large Hadoop streaming job that generally works fine, but a few (2-4) of the ~3000 maps and reduces have problems. To make matters worse, the problems are system-dependent (we run an a cluster with machines of slightly different OS versions). I'd of course like to debug these problems,

Re: extracting input to a task from a (streaming) job?

2008-08-07 Thread Leon Mergen
Hello John, On Thu, Aug 7, 2008 at 6:30 PM, John Heidemann [EMAIL PROTECTED] wrote: I have a large Hadoop streaming job that generally works fine, but a few (2-4) of the ~3000 maps and reduces have problems. To make matters worse, the problems are system-dependent (we run an a cluster with

Re: extracting input to a task from a (streaming) job?

2008-08-07 Thread John Heidemann
On Thu, 07 Aug 2008 19:42:05 +0200, Leon Mergen wrote: Hello John, On Thu, Aug 7, 2008 at 6:30 PM, John Heidemann [EMAIL PROTECTED] wrote: I have a large Hadoop streaming job that generally works fine, but a few (2-4) of the ~3000 maps and reduces have problems. To make matters worse, the