Re: Error reporting from map function

2007-08-02 Thread ojh06
Hi Doug, Thanks for the reply. Could you possibly explain how my program would get access to the task reports from each tracker? I've found the getMapTaskReports method in the JobClient class, but can't work out how to access it other than by creating a new instance of JobClient - but

Re: Error reporting from map function

2007-08-02 Thread Michael Bieniosek
On 8/2/07 5:20 AM, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: I've found the getMapTaskReports method in the JobClient class, but can't work out how to access it other than by creating a new instance of JobClient - but then that JobClient would be a differnt one to the one that was

Re: Error reporting from map function

2007-08-02 Thread ojh06
Hi Michael, Thanks for the reply. I've tried to write some code to do this now but its not working. I was wondering if there's anything obviously wrong? After my runJob() I put (just as a test): JobClient aJC = new JobClient(); String jobid = jobConf.get(mapred.job.id);

Re: Error reporting from map function

2007-07-31 Thread Doug Cutting
[EMAIL PROTECTED] wrote: I've written a map task that will on occasion not compute the correct result. This can easily be detected, at which point I'd like the map task to report the error and terminate the entire map/reduce job. Does anyone know of a way I can do this? You can easily kill

Re: Error reporting from map function

2007-07-30 Thread Anthony D. Urso
In that case, it would be better to communicate the error in-band somehow before throwing the exception. On Tue, Jul 31, 2007 at 12:09:27AM +0100, [EMAIL PROTECTED] wrote: Thanks Anthony, its good to know it can be done! However, I was hoping to be able to report the numerical error in my map