Dmitriy, Thanks for the solution.It worked really well. :) Thanks, Souri
On Tue, May 3, 2011 at 1:04 AM, Dmitriy Ryaboy <[email protected]> wrote: > Ok, so you don't want to exit from a UDF, you want to stop processing the > mapper. > > What you want is an early EOF from your InputFormat. So I guess the answer > is to have a custom inputFormat that monitors some object that your UDF can > modify, and the input format can report EOF if the condition is satisfied > (or it's actually out of data). > > D > > > On Sun, May 1, 2011 at 11:11 PM, souri datta <[email protected] > >wrote: > > > I think I was not able to explain my problem here. > > > > So, the udf runs in a mapper job which is doing some very expensive i/o > > operation. If it processes all the input files, the time consumed will be > > huge. So, I want to exit from the mapper on meeting the particular > > condition > > so that I don't process all the input files. > > > > Thanks, > > Souri > > > > On Mon, May 2, 2011 at 1:46 AM, Dmitriy Ryaboy <[email protected]> > wrote: > > > > > Right. I assume there is a reason you don't want to or are unable to > have > > > your udf check your condition and call return? > > > > > > -----Original Message----- > > > From: "souri datta" <[email protected]> > > > To: [email protected] > > > Sent: 5/1/2011 8:50 AM > > > Subject: Re: Early exit from Pig udf > > > > > > Meaning it should be able to finish quickly(return from the method). > > > > > > On Fri, Apr 29, 2011 at 9:52 PM, Dmitriy Ryaboy <[email protected]> > > > wrote: > > > > > > > What do you mean by return? > > > > > > > > > > > > On Fri, Apr 29, 2011 at 5:01 AM, souri datta < > [email protected] > > > > >wrote: > > > > > > > > > Hi, > > > > > I have a pig udf.My requirement is , on meeting certain criteria, > I > > > want > > > > > to > > > > > return from Pig udf.Is there any way I can early exit from Pig udf? > > > > > Also, how can it be done in a Map/Reduce job? > > > > > > > > > > > > > > > Thanks, > > > > > Souri > > > > > > > > > > > > > > > > > >
