Re: how to set one map task for each input key-value pair

2009-11-28 Thread Jason Venner
inal Message - From: "Jason Venner" > To: > Sent: Friday, November 27, 2009 12:06 AM > Subject: Re: how to set one map task for each input key-value pair > > > > The only thing that comes immediately to mind is to write your own custom >> input format th

Re: how to set one map task for each input key-value pair

2009-11-27 Thread Upendra Dadi
ignoring the dummy characters. Do you think this could work? Thanks. Regards, Upendra - Original Message - From: "Jason Venner" To: Sent: Friday, November 27, 2009 12:06 AM Subject: Re: how to set one map task for each input key-value pair The only thing that comes imme

Re: how to set one map task for each input key-value pair

2009-11-26 Thread Jason Venner
The only thing that comes immediately to mind is to write your own custom input format that knows how to tell where the boundaries are in your data set, and uses those to specify the beginning and end of the input splits. You can also tell the framework not to split your individual input files by