Another question here is in getDefaultWorkFile() is that, how is it possible
to find out the mapper number that is used in output. For eg, if you have 30
mappers, how can I add to output file( <OutputFile>) of 30th mapper -
<OutputFile>_30 ?
On Sun, Jun 19, 2011 at 11:19 PM, Mapred Learn <mapred.le...@gmail.com>wrote:
> Thanks !
> I will try this !
>
> On Sun, Jun 19, 2011 at 11:16 PM, Christoph Schmitz <
> christoph.schm...@1und1.de> wrote:
>
>> Hi JJ,
>>
>> you can do that by subclassing TextOutputFormat (or whichever output
>> format you're using) and overloading the getDefaultWorkFile method:
>>
>> public class MyOutputFormat<K, V> extends TextOutputFormat<K, V> {
>> // ...
>> public Path getDefaultWorkFile(TaskAttemptContext context,
>> String extension) throws IOException {
>> FileOutputCommitter committer = (FileOutputCommitter)
>> getOutputCommitter(context);
>> return new Path(committer.getWorkPath(),
>> myOwnMethodToComputeTheFileName(context));
>> }
>> }
>>
>> Regards,
>>
>> Christoph
>>
>> -----Ursprüngliche Nachricht-----
>> Von: Mapred Learn [mailto:mapred.le...@gmail.com]
>> Gesendet: Montag, 20. Juni 2011 06:59
>> An: mapreduce-user@hadoop.apache.org; cdh-u...@cloudera.org
>> Betreff: how to change default name of a sequnce file
>>
>> Hi,
>> I want to name output files of my map-red job (sequence files) to be a
>> certain name instead of part* default format.
>>
>> Has anyone ever tried to over-ride the default filename and give output
>> file name per map-red ?
>>
>> Thanks,
>> -JJ
>>
>
>
