[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176570#comment-14176570
 ] 

Ivan Mitic commented on MAPREDUCE-5911:
---------------------------------------

Thank you [~jira.shegalov] for bringing this up. You are right, this won't work 
with the default partitioner. Sorry I wasn't aware of MAPREDUCE-4879. Let me 
take another look and see whether to revert the change that went in or go with 
your patch as an addendum. 

> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: examples
>            Reporter: Ivan Mitic
>            Assignee: Bruno P. Kinoshita
>            Priority: Minor
>             Fix For: 2.6.0
>
>         Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in 
> {{FileOutputFormat#checkOutputSpecs}} by throwing 
> {{FileAlreadyExistsException}}.  However, terasort uses a specialized output 
> format, {{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}.  
> The subclass overrides {{checkOutputSpecs}}, but does not re-implement the 
> existence check and throw {{FileAlreadyExistsException}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to