[ https://issues.apache.org/jira/browse/HADOOP-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718679#action_12718679 ]
Ian Nowland commented on HADOOP-5889: ------------------------------------- Can do. One question I have is that there exists a org.apache.hadoop.mapred.TestFileOutputFormat but not a corresponding org.apache.hadoop.mapreduce.lib.output.TestFileOutputFormat. Should I copy over the existing test to the new location? Also, should I make my source change in both the old mapred as well as the newer mapreduce files? > Allow writing to output directories that exist, as long as they are empty > ------------------------------------------------------------------------- > > Key: HADOOP-5889 > URL: https://issues.apache.org/jira/browse/HADOOP-5889 > Project: Hadoop Core > Issue Type: Improvement > Components: fs > Affects Versions: 0.18.3 > Reporter: Ian Nowland > Fix For: 0.21.0 > > Attachments: HADOOP-5889-0.patch > > > The current behavior in FileOutputFormat.checkOutputSpecs is to fail if the > path specified by mapred.output.dir exists at the start of the job. This is > to protect from accidentally overwriting existing data. There seems no harm > then in slightly relaxing this check to allow the case for the output to > exist if it is an empty directory. > At a minimum this would allow outputting to the root of S3N buckets, which is > currently impossible (https://issues.apache.org/jira/browse/HADOOP-5805). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.