[
https://issues.apache.org/jira/browse/HADOOP-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian Nowland updated HADOOP-5889:
--------------------------------
Attachment: HADOOP-5889-0.patch
Simple patch with additional check to not throw if existing directory is empty.
> Allow writing to output directories that exist, as long as they are empty
> -------------------------------------------------------------------------
>
> Key: HADOOP-5889
> URL: https://issues.apache.org/jira/browse/HADOOP-5889
> Project: Hadoop Core
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.18.3
> Reporter: Ian Nowland
> Attachments: HADOOP-5889-0.patch
>
>
> The current behavior in FileOutputFormat.checkOutputSpecs is to fail if the
> path specified by mapred.output.dir exists at the start of the job. This is
> to protect from accidentally overwriting existing data. There seems no harm
> then in slightly relaxing this check to allow the case for the output to
> exist if it is an empty directory.
> At a minimum this would allow outputting to the root of S3N buckets, which is
> currently impossible (https://issues.apache.org/jira/browse/HADOOP-5805).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
