Allow writing to output directories that exist, as long as they are empty
-------------------------------------------------------------------------
Key: HADOOP-5889
URL: https://issues.apache.org/jira/browse/HADOOP-5889
Project: Hadoop Core
Issue Type: Improvement
Components: fs
Affects Versions: 0.18.3
Reporter: Ian Nowland
The current behavior in FileOutputFormat.checkOutputSpecs is to fail if the
path specified by mapred.output.dir exists at the start of the job. This is to
protect from accidentally overwriting existing data. There seems no harm then
in slightly relaxing this check to allow the case for the output to exist if it
is an empty directory.
At a minimum this would allow outputting to the root of S3N buckets, which is
currently impossible (https://issues.apache.org/jira/browse/HADOOP-5805).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
