[
https://issues.apache.org/jira/browse/HADOOP-19278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19278:
------------------------------------
Description:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
Tnhis is incompatible with all hadoop versions before 3.2.2 and with hadoop
3.3.0
when applications using the s3a connector attempt to write to the same
repository.
We've supported directory marker retention since HADOOP-13230 went in.
and switch to making it the default in HADOOP-18752
was:
We've supported directory marker retention since HADOOP-13230 went in.
and switch to making it the default in HADOOP-18752
nobody has ever complained about this.
proposed: cut directory marker deletion entirely.
this will
* simplify our code
* cut down on test options
> S3A: remove option to delete directory markers
> ----------------------------------------------
>
> Key: HADOOP-19278
> URL: https://issues.apache.org/jira/browse/HADOOP-19278
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.1
> Reporter: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> S3A no longer supports the ability to disable deletion of parent directory
> markers on file or directory creation.
> The option "fs.s3a.directory.marker.retention" is no longer supported.
> Tnhis is incompatible with all hadoop versions before 3.2.2 and with hadoop
> 3.3.0
> when applications using the s3a connector attempt to write to the same
> repository.
> We've supported directory marker retention since HADOOP-13230 went in.
> and switch to making it the default in HADOOP-18752
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
