[
https://issues.apache.org/jira/browse/HADOOP-19278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19278:
------------------------------------
Description:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
This is incompatible with all hadoop versions before 3.2.2 and with hadoop 3.3.0
when applications using the s3a connector attempt to write to the same
repository.
Fix: upgrade to a recent version of the Hadoop libraries when working with S3
storage, for which there are many reasons
was:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
Tnhis is incompatible with all hadoop versions before 3.2.2 and with hadoop
3.3.0
when applications using the s3a connector attempt to write to the same
repository.
We've supported directory marker retention since HADOOP-13230 went in.
and switch to making it the default in HADOOP-18752
> S3A: remove option to delete directory markers
> ----------------------------------------------
>
> Key: HADOOP-19278
> URL: https://issues.apache.org/jira/browse/HADOOP-19278
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.1
> Reporter: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> S3A no longer supports the ability to disable deletion of parent directory
> markers on file or directory creation.
> The option "fs.s3a.directory.marker.retention" is no longer supported.
> This is incompatible with all hadoop versions before 3.2.2 and with hadoop
> 3.3.0
> when applications using the s3a connector attempt to write to the same
> repository.
> Fix: upgrade to a recent version of the Hadoop libraries when working with S3
> storage, for which there are many reasons
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
