[
https://issues.apache.org/jira/browse/HADOOP-19278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19278:
------------------------------------
Description:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
This is incompatible with all hadoop versions before 3.2.2 and with hadoop 3.3.0
when applications using the s3a connector attempt to write to the same
repository.
Fix: upgrade to a recent version of the Hadoop libraries when working with S3
storage, for which there are many reasons
h3. cherrypicking:
* include HADOOP-19464
was:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
This is incompatible with all hadoop versions before 3.2.2 and with hadoop 3.3.0
when applications using the s3a connector attempt to write to the same
repository.
Fix: upgrade to a recent version of the Hadoop libraries when working with S3
storage, for which there are many reasons
> S3A: remove option to delete directory markers
> ----------------------------------------------
>
> Key: HADOOP-19278
> URL: https://issues.apache.org/jira/browse/HADOOP-19278
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.1
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.0
>
>
> S3A no longer supports the ability to disable deletion of parent directory
> markers on file or directory creation.
> The option "fs.s3a.directory.marker.retention" is no longer supported.
> This is incompatible with all hadoop versions before 3.2.2 and with hadoop
> 3.3.0
> when applications using the s3a connector attempt to write to the same
> repository.
> Fix: upgrade to a recent version of the Hadoop libraries when working with S3
> storage, for which there are many reasons
> h3. cherrypicking:
> * include HADOOP-19464
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
