[
https://issues.apache.org/jira/browse/HADOOP-16474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896276#comment-16896276
]
Steve Loughran commented on HADOOP-16474:
-----------------------------------------
Proposed, some new DDB method (markRenameDestAuth(path, bulkoperation, auth)),
only use it in the rename trackers. and then only when the rename is
successful. This would benefit all apps which (still) use rename to commit work
> S3Guard ProgressiveRenameTracker to mark dest dir as authoritative on success
> -----------------------------------------------------------------------------
>
> Key: HADOOP-16474
> URL: https://issues.apache.org/jira/browse/HADOOP-16474
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Priority: Major
>
> After a directory rename is successful, the destination will contain only
> those files which have been copied by the S3guard-enabled client, with the
> directory tree updated as new entries are added.
> At that point, the ProgressiveRenameTracker could tell the store to complete
> the rename and in so doing, give clients maximum performance without needing
> any LIST commands.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
