Steve Loughran updated HADOOP-13407:
    Parent: HADOOP-15220  (was: HADOOP-14831)

> s3a directory housekeeping operations to be done in async thread
> ----------------------------------------------------------------
>                 Key: HADOOP-13407
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13407
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
> Some of the delays on s3a calls are due to cleaning up parent pseudo 
> directories; repeated getParent/GET calls to look for the entries, then to 
> delete them.
> We could possibly make this asynchronous; the core semantics would be 
> retained, just the cleanup delayed.
> Risks?
> # while the cleanup is in progress, getFileStatus of parent dirs could imply 
> that the parent dir is still empty
> # failure
> of course, these risks exist today. We really need an s3a fsck

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to