Steve Loughran created HADOOP-13974:
---------------------------------------

             Summary: S3a CLI to support list/purge of pending multipart commits
                 Key: HADOOP-13974
                 URL: https://issues.apache.org/jira/browse/HADOOP-13974
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: HADOOP-13345
            Reporter: Steve Loughran


The S3A CLI will need to be able to list and delete pending multipart commits. 

We can do the cleanup already via fs.s3a properties. The CLI will let scripts 
stat for outstanding data (have a different exit code) and permit batch jobs to 
explicitly trigger cleanups.

This will become critical with the multipart committer, as there's a 
significantly higher likelihood of commits remaining outstanding.

We may also want to be able to enumerate/cancel all pending commits in the FS 
tree



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to