Steve Loughran created HADOOP-13974:
---------------------------------------
Summary: S3a CLI to support list/purge of pending multipart commits
Key: HADOOP-13974
URL: https://issues.apache.org/jira/browse/HADOOP-13974
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Affects Versions: HADOOP-13345
Reporter: Steve Loughran
The S3A CLI will need to be able to list and delete pending multipart commits.
We can do the cleanup already via fs.s3a properties. The CLI will let scripts
stat for outstanding data (have a different exit code) and permit batch jobs to
explicitly trigger cleanups.
This will become critical with the multipart committer, as there's a
significantly higher likelihood of commits remaining outstanding.
We may also want to be able to enumerate/cancel all pending commits in the FS
tree
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]