[
https://issues.apache.org/jira/browse/HADOOP-19536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18012417#comment-18012417
]
Steve Loughran commented on HADOOP-19536:
-----------------------------------------
[~ayshukla]
bq. This class get some original configs. Is there a possibility to set the
configs after the initialisation of the class?
createFile() API is a builder API for file creation -add tagging there. With
tests, obviously. always the tests, where i expect the same quality as
production code, including non-repetition of code
For deletion: no equivalent, and changing the semantics of delete() would be so
traumatic.
What you could consider proposing is that the s3a bulk delete API is modified
so that instead of issuing delete calls it tags the files. The semantics of the
API are "files only, no safety checks and success means files no long exist"
-but maybe that could be tuned to do "if FS created with
fs.s3a.bulk.delete.custom.tags="tag=value, t2=v2" then instead of deleting,
the files are tagged.
> S3A : Add option for custom S3 tags while writing and deleting S3 objects
> -------------------------------------------------------------------------
>
> Key: HADOOP-19536
> URL: https://issues.apache.org/jira/browse/HADOOP-19536
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Reporter: Syed Shameerur Rahman
> Priority: Major
> Labels: pull-request-available
>
> Custom S3 object
> [tags|https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html]
> can be added to S3 objects while writing and deleting.
> *Use Case:*
> S3 tags can be used to categorize the
> [objects|https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html]
> and potentially apply bucket level polices to take some actions.
> For example : objects can be marked as "to-be-glacier" and based on some
> bucket policy the written objects can be moved to Glacier tier after sometime
> for cost savings.
> Apache iceberg's [S3FileIO|#s3-tags]] also uses S3 Tags for soft deletes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
