[ 
https://issues.apache.org/jira/browse/HADOOP-19536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18010413#comment-18010413
 ] 

Steve Loughran commented on HADOOP-19536:
-----------------------------------------

ok. 
* soft delete is special, as that is mapping a delete call to a tag update
* can you help me get my impala PR for bulk delete in 
(https://github.com/apache/iceberg/pull/10233) )especially why those tests 
don't work, as that will reduce delete time by an order of magnitude, with 
shipping hadoop releases. Then tagging can be done. 

now, can you put the design up, ideally as a doc in a PR ()e.g. 
hadoop-aws/src/main/site/..../tagging.md  so that we can review it. thanks

> S3A : Add option for custom S3 tags while writing and deleting S3 objects
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-19536
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19536
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Syed Shameerur Rahman
>            Priority: Major
>
> Custom S3 object 
> [tags|https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html]
>  can be added to S3 objects while writing and deleting.
> *Use Case:*
> S3 tags can be used to categorize the 
> [objects|https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html]
>  and potentially apply bucket level polices to take some actions.
> For example : objects can be marked as "to-be-glacier" and based on some 
> bucket policy the written objects can be moved to Glacier tier after sometime 
> for cost savings.
> Apache iceberg's [S3FileIO|#s3-tags]] also uses S3 Tags for soft deletes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to