[
https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883013#comment-17883013
]
Steve Loughran commented on HADOOP-19256:
-----------------------------------------
[~scotterdogger-dbx] we welcome you, your insights, any code, tests or
documentation you have to offer, -any any testing you can perform through your
libraries against AWS *and* third party stores.
I'm drafting a doc on features and how to implement them effectively.
We should be able to get this into a future 3.4.2 release, which will be enough
for you to code & test with; adding it as a createFIle() option guarantees no
regressions.
for create(overwrite=false) and rename(file) i worry about breaking third party
stores -or equally bad, having libraries thinking it is atomic when it isn't.
tricky one that. It'll be straightforward to implement. In fact, i may add it
to storediag's file operation tests in advance
https://github.com/steveloughran/cloudstore/blob/main/src/main/java/org/apache/hadoop/fs/store/diag/StoreDiag.java#L726
{code}
stream1 = fs.open(path. false)
stream2 = fs.open(path, false) // fails here on real posix systems
stream1.write("s1");
stream2.wriate("s2);
s2.close()
s1.close() // MUST fail here if conditional puts are allowed
{code}
anyway, will share the doc/plan ASAP..if you or anyone else can collaborate
here it'd be great.
I think we should also have a zoom call on this late next week
{code}
> S3A: Support S3 Conditional Writes
> ----------------------------------
>
> Key: HADOOP-19256
> URL: https://issues.apache.org/jira/browse/HADOOP-19256
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Ahmar Suhail
> Priority: Major
> Labels: pull-request-available
>
> S3 Conditional Write (Put-if-absent) capability is now generally available -
> [https://aws.amazon.com/about-aws/whats-new/2024/08/amazon-s3-conditional-writes/]
>
> S3A should allow passing in this put-if-absent header to prevent over writing
> of files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
