[
https://issues.apache.org/jira/browse/ARROW-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489522#comment-17489522
]
Carlos O'Ryan commented on ARROW-12509:
---------------------------------------
> The copy use the if match feature) but I think this type of operation might
> be expensive.
Depends on what you mean by expensive and which operation are you referring to.
Copy operations (aka rewrites) in GCS are relatively cheap. In most cases
they are just metadata updates, even in the cases where they are not (changing
the storage class, storage location and/or encryption keys) the copy happens
server-side which is much cheaper than a download + upload. AFAIK, the
pre-condition checks are also cheap compared to an upload, download, or
checking the metadata on the client side.
> [C++] More fine-grained control of file creation in filesystem layer
> --------------------------------------------------------------------
>
> Key: ARROW-12509
> URL: https://issues.apache.org/jira/browse/ARROW-12509
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Antoine Pitrou
> Assignee: Antoine Pitrou
> Priority: Major
>
> {{FileSystem::OpenOutputStream}} silently truncates an existing file.
> It would be better to give more control to the user. Ideally, one could
> choose between several options: "always overwrite and fail if doesn't exist",
> "overwrite if exists, otherwise create", "creates if doesn't exist, otherwise
> fails".
> One should research whether e.g. S3 supports such control.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
