[
https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662334#comment-16662334
]
Ewan Higgs commented on HDFS-13713:
-----------------------------------
{quote} I'd expect it to be visible, yes?{quote}
Yes.
{quote}FWIW, I suspect that AWS will still bill you for those uncommitted
parts, even if complete() simply discards the parts. {quote}
AFAIK, yes, you will be billed for parts that have not yet been realized.
{quote}How about we say
if you attempt >1 MPU to the same dest then it may be rejected, or it may be
accepted. In the latter case, which upload becomes visible after the first
completes{quote}
I'm not sure what you mean by "In the latter case, which upload becomes visible
after the first completes."
e.g.
"If you complete multiple objects to the same destination at the same time, one
of the files will be in the destination. The file that is available is
dependent on the target storage system." As opposed to "there will be an error"
or, worse, "the file will be corrupted".
My thoughts are that if a user writes multiple files to the same destination at
the same time, then they either don't mind which one is 'the winner' or they
should be advised to choose names that won't collide.
> Add specification of Multipart Upload API to FS specification, with contract
> tests
> ----------------------------------------------------------------------------------
>
> Key: HDFS-13713
> URL: https://issues.apache.org/jira/browse/HDFS-13713
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs, test
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Assignee: Ewan Higgs
> Priority: Blocker
> Attachments: HADOOP-13713-004.patch, HADOOP-13713-004.patch,
> HADOOP-13713-005.patch, HADOOP-13713-006.patch, HADOOP-13713-007.patch,
> HDFS-13713.001.patch, HDFS-13713.002.patch, HDFS-13713.003.patch,
> HDFS-13713.008.patch, multipartuploader.md
>
>
> There's nothing in the FS spec covering the new API. Add it in a new .md file
> * add FS model with the notion of a function mapping (uploadID -> Upload),
> the operations (list, commit, abort). The [TLA+
> mode|https://issues.apache.org/jira/secure/attachment/12865161/objectstore.pdf]l
> of HADOOP-13786 shows how to do this.
> * Contract tests of not just the successful path, but all the invalid ones.
> * implementations of the contract tests of all FSs which support the new API.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
