Interesting point. Even the S3 and Azure drivers have support for multi-part upload. Maybe we can implement retries for all of them.
If everyone agrees, we can open a ticket for it. I can work on it. Regards, Mahendra On Thu, Jul 11, 2013 at 12:01 AM, Ben McCann <[email protected]> wrote: > Great! One other question. How does it handle a flaky connection / backend? > I looked through the code and didn't see any retry logic. I'd like to > upload a 100GB file, but have run into trouble with other tools that don't > retry. I'd like it to split it into < 5GB chunks which I see now that > libcloud supports, and then also retry each of those chunks a configurable > number of times. I'll have to talk to my hosting provider as well to see > why uploading to object storage is so flaky, but I'm hoping I can also have > the client be resilient in that case. > > > On Tue, Jul 9, 2013 at 3:21 AM, Tomaz Muraus <[email protected]> wrote: > > > Yes, CloudFiles / Swift storage driver does support uploading large > objects > > via the ex_multipart_upload_object method - > > > > > https://github.com/apache/libcloud/blob/trunk/libcloud/storage/drivers/cloudfiles.py#L463 > > > > And yes, you are right about the docs. I will try to update them and add > an > > example soon. > > > > On Mon, Jul 8, 2013 at 11:14 PM, Ben McCann <[email protected]> wrote: > > > > > Hi, > > > > > > Does libcloud have large object > > > support< > > > > > > http://docs.openstack.org/trunk/openstack-object-storage/developer/content/large-object-creation.html > > > >for > > > OpenStack? I didn't see anything in the docs mentioning it one way or > > > the other. > > > > > > Thanks, > > > Ben > > > > > > -- > > > about.me/benmccann > > > > > > > > > -- > about.me/benmccann > -- Mahendra http://twitter.com/mahendra
