Re: [openstack-dev] [Glance] Proposed S3 multi-part upload functionality
Thanks, I'm done here. https://review.openstack.org/#/c/49316/ - Ozawa > Ozawa, +1 to what Zhi said. Go ahead and submit a patch for review and we can > consider it for Icehouse. Also try to attend the glance meeting if possible > and we can discuss it there. > > Having better uploads/downloads and specifically better error handling for > uploads and downloads would definitely help conserve resources and improve > time taken. > > Iccha > > -Original Message- > From: "Zhi Yan Liu" > Sent: Monday, September 30, 2013 1:29am > To: "OpenStack Development Mailing List" > Subject: Re: [openstack-dev] [Glance] Proposed S3 multi-part upload > functionality > > On Mon, Sep 30, 2013 at 12:22 PM, Masashi Ozawa wrote: > > Hi everyone, > > > > We already created the blueprint for this feature below belore, if > > Glance can use S3 MultiPart Upload REST API for the large objects in > > future release as Amazon recommends it for the large object to be > > uploaded, I believe that it's very useful for the customers and a good > > thing for AWS and other S3 servers. > > > > https://blueprints.launchpad.net/glance/+spec/s3-multi-part-upload > > > > However it's not in the future release list so we actually implemeted > > this feature based on Grizzly for an internal testing porpose and it > > works so far. > > > > Made the implementation strategy below. So please review this so that > > we can hopefully have this feature in the future openstack release. > > > > - Proposal S3 multi-part upload functionality > > https://etherpad.openstack.org/s3-multi-part-upload > > > > thanks, > > - Ozawa > > -- > > Cloudian KK - http://cloudian.jp/ > > Masashi Ozawa > > > > > > ___ > > OpenStack-dev mailing list > > OpenStack-dev@lists.openstack.org > > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > Hello Masashi Ozawa, > > I consider it's a worth enhancement for s3 store driver, with a minor > change and a boto requirement update. You can just prepare your patch > base on the trunk code and commit it to Gerrit to allow team take a > review If you like. > Actually I'm just thinking if a resume-broken-transfer (image > uploading and downloading) is a useful thing for Glance as a common > requirement/enhancement. Any thoughts from you(s)? > > thanks, > zhiyan > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Glance] Proposed S3 multi-part upload functionality
Ozawa, +1 to what Zhi said. Go ahead and submit a patch for review and we can consider it for Icehouse. Also try to attend the glance meeting if possible and we can discuss it there. Having better uploads/downloads and specifically better error handling for uploads and downloads would definitely help conserve resources and improve time taken. Iccha -Original Message- From: "Zhi Yan Liu" Sent: Monday, September 30, 2013 1:29am To: "OpenStack Development Mailing List" Subject: Re: [openstack-dev] [Glance] Proposed S3 multi-part upload functionality On Mon, Sep 30, 2013 at 12:22 PM, Masashi Ozawa wrote: > Hi everyone, > > We already created the blueprint for this feature below belore, if > Glance can use S3 MultiPart Upload REST API for the large objects in > future release as Amazon recommends it for the large object to be > uploaded, I believe that it's very useful for the customers and a good > thing for AWS and other S3 servers. > > https://blueprints.launchpad.net/glance/+spec/s3-multi-part-upload > > However it's not in the future release list so we actually implemeted > this feature based on Grizzly for an internal testing porpose and it > works so far. > > Made the implementation strategy below. So please review this so that > we can hopefully have this feature in the future openstack release. > > - Proposal S3 multi-part upload functionality > https://etherpad.openstack.org/s3-multi-part-upload > > thanks, > - Ozawa > -- > Cloudian KK - http://cloudian.jp/ > Masashi Ozawa > > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev Hello Masashi Ozawa, I consider it's a worth enhancement for s3 store driver, with a minor change and a boto requirement update. You can just prepare your patch base on the trunk code and commit it to Gerrit to allow team take a review If you like. Actually I'm just thinking if a resume-broken-transfer (image uploading and downloading) is a useful thing for Glance as a common requirement/enhancement. Any thoughts from you(s)? thanks, zhiyan ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Glance] Proposed S3 multi-part upload functionality
On Mon, Sep 30, 2013 at 12:22 PM, Masashi Ozawa wrote: > Hi everyone, > > We already created the blueprint for this feature below belore, if > Glance can use S3 MultiPart Upload REST API for the large objects in > future release as Amazon recommends it for the large object to be > uploaded, I believe that it's very useful for the customers and a good > thing for AWS and other S3 servers. > > https://blueprints.launchpad.net/glance/+spec/s3-multi-part-upload > > However it's not in the future release list so we actually implemeted > this feature based on Grizzly for an internal testing porpose and it > works so far. > > Made the implementation strategy below. So please review this so that > we can hopefully have this feature in the future openstack release. > > - Proposal S3 multi-part upload functionality > https://etherpad.openstack.org/s3-multi-part-upload > > thanks, > - Ozawa > -- > Cloudian KK - http://cloudian.jp/ > Masashi Ozawa > > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev Hello Masashi Ozawa, I consider it's a worth enhancement for s3 store driver, with a minor change and a boto requirement update. You can just prepare your patch base on the trunk code and commit it to Gerrit to allow team take a review If you like. Actually I'm just thinking if a resume-broken-transfer (image uploading and downloading) is a useful thing for Glance as a common requirement/enhancement. Any thoughts from you(s)? thanks, zhiyan ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Glance] Proposed S3 multi-part upload functionality
Hi everyone, We already created the blueprint for this feature below belore, if Glance can use S3 MultiPart Upload REST API for the large objects in future release as Amazon recommends it for the large object to be uploaded, I believe that it's very useful for the customers and a good thing for AWS and other S3 servers. https://blueprints.launchpad.net/glance/+spec/s3-multi-part-upload However it's not in the future release list so we actually implemeted this feature based on Grizzly for an internal testing porpose and it works so far. Made the implementation strategy below. So please review this so that we can hopefully have this feature in the future openstack release. - Proposal S3 multi-part upload functionality https://etherpad.openstack.org/s3-multi-part-upload thanks, - Ozawa -- Cloudian KK - http://cloudian.jp/ Masashi Ozawa ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
