[Yahoo-eng-team] [Bug 1370989] [NEW] s3_store_host including port num not working

2014-09-18 Thread Masashi Ozawa 
Public bug reported:

Due to the following change in boto, s3_store_host with :port num
does not work for now.  If s3_store_host is configured with port num
like below, it will try to connect to 80 as the standard http port.

https://github.com/boto/boto/commit/0205cadde7b68c6648c410a9b1ef653655eae3b8

[/etc/glance/glace-api.conf]
s3_store_host=s3.cloudian.com:18080

** Affects: glance
 Importance: Undecided
 Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1370989

Title:
  s3_store_host including port num not working

Status in OpenStack Image Registry and Delivery Service (Glance):
  New

Bug description:
  Due to the following change in boto, s3_store_host with :port num
  does not work for now.  If s3_store_host is configured with port num
  like below, it will try to connect to 80 as the standard http port.

  https://github.com/boto/boto/commit/0205cadde7b68c6648c410a9b1ef653655eae3b8

  [/etc/glance/glace-api.conf]
  s3_store_host=s3.cloudian.com:18080

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1370989/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1360151] [NEW] utils.chunkreadable is not returning the correct chunk

2014-08-22 Thread Masashi Ozawa 
Public bug reported:

During the testing with the master glance with S3, we found that
utils.chunkreadable is not returning the correct chunk if the image
location URL is specified.

Because Implemented S3 multi-part upload functionality
(https://review.openstack.org/#/c/49316/) is merged into master, if the
image to be created is specified as URL like below and its size is
greater than 100MB(as default), it will always fail.

$ glance image-create --name=Ubuntu1404 Cloud --is-public=true
--container-format=ovf --disk-format=qcow2 --copy-from https://cloud-
images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img

Here is an excerpt from api.log.

2014-08-22 08:45:59.601 13656 INFO urllib3.connectionpool [-] Starting new HTTP 
connection (1): 10.184.145.84
2014-08-22 08:46:01.188 13656 INFO glance.api.v1.images [-] Triggering 
asynchronous copy from external source
2014-08-22 08:46:01.192 13656 INFO glance.wsgi.server [-] 10.184.145.84 - - 
[22/Aug/2014 08:46:01] POST /v1/images HTTP/1.1 201 722 1.592873
2014-08-22 08:46:03.257 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=1, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:03.765 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=2, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:04.273 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=3, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:04.528 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=4, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:05.036 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=5, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:05.291 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=6, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:05.545 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=7, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:05.799 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=8, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:05.802 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=9, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.054 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=10, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.308 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=11, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.319 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=12, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.563 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=13, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.573 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=14, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.817 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=15, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:06.827 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=16, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:07.072 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=17, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:07.082 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=18, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:07.326 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=19, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:07.335 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=20, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230, 
UploadId=MmI0ZDY2NTQ5MTQwODY5NzE2MjI2Mw
2014-08-22 08:46:07.364 13656 INFO glance.store.s3 [-] Uploading upload part in 
S3 partnum=21, size=65536, key=5f35132b-18e0-47a9-8d59-0370afd99230,