[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
** Changed in: landscape Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
** Changed in: simplestreams (Ubuntu Bionic) Status: In Progress => Fix Released ** Changed in: simplestreams (Ubuntu Bionic) Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
TL;DR version: We are going to fix Bionic simplestreams package and provide this Bionic simplestreams package in Ubuntu Cloud Archive for Xenial. With that, we are fixing Xenial simplestreams behavior (to work with keystone v3) only if end-user enables Ubuntu Cloud Archive. Conversation about this topic: https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/simplestreams/+git/simplestreams/+merge/373030/comments/980111 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
** Changed in: simplestreams (Ubuntu Xenial) Status: In Progress => Won't Fix ** Changed in: simplestreams (Ubuntu Bionic) Status: Fix Released => In Progress ** Changed in: simplestreams (Ubuntu Xenial) Assignee: Rafael David Tinoco (rafaeldtinoco) => (unassigned) ** Changed in: simplestreams (Ubuntu Bionic) Assignee: (unassigned) => Rafael David Tinoco (rafaeldtinoco) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
** Merge proposal linked: https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/simplestreams/+git/simplestreams/+merge/373030 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
For Xenial SRU, please read summary at: https://bugs.launchpad.net/ubuntu/+source/simplestreams/+bug/1686437/comments/19 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1583276 Title: glance restarted during image upload, image stuck in "saving" state To manage notifications about this bug go to: https://bugs.launchpad.net/glance-simplestreams-sync-charm/+bug/1583276/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1583276] Re: glance restarted during image upload, image stuck in "saving" state
** Description changed:
+ [Impact]
+
CI run: https://ci.lscape.net/job/landscape-system-tests/2451/
gs3 log attached. Below some excerpts:
It looks like the problem started when it uploaded the first image (14.04) to
glance. That failed:
WARNING * 05-18 13:36:48 [PID:10259] * root * No rabbitmq connection
available for msg{'status': 'Syncing', 'message':
'ubuntu-trusty-14.04-amd64-server-20160516 99%\n
DEBUG * 05-18 13:36:50 [PID:10259] * glanceclient.common.http * curl -i
-X POST -H 'x-image-meta-property-source_content_id:
com.ubuntu.cloud:released:download' -H 'INFO * 05-18 13:37:01 [PID:10364]
* root * glance-simplestreams-sync started.
INFO * 05-18 13:37:01 [PID:10364] * root *
/var/run/glance-simplestreams-sync.pid is locked, exiting
ERROR * 05-18 13:37:07 [PID:10259] * root * Glance Client exception
during do_sync:
Error communicating with http://10.96.10.146:9292 [Errno 32] Broken pipe
Will continue polling.
Traceback (most recent call last):
- File "/usr/share/glance-simplestreams-sync/glance-simplestreams-sync.py",
line 444, in main
- do_sync(charm_conf, status_exchange)
- File "/usr/share/glance-simplestreams-sync/glance-simplestreams-sync.py",
line 215, in do_sync
- tmirror.sync(smirror, path=initial_path)
- File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 91, in sync
- return self.sync_index(reader, path, data, content)
- File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 254, in sync_index
- self.sync(reader, path=epath)
- File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 89, in sync
- return self.sync_products(reader, path, data, content)
- File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 341, in sync_products
- self.insert_item(item, src, target, pgree, ipath_cs)
- File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/glance.py",
line 303, in insert_item
- ret = self.gclient.images.create(**create_kwargs)
- File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line
253, in create
- 'POST', '/v1/images', headers=hdrs, body=image_data)
- File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line
289, in raw_request
- return self._http_request(url, method, **kwargs)
- File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line
235, in _http_request
- raise exc.CommunicationError(message=message)
+ File "/usr/share/glance-simplestreams-sync/glance-simplestreams-sync.py",
line 444, in main
+ do_sync(charm_conf, status_exchange)
+ File "/usr/share/glance-simplestreams-sync/glance-simplestreams-sync.py",
line 215, in do_sync
+ tmirror.sync(smirror, path=initial_path)
+ File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 91, in sync
+ return self.sync_index(reader, path, data, content)
+ File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 254, in sync_index
+ self.sync(reader, path=epath)
+ File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 89, in sync
+ return self.sync_products(reader, path, data, content)
+ File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/__init__.py",
line 341, in sync_products
+ self.insert_item(item, src, target, pgree, ipath_cs)
+ File "/usr/lib/python2.7/dist-packages/simplestreams/mirrors/glance.py",
line 303, in insert_item
+ ret = self.gclient.images.create(**create_kwargs)
+ File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line
253, in create
+ 'POST', '/v1/images', headers=hdrs, body=image_data)
+ File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line
289, in raw_request
+ return self._http_request(url, method, **kwargs)
+ File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line
235, in _http_request
+ raise exc.CommunicationError(message=message)
CommunicationError: Error communicating with http://10.96.10.146:9292 [Errno
32] Broken pipe
INFO * 05-18 13:37:07 [PID:10259] * root * sync done.
INFO * 05-18 13:38:01 [PID:10372] * root * glance-simplestreams-sync
started.
+
+ [Test Case]
Found evidence in the juju logs for glance/0 that it restarted right at
13:37:07:
2016-05-18 13:37:07 INFO ceph-relation-changed ^MReading state information...
0%^MReading state information... 0%^MReading state information... Done
2016-05-18 13:37:07 INFO juju-log ceph:50: Loaded template from
templates/ceph.conf
2016-05-18 13:37:07 INFO juju-log ceph:50: Rendering from template: ceph.conf
2016-05-18 13:37:07 INFO juju-log ceph:50: Wrote template
/var/lib/charm/glance/ceph.conf.
2016-05-18 13:37:07 INFO ceph-relation-changed glance-api stop/waiting
2016-05-18 13:37:07 INFO ceph-relation-changed glance-api start/running,
process 62839
