Re: [Openstack] nova backup - instances unreachable

2017-01-23 Thread John Petrini
Adding disable_libvirt_livesnapshot = false to the nova.conf enabled live snapshots. Thanks everyone for the help. ___ John Petrini NOC Systems Administrator // *CoreDial, LLC* // coredial.com // [image: Twitter] [image: LinkedIn]

Re: [Openstack] nova backup - instances unreachable

2017-01-23 Thread John Petrini
Hi Eugen, disable_libvirt_livesnapshot is not present in the nova.conf. During the snapshot the nova logs says "Beginning cold snapshot". I read about this option in the nova documentation but did not realize it was the default. In fact I assumed it wasn't since it's in the workarounds section.

Re: [Openstack] nova backup - instances unreachable

2017-01-23 Thread Eugen Block
Have you enabled live snapshots in nova.conf? The default for this option is "true", so you should check that: disable_libvirt_livesnapshot = false Is it really a live snaphot? What's in the nova-compute.log? It should say something like [instance: XXX] Beginning live snapshot process

Re: [Openstack] nova backup - instances unreachable

2017-01-20 Thread John Petrini
Hi All, Following up after making this change. Adding write permissions to the images pool in Ceph did the trick and RBD snapshots now work. However the instance is still paused for the duration of the snapshot. Is it possible to do a live snapshot without pausing the instance? Thanks, John On

Re: [Openstack] nova backup - instances unreachable

2017-01-13 Thread Eugen Block
Thanks, for anyone interested in this issue, I filed a bug report: https://bugs.launchpad.net/nova/+bug/1656242 Regards, Eugen Zitat von Mohammed Naser : It is likely because this has been tested with QEMU only. I think you might want to bring this up with the Nova

Re: [Openstack] nova backup - instances unreachable

2017-01-12 Thread Mohammed Naser
It is likely because this has been tested with QEMU only. I think you might want to bring this up with the Nova team. Sent from my iPhone > On Jan 12, 2017, at 11:28 AM, Eugen Block wrote: > > I'm not sure if this is the right spot, but I added some log statements into >

Re: [Openstack] nova backup - instances unreachable

2017-01-12 Thread Eugen Block
Yes, I truncated the file and uploaded it: http://dropcanvas.com/ta7nu (First time I used this service, please give me feedback if this doesn't work for you) I see the "Beginning cold snapshot process" message, but I don't know why. Any help is appreciated! Regards, Eugen Zitat von

Re: [Openstack] nova backup - instances unreachable

2017-01-12 Thread Mohammed Naser
Would you be able to share the logs of a full snapshot run with the compute node in debug? Sent from my iPhone > On Jan 12, 2017, at 7:47 AM, Eugen Block wrote: > > That's strange, I also searched for this message, but nothing there. I have > debug logs enabled on compute node

Re: [Openstack] nova backup - instances unreachable

2017-01-12 Thread Eugen Block
That's strange, I also searched for this message, but nothing there. I have debug logs enabled on compute node but I don't see anything regarding ceph. No matter, what I do, my instance is always shutdown before a snapshot is taken. What else can I try? Zitat von John Petrini

Re: [Openstack] nova backup - instances unreachable

2017-01-11 Thread John Petrini
Mohammed, It looks like you may be right. Just found the permissions issue in the nova log on the compute node. 4-e8f52e4fbcfb 691caf1c10354efab3e3c8ed61b7d89a 49bc5e5bf2684bd0948d9f94c7875027 - - -] Performing standard snapshot because direct snapshot failed: no write permission on storage pool

Re: [Openstack] nova backup - instances unreachable

2017-01-11 Thread Mohammed Naser
Hi John, It just works for us with Mitaka. You might be running with issues regarding permissions where the Nova user might not be able to write to the images pool. Turn debug on in your nova compute and snapshot a machine on it, you'll see the logs and if it's turning it off, it's probably

Re: [Openstack] nova backup - instances unreachable

2017-01-11 Thread Eugen Block
Have you or anyone else implemented this in Mitaka? Yes, we are also running Mitaka and I also read Sebastien Han's blogs ;-) our snapshots are not happening at the RBD level, they are being copied and uploaded to glance which takes up a lot of space and is very slow. Unfortunately, that's

Re: [Openstack] nova backup - instances unreachable

2017-01-11 Thread Eugen Block
Hi, this seems to be exptected, the docs say: "Shut down the source VM before you take the snapshot to ensure that all data is flushed to disk." So if the VM is not shut down, it's freezed to prevent data loss (I guess). Depending on your storage backend, there are other ways to perform

[Openstack] nova backup - instances unreachable

2017-01-05 Thread John Petrini
Hello, I've just started experimenting with nova backup and discovered that there is a period of time during the snapshot where the instance becomes unreachable. Is this behavior expected during a live snapshot? Is there any way to prevent this? ___ John Petrini