[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Ok, closing the LP task as well for now, thanks Chavez ** Changed in: qemu (Ubuntu) Status: Incomplete => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
BTW - libvirt 3.6 is available for a while in 17.10 now. Any new test results? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Hmm, so still happening on libvirt 2.5 then reading your logs. Yet I miss a way to reproduce for now. I'll soon (hopefully) have an even newer libvirt available for 17.10 which we could retest to see if there is a known fix. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Hi Lee, thanks for sharing - things start to make more and more sense. We happened to have other slightly similar issues to occur somewhat more often in openstack CI while hardly anywhere else. The other efforts of debugging are currently waiting on testing experimental PPAs at bug 1673483. Now since this is: - about blockjobs - seems hard to reproduce in other setups - somewhat reproducible in the openstack-ci It might as well be due to the same reasons. But that would mean for now we would need the same thing which is checking if the suggested PPAs There was a discussion on the ML about this as well. If you read around the bashing you'll find as well that the next step is about testing these ppas to consider them for an SRU if helpful (after more regression checks). So far it seems to be quite effort to splice a ppa in there, if you happen to be able to do so on your end of things please give it a try at [1]! [1]: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1673483/comments/5 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
As discussed on the ML in c#25 we are continuing to see this in the OpenStack CI. I've included some links to some examples below : http://logs.openstack.org/43/458843/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/747160c/logs/subnode-2/libvirt/qemu/instance-0002.txt.gz http://logs.openstack.org/43/458843/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/747160c/logs/libvirt/qemu/instance-0002.txt.gz http://logs.openstack.org/40/459840/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/2978a6b/logs/subnode-2/libvirt/qemu/instance-0002.txt.gz http://logs.openstack.org/40/459840/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/2978a6b/logs/libvirt/qemu/instance-0002.txt.gz -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Source: ls -1 /var/lib/uvtool/libvirt/images/* /var/lib/uvtool/libvirt/images/kvmguest-xenial-normal-ds.qcow /var/lib/uvtool/libvirt/images/kvmguest-xenial-normal.qcow /var/lib/uvtool/libvirt/images/x-uvt-b64-Y29tLnVidW50dS5jbG91ZC5kYWlseTpzZXJ2ZXI6MTYuMDQ6cHBjNjRlbCAyMDE3MDQyNA== Target: /var/lib/uvtool/libvirt/images/x-uvt-b64-Y29tLnVidW50dS5jbG91ZC5kYWlseTpzZXJ2ZXI6MTYuMDQ6cHBjNjRlbCAyMDE3MDQyNA== So the base image is there that the qcows refer to (is a prereq) qemu-img info /var/lib/uvtool/libvirt/images/kvmguest-xenial-normal.qcow image: /var/lib/uvtool/libvirt/images/kvmguest-xenial-normal.qcow [...] backing file: /var/lib/uvtool/libvirt/images/x-uvt-b64-Y29tLnVidW50dS5jbG91ZC5kYWlseTpzZXJ2ZXI6MTYuMDQ6cHBjNjRlbCAyMDE3MDQyNA== Migration with --copy-storage-all working just fine (--copy-storage-inc as well). Tested on Xenial and Zesty as latest LTS and latest release (on ppc64el). I'll push that to the regular testing to see if it triggers on a more frequent testing. Might I ask if this is 100% reproducible for you or if it happens at a lower rate? So we are back to find what is different in your case and/or get the crash report you are seeing. ** Changed in: qemu (Ubuntu) Status: Triaged => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Ok, ppc64el test completed as well without triggering the bug as described. I'll tomorrow try to check on details of the disks you used, take bigger/smaller ones and such but for it seems reproproducible. Thant makes the comment of Greg even more important, if there are dumps generated at your crash please share them if possible. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Found a ppc host now and will run tests over night there as well to see if it was arch dependent. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
I added the copy-storage tests to my tests with actually shared storage, as well as without shared storage. It happened to work on my dev system (x86). My disks were qcow as we thought it would be the only important ingredient to trigger this. vda/var/lib/uvtool/libvirt/images/z-test1.qcow vdb/var/lib/uvtool/libvirt/images/z-test1-ds.qcow Given what code runs there I'd wonder if this is a architecture specific issue, but I'll push it to the auto-testing and check if it shows up on power (or s390). Our recent switch to the new development release artful aardvark will postpone this testing a few days until all daily images are ready. ... trying to find a sys I can bother manually. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1680162] Re: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed
Ok, thanks for the Details. Given that I think the underlying FS is not so important but as you spotted the diff raw/qcow2 seems to be. So I'm looking out to recreate this with qcow2 image guests then. I'm away for a few days, but fixes are hard atm due to the Zesty release freeze anyway. Finally, do you happen to know if this worked pre Zesty. I'll test on my own once I can reproduce, but maybe you just know. ** Changed in: qemu (Ubuntu) Status: Incomplete => Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1680162 Title: Ubuntu17.04 KVM: Non-shared migration: nbd_receive_request():L710: read failed To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1680162/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
