[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2014.2.3-0ubuntu1.1 --- nova (1:2014.2.3-0ubuntu1.1) utopic; urgency=medium * d/nova-compute.upstart: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Mon, 06 Jul 2015 12:06:00 +0100 ** Changed in: nova (Ubuntu Utopic) Status: Fix Committed = Fix Released ** Changed in: nova (Ubuntu Vivid) Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2014.1.5-0ubuntu1.1 --- nova (1:2014.1.5-0ubuntu1.1) trusty; urgency=medium [ Edward Hope-Morley ] - d/nova-compute.upstart: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022) -- Edward Hope-Morley edward.hope-mor...@canonical.com Wed, 08 Jul 2015 09:44:18 -0500 ** Changed in: nova (Ubuntu Trusty) Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2014.1.5-0ubuntu1.1 --- nova (1:2014.1.5-0ubuntu1.1) trusty; urgency=medium [ Edward Hope-Morley ] - d/nova-compute.upstart: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022) -- Edward Hope-Morley edward.hope-mor...@canonical.com Wed, 08 Jul 2015 09:44:18 -0500 ** Changed in: nova (Ubuntu Trusty) Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2014.2.3-0ubuntu1.1 --- nova (1:2014.2.3-0ubuntu1.1) utopic; urgency=medium * d/nova-compute.upstart: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Mon, 06 Jul 2015 12:06:00 +0100 ** Changed in: nova (Ubuntu Utopic) Status: Fix Committed = Fix Released ** Changed in: nova (Ubuntu Vivid) Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2015.1.0-0ubuntu1.1 --- nova (1:2015.1.0-0ubuntu1.1) vivid; urgency=medium * d/nova-compute.upstart.in: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Fri, 03 Jul 2015 18:57:59 +0100 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 1:2015.1.0-0ubuntu1.1 --- nova (1:2015.1.0-0ubuntu1.1) vivid; urgency=medium * d/nova-compute.upstart.in: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Fri, 03 Jul 2015 18:57:59 +0100 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/icehouse -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/icehouse -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
T/U/V verified *-proposed builds. Deployed Openstack I/J/K with these packages and all seems good. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
T/U/V verified *-proposed builds. Deployed Openstack I/J/K with these packages and all seems good. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch removed: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423971/+files/trusty.debdiff ** Patch added: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4426408/+files/trusty.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch removed: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423971/+files/trusty.debdiff ** Patch added: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4426408/+files/trusty.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
Hello Edward, or anyone else affected, Accepted nova into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/1:2014.1.5-0ubuntu1.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: nova (Ubuntu Trusty) Status: In Progress = Fix Committed ** Tags added: verification-needed ** Changed in: nova (Ubuntu Utopic) Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
Hello Edward, or anyone else affected, Accepted nova into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/1:2014.1.5-0ubuntu1.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: nova (Ubuntu Trusty) Status: In Progress = Fix Committed ** Tags added: verification-needed ** Changed in: nova (Ubuntu Utopic) Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
Hello Edward, or anyone else affected, Accepted nova into vivid-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/1:2015.1.0-0ubuntu1.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: nova (Ubuntu Vivid) Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
Hello Edward, or anyone else affected, Accepted nova into vivid-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/1:2015.1.0-0ubuntu1.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: nova (Ubuntu Vivid) Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/kilo -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/kilo -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: wily.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4425020/+files/wily.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: wily.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4425020/+files/wily.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/juno -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Branch linked: lp:~ubuntu-server-dev/nova/juno -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 2:12.0.0~b1-0ubuntu2 --- nova (2:12.0.0~b1-0ubuntu2) wily; urgency=medium * d/nova-compute.upstart.in: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Mon, 06 Jul 2015 11:53:51 +0100 ** Changed in: nova (Ubuntu) Status: In Progress = Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
This bug was fixed in the package nova - 2:12.0.0~b1-0ubuntu2 --- nova (2:12.0.0~b1-0ubuntu2) wily; urgency=medium * d/nova-compute.upstart.in: Fix (another) race between nova-compute and neutron-ovs-cleanup (LP: #1471022). -- Edward Hope-Morley edward.hope-mor...@canonical.com Mon, 06 Jul 2015 11:53:51 +0100 ** Changed in: nova (Ubuntu) Status: In Progress = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
To clarify, the reason I am not using wait-for-state (http://pastebin.ubuntu.com/11820672/) with WAIT_FOREVER=Y is primarily because it will attempt to start the WAIT_FOR service once only then go into an infinite wait loop which could be a problem in nova upgrade scenarios where we would be waiting for neutron-ovs-cleanup to start when it may not, itself, be waiting to start perhaps because it (or it's dependencies) might never start resulting in nova-compute never starting. So what I am implementing here is a repeated retry with increasing interval but with a finite number of attempts so that nova- compute will always eventually start but not after giving neutron-ovs- cleanup (if installed) plenty of time to start. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
To clarify, the reason I am not using wait-for-state (http://pastebin.ubuntu.com/11820672/) with WAIT_FOREVER=Y is primarily because it will attempt to start the WAIT_FOR service once only then go into an infinite wait loop which could be a problem in nova upgrade scenarios where we would be waiting for neutron-ovs-cleanup to start when it may not, itself, be waiting to start perhaps because it (or it's dependencies) might never start resulting in nova-compute never starting. So what I am implementing here is a repeated retry with increasing interval but with a finite number of attempts so that nova- compute will always eventually start but not after giving neutron-ovs- cleanup (if installed) plenty of time to start. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
So it does appear that this a result of the openvswitch-switch service
taking a while to startup on boot/reboot. I have added some retry logic
to nova-compute and it appears that openvswitch is taking around 80s to
start:
neutron-ovs-cleanup start/pre-start, process 3055
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 1s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 3s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 3s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 5s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 5s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 7s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 7s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 9s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 9s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 11s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 11s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 13s
neutron-ovs-cleanup start/running
2015-07-03 17:51:40.660 15690 DEBUG nova.servicegroup.api [-] ServiceGroup
driver defined as an instance of db __new__
/usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2015-07-03 17:51:43.053 15690 INFO nova.openstack.common.periodic_task [-]
Skipping periodic task _periodic_update_dns because its interval is negative
2015-07-03 17:51:44.320 15690 DEBUG stevedore.extension [-] found extension
EntryPoint.parse('file = nova.image.download.file') _load_plugins
/usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-07-03 17:51:44.602 15690 DEBUG stevedore.extension [-] found extension
EntryPoint.parse('file = nova.image.download.file') _load_plugins
/usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-07-03 17:51:44.603 15690 INFO nova.virt.driver [-] Loading compute driver
'libvirt.LibvirtDriver'
I'll have an SRU patch up shortlty
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to nova in Ubuntu.
https://bugs.launchpad.net/bugs/1471022
Title:
[SRU] race between nova-compute and neutron-ovs-cleanup
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
So it does appear that this a result of the openvswitch-switch service
taking a while to startup on boot/reboot. I have added some retry logic
to nova-compute and it appears that openvswitch is taking around 80s to
start:
neutron-ovs-cleanup start/pre-start, process 3055
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 1s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 3s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 3s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 5s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 5s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 7s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 7s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 9s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 9s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 11s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 11s
neutron-ovs-cleanup start/pre-start, process 3055
Attempting to start neutron-ovs-cleanup
start: Job is already running: neutron-ovs-cleanup
Recheck neutron-ovs-cleanup status in 13s
neutron-ovs-cleanup start/running
2015-07-03 17:51:40.660 15690 DEBUG nova.servicegroup.api [-] ServiceGroup
driver defined as an instance of db __new__
/usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2015-07-03 17:51:43.053 15690 INFO nova.openstack.common.periodic_task [-]
Skipping periodic task _periodic_update_dns because its interval is negative
2015-07-03 17:51:44.320 15690 DEBUG stevedore.extension [-] found extension
EntryPoint.parse('file = nova.image.download.file') _load_plugins
/usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-07-03 17:51:44.602 15690 DEBUG stevedore.extension [-] found extension
EntryPoint.parse('file = nova.image.download.file') _load_plugins
/usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-07-03 17:51:44.603 15690 INFO nova.virt.driver [-] Loading compute driver
'libvirt.LibvirtDriver'
I'll have an SRU patch up shortlty
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1471022
Title:
[SRU] race between nova-compute and neutron-ovs-cleanup
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: utopic.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423972/+files/utopic.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: utopic.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423972/+files/utopic.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: vivid.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423974/+files/vivid.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Description changed: + [Impact] + This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. + + The proposed solution here is add some retry logic to nova-compute + upstart job to tolerate neutron-ovs-cleanup not being able to start yet. + We, therefore, allow a certain number of retries, every other with an + incremented delay, before giving up and allowing nova-compute to start + anyway. If ovs-cleanup failed to start after what is a failry liberal + retry period, it is assumed to have failed altogether this making is + safe(ish) to start nova-compute. + + [Test Case] + + In one terminal (as root) do: + service neutron-ovs-cleanup stop; service openvswitch-switch stop; service nova-compute restart + + In another do: + sudo tail -F /var/log/upstart/nova-compute.log + + Observe the retries occurring + + Then do 'sudo service openvswitch-switch start' and observe nova-compute + retry and succeed. + + [Regression Potential] + + * If openvswitch-switch does not start within the max retries and + intervals nova-compute will start anyway and of ovs-cleanup were at some + point to run one would see the behaviour that LP 1420572 was intended to + resolve. It does not seem to make sense to wait indefinitely for ovs- + cleanup to be up and the coded interval is pretty liberal and should be + plenty enough. ** Changed in: nova (Ubuntu Trusty) Status: New = In Progress ** Changed in: nova (Ubuntu Utopic) Status: New = In Progress ** Changed in: nova (Ubuntu Vivid) Status: New = In Progress ** Changed in: nova (Ubuntu Trusty) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Changed in: nova (Ubuntu Utopic) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Changed in: nova (Ubuntu Vivid) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Description changed: [Impact] This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. The proposed solution here is add some retry logic to nova-compute upstart job to tolerate neutron-ovs-cleanup not being able to start yet. We, therefore, allow a certain number of retries, every other with an incremented delay, before giving up and allowing nova-compute to start anyway. If ovs-cleanup failed to start after what is a failry liberal - retry period, it is assumed to have failed altogether this making is + retry period, it is assumed to have failed altogether thus making is safe(ish) to start nova-compute. [Test Case] In one terminal (as root) do: service neutron-ovs-cleanup stop; service openvswitch-switch stop; service nova-compute restart In another do: sudo tail -F /var/log/upstart/nova-compute.log Observe the retries occurring Then do 'sudo service openvswitch-switch start' and observe nova-compute retry and succeed. [Regression Potential] - * If openvswitch-switch does not start within the max retries and + * If openvswitch-switch does not start within the max retries and intervals nova-compute will start anyway and of ovs-cleanup were at some point to run one would see the behaviour that LP 1420572 was intended to resolve. It does not seem to make sense to wait indefinitely for ovs- cleanup to be up and the coded interval is pretty liberal and should be plenty enough. ** Description changed: [Impact] This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Description changed: + [Impact] + This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. + + The proposed solution here is add some retry logic to nova-compute + upstart job to tolerate neutron-ovs-cleanup not being able to start yet. + We, therefore, allow a certain number of retries, every other with an + incremented delay, before giving up and allowing nova-compute to start + anyway. If ovs-cleanup failed to start after what is a failry liberal + retry period, it is assumed to have failed altogether this making is + safe(ish) to start nova-compute. + + [Test Case] + + In one terminal (as root) do: + service neutron-ovs-cleanup stop; service openvswitch-switch stop; service nova-compute restart + + In another do: + sudo tail -F /var/log/upstart/nova-compute.log + + Observe the retries occurring + + Then do 'sudo service openvswitch-switch start' and observe nova-compute + retry and succeed. + + [Regression Potential] + + * If openvswitch-switch does not start within the max retries and + intervals nova-compute will start anyway and of ovs-cleanup were at some + point to run one would see the behaviour that LP 1420572 was intended to + resolve. It does not seem to make sense to wait indefinitely for ovs- + cleanup to be up and the coded interval is pretty liberal and should be + plenty enough. ** Changed in: nova (Ubuntu Trusty) Status: New = In Progress ** Changed in: nova (Ubuntu Utopic) Status: New = In Progress ** Changed in: nova (Ubuntu Vivid) Status: New = In Progress ** Changed in: nova (Ubuntu Trusty) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Changed in: nova (Ubuntu Utopic) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Changed in: nova (Ubuntu Vivid) Assignee: (unassigned) = Edward Hope-Morley (hopem) ** Description changed: [Impact] This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. The proposed solution here is add some retry logic to nova-compute upstart job to tolerate neutron-ovs-cleanup not being able to start yet. We, therefore, allow a certain number of retries, every other with an incremented delay, before giving up and allowing nova-compute to start anyway. If ovs-cleanup failed to start after what is a failry liberal - retry period, it is assumed to have failed altogether this making is + retry period, it is assumed to have failed altogether thus making is safe(ish) to start nova-compute. [Test Case] In one terminal (as root) do: service neutron-ovs-cleanup stop; service openvswitch-switch stop; service nova-compute restart In another do: sudo tail -F /var/log/upstart/nova-compute.log Observe the retries occurring Then do 'sudo service openvswitch-switch start' and observe nova-compute retry and succeed. [Regression Potential] - * If openvswitch-switch does not start within the max retries and + * If openvswitch-switch does not start within the max retries and intervals nova-compute will start anyway and of ovs-cleanup were at some point to run one would see the behaviour that LP 1420572 was intended to resolve. It does not seem to make sense to wait indefinitely for ovs- cleanup to be up and the coded interval is pretty liberal and should be plenty enough. ** Description changed: [Impact] This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423971/+files/trusty.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: vivid.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423974/+files/vivid.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Patch added: trusty.debdiff https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+attachment/4423971/+files/trusty.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
The attachment trusty.debdiff seems to be a debdiff. The ubuntu- sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the patch flag from the attachment, remove the patch tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team. [This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.] ** Tags added: patch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
The attachment trusty.debdiff seems to be a debdiff. The ubuntu- sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the patch flag from the attachment, remove the patch tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team. [This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.] ** Tags added: patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Also affects: neutron (Ubuntu Utopic) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Vivid) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Trusty) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Also affects: neutron (Ubuntu Utopic) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Vivid) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Trusty) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Description changed: This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there - is now a race between the two whereby nova-compute fails to start or - boot/reboot with the following in /var/log/upstart/nova-compute.log: + is now a race between the two whereby nova-compute sometimes fails to + start or boot/reboot with the following in /var/log/upstart/nova- + compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. ** Description changed: This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to - start or boot/reboot with the following in /var/log/upstart/nova- + start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. ** Changed in: neutron (Ubuntu Trusty) Importance: Undecided = High ** Changed in: neutron (Ubuntu Utopic) Importance: Undecided = High ** Changed in: neutron (Ubuntu Vivid) Importance: Undecided = High ** Changed in: neutron (Ubuntu) Status: New = In Progress ** Changed in: neutron (Ubuntu) Assignee: (unassigned) = Edward Hope-Morley (hopem) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
** Description changed: This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there - is now a race between the two whereby nova-compute fails to start or - boot/reboot with the following in /var/log/upstart/nova-compute.log: + is now a race between the two whereby nova-compute sometimes fails to + start or boot/reboot with the following in /var/log/upstart/nova- + compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. ** Description changed: This issue appears to be a consequence of https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1420572 where we added a 'wait-for-state running' to the nova-compute upstart so as to ensure that neutron-ovs-cleanup has finished before nova-compute starts. I have started to spot, however, that on some hosts (metal only) there is now a race between the two whereby nova-compute sometimes fails to - start or boot/reboot with the following in /var/log/upstart/nova- + start on system boot/reboot with the following in /var/log/upstart/nova- compute.log: ... libvirt-bin stop/waiting wait-for-state stop/waiting neutron-ovs-cleanup start/pre-start, process 3084 start: Job failed to start If I manually restart nova-compute all is fine. So this looks like a race between nova-compute's wait-for-state and neutron-ovs-cleanup's pre-start - start/running. ** Changed in: neutron (Ubuntu Trusty) Importance: Undecided = High ** Changed in: neutron (Ubuntu Utopic) Importance: Undecided = High ** Changed in: neutron (Ubuntu Vivid) Importance: Undecided = High ** Changed in: neutron (Ubuntu) Status: New = In Progress ** Changed in: neutron (Ubuntu) Assignee: (unassigned) = Edward Hope-Morley (hopem) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
So, this is possibly a result of neutron-ovs-cleaunp failing to start at the time nova-compute does the wait-for-state (and implicitly tries to start neutron-ovs-cleanup) due to the fact that openvswitch is not ready to start at that very moment. I am going to attempt to resolve this by making the nova-compute wait-for-state logic more accommodating of the fact that neutron-ovs-cleanup may not be ready to start at the time of the check. ** Package changed: neutron (Ubuntu) = nova (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1471022] Re: [SRU] race between nova-compute and neutron-ovs-cleanup
So, this is possibly a result of neutron-ovs-cleaunp failing to start at the time nova-compute does the wait-for-state (and implicitly tries to start neutron-ovs-cleanup) due to the fact that openvswitch is not ready to start at that very moment. I am going to attempt to resolve this by making the nova-compute wait-for-state logic more accommodating of the fact that neutron-ovs-cleanup may not be ready to start at the time of the check. ** Package changed: neutron (Ubuntu) = nova (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1471022 Title: [SRU] race between nova-compute and neutron-ovs-cleanup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1471022/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
