[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Changed in: cloud-archive Status: In Progress => Invalid -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
This bug was fixed in the package neutron - 1:2015.1.3-0ubuntu1 --- neutron (1:2015.1.3-0ubuntu1) trusty-kilo; urgency=medium . [ Corey Bryant ] * d/tests/neutron-agents: Give daemon 5 seconds to start to prevent race. . [ James Page ] * New upstream stable release (LP: #1559215): - d/p/dhcp-protect-against-case-when-device-name-is-none.patch: Dropped, included upstream. * Ensure tunnels are fully reconstructed after openvswitch restarts (LP: #1460164): - d/p/ovs-restart.patch: Cherry picked from upstream review. ** Changed in: cloud-archive/kilo Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Branch linked: lp:~ubuntu-server-dev/neutron/kilo -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Changed in: cloud-archive/kilo Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Changed in: cloud-archive/kilo Assignee: Ihar Hrachyshka (ihar-hrachyshka) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Changed in: cloud-archive/icehouse Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
This bug was fixed in the package neutron - 2:7.0.3-0ubuntu1 --- neutron (2:7.0.3-0ubuntu1) wily; urgency=medium * New upstream point release (LP: #1544568): - Ensure that tunnels are fully reset on ovs restart (LP: #1460164). - d/p/iproute2-compat.patch: Drop, included upstream. -- James Page Thu, 11 Feb 2016 17:07:16 + -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
This bug was fixed in the package neutron - 1:2014.1.5-0ubuntu3 --- neutron (1:2014.1.5-0ubuntu3) trusty; urgency=medium [ Corey Bryant ] * d/p/make_del_fdb_flow_idempotent.patch: Cherry pick from Juno to prevent KeyError on duplicate port removal in del_fdb_flow() (LP: #1531963). * d/tests/*-plugin: Fix race between service restart and pidof test. [ James Page ] * d/p/ovs-restart.patch: Ensure that tunnels are fully reset on ovs restart (LP: #1460164). -- Corey Bryant Wed, 10 Feb 2016 14:52:04 -0500 ** Changed in: neutron (Ubuntu Trusty) Status: Fix Committed => Fix Released ** Changed in: neutron (Ubuntu Wily) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
This has passed testing so I'm marking it as verification-done. ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Hello James, or anyone else affected, Accepted neutron into wily-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/2:7.0.3-0ubuntu1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: neutron (Ubuntu Wily) Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Also affects: cloud-archive/icehouse Importance: Undecided Status: New ** Changed in: cloud-archive/icehouse Status: New => Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Hello James, or anyone else affected, Accepted neutron into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/1:2014.1.5-0ubuntu3 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: neutron (Ubuntu Trusty) Status: In Progress => Fix Committed ** Tags added: verification-needed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Changed in: cloud-archive/kilo Status: New => In Progress ** Changed in: cloud-archive/kilo Assignee: (unassigned) => Ihar Hrachyshka (ihar-hrachyshka) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Description changed:
+ [Impact]
+ Restarts of openvswitch (typically on upgrade) result in loss of tunnel
connectivity when the l2population driver is in use. This results in loss of
access to all instances on the effected compute hosts
+
+ [Test Case]
+ Deploy cloud with ml2/ovs/l2population enabled
+ boot instances
+ restart ovs; instance connectivity will be lost until the
neutron-openvswitch-agent is restarted on the compute hosts.
+
+ [Regression Potential]
+ Minimal - in multiple stable branches upstream.
+
+ [Original Bug Report]
On 2015-05-28, our Landscape auto-upgraded packages on two of our
OpenStack clouds. On both clouds, but only on some compute nodes, the
upgrade of openvswitch-switch and corresponding downtime of
ovs-vswitchd appears to have triggered some sort of race condition
within neutron-plugin-openvswitch-agent leaving it in a broken state;
any new instances come up with non-functional network but pre-existing
instances appear unaffected. Restarting n-p-ovs-agent on the affected
compute nodes is sufficient to work around the problem.
The packages Landscape upgraded (from /var/log/apt/history.log):
Start-Date: 2015-05-28 14:23:07
Upgrade: nova-compute-libvirt:amd64 (2014.1.4-0ubuntu2, 2014.1.4-0ubuntu2.1),
libsystemd-login0:amd64 (204-5ubuntu20.11, 204-5ubuntu20.12),
nova-compute-kvm:amd64 (2014.1.4-0ubuntu2, 2014.1.4-0ubuntu2.1),
systemd-services:amd64 (204-5ubuntu20.11, 204-5ubuntu20.12),
isc-dhcp-common:amd64 (4.2.4-7ubuntu12.1, 4.2.4-7ubuntu12.2), nova-common:amd64
(2014.1.4-0ubuntu2, 2014.1.4-0ubuntu2.1), python-nova:amd64 (2014.1.4-0ubuntu2,
2014.1.4-0ubuntu2.1), libsystemd-daemon0:amd64 (204-5ubuntu20.11,
204-5ubuntu20.12), grub-common:amd64 (2.02~beta2-9ubuntu1.1,
2.02~beta2-9ubuntu1.2), libpam-systemd:amd64 (204-5ubuntu20.11,
204-5ubuntu20.12), udev:amd64 (204-5ubuntu20.11, 204-5ubuntu20.12),
grub2-common:amd64 (2.02~beta2-9ubuntu1.1, 2.02~beta2-9ubuntu1.2),
openvswitch-switch:amd64 (2.0.2-0ubuntu0.14.04.1, 2.0.2-0ubuntu0.14.04.2),
libudev1:amd64 (204-5ubuntu20.11, 204-5ubuntu20.12), isc-dhcp-client:amd64
(4.2.4-7ubuntu12.1, 4.2.4-7ubuntu12.2), python-eventlet:amd64 (0.13.0-1ubuntu2,
0.13.0-1ubuntu
2.1), python-novaclient:amd64 (2.17.0-0ubuntu1.1, 2.17.0-0ubuntu1.2),
grub-pc-bin:amd64 (2.02~beta2-9ubuntu1.1, 2.02~beta2-9ubuntu1.2), grub-pc:amd64
(2.02~beta2-9ubuntu1.1, 2.02~beta2-9ubuntu1.2), nova-compute:amd64
(2014.1.4-0ubuntu2, 2014.1.4-0ubuntu2.1), openvswitch-common:amd64
(2.0.2-0ubuntu0.14.04.1, 2.0.2-0ubuntu0.14.04.2)
End-Date: 2015-05-28 14:24:47
From /var/log/neutron/openvswitch-agent.log:
2015-05-28 14:24:18.336 47866 ERROR neutron.agent.linux.ovsdb_monitor
[-] Error received from ovsdb monitor: ovsdb-client:
unix:/var/run/openvswitch/db.sock: receive failed (End of file)
Looking at a stuck instances, all the right tunnels and bridges and
what not appear to be there:
root@vector:~# ip l l | grep c-3b
- 460002: qbr7ed8b59c-3b: mtu 1500 qdisc
noqueue state UP mode DEFAULT group default
+ 460002: qbr7ed8b59c-3b: mtu 1500 qdisc
noqueue state UP mode DEFAULT group default
460003: qvo7ed8b59c-3b: mtu 1500
qdisc pfifo_fast master ovs-system state UP mode DEFAULT group default qlen 1000
460004: qvb7ed8b59c-3b: mtu 1500
qdisc pfifo_fast master qbr7ed8b59c-3b state UP mode DEFAULT group default qlen
1000
460005: tap7ed8b59c-3b: mtu 1500 qdisc
pfifo_fast master qbr7ed8b59c-3b state UNKNOWN mode DEFAULT group default qlen
500
root@vector:~# ovs-vsctl list-ports br-int | grep c-3b
qvo7ed8b59c-3b
- root@vector:~#
+ root@vector:~#
But I can't ping the unit from within the qrouter-${id} namespace on
the neutron gateway. If I tcpdump the {q,t}*c-3b interfaces, I don't
see any traffic.
** Changed in: neutron (Ubuntu Trusty)
Status: New => In Progress
** Changed in: neutron (Ubuntu Trusty)
Assignee: (unassigned) => James Page (james-page)
** Also affects: cloud-archive
Importance: Undecided
Status: New
** Also affects: cloud-archive/juno
Importance: Undecided
Status: New
** Also affects: cloud-archive/kilo
Importance: Undecided
Status: New
** Changed in: cloud-archive/kilo
Importance: Undecided => Medium
** Changed in: cloud-archive/juno
Importance: Undecided => Medium
** Changed in: neutron (Ubuntu Trusty)
Importance: Undecided => High
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to neutron in Ubuntu.
https://bugs.launchpad.net/bugs/1460164
Title:
restart of openvswitch-switch causes instance network down when
l2population enabled
To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Branch linked: lp:~ubuntu-server-dev/neutron/icehouse -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Also affects: neutron (Ubuntu Xenial) Importance: High Status: Triaged ** Also affects: neutron (Ubuntu Trusty) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Wily) Importance: Undecided Status: New ** Changed in: neutron (Ubuntu Xenial) Status: Triaged => Fix Released ** Changed in: neutron (Ubuntu Wily) Importance: Undecided => High ** Changed in: neutron (Ubuntu Wily) Status: New => In Progress ** Changed in: neutron (Ubuntu Wily) Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Reviewed: https://review.openstack.org/272566 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=05f8099a68918342b6e0a65e78619becfa19a4ae Submitter: Jenkins Branch:stable/liberty commit 05f8099a68918342b6e0a65e78619becfa19a4ae Author: James Page Date: Fri Dec 18 15:02:11 2015 + Ensure that tunnels are fully reset on ovs restart When the l2population mechanism driver is enabled, if ovs is restarted tunnel ports are not re-configured in full due to stale ofport handles in the OVS agent. Reset all handles when OVS is restarted to ensure that tunnels are fully recreated in this situation. Change-Id: If0e034a034a7f000a1c58aa8a43d2c857dee6582 Closes-bug: #1460164 (cherry picked from commit 17c14977ce0e2291e911739f8c85838f1c1f3473) ** Tags added: in-stable-liberty -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Reviewed: https://review.openstack.org/259485 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=17c14977ce0e2291e911739f8c85838f1c1f3473 Submitter: Jenkins Branch:master commit 17c14977ce0e2291e911739f8c85838f1c1f3473 Author: James Page Date: Fri Dec 18 15:02:11 2015 + Ensure that tunnels are fully reset on ovs restart When the l2population mechanism driver is enabled, if ovs is restarted tunnel ports are not re-configured in full due to stale ofport handles in the OVS agent. Reset all handles when OVS is restarted to ensure that tunnels are fully recreated in this situation. Change-Id: If0e034a034a7f000a1c58aa8a43d2c857dee6582 Closes-bug: #1460164 ** Changed in: neutron Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Tags added: l2-pop -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Are liberty (most likely) or kilo affected by this bug? In such case add kilo-backport-potential &/or liberty-backport- potential, please. ** Tags added: kilo-backport-potential liberty-backport-potential -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
based on the IRC conversation with James Page, I added the backport flags. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Fix proposed to branch: master Review: https://review.openstack.org/259485 ** Changed in: neutron Status: New => In Progress ** Changed in: neutron Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Resetting the ofport trackers appears to resolve the problem for a openvswitch-switch restart. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
The fdb_add method checks to see if the agent already has a registered ofport for each tunnel it requires - this is now stale, so results in the tunnel setup being skipped - the tunnel ports are still present in the ovsdb - however all of the flows are missing resulting in full loss of instance connectivity. ** Also affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
On a full agent restart, tunnels are setup:
2015-12-18 14:41:51.505 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
826251b8-cc26-435e-9488-16ae67bde4f6 updated. Details: {u'admin_state_up':
True, u'network_id': u'15b42697-cf68-4b78-9e19-2d167d0b37cc',
u'segmentation_id': 5, u'physical_network': None, u'device':
u'826251b8-cc26-435e-9488-16ae67bde4f6', u'port_id':
u'826251b8-cc26-435e-9488-16ae67bde4f6', u'network_type': u'gre'}
2015-12-18 14:41:51.506 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as local
vlan for net-id=15b42697-cf68-4b78-9e19-2d167d0b37cc
2015-12-18 14:41:51.757 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent
[req-c53ce242-0dc1-41d2-9ab9-de88980dc3ab None] setup_tunnel_port: gre-0a052634
10.5.38.52 gre
2015-12-18 14:41:51.769 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device 826251b8-cc26-435e-9488-16ae67bde4f6 completed.
2015-12-18 14:41:51.868 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] setup_tunnel_port:
gre-0a052630 10.5.38.48 gre
2015-12-18 14:41:51.974 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] setup_tunnel_port:
gre-0a052633 10.5.38.51 gre
but on a openvswitch-switch restart, this does not happen:
5-12-18 14:42:21.836 17767 ERROR neutron.agent.linux.ovsdb_monitor [-] Error
received from ovsdb monitor: ovsdb-client: unix:/var/run/openvswitch/db.sock:
receive failed (End of file)
2015-12-18 14:42:23.103 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Mapping physical
network physnet1 to bridge br-data
2015-12-18 14:42:24.923 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent tunnel out of
sync with plugin!
2015-12-18 14:42:25.188 17767 INFO neutron.agent.securitygroups_rpc [-]
Preparing filters for devices set([u'826251b8-cc26-435e-9488-16ae67bde4f6'])
2015-12-18 14:42:25.664 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
826251b8-cc26-435e-9488-16ae67bde4f6 updated. Details: {u'admin_state_up':
True, u'network_id': u'15b42697-cf68-4b78-9e19-2d167d0b37cc',
u'segmentation_id': 5, u'physical_network': None, u'device':
u'826251b8-cc26-435e-9488-16ae67bde4f6', u'port_id':
u'826251b8-cc26-435e-9488-16ae67bde4f6', u'network_type': u'gre'}
2015-12-18 14:42:25.665 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as local
vlan for net-id=15b42697-cf68-4b78-9e19-2d167d0b37cc
2015-12-18 14:42:26.054 17767 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device 826251b8-cc26-435e-9488-16ae67bde4f6 completed.
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to neutron in Ubuntu.
https://bugs.launchpad.net/bugs/1460164
Title:
restart of openvswitch-switch causes instance network down when
l2population enabled
To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1460164/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled
Looking at the tunnel_sync function in Icehouse: def tunnel_sync(self): resync = False try: for tunnel_type in self.tunnel_types: details = self.plugin_rpc.tunnel_sync(self.context, self.local_ip, tunnel_type) if not self.l2_pop: tunnels = details['tunnels'] for tunnel in tunnels: if self.local_ip != tunnel['ip_address']: you can quite clearly see that if l2_pop is enabled, then tunnel ports are not setup after the restart. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/1460164/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
