[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Marking Juno as "Won't fix" for the Ubuntu Cloud Archive since it is EOL. ** Changed in: cloud-archive/juno Status: New => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Tags removed: kilo-backport-potential liberty-backport-potential -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Also affects: neutron/kilo Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Reviewed: https://review.openstack.org/272643 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=b79ed67ef703be3a034ed0cf95d401b0711dae46 Submitter: Jenkins Branch:stable/kilo commit b79ed67ef703be3a034ed0cf95d401b0711dae46 Author: James Page

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive Status: In Progress => Invalid -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive Status: In Progress => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 1:2015.1.3-0ubuntu1 --- neutron (1:2015.1.3-0ubuntu1) trusty-kilo; urgency=medium . [ Corey Bryant ] * d/tests/neutron-agents: Give daemon 5 seconds to start to prevent race. . [ James Page ] * New upstream stable release (LP:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 1:2015.1.3-0ubuntu1 --- neutron (1:2015.1.3-0ubuntu1) trusty-kilo; urgency=medium . [ Corey Bryant ] * d/tests/neutron-agents: Give daemon 5 seconds to start to prevent race. . [ James Page ] * New upstream stable release (LP:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Branch linked: lp:~ubuntu-server-dev/neutron/kilo -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Branch linked: lp:~ubuntu-server-dev/neutron/kilo -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Assignee: Ihar Hrachyshka (ihar-hrachyshka) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Assignee: Ihar Hrachyshka (ihar-hrachyshka) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/icehouse Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/icehouse Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 1:2014.1.5-0ubuntu3 --- neutron (1:2014.1.5-0ubuntu3) trusty; urgency=medium [ Corey Bryant ] * d/p/make_del_fdb_flow_idempotent.patch: Cherry pick from Juno to prevent KeyError on duplicate port removal in del_fdb_flow() (LP:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 2:7.0.3-0ubuntu1 --- neutron (2:7.0.3-0ubuntu1) wily; urgency=medium * New upstream point release (LP: #1544568): - Ensure that tunnels are fully reset on ovs restart (LP: #1460164). - d/p/iproute2-compat.patch: Drop, included

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 2:7.0.3-0ubuntu1 --- neutron (2:7.0.3-0ubuntu1) wily; urgency=medium * New upstream point release (LP: #1544568): - Ensure that tunnels are fully reset on ovs restart (LP: #1460164). - d/p/iproute2-compat.patch: Drop, included

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This bug was fixed in the package neutron - 1:2014.1.5-0ubuntu3 --- neutron (1:2014.1.5-0ubuntu3) trusty; urgency=medium [ Corey Bryant ] * d/p/make_del_fdb_flow_idempotent.patch: Cherry pick from Juno to prevent KeyError on duplicate port removal in del_fdb_flow() (LP:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This has passed testing so I'm marking it as verification-done. ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu.

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

This has passed testing so I'm marking it as verification-done. ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Hello James, or anyone else affected, Accepted neutron into wily-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/2:7.0.3-0ubuntu1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Hello James, or anyone else affected, Accepted neutron into wily-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/2:7.0.3-0ubuntu1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Also affects: cloud-archive/icehouse Importance: Undecided Status: New ** Changed in: cloud-archive/icehouse Status: New => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Also affects: cloud-archive/icehouse Importance: Undecided Status: New ** Changed in: cloud-archive/icehouse Status: New => Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu.

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Hello James, or anyone else affected, Accepted neutron into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/1:2014.1.5-0ubuntu3 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Hello James, or anyone else affected, Accepted neutron into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/neutron/1:2014.1.5-0ubuntu3 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Status: New => In Progress ** Changed in: cloud-archive/kilo Assignee: (unassigned) => Ihar Hrachyshka (ihar-hrachyshka) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Changed in: cloud-archive/kilo Status: New => In Progress ** Changed in: cloud-archive/kilo Assignee: (unassigned) => Ihar Hrachyshka (ihar-hrachyshka) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu.

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Also affects: neutron (Ubuntu Xenial) Importance: High Status: Triaged ** Also affects: neutron (Ubuntu Trusty) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Wily) Importance: Undecided Status: New ** Changed in: neutron (Ubuntu Xenial)

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Also affects: neutron (Ubuntu Xenial) Importance: High Status: Triaged ** Also affects: neutron (Ubuntu Trusty) Importance: Undecided Status: New ** Also affects: neutron (Ubuntu Wily) Importance: Undecided Status: New ** Changed in: neutron (Ubuntu Xenial)

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Branch linked: lp:~ubuntu-server-dev/neutron/icehouse -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Description changed: + [Impact] + Restarts of openvswitch (typically on upgrade) result in loss of tunnel connectivity when the l2population driver is in use. This results in loss of access to all instances on the effected compute hosts + + [Test Case] + Deploy cloud with

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Branch linked: lp:~ubuntu-server-dev/neutron/icehouse -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Description changed: + [Impact] + Restarts of openvswitch (typically on upgrade) result in loss of tunnel connectivity when the l2population driver is in use. This results in loss of access to all instances on the effected compute hosts + + [Test Case] + Deploy cloud with

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Reviewed: https://review.openstack.org/272566 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=05f8099a68918342b6e0a65e78619becfa19a4ae Submitter: Jenkins Branch:stable/liberty commit 05f8099a68918342b6e0a65e78619becfa19a4ae Author: James Page

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Reviewed: https://review.openstack.org/272566 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=05f8099a68918342b6e0a65e78619becfa19a4ae Submitter: Jenkins Branch:stable/liberty commit 05f8099a68918342b6e0a65e78619becfa19a4ae Author: James Page

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Tags added: l2-pop -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Tags added: l2-pop -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Reviewed: https://review.openstack.org/259485 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=17c14977ce0e2291e911739f8c85838f1c1f3473 Submitter: Jenkins Branch:master commit 17c14977ce0e2291e911739f8c85838f1c1f3473 Author: James Page Date:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Reviewed: https://review.openstack.org/259485 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=17c14977ce0e2291e911739f8c85838f1c1f3473 Submitter: Jenkins Branch:master commit 17c14977ce0e2291e911739f8c85838f1c1f3473 Author: James Page Date:

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Are liberty (most likely) or kilo affected by this bug? In such case add kilo-backport-potential &/or liberty-backport- potential, please. ** Tags added: kilo-backport-potential liberty-backport-potential -- You received this bug notification because you are a member of Ubuntu Bugs, which is

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Are liberty (most likely) or kilo affected by this bug? In such case add kilo-backport-potential &/or liberty-backport- potential, please. ** Tags added: kilo-backport-potential liberty-backport-potential -- You received this bug notification because you are a member of Ubuntu Server Team,

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

based on the IRC conversation with James Page, I added the backport flags. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

based on the IRC conversation with James Page, I added the backport flags. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes instance network down when l2population enabled To manage notifications about

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

The fdb_add method checks to see if the agent already has a registered ofport for each tunnel it requires - this is now stale, so results in the tunnel setup being skipped - the tunnel ports are still present in the ovsdb - however all of the flows are missing resulting in full loss of instance

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

The fdb_add method checks to see if the agent already has a registered ofport for each tunnel it requires - this is now stale, so results in the tunnel setup being skipped - the tunnel ports are still present in the ovsdb - however all of the flows are missing resulting in full loss of instance

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

On a full agent restart, tunnels are setup: 2015-12-18 14:41:51.505 17767 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port 826251b8-cc26-435e-9488-16ae67bde4f6 updated. Details: {u'admin_state_up': True, u'network_id': u'15b42697-cf68-4b78-9e19-2d167d0b37cc',

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Fix proposed to branch: master Review: https://review.openstack.org/259485 ** Changed in: neutron Status: New => In Progress ** Changed in: neutron Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Server

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Resetting the ofport trackers appears to resolve the problem for a openvswitch-switch restart. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of openvswitch-switch causes

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Resetting the ofport trackers appears to resolve the problem for a openvswitch-switch restart. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1460164 Title: restart of

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Fix proposed to branch: master Review: https://review.openstack.org/259485 ** Changed in: neutron Status: New => In Progress ** Changed in: neutron Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Bugs, which

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

On a full agent restart, tunnels are setup: 2015-12-18 14:41:51.505 17767 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port 826251b8-cc26-435e-9488-16ae67bde4f6 updated. Details: {u'admin_state_up': True, u'network_id': u'15b42697-cf68-4b78-9e19-2d167d0b37cc',

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Looking at the tunnel_sync function in Icehouse: def tunnel_sync(self): resync = False try: for tunnel_type in self.tunnel_types: details = self.plugin_rpc.tunnel_sync(self.context,

[Bug 1460164] Re: restart of openvswitch-switch causes instance network down when l2population enabled

Looking at the tunnel_sync function in Icehouse: def tunnel_sync(self): resync = False try: for tunnel_type in self.tunnel_types: details = self.plugin_rpc.tunnel_sync(self.context,