*** This bug is a duplicate of bug 1533457 *** https://bugs.launchpad.net/bugs/1533457
** This bug is no longer a duplicate of bug 1605546 Race with deleting HA routers ** This bug has been marked a duplicate of bug 1533457 Neutron server unable to sync HA info after race between HA router creating and deleting -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1606801 Title: deleting router run into race condition Status in neutron: New Bug description: After deleting a router the logfiles of both network nodes are filled up with " RuntimeError: Exit code: 1; Stdin: ; Stdout: ; Stderr: Cannot open network namespace "qrouter-3767" After i have restarted the openstack services on the network nodes, no new entries Reproduceable: yes Steps: * add router via CLI or dashboard * delete router via CLI or dashboard * logfiles grow up Openstack version: mitaka ( this error occured on liberty too ! ) OS: Centos 7, latest updates Installed Packages on nerwork nodes openstack-neutron-vpnaas-8.0.0-1.el7.noarch openstack-neutron-common-8.1.2-1.el7.noarch openstack-neutron-metering-agent-8.1.2-1.el7.noarch python-neutronclient-4.1.1-2.el7.noarch python-neutron-8.1.2-1.el7.noarch python-neutron-fwaas-8.0.0-3.el7.noarch openstack-neutron-ml2-8.1.2-1.el7.noarch openstack-neutron-bgp-dragent-8.1.2-1.el7.noarch python-neutron-vpnaas-8.0.0-1.el7.noarch openstack-neutron-openvswitch-8.1.2-1.el7.noarch openstack-neutron-8.1.2-1.el7.noarch python-neutron-lib-0.0.2-1.el7.noarch openstack-neutron-fwaas-8.0.0-3.el7.noarch Logfile network node: 2.770 44778 DEBUG neutron.agent.linux.ra [-] radvd disabled for router 37678766-597a-4e33-b83a-65142ca2ced8 disable /usr/lib/python2.7/site-packages/neutron/agent/linux/ra.py:190 2016-07-27 09:10:02.770 44778 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'qrouter-37678766-597a-4e33-b83a-65142ca2ced8', 'find', '/sys/class/net', '-maxdepth', '1', '-type', 'l', '-printf', '%f '] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:100 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.linux.utils [-] Exit code: 1; Stdin: ; Stdout: ; Stderr: Cannot open network namespace "qrouter-37678766-597a-4e33-b83a-65142ca2ced8": No such file or directory 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent [-] Error while deleting router 37678766-597a-4e33-b83a-65142ca2ced8 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 359, in _safe_router_removed 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent self._router_removed(router_id) 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 377, in _router_removed 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent ri.delete(self) 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 380, in delete 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent super(HaRouter, self).delete(agent) 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/router_info.py", line 349, in delete 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent self.router_namespace.delete() 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/namespaces.py", line 100, in delete 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent for d in ns_ip.get_devices(exclude_loopback=True): 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 130, in get_devices 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent log_fail_as_error=self.log_fail_as_error 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 140, in execute 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent raise RuntimeError(msg) 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent RuntimeError: Exit code: 1; Stdin: ; Stdout: ; Stderr: Cannot open network namespace "qrouter-37678766-597a-4e33-b83a-65142ca2ced8": No such file or directory 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent 2016-07-27 09:10:02.773 44778 ERROR neutron.agent.l3.agent Attached logfiles of control node and both network nodes. At 09:09:00 -> added router At 09:10:00 -> deleted router To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1606801/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp