Reviewed: https://review.openstack.org/126903 Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=6e79981b7caadbbbb2119461034dfe7b4d1c1a64 Submitter: Jenkins Branch: proposed/juno
commit 6e79981b7caadbbbb2119461034dfe7b4d1c1a64 Author: Derek Higgins <[email protected]> Date: Fri Sep 12 16:31:44 2014 +0100 Retry getting the list of service plugins On systems that start both neutron-server and neutron-l3-agent together, there is a chance that the first call to neutron will timeout. Retry upto 4 more times to avoid the l3 agent exiting on startup. This should make the l3 agent a little more robust on startup but still not ideal, ideally it wouldn't exit and retry periodically. Change-Id: I2171a164f3f77bccd89895d73c1c8d67f7190488 Closes-Bug: #1353953 Closes-Bug: #1368152 Closes-Bug: #1368795 (cherry picked from commit e7f0b56d74fbfbb08a3b7a0d2da4cefb6fe2aa67) ** Changed in: neutron Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1353953 Title: Race between neutron-server and l3-agent Status in OpenStack Neutron (virtual network service): Fix Released Status in tripleo - openstack on openstack: In Progress Bug description: http://logs.openstack.org/58/87758/24/check-tripleo/check-tripleo- novabm-overcloud-f20-nonha/848e217/console.html 2014-08-07 10:35:52.753 | + wait_for 30 10 ping -c 1 192.0.2.46 2014-08-07 10:42:23.169 | Timing out after 300 seconds: 2014-08-07 10:42:23.169 | COMMAND=ping -c 1 192.0.2.46 2014-08-07 10:42:23.169 | OUTPUT=PING 192.0.2.46 (192.0.2.46) 56(84) bytes of data. 2014-08-07 10:42:23.169 | From 192.0.2.46 icmp_seq=1 Destination Host Unreachable 2014-08-07 10:42:23.169 | 2014-08-07 10:42:23.169 | --- 192.0.2.46 ping statistics looks like neutron dhcp agent issues http://logs.openstack.org/58/87758/24/check-tripleo/check-tripleo- novabm-overcloud-f20-nonha/848e217/logs/overcloud-controller0_logs /neutron-dhcp-agent.txt.gz Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv sudo[14027]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ip netns exec qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6 ip link set tap7e59533d-32 up Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: 2014-08-07 10:31:10.476 12316 ERROR neutron.agent.linux.utils [req-fdebecfd-81d2-48c2-8765-7545e1e9dbb1 None] Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6', 'ip', 'link', 'set', 'tap7e59533d-32', 'up'] Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Exit code: 1 Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stdout: '' Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stderr: 'Cannot open network namespace "qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6": No such file or directory\n' Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv sudo[14032]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ip netns exec qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6 ip -o link show tap7e59533d-32 Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: 2014-08-07 10:31:10.596 12316 ERROR neutron.agent.linux.utils [req-fdebecfd-81d2-48c2-8765-7545e1e9dbb1 None] Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6', 'ip', '-o', 'link', 'show', 'tap7e59533d-32'] Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Exit code: 1 Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stdout: '' Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stderr: 'Cannot open network namespace "qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6": No such file or directory\n' To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1353953/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
