subject:"\[Yahoo\-eng\-team\] \[Bug 1439472\] Re\: OVS doesn't restart properly when Exception occurred"

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

2016-03-28 Thread watanabe.isao

** Changed in: neutron/kilo
   Status: New => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1439472

Title:
  OVS doesn't restart properly when Exception occurred

Status in neutron:
  Fix Released
Status in neutron kilo series:
  Fix Released

Bug description:
  Wish this fix can be fixed into kilo. If it's not able due to the bad timing, 
wish this fix can be merged into stable/kilo.
  ---
  [The problem]
  If there is an Exception (such as DBConnectionError) occurred/occurring when 
OVS restart,
  OVS will return "every thing is OK :-)",
  while flow of created network in br-tun will NOT be recovered. :-(
  Unless user operation of OVS restart has been executed.
  ---
  [action and log]
  [q-agent.log]
  [[[create network and subnet and add it to DHCP agent]]]
  [[[I turned off MySQL]]]
  [[[But nothing happened]]]
  [[[Then I restarted OVS]]]
  [[[Here it goes...]]]
  ...
  ...
  ...
  2015-04-01 22:06:48.237 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.060 INFO 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Agent tunnel out of sync 
with plugin!
  2015-04-01 22:06:56.061 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
705639bc86ae44f4b4cc28715ce981e8 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.062 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
41f997f166c04cff986ff08eb298b3eb. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.085 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.111 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
6f012243c4844978a7b8181bedcafcc9 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.112 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
04ed1ccb78bb4ab495b9ebf40c2338f5. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.138 ERROR 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Error while processing VIF 
ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call 
last):
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1522, in rpc_loop
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent ovs_restarted)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1260, in process_network_ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
port_info.get('updated', set()))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 360, in 
setup_port_filters
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
self.prepare_devices_filter(new_devices)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 219, in 
decorated_function
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent *args, **kwargs)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 229, in 
prepare_devices_filter
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent self.context, 
list(device_ids))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 116, in 
security_group_info_for_devices
  2015-04

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

2015-07-23 Thread Alan Pevec

** Also affects: neutron/kilo
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1439472

Title:
  OVS doesn't restart properly when Exception occurred

Status in neutron:
  Fix Released
Status in neutron kilo series:
  New

Bug description:
  Wish this fix can be fixed into kilo. If it's not able due to the bad timing, 
wish this fix can be merged into stable/kilo.
  ---
  [The problem]
  If there is an Exception (such as DBConnectionError) occurred/occurring when 
OVS restart,
  OVS will return "every thing is OK :-)",
  while flow of created network in br-tun will NOT be recovered. :-(
  Unless user operation of OVS restart has been executed.
  ---
  [action and log]
  [q-agent.log]
  [[[create network and subnet and add it to DHCP agent]]]
  [[[I turned off MySQL]]]
  [[[But nothing happened]]]
  [[[Then I restarted OVS]]]
  [[[Here it goes...]]]
  ...
  ...
  ...
  2015-04-01 22:06:48.237 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.060 INFO 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Agent tunnel out of sync 
with plugin!
  2015-04-01 22:06:56.061 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
705639bc86ae44f4b4cc28715ce981e8 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.062 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
41f997f166c04cff986ff08eb298b3eb. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.085 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.111 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
6f012243c4844978a7b8181bedcafcc9 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.112 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
04ed1ccb78bb4ab495b9ebf40c2338f5. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.138 ERROR 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Error while processing VIF 
ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call 
last):
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1522, in rpc_loop
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent ovs_restarted)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1260, in process_network_ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
port_info.get('updated', set()))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 360, in 
setup_port_filters
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
self.prepare_devices_filter(new_devices)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 219, in 
decorated_function
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent *args, **kwargs)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 229, in 
prepare_devices_filter
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent self.context, 
list(device_ids))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 116, in 
security_group_info_for_devices
  2015-

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

2015-06-24 Thread Thierry Carrez

** Changed in: neutron
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1439472

Title:
  OVS doesn't restart properly when Exception occurred

Status in OpenStack Neutron (virtual network service):
  Fix Released

Bug description:
  Wish this fix can be fixed into kilo. If it's not able due to the bad timing, 
wish this fix can be merged into stable/kilo.
  ---
  [The problem]
  If there is an Exception (such as DBConnectionError) occurred/occurring when 
OVS restart,
  OVS will return "every thing is OK :-)",
  while flow of created network in br-tun will NOT be recovered. :-(
  Unless user operation of OVS restart has been executed.
  ---
  [action and log]
  [q-agent.log]
  [[[create network and subnet and add it to DHCP agent]]]
  [[[I turned off MySQL]]]
  [[[But nothing happened]]]
  [[[Then I restarted OVS]]]
  [[[Here it goes...]]]
  ...
  ...
  ...
  2015-04-01 22:06:48.237 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.060 INFO 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Agent tunnel out of sync 
with plugin!
  2015-04-01 22:06:56.061 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
705639bc86ae44f4b4cc28715ce981e8 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.062 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
41f997f166c04cff986ff08eb298b3eb. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.085 DEBUG 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Unable to sync tunnel IP 
192.168.122.96: Remote error: DBConnectionError (OperationalError) (2003, 
"Can't connect to MySQL server on '127.0.0.1' (111)") None None
  ...
  ...
  ...
  2015-04-01 22:06:56.111 DEBUG oslo_messaging._drivers.amqpdriver 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] MSG_ID is 
6f012243c4844978a7b8181bedcafcc9 _send 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:311
  2015-04-01 22:06:56.112 DEBUG oslo_messaging._drivers.amqp 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] UNIQUE_ID is 
04ed1ccb78bb4ab495b9ebf40c2338f5. _add_unique_id 
/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:258
  2015-04-01 22:06:56.138 ERROR 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
[req-352cd26d-7278-483e-a873-7558d0f37acd None None] Error while processing VIF 
ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call 
last):
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1522, in rpc_loop
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent ovs_restarted)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", 
line 1260, in process_network_ports
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
port_info.get('updated', set()))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 360, in 
setup_port_filters
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent 
self.prepare_devices_filter(new_devices)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 219, in 
decorated_function
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent *args, **kwargs)
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 229, in 
prepare_devices_filter
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent self.context, 
list(device_ids))
  2015-04-01 22:06:56.138 3698 TRACE 
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File 
"/opt/stack/neutron/neutron/agent/securitygroups_rpc.py", line 116, in 
security_group_info_for_devices
  2015-04-01 2

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

[Yahoo-eng-team] [Bug 1439472] Re: OVS doesn't restart properly when Exception occurred

3 matches

Site Navigation

Mail list logo

Footer information