[Yahoo-eng-team] [Bug 1731597] [NEW] Can't set headers when using the list resource api in Neutron Client
Public bug reported: In neutronclient/v2_0/client.py, the api of listing resouce will call def list(self, collection, path, retrieve_all=True, **params): this list method will call def _pagination(self, collection, path, **params): this _pagination method will call def get(self, action, body=None, headers=None, params=None): We can see that we can set headers when using get(). But in list(),_pagination() they overlooked the headers. In order to list the resource, I used the api of list(). But when I call the api of list, I can't set headers. Best regards:-) ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1731597 Title: Can't set headers when using the list resource api in Neutron Client Status in neutron: New Bug description: In neutronclient/v2_0/client.py, the api of listing resouce will call def list(self, collection, path, retrieve_all=True, **params): this list method will call def _pagination(self, collection, path, **params): this _pagination method will call def get(self, action, body=None, headers=None, params=None): We can see that we can set headers when using get(). But in list(),_pagination() they overlooked the headers. In order to list the resource, I used the api of list(). But when I call the api of list, I can't set headers. Best regards:-) To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1731597/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731595] [NEW] L3 HA: multiple agents are active at the same time
Public bug reported: OS: Xenial, Ocata from Ubuntu Cloud Archive We have three neutron-gateway hosts, with L3 HA enabled and a min of 2, max of 3. There are approx. 400 routers defined. At some point (we weren't monitoring exactly) a number of the routers changed from being one active, and 1+ others standby, to >1 active. This included each of the 'active' namespaces having the same IP addresses allocated, and therefore traffic problems reaching instances. Removing the routers from all but one agent, and re-adding, resolved the issue. Restarting one l3 agent also appeared to resolve the issue, but very slowly, to the point where we needed the system alive again faster and reverted to removing/re-adding. At the same time, a number of routers were listed without any agents active at all. This situation appears to have been resolved by adding routers to agents, after several minutes downtime. I'm finding it very difficult to find relevant keepalived messages to indicate what's going on, but what I do notice is that all the agents have equal priority and are configured as 'backup'. I am trying to figure out a way to get a reproducer of this, it might be that we need to have a large number of routers configured on a small number of gateways. ** Affects: neutron Importance: Undecided Status: New ** Tags: canonical-bootstack -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1731595 Title: L3 HA: multiple agents are active at the same time Status in neutron: New Bug description: OS: Xenial, Ocata from Ubuntu Cloud Archive We have three neutron-gateway hosts, with L3 HA enabled and a min of 2, max of 3. There are approx. 400 routers defined. At some point (we weren't monitoring exactly) a number of the routers changed from being one active, and 1+ others standby, to >1 active. This included each of the 'active' namespaces having the same IP addresses allocated, and therefore traffic problems reaching instances. Removing the routers from all but one agent, and re-adding, resolved the issue. Restarting one l3 agent also appeared to resolve the issue, but very slowly, to the point where we needed the system alive again faster and reverted to removing/re-adding. At the same time, a number of routers were listed without any agents active at all. This situation appears to have been resolved by adding routers to agents, after several minutes downtime. I'm finding it very difficult to find relevant keepalived messages to indicate what's going on, but what I do notice is that all the agents have equal priority and are configured as 'backup'. I am trying to figure out a way to get a reproducer of this, it might be that we need to have a large number of routers configured on a small number of gateways. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1731595/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731395] Re: test_server_cfn_init and test_server_signal_userdata_format_software_config failing frequently
** Changed in: heat Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1731395 Title: test_server_cfn_init and test_server_signal_userdata_format_software_config failing frequently Status in OpenStack Heat: Invalid Status in OpenStack Compute (nova): Fix Released Bug description: Traceback: 2017-11-10 03:07:31.357527 | primary | 2017-11-10 03:07:31.357 | heat_integrationtests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_software_config 2017-11-10 03:07:31.359064 | primary | 2017-11-10 03:07:31.358 | 2017-11-10 03:07:31.360609 | primary | 2017-11-10 03:07:31.360 | 2017-11-10 03:07:31.362409 | primary | 2017-11-10 03:07:31.361 | Captured traceback: 2017-11-10 03:07:31.364077 | primary | 2017-11-10 03:07:31.363 | ~~~ 2017-11-10 03:07:31.365498 | primary | 2017-11-10 03:07:31.365 | Traceback (most recent call last): 2017-11-10 03:07:31.366965 | primary | 2017-11-10 03:07:31.366 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 387, in _stack_delete 2017-11-10 03:07:31.368528 | primary | 2017-11-10 03:07:31.368 | success_on_not_found=True) 2017-11-10 03:07:31.370051 | primary | 2017-11-10 03:07:31.369 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 368, in _wait_for_stack_status 2017-11-10 03:07:31.371436 | primary | 2017-11-10 03:07:31.371 | fail_regexp): 2017-11-10 03:07:31.372777 | primary | 2017-11-10 03:07:31.372 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 332, in _verify_status 2017-11-10 03:07:31.374123 | primary | 2017-11-10 03:07:31.373 | stack_status_reason=stack.stack_status_reason) 2017-11-10 03:07:31.375699 | primary | 2017-11-10 03:07:31.375 | heat_integrationtests.common.exceptions.StackBuildErrorException: Stack ServerSignalIntegrationTest-1700906107 is in DELETE_FAILED status due to 'Resource DELETE failed: ResourceInError: resources.server: Went to status ERROR due to "Server Se-gnalIntegrationTest-1700906107-server-l5mj3wi5kfci delete failed: (404) Port id 387d58a6-7a65-4514-9695-18bfcb2302f5 could not be found."' Noticed at: http://logs.openstack.org/40/509140/22/check/legacy-heat-dsvm-functional-orig-mysql-lbaasv2/b0e5f36/job-output.txt.gz http://logs.openstack.org/98/509098/19/check/heat-functional-convg- mysql-lbaasv2-amqp1/df22003/job-output.txt.gz From neutron logs: http://logs.openstack.org/40/509140/22/check/legacy-heat-dsvm-functional-orig-mysql-lbaasv2/b0e5f36/logs/screen-q-svc.txt.gz#_Nov_10_03_12_34_409860 Probably it's https://review.openstack.org/#/c/505613/ Testing the revert with https://review.openstack.org/518834 To manage notifications about this bug go to: https://bugs.launchpad.net/heat/+bug/1731395/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1693335] Re: UUID case sensitivity causing unfriendly and unexpected API errors
** Also affects: nova/ocata Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1693335 Title: UUID case sensitivity causing unfriendly and unexpected API errors Status in OpenStack Compute (nova): Fix Released Status in OpenStack Compute (nova) ocata series: In Progress Status in OpenStack Compute (nova) pike series: In Progress Bug description: I was seeing a user pass an uppercase UUID from their app to the Nova API's. Their calls failed with a 500 error and the following exception in the nova-api log: 017-05-24 11:20:27.176 68631 ERROR nova.api.openstack [req-674b4fd1-9a22-488e-97d2-29fca9ca3b7c 98afbc5675e059f7b1dde34c44d615712e3aafed8afcdfb5d890276ec554e737 951955d46e3a45c99e4c8649e8abe247 - - -] Caught error: 'NoneType' object has no attribute 'get' 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack Traceback (most recent call last): 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/__init__.py", line 139, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return req.get_response(self.application) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1317, in send 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack application, catch_exc_info=False) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1281, in call_application 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack app_iter = application(self.environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 130, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 195, in call_func 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return self.func(req, *args, **kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py", line 467, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack response = req.get_response(self._app) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1317, in send 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack application, catch_exc_info=False) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1281, in call_application 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack app_iter = application(self.environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/routes/middleware.py", line 131, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack response = self.app(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 130, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 195, in call_func 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return self.func(req, *args, **kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 672, in __call__ 2017-05-24 11:20:27.176 68631 ERROR
[Yahoo-eng-team] [Bug 1706750] Re: FlushError for automatic IPAllocations when subnet create is retried
We still see this failure happening in Red Hat CI with the same symptoms for OSP12 (Pike), reopening. ** Changed in: neutron Status: Fix Released => Confirmed ** Bug watch added: Red Hat Bugzilla #1506668 https://bugzilla.redhat.com/show_bug.cgi?id=1506668 -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1706750 Title: FlushError for automatic IPAllocations when subnet create is retried Status in neutron: Confirmed Bug description: The error is seen in Red Hat CI: https://bugzilla.redhat.com/show_bug.cgi?id=1470784 There are hits in Kibana too: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22FlushError%3A%20New%20instance%20%3CIPAllocation%20at%5C%22 In server.log: 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation [req-3c97d83e-3beb-4b28-a29f-697fc1ee8bc6 5f2e0d72ef8e4fb18b500759cfe5e503 205f2a3630a0426f8da20b4467ea003b - default default] POST failed.: FlushError: New instance with identity key (, ('2003::1:f816:3eff:fe3f:aa00', '8032a1cd-9236-4126-83fa-2f039ed2b890', 'c0542b84-bcd0-48e1-ace1-6da1f50246dc')) conflicts with persistent instance 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation Traceback (most recent call last): 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/pecan/core.py", line 678, in __call__ 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation self.invoke_controller(controller, args, kwargs, state) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/pecan/core.py", line 569, in invoke_controller 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation result = controller(*args, **kwargs) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 94, in wrapped 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation setattr(e, '_RETRY_EXCEEDED', True) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation six.reraise(self.type_, self.value, self.tb) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 90, in wrapped 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 150, in wrapper 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation ectxt.value = e.inner_exc 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation six.reraise(self.type_, self.value, self.tb) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 138, in wrapper 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 129, in wrapped 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation LOG.debug("Retry wrapper got retriable exception: %s", e) 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-07-13 15:20:51.064 85185 ERROR neutron.pecan_wsgi.hooks.translation six.reraise(self.type_, self.value, self.tb) 2017-07-13
[Yahoo-eng-team] [Bug 1731494] [NEW] neutron-openvswitch-agent crashes due to TypeError exception in ovs_ryuapp
Public bug reported: At some point during some rally test, we saw this exception in ovs agent logs: 2017-11-07 13:35:51.428 597682 DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-62f85bb3-db4c-4485-b35c-b7c1cafb3970 3d527bdd3ede4c6a97f91b701393b8e3 5f753e92a5d740fc97252bd39f868561 - - -] port_delete message processed for port 3e8348d0-40e1-4146-b803-1e6c6eddba53 port_delete /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:430 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp [req-141ecd16-22d7-4b1c-aa91-25d5077414f5 - - - - -] Agent main thread died of an exception: TypeError: int() can't convert non-string with explicit base 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp Traceback (most recent call last): 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_ryuapp.py", line 40, in agent_main_wrapper 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp ovs_agent.main(bridge_classes) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 2205, in main 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp agent.daemon_loop() 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp return f(*args, **kwargs) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 2120, in daemon_loop 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.rpc_loop(polling_manager=pm) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp return f(*args, **kwargs) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 1985, in rpc_loop 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp ovs_status = self.check_ovs_status() 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp return f(*args, **kwargs) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 1787, in check_ovs_status 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp status = self.int_br.check_canary_table() 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/br_int.py", line 52, in check_canary_table 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp flows = self.dump_flows(constants.CANARY_TABLE) 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py", line 141, in dump_flows 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp (dp, ofp, ofpp) = self._get_dp() 2017-11-07 13:35:51.439 597682 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File
[Yahoo-eng-team] [Bug 1731488] [NEW] nova list no IP address info for some instances.
Public bug reported: Hi Guys: "nova list" command output has no IP address info for some instances ,but other have it; I don't know why. for example,there is no network info for GL-app-server-1 but GL-app- server-2 in "nova list" output , and I can query it has an interface by "nova interface-list",why? [root@cloud-01 ~]# nova list --all |grep app-server | d1d09a01-7ea6-4c28-af67-a3f6ea4cd9f7 | GL-app-server-1| b7b2911d635c4657b5bf875b99e0ca14 | ACTIVE | - | Running | | | 37afa02b-eed9-4c71-8246-250463a5a9c6 | GL-app-server-2| b7b2911d635c4657b5bf875b99e0ca14 | ACTIVE | - | Running | ex-eit-test=11.225.11.16 | [root@cloud-01 ~]# nova interface-list d1d09a01-7ea6-4c28-af67-a3f6ea4cd9f7 ++--+--+--+---+ | Port State | Port ID | Net ID | IP addresses | MAC Addr | ++--+--+--+---+ | ACTIVE | 5b706f6b-6c52-49f9-9c56-13ff30b61d3c | bf358074-4e27-4b97-8122-c64d8a3ac665 | 11.225.11.13 | fa:16:3e:1f:b7:0b | ++--+--+--+---+ nova --version 7.1.1 ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1731488 Title: nova list no IP address info for some instances. Status in OpenStack Compute (nova): New Bug description: Hi Guys: "nova list" command output has no IP address info for some instances ,but other have it; I don't know why. for example,there is no network info for GL-app-server-1 but GL-app- server-2 in "nova list" output , and I can query it has an interface by "nova interface-list",why? [root@cloud-01 ~]# nova list --all |grep app-server | d1d09a01-7ea6-4c28-af67-a3f6ea4cd9f7 | GL-app-server-1| b7b2911d635c4657b5bf875b99e0ca14 | ACTIVE | - | Running | | | 37afa02b-eed9-4c71-8246-250463a5a9c6 | GL-app-server-2| b7b2911d635c4657b5bf875b99e0ca14 | ACTIVE | - | Running | ex-eit-test=11.225.11.16 | [root@cloud-01 ~]# nova interface-list d1d09a01-7ea6-4c28-af67-a3f6ea4cd9f7 ++--+--+--+---+ | Port State | Port ID | Net ID | IP addresses | MAC Addr | ++--+--+--+---+ | ACTIVE | 5b706f6b-6c52-49f9-9c56-13ff30b61d3c | bf358074-4e27-4b97-8122-c64d8a3ac665 | 11.225.11.13 | fa:16:3e:1f:b7:0b | ++--+--+--+---+ nova --version 7.1.1 To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1731488/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731395] Re: test_server_cfn_init and test_server_signal_userdata_format_software_config failing frequently
Reviewed: https://review.openstack.org/518833 Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=ce35e9c26f70adee650cefe6f8361d5a42f7a129 Submitter: Zuul Branch:master commit ce35e9c26f70adee650cefe6f8361d5a42f7a129 Author: Rabi MishraDate: Fri Nov 10 05:06:47 2017 + Revert "Don't overwrite binding-profile" This reverts commit ee7858ffcaf3f874feb0ea0c68871f2c93254fdd. Looks like heat gate is broken with this change, and the revert fixes it. Tested with https://review.openstack.org/#/c/518834/ Change-Id: I3fefcda93e496e97474bd419d50bd9753a4d1fed Closes-Bug: #1731395 ** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1731395 Title: test_server_cfn_init and test_server_signal_userdata_format_software_config failing frequently Status in OpenStack Heat: New Status in OpenStack Compute (nova): Fix Released Bug description: Traceback: 2017-11-10 03:07:31.357527 | primary | 2017-11-10 03:07:31.357 | heat_integrationtests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_software_config 2017-11-10 03:07:31.359064 | primary | 2017-11-10 03:07:31.358 | 2017-11-10 03:07:31.360609 | primary | 2017-11-10 03:07:31.360 | 2017-11-10 03:07:31.362409 | primary | 2017-11-10 03:07:31.361 | Captured traceback: 2017-11-10 03:07:31.364077 | primary | 2017-11-10 03:07:31.363 | ~~~ 2017-11-10 03:07:31.365498 | primary | 2017-11-10 03:07:31.365 | Traceback (most recent call last): 2017-11-10 03:07:31.366965 | primary | 2017-11-10 03:07:31.366 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 387, in _stack_delete 2017-11-10 03:07:31.368528 | primary | 2017-11-10 03:07:31.368 | success_on_not_found=True) 2017-11-10 03:07:31.370051 | primary | 2017-11-10 03:07:31.369 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 368, in _wait_for_stack_status 2017-11-10 03:07:31.371436 | primary | 2017-11-10 03:07:31.371 | fail_regexp): 2017-11-10 03:07:31.372777 | primary | 2017-11-10 03:07:31.372 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 332, in _verify_status 2017-11-10 03:07:31.374123 | primary | 2017-11-10 03:07:31.373 | stack_status_reason=stack.stack_status_reason) 2017-11-10 03:07:31.375699 | primary | 2017-11-10 03:07:31.375 | heat_integrationtests.common.exceptions.StackBuildErrorException: Stack ServerSignalIntegrationTest-1700906107 is in DELETE_FAILED status due to 'Resource DELETE failed: ResourceInError: resources.server: Went to status ERROR due to "Server Se-gnalIntegrationTest-1700906107-server-l5mj3wi5kfci delete failed: (404) Port id 387d58a6-7a65-4514-9695-18bfcb2302f5 could not be found."' Noticed at: http://logs.openstack.org/40/509140/22/check/legacy-heat-dsvm-functional-orig-mysql-lbaasv2/b0e5f36/job-output.txt.gz http://logs.openstack.org/98/509098/19/check/heat-functional-convg- mysql-lbaasv2-amqp1/df22003/job-output.txt.gz From neutron logs: http://logs.openstack.org/40/509140/22/check/legacy-heat-dsvm-functional-orig-mysql-lbaasv2/b0e5f36/logs/screen-q-svc.txt.gz#_Nov_10_03_12_34_409860 Probably it's https://review.openstack.org/#/c/505613/ Testing the revert with https://review.openstack.org/518834 To manage notifications about this bug go to: https://bugs.launchpad.net/heat/+bug/1731395/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731431] [NEW] Cloud-init could not identify OVF datasource
Public bug reported: Deployed OVF template with latest Xenial to vmWare vSphere ESXi via vCenter based on the latest OVA, sourced from: http://cloud- images.ubuntu.com/xenial/current/xenial-server-cloudimg-amd64.ova (dated November 9, 2017). Cannot attach requested contents due to sensitive data. ** # A new feature in cloud-init identified possible datasources for# # this system as:# # ['Ec2', 'None'] # # However, the datasource used was: OVF # ## # In the future, cloud-init will only attempt to use datasources that# # are identified or specifically configured. # # For more information see # # https://bugs.launchpad.net/bugs/1669675 # ## # If you are seeing this message, please file a bug against # # cloud-init at # #https://bugs.launchpad.net/cloud-init/+filebug?field.tags=dsid # # Make sure to include the cloud provider your instance is # # running on.# ## ** Affects: cloud-init Importance: Undecided Status: New ** Tags: dsid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to cloud-init. https://bugs.launchpad.net/bugs/1731431 Title: Cloud-init could not identify OVF datasource Status in cloud-init: New Bug description: Deployed OVF template with latest Xenial to vmWare vSphere ESXi via vCenter based on the latest OVA, sourced from: http://cloud- images.ubuntu.com/xenial/current/xenial-server-cloudimg-amd64.ova (dated November 9, 2017). Cannot attach requested contents due to sensitive data. ** # A new feature in cloud-init identified possible datasources for# # this system as:# # ['Ec2', 'None'] # # However, the datasource used was: OVF # ## # In the future, cloud-init will only attempt to use datasources that# # are identified or specifically configured. # # For more information see # # https://bugs.launchpad.net/bugs/1669675 # ## # If you are seeing this message, please file a bug against # # cloud-init at # #https://bugs.launchpad.net/cloud-init/+filebug?field.tags=dsid # # Make sure to include the cloud provider your instance is # # running on.# ## To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-init/+bug/1731431/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731439] [NEW] stack topology doesn't show dependency when convergence is disabled
Public bug reported: When convergence engine is disabled in heat.conf Stack topology doesn't show dependency lines between the resources ** Affects: horizon Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Dashboard (Horizon). https://bugs.launchpad.net/bugs/1731439 Title: stack topology doesn't show dependency when convergence is disabled Status in OpenStack Dashboard (Horizon): New Bug description: When convergence engine is disabled in heat.conf Stack topology doesn't show dependency lines between the resources To manage notifications about this bug go to: https://bugs.launchpad.net/horizon/+bug/1731439/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1731421] [NEW] nodejs-npm-run-test fails because of "No binary for Chrome browser on your platform"
Public bug reported: nodejs-npm-run-test job fails with the following error: 2017-11-10 08:40:38.047617 | ubuntu-xenial | [32m10 11 2017 08:40:38.044:INFO [karma]: [39mKarma v1.1.2 server started at http://localhost:9876/ 2017-11-10 08:40:38.048797 | ubuntu-xenial | [32m10 11 2017 08:40:38.048:INFO [launcher]: [39mLaunching browser Chrome with unlimited concurrency 2017-11-10 08:40:38.056114 | ubuntu-xenial | [32m10 11 2017 08:40:38.056:INFO [launcher]: [39mStarting browser Chrome 2017-11-10 08:40:38.057322 | ubuntu-xenial | [31m10 11 2017 08:40:38.057:ERROR [launcher]: [39mNo binary for Chrome browser on your platform. 2017-11-10 08:40:38.057372 | ubuntu-xenial | Please, set "CHROME_BIN" env variable. http://logs.openstack.org/44/518844/1/check/nodejs-npm-run-test/19e8ef5 /job-output.txt.gz#_2017-11-10_08_40_38_057322 ** Affects: horizon Importance: Critical Assignee: Akihiro Motoki (amotoki) Status: In Progress ** Tags: gate-failure ** Changed in: horizon Importance: Undecided => Critical ** Changed in: horizon Milestone: None => queens-2 ** Tags added: gate-failure -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Dashboard (Horizon). https://bugs.launchpad.net/bugs/1731421 Title: nodejs-npm-run-test fails because of "No binary for Chrome browser on your platform" Status in OpenStack Dashboard (Horizon): In Progress Bug description: nodejs-npm-run-test job fails with the following error: 2017-11-10 08:40:38.047617 | ubuntu-xenial | [32m10 11 2017 08:40:38.044:INFO [karma]: [39mKarma v1.1.2 server started at http://localhost:9876/ 2017-11-10 08:40:38.048797 | ubuntu-xenial | [32m10 11 2017 08:40:38.048:INFO [launcher]: [39mLaunching browser Chrome with unlimited concurrency 2017-11-10 08:40:38.056114 | ubuntu-xenial | [32m10 11 2017 08:40:38.056:INFO [launcher]: [39mStarting browser Chrome 2017-11-10 08:40:38.057322 | ubuntu-xenial | [31m10 11 2017 08:40:38.057:ERROR [launcher]: [39mNo binary for Chrome browser on your platform. 2017-11-10 08:40:38.057372 | ubuntu-xenial | Please, set "CHROME_BIN" env variable. http://logs.openstack.org/44/518844/1/check/nodejs-npm-run- test/19e8ef5/job-output.txt.gz#_2017-11-10_08_40_38_057322 To manage notifications about this bug go to: https://bugs.launchpad.net/horizon/+bug/1731421/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1693335] Re: UUID case sensitivity causing unfriendly and unexpected API errors
Reviewed: https://review.openstack.org/467772 Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=ecfb65cee68e96cc99ceecddbf27c6d6f768358e Submitter: Zuul Branch:master commit ecfb65cee68e96cc99ceecddbf27c6d6f768358e Author: Matt RiedemannDate: Wed May 24 17:06:35 2017 -0400 Fix instance lookup in hide_server_addresses extension The hide_server_addresses extension is looking up the cached instance based on what the user provided for the server id, which may not match what is used to cache the instance for the request. For example, a request with upper-case server uuid could be found in a mysql-backed system because mysql is case insensitive by default, but the instance is keyed off the server id from the DB, which is lower-case, so we'll fail to look up the instance in the cache if the IDs don't match. There is no test for this because it turns out it's actually really hard to recreate this since it requires running with a mysql backend to recreate the case insensitive check, which isn't going to work with sqlite. Given how trivial this fix is, creating a big mysql recreate test is not worth it. Change-Id: I09b288aa2ad9969800a3cd26c675b002c6c9f638 Closes-Bug: #1693335 ** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1693335 Title: UUID case sensitivity causing unfriendly and unexpected API errors Status in OpenStack Compute (nova): Fix Released Bug description: I was seeing a user pass an uppercase UUID from their app to the Nova API's. Their calls failed with a 500 error and the following exception in the nova-api log: 017-05-24 11:20:27.176 68631 ERROR nova.api.openstack [req-674b4fd1-9a22-488e-97d2-29fca9ca3b7c 98afbc5675e059f7b1dde34c44d615712e3aafed8afcdfb5d890276ec554e737 951955d46e3a45c99e4c8649e8abe247 - - -] Caught error: 'NoneType' object has no attribute 'get' 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack Traceback (most recent call last): 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/__init__.py", line 139, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return req.get_response(self.application) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1317, in send 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack application, catch_exc_info=False) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1281, in call_application 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack app_iter = application(self.environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 130, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack resp = self.call_func(req, *args, **self.kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 195, in call_func 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return self.func(req, *args, **kwargs) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py", line 467, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack response = req.get_response(self._app) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1317, in send 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack application, catch_exc_info=False) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1281, in call_application 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack app_iter = application(self.environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__ 2017-05-24 11:20:27.176 68631 ERROR nova.api.openstack return resp(environ, start_response) 2017-05-24 11:20:27.176 68631 ERROR