Public bug reported: http://logs.openstack.org/68/367268/4/gate/gate-tempest-dsvm-neutron- dvr-ubuntu-xenial/da4739d/console.html
2016-09-13 02:23:34.790198 | tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_dhcpv6_stateless[compute,id-cf1c4425-766b-45b8-be35-e2959728eb00,network] 2016-09-13 02:23:34.790254 | ------------------------------------------------------------------------------------------------------------------------------------------------------- 2016-09-13 02:23:34.790263 | 2016-09-13 02:23:34.790273 | Captured traceback: 2016-09-13 02:23:34.790284 | ~~~~~~~~~~~~~~~~~~~ 2016-09-13 02:23:34.790297 | Traceback (most recent call last): 2016-09-13 02:23:34.790313 | File "tempest/test.py", line 107, in wrapper 2016-09-13 02:23:34.790329 | return f(self, *func_args, **func_kwargs) 2016-09-13 02:23:34.790357 | File "tempest/scenario/test_network_v6.py", line 256, in test_dualnet_multi_prefix_dhcpv6_stateless 2016-09-13 02:23:34.790368 | dualnet=True) 2016-09-13 02:23:34.790390 | File "tempest/scenario/test_network_v6.py", line 163, in _prepare_and_test 2016-09-13 02:23:34.790402 | dualnet=dualnet) 2016-09-13 02:23:34.790424 | File "tempest/scenario/test_network_v6.py", line 104, in prepare_network 2016-09-13 02:23:34.790436 | subnet_id=sub6['id']) 2016-09-13 02:23:34.790461 | File "tempest/lib/services/network/routers_client.py", line 69, in add_router_interface 2016-09-13 02:23:34.790481 | return self.update_resource(uri, kwargs) 2016-09-13 02:23:34.790504 | File "tempest/lib/services/network/base.py", line 74, in update_resource 2016-09-13 02:23:34.790520 | resp, body = self.put(req_uri, req_post_data) 2016-09-13 02:23:34.790539 | File "tempest/lib/common/rest_client.py", line 340, in put 2016-09-13 02:23:34.790561 | return self.request('PUT', url, extra_headers, headers, body, chunked) 2016-09-13 02:23:34.790581 | File "tempest/lib/common/rest_client.py", line 665, in request 2016-09-13 02:23:34.790591 | resp, resp_body) 2016-09-13 02:23:34.790613 | File "tempest/lib/common/rest_client.py", line 829, in _error_checker 2016-09-13 02:23:34.790623 | message=message) 2016-09-13 02:23:34.790640 | tempest.lib.exceptions.ServerFault: Got server fault 2016-09-13 02:23:34.790663 | Details: Request Failed: internal server error while processing your request. In the neutron-server log: 2016-09-13 01:58:24.208 13912 ERROR neutron.plugins.ml2.rpc [req-1ab511fe-43a8-4491-b3d1-a33fd6c797ac - -] Failed to update device 55c41e91-6cf3-4059-8653-3d9727f29674 up 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] Mechanism driver 'l2population' failed in delete_port_postcommit 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers Traceback (most recent call last): 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers File "/opt/stack/new/neutron/neutron/plugins/ml2/managers.py", line 433, in _call_on_drivers 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context) 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers File "/opt/stack/new/neutron/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 80, in delete_port_postcommit 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers fdb_entries[network_id]['ports'] = other_fdb_ports 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__' 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers 2016-09-13 02:04:16.835 13911 ERROR neutron.plugins.ml2.plugin [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] mechanism_manager.delete_port_postcommit failed for port cd4447f6-83d3-44ff-b678-7936272d4368 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource [req-7eb6c757-6de0-4f5e-b062-6ccee17e8887 tempest-TestGettingAddress-6985564 -] add_router_interface failed: No details. 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource Traceback (most recent call last): 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 79, in resource 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource result = method(request=request, **args) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 250, in _handle_action 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ret_value = getattr(self._plugin, name)(*arg_list, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 415, in add_router_interface 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource port['id']) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 385, in add_router_interface 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource {'port': {'fixed_ips': fixed_ips}}) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(self, context, *args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1383, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource port) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1221, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_port=new_port) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 725, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_port.get('mac_address')) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 329, in update_port_with_ips 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_mac) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 282, in _update_ips_for_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource context, original_ips, new_ips, port['device_owner']) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 425, in _get_changed_ips_for_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource if ip.get('subnet_id') not in delete_subnet_ids] 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 68, in get 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return getattr(self, key, default) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 237, in __get__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return self.impl.get(instance_state(instance), dict_) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 578, in get 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource value = state._load_expired(state, passive) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/state.py", line 474, in _load_expired 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.manager.deferred_scalar_loader(self, toload) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 610, in load_scalar_attributes 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource (state_str(state))) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource DetachedInstanceError: Instance <IPAllocation at 0x7fdafc02db50> is not bound to a Session; attribute refresh operation cannot proceed ** Affects: neutron Importance: High Status: New ** Tags: gate-failure l3-ipam-dhcp ** Changed in: neutron Importance: Undecided => High ** Changed in: neutron Milestone: None => newton-rc1 ** Tags added: gate-failure l3-ipam-dhcp -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1622905 Title: test_dualnet_multi_prefix_dhcpv6_stateless fails with 'DetachedInstanceError: Instance <IPAllocation at ...> is not bound to a Session; attribute refresh operation cannot proceed' Status in neutron: New Bug description: http://logs.openstack.org/68/367268/4/gate/gate-tempest-dsvm-neutron- dvr-ubuntu-xenial/da4739d/console.html 2016-09-13 02:23:34.790198 | tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_dhcpv6_stateless[compute,id-cf1c4425-766b-45b8-be35-e2959728eb00,network] 2016-09-13 02:23:34.790254 | ------------------------------------------------------------------------------------------------------------------------------------------------------- 2016-09-13 02:23:34.790263 | 2016-09-13 02:23:34.790273 | Captured traceback: 2016-09-13 02:23:34.790284 | ~~~~~~~~~~~~~~~~~~~ 2016-09-13 02:23:34.790297 | Traceback (most recent call last): 2016-09-13 02:23:34.790313 | File "tempest/test.py", line 107, in wrapper 2016-09-13 02:23:34.790329 | return f(self, *func_args, **func_kwargs) 2016-09-13 02:23:34.790357 | File "tempest/scenario/test_network_v6.py", line 256, in test_dualnet_multi_prefix_dhcpv6_stateless 2016-09-13 02:23:34.790368 | dualnet=True) 2016-09-13 02:23:34.790390 | File "tempest/scenario/test_network_v6.py", line 163, in _prepare_and_test 2016-09-13 02:23:34.790402 | dualnet=dualnet) 2016-09-13 02:23:34.790424 | File "tempest/scenario/test_network_v6.py", line 104, in prepare_network 2016-09-13 02:23:34.790436 | subnet_id=sub6['id']) 2016-09-13 02:23:34.790461 | File "tempest/lib/services/network/routers_client.py", line 69, in add_router_interface 2016-09-13 02:23:34.790481 | return self.update_resource(uri, kwargs) 2016-09-13 02:23:34.790504 | File "tempest/lib/services/network/base.py", line 74, in update_resource 2016-09-13 02:23:34.790520 | resp, body = self.put(req_uri, req_post_data) 2016-09-13 02:23:34.790539 | File "tempest/lib/common/rest_client.py", line 340, in put 2016-09-13 02:23:34.790561 | return self.request('PUT', url, extra_headers, headers, body, chunked) 2016-09-13 02:23:34.790581 | File "tempest/lib/common/rest_client.py", line 665, in request 2016-09-13 02:23:34.790591 | resp, resp_body) 2016-09-13 02:23:34.790613 | File "tempest/lib/common/rest_client.py", line 829, in _error_checker 2016-09-13 02:23:34.790623 | message=message) 2016-09-13 02:23:34.790640 | tempest.lib.exceptions.ServerFault: Got server fault 2016-09-13 02:23:34.790663 | Details: Request Failed: internal server error while processing your request. In the neutron-server log: 2016-09-13 01:58:24.208 13912 ERROR neutron.plugins.ml2.rpc [req-1ab511fe-43a8-4491-b3d1-a33fd6c797ac - -] Failed to update device 55c41e91-6cf3-4059-8653-3d9727f29674 up 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] Mechanism driver 'l2population' failed in delete_port_postcommit 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers Traceback (most recent call last): 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers File "/opt/stack/new/neutron/neutron/plugins/ml2/managers.py", line 433, in _call_on_drivers 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context) 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers File "/opt/stack/new/neutron/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 80, in delete_port_postcommit 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers fdb_entries[network_id]['ports'] = other_fdb_ports 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__' 2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers 2016-09-13 02:04:16.835 13911 ERROR neutron.plugins.ml2.plugin [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] mechanism_manager.delete_port_postcommit failed for port cd4447f6-83d3-44ff-b678-7936272d4368 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource [req-7eb6c757-6de0-4f5e-b062-6ccee17e8887 tempest-TestGettingAddress-6985564 -] add_router_interface failed: No details. 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource Traceback (most recent call last): 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 79, in resource 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource result = method(request=request, **args) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 250, in _handle_action 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ret_value = getattr(self._plugin, name)(*arg_list, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 415, in add_router_interface 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource port['id']) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 385, in add_router_interface 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource {'port': {'fixed_ips': fixed_ips}}) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(self, context, *args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource traceback.format_exc()) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.force_reraise() 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1383, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource port) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return method(*args, **kwargs) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1221, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_port=new_port) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 725, in update_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_port.get('mac_address')) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 329, in update_port_with_ips 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource new_mac) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 282, in _update_ips_for_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource context, original_ips, new_ips, port['device_owner']) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 425, in _get_changed_ips_for_port 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource if ip.get('subnet_id') not in delete_subnet_ids] 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 68, in get 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return getattr(self, key, default) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 237, in __get__ 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource return self.impl.get(instance_state(instance), dict_) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 578, in get 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource value = state._load_expired(state, passive) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/state.py", line 474, in _load_expired 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource self.manager.deferred_scalar_loader(self, toload) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 610, in load_scalar_attributes 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource (state_str(state))) 2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource DetachedInstanceError: Instance <IPAllocation at 0x7fdafc02db50> is not bound to a Session; attribute refresh operation cannot proceed To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1622905/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp