Public bug reported: Scale environment 45 compute node, 3 controller, Mitaka. During execution of Rally test boot_and_delete_server_with_secgroups error appeared in logs
2016-07-03 08:05:02.314 21792 INFO neutron.plugins.ml2.db [req-0d9d3031-0698-4a24-9ce0-4c886d641c91 ea3ede1f05e348e7853e9f 42c9426830 dc754a03f8de4b468396f8bc3d4a94ee - - -] Added segment af70f885-39df-4c2b-adfc-225d81c8c03c of type vxlan for ne twork 967af409-e2f4-418a-8919-a7e4a2133996 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource [req-1e786fea-0a7b-4613-9914-bda50be6028e d044072ee7c447bb922d 778565b329e2 715ca0f3f5a74733a49133c4d2202939 - - -] create failed 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource Traceback (most recent call last): 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/resour ce.py", line 84, in resource 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result = method(request=request, **args) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 410, in create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create(request, body, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 220, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 196, in force_reraise 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 521, in _create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource obj = do_create(body) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 503, in do_create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource request.context, reservation.reservation_id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 220, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 196, in force_reraise 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 496, in do_create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return obj_creator(request.context, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p lugin.py", line 696, in create_network 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result, mech_context = self._create_network_db(context, ne twork) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p lugin.py", line 659, in _create_network_db 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._ensure_default_security_group(context, tenant_id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 709, in _ensure_default_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create_default_security_group(context, tenant _id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 720, in _create_default_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context, security_group, default_sg=True) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 189, in create_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/contextlib.py", line 24, in __exit_ _ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.gen.next() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/api.py", l ine 89, in autonested_transaction 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource yield tx 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio n.py", line 490, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langh elpers.py", line 70, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compat.reraise(type_, value, traceback) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio n.py", line 490, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback() e.py", line 1563, in rollback 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._do_rollback() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1625, in _do_rollback 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._savepoint, self._parent) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 717, in _rollback_to_savepoint_impl 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.engine.dialect.do_rollback_to_savepoint(self, name) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def ault.py", line 441, in do_rollback_to_savepoint 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource connection.execute(expression.RollbackToSavepointClause(na me)) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 914, in execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return meth(self, multiparams, params) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elemen ts.py", line 323, in _execute_on_connection 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return connection._execute_clauseelement(self, multiparams , params) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compiled_sql, distilled_params 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1146, in _execute_context 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1337, in _handle_dbapi_exception 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource util.raise_from_cause(newraise, exc_info) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compa t.py", line 200, in raise_from_cause 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource reraise(type(exception), exception, tb=exc_tb, cause=cause ) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1139, in _execute_context 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def ault.py", line 450, in do_execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource cursor.execute(statement, parameters) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 219, in execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.errorhandler(self, exc, value) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 38, in defaulterrorhandler 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource raise errorvalue 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource OperationalError: (_mysql_exceptions.OperationalError) (1305, 'SAVEPOINT sa_savepoint_1 does not exist') [SQL: u'ROLLBACK TO SAVEPOINT sa_savepoint_1'] ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1605201 Title: OperationalError:'SAVEPOINT sa_savepoint_1 does not exist' during Rally boot_and_delete_server_with_secgroups Status in neutron: New Bug description: Scale environment 45 compute node, 3 controller, Mitaka. During execution of Rally test boot_and_delete_server_with_secgroups error appeared in logs 2016-07-03 08:05:02.314 21792 INFO neutron.plugins.ml2.db [req-0d9d3031-0698-4a24-9ce0-4c886d641c91 ea3ede1f05e348e7853e9f 42c9426830 dc754a03f8de4b468396f8bc3d4a94ee - - -] Added segment af70f885-39df-4c2b-adfc-225d81c8c03c of type vxlan for ne twork 967af409-e2f4-418a-8919-a7e4a2133996 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource [req-1e786fea-0a7b-4613-9914-bda50be6028e d044072ee7c447bb922d 778565b329e2 715ca0f3f5a74733a49133c4d2202939 - - -] create failed 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource Traceback (most recent call last): 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/resour ce.py", line 84, in resource 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result = method(request=request, **args) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 410, in create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create(request, body, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 220, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 196, in force_reraise 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return f(*args, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 521, in _create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource obj = do_create(body) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 503, in do_create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource request.context, reservation.reservation_id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 220, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p y", line 196, in force_reraise 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p y", line 496, in do_create 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return obj_creator(request.context, **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p lugin.py", line 696, in create_network 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result, mech_context = self._create_network_db(context, ne twork) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p lugin.py", line 659, in _create_network_db 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._ensure_default_security_group(context, tenant_id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 709, in _ensure_default_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create_default_security_group(context, tenant _id) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 720, in _create_default_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context, security_group, default_sg=True) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr oups_db.py", line 189, in create_security_group 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource **kwargs) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/contextlib.py", line 24, in __exit_ _ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.gen.next() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/api.py", l ine 89, in autonested_transaction 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource yield tx 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio n.py", line 490, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langh elpers.py", line 70, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compat.reraise(type_, value, traceback) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio n.py", line 490, in __exit__ 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback() e.py", line 1563, in rollback 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._do_rollback() 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1625, in _do_rollback 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._savepoint, self._parent) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 717, in _rollback_to_savepoint_impl 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.engine.dialect.do_rollback_to_savepoint(self, name) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def ault.py", line 441, in do_rollback_to_savepoint 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource connection.execute(expression.RollbackToSavepointClause(na me)) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 914, in execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return meth(self, multiparams, params) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elemen ts.py", line 323, in _execute_on_connection 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return connection._execute_clauseelement(self, multiparams , params) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compiled_sql, distilled_params 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1146, in _execute_context 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1337, in _handle_dbapi_exception 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource util.raise_from_cause(newraise, exc_info) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compa t.py", line 200, in raise_from_cause 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource reraise(type(exception), exception, tb=exc_tb, cause=cause ) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas e.py", line 1139, in _execute_context 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def ault.py", line 450, in do_execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource cursor.execute(statement, parameters) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 219, in execute 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.errorhandler(self, exc, value) 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 38, in defaulterrorhandler 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource raise errorvalue 2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource OperationalError: (_mysql_exceptions.OperationalError) (1305, 'SAVEPOINT sa_savepoint_1 does not exist') [SQL: u'ROLLBACK TO SAVEPOINT sa_savepoint_1'] To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1605201/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp