Public bug reported:
Only the libvirt driver supports live migration abort (and that may have
some caveates if the action results in a exception). If the call takes
places with a driver that does not support the opertaion then the follow
stack trace appears:
nova live-migration-abort doesn’t work.
It failed with exception "NotImplementedError".
Steps:
1) Do live migration (make sure vmkernel adaptors has vmotion enabled)
2) During live-migration is going on from one cluster to another trigger
command nova live-migration-abort.
3) you will see nova instance goes into ERROR state.
nova-compute error logs:
========================
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
[req-8cca230a-2ef0-4af4-9172-2259a38496ba fbb20822241440e7acac310fdc238280
bf2edf2a7ddc48a299f183b8da055c46 - d5b840b9e52c43d3ad9e208e22ad531f
d5b840b9e52c43d3ad9e208e22ad531f] Exception during message handling:
NotImplementedError
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server Traceback (most
recent call last):
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 163, in
_process_incoming
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server res =
self.dispatcher.dispatch(message)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 220,
in dispatch
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
self._do_dispatch(endpoint, method, ctxt, args)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 190,
in _do_dispatch
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server result =
func(ctxt, **new_args)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 76, in
wrapped
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server function_name,
call_dict, binary)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.force_reraise()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 67, in
wrapped
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return f(self,
context, *args, **kw)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 977, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
function(self, context, *args, **kwargs)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 214, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
kwargs['instance'], e, sys.exc_info())
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.force_reraise()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 202, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
function(self, context, *args, **kwargs)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6304, in
live_migration_abort
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.driver.live_migration_abort(instance)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/virt/driver.py", line 943, in
live_migration_abort
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server raise
NotImplementedError()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
NotImplementedError
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
This will resulty in the instance being in an ERROR state (although it
clearly is not)
** Affects: nova
Importance: Undecided
Assignee: Gary Kotton (garyk)
Status: In Progress
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1815466
Title:
Live migrate abort results in instance going into an error state
Status in OpenStack Compute (nova):
In Progress
Bug description:
Only the libvirt driver supports live migration abort (and that may
have some caveates if the action results in a exception). If the call
takes places with a driver that does not support the opertaion then
the follow stack trace appears:
nova live-migration-abort doesn’t work.
It failed with exception "NotImplementedError".
Steps:
1) Do live migration (make sure vmkernel adaptors has vmotion enabled)
2) During live-migration is going on from one cluster to another trigger
command nova live-migration-abort.
3) you will see nova instance goes into ERROR state.
nova-compute error logs:
========================
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
[req-8cca230a-2ef0-4af4-9172-2259a38496ba fbb20822241440e7acac310fdc238280
bf2edf2a7ddc48a299f183b8da055c46 - d5b840b9e52c43d3ad9e208e22ad531f
d5b840b9e52c43d3ad9e208e22ad531f] Exception during message handling:
NotImplementedError
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server Traceback (most
recent call last):
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 163, in
_process_incoming
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server res =
self.dispatcher.dispatch(message)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 220,
in dispatch
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
self._do_dispatch(endpoint, method, ctxt, args)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 190,
in _do_dispatch
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server result =
func(ctxt, **new_args)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 76, in
wrapped
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server function_name,
call_dict, binary)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.force_reraise()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 67, in
wrapped
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return f(self,
context, *args, **kw)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 977, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
function(self, context, *args, **kwargs)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 214, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
kwargs['instance'], e, sys.exc_info())
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.force_reraise()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 202, in
decorated_function
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server return
function(self, context, *args, **kwargs)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6304, in
live_migration_abort
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
self.driver.live_migration_abort(instance)
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server File
"/usr/lib/python2.7/dist-packages/nova/virt/driver.py", line 943, in
live_migration_abort
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server raise
NotImplementedError()
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
NotImplementedError
2019-02-05 18:28:59.040 31616 ERROR oslo_messaging.rpc.server
This will resulty in the instance being in an ERROR state (although it
clearly is not)
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1815466/+subscriptions
--
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : [email protected]
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help : https://help.launchpad.net/ListHelp
