Reviewed: https://review.opendev.org/669674 Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=01c334cbdd859f4e486ac2c369a4bdb3ec7709cc Submitter: Zuul Branch: master
commit 01c334cbdd859f4e486ac2c369a4bdb3ec7709cc Author: Francois Palin <[email protected]> Date: Mon Jul 8 10:12:25 2019 -0400 Add retry to cinder API calls related to volume detach When shutting down an instance for which volume needs to be deleted, if cinder RPC timeout expires before cinder volume driver terminates connection, then an unknown cinder exception is received and the volume is not removed. This fix adds a retry mechanism directly in cinder API calls attachment_delete, terminate_connection, and detach. Change-Id: I3c9ae47d0ceb64fa3082a01cb7df27faa4f5a00d Closes-Bug: #1834659 ** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1834659 Title: Volume not removed on instance deletion Status in OpenStack Compute (nova): Fix Released Bug description: Description =========== When we deploy a non-ephemeral instance (i.e. Creating a new volume), and indicate "YES" in "Delete Volume on Instance delete",then delete the instance, and volume driver terminate connection in cinder takes too long to return, the volume is not removed. The volume status remains as "In-use" and "Attached to None on /dev/vda". For example: abcfa1db-1748-4f04-9a29-128cf22efcc5 - 130GiB In-use - Attached to None on /dev/vda Steps to reproduce ================== Please refer to this bug comment #2 below Expected result =============== Volume gets removed Actual result ============= Volume remains attached Environment =========== Issue was initially reported downstream against Newton release (see comment #1 below). Customer was using hitachi volume driver: volume_driver = cinder.volume.drivers.hitachi.hbsd.hbsd_fc.HBSDFCDriver As a note, the hitachi drivers are unsupported as of Pike (see cinder commit 595c8d3f8523a9612ccc64ff4147eab993493892 Issue was reproduced in a devstack environment runnning the Stein release. Volume driver used was lvm (devstack default) To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1834659/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
