[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

This bug was fixed in the package python-os-brick - 1.2.0-2ubuntu0.3~cloud0
---

 python-os-brick (1.2.0-2ubuntu0.3~cloud0) trusty-mitaka; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 python-os-brick (1.2.0-2ubuntu0.3) xenial; urgency=medium
 .
   * d/p/Stop-calling-multipath-r-when-attaching-detaching-iS.patch: Backport
 Backport fix for stopping calling 'multipath -r' (LP: #1623700)


** Changed in: cloud-archive/mitaka
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

This bug was fixed in the package python-os-brick - 1.6.1-0ubuntu1.2~cloud0
---

 python-os-brick (1.6.1-0ubuntu1.2~cloud0) xenial-newton; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 python-os-brick (1.6.1-0ubuntu1.2) yakkety; urgency=medium
 .
   * d/p/stop-calling-multipath-r-when-attaching-detaching-iS.patch
Backport fix for stopping calling 'multipath -r' (LP: #1623700)


** Changed in: cloud-archive/newton
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

This bug was fixed in the package python-os-brick - 1.6.1-0ubuntu1.2~cloud0
---

 python-os-brick (1.6.1-0ubuntu1.2~cloud0) xenial-newton; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 python-os-brick (1.6.1-0ubuntu1.2) yakkety; urgency=medium
 .
   * d/p/stop-calling-multipath-r-when-attaching-detaching-iS.patch
Backport fix for stopping calling 'multipath -r' (LP: #1623700)


** Changed in: cloud-archive/newton
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

This bug was fixed in the package python-os-brick - 1.2.0-2ubuntu0.3~cloud0
---

 python-os-brick (1.2.0-2ubuntu0.3~cloud0) trusty-mitaka; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 python-os-brick (1.2.0-2ubuntu0.3) xenial; urgency=medium
 .
   * d/p/Stop-calling-multipath-r-when-attaching-detaching-iS.patch: Backport
 Backport fix for stopping calling 'multipath -r' (LP: #1623700)


** Changed in: cloud-archive/mitaka
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

I've verified that the new package (1.6.1-0ubuntu1.2~cloud0 and
1.2.0-2ubuntu0.3~cloud0) doesn't break anything and fix the problem. see
https://pastebin.canonical.com/186800/ and
https://pastebin.canonical.com/186797/

** Tags removed: verification-mitaka-needed verification-newton-needed
** Tags added: verification-mitaka-done verification-newton-done

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Launchpad Bug Tracker]

This bug was fixed in the package python-os-brick - 1.6.1-0ubuntu1.2

---
python-os-brick (1.6.1-0ubuntu1.2) yakkety; urgency=medium

  * d/p/stop-calling-multipath-r-when-attaching-detaching-iS.patch
   Backport fix for stopping calling 'multipath -r' (LP: #1623700)

 -- Hua Zhang   Wed, 22 Mar 2017 18:04:15
+0800

** Changed in: python-os-brick (Ubuntu Yakkety)
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Launchpad Bug Tracker]

This bug was fixed in the package python-os-brick - 1.2.0-2ubuntu0.3

---
python-os-brick (1.2.0-2ubuntu0.3) xenial; urgency=medium

  * d/p/Stop-calling-multipath-r-when-attaching-detaching-iS.patch: Backport
Backport fix for stopping calling 'multipath -r' (LP: #1623700)

 -- Zhang Hua   Fri, 17 Mar 2017 19:23:13
+0800

** Changed in: python-os-brick (Ubuntu Xenial)
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

Hello Patrick, or anyone else affected,

Accepted python-os-brick into mitaka-proposed. The package will build
now and be available in the Ubuntu Cloud Archive in a few hours, and
then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed
repository:

  sudo add-apt-repository cloud-archive:mitaka-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, and change the tag
from verification-mitaka-needed to verification-mitaka-done. If it does
not fix the bug for you, please add a comment stating that, and change
the tag to verification-mitaka-failed. In either case, details of your
testing will help us make a better decision.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in
advance!

** Tags removed: verification-xenial-done verification-yakkety-done
** Tags added: verification-done

** Changed in: cloud-archive/mitaka
   Status: Triaged => Fix Committed

** Tags added: verification-mitaka-needed

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[James Page]

Hello Patrick, or anyone else affected,

Accepted python-os-brick into mitaka-proposed. The package will build
now and be available in the Ubuntu Cloud Archive in a few hours, and
then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed
repository:

  sudo add-apt-repository cloud-archive:mitaka-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, and change the tag
from verification-mitaka-needed to verification-mitaka-done. If it does
not fix the bug for you, please add a comment stating that, and change
the tag to verification-mitaka-failed. In either case, details of your
testing will help us make a better decision.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in
advance!

** Tags removed: verification-xenial-done verification-yakkety-done
** Tags added: verification-done

** Changed in: cloud-archive/mitaka
   Status: Triaged => Fix Committed

** Tags added: verification-mitaka-needed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

It is worth mentioning that just now our customer also give me feedback
that the package in xenial-proposed solved their problem. thanks.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

Verified successfully on both xenial-proposed and yakkety-proposed.
http://paste.ubuntu.com/24365563/

** Tags removed: verification-needed
** Tags added: verification-xenial-done verification-yakkety-done

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Chris J Arges]

Hello Patrick, or anyone else affected,

Accepted python-os-brick into xenial-proposed. The package will build
now and be available at https://launchpad.net/ubuntu/+source/python-os-
brick/1.2.0-2ubuntu0.3 in a few hours, and then in the -proposed
repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to
enable and use -proposed.  Your feedback will aid us getting this update
out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, and change the tag
from verification-needed to verification-done. If it does not fix the
bug for you, please add a comment stating that, and change the tag to
verification-failed.  In either case, details of your testing will help
us make a better decision.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance!

** Changed in: python-os-brick (Ubuntu Xenial)
   Status: In Progress => Fix Committed

** Tags added: verification-needed

** Changed in: python-os-brick (Ubuntu Yakkety)
   Status: Triaged => Fix Committed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Edward Hope-Morley]

** Tags removed: sts-sponsor

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Michael Terry]

Thanks zhhuabj and gustavo!  I've uploaded the patches to yakkety and
xenial.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Gustavo Randich]

Hi Joshua, I've done some tests and it's OK!
Thank you

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Edward Hope-Morley]

** Tags removed: sts-sru ubuntu-sponsors
** Tags added: sts-sru-needed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Re: [Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Gustavo Randich]

Hi Joshua, I'll check this and give you feedback. Thanks!


On Wed, 22 Mar 2017 at 09:31, Hua Zhang 
wrote:

> @Gustavo,
>
> Liang's comment in patch set 3 [1] can explain your problem, he said:
>
> The dev can disappear momentarily right after 'multipath -r "dev"'. So
> it doesn't happen for every single path. If it did, it would cause a lot
> more issues. The multipath dev removal path reloads the dev near the
> beginning of the operation (_rescan_multipath). Thus the "stat" here can
> fail if it is executed before the dev node being re-created.
>
> 1, 'multipath -r' in _rescan_multipath() [10] can make the multipath dev
> disappear momentarily [9] due to the bug [9].
>
> 2, _get_multipath_device_name() [2] uses 'multipath -ll' command to find
> multipath device name [3], so we saw:
>
> Jan 25 09:24:40 Lock "connect_volume" acquired by
> "os_brick.initiator.connector.disconnect_volume" :: waited 0.000s
> ...
> Jan 25 09:24:40 multipath ['-ll', u'/dev/sdr']:
> stdout=360080e5000297ea4050658885f45 dm-6 NETAPP,INF-01-00#012
>
> 3, _linuxscsi.remove_multipath_device() [4] will invoke
> remove_multipath_device() [4], so we saw:
>
> Jan 25 09:24:40 remove multipath device /dev/sdr'
>
> 4, then find_multipath_device() will be invoked [5], then 'multipath -l'
> will be invoked [6]
>
> 5, the "stat" right after 'multipath -r' here [7] can fail if it is
> executed before the dev node being re-created. so we saw:
>
> Jan 25 09:24:40 Couldn't find multipath device
> /dev/mapper/360080e5000297ea4050658885f45
>
> So the fix [1] was trying to fix this problem, but it was abandoned later
> because we already have the fix [8], that's also why I am trying to
> backport it.
> FYI, the root cause of your problem is a bug in multipath-tools [9], you
> can also fix the problem by upgrading multipath-tools.
>
> [1] https://review.openstack.org/#/c/366065
> [2]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L925
> [3]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L1200
> [4]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L935
> [5]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L124
> [6]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L263
> [7]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L288
> [8] https://review.openstack.org/#/c/374421/
> [9] https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1621340
> [10]
> https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L918
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1623700
>
> Title:
>   [SRU] multipath iscsi does not logout of sessions on xenial
>
> Status in Ubuntu Cloud Archive:
>   Fix Released
> Status in Ubuntu Cloud Archive mitaka series:
>   Triaged
> Status in Ubuntu Cloud Archive newton series:
>   Triaged
> Status in os-brick:
>   Fix Released
> Status in python-os-brick package in Ubuntu:
>   Fix Released
> Status in python-os-brick source package in Xenial:
>   In Progress
> Status in python-os-brick source package in Yakkety:
>   Triaged
>
> Bug description:
>   [Impact]
>
>* The reload (multipath -r) in _rescan_multipath can cause
>   /dev/mapper/ to be deleted and re-created (bug #1621340 is used
>   to track this problem), it would cause a lot more downstream openstack
>   issues. For example, and right in between that, os.stat(mdev) called
>   by _discover_mpath_device() will fail to find the file. For example,
>   when detaching a volume the iscsi sessions are not logged out. This
>   leaves behind a mpath device and the iscsi /dev/disk/by-path devices
>   as broken luns. So we should stop calling multipath -r when
>   attaching/detaching iSCSI volumes, multipath will load devices on its
>   own.
>
>   [Test Case]
>
>* Enable iSCSI driver and cinder/nova multipath
>* Detach a iSCSI volume
>* Check that devices/symlinks do not get messed up mentioned below
>
>   [Regression Potential]
>
>* None
>
>
>   stack@xenial-devstack-master-master-20160914-092014:~$ nova
> volume-attach 6e1017a7-6dea-418f-ad9b-879da085bd13
> d1d68e04-a217-44ea-bb74-65e0de73e5f8
>   +--+--+
>   | Property | Value|
>   +--+--+
>   | device   | /dev/vdb |
>   | id   | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
>   | serverId | 6e1017a7-6dea-418f-ad9b-879da085bd13 |
>   | volumeId | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
>   +--+--+
>
>   stack@xenial-devstack-master-master-20160914-092014:~$ cinder list
>
> 

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

** Description changed:

  [Impact]
  
-  * The reload (multipath -r) in _rescan_multipath can cause
- /dev/mapper/ to be deleted and re-created (bug #1621340 is used to
- track this problem), it would cause a lot more downstream openstack
- issues. For example, and right in between that, os.stat(mdev) called by
- _discover_mpath_device() will fail to find the file. For example, when
- detaching a volume the iscsi sessions are not logged out. This leaves
- behind a mpath device and the iscsi /dev/disk/by-path devices as broken
- luns. So we should stop calling multipath -r when attaching/detaching
- iSCSI volumes, multipath will load devices on its own.
+  * multipath-tools has a bug that 'multipath -r' can cause
+ /dev/mapper/ to be deleted and re-created momentarily (bug
+ #1621340 is used to track this problem), thus os.stat(mdev) right after
+ _rescan_multipath ('multipath -r') in os-brick can fail if it is
+ executed before multipath dev being re-created. This will also lead to
+ multipath iscsi does not logout of sessions on xenial.
  
  [Test Case]
  
-  * Enable iSCSI driver and cinder/nova multipath
+  * Enable cinder multipath by adding iscsi_ip_address and 
iscsi_secondary_ip_addresses in cinder.conf
+  * Enable nova multipath by adding iscsi_use_multipath=True in [libvirt] 
secion of nova.conf
   * Detach a iSCSI volume
-  * Check that devices/symlinks do not get messed up mentioned below
+  * Check that devices/symlinks do not get messed up mentioned below, or check 
that multipath device /dev/mapper/ doesn't be deleted and re-created 
momentarily
  
  [Regression Potential]
  
-  * None
- 
- 
- stack@xenial-devstack-master-master-20160914-092014:~$ nova volume-attach 
6e1017a7-6dea-418f-ad9b-879da085bd13 d1d68e04-a217-44ea-bb74-65e0de73e5f8
- +--+--+
- | Property | Value|
- +--+--+
- | device   | /dev/vdb |
- | id   | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
- | serverId | 6e1017a7-6dea-418f-ad9b-879da085bd13 |
- | volumeId | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
- +--+--+
- 
- stack@xenial-devstack-master-master-20160914-092014:~$ cinder list
- 
+--++--+--+-+--+--+
- | ID   | Status | Name | Size | Volume Type | 
Bootable | Attached to  |
- 
+--++--+--+-+--+--+
- | d1d68e04-a217-44ea-bb74-65e0de73e5f8 | in-use | -| 1| pure-iscsi  | 
false| 6e1017a7-6dea-418f-ad9b-879da085bd13 |
- 
+--++--+--+-+--+--+
- 
- stack@xenial-devstack-master-master-20160914-092014:~$ nova list
- 
+--+--+++-+-+
- | ID   | Name | Status | Task State | Power 
State | Networks|
- 
+--+--+++-+-+
- | 6e1017a7-6dea-418f-ad9b-879da085bd13 | test | ACTIVE | -  | Running 
| public=172.24.4.12, 2001:db8::b |
- 
+--+--+++-+-+
+  * multipath-tools loads devices on its own, we shouldn't need to be
+ forcing multipathd to do reload, so there is no regression potential.
  
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo iscsiadm -m 
session
  tcp: [5] 10.0.1.10:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [6] 10.0.5.10:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [7] 10.0.1.11:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [8] 10.0.5.11:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
+ 
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo iscsiadm -m node
  10.0.1.11:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.5.11:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.5.10:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.1.10:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo tail -f 
/var/log/syslog
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get udev uid: 
Invalid argument
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get sysfs uid: 
Invalid argument
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get sgio uid: 
No such file 

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

@Gustavo,

Liang's comment in patch set 3 [1] can explain your problem, he said:

The dev can disappear momentarily right after 'multipath -r "dev"'. So
it doesn't happen for every single path. If it did, it would cause a lot
more issues. The multipath dev removal path reloads the dev near the
beginning of the operation (_rescan_multipath). Thus the "stat" here can
fail if it is executed before the dev node being re-created.

1, 'multipath -r' in _rescan_multipath() [10] can make the multipath dev
disappear momentarily [9] due to the bug [9].

2, _get_multipath_device_name() [2] uses 'multipath -ll' command to find
multipath device name [3], so we saw:

Jan 25 09:24:40 Lock "connect_volume" acquired by 
"os_brick.initiator.connector.disconnect_volume" :: waited 0.000s
...
Jan 25 09:24:40 multipath ['-ll', u'/dev/sdr']: 
stdout=360080e5000297ea4050658885f45 dm-6 NETAPP,INF-01-00#012

3, _linuxscsi.remove_multipath_device() [4] will invoke
remove_multipath_device() [4], so we saw:

Jan 25 09:24:40 remove multipath device /dev/sdr'

4, then find_multipath_device() will be invoked [5], then 'multipath -l'
will be invoked [6]

5, the "stat" right after 'multipath -r' here [7] can fail if it is
executed before the dev node being re-created. so we saw:

Jan 25 09:24:40 Couldn't find multipath device
/dev/mapper/360080e5000297ea4050658885f45

So the fix [1] was trying to fix this problem, but it was abandoned later 
because we already have the fix [8], that's also why I am trying to backport it.
FYI, the root cause of your problem is a bug in multipath-tools [9], you can 
also fix the problem by upgrading multipath-tools.

[1] https://review.openstack.org/#/c/366065
[2] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L925
[3] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L1200
[4] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L935
[5] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L124
[6] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L263
[7] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/linuxscsi.py#L288
[8] https://review.openstack.org/#/c/374421/
[9] https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1621340
[10] 
https://github.com/openstack/os-brick/blob/stable/mitaka/os_brick/initiator/connector.py#L918

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

@Gustavo,

I can't reproduce your problem, this patch works well for me. I did two
experiments.

One experiment is WITHOUT multipath-tools patch [1] + WITHOUT this os-
brick patch, the test result can refer the link [2], we can see that
multipath device can be deleted by 'multipath -r'.

Mar 22 10:33:52 juju-zhhuabj-machine-9 nova-compute[22305]: 2017-03-22 
10:33:52.233 22305 WARNING os_brick.initiator.linuxscsi 
[req-0536068d-110c-43a4-82e4-941cdb715042 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] Couldn't find multipath device 
/dev/mapper/36e010001
 
Another experiment is WITHOUT multipath-tools patch [2] + WITH this os-brick 
patch, the test result can refer the link [3], we can see that multipath device 
doesn't be delete because this os-brick patch has removed 'multipath -r'.

Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.520 17329 DEBUG oslo_concurrency.lockutils 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] Lock "connect_volume" acquired by 
"os_brick.initiator.connector.disconnect_volume" :: waited 0.001s inner 
/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:273
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.523 17329 DEBUG oslo_concurrency.processutils 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] Running cmd (subprocess): sudo 
nova-rootwrap /etc/nova/rootwrap.conf multipath -ll /dev/sda execute 
/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:344
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.705 17329 DEBUG oslo_concurrency.processutils 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] CMD "sudo nova-rootwrap 
/etc/nova/rootwrap.conf multipath -ll /dev/sda" returned: 0 in 0.183s execute 
/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.707 17329 DEBUG os_brick.initiator.connector 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] multipath ['-ll', u'/dev/sda']: 
stdout=36e010001 dm-0 IET,VIRTUAL-DISK
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: size=1.0G 
features='0' hwhandler='0' wp=rw
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: |-+- 
policy='round-robin 0' prio=1 status=active
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: | `- 4:0:0:1 sda 
8:0  active ready running
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: `-+- 
policy='round-robin 0' prio=1 status=enabled
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]:   `- 5:0:0:1 sdb 
8:16 active ready running
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]:  stderr= 
_run_multipath 
/usr/lib/python2.7/dist-packages/os_brick/initiator/connector.py:1286
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.709 17329 DEBUG os_brick.initiator.linuxscsi 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] remove multipath device /dev/sda 
remove_multipath_device 
/usr/lib/python2.7/dist-packages/os_brick/initiator/linuxscsi.py:123
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.710 17329 DEBUG oslo_concurrency.processutils 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] Running cmd (subprocess): sudo 
nova-rootwrap /etc/nova/rootwrap.conf multipath -l /dev/sda execute 
/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:344
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.826 17329 DEBUG oslo_concurrency.processutils 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] CMD "sudo nova-rootwrap 
/etc/nova/rootwrap.conf multipath -l /dev/sda" returned: 0 in 0.116s execute 
/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.829 17329 DEBUG os_brick.initiator.linuxscsi 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] Found multipath device = 
/dev/mapper/36e010001 find_multipath_device 
/usr/lib/python2.7/dist-packages/os_brick/initiator/linuxscsi.py:301
Mar 22 11:06:20 juju-zhhuabj-machine-9 nova-compute[17329]: 2017-03-22 
11:06:20.829 17329 DEBUG os_brick.initiator.linuxscsi 
[req-bbcf6687-4e5d-4748-9887-726ff8489008 3f685b7c349c4734afc1a9a87968aca5 
52bc463e2bbd46c792ca0d17effd2a86 - - -] multipath LUNs to 

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Louis Bouchard]

** Also affects: python-os-brick (Ubuntu Yakkety)
   Importance: Undecided
   Status: New

** Changed in: python-os-brick (Ubuntu Yakkety)
   Importance: Undecided => Medium

** Changed in: python-os-brick (Ubuntu Yakkety)
   Status: New => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

Can't seem to target this to yakkety atm, launchpad is erroring for me.

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

Can't seem to target this to yakkety atm, launchpad is erroring for me.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

Hua, Can you update the regression potential for the Ubuntu SRU details
please?  'None' isn't really a good answer, especially with Gustavo's
comment above.  Can we check if any other patches have landed upstream
wrt his comment?

** Also affects: cloud-archive/mitaka
   Importance: Undecided
   Status: New

** Also affects: cloud-archive/newton
   Importance: Undecided
   Status: New

** Changed in: cloud-archive
   Status: New => Fix Released

** Changed in: cloud-archive
   Importance: Undecided => Medium

** Changed in: cloud-archive/mitaka
   Importance: Undecided => Medium

** Changed in: cloud-archive/newton
   Importance: Undecided => Medium

** Changed in: cloud-archive/newton
   Status: New => Triaged

** Changed in: cloud-archive/mitaka
   Status: New => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

This is going to need to land in yakkety and newton before it gets backported 
to xenial. I've initiated the upstream backport to newton:
https://review.openstack.org/#/c/447018/

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

This is going to need to land in yakkety and newton before it gets backported 
to xenial. I've initiated the upstream backport to newton:
https://review.openstack.org/#/c/447018/

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Corey Bryant]

Hua, Can you update the regression potential for the Ubuntu SRU details
please?  'None' isn't really a good answer, especially with Gustavo's
comment above.  Can we check if any other patches have landed upstream
wrt his comment?

** Also affects: cloud-archive/mitaka
   Importance: Undecided
   Status: New

** Also affects: cloud-archive/newton
   Importance: Undecided
   Status: New

** Changed in: cloud-archive
   Status: New => Fix Released

** Changed in: cloud-archive
   Importance: Undecided => Medium

** Changed in: cloud-archive/mitaka
   Importance: Undecided => Medium

** Changed in: cloud-archive/newton
   Importance: Undecided => Medium

** Changed in: cloud-archive/newton
   Status: New => Triaged

** Changed in: cloud-archive/mitaka
   Status: New => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

** Patch added: "fix-1623700-xenial-v2.debdiff"
   
https://bugs.launchpad.net/os-brick/+bug/1623700/+attachment/4839388/+files/fix-1623700-xenial-v2.debdiff

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Billy Olsen]

** Tags added: sts sts-sponsor ubuntu-sponsors

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Mathew Hodson]

** Changed in: python-os-brick (Ubuntu)
   Importance: Undecided => Medium

** Changed in: python-os-brick (Ubuntu Xenial)
   Importance: Undecided => Medium

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

anyone can help sponsor this sru ?  thank a lot

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Edward Hope-Morley]

** Changed in: python-os-brick (Ubuntu)
   Status: Invalid => Fix Released

** Changed in: python-os-brick (Ubuntu Xenial)
   Status: New => In Progress

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Edward Hope-Morley]

** Also affects: cloud-archive
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

** Changed in: python-os-brick (Ubuntu)
   Status: New => Invalid

** Changed in: python-os-brick (Ubuntu Xenial)
 Assignee: (unassigned) => Hua Zhang (zhhuabj)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/os-brick/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Louis Bouchard]

** Also affects: python-os-brick (Ubuntu)
   Importance: Undecided
   Status: New

** Also affects: python-os-brick (Ubuntu Xenial)
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623700

Title:
  [SRU] multipath iscsi does not logout of sessions on xenial

To manage notifications about this bug go to:
https://bugs.launchpad.net/os-brick/+bug/1623700/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623700] Re: [SRU] multipath iscsi does not logout of sessions on xenial

[Hua Zhang]

** Summary changed:

- multipath iscsi does not logout of sessions on xenial
+ [SRU] multipath iscsi does not logout of sessions on xenial

** Description changed:

- Using ubuntu 16.04 devstack w/ Pure iSCSI driver and multipathing when
+ [Impact]
+ 
+  * The reload (multipath -r) in _rescan_multipath can cause
+ /dev/mapper/ to be deleted and re-created (bug #1621340 is used to
+ track this problem), it would cause a lot more downstream openstack
+ issues. For example, and right in between that, os.stat(mdev) called by
+ _discover_mpath_device() will fail to find the file. For example, when
  detaching a volume the iscsi sessions are not logged out. This leaves
  behind a mpath device and the iscsi /dev/disk/by-path devices as broken
- luns
+ luns. So we should stop calling multipath -r when attaching/detaching
+ iSCSI volumes, multipath will load devices on its own.
+ 
+ [Test Case]
+ 
+  * Enable iSCSI driver and cinder/nova multipath
+  * Detach a iSCSI volume
+  * Check that devices/symlinks do not get messed up mentioned below
+ 
+ [Regression Potential]
+ 
+  * None
  
  
  stack@xenial-devstack-master-master-20160914-092014:~$ nova volume-attach 
6e1017a7-6dea-418f-ad9b-879da085bd13 d1d68e04-a217-44ea-bb74-65e0de73e5f8
  +--+--+
  | Property | Value|
  +--+--+
  | device   | /dev/vdb |
  | id   | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
  | serverId | 6e1017a7-6dea-418f-ad9b-879da085bd13 |
  | volumeId | d1d68e04-a217-44ea-bb74-65e0de73e5f8 |
  +--+--+
- stack@xenial-devstack-master-master-20160914-092014:~$
- stack@xenial-devstack-master-master-20160914-092014:~$
- stack@xenial-devstack-master-master-20160914-092014:~$
- stack@xenial-devstack-master-master-20160914-092014:~$
+ 
  stack@xenial-devstack-master-master-20160914-092014:~$ cinder list
  
+--++--+--+-+--+--+
  | ID   | Status | Name | Size | Volume Type | 
Bootable | Attached to  |
  
+--++--+--+-+--+--+
  | d1d68e04-a217-44ea-bb74-65e0de73e5f8 | in-use | -| 1| pure-iscsi  | 
false| 6e1017a7-6dea-418f-ad9b-879da085bd13 |
  
+--++--+--+-+--+--+
+ 
  stack@xenial-devstack-master-master-20160914-092014:~$ nova list
  
+--+--+++-+-+
  | ID   | Name | Status | Task State | Power 
State | Networks|
  
+--+--+++-+-+
  | 6e1017a7-6dea-418f-ad9b-879da085bd13 | test | ACTIVE | -  | Running 
| public=172.24.4.12, 2001:db8::b |
  
+--+--+++-+-+
+ 
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo iscsiadm -m 
session
  tcp: [5] 10.0.1.10:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [6] 10.0.5.10:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [7] 10.0.1.11:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  tcp: [8] 10.0.5.11:3260,1 
iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873 (non-flash)
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo iscsiadm -m node
  10.0.1.11:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.5.11:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.5.10:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
  10.0.1.10:3260,-1 iqn.2010-06.com.purestorage:flasharray.3adbe40b49bac873
+ 
  stack@xenial-devstack-master-master-20160914-092014:~$ sudo tail -f 
/var/log/syslog
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get udev uid: 
Invalid argument
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get sysfs uid: 
Invalid argument
  Sep 14 22:33:14 xenial-qemu-tester multipath: dm-0: failed to get sgio uid: 
No such file or directory
  Sep 14 22:33:14 xenial-qemu-tester systemd[1347]: 
dev-disk-by\x2did-scsi\x2d3624a93709a738ed78583fd12003fb774.device: Dev 
dev-disk-by\x2did-scsi\x2d3624a93709a738ed78583fd12003fb774.device appeared 
twice with different sysfs paths 
/sys/devices/platform/host6/session5/target6:0:0/6:0:0:1/block/sda and 
/sys/devices/virtual/block/dm-0
  Sep 14 22:33:14 xenial-qemu-tester systemd[1347]: