I did it of course! :) However I found the real issue.
While I was playing with multipath I disabled some feature from RBD image, one of this was EXCLUSIVE LOCK, because I was thinking it was related to the issue with multipath. Instead this brake the RBD iscsi target on gateway side (but not immediatly, brake apply on for new gateway or rebooted server). So I figure out only when I reboot another node that gateway would not come up again.
Disabling *Exclusive Lock* will make the Gateway Crash and "gwcli" will show you the 500 error status code.
Reanabling the feature and rebooting gateway one by one solve the issue. Maybe it's better to lock feature on RBD pool managed by APPs. So nobody could make some distructive changes to features like I did it. Thanks! :) Il 13/06/2018 16:15, Jason Dillaman ha scritto:
I've never used XenServer, but I'd imagine you would need to do something similar to what is documented here [1]. [1] http://docs.ceph.com/docs/master/rbd/iscsi-initiator-linux/ On Wed, Jun 13, 2018 at 5:11 AM, Max Cuttins <m...@phoenixweb.it> wrote:I just realize there is a an error: multipath -r Jun 13 11:02:27 | rbd0: HDIO_GETGEO failed with 25 reload: mpatha (360014051b4fb8c6384545b7ae7d5142e) undef LIO-ORG ,TCMU device size=100G features='1 queue_if_no_path' hwhandler='1 alua' wp=undef |-+- policy='queue-length 0' prio=130 status=undef | `- 5:0:0:0 sdb 8:16 active ready running `-+- policy='queue-length 0' prio=1 status=undef `- 4:0:0:0 sda 8:0 active ghost running I have added these lines to blacklist in /etc/multipath.conf blacklist { devnode "^(rbd)[0-9]*" } This solved the error, but..... gateway still not updated. Il 13/06/2018 10:59, Max Cuttins ha scritto: Hi everybody, maybe I miss something but multipath is not adding new iscsi gateways. I have installed 2 gateway and test it on a client. Everything worked fine. After that I decided to complete install and create a 3rd gateway. But no one iscsi initiatior client update the number of gateways. One clients broke up and now cannot write anymore to the disk (can read the size of volume but cannot read or write). I have runned: systemctl restart multipathd and also: multipath -r but this always display only 2 paths: multipath -ll mpatha (360014051b4fb8c6384545b7ae7d5142e) dm-2 LIO-ORG ,TCMU device size=100G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw |-+- policy='queue-length 0' prio=130 status=active | `- 5:0:0:0 sdb 8:16 active ready running `-+- policy='queue-length 0' prio=1 status=enabled `- 4:0:0:0 sda 8:0 active ghost running What I shoulded did? _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
