Re: [ceph-users] Problems setting up iSCSI

[Bernhard Dick]

Am 29.06.2018 um 17:45 schrieb Jason Dillaman:
The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, 
it's what I use in my test environment. I really cannot explain why 
tcmu-runner is missing the rbd handler. I can only assume you have 
restarted the daemon after installing it.
That did the trick. I didn't do any reboot or daemon restarting when I 
installed the other (newer) tcmu-runner versions. So the old version 
still ran.

Now it seems to be working.
Thank you very much for your help.

  Best regards
Bernhard
Any other log messages from 
tcmu-runner? Do you have a "/usr/lib64/tcmu-runner/handler_rbd.so" file? 
Perhaps enable debug-level logging in "/etc/tcmu/tcmu.conf" and see if 
that helps.


On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick > wrote:


Am 29.06.2018 um 17:26 schrieb Jason Dillaman:
 > OK, so your tcmu-runner doesn't have support for rbd images for some
 > reason. Where did you get your copy of tcmu-runner?
hm originally I took it from the gluster40 repository from the Centos
Storage SIG.
 > You should build it
 > from upstream or pull a copy from here [1].
 >
 > [1] https://shaman.ceph.com/repos/tcmu-runner/
I tried the version:

https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm
(because the version number from the storage SIG was a 1.3.0-rc4 which
seemed a bit low). That resulted also in the error above.

Now I tried the version from

https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/
but the error persists.

I am however able to map and unmap the image on the host using rbd map
and unmap commands.

    Regards
      Bernhard
 >
 > On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick mailto:bernh...@bdick.de>
 > >> wrote:
 >
 >     Hi,
 >
 >     Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
 >      > Is 'tcmu-runner' running on that node?
 >     yes it is running
 >
 >      > Any errors in dmesg or
 >     here are no errors
 >      > /var/log/tcmu-runner.log?
 >     the following error is shown:
 >     [ERROR] add_device:436: could not find handler for uio0
 >
 >         Regards
 >           Bernhard
 >      >
 >      > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick
mailto:bernh...@bdick.de>
 >     >
 >      > 
      >
 >      >     Hi,
 >      >
 >      >     Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
 >      >      > Do you have the ansible backtrace from the
"ceph-iscsi-gw :
 >      >     igw_lun |
 >      >      > configureluns (create/map rbds and add to lio)]" step?
 >      >     I assume you mean the following (from running with
verbosity
 >     3, after
 >      >     running the purge-iscsi-gateways playbook beforehand)
 >      >
 >      >     Using module file
/home/dick/git/ceph-ansible/library/igw_lun.py
 >      >      ESTABLISH SSH CONNECTION FOR USER: root
 >      >      SSH: EXEC ssh -o ControlMaster=auto -o
 >      >     ControlPersist=600s -o StrictHostKeyChecking=no -o
 >      >     KbdInteractiveAuthentication=no -o
 >      >     PreferredAuthentications=gssapi-with-mic,g
 >      >     ssapi-keyex,hostbased,publickey -o
PasswordAuthentication=no -o
 >      >     User=root -o ConnectTimeout=30 -o
 >      >     ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04
 >     '/bin/sh -c
 >      >     '"'"'/usr/bin/p
 >      >     ython && sleep 0'"'"''
 >      >      (1, '', 'Traceback (most recent call
last):\n
 >     File
 >      >     "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line
166, in
 >      >     \n
 >      >          ansible_main()\n  File "/tmp/ansible_F3
 >      >     sf6j/ansible_module_igw_lun.py", line 135, in
ansible_main\n
 >      >     lun.manage(desired_state)\n  File
 >      >   
  "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",

 >     line 365,
 >      >     in manage\n    self.allocate()\n  File "/u
 >      >     sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
 >     line 490, in
 >      >     allocate\n    lun = self.add_dev_to_lio()\n  File
 >      >   
  "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",

 >     line 683,
 >      >     in add_dev_to_lio\n
 >      >           wwn=in_wwn, control=control_string)\n  File
 >      >     "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",

Re: [ceph-users] Problems setting up iSCSI

[Jason Dillaman]

The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, it's
what I use in my test environment. I really cannot explain why tcmu-runner
is missing the rbd handler. I can only assume you have restarted the daemon
after installing it. Any other log messages from tcmu-runner? Do you have a
"/usr/lib64/tcmu-runner/handler_rbd.so" file? Perhaps enable debug-level
logging in "/etc/tcmu/tcmu.conf" and see if that helps.

On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick  wrote:

> Am 29.06.2018 um 17:26 schrieb Jason Dillaman:
> > OK, so your tcmu-runner doesn't have support for rbd images for some
> > reason. Where did you get your copy of tcmu-runner?
> hm originally I took it from the gluster40 repository from the Centos
> Storage SIG.
> > You should build it
> > from upstream or pull a copy from here [1].
> >
> > [1] https://shaman.ceph.com/repos/tcmu-runner/
> I tried the version:
>
> https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm
> (because the version number from the storage SIG was a 1.3.0-rc4 which
> seemed a bit low). That resulted also in the error above.
>
> Now I tried the version from
>
> https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/
> but the error persists.
>
> I am however able to map and unmap the image on the host using rbd map
> and unmap commands.
>
>Regards
>  Bernhard
> >
> > On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick  > > wrote:
> >
> > Hi,
> >
> > Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
> >  > Is 'tcmu-runner' running on that node?
> > yes it is running
> >
> >  > Any errors in dmesg or
> > here are no errors
> >  > /var/log/tcmu-runner.log?
> > the following error is shown:
> > [ERROR] add_device:436: could not find handler for uio0
> >
> > Regards
> >   Bernhard
> >  >
> >  > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick  > 
> >  > >> wrote:
> >  >
> >  > Hi,
> >  >
> >  > Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
> >  >  > Do you have the ansible backtrace from the "ceph-iscsi-gw :
> >  > igw_lun |
> >  >  > configureluns (create/map rbds and add to lio)]" step?
> >  > I assume you mean the following (from running with verbosity
> > 3, after
> >  > running the purge-iscsi-gateways playbook beforehand)
> >  >
> >  > Using module file
> /home/dick/git/ceph-ansible/library/igw_lun.py
> >  >  ESTABLISH SSH CONNECTION FOR USER: root
> >  >  SSH: EXEC ssh -o ControlMaster=auto -o
> >  > ControlPersist=600s -o StrictHostKeyChecking=no -o
> >  > KbdInteractiveAuthentication=no -o
> >  > PreferredAuthentications=gssapi-with-mic,g
> >  > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no
> -o
> >  > User=root -o ConnectTimeout=30 -o
> >  > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04
> > '/bin/sh -c
> >  > '"'"'/usr/bin/p
> >  > ython && sleep 0'"'"''
> >  >  (1, '', 'Traceback (most recent call last):\n
> > File
> >  > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
> >  > \n
> >  >  ansible_main()\n  File "/tmp/ansible_F3
> >  > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
> >  > lun.manage(desired_state)\n  File
> >  > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 365,
> >  > in manage\nself.allocate()\n  File "/u
> >  > sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 490, in
> >  > allocate\nlun = self.add_dev_to_lio()\n  File
> >  > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 683,
> >  > in add_dev_to_lio\n
> >  >   wwn=in_wwn, control=control_string)\n  File
> >  > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line
> 818, in
> >  > __init__\nself._configure(config, size, wwn,
> hw_max_sectors,
> >  > control)\n  File "/usr/lib/pytho
> >  > n2.7/site-packages/rtslib_fb/tcm.py", line 836, in
> _configure\n
> >  > self._enable()\n  File
> >  > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line
> 172, in
> >  > _enable\nfwrite(path, "1\\n")\n  File "/usr/lib/pyt
> >  > hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
> >  > file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> >  > directory\n')
> >  > The full traceback is:
> >  > Traceback (most recent call last):
> >  > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
> > 

Re: [ceph-users] Problems setting up iSCSI

[Bernhard Dick]

Am 29.06.2018 um 17:26 schrieb Jason Dillaman:
OK, so your tcmu-runner doesn't have support for rbd images for some 
reason. Where did you get your copy of tcmu-runner? 
hm originally I took it from the gluster40 repository from the Centos 
Storage SIG.
You should build it 
from upstream or pull a copy from here [1].


[1] https://shaman.ceph.com/repos/tcmu-runner/
I tried the version: 
https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm
(because the version number from the storage SIG was a 1.3.0-rc4 which 
seemed a bit low). That resulted also in the error above.


Now I tried the version from 
https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/

but the error persists.

I am however able to map and unmap the image on the host using rbd map 
and unmap commands.


  Regards
Bernhard


On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick > wrote:


Hi,

Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
 > Is 'tcmu-runner' running on that node?
yes it is running

 > Any errors in dmesg or
here are no errors
 > /var/log/tcmu-runner.log?
the following error is shown:
[ERROR] add_device:436: could not find handler for uio0

    Regards
      Bernhard
 >
 > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick mailto:bernh...@bdick.de>
 > >> wrote:
 >
 >     Hi,
 >
 >     Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
 >      > Do you have the ansible backtrace from the "ceph-iscsi-gw :
 >     igw_lun |
 >      > configureluns (create/map rbds and add to lio)]" step?
 >     I assume you mean the following (from running with verbosity
3, after
 >     running the purge-iscsi-gateways playbook beforehand)
 >
 >     Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
 >      ESTABLISH SSH CONNECTION FOR USER: root
 >      SSH: EXEC ssh -o ControlMaster=auto -o
 >     ControlPersist=600s -o StrictHostKeyChecking=no -o
 >     KbdInteractiveAuthentication=no -o
 >     PreferredAuthentications=gssapi-with-mic,g
 >     ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
 >     User=root -o ConnectTimeout=30 -o
 >     ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04
'/bin/sh -c
 >     '"'"'/usr/bin/p
 >     ython && sleep 0'"'"''
 >      (1, '', 'Traceback (most recent call last):\n 
File

 >     "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
 >     \n
 >          ansible_main()\n  File "/tmp/ansible_F3
 >     sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
 >     lun.manage(desired_state)\n  File
 >     "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 365,
 >     in manage\n    self.allocate()\n  File "/u
 >     sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 490, in
 >     allocate\n    lun = self.add_dev_to_lio()\n  File
 >     "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 683,
 >     in add_dev_to_lio\n
 >           wwn=in_wwn, control=control_string)\n  File
 >     "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
 >     __init__\n    self._configure(config, size, wwn, hw_max_sectors,
 >     control)\n  File "/usr/lib/pytho
 >     n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
 >     self._enable()\n  File
 >     "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
 >     _enable\n    fwrite(path, "1\\n")\n  File "/usr/lib/pyt
 >     hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
 >     file_fd.write(str(string))\nIOError: [Errno 2] No such file or
 >     directory\n')
 >     The full traceback is:
 >     Traceback (most recent call last):
 >         File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
line 166, in
 >     
 >           ansible_main()
 >         File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
line 135, in
 >     ansible_main
 >           lun.manage(desired_state)
 >         File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
 >     line 365, in manage
 >           self.allocate()
 >         File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
 >     line 490, in allocate
 >           lun = self.add_dev_to_lio()
 >         File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
 >     line 683, in add_dev_to_lio
 >           wwn=in_wwn, control=control_string)
 >         File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
line 818,
 >     in __init__
 >           

Re: [ceph-users] Problems setting up iSCSI

[Jason Dillaman]

OK, so your tcmu-runner doesn't have support for rbd images for some
reason. Where did you get your copy of tcmu-runner? You should build it
from upstream or pull a copy from here [1].

[1] https://shaman.ceph.com/repos/tcmu-runner/

On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick  wrote:

> Hi,
>
> Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
> > Is 'tcmu-runner' running on that node?
> yes it is running
>
> > Any errors in dmesg or
> here are no errors
> > /var/log/tcmu-runner.log?
> the following error is shown:
> [ERROR] add_device:436: could not find handler for uio0
>
>Regards
>  Bernhard
> >
> > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick  > > wrote:
> >
> > Hi,
> >
> > Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
> >  > Do you have the ansible backtrace from the "ceph-iscsi-gw :
> > igw_lun |
> >  > configureluns (create/map rbds and add to lio)]" step?
> > I assume you mean the following (from running with verbosity 3, after
> > running the purge-iscsi-gateways playbook beforehand)
> >
> > Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
> >  ESTABLISH SSH CONNECTION FOR USER: root
> >  SSH: EXEC ssh -o ControlMaster=auto -o
> > ControlPersist=600s -o StrictHostKeyChecking=no -o
> > KbdInteractiveAuthentication=no -o
> > PreferredAuthentications=gssapi-with-mic,g
> > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
> > User=root -o ConnectTimeout=30 -o
> > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c
> > '"'"'/usr/bin/p
> > ython && sleep 0'"'"''
> >  (1, '', 'Traceback (most recent call last):\n  File
> > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
> > \n
> >  ansible_main()\n  File "/tmp/ansible_F3
> > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
> > lun.manage(desired_state)\n  File
> > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line
> 365,
> > in manage\nself.allocate()\n  File "/u
> > sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490,
> in
> > allocate\nlun = self.add_dev_to_lio()\n  File
> > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line
> 683,
> > in add_dev_to_lio\n
> >   wwn=in_wwn, control=control_string)\n  File
> > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
> > __init__\nself._configure(config, size, wwn, hw_max_sectors,
> > control)\n  File "/usr/lib/pytho
> > n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
> > self._enable()\n  File
> > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
> > _enable\nfwrite(path, "1\\n")\n  File "/usr/lib/pyt
> > hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
> > file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> > directory\n')
> > The full traceback is:
> > Traceback (most recent call last):
> > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166,
> in
> > 
> >   ansible_main()
> > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135,
> in
> > ansible_main
> >   lun.manage(desired_state)
> > File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 365, in manage
> >   self.allocate()
> > File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 490, in allocate
> >   lun = self.add_dev_to_lio()
> > File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 683, in add_dev_to_lio
> >   wwn=in_wwn, control=control_string)
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line
> 818,
> > in __init__
> >   self._configure(config, size, wwn, hw_max_sectors, control)
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line
> 836,
> > in _configure
> >   self._enable()
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line
> 172,
> > in _enable
> >   fwrite(path, "1\n")
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line
> > 79,
> > in fwrite
> >   file_fd.write(str(string))
> > IOError: [Errno 2] No such file or directory
> >
> > failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
> > u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size':
> > u'1G'}) => {
> >   "changed": false,
> >   "item": {
> >   "host": "ovirt-test04",
> >   "image": "iscsi2342",
> >   "pool": "rbd",
> >   "size": "1G",
> >   "state": "present"
> >   },
> >   "module_stderr": "Traceback (most recent call last):\n  File
> > \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
> > \n  

Re: [ceph-users] Problems setting up iSCSI

[Bernhard Dick]

Hi,

Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
Is 'tcmu-runner' running on that node? 

yes it is running

Any errors in dmesg or 

here are no errors

/var/log/tcmu-runner.log?

the following error is shown:
[ERROR] add_device:436: could not find handler for uio0

  Regards
Bernhard


On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick > wrote:


Hi,

Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
 > Do you have the ansible backtrace from the "ceph-iscsi-gw :
igw_lun |
 > configureluns (create/map rbds and add to lio)]" step?
I assume you mean the following (from running with verbosity 3, after
running the purge-iscsi-gateways playbook beforehand)

Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
 ESTABLISH SSH CONNECTION FOR USER: root
 SSH: EXEC ssh -o ControlMaster=auto -o
ControlPersist=600s -o StrictHostKeyChecking=no -o
KbdInteractiveAuthentication=no -o
PreferredAuthentications=gssapi-with-mic,g
ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
User=root -o ConnectTimeout=30 -o
ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c
'"'"'/usr/bin/p
ython && sleep 0'"'"''
 (1, '', 'Traceback (most recent call last):\n  File
"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
\n
     ansible_main()\n  File "/tmp/ansible_F3
sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
lun.manage(desired_state)\n  File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365,
in manage\n    self.allocate()\n  File "/u
sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in
allocate\n    lun = self.add_dev_to_lio()\n  File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683,
in add_dev_to_lio\n
      wwn=in_wwn, control=control_string)\n  File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
__init__\n    self._configure(config, size, wwn, hw_max_sectors,
control)\n  File "/usr/lib/pytho
n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
self._enable()\n  File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
_enable\n    fwrite(path, "1\\n")\n  File "/usr/lib/pyt
hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
file_fd.write(str(string))\nIOError: [Errno 2] No such file or
directory\n')
The full traceback is:
Traceback (most recent call last):
    File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in

      ansible_main()
    File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in
ansible_main
      lun.manage(desired_state)
    File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 365, in manage
      self.allocate()
    File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 490, in allocate
      lun = self.add_dev_to_lio()
    File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 683, in add_dev_to_lio
      wwn=in_wwn, control=control_string)
    File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818,
in __init__
      self._configure(config, size, wwn, hw_max_sectors, control)
    File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 836,
in _configure
      self._enable()
    File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172,
in _enable
      fwrite(path, "1\n")
    File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line
79,
in fwrite
      file_fd.write(str(string))
IOError: [Errno 2] No such file or directory

failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size':
u'1G'}) => {
      "changed": false,
      "item": {
          "host": "ovirt-test04",
          "image": "iscsi2342",
          "pool": "rbd",
          "size": "1G",
          "state": "present"
      },
      "module_stderr": "Traceback (most recent call last):\n  File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
\n    ansible_main()\n  File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
py\", line 135, in ansible_main\n    lun.manage(desired_state)\n  File
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
365,
in manage\n    self.allocate()\n  File \"/usr/lib/python2.7/site-pa
ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\n    lun =
self.add_dev_to_lio()\n  File
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
683,
in add_dev_to_lio\n    wwn=in_wwn, contr
ol=control_string)\n  File
\"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 818, in
__init__\n    self._configure(config, size, wwn, 

Re: [ceph-users] Problems setting up iSCSI

[Jason Dillaman]

Is 'tcmu-runner' running on that node? Any errors in dmesg or
/var/log/tcmu-runner.log?

On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick  wrote:

> Hi,
>
> Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
> > Do you have the ansible backtrace from the "ceph-iscsi-gw : igw_lun |
> > configureluns (create/map rbds and add to lio)]" step?
> I assume you mean the following (from running with verbosity 3, after
> running the purge-iscsi-gateways playbook beforehand)
>
> Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
>  ESTABLISH SSH CONNECTION FOR USER: root
>  SSH: EXEC ssh -o ControlMaster=auto -o
> ControlPersist=600s -o StrictHostKeyChecking=no -o
> KbdInteractiveAuthentication=no -o
> PreferredAuthentications=gssapi-with-mic,g
> ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
> User=root -o ConnectTimeout=30 -o
> ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c
> '"'"'/usr/bin/p
> ython && sleep 0'"'"''
>  (1, '', 'Traceback (most recent call last):\n  File
> "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in \n
> ansible_main()\n  File "/tmp/ansible_F3
> sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
> lun.manage(desired_state)\n  File
> "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365,
> in manage\nself.allocate()\n  File "/u
> sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in
> allocate\nlun = self.add_dev_to_lio()\n  File
> "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683,
> in add_dev_to_lio\n
>  wwn=in_wwn, control=control_string)\n  File
> "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
> __init__\nself._configure(config, size, wwn, hw_max_sectors,
> control)\n  File "/usr/lib/pytho
> n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
> self._enable()\n  File
> "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
> _enable\nfwrite(path, "1\\n")\n  File "/usr/lib/pyt
> hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
> file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> directory\n')
> The full traceback is:
> Traceback (most recent call last):
>File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
> 
>  ansible_main()
>File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in
> ansible_main
>  lun.manage(desired_state)
>File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 365, in manage
>  self.allocate()
>File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 490, in allocate
>  lun = self.add_dev_to_lio()
>File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 683, in add_dev_to_lio
>  wwn=in_wwn, control=control_string)
>File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818,
> in __init__
>  self._configure(config, size, wwn, hw_max_sectors, control)
>File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 836,
> in _configure
>  self._enable()
>File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172,
> in _enable
>  fwrite(path, "1\n")
>File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line 79,
> in fwrite
>  file_fd.write(str(string))
> IOError: [Errno 2] No such file or directory
>
> failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
> u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size': u'1G'}) => {
>  "changed": false,
>  "item": {
>  "host": "ovirt-test04",
>  "image": "iscsi2342",
>  "pool": "rbd",
>  "size": "1G",
>  "state": "present"
>  },
>  "module_stderr": "Traceback (most recent call last):\n  File
> \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
> \nansible_main()\n  File
> \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
> py\", line 135, in ansible_main\nlun.manage(desired_state)\n  File
> \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 365,
> in manage\nself.allocate()\n  File \"/usr/lib/python2.7/site-pa
> ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\nlun =
> self.add_dev_to_lio()\n  File
> \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 683,
> in add_dev_to_lio\nwwn=in_wwn, contr
> ol=control_string)\n  File
> \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 818, in
> __init__\nself._configure(config, size, wwn, hw_max_sectors,
> control)\n  File \"/usr/lib/python2.7/site-packages
> /rtslib_fb/tcm.py\", line 836, in _configure\nself._enable()\n  File
> \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 172, in
> _enable\nfwrite(path, \"1\\n\")\n  File \"/usr/lib/python2.7/site-
> packages/rtslib_fb/utils.py\", line 79, in fwrite\n
> file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> directory\n",
>  "module_stdout": "",
>  "msg": "MODULE 

Re: [ceph-users] Problems setting up iSCSI

[Bernhard Dick]

Hi,

Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
Do you have the ansible backtrace from the "ceph-iscsi-gw : igw_lun | 
configureluns (create/map rbds and add to lio)]" step? 
I assume you mean the following (from running with verbosity 3, after 
running the purge-iscsi-gateways playbook beforehand)


Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
 ESTABLISH SSH CONNECTION FOR USER: root
 SSH: EXEC ssh -o ControlMaster=auto -o 
ControlPersist=600s -o StrictHostKeyChecking=no -o 
KbdInteractiveAuthentication=no -o 
PreferredAuthentications=gssapi-with-mic,g
ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 
User=root -o ConnectTimeout=30 -o 
ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c 
'"'"'/usr/bin/p

ython && sleep 0'"'"''
 (1, '', 'Traceback (most recent call last):\n  File 
"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in \n 
   ansible_main()\n  File "/tmp/ansible_F3
sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n 
lun.manage(desired_state)\n  File 
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365, 
in manage\nself.allocate()\n  File "/u
sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in 
allocate\nlun = self.add_dev_to_lio()\n  File 
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683, 
in add_dev_to_lio\n
wwn=in_wwn, control=control_string)\n  File 
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in 
__init__\nself._configure(config, size, wwn, hw_max_sectors, 
control)\n  File "/usr/lib/pytho
n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n 
self._enable()\n  File 
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in 
_enable\nfwrite(path, "1\\n")\n  File "/usr/lib/pyt
hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n 
file_fd.write(str(string))\nIOError: [Errno 2] No such file or directory\n')

The full traceback is:
Traceback (most recent call last):
  File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in 


ansible_main()
  File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in 
ansible_main

lun.manage(desired_state)
  File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", 
line 365, in manage

self.allocate()
  File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", 
line 490, in allocate

lun = self.add_dev_to_lio()
  File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", 
line 683, in add_dev_to_lio

wwn=in_wwn, control=control_string)
  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, 
in __init__

self._configure(config, size, wwn, hw_max_sectors, control)
  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 836, 
in _configure

self._enable()
  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, 
in _enable

fwrite(path, "1\n")
  File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line 79, 
in fwrite

file_fd.write(str(string))
IOError: [Errno 2] No such file or directory

failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image': 
u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size': u'1G'}) => {

"changed": false,
"item": {
"host": "ovirt-test04",
"image": "iscsi2342",
"pool": "rbd",
"size": "1G",
"state": "present"
},
"module_stderr": "Traceback (most recent call last):\n  File 
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in 
\nansible_main()\n  File 
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
py\", line 135, in ansible_main\nlun.manage(desired_state)\n  File 
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 365, 
in manage\nself.allocate()\n  File \"/usr/lib/python2.7/site-pa
ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\nlun = 
self.add_dev_to_lio()\n  File 
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 683, 
in add_dev_to_lio\nwwn=in_wwn, contr
ol=control_string)\n  File 
\"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 818, in 
__init__\nself._configure(config, size, wwn, hw_max_sectors, 
control)\n  File \"/usr/lib/python2.7/site-packages
/rtslib_fb/tcm.py\", line 836, in _configure\nself._enable()\n  File 
\"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 172, in 
_enable\nfwrite(path, \"1\\n\")\n  File \"/usr/lib/python2.7/site-
packages/rtslib_fb/utils.py\", line 79, in fwrite\n 
file_fd.write(str(string))\nIOError: [Errno 2] No such file or 
directory\n",

"module_stdout": "",
"msg": "MODULE FAILURE",
"rc": 1
}

Have you tried 
using the stock v4.16 kernel (no need to use the one on shaman)?
I have also used the v4.17.2-1.el7.elrepo.x86_64 elrepo kernel, having 
the same result.


  Regards
Bernhard


On Thu, Jun 28, 2018 at 11:29 AM Bernhard Dick > wrote:


Hi Jason,

Am 

Re: [ceph-users] Problems setting up iSCSI

[Jason Dillaman]

Do you have the ansible backtrace from the "ceph-iscsi-gw : igw_lun |
configure luns (create/map rbds and add to lio)]" step? Have you tried
using the stock v4.16 kernel (no need to use the one on shaman)?

On Thu, Jun 28, 2018 at 11:29 AM Bernhard Dick  wrote:

> Hi Jason,
>
> Am 28.06.2018 um 14:33 schrieb Jason Dillaman:
> > You should have "/var/log/ansible-module-igw_config.log" on the target
> > machine that hopefully includes more information about why the RBD image
> > is missing from the TCM backend.
> I have the logfile, however there everything seems fine. The last lines
> are:
> 2018-06-28 17:25:36,876 igw_lun.py DEBUG: Check the rbd image size
> matches the request
> 2018-06-28 17:25:36,904 igw_lun.py DEBUG: rbd image rbd.iscsi2342
> size matches the configuration file request
> 2018-06-28 17:25:36,904 igw_lun.py DEBUG: Begin processing LIO mapping
> 2018-06-28 17:25:36,905 igw_lun.py INFO : (LUN.add_dev_to_lio)
> Adding image 'rbd.iscsi2342' to LIO
> 2018-06-28 17:25:36,905 igw_lun.py DEBUG: control="max_data_area_mb=8"
>
>Regards
>  Bernhard
>
> > In the past, I've seen issues w/ image
> > features and image size mismatch causing the process to abort
> >
> > On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick  > > wrote:
> >
> > Hi,
> >
> > I'm trying to setup iSCSI using ceph-ansible (stable-3.1) branch with
> > one iscsi gateway. The Host is a CentOS 7 host and I use the packages
> > from the Centos Storage SIG for luminous. Additionally I have
> installed:
> > ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7
> > ceph-iscsi-config Version 2.6 Release 15.ge016c6f.el7
> > from the iscsi project at shaman.ceph.com .
> > The python-rtslib version on the host is 2.1.fb67 Release 10.g7713d1e
> > also from shaman. The running kernel version is
> > 4.15.0-ceph-g1c778f43da52.
> > The ansible process stops at TASK [ceph-iscsi-gw : igw_lun |
> configure
> > luns (create/map rbds and add to lio)] complaining about file not
> found
> > while caused by the self._enable function in tcm.py. That is due to
> the
> > directory /sys/kernel/config/target/core/user_0/ is completely
> missing
> > at this step.
> > Do you have any ideas how to fix or debug this further?
> >
> > Regards
> >   Bernhard
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com 
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> >
> >
> > --
> > Jason
>
>
> --
> Dipl.-Inf. Bernhard Dick
> Auf dem Anger 24
> DE-46485 Wesel
> www.BernhardDick.de
>
> jabber: bernh...@jabber.bdick.de
>
> Tel : +49.2812068620
> Mobil : +49.1747607927
> FAX : +49.2812068621
> USt-IdNr.: DE274728845
>


-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Problems setting up iSCSI

[Bernhard Dick]

Hi Jason,

Am 28.06.2018 um 14:33 schrieb Jason Dillaman:
You should have "/var/log/ansible-module-igw_config.log" on the target 
machine that hopefully includes more information about why the RBD image 
is missing from the TCM backend.

I have the logfile, however there everything seems fine. The last lines are:
2018-06-28 17:25:36,876 igw_lun.py DEBUG: Check the rbd image size 
matches the request
2018-06-28 17:25:36,904 igw_lun.py DEBUG: rbd image rbd.iscsi2342 
size matches the configuration file request

2018-06-28 17:25:36,904 igw_lun.py DEBUG: Begin processing LIO mapping
2018-06-28 17:25:36,905 igw_lun.py INFO : (LUN.add_dev_to_lio) 
Adding image 'rbd.iscsi2342' to LIO

2018-06-28 17:25:36,905 igw_lun.py DEBUG: control="max_data_area_mb=8"

  Regards
Bernhard

In the past, I've seen issues w/ image 
features and image size mismatch causing the process to abort


On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick > wrote:


Hi,

I'm trying to setup iSCSI using ceph-ansible (stable-3.1) branch with
one iscsi gateway. The Host is a CentOS 7 host and I use the packages
from the Centos Storage SIG for luminous. Additionally I have installed:
ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7
ceph-iscsi-config Version 2.6 Release 15.ge016c6f.el7
from the iscsi project at shaman.ceph.com .
The python-rtslib version on the host is 2.1.fb67 Release 10.g7713d1e
also from shaman. The running kernel version is
4.15.0-ceph-g1c778f43da52.
The ansible process stops at TASK [ceph-iscsi-gw : igw_lun | configure
luns (create/map rbds and add to lio)] complaining about file not found
while caused by the self._enable function in tcm.py. That is due to the
directory /sys/kernel/config/target/core/user_0/ is completely missing
at this step.
Do you have any ideas how to fix or debug this further?

    Regards
      Bernhard
___
ceph-users mailing list
ceph-users@lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
Jason



--
Dipl.-Inf. Bernhard Dick
Auf dem Anger 24
DE-46485 Wesel
www.BernhardDick.de

jabber: bernh...@jabber.bdick.de

Tel : +49.2812068620
Mobil : +49.1747607927
FAX : +49.2812068621
USt-IdNr.: DE274728845
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Problems setting up iSCSI

[Jason Dillaman]

You should have "/var/log/ansible-module-igw_config.log" on the target
machine that hopefully includes more information about why the RBD image is
missing from the TCM backend. In the past, I've seen issues w/ image
features and image size mismatch causing the process to abort.

On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick  wrote:

> Hi,
>
> I'm trying to setup iSCSI using ceph-ansible (stable-3.1) branch with
> one iscsi gateway. The Host is a CentOS 7 host and I use the packages
> from the Centos Storage SIG for luminous. Additionally I have installed:
> ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7
> ceph-iscsi-config Version 2.6 Release 15.ge016c6f.el7
> from the iscsi project at shaman.ceph.com.
> The python-rtslib version on the host is 2.1.fb67 Release 10.g7713d1e
> also from shaman. The running kernel version is 4.15.0-ceph-g1c778f43da52.
> The ansible process stops at TASK [ceph-iscsi-gw : igw_lun | configure
> luns (create/map rbds and add to lio)] complaining about file not found
> while caused by the self._enable function in tcm.py. That is due to the
> directory /sys/kernel/config/target/core/user_0/ is completely missing
> at this step.
> Do you have any ideas how to fix or debug this further?
>
>Regards
>  Bernhard
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com