New error Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out) Dec 20 11:03:34 osd03 journal: LUN alloc problem - Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out)
This is interesting as I was under the impression that kernel 4.14 is patched ( I am using 4.14.7-1.el7.elrepo.x86_64 ) Any ideas / suggestions ? Do I need to patch this kernel ..if yes, how ? Steven On 20 December 2017 at 11:03, Steven Vacaroaia <[email protected]> wrote: > Hi Jason, > > Many thanks for your prompt response > > Is this the branch you are suggesting ? > > https://github.com/ceph/ceph-iscsi-cli/tree/reduce_startup_time > > If not, please provide a link > > Steven > > On 20 December 2017 at 10:58, Jason Dillaman <[email protected]> wrote: > >> Can you try the latest HEAD revision of ceph-iscsi-config / >> ceph-iscsi-cli? There have been a lot of bug fixes and it should also >> provide better debug logs when an error occurs. >> >> On Wed, Dec 20, 2017 at 10:46 AM, Steven Vacaroaia <[email protected]> >> wrote: >> > Hi, >> > >> > It will be greatly appreciated if you could provide some guidance >> > Even a working gateway.conf would be great as some people are saying >> that >> > loading a working config will work >> > >> > The issue is that cannot create disks because - "Failed : 500 INTERNAL >> > SERVER ERROR" >> > >> > gwcli disks directory exists only in the root folder - there is no disks >> > directory under iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw >> so I >> > tried creating disks in both locations >> > >> > gwcli >> > /> ls >> > o- / >> > ............................................................ >> ............................................................. >> > [...] >> > o- clusters >> > ............................................................ >> ............................................ >> > [Clusters: 1] >> > | o- ceph >> > ............................................................ >> ................................................ >> > [HEALTH_OK] >> > | o- pools >> > ............................................................ >> .............................................. >> > [Pools: 3] >> > | | o- rbd >> > ............................................................ >> ................. >> > [(x2), Commit: 0b/2.3T (0%), Used: 30K] >> > | | o- test-erasure >> > .................................................................... >> [(3+0), >> > Commit: 0b/3.1T (0%), Used: 0b] >> > | | o- test-replicated >> > ................................................................. >> [(x2), >> > Commit: 0b/2.3T (0%), Used: 69K] >> > | o- topology >> > ............................................................ >> .................................... >> > [OSDs: 9,MONs: 1] >> > o- disks >> > ............................................................ >> .............................................. >> > [0b, Disks: 0] >> > o- iscsi-target >> > ............................................................ >> ......................................... >> > [Targets: 1] >> > o- iqn.2003-01.com.redhat.iscsi-gw:ceph-gw >> > ....................................................................... >> > [Gateways: 2] >> > o- gateways >> > ............................................................ >> ................................ >> > [Up: 2/2, Portals: 2] >> > | o- osd01 >> > ............................................................ >> ................................... >> > [10.10.30.181 (UP)] >> > | o- osd03 >> > ............................................................ >> ................................... >> > [10.10.30.183 (UP)] >> > o- host-groups >> > ............................................................ >> ...................................... >> > [Groups : 0] >> > o- hosts >> > ............................................................ >> .............................................. >> > [Hosts: 0] >> > /> /disks/ create pool=rbd image=disk1 size=10g >> > Failed : 500 INTERNAL SERVER ERROR >> > /> cd iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw/ >> > /iscsi-target...si-gw:ceph-gw> /disks/ create pool=rbd image=disk1 >> size=10g >> > Failed : 500 INTERNAL SERVER ERROR >> > >> > >> > >> > rados ls -p rbd >> > rbd_header.853b1d9f6e5f >> > rbd_object_map.85865675ff36 >> > rbd_header.5fb6257130a3 >> > gateway.conf >> > rbd_directory >> > rbd_object_map.5fb6257130a3 >> > rbd_header.85865675ff36 >> > rbd_info >> > rbd_header.60003a95f874 >> > rbd_object_map.853b1d9f6e5f >> > rbd_object_map.8577100f59dc >> > rbd_object_map.855b22221a70 >> > rbd_object_map.60003a95f874 >> > rbd_header.855b22221a70 >> > rbd_header.8577100f59dc >> > >> > >> > Here is more pertinent info >> > >> > Linux osd03 4.14.5-1.el7.elrepo.x86_64 >> > >> > Successfully installed rtslib-fb-2.1.64 >> > >> > Successfully installed targetcli-fb-2.1.fb47 >> > >> > Successfully installed ceph-iscsi-config-2.3 >> > >> > Successfully installed gwcli-2.5 >> > >> > Successfully installed gwtop-2.1 >> > >> > >> > /var/log/messages >> > >> > >> > rbd-target-api: File "rbd.pyx", line 1392, in rbd.Image.__init__ >> > (/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/ >> AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/cen >> > >> > tos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.2/rpm/el7/ >> BUILD/ceph-12.2.2/build/src/pybind/rbd/pyrex/rbd.c:11741) >> > >> > Dec 20 10:31:57 osd03 rbd-target-api: ImageNotFound: [errno 2] error >> opening >> > image disk1 at snapshot None >> > >> > Dec 20 10:31:57 osd03 journal: _disk change on 127.0.0.1 failed with 500 >> > >> > Dec 20 10:31:57 osd03 journal: 127.0.0.1 - - [20/Dec/2017 10:31:57] "PUT >> > /api/disk/rbd.disk1 HTTP/1.1" 500 - >> > >> > >> > /var/log/rbd-target-api.log >> > 2017-12-20 10:31:57,190 DEBUG [rbd-target-api:594:disk()] - this >> host is >> > osd03 >> > 2017-12-20 10:31:57,191 DEBUG [rbd-target-api:609:disk()] - All >> gateways: >> > [u'osd03', u'osd01'] >> > 2017-12-20 10:31:57,191 DEBUG [rbd-target-api:623:disk()] - Other >> > gateways: [u'osd01'] >> > 2017-12-20 10:31:57,194 INFO [_internal.py:87:_log()] - 127.0.0.1 - >> - >> > [20/Dec/2017 10:31:57] "GET /api/config HTTP/1.1" 200 - >> > 2017-12-20 10:31:57,214 INFO [_internal.py:87:_log()] - 127.0.0.1 - >> - >> > [20/Dec/2017 10:31:57] "GET /api/_ping HTTP/1.1" 200 - >> > 2017-12-20 10:31:57,219 DEBUG [rbd-target-api:1405:call_api()] - >> gateway >> > update order is 127.0.0.1,osd01 >> > 2017-12-20 10:31:57,219 DEBUG [rbd-target-api:1408:call_api()] - >> > processing GW '127.0.0.1' >> > 2017-12-20 10:31:57,237 DEBUG [common.py:123:_get_ceph_config()] - >> > (_get_rbd_config) Opening connection to rbd pool >> > 2017-12-20 10:31:57,237 DEBUG [common.py:131:_get_ceph_config()] - >> > (_get_rbd_config) connection opened >> > 2017-12-20 10:31:57,238 DEBUG [common.py:99:_read_config_object()] - >> > _read_config_object reading the config object >> > 2017-12-20 10:31:57,239 DEBUG [common.py:147:_get_ceph_config()] - >> > (_get_rbd_config) config object contains '{ >> > "clients": {}, >> > "created": "2017/12/20 14:22:23", >> > "disks": {}, >> > "epoch": 4, >> > "gateways": { >> > "created": "2017/12/20 14:55:08", >> > "ip_list": [ >> > "10.10.30.183", >> > "10.10.30.181" >> > ], >> > "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw", >> > "osd01": { >> > "active_luns": 0, >> > "created": "2017/12/20 14:56:52", >> > "gateway_ip_list": [ >> > "10.10.30.183", >> > "10.10.30.181" >> > ], >> > "inactive_portal_ips": [ >> > "10.10.30.183" >> > ], >> > "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw", >> > "portal_ip_address": "10.10.30.181", >> > "tpgs": 2, >> > "updated": "2017/12/20 14:56:52" >> > }, >> > "osd03": { >> > "active_luns": 0, >> > "created": "2017/12/20 14:55:45", >> > "gateway_ip_list": [ >> > "10.10.30.183", >> > "10.10.30.181" >> > ], >> > "inactive_portal_ips": [ >> > "10.10.30.181" >> > ], >> > "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw", >> > "portal_ip_address": "10.10.30.183", >> > "tpgs": 2, >> > "updated": "2017/12/20 14:56:51" >> > } >> > }, >> > "groups": {}, >> > "updated": "2017/12/20 14:56:52", >> > "version": 3 >> > }' >> > 2017-12-20 10:31:57,262 DEBUG [lun.py:328:allocate()] - LUN.allocate >> > starting, listing rbd devices >> > 2017-12-20 10:31:57,279 DEBUG [lun.py:331:allocate()] - rados pool >> 'rbd' >> > contains the following - [u'disk1', u'disk2', u'disk3', u'disk4', >> u'disk6', >> > u'disk7'] >> > 2017-12-20 10:31:57,279 DEBUG [lun.py:336:allocate()] - Hostname >> Check - >> > this host is osd03, target host for allocations is osd03 >> > 2017-12-20 10:31:57,321 INFO [_internal.py:87:_log()] - 127.0.0.1 - >> - >> > [20/Dec/2017 10:31:57] "PUT /api/_disk/rbd.disk1 HTTP/1.1" 500 - >> > 2017-12-20 10:31:57,322 ERROR [rbd-target-api:1429:call_api()] - >> _disk >> > change on 127.0.0.1 failed with 500 >> > 2017-12-20 10:31:57,333 INFO [_internal.py:87:_log()] - 127.0.0.1 - >> - >> > [20/Dec/2017 10:31:57] "PUT /api/disk/rbd.disk1 HTTP/1.1" 500 - >> > >> > >> > _______________________________________________ >> > ceph-users mailing list >> > [email protected] >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > >> >> >> >> -- >> Jason >> > >
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
