Re: [ceph-users] missing feature 400000000000000 ?
Correct me if I'm wrong, but I understand rbd-nbd is a userland client for mapping RBDs to local block devices (like "rbd map" in the kernel client), not a client for mounting the cephfs filesystem which is what Riccardo is using? Rich On 17/07/17 12:48, Massimiliano Cuttini wrote: > Hi Riccardo, > > using ceph-fuse will add extra layer. > Consider to use instead ceph-nbd which is a porting to use network device > blocks. > This should be faster and allow you to use latest tunables (which it's > better). > > Il 17/07/2017 10:56, Riccardo Murri ha scritto: >> Thanks a lot to all! Both the suggestion to use "ceph osd tunables >> hammer" and to use "ceph-fuse" instead solved the issue. >> >> Riccardo signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] missing feature 400000000000000 ?
Hi Riccardo, using ceph-fuse will add extra layer. Consider to use instead ceph-nbd which is a porting to use network device blocks. This should be faster and allow you to use latest tunables (which it's better). Il 17/07/2017 10:56, Riccardo Murri ha scritto: Thanks a lot to all! Both the suggestion to use "ceph osd tunables hammer" and to use "ceph-fuse" instead solved the issue. Riccardo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] missing feature 400000000000000 ?
Thanks a lot to all! Both the suggestion to use "ceph osd tunables hammer" and to use "ceph-fuse" instead solved the issue. Riccardo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] missing feature 400000000000000 ?
On 14/07/17 11:03, Ilya Dryomov wrote: > On Fri, Jul 14, 2017 at 11:29 AM, Riccardo Murri > wrote: >> Hello, >> >> I am trying to install a test CephFS "Luminous" system on Ubuntu 16.04. >> >> Everything looks fine, but the `mount.ceph` command fails (error 110, >> timeout); >> kernel logs show a number of messages like these before the `mount` >> prog gives up: >> >> libceph: ... feature set mismatch, my 107b84a842aca < server's >> 40107b84a842aca, missing 400 >> >> I read in [1] that this is feature >> CEPH_FEATURE_NEW_OSDOPREPLY_ENCODING which is only supported in >> kernels 4.5 and up -- whereas Ubuntu 16.04 runs Linux 4.4. >> >> Is there some tunable or configuration file entry that I can set, >> which will make Luminous FS mounting work on the std Ubuntu 16.04 >> Linux kernel? I.e., is there a way I can avoid upgrading the kernel? >> >> [1]: >> http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client > > Yes, you should be able to set your CRUSH tunables profile to hammer > with "ceph osd crush tunables hammer". > > Thanks, > > Ilya Alternatively, keep in mind you can install ceph-fuse and mount the FS using that userland client instead, if you'd prefer the tunables in your cluster to be up to date. Rich signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] missing feature 400000000000000 ?
On Fri, Jul 14, 2017 at 11:29 AM, Riccardo Murri wrote: > Hello, > > I am trying to install a test CephFS "Luminous" system on Ubuntu 16.04. > > Everything looks fine, but the `mount.ceph` command fails (error 110, > timeout); > kernel logs show a number of messages like these before the `mount` > prog gives up: > > libceph: ... feature set mismatch, my 107b84a842aca < server's > 40107b84a842aca, missing 400 > > I read in [1] that this is feature > CEPH_FEATURE_NEW_OSDOPREPLY_ENCODING which is only supported in > kernels 4.5 and up -- whereas Ubuntu 16.04 runs Linux 4.4. > > Is there some tunable or configuration file entry that I can set, > which will make Luminous FS mounting work on the std Ubuntu 16.04 > Linux kernel? I.e., is there a way I can avoid upgrading the kernel? > > [1]: > http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client Yes, you should be able to set your CRUSH tunables profile to hammer with "ceph osd crush tunables hammer". Thanks, Ilya ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] missing feature 400000000000000 ?
according to some slide in https://www.youtube.com/watch?v=gp6if858HUI the support is: > TUNABLE RELEASE CEPH_VERSION KERNEL > CRUSH_TUNABLES argonaut v0.48.1 v3.6 > CRUSH_TUNABLES2 bobtail v0.55 v3.9 > CRUSH_TUNABLES3 firefly v0.78 v3.15 > CRUSH_V4 hammerv0.94 v4.1 > CRUSH_TUNABLES5 Jewel v10.0.2 v4.5 So go to hammer tunables: > ceph osd crush tunables hammer On 07/14/17 11:29, Riccardo Murri wrote: > Hello, > > I am trying to install a test CephFS "Luminous" system on Ubuntu 16.04. > > Everything looks fine, but the `mount.ceph` command fails (error 110, > timeout); > kernel logs show a number of messages like these before the `mount` > prog gives up: > > libceph: ... feature set mismatch, my 107b84a842aca < server's > 40107b84a842aca, missing 400 > > I read in [1] that this is feature > CEPH_FEATURE_NEW_OSDOPREPLY_ENCODING which is only supported in > kernels 4.5 and up -- whereas Ubuntu 16.04 runs Linux 4.4. > > Is there some tunable or configuration file entry that I can set, > which will make Luminous FS mounting work on the std Ubuntu 16.04 > Linux kernel? I.e., is there a way I can avoid upgrading the kernel? > > [1]: > http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client > > Thanks, > Riccardo > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Peter Maloney Brockmann Consult Max-Planck-Str. 2 21502 Geesthacht Germany Tel: +49 4152 889 300 Fax: +49 4152 889 333 E-mail: peter.malo...@brockmann-consult.de Internet: http://www.brockmann-consult.de ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com