Re: [ceph-users] No ops on some OSD
Very very nice, Thanks! Is there a heavy penalty to pay for enabling this? -Original Message- From: John Spray [mailto:jsp...@redhat.com] Sent: maandag 13 november 2017 11:48 To: Marc Roos Cc: iswaradrmwn; ceph-users Subject: Re: [ceph-users] No ops on some OSD On Sun, Nov 12, 2017 at 2:56 PM, Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > [@c03 ~]# ceph osd status > 2017-11-12 15:54:13.164823 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore > 2017-11-12 15:54:13.211219 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore no valid > command found; 10 closest matches: > osd map {} osd lspools {} osd > count-metadata osd versions osd find > osd metadata {} osd getmaxosd osd ls-tree > {<int[0-]>} {} osd getmap {<int[0-]>} osd getcrushmap > {<int[0-]>} Error EINVAL: invalid command The "osd status" command comes from the ceph-mgr module called "status" -- this is enabled by default but it's possible that it got switched off on your system? Check your ceph-mgr logs and whether it's in "ceph mgr module ls" (or try enabling with "ceph mgr module enable status") John > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: zondag 12 november 2017 2:17 > Cc: ceph-users > Subject: Re: [ceph-users] No ops on some OSD > > Still the same syntax (ceph osd status) > > Thanks > > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> > wrote: > > > > > What is the new syntax for "ceph osd status" for luminous? > > > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: donderdag 2 november 2017 6:19 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] No ops on some OSD > > Hello, > > I want to ask about my problem. There's some OSD that dont > have any load > (indicated with No ops on that OSD). > > Hereby I attached the ceph osd status result : > https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. > There's no > load or operation happened at that OSD. How to fix this? > > Thank you > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System > Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] No ops on some OSD
On Sun, Nov 12, 2017 at 2:56 PM, Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > [@c03 ~]# ceph osd status > 2017-11-12 15:54:13.164823 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore > 2017-11-12 15:54:13.211219 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore > no valid command found; 10 closest matches: > osd map {} > osd lspools {} > osd count-metadata > osd versions > osd find > osd metadata {} > osd getmaxosd > osd ls-tree {<int[0-]>} {} > osd getmap {<int[0-]>} > osd getcrushmap {<int[0-]>} > Error EINVAL: invalid command The "osd status" command comes from the ceph-mgr module called "status" -- this is enabled by default but it's possible that it got switched off on your system? Check your ceph-mgr logs and whether it's in "ceph mgr module ls" (or try enabling with "ceph mgr module enable status") John > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: zondag 12 november 2017 2:17 > Cc: ceph-users > Subject: Re: [ceph-users] No ops on some OSD > > Still the same syntax (ceph osd status) > > Thanks > > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> > wrote: > > > > > What is the new syntax for "ceph osd status" for luminous? > > > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: donderdag 2 november 2017 6:19 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] No ops on some OSD > > Hello, > > I want to ask about my problem. There's some OSD that dont have any > load > (indicated with No ops on that OSD). > > Hereby I attached the ceph osd status result : > https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's > no > load or operation happened at that OSD. How to fix this? > > Thank you > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] No ops on some OSD
Indeed this what I have [@c01 ceph]# ceph --version ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable) [@c01 ceph]# ceph tell osd.* version|head osd.0: { "version": "ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable)" } osd.1: { "version": "ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable)" } osd.2: { "version": "ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable)" } osd.3: { [@c01 ceph]# rpm -qa | grep ceph | sort ceph-12.2.1-0.el7.x86_64 ceph-base-12.2.1-0.el7.x86_64 ceph-common-12.2.1-0.el7.x86_64 ceph-mds-12.2.1-0.el7.x86_64 ceph-mgr-12.2.1-0.el7.x86_64 ceph-mon-12.2.1-0.el7.x86_64 ceph-osd-12.2.1-0.el7.x86_64 ceph-selinux-12.2.1-0.el7.x86_64 collectd-ceph-5.7.1-2.el7.x86_64 libcephfs2-12.2.1-0.el7.x86_64 nfs-ganesha-ceph-2.5.2-.el7.x86_64 python-cephfs-12.2.1-0.el7.x86_64 -Original Message- From: Caspar Smit [mailto:caspars...@supernas.eu] Sent: maandag 13 november 2017 10:51 To: ceph-users Subject: Re: [ceph-users] No ops on some OSD Weird # ceph --version ceph version 12.2.1 (fc129ad90a65dc0b419412e77cb85ac230da42a6) luminous (stable) # ceph osd status +++---+---++-++-+ | id | host | used | avail | wr ops | wr data | rd ops | rd data | +++---+---++-++-+ | 0 | node04 | 115M | 11.6G |0 | 0 |0 | 0 | +++---+---++-++-+ ps. output is from a single host with 1 (virtual) OSD configured but the command works Try to remove that dangerous and experimental features setting from your ceph.conf and see if that solves it. Caspar 2017-11-12 15:56 GMT+01:00 Marc Roos <m.r...@f1-outsourcing.eu>: [@c03 ~]# ceph osd status 2017-11-12 15:54:13.164823 7f478a6ad700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore 2017-11-12 15:54:13.211219 7f478a6ad700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore no valid command found; 10 closest matches: osd map {} osd lspools {} osd count-metadata osd versions osd find osd metadata {} osd getmaxosd osd ls-tree {<int[0-]>} {} osd getmap {<int[0-]>} osd getcrushmap {<int[0-]>} Error EINVAL: invalid command -Original Message- From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] Sent: zondag 12 november 2017 2:17 Cc: ceph-users Subject: Re: [ceph-users] No ops on some OSD Still the same syntax (ceph osd status) Thanks Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> wrote: What is the new syntax for "ceph osd status" for luminous? -Original Message- From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] Sent: donderdag 2 november 2017 6:19 To: ceph-users@lists.ceph.com Subject: [ceph-users] No ops on some OSD Hello, I want to ask about my problem. There's some OSD that dont have any load (indicated with No ops on that OSD). Hereby I attached the ceph osd status result : https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's no load or operation happened at that OSD. How to fix this? Thank you Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> <ht
Re: [ceph-users] No ops on some OSD
Weird # ceph --version ceph version 12.2.1 (fc129ad90a65dc0b419412e77cb85ac230da42a6) luminous (stable) # ceph osd status +++---+---++-++-+ | id | host | used | avail | wr ops | wr data | rd ops | rd data | +++---+---++-++-+ | 0 | node04 | 115M | 11.6G |0 | 0 |0 | 0 | +++---+---++-++-+ ps. output is from a single host with 1 (virtual) OSD configured but the command works Try to remove that dangerous and experimental features setting from your ceph.conf and see if that solves it. Caspar 2017-11-12 15:56 GMT+01:00 Marc Roos <m.r...@f1-outsourcing.eu>: > > [@c03 ~]# ceph osd status > 2017-11-12 15:54:13.164823 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore > 2017-11-12 15:54:13.211219 7f478a6ad700 -1 WARNING: the following > dangerous and experimental features are enabled: bluestore > no valid command found; 10 closest matches: > osd map {} > osd lspools {} > osd count-metadata > osd versions > osd find > osd metadata {} > osd getmaxosd > osd ls-tree {<int[0-]>} {} > osd getmap {<int[0-]>} > osd getcrushmap {<int[0-]>} > Error EINVAL: invalid command > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: zondag 12 november 2017 2:17 > Cc: ceph-users > Subject: Re: [ceph-users] No ops on some OSD > > Still the same syntax (ceph osd status) > > Thanks > > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> > wrote: > > > > > What is the new syntax for "ceph osd status" for luminous? > > > > > > -----Original Message----- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: donderdag 2 november 2017 6:19 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] No ops on some OSD > > Hello, > > I want to ask about my problem. There's some OSD that dont have any > load > (indicated with No ops on that OSD). > > Hereby I attached the ceph osd status result : > https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's > no > load or operation happened at that OSD. How to fix this? > > Thank you > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] No ops on some OSD
[@c03 ~]# ceph osd status 2017-11-12 15:54:13.164823 7f478a6ad700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore 2017-11-12 15:54:13.211219 7f478a6ad700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore no valid command found; 10 closest matches: osd map {} osd lspools {} osd count-metadata osd versions osd find osd metadata {} osd getmaxosd osd ls-tree {<int[0-]>} {} osd getmap {<int[0-]>} osd getcrushmap {<int[0-]>} Error EINVAL: invalid command -Original Message- From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] Sent: zondag 12 november 2017 2:17 Cc: ceph-users Subject: Re: [ceph-users] No ops on some OSD Still the same syntax (ceph osd status) Thanks Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> wrote: What is the new syntax for "ceph osd status" for luminous? -Original Message- From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] Sent: donderdag 2 november 2017 6:19 To: ceph-users@lists.ceph.com Subject: [ceph-users] No ops on some OSD Hello, I want to ask about my problem. There's some OSD that dont have any load (indicated with No ops on that OSD). Hereby I attached the ceph osd status result : https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's no load or operation happened at that OSD. How to fix this? Thank you Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] No ops on some OSD
Still the same syntax (ceph osd status) Thanks Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com On Sat, Nov 4, 2017 at 6:11 PM, Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > > What is the new syntax for "ceph osd status" for luminous? > > > > > -Original Message- > From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] > Sent: donderdag 2 november 2017 6:19 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] No ops on some OSD > > Hello, > > I want to ask about my problem. There's some OSD that dont have any load > (indicated with No ops on that OSD). > > Hereby I attached the ceph osd status result : > https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's no > load or operation happened at that OSD. How to fix this? > > Thank you > Regards, > > I Gede Iswara Darmawan > > Information System - School of Industrial and System Engineering > > Telkom University > > P / SMS / WA : 081 322 070719 > > E : iswaradr...@gmail.com / iswaradr...@live.com > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] No ops on some OSD
What is the new syntax for "ceph osd status" for luminous? -Original Message- From: I Gede Iswara Darmawan [mailto:iswaradr...@gmail.com] Sent: donderdag 2 november 2017 6:19 To: ceph-users@lists.ceph.com Subject: [ceph-users] No ops on some OSD Hello, I want to ask about my problem. There's some OSD that dont have any load (indicated with No ops on that OSD). Hereby I attached the ceph osd status result : https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's no load or operation happened at that OSD. How to fix this? Thank you Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] No ops on some OSD
Hello, I want to ask about my problem. There's some OSD that dont have any load (indicated with No ops on that OSD). Hereby I attached the ceph osd status result : https://pastebin.com/fFLcCbpk . Look at OSD 17,61 and 72. There's no load or operation happened at that OSD. How to fix this? Thank you Regards, I Gede Iswara Darmawan Information System - School of Industrial and System Engineering Telkom University P / SMS / WA : 081 322 070719 E : iswaradr...@gmail.com / iswaradr...@live.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com