It doesn't look like your OSD is mounted. What do you have when you run mount? How did you create your OSDs?
Robert LeBlanc Sent from a mobile device please excuse any typos. On Mar 25, 2015 1:31 AM, "oyym...@gmail.com" <oyym...@gmail.com> wrote: > Hi，Jesus > I encountered similar problem. > *1.* shut down one of nodes， but all osds can't reactive on the node > after reboot. > *2.* run service ceph restart manually, got the same error message: > [root@storage4 ~]# /etc/init.d/ceph start > === osd.15 === > 2015-03-23 14:43:32.399811 7fed0fcf4700 -1 monclient(hunting): ERROR: > missing keyring, cannot use cephx for authentication > 2015-03-23 14:43:32.399814 7fed0fcf4700 0 librados: osd.15 initialization > error (2) No such file or directory > Error connecting to cluster: ObjectNotFound > failed: 'timeout 30 /usr/bin/ceph -c /etc/ceph/ceph.conf --name=osd.15 > --keyring=/var/lib/ceph/osd/ceph-15/keyring osd crush create-or-move -- 15 > 0.19 host=storage4 root=default' > ...... > 3. ll /var/lib/ceph/osd/ceph-15/ > total 0 > > all files *disappeared* in the /var/lib/ceph/osd/ceph-15/ > > > > > ------------------------------ > oyym...@gmail.com > > > *From:* Jesus Chavez (jeschave) <jesch...@cisco.com> > *Date:* 2015-03-24 05:09 > *To:* ceph-users <ceph-users@lists.ceph.com> > *Subject:* [ceph-users] ERROR: missing keyring, cannot use cephx for > authentication > Hi all, I did HA failover test shutting down 1 node and I see that only 1 > OSD came up after reboot: > > [root@geminis ceph]# df -h > Filesystem Size Used Avail Use% Mounted on > /dev/mapper/rhel-root 50G 4.5G 46G 9% / > devtmpfs 126G 0 126G 0% /dev > tmpfs 126G 80K 126G 1% /dev/shm > tmpfs 126G 9.9M 126G 1% /run > tmpfs 126G 0 126G 0% /sys/fs/cgroup > /dev/sda1 494M 165M 330M 34% /boot > /dev/mapper/rhel-home 36G 44M 36G 1% /home > /dev/sdc1 3.7T 134M 3.7T 1% /var/lib/ceph/osd/ceph-14 > > If I run service ceph restart I got this error message… > > Stopping Ceph osd.94 on geminis...done > === osd.94 === > 2015-03-23 15:05:41.632505 7fe7b9941700 -1 monclient(hunting): ERROR: > missing keyring, cannot use cephx for authentication > 2015-03-23 15:05:41.632508 7fe7b9941700 0 librados: osd.94 initialization > error (2) No such file or directory > Error connecting to cluster: ObjectNotFound > failed: 'timeout 30 /usr/bin/ceph -c /etc/ceph/ceph.conf --name=osd.94 > --keyring=/var/lib/ceph/osd/ceph-94/keyring osd crush create-or-move -- 94 > 0.05 host=geminis root=default > > > I have ceph.conf and ceph.client.admin.keyring under /etc/ceph: > > > [root@geminis ceph]# ls /etc/ceph > ceph.client.admin.keyring ceph.conf rbdmap tmp1OqNFi tmptQ0a1P > [root@geminis ceph]# > > > does anybody know what could be wrong? > > Thanks > > > > > > * Jesus Chavez* > SYSTEMS ENGINEER-C.SALES > > jesch...@cisco.com > Phone: *+52 55 5267 3146 <%2B52%2055%205267%203146>* > Mobile: *+51 1 5538883255* > > CCIE - 44433 > > > Cisco.com <http://www.cisco.com/> > > > > > > Think before you print. > > This email may contain confidential and privileged material for the sole > use of the intended recipient. Any review, use, distribution or disclosure > by others is strictly prohibited. If you are not the intended recipient (or > authorized to receive for the recipient), please contact the sender by > reply email and delete all copies of this message. > > Please click here > <http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for > Company Registration Information. > > > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
