UUID strings in the file /etc/fstab refer to devices. you can retrieve UUID
using command blkid, for instance:
# blkid /dev/sda1
/dev/sda1: UUID=1bcb1cbb-abd2-4cfa-bf89-1726ea6cd2fa TYPE=xfs
oyym...@gmail.com
From: Jesus Chavez (jeschave)
Date: 2015-04-14 07:03
To: oyym...@gmail.com
CC: ceph-users
Subject: Re: [ceph-users] ERROR: missing keyring, cannot use cephx for
authentication
How did you get the UUIDs without mounting the osds?
Thanks
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jesch...@cisco.com
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433
On Apr 10, 2015, at 11:47 PM, oyym...@gmail.com oyym...@gmail.com wrote:
In my cluster, mount osd devices manually in /etc/fstab, for instances:
vi /etc/fstab
# ...
UUID=98c87892-21cd-481b-9619-1a4a65620d79 /var/lib/ceph/osd/ceph-0 xfs
rw,noatime,inode64,logbsize=256k,delaylog 0 3
UUID=d56aeb7b-6160-4872-91dc-346b39019081 /var/lib/ceph/osd/ceph-1 xfs
rw,noatime,inode64,logbsize=256k,delaylog 0 3
UUID=db9782a6-b661-46b5-b993-a4d96bdc37d8 /var/lib/ceph/osd/ceph-2 xfs
rw,noatime,inode64,logbsize=256k,delaylog 0 3
UUID=ec95aa19-127d-410b-86a3-d68ee6baff2e /var/lib/ceph/osd/ceph-3 xfs
rw,noatime,inode64,logbsize=256k,delaylog 0 3
UUID=44694045-d9a3-4df4-948c-a77696d22406 /var/lib/ceph/osd/ceph-4 xfs
rw,noatime,inode64,logbsize=256k,delaylog 0 3
mount -a
mount
/dev/sda12 on /var/lib/ceph/osd/ceph-0 type xfs
(rw,noatime,seclabel,attr2,inode64,logbsize=256k,noquota)
/dev/sda13 on /var/lib/ceph/osd/ceph-1 type xfs
(rw,noatime,seclabel,attr2,inode64,logbsize=256k,noquota)
/dev/sdb1 on /var/lib/ceph/osd/ceph-2 type xfs
(rw,noatime,seclabel,attr2,inode64,logbsize=256k,noquota)
/dev/sdb2 on /var/lib/ceph/osd/ceph-3 type xfs
(rw,noatime,seclabel,attr2,inode64,logbsize=256k,noquota)
/dev/sdb3 on /var/lib/ceph/osd/ceph-4 type xfs
(rw,noatime,seclabel,attr2,inode64,logbsize=256k,noquota)
reboot
ceph osd tree
# id weight type name up/down reweight
-1 22.75 root default
-2 4.55 host storage1
0 0.91 osd.0 up 1
1 0.91 osd.1 up 1
2 0.91 osd.2 up 1
3 0.91 osd.3 up 1
4 0.91 osd.4 up 1
-3 4.55 host storage2
5 0.91 osd.5 up 1
6 0.91 osd.6 up 1
7 0.91 osd.7 up 1
8 0.91 osd.8 up 1
9 0.91 osd.9 up 1
-4 4.55 host lkl-storage3
10 0.91 osd.10 up 1
11 0.91 osd.11 up 1
12 0.91 osd.12 up 1
13 0.91 osd.13 up 1
14 0.91 osd.14 up 1
-5 4.55 host storage4
15 0.91 osd.15 up 1
16 0.91 osd.16 up 1
17 0.91 osd.17 up 1
18 0.91 osd.18 up 1
19 0.91 osd.19 up 1
-6 4.55 host storage5
20 0.91 osd.20 up 1
21 0.91 osd.21 up 1
22 0.91 osd.22 up 1
23 0.91 osd.23 up 1
24 0.91 osd.24 up 1
oyym...@gmail.com
From: Jesus Chavez (jeschave)
Date: 2015-04-10 22:17
To: oyym...@gmail.com
Subject: Re: [ceph-users] ERROR: missing keyring, cannot use cephx for
authentication
Hi there, just to be sure if you could figure how to fix this problem?
Thanks
image005(04-11-12-39-14).png
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jesch...@cisco.com
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433
Cisco.com
image006(04-11-12-39-14).gif
Think before you print.
This email may contain confidential and privileged material for the sole use of
the intended recipient. Any review, use, distribution or disclosure by others
is strictly prohibited. If you are not the intended recipient (or authorized to
receive for the recipient), please contact the sender by reply email and delete
all copies of this message.
Please click here for Company Registration Information.
On Mar 27, 2015, at 8:05 AM, Jesus Chavez (jeschave) jesch...@cisco.com wrote:
Did you know how to solve it? it is really weird…
Thanks!
image005.png
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jesch...@cisco.com
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433
Cisco.com
image006.gif
Think before you print.
This email may contain confidential and privileged material for the sole use of
the intended recipient. Any review, use, distribution or disclosure by others
is strictly prohibited. If you are not the intended recipient (or authorized to
receive for the recipient), please contact the sender by reply email and delete
all copies of this message.
Please click here for Company Registration Information.
On Mar 25, 2015, at 1:31 AM, oyym...@gmail.com wrote:
Hi,Jesus
I encountered similar problem.
1. shut down one of nodes, but all osds can't reactive on the node after reboot.
2. run service ceph restart manually, got the same error message:
[root@storage4 ~]# /etc/init.d/ceph start
=== osd.15 ===
2015-03-23 14:43:32.399811 7fed0fcf4700 -1 monclient(hunting): ERROR: missing
keyring, cannot use cephx for authentication
2015-03-23 14:43:32.399814 7fed0fcf4700 0 librados: osd.15 initialization error
(2) No such file or directory
Error connecting to cluster: ObjectNotFound
failed: 'timeout 30 /usr/bin/ceph -c /etc/ceph/ceph.conf --name=osd.15
--keyring=/var/lib/ceph/osd/ceph-15/keyring osd crush create-or-move -- 15 0.19