Hello Vikrant 

You can try creating directories manually on the monitor node 

mkdir -p  /var/lib/ceph/{tmp,mon,mds,bootstrap-osd} 


    * Important Do not call ceph-deploy with sudo or run it as root if you are 
logged in as a different user, because it will not issue sudo commands needed 
on the remote host. 

Try this hope this helps you. 

Many Thanks 
Karan Singh 


----- Original Message -----

From: "Vikrant Verma" <[email protected]> 
To: [email protected] 
Sent: Friday, 8 November, 2013 2:41:36 PM 
Subject: [ceph-users] Unable to find bootstrap-osd and bootstrap-mds 
ceph.keyring 

Hi All, 



I am able to Add a Ceph Monitor (step 3) as per the link 
http://ceph.com/docs/master/start/quick-ceph-deploy/ (Setting Up Ceph Storage 
Cluster) 



But when I am executing the gatherkey command, I am getting the 
warnings(highlighted in yellow). Please find the details – 



Command – “ ceph-deploy gatherkeys vikrant” (vikrant is the hostname of the 
ceph-node1) 

Output – 

[ceph_deploy.cli][INFO ] Invoked (1.3.1): /usr/bin/ceph-deploy gatherkeys 
vikrant 
[ceph_deploy.gatherkeys][DEBUG ] Have ceph.client.admin.keyring 
[ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring 
[ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for 
/var/lib/ceph/bootstrap-osd/ceph.keyring 
[vikrant][DEBUG ] connected to host: vikrant 
[vikrant][DEBUG ] detect platform information from remote host 
[vikrant][DEBUG ] detect machine type 
[vikrant][DEBUG ] fetch remote file 
[ceph_deploy.gatherkeys][WARNIN] Unable to find 
/var/lib/ceph/bootstrap-osd/ceph.keyring on ['vikrant'] 
[ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for 
/var/lib/ceph/bootstrap-mds/ceph.keyring 
[vikrant][DEBUG ] connected to host: vikrant 
[vikrant][DEBUG ] detect platform information from remote host 
[vikrant][DEBUG ] detect machine type 
[vikrant][DEBUG ] fetch remote file 
[ceph_deploy.gatherkeys][WARNIN] Unable to find 
/var/lib/ceph/bootstrap-mds/ceph.keyring on ['vikrant'] 



I checked ceph.keyring is not generated for bootstrap-osd and bootstrap-mds in 
ceph-node1, due to which the next command “ ceph-deploy osd prepare ceph-node2” 
is giving error. 



Please find the setup details – 

One Admin Node – from where I am executing ceph-deploy commands 

Ceph-node1 – this is the ceph monitor, (hostname is vikrant) 

Ceph-node2 – Ceph OSD, this is on a separate machine ( as of now I am trying to 
configure one OSD, in the link they have mentioned the example for two OSD) 



Content of ceph.conf (this is same for admin node and ceph-node1) 

[global] 
fsid = eb4099a6-d2ab-437c-94f2-f3b43b3170d1 
mon_initial_members = vikrant 
mon_host = 10.XX.XX.XX 
auth_supported = cephx 
osd_journal_size = 1024 
filestore_xattr_use_omap = true 





Output of “ceph-deploy mon create vikrant” command (vikrant is the hostname of 
the ceph-node1) -- 

---------------------------------------------ceph-deploy mon create vikrant 
-----o/p-------------------------- 

[ceph_deploy.cli][INFO ] Invoked (1.3.1): /usr/bin/ceph-deploy mon create 
vikrant 

[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts vikrant 

[ceph_deploy.mon][DEBUG ] detecting platform for host vikrant ... 

[vikrant][DEBUG ] connected to host: vikrant 

[vikrant][DEBUG ] detect platform information from remote host 

[vikrant][DEBUG ] detect machine type 

[ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise 

[vikrant][DEBUG ] determining if provided host has same hostname in remote 

[vikrant][DEBUG ] get remote short hostname 

[vikrant][DEBUG ] deploying mon to vikrant 

[vikrant][DEBUG ] get remote short hostname 

[vikrant][DEBUG ] remote hostname: vikrant 

[vikrant][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf 

[vikrant][DEBUG ] create the mon path if it does not exist 

[vikrant][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-vikrant/done 

[vikrant][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-vikrant/done 

[vikrant][INFO ] creating tmp path: /var/lib/ceph/tmp 

[vikrant][INFO ] creating keyring file: 
/var/lib/ceph/tmp/ceph-vikrant.mon.keyring 

[vikrant][DEBUG ] create the monitor keyring file 

[vikrant][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i 
vikrant --keyring /var/lib/ceph/tmp/ceph-vikrant.mon.keyring 

[vikrant][DEBUG ] ceph-mon: mon.noname-a 10.XX.XX.XX:6789/0 is local, renaming 
to mon.vikrant 

[vikrant][DEBUG ] ceph-mon: set fsid to eb4099a6-d2ab-437c-94f2-f3b43b3170d1 

[vikrant][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vikrant for 
mon.vikrant 

[vikrant][INFO ] unlinking keyring file 
/var/lib/ceph/tmp/ceph-vikrant.mon.keyring 

[vikrant][DEBUG ] create a done file to avoid re-doing the mon deployment 

[vikrant][DEBUG ] create the init path if it does not exist 

[vikrant][DEBUG ] locating the `service` executable... 

[vikrant][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph 
id=vikrant 

[vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon 
/var/run/ceph/ceph-mon.vikrant.asok mon_status 

[vikrant][DEBUG ] 
********************************************************************************
 

[vikrant][DEBUG ] status for monitor: mon.vikrant 

[vikrant][DEBUG ] { 

[vikrant][DEBUG ] "election_epoch": 2, 

[vikrant][DEBUG ] "extra_probe_peers": [], 

[vikrant][DEBUG ] "monmap": { 

[vikrant][DEBUG ] "created": "0.000000", 

[vikrant][DEBUG ] "epoch": 1, 

[vikrant][DEBUG ] "fsid": "eb4099a6-d2ab-437c-94f2-f3b43b3170d1", 

[vikrant][DEBUG ] "modified": "0.000000", 

[vikrant][DEBUG ] "mons": [ 

[vikrant][DEBUG ] { 

[vikrant][DEBUG ] "addr": "10.XX.XX.XX:6789/0", 

[vikrant][DEBUG ] "name": "vikrant", 

[vikrant][DEBUG ] "rank": 0 

[vikrant][DEBUG ] } 

[vikrant][DEBUG ] ] 

[vikrant][DEBUG ] }, 

[vikrant][DEBUG ] "name": "vikrant", 

[vikrant][DEBUG ] "outside_quorum": [], 

[vikrant][DEBUG ] "quorum": [ 

[vikrant][DEBUG ] 0 

[vikrant][DEBUG ] ], 

[vikrant][DEBUG ] "rank": 0, 

[vikrant][DEBUG ] "state": "leader" 

[vikrant][DEBUG ] } 

[vikrant][DEBUG ] 
********************************************************************************
 

[vikrant][INFO ] monitor: mon.vikrant is running 

[vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon 
/var/run/ceph/ceph-mon.vikrant.asok mon_status 



Please let me know if you need any further information. 



The intention is to setup a Ceph Block Device as per the link 
http://ceph.com/docs/master/start/quick-rbd/ , and it is mentioned in the link 
that Ceph Storage Cluster needs to be setup first before working with Ceph 
Block Device. 



Please let me know your inputs on the above. 



Regards, Vikrant 

_______________________________________________ 
ceph-users mailing list 
[email protected] 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 

_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to