2018-07-09 16:10 GMT+02:00 Thomas Roth <[email protected]>: > Thanks, but doesn't work. > > It is always the subcommand > /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring > /var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json > > (also 'ceph ... osd tree -i - osd new NEWID') > > which fails with client.bootstrap-osd authentication error > > Of course, 'ceph osd tree' works just fine. > > > Must be something I have missed when upgrading from Jewel. In fact, there > where no > boostrap-xxx/keyrings anywhere, I just have my /etc/ceph/ceph.mon.keyring > which seems to have managed > the magic before. >
You have to put it there manually if you don't use any deployment tool like ceph-deploy. If you have a normal admin keyring on that server anyways, then you can just run ceph auth get client.bootstrap-osd > /var/lib/ceph/bootstrap-osd/ceph.keyring Paul > > Cheers, > Thommas > > On 07/06/2018 09:36 PM, Paul Emmerich wrote: > > Hi, > > > > both ceph-disk and ceph-volume need a keyring in the file > > > > /var/lib/ceph/bootstrap-osd/ceph.keyring > > > > The key should look like this: > > > > [client.bootstrap-osd] > > key = XXXX > > caps mon = "allow profile bootstrap-osd" > > > > > > Paul > > > > > > 2018-07-06 16:47 GMT+02:00 Thomas Roth <[email protected]>: > > > >> Hi all, > >> > >> I wonder which is the correct key to create/recreate an additional OSD > >> with 12.2.5. > >> > >> Following > >> http://docs.ceph.com/docs/master/rados/operations/ > >> bluestore-migration/#convert-existing-osds, I took > >> one of my old OSD out of the cluster, but failed subsequently recreating > >> it as a BlueStor OSD. > >> > >> I tried "ceph-volume" at first, now got one step further using > "ceph-disk" > >> with > >> "ceph-disk prepare --bluestore /dev/sdh", which completed, I assume > >> successfully. > >> > >> However, "ceph-disk activate" fails with basically the same error as > >> "ceph-volume" before, > >> > >> > >> ~# ceph-disk activate /dev/sdh1 > >> command_with_stdin: 2018-07-06 16:23:18.677429 7f905de45700 0 librados: > >> client.bootstrap-osd > >> authentication error (1) Operation not permitted > >> [errno 1] error connecting to the cluster > >> > >> > >> > >> Now this test cluster was created under Jewel, where I created OSDs by > >> "ceph-osd -i $ID --mkfs --mkkey --osd-uuid $UUID" > >> and > >> "ceph auth add osd.#{ID} osd 'allow *' mon 'allow profile osd' -i > >> /var/lib/ceph/osd/ceph-#{ID}/keyring" > >> > >> This did not produce any "/var/lib/ceph/bootstrap-osd/ceph.keyring", > but > >> I found them on my mon hosts. > >> "ceph-volume" and "ceph-disk" go looking for that file, so I put it > there, > >> to no avail. > >> > >> > >> > >> Btw, the target server has still several "up" and "in" OSDs running, so > >> this is not a question of > >> network or general authentication issues. > >> > >> Cheers, > >> Thomas > >> _______________________________________________ > >> ceph-users mailing list > >> [email protected] > >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >> > > > > > > > > -- > -------------------------------------------------------------------- > Thomas Roth > Department: Informationstechnologie > Location: SB3 2.291 > Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 > > GSI Helmholtzzentrum für Schwerionenforschung GmbH > Planckstraße 1 > 64291 Darmstadt > www.gsi.de > > Gesellschaft mit beschränkter Haftung > Sitz der Gesellschaft: Darmstadt > Handelsregister: Amtsgericht Darmstadt, HRB 1528 > > Geschäftsführung: Ursula Weyrich > Professor Dr. Paolo Giubellino > Jörg Blaurock > > Vorsitzende des Aufsichtsrates: St Dr. Georg Schütte > Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt > > -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
