Hi,
I am working on a small 3 node ceph cluster which used to work as
expected.
When creating a new ceph osd the ceph-volume command throws some errors
and filestore instead of bluestore is created. (The drive was clean
using blkdiscard before and no traces left in /etc from previous
attempts.
Any hints?
Regards
--martin
# ceph-volume lvm create --bluestore --data vgsdb/sdb1
--> Incompatible flags were found, some values may get ignored
--> Cannot use None (None) with --bluestore (bluestore)
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph --cluster ceph --name
client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring
-i - osd new 19959f26-f2ed-451d-acb7-a808d15510cf
Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
--> Executable selinuxenabled not in PATH:
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Running command: /usr/bin/chown -h ceph:ceph /dev/vgsdb/sdb1
Running command: /usr/bin/chown -R ceph:ceph /dev/dm-6
Running command: /usr/bin/ln -s /dev/vgsdb/sdb1
/var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/ceph --cluster ceph --name
client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring
mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap
stderr: 2025-05-16T14:47:08.049+0000 772d282ef6c0 -1 auth: unable to
find a keyring on /etc/pve/priv/ceph.client.bootstrap-osd.keyring: (2)
No such file or directory
2025-05-16T14:47:08.049+0000 772d282ef6c0 -1
AuthRegistry(0x772d200660d0) no keyring found at
/etc/pve/priv/ceph.client.bootstrap-osd.keyring, disabling cephx
stderr: got monmap epoch 20
--> Creating keyring file for osd.0
Running command: /usr/bin/chown -R ceph:ceph
/var/lib/ceph/osd/ceph-0/keyring
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
Running command: /usr/bin/ceph-osd --cluster ceph --osd-objectstore
bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap
--keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid
19959f26-f2ed-451d-acb7-a808d15510cf --setuser ceph --setgroup ceph
stderr: 2025-05-16T14:47:08.948+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0//block) _read_bdev_label unable to
decode label /var/lib/ceph/osd/ceph-0//block at offset 102: void
bluestore_bdev_label_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)
decode past end of struct encoding: Malformed input [buffer:3]
stderr: 2025-05-16T14:47:08.948+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0//block) _read_bdev_label unable to
decode label /var/lib/ceph/osd/ceph-0//block at offset 102: void
bluestore_bdev_label_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)
decode past end of struct encoding: Malformed input [buffer:3]
stderr: 2025-05-16T14:47:08.948+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0//block) _read_bdev_label unable to
decode label /var/lib/ceph/osd/ceph-0//block at offset 102: void
bluestore_bdev_label_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)
decode past end of struct encoding: Malformed input [buffer:3]
stderr: 2025-05-16T14:47:08.948+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0//block) _read_bdev_label unable to
decode label /var/lib/ceph/osd/ceph-0//block at offset 102: void
bluestore_bdev_label_t::decode(ceph::buffer::v15_2_0::list::const_iterator&)
decode past end of struct encoding: Malformed input [buffer:3]
stderr: 2025-05-16T14:47:08.948+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0//block) No valid bdev label found
stderr: 2025-05-16T14:47:09.190+0000 7eaab06e0880 -1
bluestore(/var/lib/ceph/osd/ceph-0/) _read_fsid unparsable uuid
--> ceph-volume lvm prepare successful for: vgsdb/sdb1
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph
prime-osd-dir --dev /dev/vgsdb/sdb1 --path /var/lib/ceph/osd/ceph-0
--no-mon-config
Running command: /usr/bin/ln -snf /dev/vgsdb/sdb1
/var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/chown -h ceph:ceph
/var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/chown -R ceph:ceph /dev/dm-6
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/systemctl enable
ceph-volume@lvm-0-19959f26-f2ed-451d-acb7-a808d15510cf
stderr: Created symlink
/etc/systemd/system/multi-user.target.wants/ceph-volume@lvm-0-19959f26-f2ed-451d-acb7-a808d15510cf.service
→ /lib/systemd/system/ceph-volume@.service.
Running command: /usr/bin/systemctl enable --runtime ceph-osd@0
stderr: Created symlink
/run/systemd/system/ceph-osd.target.wants/ceph-osd@0.service →
/lib/systemd/system/ceph-osd@.service.
Running command: /usr/bin/systemctl start ceph-osd@0
--> ceph-volume lvm activate successful for osd ID: 0
--> ceph-volume lvm create successful for: vgsdb/sdb1
--
Martin Konold - Prokurist, CTO
KONSEC GmbH - make things real
Amtsgericht Stuttgart, HRB 23690
Geschäftsführer: Andreas Mack
Im Köller 3, 70794 Filderstadt, Germany
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io
