Hi Nathan, this indeed appears to be a Gentoo-specific issue. They install the file at: /usr/libexec/ceph/ceph-osd-prestart.sh instead of /usr/lib/ceph/ceph-osd-prestart.sh
It depends on how you strongly you follow FHS ( http://refspecs.linuxfoundation.org/FHS_3.0/fhs/ch04s07.html ) which is the actual correct place to be used. It seems Gentoo packagers took FHS 3.0 seriously to decide where to install things, but did not patch the code accordingly, so this surely warrants a Gentoo bug. Distro packagers should then decide whether they want to change install location (and rather follow Ceph upstream than FHS 3.0), or patch the code to enforce FHS 3.0. https://bugs.gentoo.org/632028 is also related to that. Cheers, Oliver Am 11.03.2018 um 00:34 schrieb Nathan Dehnel: > Trying to create an OSD: > > gentooserver ~ # ceph-volume lvm create --data /dev/sdb > Running command: ceph-authtool --gen-print-key > Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring > /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new > e70500fe-0d51-48c3-a607-414957886726 > Running command: vgcreate --force --yes > ceph-a736559a-92d1-483e-9289-d2c7feed510f /dev/sdb > stdout: Volume group "ceph-a736559a-92d1-483e-9289-d2c7feed510f" > successfully created > Running command: lvcreate --yes -l 100%FREE -n > osd-block-e70500fe-0d51-48c3-a607-414957886726 > ceph-a736559a-92d1-483e-9289-d2c7feed510f > stdout: Logical volume "osd-block-e70500fe-0d51-48c3-a607-414957886726" > created. > Running command: ceph-authtool --gen-print-key > Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0 > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: ln -s > /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 > /var/lib/ceph/osd/ceph-0/block > Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring > /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o > /var/lib/ceph/osd/ceph-0/activate.monmap > stderr: got monmap epoch 1 > Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring > --create-keyring --name osd.0 --add-key > AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg== > stdout: creating /var/lib/ceph/osd/ceph-0/keyring > stdout: added entity osd.0 auth auth(auid = 18446744073709551615 > key=AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg== with 0 caps) > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/ > Running command: ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs > -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data > /var/lib/ceph/osd/ceph-0/ --osd-uuid e70500fe-0d51-48c3-a607-414957886726 > --setuser ceph --setgroup ceph > --> ceph-volume lvm prepare successful for: /dev/sdb > Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev > /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 > --path /var/lib/ceph/osd/ceph-0 > Running command: ln -snf > /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 > /var/lib/ceph/osd/ceph-0/block > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 > Running command: systemctl enable > ceph-volume@lvm-0-e70500fe-0d51-48c3-a607-414957886726 > stderr: Created symlink > /etc/systemd/system/multi-user.target.wants/[email protected] > → /lib/systemd/system/[email protected]. > Running command: systemctl start ceph-osd@0 > stderr: Job for [email protected] failed because the control process exited > with error code. > See "systemctl status [email protected]" and "journalctl -xe" for details. > --> Was unable to complete a new OSD, will rollback changes > --> OSD will be fully purged from the cluster, because the ID was generated > Running command: ceph osd purge osd.0 --yes-i-really-mean-it > stderr: purged osd.0 > --> RuntimeError: command returned non-zero exit status: 1 > > journalctl -xe > -- Unit [email protected] has begun starting up. > Mar 10 17:14:34 gentooserver systemd[3977]: [email protected]: Failed to > execute command: No such file or directory > Mar 10 17:14:34 gentooserver systemd[3977]: [email protected]: Failed at > step EXEC spawning /usr/lib/ceph/ceph-osd-prestart.sh: No such file or > directory > -- Subject: Process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed > -- Defined-By: systemd > -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel > -- > -- The process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed and > failed. > -- > -- The error number returned by this process is 2. > Mar 10 17:14:34 gentooserver systemd[1]: [email protected]: Control process > exited, code=exited status=203 > Mar 10 17:14:34 gentooserver systemd[1]: [email protected]: Failed with > result 'exit-code'. > Mar 10 17:14:34 gentooserver systemd[1]: Failed to start Ceph object storage > daemon osd.0. > -- Subject: Unit [email protected] has failed > -- Defined-By: systemd > -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel > -- > -- Unit [email protected] has failed. > -- > -- The result is RESULT. > > Why is this file missing? Should I file a bug with my distro's packager? > > > _______________________________________________ > ceph-users mailing list > [email protected] > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
