Hey Cephers,

The big picture is, that I am trying to migrate a DB to a different DB-Device. I used to do this many times on Ubuntu 22.04 and Reef. With Ubuntu 24.04 and Squid however, I am facing a "permission denied" scenario, that I do not understand. It seems like the "cephadm shell" container is missing permissions to interact with /dev/ceph-* lvs.

Our setup is containerized with Docker and deployed with cephadm.


From within "cephadm shell":

"ls -alh /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f065
0
ls: cannot access '/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650': No such file or directory"

From root on the same host:
"ls -alh /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650 lrwxrwxrwx 1 root root 7 Jun 25 17:12 /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650 -> ../dm-3"

The container just cannot "see" the lv-device.

Something like

"ceph-volume lvm activate 1 91ae2955-577a-4722-8548-5e78372f0650"

will then just fail with:
```
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1
Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650 --path /var/lib/ceph/osd/ceph-1 --no-mon-config  stderr: failed to read label for /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650: (1) *Operation not permitted*  stderr: 2026-06-29T15:57:48.848+0000 7e8959bbca80 -1 bdev(0x5d2610965800 /dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650) open stat got: (1) Operation not permitted
-->  RuntimeError: command returned non-zero exit status: 1

```

Has anyone had this problem and solved it?

Is the recommended way to install ceph utilities like ceph-volume on the host instead using the toolkit from the cephadm shell?


Best

_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to