Hi,

I did have this issue but not while migrating a db. Try removing the bluestore 
tool and any other ceph-* packages that you installed manually, except for 
cephadm.

Then maybe a reatart might be necessary for that node or reatarting the docker 
daemon.

Hope this helps
Cheers


Best regards - mit freundlichen Gruessen,
Christian Frech

-------- Original Message --------
On Monday, 06/29/26 at 18:08 mailing-lists via ceph-users <[email protected]> 
wrote:
Hey Cephers,

The big picture is, that I am trying to migrate a DB to a different
DB-Device. I used to do this many times on Ubuntu 22.04 and Reef. With
Ubuntu 24.04 and Squid however, I am facing a "permission denied"
scenario, that I do not understand. It seems like the "cephadm shell"
container is missing permissions to interact with /dev/ceph-* lvs.

Our setup is containerized with Docker and deployed with cephadm.


 From within "cephadm shell":

"ls -alh
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f065
0
ls: cannot access
'/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650':
No such file or directory"

 From root on the same host:
"ls -alh
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650

lrwxrwxrwx 1 root root 7 Jun 25 17:12
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650
-> ../dm-3"

The container just cannot "see" the lv-device.

Something like

"ceph-volume lvm activate 1 91ae2955-577a-4722-8548-5e78372f0650"

will then just fail with:
```
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1
Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph
prime-osd-dir --dev
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650
--path /var/lib/ceph/osd/ceph-1 --no-mon-config
  stderr: failed to read label for
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650:
(1) *Operation not permitted*
  stderr: 2026-06-29T15:57:48.848+0000 7e8959bbca80 -1
bdev(0x5d2610965800
/dev/ceph-0bafc014-2bc6-4ecf-96a2-80b2dd414ad2/osd-block-91ae2955-577a-4722-8548-5e78372f0650)
open stat got: (1) Operation not permitted
-->  RuntimeError: command returned non-zero exit status: 1

```

Has anyone had this problem and solved it?

Is the recommended way to install ceph utilities like ceph-volume on the
host instead using the toolkit from the cephadm shell?


Best

_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]

_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to