We're testing rbd mirroring so that we can replicate openstack volumes
to a new ceph cluster for use in a new openstack deployment.
We currently have one-way mirroring enabled on two of our test clusters
in pool mode.
How can I disable replication on the new cluster for a particular image
once I am done? If I turn journaling off, the volume appears to be
completely removed from the new cluster. I cannot disable the mirroring
on an image basis, because we enabled it on a pool basis.
At the moment, I cannot disable mirroring on the pool at all. There
seems to be a broken image that is causing problems.
$ sudo rbd mirror pool status volumes --verbose
health: ERROR
daemon health: WARNING
image health: ERROR
images: 2 total
1 error
1 replaying
DAEMONS
service 324099:
instance_id:
client_id: os-store1.uzudyj
hostname: os-store1
version: 15.2.13
leader: false
health: OK
IMAGES
volume-44975133-313a-4cfe-a74b-9f9d43d395c0:
global_id: c826e2e5-ce0b-43aa-ac94-0900b997841f
2022-10-05T20:34:28.046+0000 7fd907fff700 -1
librbd::image::OpenRequest: failed to retrieve initial metadata: (2) No
such file or directory
2022-10-05T20:34:28.046+0000 7fd9077fe700 -1 librbd::io::AioCompletion:
0x559b5cc50f60 fail: (2) No such file or directory
rbd: failed to open image volume-fa407405-56eb-460e-9ec9-aa3d73f24253:
(2) No such file or directory
$ sudo rbd mirror pool disable volumes
2022-10-05T20:43:49.558+0000 7f4db5eb8380 -1 librbd::api::Mirror:
mode_set: mirror peers still registered
$ sudo rbd ls volumes
volume-44975133-313a-4cfe-a74b-9f9d43d395c0
volume-fa407405-56eb-460e-9ec9-aa3d73f24253
$ sudo rbd create --size 20 volumes/volume-fa407405-56eb-460e-9ec9-
aa3d73f24253
rbd: create error: (17) File exists
2022-10-05T20:58:35.457+0000 7fe8816f3380 -1 librbd: rbd image volume-
fa407405-56eb-460e-9ec9-aa3d73f24253 already exists
What can I do to make ceph get rid of this "phantom" image? This is a
test cluster, so I don't care if it's destructive to the image or not.
If I changed the mirroring mode to image instead of pool, could I
disable mirroring on a specific image but not lose the image on the
mirror peer?
--
John Ratliff
Systems Automation Engineer
GlobalNOC @ Indiana University
_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
