[Bug 1921453] Re: multi-zone replication doesn't work
** Changed in: charm-ceph-radosgw Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
** Changed in: charm-ceph-radosgw Milestone: None => 21.10 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
Reviewed: https://review.opendev.org/c/openstack/charm-ceph-radosgw/+/786030 Committed: https://opendev.org/openstack/charm-ceph-radosgw/commit/15d7a9d82729758e50efb48106f8cd1f1284210c Submitter: "Zuul (22348)" Branch:master commit 15d7a9d82729758e50efb48106f8cd1f1284210c Author: James Page Date: Tue Apr 13 10:43:39 2021 +0100 Add otp pool to broker request Ceph RADOS gateway >= Mimic has an additional metadata pool (otp). Add this to the broker request to ensure that its created correctly by the ceph-mon application rather than being auto-created by the radosgw application Change-Id: I5e9b4e449bd1bc300225d223329bb62f3a381705 Closes-Bug: 1921453 ** Changed in: charm-ceph-radosgw Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
With proposed fix applied: $ sudo radosgw-admin sync status realm 964d0450-a906-4726-9c1c-a2aa5d788684 (replicated) zonegroup f846f9a9-c075-4541-b449-3891b796f480 (us) zone 8e6e56a1-cdfc-49f7-a581-1f4a8059037e (us-west) metadata sync syncing full sync: 0/64 shards incremental sync: 64/64 shards metadata is caught up with master data sync source: 1e2de205-5862-4e20-af12-7268565ad8a0 (us-east) syncing full sync: 0/128 shards incremental sync: 128/128 shards data is caught up with source -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
Removing field high - in anything other than a cut down test deployment this will work fine - however a charm update is appropriate to get consistent pool configuration. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
The otp_pool was new in >= mimic. The radosgw daemon will create the pool if it does not exist - in a normal deployment this is created with the default size (3) which is fine and then gets autotuned as need be. ** Changed in: ceph (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
OK figured this out - the master site has an .otp pool that is configured with size 3 (and the supplied test bundle only has single OSD hosts). Setting the size of this pool to 1 resolves the issue but this does highlight that the .otp pool is not created by the charm and gets auto-created by rgw - with incorrect configuration. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
"the system user is absent from the slave deployment" can you elaborate on this? In the procedure on docs.ceph.com there is no step to configure the system user on the secondary site - it is supposed to come through the replication once I pull the realm. And just to add once again - if I follow the procedure manually - I'm not observing this issue of improper authentication, however the metadata isn't being synced. I'm talking https://docs.ceph.com/en/latest/radosgw/multisite/ (which actually has a few mistakes) and https://dokk.org/documentation/ceph/v10.2.8/radosgw/multisite/ hat was a great manual. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
I don't believe this is a charm issue - it looks like a bug in the metadata sync process in ceph itself. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1921453] Re: multi-zone replication doesn't work
It looks like the metadata sync is failing for some reason, resulting in the secondary zone not have the right system user - which results in the errors on the primary zone when it attempts to sync data back ** Also affects: ceph (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1921453 Title: multi-zone replication doesn't work To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph-radosgw/+bug/1921453/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
