Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-17 Thread Iain Buclaw
On Mon, 8 Apr 2019 at 10:33, Iain Buclaw wrote: > > On Mon, 8 Apr 2019 at 05:01, Matt Benjamin wrote: > > > > Hi Christian, > > > > Dynamic bucket-index sharding for multi-site setups is being worked > > on, and will land in the N release cycle. > > > > What about removing orphaned shards on the

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-08 Thread Iain Buclaw
On Mon, 8 Apr 2019 at 05:01, Matt Benjamin wrote: > > Hi Christian, > > Dynamic bucket-index sharding for multi-site setups is being worked > on, and will land in the N release cycle. > What about removing orphaned shards on the master? Is the existing tools able to work with that? On the

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-07 Thread Matt Benjamin
Hi Christian, Dynamic bucket-index sharding for multi-site setups is being worked on, and will land in the N release cycle. regards, Matt On Sun, Apr 7, 2019 at 6:59 PM Christian Balzer wrote: > > On Fri, 5 Apr 2019 11:42:28 -0400 Casey Bodley wrote: > > > Hi Iain, > > > > Resharding is not

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-07 Thread Christian Balzer
On Fri, 5 Apr 2019 11:42:28 -0400 Casey Bodley wrote: > Hi Iain, > > Resharding is not supported in multisite. The issue is that the master zone > needs to be authoritative for all metadata. If bucket reshard commands run > on the secondary zone, they create new bucket instance metadata that the

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-06 Thread Iain Buclaw
On Fri, 5 Apr 2019 at 17:42, Casey Bodley wrote: > > Hi Iain, > > Resharding is not supported in multisite. The issue is that the master zone > needs to be authoritative for all metadata. If bucket reshard commands run on > the secondary zone, they create new bucket instance metadata that the

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-05 Thread Casey Bodley
Hi Iain, Resharding is not supported in multisite. The issue is that the master zone needs to be authoritative for all metadata. If bucket reshard commands run on the secondary zone, they create new bucket instance metadata that the master zone never sees, so replication can't reconcile those

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-04 Thread Iain Buclaw
On Wed, 3 Apr 2019 at 09:41, Iain Buclaw wrote: > > On Tue, 19 Feb 2019 at 10:11, Iain Buclaw wrote: > > > > > > # ./radosgw-gc-bucket-indexes.sh master.rgw.buckets.index | wc -l > > 7511 > > > > # ./radosgw-gc-bucket-indexes.sh secondary1.rgw.buckets.index | wc -l > > 3509 > > > > #

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-03 Thread Iain Buclaw
On Tue, 19 Feb 2019 at 10:11, Iain Buclaw wrote: > > > # ./radosgw-gc-bucket-indexes.sh master.rgw.buckets.index | wc -l > 7511 > > # ./radosgw-gc-bucket-indexes.sh secondary1.rgw.buckets.index | wc -l > 3509 > > # ./radosgw-gc-bucket-indexes.sh secondary2.rgw.buckets.index | wc -l > 3801 >

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-04-03 Thread Iain Buclaw
On Tue, 19 Feb 2019 at 10:11, Iain Buclaw wrote: > > On Tue, 19 Feb 2019 at 10:05, Iain Buclaw wrote: > > > > On Tue, 19 Feb 2019 at 09:59, Iain Buclaw wrote: > > > > > > On Wed, 6 Feb 2019 at 09:28, Iain Buclaw wrote: > > > > > > > > On Tue, 5 Feb 2019 at 10:04, Iain Buclaw wrote: > > > > >

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-19 Thread Iain Buclaw
On Tue, 19 Feb 2019 at 10:05, Iain Buclaw wrote: > > On Tue, 19 Feb 2019 at 09:59, Iain Buclaw wrote: > > > > On Wed, 6 Feb 2019 at 09:28, Iain Buclaw wrote: > > > > > > On Tue, 5 Feb 2019 at 10:04, Iain Buclaw wrote: > > > > > > > > On Tue, 5 Feb 2019 at 09:46, Iain Buclaw wrote: > > > > > >

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-19 Thread Iain Buclaw
On Tue, 19 Feb 2019 at 09:59, Iain Buclaw wrote: > > On Wed, 6 Feb 2019 at 09:28, Iain Buclaw wrote: > > > > On Tue, 5 Feb 2019 at 10:04, Iain Buclaw wrote: > > > > > > On Tue, 5 Feb 2019 at 09:46, Iain Buclaw wrote: > > > > > > > > Hi, > > > > > > > > Following the update of one secondary

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-19 Thread Iain Buclaw
On Wed, 6 Feb 2019 at 09:28, Iain Buclaw wrote: > > On Tue, 5 Feb 2019 at 10:04, Iain Buclaw wrote: > > > > On Tue, 5 Feb 2019 at 09:46, Iain Buclaw wrote: > > > > > > Hi, > > > > > > Following the update of one secondary site from 12.2.8 to 12.2.11, the > > > following warning have come up. >

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-06 Thread Iain Buclaw
On Tue, 5 Feb 2019 at 10:04, Iain Buclaw wrote: > > On Tue, 5 Feb 2019 at 09:46, Iain Buclaw wrote: > > > > Hi, > > > > Following the update of one secondary site from 12.2.8 to 12.2.11, the > > following warning have come up. > > > > HEALTH_WARN 1 large omap objects > > LARGE_OMAP_OBJECTS 1

Re: [ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-05 Thread Iain Buclaw
On Tue, 5 Feb 2019 at 09:46, Iain Buclaw wrote: > > Hi, > > Following the update of one secondary site from 12.2.8 to 12.2.11, the > following warning have come up. > > HEALTH_WARN 1 large omap objects > LARGE_OMAP_OBJECTS 1 large omap objects > 1 large objects found in pool

[ceph-users] RGW: Reshard index of non-master zones in multi-site

2019-02-05 Thread Iain Buclaw
Hi, Following the update of one secondary site from 12.2.8 to 12.2.11, the following warning have come up. HEALTH_WARN 1 large omap objects LARGE_OMAP_OBJECTS 1 large omap objects 1 large objects found in pool '.rgw.buckets.index' Search the cluster log for 'Large omap object found' for