I’ve been struggling mightily with getting a realm/zonegroup/zone configuration 
that works for me, and I find it difficult to imagine this isn’t a very common 
issue.  So I might assume I’m thinking about this incorrectly.

We have several clusters, geographically dispersed.  I want them all to share a 
namespace, so I assume that means one realm.  But I want to give users the 
ability to create buckets that replicate among these clusters at their 
discretion, with a default bucket creation of “no replication.”  Last time I 
asked, I was told to disable bucket sync for those buckets I didn’t want 
replicating.  But that requires radosgw-admin access, and I want this to be 
totally self-serve at the user level.

Can anyone tell me what elements of a configuration I need to enable this?  It 
seems more complicated than a single realm, 3-zone zonegroup.  I’m just not 
getting that “more complexity” right.  I need to know in general if what I’m 
trying to do is possible, and find out about the caveats/best-practices.


--Christian

What I’ve tried:  latest luminous releases; realm=earth, (replicating setup: 
zonegroup=us, zones=us-west-1-rep, us-west-2-rep, us-east-1-rep) + 
(non-replicating setup: each cluster having another zonegroup/zone = 
us-west-1-local/us-west-1-localzone, us-west-2-local/us-west-2-localzone, 
us-east-1-local/us-east-1-localzone).  I have two radosgw per cluster, one 
aligned with the replicating zone and one aligned with the local zone (this is 
a requirement?)  This seems to be barely working, and test users get a lot of 
errors when doing bucket or object ops.  We can see all the buckets and objects 
from any of the radosgw that are clients of a cluster, but s3 commands using 
the “wrong” radosgw often fail.  I’d like to be able to load balance across 
both our radosgw hosts to access a particular cluster, to maintain HA access.  
That doesn’t work well if a radosgw is “assigned” to a particular zone…
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to