Re: [ceph-users] Cache data consistency among multiple RGW instances

2015-01-21 Thread ZHOU Yuan
Greg, Thanks a lot for the education! Sincerely, Yuan On Tue, Jan 20, 2015 at 2:37 PM, Gregory Farnum wrote: > You don't need to list them anywhere for this to work. They set up the > necessary communication on their own by making use of watch-notify. > > On Mon, Jan 19, 2015 at 6:55 PM ZHOU Yu

Re: [ceph-users] Cache data consistency among multiple RGW instances

2015-01-21 Thread Ashish Chandra
Hi Greg/Zhou, I have got a similar setup where I have got one HAProxy node and 3 RadosGW client. I have got rgw cache disabled in my setup. earlier I had only one node running RadosGW, there I can see the difference in inbound and outbound network traffic sometimes to a tune of factor of 10. If

Re: [ceph-users] Cache data consistency among multiple RGW instances

2015-01-21 Thread ZHOU Yuan
Thanks Greg, that's a awesome feature I missed. I find some explanation on the watch-notify thing: http://www.slideshare.net/Inktank_Ceph/sweil-librados. Just want to confirm, it looks like I need to list all the RGW instances in ceph.conf, and then these RGW instances will automatically do the ca

Re: [ceph-users] Cache data consistency among multiple RGW instances

2015-01-19 Thread Gregory Farnum
You don't need to list them anywhere for this to work. They set up the necessary communication on their own by making use of watch-notify. On Mon, Jan 19, 2015 at 6:55 PM ZHOU Yuan wrote: > Thanks Greg, that's a awesome feature I missed. I find some > explanation on the watch-notify thing: > http

Re: [ceph-users] Cache data consistency among multiple RGW instances

2015-01-19 Thread Gregory Farnum
On Sun, Jan 18, 2015 at 6:40 PM, ZHOU Yuan wrote: > Hi list, > > I'm trying to understand the RGW cache consistency model. My Ceph > cluster has multiple RGW instances with HAProxy as the load balancer. > HAProxy would choose one RGW instance to serve the request(with > round-robin). > The questio

[ceph-users] Cache data consistency among multiple RGW instances

2015-01-18 Thread ZHOU Yuan
Hi list, I'm trying to understand the RGW cache consistency model. My Ceph cluster has multiple RGW instances with HAProxy as the load balancer. HAProxy would choose one RGW instance to serve the request(with round-robin). The question is if RGW cache was enabled, which is the default behavior, th