Hi Mohammed,

Thanks for your reply, comments follow inline.

On 10/27/11 3:00 PM, Mohammed Junaid wrote:
Hi Daniel,

    However, I've been trying to setup an extra swift proxy to offload
    some of the CPU usage I've been experiencing in our tests and I
    can't really find a way to do so.
    What's the correct way to proceed, with gluster's object-storage?
    Anyone else has done it?


To increase the proxy server count, edit the file "/etc/gluster-object/proxy-server.conf and add the line

workers = <count>

Yes, I did that. However the CPU usage gets very high (100% for all cores) to have all the Gluster and Swift daemons running on the same machine. We want to separate the processes in the same manner it is already possible in Swift.

    Following Swift's documentation I get stuck at copying the ring
    files (do they exist in gluster's object-storage?). Then I've
    thought I could simply setup gluster object-storage in a proxy
    machine and somehow redirect the requests from the proxy to the
    storage machine, but I'm failing miserably that way as well.


For using gluster object-storage, there is no need to generate the ring files. Please follow the gluster object-storage documentation to setup the machines.

I read the documentation and there's no mention about separating the swift/object-storage servers in such way. I already have a working setup, I just need to add more proxies. I could, of course, setup two sets of independent servers and somehow do a messy data sharding between the two servers, but it's simpler and cheaper to scale just the proxy servers as needed (this is almost standard procedure in Swift) since, from our measurements, they are the bottleneck.

Moreover, I downloaded the latest UFO code from git, where it has some support for specifying external IP addresses for Accounting and Storage daemons, but I'm still failing somewhere at making it work. Requests do now get processed from an external proxy and forwarded to the correct auth server, but something seems to be failing in the process.

Daniel

■━━━━━━━━━━━━━━━━━━━━━━━━
 SkillUpJapan Corporation
 Research and Development Office
  Senior Researcher Engineer
 Daniel Pereira [email protected]
 Tokyo, Shinjuku, Takadanobaba 1-24-16
   Uchida Building 1st Floor
 TEL:03-5287-4087 FAX:03-5287-4135
   http://www.skillupjapan.co.jp/
■━━━━━━━━━━━━━━━━━━━━━━━━



_______________________________________________
Gluster-users mailing list
[email protected]
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Reply via email to