Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Aravinda
Geo-replication and Sharding Team today discussed about the approach to make Sharding aware Geo-replication. Details are as below Participants: Aravinda, Kotresh, Krutika, Rahul Hinduja, Vijay Bellur - Both Master and Slave Volumes should be Sharded Volumes with same configurations. - In

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Emmanuel Dreyfus
On Wed, Sep 02, 2015 at 02:04:32PM +0530, Pranith Kumar Karampuri wrote: > >And more generally, do we have a way to ratelimit FOPs per client, so > >that one client cannot make the cluster unusable for the others? > Do you have profile data? No, it was on a production setup and I was too focused

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Venky Shankar
On Wed, Sep 2, 2015 at 2:05 PM, Venky Shankar wrote: > On Wed, Sep 2, 2015 at 1:59 PM, Emmanuel Dreyfus wrote: >> Hi >> >> Yesterday I experienced the problem of a single user bringing down >> a glusterfs cluster to its knees because of a high amount of

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Venky Shankar
On Wed, Sep 2, 2015 at 1:59 PM, Emmanuel Dreyfus wrote: > Hi > > Yesterday I experienced the problem of a single user bringing down > a glusterfs cluster to its knees because of a high amount of rename > operations. > > I understand rename on DHT can be very costly because data

[Gluster-devel] FOP ratelimit?

2015-09-02 Thread Emmanuel Dreyfus
Hi Yesterday I experienced the problem of a single user bringing down a glusterfs cluster to its knees because of a high amount of rename operations. I understand rename on DHT can be very costly because data really have to be moved from a brick to another one just for a file name change. Is

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Emmanuel Dreyfus
On Wed, Sep 02, 2015 at 02:05:03PM +0530, Venky Shankar wrote: > > I understand rename on DHT can be very costly because data really have > > to be moved from a brick to another one just for a file name change. > > Is there a workaround for this behavior? > > Not really. DHT uses pointer files

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Raghavendra Gowdappa
- Original Message - > From: "Pranith Kumar Karampuri" > To: "Emmanuel Dreyfus" , gluster-devel@gluster.org > Sent: Wednesday, September 2, 2015 2:04:32 PM > Subject: Re: [Gluster-devel] FOP ratelimit? > > > > On 09/02/2015 01:59 PM, Emmanuel

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Aravinda
On 09/02/2015 08:22 PM, Venky Shankar wrote: On Wed, Sep 2, 2015 at 12:42 PM, Aravinda wrote: Geo-replication and Sharding Team today discussed about the approach to make Sharding aware Geo-replication. Details are as below Participants: Aravinda, Kotresh, Krutika, Rahul

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Shyam
On 09/02/2015 10:47 AM, Krutika Dhananjay wrote: *From: *"Shyam" *To: *"Aravinda" , "Gluster Devel" *Sent: *Wednesday, September 2,

[Gluster-devel] Introducing georepsetup - Gluster Geo-replication Setup Tool

2015-09-02 Thread Aravinda
Hi, Created a CLI tool using Python to simplify the Geo-replication Setup process. This tool takes care of running gsec_create command, distributing the SSH keys from Master to all Slave nodes etc. All in one single command :) Initial password less SSH login is not required, this tool prompts

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Venky Shankar
] On Wed, Sep 2, 2015 at 8:50 PM, Aravinda wrote: > > On 09/02/2015 08:22 PM, Venky Shankar wrote: >> >> On Wed, Sep 2, 2015 at 12:42 PM, Aravinda wrote: >>> >>> Geo-replication and Sharding Team today discussed about the approach >>> to make Sharding

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Venky Shankar
On Wed, Sep 2, 2015 at 11:39 PM, Aravinda wrote: > > On 09/02/2015 11:13 PM, Shyam wrote: >> >> On 09/02/2015 10:47 AM, Krutika Dhananjay wrote: >>> >>> >>> >>> >>> >>> *From: *"Shyam"

Re: [Gluster-devel] Introducing georepsetup - Gluster Geo-replication Setup Tool

2015-09-02 Thread Kotresh Hiremath Ravishankar
Hi Aravinda, I used it yesterday. It greatly simplifies the geo-rep setup. It would be great if it is enhanced to troubleshoot what's wrong in already corrupted setup. Thanks and Regards, Kotresh H R - Original Message - > From: "Aravinda" > To: "Gluster Devel"

Re: [Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Prasanna Kalever
Hi Pranith, If you need any assistance please let me know, I will be happy to learn this. Thanks & regards, Prasanna Kumar K - Original Message - From: "Pranith Kumar Karampuri" To: "Vijay Bellur" , "Atin Mukherjee"

[Gluster-devel] REMINDER: Weekly gluster community meeting to start in ~2 hours

2015-09-02 Thread Krutika Dhananjay
Hi All, In about 2 hours from now we will have the regular weekly Gluster Community meeting. Meeting details: - location: #gluster-meeting on Freenode IRC - date: every Wednesday - time: 12:00 UTC, 14:00 CEST, 17:30 IST (in your terminal, run: date -d "12:00 UTC") - agenda:

Re: [Gluster-devel] Why are all the jenkins jobs running in fr_FR locale lately?

2015-09-02 Thread Michael Scherer
Le lundi 31 août 2015 à 10:28 -0400, Kaleb S. KEITHLEY a écrit : > While it doesn't bother me, some of our devs may have some trouble > reading the output. > > Could we go back to the C locale? I suspect to be some locale leak from y ssh session to jenkins. Not sure how to do, except a restart

Re: [Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Pranith Kumar Karampuri
On 09/02/2015 07:33 PM, Vijay Bellur wrote: On Wednesday 02 September 2015 06:38 PM, Atin Mukherjee wrote: IIRC, Pranith already volunteered for it in one of the last community meetings? Thanks Atin. I do recollect it now. Pranith - can you confirm being the release manager for 3.7.5?

Re: [Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Atin Mukherjee
IIRC, Pranith already volunteered for it in one of the last community meetings? -Atin Sent from one plus one On Sep 2, 2015 6:00 PM, "Vijay Bellur" wrote: > Hi All, > > We have been rotating release managers for minor releases in the 3.7.x > train. We just released 3.7.4 and

[Gluster-devel] Minutes of the Weekly Gluster Community Meeting held on 2nd September, 2015

2015-09-02 Thread Krutika Dhananjay
Minutes: Minutes: http://meetbot.fedoraproject.org/gluster-meeting/2015-09-02/gluster-meeting.2015-09-02-12.00.html Minutes (text): http://meetbot.fedoraproject.org/gluster-meeting/2015-09-02/gluster-meeting.2015-09-02-12.00.txt Log:

[Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Vijay Bellur
Hi All, We have been rotating release managers for minor releases in the 3.7.x train. We just released 3.7.4 and are looking for volunteers to be release managers for 3.7.5 (scheduled for 30th September). If anybody is interested in volunteering, please drop a note here. Thanks, Vijay

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Jeff Darcy
> Do you have any ideas here on QoS? Can it be provided as a use-case for > multi-tenancy you were working on earlier? My interpretation of QoS would include rate limiting, but more per *activity* (e.g. self-heal, rebalance, user I/O) or per *tenant* rather than per *client*. Also, it's easier

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Krutika Dhananjay
- Original Message - > From: "Shyam" > To: "Aravinda" , "Gluster Devel" > > Sent: Wednesday, September 2, 2015 8:09:55 PM > Subject: Re: [Gluster-devel] Gluster Sharding and Geo-replication > On 09/02/2015 03:12 AM,

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Venky Shankar
On Wed, Sep 2, 2015 at 12:42 PM, Aravinda wrote: > Geo-replication and Sharding Team today discussed about the approach > to make Sharding aware Geo-replication. Details are as below > > Participants: Aravinda, Kotresh, Krutika, Rahul Hinduja, Vijay Bellur > > - Both Master

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Vijay Bellur
On Wednesday 02 September 2015 08:09 PM, Shyam wrote: On 09/02/2015 03:12 AM, Aravinda wrote: Geo-replication and Sharding Team today discussed about the approach to make Sharding aware Geo-replication. Details are as below Participants: Aravinda, Kotresh, Krutika, Rahul Hinduja, Vijay Bellur

Re: [Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Vijay Bellur
On Wednesday 02 September 2015 07:34 PM, Pranith Kumar Karampuri wrote: On 09/02/2015 07:33 PM, Vijay Bellur wrote: On Wednesday 02 September 2015 06:38 PM, Atin Mukherjee wrote: IIRC, Pranith already volunteered for it in one of the last community meetings? Thanks Atin. I do recollect it

Re: [Gluster-devel] Wanted - 3.7.5 release manager

2015-09-02 Thread Vijay Bellur
On Wednesday 02 September 2015 06:38 PM, Atin Mukherjee wrote: IIRC, Pranith already volunteered for it in one of the last community meetings? Thanks Atin. I do recollect it now. Pranith - can you confirm being the release manager for 3.7.5? -Vijay -Atin Sent from one plus one On Sep 2,

Re: [Gluster-devel] FOP ratelimit?

2015-09-02 Thread Emmanuel Dreyfus
Raghavendra Gowdappa wrote: > Its helpful if you can give some pointers on what parameters (like > latency, throughput etc) you want us to consider for QoS. Full blown QoS would be nice, but a first line of defense against resource hogs seems just badly required. A bare

Re: [Gluster-devel] Gluster Sharding and Geo-replication

2015-09-02 Thread Shyam
On 09/02/2015 03:12 AM, Aravinda wrote: Geo-replication and Sharding Team today discussed about the approach to make Sharding aware Geo-replication. Details are as below Participants: Aravinda, Kotresh, Krutika, Rahul Hinduja, Vijay Bellur - Both Master and Slave Volumes should be Sharded