Re: [Gluster-users] Tuning for small files

2015-10-02 Thread Thibault Godouet
> > To: "Ben Turner" <btur...@redhat.com> > > Cc: hm...@t-hamel.fr, gluster-users@gluster.org > > Sent: Tuesday, September 29, 2015 1:36:20 PM > > Subject: Re: [Gluster-users] Tuning for small files > > > > Ben, > > > > I suspect meta-da

Re: [Gluster-users] Tuning for small files

2015-10-01 Thread André Bauer
t: Wednesday, September 30, 2015 2:48:57 AM >> Subject: Re: [Gluster-users] Tuning for small files >> >>> Where you run into problems with smallfiles on gluster is latency of >> sending >>> data over the wire. For every smallfile create there are a bunch of >

Re: [Gluster-users] Tuning for small files

2015-09-30 Thread Iain Milne
> Where you run into problems with smallfiles on gluster is latency of sending > data over the wire. For every smallfile create there are a bunch of different > file opetations we have to do on every file. For example we will have to do > at least 1 lookup per brick to make sure that the file

Re: [Gluster-users] Tuning for small files

2015-09-30 Thread Ben Turner
- Original Message - > From: "Iain Milne" <gluste...@noognet.org> > To: gluster-users@gluster.org > Sent: Wednesday, September 30, 2015 11:00:07 AM > Subject: Re: [Gluster-users] Tuning for small files > > > Here are all 3 of the settings I was tal

Re: [Gluster-users] Tuning for small files

2015-09-30 Thread Ben Turner
- Original Message - > From: "Iain Milne" <gluste...@noognet.org> > To: gluster-users@gluster.org > Sent: Wednesday, September 30, 2015 2:48:57 AM > Subject: Re: [Gluster-users] Tuning for small files > > > Where you run into problems with smallfil

Re: [Gluster-users] Tuning for small files

2015-09-30 Thread Iain Milne
> Here are all 3 of the settings I was talking about: > > gluster v set testvol client.event-threads 4 > gluster v set testvol server.event-threads 4 > gluster v set testvol performance.lookup-optimize on > > Yes, lookup optimize needs to be enabled. Thanks for that. The first two

Re: [Gluster-users] Tuning for small files

2015-09-29 Thread Ben Turner
- Original Message - > From: "Thibault Godouet" <tib...@godouet.net> > To: "Ben Turner" <btur...@redhat.com> > Cc: hm...@t-hamel.fr, gluster-users@gluster.org > Sent: Tuesday, September 29, 2015 1:36:20 PM > Subject: Re: [Gluster-users] Tunin

Re: [Gluster-users] Tuning for small files

2015-09-29 Thread Thibault Godouet
and lookup optimize? Or are those by far the most important in this scenario? Thx, Thibault. - Original Message - > From: hm...@t-hamel.fr > To: aba...@magix.net > Cc: gluster-users@gluster.org > Sent: Monday, September 28, 2015 7:40:52 AM > Subject: Re: [Gluster-users] Tuning

Re: [Gluster-users] Tuning for small files

2015-09-28 Thread Ben Turner
- Original Message - > From: hm...@t-hamel.fr > To: aba...@magix.net > Cc: gluster-users@gluster.org > Sent: Monday, September 28, 2015 7:40:52 AM > Subject: Re: [Gluster-users] Tuning for small files > > I'm also quite interested by small files performances optimiza

Re: [Gluster-users] Tuning for small files

2015-09-28 Thread hmlth
I'm also quite interested by small files performances optimization, but I'm a bit confused about the best option between 3.6/3.7. Ben Turner was saying that 3.6 might give the best performances: http://www.gluster.org/pipermail/gluster-users/2015-September/023733.html What kind of gain is

Re: [Gluster-users] Tuning for small files

2015-09-28 Thread André Bauer
If you're not already on Glusterfs 3.7.x i would recommend an update first. Am 25.09.2015 um 17:49 schrieb Thibault Godouet: > Hi, > > There are quite a few tuning parameters for Gluster (as seen in Gluster > volume XYZ get all), but I didn't find much documentation on those. > Some people do

[Gluster-users] Tuning for small files

2015-09-25 Thread Thibault Godouet
Hi, There are quite a few tuning parameters for Gluster (as seen in Gluster volume XYZ get all), but I didn't find much documentation on those. Some people do seem to set at least some of them, so the knowledge must be somewhere... Is there a good source of information to understand what they

Re: [Gluster-users] Tuning for small files?

2014-07-10 Thread Jocelyn Hotte
Hi, can anyone help me with this issue? From: Jocelyn Hotte Sent: 8 juillet 2014 11:16 To: gluster-users@gluster.org Subject: Tuning for small files? Hello Gluster Community, I was wondering if there are some things I could do to optimize gluster for small files. Our bricks are 4 SSD in Raid0,

Re: [Gluster-users] Tuning for small files?

2014-07-10 Thread Prasad, Nirmal
] Tuning for small files? Hi, can anyone help me with this issue? From: Jocelyn Hotte Sent: 8 juillet 2014 11:16 To: gluster-users@gluster.orgmailto:gluster-users@gluster.org Subject: Tuning for small files? Hello Gluster Community, I was wondering if there are some things I could do to optimize

[Gluster-users] Tuning for small files?

2014-07-08 Thread Jocelyn Hotte
Hello Gluster Community, I was wondering if there are some things I could do to optimize gluster for small files. Our bricks are 4 SSD in Raid0, and we have a replica set factor of 3 We have a use-case where we would like to optimize our gluster mount for small files (about 6kb). Here's my