[Gluster-devel] REMINDER: Gluster Community Bug Triage meeting today at 12:00 UTC

2014-11-25 Thread Niels de Vos
Hi all, Later today we will have an other Gluster Community Bug Triage meeting. Meeting details: - location: #gluster-meeting on Freenode IRC - date: every Tuesday - time: 12:00 UTC, 13:00 CET (in your terminal, run: date -d 12:00 UTC) - agenda: https://public.pad.fsfe.org/p/gluster-bug-triage

Re: [Gluster-devel] Wrong behavior on fsync of md-cache ?

2014-11-25 Thread Xavier Hernandez
On 11/25/2014 07:38 AM, Raghavendra Gowdappa wrote: - Original Message - From: Xavier Hernandez xhernan...@datalab.es To: Raghavendra Gowdappa rgowd...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org, Emmanuel Dreyfus m...@netbsd.org Sent: Tuesday, November 25, 2014 12:49:03 AM

Re: [Gluster-devel] Wrong behavior on fsync of md-cache ?

2014-11-25 Thread Emmanuel Dreyfus
On Tue, Nov 25, 2014 at 09:35:25AM +0100, Xavier Hernandez wrote: Anyway it seems that there's a difference between linux and NetBSD because this test only fails on NetBSD. Is it possible that linux's fuse implementation delays the fsync request until all pending writes have been answered ?

Re: [Gluster-devel] Wrong behavior on fsync of md-cache ?

2014-11-25 Thread Raghavendra Gowdappa
- Original Message - From: Xavier Hernandez xhernan...@datalab.es To: Raghavendra Gowdappa rgowd...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org, Emmanuel Dreyfus m...@netbsd.org Sent: Tuesday, November 25, 2014 2:05:25 PM Subject: Re: Wrong behavior on fsync of md-cache

Re: [Gluster-devel] Wrong behavior on fsync of md-cache ?

2014-11-25 Thread Xavier Hernandez
On 11/25/2014 12:59 PM, Raghavendra Gowdappa wrote: - Original Message - From: Xavier Hernandez xhernan...@datalab.es To: Raghavendra Gowdappa rgowd...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org, Emmanuel Dreyfus m...@netbsd.org Sent: Tuesday, November 25, 2014 2:05:25 PM

Re: [Gluster-devel] Wrong behavior on fsync of md-cache ?

2014-11-25 Thread Emmanuel Dreyfus
Xavier Hernandez xhernan...@datalab.es wrote: An alternative would be to temporarily remove or change this test to avoid the problem. That would help on that test, but I suspect the same problem is responsible for other spurious failures. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
Are you referring to something else in your request? Meaning, you want /myfile, /dir1/myfile and /dir2/dir3/myfile to fall onto the same bricks/subvolumes and that perchance is what you are looking for? That is EXACTLY what I am looking for. What are my chances? BR Jan

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
I think I have it. Unless I’m totally confused, I can hash ONLY on the filename with: glusterfs --volfile-server=a_server --volfile-id=a_volume \ --xlator-option a_volume-dht.extra_hash_regex='.*[/]' \ /a/mountpoint Correct? Jan From: Jan H Holtzhausen j...@holtztech.info Date:

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Shyam
On 11/25/2014 02:28 PM, Jan H Holtzhausen wrote: I think I have it. Unless I’m totally confused, I can hash ONLY on the filename with: glusterfs --volfile-server=a_server --volfile-id=a_volume \ --xlator-option a_volume-dht.extra_hash_regex='.*[/]' \ /a/mountpoint Correct? The

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
Hmm Then something is wrong, If I upload 2 identical files, with different paths they only end up on the same server 1/4 of the time (I have 4 bricks). I’ll test the regex quickly. BR Jan On 2014/11/25, 7:55 PM, Shyam srang...@redhat.com wrote: On 11/25/2014 02:28 PM, Jan H Holtzhausen

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Shyam
On 11/25/2014 03:11 PM, Jan H Holtzhausen wrote: STILL doesn’t work … exact same file ends up on 2 different bricks … I must be missing something. All I need is for: /directory1/subdirectory2/foo And /directory2/subdirectoryaaa999/foo To end up on the same brick…. This is not possible is

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
So in a distributed cluster, the GFID tells all bricks what a files preceding directory structure looks like? Where the physical file is saved is a function of the filename ONLY. Therefore My requirement should be met by default, or am I being dense? BR Jan On 2014/11/25, 8:15 PM, Shyam

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
As to the why. Filesystem cache hits. Files with the same name tend to be the same files. Regards Jan On 2014/11/25, 8:42 PM, Jan H Holtzhausen j...@holtztech.info wrote: So in a distributed cluster, the GFID tells all bricks what a files preceding directory structure looks like? Where the

Re: [Gluster-devel] Single layout at root (Was EHT / DHT)

2014-11-25 Thread Anand Avati
On Tue Nov 25 2014 at 1:28:59 PM Shyam srang...@redhat.com wrote: On 11/12/2014 01:55 AM, Anand Avati wrote: On Tue, Nov 11, 2014 at 1:56 PM, Jeff Darcy jda...@redhat.com mailto:jda...@redhat.com wrote: (Personally I would have done this by mixing in the parent GFID to

Re: [Gluster-devel] Single layout at root (Was EHT / DHT)

2014-11-25 Thread Shyam
On 11/25/2014 05:03 PM, Anand Avati wrote: On Tue Nov 25 2014 at 1:28:59 PM Shyam srang...@redhat.com mailto:srang...@redhat.com wrote: On 11/12/2014 01:55 AM, Anand Avati wrote: On Tue, Nov 11, 2014 at 1:56 PM, Jeff Darcy jda...@redhat.com mailto:jda...@redhat.com

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Poornima Gurusiddaiah
Out of curiosity, what back end and deduplication solution are you using? Regards, Poornima - Original Message - From: Jan H Holtzhausen j...@holtztech.info To: Anand Avati av...@gluster.org, Shyam srang...@redhat.com, gluster-devel@gluster.org Sent: Wednesday, November 26, 2014

Re: [Gluster-devel] EHT / DHT

2014-11-25 Thread Jan H Holtzhausen
I could tell you… But Symantec wouldn’t like it….. From: Poornima Gurusiddaiah pguru...@redhat.com Date: Wednesday 26 November 2014 at 7:16 AM To: Jan H Holtzhausen j...@holtztech.info Cc: gluster-devel@gluster.org Subject: Re: [Gluster-devel] EHT / DHT Out of curiosity, what back end and