Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-22 Thread paul simpson
hi shehjar, many thanks for your reply. that is 4 servers - serving ~30 clients - 95% linux, 5% mac. all NFS. Mac OS as a nfs client remains untested against Gluster NFS. Do you see these errors on Mac or Linux clients? only tested locking on linux so far. - sometimes root can stat/read

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread David Lloyd
I'm working with Paul on this. We did take advice on XFS beforehand, and were given the impression that it would just be a performance issue rather than things not actually working. We've got quite fast hardware, and are more comfortable with XFS that ext4 from our own experience so we did our

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread paul simpson
hi fabricio, many thanks for your input. indeed i am using xfs - but that seems to be mentioned in the gluster docs without any mention of problems. we benchmarked xfs vs ext4 - and found that xfs to be much better at dealing with the bulk of our data - hi-def frames ~3-10M each - and large

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 09:53 AM, David Lloyd wrote: I'm working with Paul on this. We did take advice on XFS beforehand, and were given the impression that it would just be a performance issue rather than things not actually working. Hi David XFS works fine as a backing store for GlusterFS. We've

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Brent A Nelson
On Mon, 21 Feb 2011, Joe Landman wrote: On 02/21/2011 09:53 AM, David Lloyd wrote: Likewise, we're aware of the very poor performance of gluster with small files. We serve a lot of large files, and we're now moved most of the small files off to a normal nfs server. Again small files aren't

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 12:05 PM, Brent A Nelson wrote: Those who are looking for better metadata performance might want to see if MooseFS fits their needs. It uses a metadata server which caches the entire filesystem metadata in RAM, so it seems to be very responsive. I have my home directory on

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Fabricio Cannini
Em Segunda-feira 21 Fevereiro 2011, às 12:01:11, Joe Landman escreveu: On 02/21/2011 09:53 AM, David Lloyd wrote: I'm working with Paul on this. We did take advice on XFS beforehand, and were given the impression that it would just be a performance issue rather than things not actually

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 12:17 PM, Fabricio Cannini wrote: Em Segunda-feira 21 Fevereiro 2011, às 12:01:11, Joe Landman escreveu: On 02/21/2011 09:53 AM, David Lloyd wrote: I'm working with Paul on this. We did take advice on XFS beforehand, and were given the impression that it would just be a

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread paul simpson
so, while your all about - my big question is can/does gluster (with NFS/fuse client) properly lock files? ie, a simple test is to checkout a svn tree to a gluster, modify, checkin, list, alter, revert. everytime i do this with 3.1.2 i get input/output errors from my client machine within a few

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Steve Wilson
On 02/21/2011 09:54 AM, paul simpson wrote: hi fabricio, many thanks for your input. indeed i am using xfs - but that seems to be mentioned in the gluster docs without any mention of problems. we benchmarked xfs vs ext4 - and found that xfs to be much better at dealing with the bulk of our

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 12:45 PM, Steve Wilson wrote: On 02/21/2011 09:54 AM, paul simpson wrote: hi fabricio, many thanks for your input. indeed i am using xfs - but that seems to be mentioned in the gluster docs without any mention of problems. we benchmarked xfs vs ext4 - and found that xfs to be

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Steve Wilson
On 02/21/2011 12:47 PM, Joe Landman wrote: On 02/21/2011 12:45 PM, Steve Wilson wrote: On 02/21/2011 09:54 AM, paul simpson wrote: hi fabricio, many thanks for your input. indeed i am using xfs - but that seems to be mentioned in the gluster docs without any mention of problems. we

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread paul simpson
Thanks, Joe. Both servers use NTP against the same subnet router so it's unlikely that they had a time discrepancy. I just checked the two servers and their times are consistent with each other at the moment. ...same with our machines here. all running ntpd. it's good to hear i'm not

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Kon Wilms
On Mon, Feb 21, 2011 at 9:45 AM, Steve Wilson ste...@purdue.edu wrote: We had trouble with reliability for small, actively-accessed files on a distribute-replicate volume in both GlusterFS 3.11 and 3.12.  It seems that the replicated servers would eventually get out of sync with each other on

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 01:39 PM, Kon Wilms wrote: On Mon, Feb 21, 2011 at 9:45 AM, Steve Wilsonste...@purdue.edu wrote: We had trouble with reliability for small, actively-accessed files on a distribute-replicate volume in both GlusterFS 3.11 and 3.12. It seems that the replicated servers would

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread paul simpson
thanks for all responding - at least i know i'm not all alone. i am shocked to think that so many on this list are having serious fundamental issues with glusterfs - and seemingly for a long time. so, without wanting to troll - my question is: is gluster a serious stable general purpose file

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Joe Landman
On 02/21/2011 02:06 PM, paul simpson wrote: thanks for all responding - at least i know i'm not all alone. i am shocked to think that so many on this list are having serious fundamental issues with glusterfs - and seemingly for a long time. so, without wanting to troll - my question is: is

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread paul simpson
hi joe, it's very reassuring to read your post. answers in-line. I do believe it is a serious and stable system. We are running into specific bugs. I'm ok with workarounds, but I really want to find a way to cause the problems. same with both. right now i'm putting more of my

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Shehjar Tikoo
Hi Paul, Locking is part of the core GlusterFS protocol but the NFS server module does not have NLM support yet(NLM is the locking protocol associated with NFSv3). On linux, the workaround is generally to mount with the -o nolock option although I dont see why excluding this option results in

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Shehjar Tikoo
paul simpson wrote: hello all, i have been testing gluster as a central file server for a small animation studio/post production company. my initial experiments were using the fuse glusterfs protocol - but that ran extremely slowly for home dirs and general file sharing. we have since

Re: [Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-21 Thread Shehjar Tikoo
David Lloyd wrote: I'm working with Paul on this. We did take advice on XFS beforehand, and were given the impression that it would just be a performance issue rather than things not actually working. We've got quite fast hardware, and are more comfortable with XFS that ext4 from our own

[Gluster-users] Fwd: files not syncing up with glusterfs 3.1.2

2011-02-18 Thread paul simpson
hello all, i have been testing gluster as a central file server for a small animation studio/post production company. my initial experiments were using the fuse glusterfs protocol - but that ran extremely slowly for home dirs and general file sharing. we have since switched to using NFS over