Re: [Gluster-users] How to partition directory structur for 300K files?

2015-08-24 Thread Mathieu Chateau
Hello, did you do some basic tuning to help anyway ? using latest version ? in replication or only distributed ? Why using NFS and not native fuse client to mount volume? did you install VM tools (if using VMware fusion) ? Cordialement, Mathieu CHATEAU http://www.lotp.fr 2015-08-24 15:20

[Gluster-users] How to partition directory structur for 300K files?

2015-08-24 Thread Merlin Morgenstern
I am running into trouble while syncing (rsync, cp ... ) my files to glusterfs. After about 50K files, one machine dies and has to be rebooted. As there are about 300K files in one directory, I am thinking about to cluster that in a directory structure in order to overcome that problem. e.g.

Re: [Gluster-users] How to partition directory structur for 300K files?

2015-08-24 Thread Mathieu Chateau
Re, putting back mailing list so they keep up. With newer version, fuse perform much better, and provide transparent failover. As both brick are 2 VM in same host, latency will not be an issue. Most important is to ensure you have drivers /tools inside VM to get best perf. on client and

Re: [Gluster-users] How to partition directory structur for 300K files?

2015-08-24 Thread Merlin Morgenstern
thank you for the recommendation on parameters. I tried: gs2:/volume1/data/nfs glusterfs defaults,_netdev,backupvolfile-server=gs1,noatime,nodiratime,logbufs=8,logbsize=256k,largeio,inode64,swalloc,allocsize=131072k,nobarrier 0 0 The system reports: #sudo mount -a

Re: [Gluster-users] How to partition directory structur for 300K files?

2015-08-24 Thread Mathieu Chateau
Hello, this is to do on brick, not on client side Cordialement, Mathieu CHATEAU http://www.lotp.fr 2015-08-24 17:57 GMT+02:00 Merlin Morgenstern merlin.morgenst...@gmail.com : thank you for the recommendation on parameters. I tried: gs2:/volume1/data/nfs glusterfs