Just wondering if you had the chance of testing the network speed with iperf from host to host yet?
This is like the first thing to do while doing a full debug upside-down.
No matter what disks you have but note that each and one of them has a maximum IOps limit which sometimes you can hit in a way. as already suggested by others in the past you can use a binary search dividing the issue one part at a time network.. disk.. controller.. driver.. software(since the software is proven to work).

Eliezer

On 06/12/2014 11:40 PM, Aronesty, Erik wrote:
I suspect I'm having performance issues because of network speeds.

/Supposedly/ I have 10gbit connections on all my NAS devices, however,
it seems to me that the fastest I can write is 1Gbit.   When I'm copying
very large files, etc, I see 'D' as the cp waits to I/O, but when I go
the gluster servers, I don't see glusterfsd waiting (D) to write to the
bricks themselves.  I have 4 nodes, each with  10Gbit connection, each
has 2 Areca RAID controllers with 12 disk raid5, and the 2 controllers
stripped into 1 large volume.   Pretty sure there's plenty of i/o left
on the bricks themselves.

Is it possible that "one big file" isn't the right test… should I try 20
big files, and see how saturated my network can get?

Erik Aronesty
Senior Bioinformatics Architect

*EA | Quintiles
**/Genomic Services/**//*

4820 Emperor Boulevard

Durham, NC 27703 USA


Office: + 919.287.4011
[email protected] <mailto:[email protected]>

www.quintiles.com <http://www.quintiles.com/>
www.expressionanalysis.com <http://www.expressionanalysis.com/>
cid:[email protected]
<https://www.twitter.com/simulx>cid:[email protected]
<http://www.facebook.com/aronesty>cid:[email protected]
<http://www.linkedin.com/in/earonesty>



_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users


_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Reply via email to