On Wed, Jul 6, 2011 at 11:28, Alexandre Chapellon <a.chapel...@horoa.net>wrote:
> ** > > > Le 06/07/2011 11:17, Torbjørn Thorsen a écrit : > > 2011/7/5 Tracy Reed <tr...@ultraviolet.org> <tr...@ultraviolet.org>: > > On Tue, Jul 05, 2011 at 05:03:40PM +0200, Torbjørn Thorsen spake thusly: > > I'm setting up a AoE-based SAN, and I'm not quite sure I've reached a > good performance level. > > I can read and write the raw AoE device (/dev/etherd/*) at more or > less line-speed > on my 1gig Ethernet adapters. > > This means I'm seeing I/O rates of 100 to 120 MB/s when using dd or > something similar. > > This is in line with what I get also. Sounds like your performance level is > as > expected (very good). > > > However, when I put a filesystem on there, I'm seeing rates of 55 to 70 MB/s. > I've tested mostly by using rsync, cp or dd, but I tried bonnie and > saw much the same results. > > Yep. You are most likely running into physical limitations of the disk. > > I should have mentioned that the AoE device is backed by a RAID setup that is > able to write well above 120 MB/s. > If I mount the same filesystem locally, on the server, bonnie tells me > it's able to do > sequential writes at ~370 MB/s. > > If I write straight to the AoE device, I can get the expected > line-speed of the network, around ~110 MB/s. > dd if=/dev/zero of=/dev/etherd/e1.1 bs=1M > > However, when mounting a filesystem, and copying a file onto the AoE > device, I only see about ~70 MB/s. > > This leads me to thinking that the performance degradation I'm seeing > is related to > the filesystem or the network. > Of course, I wouldn't expect a filesystem to give the same performance as the > raw device, but I didn't expect to see a ~25% hit in performance, especially > when doing a sequential write. > > > What filesystem do you use? XFS is known to be the recommended filesystem > for AoE. > I'm mostly testing with ext4, though I have given ext3 a run as well. I saw that XFS is recommended in Coraids documentation, but I'm not very keen on using it. I gave it a run right now, and doing the same sequential file writing test with XFS also results in ~70 MB/s. > -- > <http://www.horoa.net> > > > ------------------------------------------------------------------------------ > All of the data generated in your IT infrastructure is seriously valuable. > Why? It contains a definitive record of application performance, security > threats, fraudulent activity, and more. Splunk takes this data and makes > sense of it. IT sense. And common sense. > http://p.sf.net/sfu/splunk-d2d-c2 > _______________________________________________ > Aoetools-discuss mailing list > Aoetools-discuss@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/aoetools-discuss > > -- Vennlig hilsen Torbjørn Thorsen Utvikler / driftstekniker Trollweb Solutions AS - Professional Magento Partner www.trollweb.no
<<horoa_sig.png>>
------------------------------------------------------------------------------ All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2
_______________________________________________ Aoetools-discuss mailing list Aoetools-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
