On Sun, May 08, 2011 at 04:59:36PM +0200, Torbjørn Thorsen spake thusly: > I really want to stay away from the iSCSI setup, > but I'm at the end of my wits with regards to getting the required > performance from AoE. > > Any ideas as to what I'm doing wrong ?
There are a few things you can do to help: 1. Make sure you are using a good switch. Cisco, HP, I hear Juniper is good too. Anything else is likely to be crap. Netgear, Linksys, Dell are all right out. 1. Make sure you use hardware flow control on the switch. 2. Double check that you really have mtu 9000 on both ends. 3. I always run vblade with the -b 16384 option as without it performance was significantly less. 4. Adding these to /etc/sysctl.conf helps a bit too: # Optimizations to increase speed for AoE net.core.rmem_default = 278528 net.core.rmem_max = 278528 net.core.wmem_default = 278528 net.core.wmem_max = 278528 net.core.netdev_max_backlog=10000 # Don't let dirty write cache hang around so long, commit to disk sooner for # safety. AoE targets can cache a lot of stuff. vm.dirty_ratio = 3 vm.dirty_background_ratio = 3 vm.min_free_kbytes = 65536 The first stanza is for performance, the second for safety. Run /sbin/sysctl -p to make the system re-read sysctl.conf so the changes can take effect. And make sure you don't have any write alignment issues on the target disk. I used to try to partition my disk but that really complicates things alignment-wise so now I just initialize the raw disk (/dev/sdc for example) as an lvm physical volume and export an lvm from that. -- Tracy Reed
pgp7vKgKpuwH0.pgp
Description: PGP signature
------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________ Aoetools-discuss mailing list Aoetools-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
