Hi Tracy, Yes, I've reached maximum rates with the current setup (4x1gbit), first of all I've changed disks to seagate constellation2 disks which is very newer than the ones I have in RAID10.
dd if=/dev/etherd/e90.2 of=/dev/zero bs=1024 count=20M 20971520+0 records in 20971520+0 records out 21474836480 bytes (21 GB) copied, 61.5485 seconds, 349 MB/s Now I try to tweak further looking into output of "ggaoectl stats": # Statistics for device aoestorage1-90-2-2000r6 read_cnt: 5235045 read_bytes: 21442744320 read_time: 9663.53 write_cnt: 0 write_bytes: 0 write_time: 0 other_cnt: 304 other_time: 0.0212562 io_slots: 1117752 io_runs: 96727 queue_length: 786443640 queue_stall: 1753 queue_over: 0 ata_err: 0 proto_err: 0 I can get a very low "queue_stall" number by setting "merge-delay = 0.002" in ggaoed.conf, if not setting merge-delay queue_stall is extremely high. And "queue_over" is 0 when setting "queue-length = 1024". If I set queue-length to 64 I get extremely high queue_over number... Also these tweaks have big influence on the read and writes rates I'm having. Direct i/o false makes the rates go even higher in my tests, but I'm not aware if this will trigger bad influence somewhere else. So for now I have this set to true (like default) ring-buffer-size = 32768 is set to highest but I haven't been able to see big changes in setting this lower... I'm trying to configure from information here: http://ggaoed.googlecode.com/svn/trunk/README And this thread: http://www.mail-archive.com/aoetools-discuss@lists.sourceforge.net/msg00386.html And of course the man pages for ggaoectl etc. I'm not completely aware how all these settings play together in order to get a good and stable performance without errors. I still think it's difficult to be sure how a "perfect" configuration is achieved. And difficult to understand the meaning of all the parameters in conjunction ;) "ggaoectl monitor" also show all interfaces is doing quite some work now. That said there's probably some more fine tuning I can do. For stability I'm also running ggaoed through the "runit" service (apt-get install runit) as I don't trust the ggaoed process to be able to start itself in case something bad happens. /Lars Den 03/07/2011 kl. 02.13 skrev Tracy Reed: > On Fri, Jul 01, 2011 at 03:45:51PM +0200, Lars Erik Dangvard Jensen spake > thusly: >> I did some more tests, and ggaoed is using 4 NICs and rates are OK now. >> Tested on another exported raid-array. > > What changed? What solved the problem? Don't leave us hanging! ;) > > -- > Tracy Reed Digital signature attached for your safety. > Copilotco Professionally Managed PCI Compliant Secure Hosting > 866-MY-COPILOT x101 http://copilotco.com ------------------------------------------------------------------------------ All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 _______________________________________________ Aoetools-discuss mailing list Aoetools-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
