Re: Very Poor Raid Card Performance - Solved
Problem solved, I believe. Here is the results from Bonnie++ with the raid card set to "writethru" which writes directly to disk. Version 1.93c --Sequential Output-- --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP Mort 2G 322 99 17482 4 20280 7 683 99 581645 99 2261 65 Latency 25812us 260ms1049ms 137ms 627us 100ms I then set the card to "writeback" and got this. Version 1.93c --Sequential Output-- --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP Mort 2G 318 98 100299 37 96431 41 676 99 414514 99 9853 425 Latency 79085us 250ms 263ms 127ms 651us 97392us Looks like write caching was not enabled, don't know why it worked in windows XP though. Thankfully I have a good UPS, wouldn't want to lose data because of a power loss. A big thanks to everyone for your advice. Steve... -- [EMAIL PROTECTED] http://folding.stanford.edu/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
On 1/17/07, Wood, Russell <[EMAIL PROTECTED]> wrote: I have an LSI MegaRaid with three drives at RAID 5: works a god-damn-treat. I don't know what my throughput is on RAID 5 but RAID 0 was fast (70MB/s+). Interesting. On my single SATA drive box I see: $ sudo dd if=/dev/ad8s1d of=/dev/zero bs=1m 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 15.552259 secs (69040891 bytes/sec) DISCLAIMER: Disclaimer. This e-mail is private and confidential. So... why send it to a public mailing list? -- Juha http://www.geekzone.co.nz/juha ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
Wood, Russell wrote: > I have an LSI MegaRaid with three drives at RAID 5: works a > god-damn-treat. I don't know what my throughput is on RAID 5 but RAID 0 > was fast (70MB/s+). Mine was RAID5. Hmm, oops, it wasn't LSI but HP/Compaq CISS, battery backed, SATA on SAS. da0 at ciss0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 476886MB (976662896 512 byte sectors: 255H 32S/T 65535C) > Were you doing these tests a few hours after initializing the array, by > any chance? If so, then the poor performance could be because the array > was `in build' while you were using it, and therefore you'd get very > poor performance. Yes, I observed BIOS status. Here's a typical run of bonnie++: Version 1.93c --Sequential Output-- --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- MachineSize K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP xxx.com 2500M 358 99 13446 4 7068 2 559 96 97548 23 300.0 10 Latency 23236us 848ms 488ms 191ms 214ms 175ms My reading of iostat during 'dd' is that writes perform good until the on-controller cache gets filled, then it slows down: tty da0pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id ... 0 60 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 1 64 127.93 217 27.08 0.00 0 0.00 0 0 5 0 95 0 61 125.92 400 49.14 0.00 0 0.00 0 0 2 1 98 0 61 128.00 107 13.36 0.00 0 0.00 0 0 2 0 98 0 61 128.00 107 13.36 0.00 0 0.00 0 0 2 0 98 0 61 128.00 104 12.99 0.00 0 0.00 0 0 2 0 98 Cache size is 128MB, 75% dedicated to write caching. signature.asc Description: OpenPGP digital signature
RE: Very Poor Raid Card Performance
> -Original Message- > From: [EMAIL PROTECTED] [mailto:owner-freebsd- > [EMAIL PROTECTED] On Behalf Of Ivan Voras > Sent: Wednesday, 17 January 2007 7:04 AM > To: freebsd-questions@freebsd.org > Subject: Re: Very Poor Raid Card Performance > > Steven Lowry wrote: > > > The main problem is my HD performance, it is approx 6x slower than in > > windows XP, hopefully there is a solution. I have an LSI Megaraid 8x > with > > four drives in a raid 5 configuration, in windows I was getting upto > 60MB/s > > transfer rates but in FBSD I am getting upto 9MB/s. I followed the I have an LSI MegaRaid with three drives at RAID 5: works a god-damn-treat. I don't know what my throughput is on RAID 5 but RAID 0 was fast (70MB/s+). Were you doing these tests a few hours after initializing the array, by any chance? If so, then the poor performance could be because the array was `in build' while you were using it, and therefore you'd get very poor performance. Regards, Russell Wood DISCLAIMER: Disclaimer. This e-mail is private and confidential. If you are not the intended recipient, please advise us by return e-mail immediately, and delete the e-mail and any attachments without using or disclosing the contents in any way. The views expressed in this e-mail are those of the author, and do not represent those of this company unless this is clearly indicated. You should scan this e-mail and any attachments for viruses. This company accepts no liability for any direct or indirect damage or loss resulting from the use of any attachments to this e-mail. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
Steven Lowry wrote: > The main problem is my HD performance, it is approx 6x slower than in > windows XP, hopefully there is a solution. I have an LSI Megaraid 8x with > four drives in a raid 5 configuration, in windows I was getting upto 60MB/s > transfer rates but in FBSD I am getting upto 9MB/s. I followed the > instructions in the handbook for tuning disks and I have set dma on. > Being new to unix, I have no idea what to try or get system information > too continue troubleshooting. > If anyone could point me in the right direction or to appropriate > documentation it would be much appreciated. First, you could try asking the question at performance/at/freebsd.org mailing list - you could get more help there. This reminds me of something I've seen on a box that's also equipped with LSI Megaraid but since disk I/O wasn't important for it, I didn't dig further and forgot about it. Maybe the driver has a problem and people on the performance list can help you. Here's a general checklist of what information to gather before sending it to performance list: * dmesg snippet (like you sent) * copy with "cp" in console, not with KDE and see if it changes anything * run 'iostat' while copying and send results * install and run "bonnie++" (disk I/O benchmark) and send results signature.asc Description: OpenPGP digital signature
Re: Very Poor Raid Card Performance
In response to "Steven Lowry" <[EMAIL PROTECTED]>: > > On Tue, January 16, 2007 18:13, Bill Moran wrote: > > In response to "Steven Lowry" <[EMAIL PROTECTED]>: > >> > >> I have been very impressed with my FreeBSD 6.2 install, I have nearly > >> everything working but there are a few things which I need help with. > >> > >> The main problem is my HD performance, it is approx 6x slower than in > >> windows XP, hopefully there is a solution. I have an LSI Megaraid 8x > >> with > >> four drives in a raid 5 configuration, in windows I was getting up to > >> 60MB/s > >> transfer rates but in FBSD I am getting up to 9MB/s. I followed the > >> instructions in the handbook for tuning disks and I have set dma on. > >> Being new to unix, I have no idea what to try or get system information > >> too continue troubleshooting. > >> If anyone could point me in the right direction or to appropriate > >> documentation > >> it would be much appreciated. > > > > You should provide the details of how you arrived at those numbers. > > Please provide details of your testing methodology. > > > > While it's impossible to compare apples to apples when pitting Windows > > against FreeBSD, you at least want to be comparing two fruits -- not > > apples and buffalo steaks or something like that. > > Thanks for your reply, > > I repeatedly copied a 700MB file from one harddrive to the Raid 5 Drive, a > different file every time so caching won't be a large factor and consistantly > got 8-9MB/s. Copying such large files is something I do on a daily basis. > Hardly scientific, more of a real use scenario. Transfer was done via KDE. And this translated in to MB/s how? Timed with a stopwatch? Keep in mind that by simply copying, you are testing the speed of the OS cache, the speed of the filesystem, and the speed of the driver all at once. We're going to have to narrow it down to isolate the problem. I can give you advice in FreeBSD, but I don't know how to do it in Windows. Additionally, if the first hard drive performs badly under FreeBSD for some reason, that would color your results. > Here is the dmesg output for the controller; > > amr0: mem > 0xfa2f-0xfa2f,0xfe80-0xfe8f irq 30 at device 14.0 on pci5 > amr0: delete logical drives supported by controller > amr0: Firmware 814D, BIOS H431, > 128MB RAM > amrd0: on amr0 > amrd0: 712392MB (1458978816 sectors) RAID 5 (optimal) > > Not sure what is meant by the delete line. It means the driver/hardware supports the optional "delete logical drives" feature. > Motherboard is an Iwill DK8N, Nforce3 Chipset, AMD 8131 PCI-X bridge. > The nvidia raid is populated by two WD raptors in a raid 1, this holds FBSD, > the LSI is for data storage. > > Any other information I could supply? -- Bill Moran Collaborative Fusion Inc. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
On Tue, January 16, 2007 18:13, Bill Moran wrote: > In response to "Steven Lowry" <[EMAIL PROTECTED]>: >> >> I have been very impressed with my FreeBSD 6.2 install, I have nearly >> everything working but there are a few things which I need help with. >> >> The main problem is my HD performance, it is approx 6x slower than in >> windows XP, hopefully there is a solution. I have an LSI Megaraid 8x >> with >> four drives in a raid 5 configuration, in windows I was getting up to >> 60MB/s >> transfer rates but in FBSD I am getting up to 9MB/s. I followed the >> instructions in the handbook for tuning disks and I have set dma on. >> Being new to unix, I have no idea what to try or get system information >> too continue troubleshooting. >> If anyone could point me in the right direction or to appropriate >> documentation >> it would be much appreciated. > > You should provide the details of how you arrived at those numbers. > Please provide details of your testing methodology. > > While it's impossible to compare apples to apples when pitting Windows > against FreeBSD, you at least want to be comparing two fruits -- not > apples and buffalo steaks or something like that. Thanks for your reply, I repeatedly copied a 700MB file from one harddrive to the Raid 5 Drive, a different file every time so caching won't be a large factor and consistantly got 8-9MB/s. Copying such large files is something I do on a daily basis. Hardly scientific, more of a real use scenario. Transfer was done via KDE. Here is the dmesg output for the controller; amr0: mem 0xfa2f-0xfa2f,0xfe80-0xfe8f irq 30 at device 14.0 on pci5 amr0: delete logical drives supported by controller amr0: Firmware 814D, BIOS H431, 128MB RAM amrd0: on amr0 amrd0: 712392MB (1458978816 sectors) RAID 5 (optimal) Not sure what is meant by the delete line. Motherboard is an Iwill DK8N, Nforce3 Chipset, AMD 8131 PCI-X bridge. The nvidia raid is populated by two WD raptors in a raid 1, this holds FBSD, the LSI is for data storage. Any other information I could supply? Steve... -- [EMAIL PROTECTED] http://folding.stanford.edu/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
With FreeBSD you can manage RAID in the OS or in your hardware (assuming hardware RAID support.) If you setup the RAID in the hardware, FreeBSD just "sees" the array as a large disk you can then partition. The advantage of doing the RAID in hardware is usually performance, but also you can dual-boot. -Derek At 10:25 AM 1/16/2007, Steven Lowry wrote: Hello, I have been very impressed with my FreeBSD 6.2 install, I have nearly everything working but there are a few things which I need help with. The main problem is my HD performance, it is approx 6x slower than in windows XP, hopefully there is a solution. I have an LSI Megaraid 8x with four drives in a raid 5 configuration, in windows I was getting upto 60MB/s transfer rates but in FBSD I am getting upto 9MB/s. I followed the instructions in the handbook for tuning disks and I have set dma on. Being new to unix, I have no idea what to try or get system information too continue troubleshooting. If anyone could point me in the right direction or to appropriate documentation it would be much appreciated. Steve... -- [EMAIL PROTECTED] http://folding.stanford.edu/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. MailScanner thanks transtec Computers for their support. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. MailScanner thanks transtec Computers for their support. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Very Poor Raid Card Performance
In response to "Steven Lowry" <[EMAIL PROTECTED]>: > > I have been very impressed with my FreeBSD 6.2 install, I have nearly > everything working but there are a few things which I need help with. > > The main problem is my HD performance, it is approx 6x slower than in > windows XP, hopefully there is a solution. I have an LSI Megaraid 8x with > four drives in a raid 5 configuration, in windows I was getting up to 60MB/s > transfer rates but in FBSD I am getting up to 9MB/s. I followed the > instructions in the handbook for tuning disks and I have set dma on. > Being new to unix, I have no idea what to try or get system information > too continue troubleshooting. > If anyone could point me in the right direction or to appropriate > documentation > it would be much appreciated. You should provide the details of how you arrived at those numbers. Please provide details of your testing methodology. While it's impossible to compare apples to apples when pitting Windows against FreeBSD, you at least want to be comparing two fruits -- not apples and buffalo steaks or something like that. -- Bill Moran Collaborative Fusion Inc. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Very Poor Raid Card Performance
Hello, I have been very impressed with my FreeBSD 6.2 install, I have nearly everything working but there are a few things which I need help with. The main problem is my HD performance, it is approx 6x slower than in windows XP, hopefully there is a solution. I have an LSI Megaraid 8x with four drives in a raid 5 configuration, in windows I was getting upto 60MB/s transfer rates but in FBSD I am getting upto 9MB/s. I followed the instructions in the handbook for tuning disks and I have set dma on. Being new to unix, I have no idea what to try or get system information too continue troubleshooting. If anyone could point me in the right direction or to appropriate documentation it would be much appreciated. Steve... -- [EMAIL PROTECTED] http://folding.stanford.edu/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
