Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
I recently got a chance to test SW RAID5 using 750GB disks (10) in a RAID5 on a 3ware card, model no: 9550SXU-12 The bottom line is the controller is doing some weird caching with writes on SW RAID5 which makes it not worth using. Recall, with SW RAID5 using regular SATA cards with (mind

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Al Boldi
Justin Piszcz wrote: UltraDense-AS-3ware-R5-9-disks,16G,50676,89,96019,34,46379,9,60267,99,5010 98,56,248.5,0,16:10:16/64,240,3,21959,84,1109,10,286,4,22923,91,544,6 UltraDense-AS-3ware-R5-9-disks,16G,49983,88,96902,37,47951,10,59002,99,529

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Gabor Gombas
On Wed, Jul 18, 2007 at 06:23:25AM -0400, Justin Piszcz wrote: I recently got a chance to test SW RAID5 using 750GB disks (10) in a RAID5 on a 3ware card, model no: 9550SXU-12 The bottom line is the controller is doing some weird caching with writes on SW RAID5 which makes it not worth

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Gabor Gombas wrote: On Wed, Jul 18, 2007 at 06:23:25AM -0400, Justin Piszcz wrote: I recently got a chance to test SW RAID5 using 750GB disks (10) in a RAID5 on a 3ware card, model no: 9550SXU-12 The bottom line is the controller is doing some weird caching with writes

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Giuseppe Ghibò wrote: Justin Piszcz ha scritto: I recently got a chance to test SW RAID5 using 750GB disks (10) in a RAID5 on a 3ware card, model no: 9550SXU-12 The bottom line is the controller is doing some weird caching with writes on SW RAID5 which makes it not

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Hannes Dorbath
On 18.07.2007 13:19, Justin Piszcz wrote: For the HW RAID tests (2) at the bottom of the e-mail, no, I did not set nr_requests or use the deadline scheduler. For the SW RAID tests, I applied similar optimizations, I am probably not at the latest firmware. The main thing I wanted to use

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Hannes Dorbath wrote: On 18.07.2007 13:19, Justin Piszcz wrote: For the HW RAID tests (2) at the bottom of the e-mail, no, I did not set nr_requests or use the deadline scheduler. For the SW RAID tests, I applied similar optimizations, I am probably not at the latest

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Sander
Justin Piszcz wrote (ao): Its too bad that there are no regular 4 port SATA PCI-e controllers out there. Is there a disadvantage to using a SaS controller from for example lsi.com ? http://lsi.com/storage_home/products_home/host_bus_adapters/sas_hbas/index.html I haven't tried them yet, but

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Hannes Dorbath
On 18.07.2007 13:32, Justin Piszcz wrote: Yes I agree here, but I guess my question is why is SW RAID5 so slow on the 3ware card? I think the controller does disable the drives write cache when exported unconfigured. It does always disable, unless you put the drive in a unit and explicit

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Giuseppe Ghibò
Justin Piszcz ha scritto: I recently got a chance to test SW RAID5 using 750GB disks (10) in a RAID5 on a 3ware card, model no: 9550SXU-12 The bottom line is the controller is doing some weird caching with writes on SW RAID5 which makes it not worth using. Recall, with SW RAID5 using

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Al Boldi wrote: Justin Piszcz wrote: UltraDense-AS-3ware-R5-9-disks,16G,50676,89,96019,34,46379,9,60267,99,5010 98,56,248.5,0,16:10:16/64,240,3,21959,84,1109,10,286,4,22923,91,544,6 UltraDense-AS-3ware-R5-9-disks,16G,49983,88,96902,37,47951,10,59002,99,529

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Sander
Justin Piszcz wrote (ao): On Wed, 18 Jul 2007, Sander wrote: Justin Piszcz wrote (ao): Its too bad that there are no regular 4 port SATA PCI-e controllers out there. Is there a disadvantage to using a SaS controller from for example lsi.com ?

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Sander wrote: Justin Piszcz wrote (ao): On Wed, 18 Jul 2007, Sander wrote: Justin Piszcz wrote (ao): Its too bad that there are no regular 4 port SATA PCI-e controllers out there. Is there a disadvantage to using a SaS controller from for example lsi.com ?

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Robin Hill
On Wed Jul 18, 2007 at 01:26:11PM +0200, Hannes Dorbath wrote: I think what you might be experiencing is that XFS can read su,sw values from the MD device and will automatically optimize itself, while it can't do that for the HW RAID device. It is absolutely essential to align your file

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Sander
Justin Piszcz wrote (ao): On Wed, 18 Jul 2007, Sander wrote: I guess they are cheap enough to try (I haven't yet): PCIe: http://lsi.com/storage_home/products_home/host_bus_adapters/sas_hbas/lsisas3080xr/index.html PCI-X

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Hannes Dorbath
On 18.07.2007 12:23, Justin Piszcz wrote: I am sure one of your questions is, well, why use SW RAID5 on the controller? Because SW RAID5 is usually much faster than HW RAID5, at least in my tests: Though that's no answer to your question, I really can't confirm that. I'm running a 3Ware

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Gabor Gombas
On Wed, Jul 18, 2007 at 01:51:16PM +0100, Robin Hill wrote: Just to pick up on this one (as I'm about to reformat my array as XFS) - does this actually work with a hardware controller? Is there any assurance that the XFS stripes align with the hardware RAID stripes? Or could you just end up

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Justin Piszcz
On Wed, 18 Jul 2007, Hannes Dorbath wrote: On 18.07.2007 12:23, Justin Piszcz wrote: I am sure one of your questions is, well, why use SW RAID5 on the controller? Because SW RAID5 is usually much faster than HW RAID5, at least in my tests: Though that's no answer to your question, I

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Bryan J. Smith
On Wed, 2007-07-18 at 12:26 -0400, Justin Piszcz wrote: I will try these options during future testing and re-visit the speeds of regular HW RAID5, thanks! I know they are part of the 3ware doc and I need to re-bench with these. 3Ware cards should be tuned for optimal performance,

Re: Software RAID5 Horrible Write Speed On 3ware Controller!!

2007-07-18 Thread Bryan J. Smith
On Wed, 2007-07-18 at 13:17 +0200, Giuseppe Ghibò wrote: Indeed not exists for PCI-e but Oden has spotted this PCI-X card (which is around 97$), based on marvell chipset: http://www.supermicro.com/products/accessories/addon/AoC-SAT2-MV8.cfm Yes! There are several Broadcom and Marvell ASICs