Re: [CentOS] RAID 6 - opinions

2013-04-23 Thread Lamar Owen
On 04/12/2013 01:01 AM, David Miller wrote: You simply match up the Linux /dev/sdX designation with the drives serial number using smartctl. When I first bring the array online I have a script that greps out the drives serial numbers from smartctl and creates a neat text file with the

Re: [CentOS] RAID 6 - opinions

2013-04-13 Thread Michael Schumacher
hi, yeah, until a disk fails on a 40 disk array and the chassis LEDs on the backplane don't light up to indicate which disk it is and your operations monkey pulls the wrong one and crash the whole raid. that is why I put a label on every drive tray that is visible without pulling the disk.

Re: [CentOS] RAID 6 - opinions

2013-04-12 Thread Seth Bardash
We build a storage unit that anyone using Centos can build. It is based on the 3ware 9750-16 controller. It has 16 x 2 TB Sata 6 gb/s disks. We always set it up as a 15 disk RAID 6 array and a hot spare. We have seen multiple instances were the A/C has gone off but the customer's UPS kept the

Re: [CentOS] RAID 6 - opinions

2013-04-12 Thread m . roth
Hi, Seth, Seth Bardash wrote: We build a storage unit that anyone using Centos can build. It is based on the 3ware 9750-16 controller. It has 16 x 2 TB Sata 6 gb/s disks. We always set it up as a 15 disk RAID 6 array and a hot spare. We have seen Interesting. We're still playing with sizing

Re: [CentOS] RAID 6 - opinions

2013-04-12 Thread John R Pierce
On 4/12/2013 12:11 PM, m.r...@5-cent.us wrote: Interesting. We're still playing with sizing the RAID sets and volumes. The prime consideration for this is that the filesystem utils still have problems with 16TB (and they appear to have been saying that fixing this is a priority for at least a

[CentOS] RAID 6 - opinions

2013-04-11 Thread m . roth
I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot spare to RAID 6, implying that the latter doesn't need one. I *certainly* have enough drives to spare in this RAID box: 42 of 'em, so two questions: should I assign

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Joseph Spenner
From: m.r...@5-cent.us m.r...@5-cent.us To: CentOS mailing list centos@centos.org Sent: Thursday, April 11, 2013 8:36 AM Subject: [CentOS] RAID 6 - opinions I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John Doe
From: Joseph Spenner joseph85...@yahoo.com A RAID5 with a hot spare isn't really the same as a RAID6.  For those not familiar with this, a RAID5 in degraded mode (after it lost a disk) will suffer a performance hit, as well as while it rebuilds from a hot spare.  A RAID6 after losing a

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Digimer
On 04/11/2013 11:36 AM, m.r...@5-cent.us wrote: I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot spare to RAID 6, implying that the latter doesn't need one. I *certainly* have enough drives to spare in this RAID

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John R Pierce
On 4/11/2013 8:36 AM, m.r...@5-cent.us wrote: I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot spare to RAID 6, implying that the latter doesn't need one. I*certainly* have enough drives to spare in this RAID

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Keith Keller
On 2013-04-11, Joseph Spenner joseph85...@yahoo.com wrote: From: m.r...@5-cent.us m.r...@5-cent.us To: CentOS mailing list centos@centos.org Sent: Thursday, April 11, 2013 8:36 AM Subject: [CentOS] RAID 6 - opinions I'm setting up this huge RAID 6 box. I've always thought of hot spares

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread m . roth
John R Pierce wrote: On 4/11/2013 8:36 AM, m.r...@5-cent.us wrote: I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot spare to RAID 6, implying that the latter doesn't need one. I*certainly* have enough drives

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread m . roth
m.r...@5-cent.us wrote: snip Ok, listening to all of this, I've also been in touch with a tech from the vendor*, who had a couple of suggestions: first, two RAID sets with two global hot spares. I've just spoken with my manager, and we're going with that, then one of the tech's other

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John R Pierce
On 4/11/2013 12:30 PM, m.r...@5-cent.us wrote: Ok, listening to all of this, I've also been in touch with a tech from the vendor*, who had a couple of suggestions: first, two RAID sets with two global hot spares. I would test how long a drive rebuild takes on a 20 disk RAID6.I suspect,

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Joseph Spenner
From: John R Pierce pie...@hogranch.com To: centos@centos.org Sent: Thursday, April 11, 2013 1:24 PM Subject: Re: [CentOS] RAID 6 - opinions On 4/11/2013 12:30 PM, m.r...@5-cent.us wrote: Ok, listening to all of this, I've also been in touch with a tech

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John R Pierce
On 4/11/2013 1:36 PM, Joseph Spenner wrote: But isn't that one of the benefits of RAID6? (not much degraded/latency effect during a rebuild, less impact on performance during rebuild, so longer times are acceptable?) trouble comes in 3s. -- john r pierce

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John R Pierce
On 4/11/2013 1:20 PM, m.r...@5-cent.us wrote: Followup comment: I created the two RAID sets, then started to create the volume sets... and realized I didn't know if it was*possible*, much less desirable, to have a volume set that spanned two RAID sets. Talked it over with my manager, and I

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread David C. Miller
- Original Message - From: Joseph Spenner joseph85...@yahoo.com To: CentOS mailing list centos@centos.org Sent: Thursday, April 11, 2013 1:36:29 PM Subject: Re: [CentOS] RAID 6 - opinions From: John R Pierce pie...@hogranch.com To: centos

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread David C. Miller
- Original Message - From: Reindl Harald h.rei...@thelounge.net To: CentOS mailing list centos@centos.org Cc: David C. Miller mille...@fusion.gat.com Sent: Thursday, April 11, 2013 4:17:18 PM Subject: Re: [CentOS] RAID 6 - opinions Am 12.04.2013 01:13, schrieb David C. Miller

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Keith Keller
On 2013-04-11, David C. Miller mille...@fusion.gat.com wrote: Just for reference, I have a 24 x 2TB SATAIII using CentOS 6.4 Linux MD RAID6 with two of those 24 disks as hotspares. The drives are in a Supermicro external SAS/SATA box connected to another Supermicro 1U computer with an

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread David C. Miller
- Original Message - From: Keith Keller kkel...@wombat.san-francisco.ca.us To: centos@centos.org Sent: Thursday, April 11, 2013 4:34:20 PM Subject: Re: [CentOS] RAID 6 - opinions On 2013-04-11, David C. Miller mille...@fusion.gat.com wrote: Just for reference, I have a 24 x

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread John R Pierce
On 4/11/2013 5:04 PM, David C. Miller wrote: The LSI 9200's I use are nothing more than a dumb $300 host bus adapter. No RAID levels or special features. I prefer to NOT use hardware RAID controllers when I can. With a generic HBA the hard drives are seen raw to the OS. You can use smartctl

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Miranda Hawarden-Ogata
On 2013/04/11 10:36 AM, Joseph Spenner wrote: From: John R Pierce pie...@hogranch.com To: centos@centos.org Sent: Thursday, April 11, 2013 1:24 PM Subject: Re: [CentOS] RAID 6 - opinions On 4/11/2013 12:30 PM, m.r...@5-cent.us wrote: Ok, listening

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Keith Keller
On 2013-04-12, Miranda Hawarden-Ogata hawar...@ifa.hawaii.edu wrote: RAID6 means you can handle 2 disk failures, but the third one will drop your array, if I'm remembering correctly. And the larger the number of disks, the higher the chance that you'll have disk failures... Yes, and yes.

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread David Miller
On Apr 11, 2013, at 5:25 PM, John R Pierce pie...@hogranch.com wrote: On 4/11/2013 5:04 PM, David C. Miller wrote: The LSI 9200's I use are nothing more than a dumb $300 host bus adapter. No RAID levels or special features. I prefer to NOT use hardware RAID controllers when I can. With a

Re: [CentOS] RAID 6 - opinions

2013-04-11 Thread Adrian Sevcenco
On 04/11/2013 06:36 PM, m.r...@5-cent.us wrote: I'm setting up this huge RAID 6 box. I've always thought of hot spares, but I'm reading things that are comparing RAID 5 with a hot spare to RAID 6, implying that the latter doesn't need one. I *certainly* have enough drives to spare in this RAID