Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-07 Thread Jeff Bacon
Subject: [zfs-discuss] Apparent SAS HBA failure-- now what? Message-ID: c8fb082c.34460%dave@alfordmedia.com Content-Type: text/plain; charset=US-ASCII First question-- is there an easy way to identify which controller is c10? Second question-- What is the best way to handle

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-07 Thread McBofh
On 8/11/10 10:21 AM, Jeff Bacon wrote: Wow, sounds familiar - binderedondat. I thought it was just when using expanders... guess it's just anything 1068-based. Lost a 20TB pool to having the controller basically just hose up what it was doing and write scragged data to the disk. 1) The

[zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Dave Pooser
My setup: A SuperMicro 24-drive chassis with Intel dual-processor motherboard, three LSI SAS3081E controllers, and 24 SATA 2TB hard drives, divided into three pools with each pool a single eight-disk RAID-Z2. (Boot is an SSD connected to motherboard SATA.) This morning I got a cheerful email from

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Khushil Dep
Can you send output of iostat -xCzn as well as fmadm faulty please? Is. This an E2 chassis? Are you using interposers? On 6 Nov 2010 18:28, Dave Pooser dave@alfordmedia.com wrote: My setup: A SuperMicro 24-drive chassis with Intel dual-processor motherboard, three LSI SAS3081E controllers,

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Dave Pooser
On 11/6/10 Nov 6, 1:35 PM, Khushil Dep khushil@gmail.com wrote: Is this an E2 chassis? Are you using interposers? No, it¹s an SC846A chassis. There are no interposers or expanders; six SFF-8087 ³iPass² cables go from ports on the HBA to ports on the backplane. Can you send output of

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Khushil Dep
Sorry u meant iostat -En I'm looking for errors On 6 Nov 2010 18:56, Dave Pooser dave@alfordmedia.com wrote: On 11/6/10 Nov 6, 1:35 PM, Khushil Dep khushil@gmail.com wrote: Is this an E2 chassis? Are you using interposers? No, it¹s an SC846A chassis. There are no interposers or

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Dave Pooser
On 11/6/10 Nov 6, 2:21 PM, Khushil Dep khushil@gmail.com wrote: Sorry I meant iostat -En I'm looking for errors # iostat -En c8d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0 Model: IMATION-MAC25-0 Revision: Serial No: 87A0079B1808000 Size: 63.89GB 63887523840 bytes

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Khushil Dep
Similar to what I've seen before, SATA disks in a 846 chassis with hardware and transport errors. Though in that occasion it was an E2 chassis with interposers. How long has this system been up? Is it production or can you offline and check all firmware on lsi controllers are up to date and match

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Dave Pooser
On 11/6/10 Nov 6, 2:35 PM, Khushil Dep khushil@gmail.com wrote: Similar to what I've seen before, SATA disks in a 846 chassis with hardware and transport errors. Though in that occasion it was an E2 chassis with interposers. How long has this system been up? Is it production or can you

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread Khushil Dep
The fmdump will let you get the serial of one disk and id the controller its on so you can swap it out and check. On 6 Nov 2010 19:45, Dave Pooser dave@alfordmedia.com wrote: On 11/6/10 Nov 6, 2:35 PM, Khushil Dep khushil@gmail.com wrote: Similar to what I've seen... It's been up for

Re: [zfs-discuss] Apparent SAS HBA failure-- now what?

2010-11-06 Thread McBofh
On 7/11/10 04:27 AM, Dave Pooser wrote: My setup: A SuperMicro 24-drive chassis with Intel dual-processor motherboard, three LSI SAS3081E controllers, and 24 SATA 2TB hard drives, divided into three pools with each pool a single eight-disk RAID-Z2. (Boot is an SSD connected to motherboard