Re: RELENG_8 / mpt / zpool Errors
The SAS 2008 chip (SAS 6G) is the one that the FreeBSD mps driver has problems with when used with port expanders. It's the older SAS 3G chip that works OK with FreeBSD I think. I had crossed some wires earlier on in our discussion. We do have a SAS 2008 chip in the system already, but it's not the one that's running the external disk boxes (and we are having no problem with those drives). The external disk boxes (the ones that are having the problems) are connect through an LSI SAS 3801E, which is handled by the mpt driver. The mpt driver is what's giving us trouble right now. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 15, 2011 11:36 PM, Tim Gustafson t...@soe.ucsc.edu wrote: The SAS 2008 chip (SAS 6G) is the one that the FreeBSD mps driver has problems with when used with port expanders. It's the older SAS 3G chip that works OK with FreeBSD I think. I had crossed some wires earlier on in our discussion. We do have a SAS 2008 chip in the system already, but it's not the one that's running the external disk boxes (and we are having no problem with those drives). The external disk boxes (the ones that are having the problems) are connect through an LSI SAS 3801E, which is handled by the mpt driver. The mpt driver is what's giving us trouble right now. Can you connect an enclosure to the SAS 2008 chip card you have now and test? I thought I had read about problems like yours with that chip on FreeBSD when using such enclosures. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
Can you connect an enclosure to the SAS 2008 chip card you have now and test? I thought I had read about problems like yours with that chip on FreeBSD when using such enclosures. The SAS 2008 chip we have is built in to the motherboard; it does not have any external connectors. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
I don't know what's out there having chosen only one such card for home use. So you'll need to do your own research. Start with looking at any card with the right chip and then look for evidence that people have used said card with FreeBSD. LSI has the SAS 9200-8e, which is based on the SAS 2008 chipset, which the mps (not the mpt) driver claims to support. We are currently using another controller that uses the SAS 2008 chipset in this same box for the internal OS drives and have not had any problems with it. So, that makes me feel good. Does anyone have any recommendation for or against the 9200-8e? -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 15, 2011 12:42 AM, Tim Gustafson t...@soe.ucsc.edu wrote: I don't know what's out there having chosen only one such card for home use. So you'll need to do your own research. Start with looking at any card with the right chip and then look for evidence that people have used said card with FreeBSD. LSI has the SAS 9200-8e, which is based on the SAS 2008 chipset, which the mps (not the mpt) driver claims to support. We are currently using another controller that uses the SAS 2008 chipset in this same box for the internal OS drives and have not had any problems with it. So, that makes me feel good. Does anyone have any recommendation for or against the 9200-8e? The SAS 2008 chip (SAS 6G) is the one that the FreeBSD mps driver has problems with when used with port expanders. It's the older SAS 3G chip that works OK with FreeBSD I think. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
I'm not sure what cards you can get now with the LSI 1068E chip. As LSI branded cards cost more, I went for for the LSI SAS2008 based Supermicro AOC-USAS2-L8i as I new I wasn't going to use port expanders. It could be hard to get cards with the older chip now (you might have to get something second hand). I'm not at all wedded to that card; any card that has two external ports will do for me. The bigger requirement is that it works well with FreeBSD 8.2 and eventually 9.0. If you had your pick of any (reasonably priced) card that had two external ports and would work in my configuration, which would it be? A port expander would be required and just a few older drives in the enclosure. A developer (of which I'm not) would need console access and ability to install new kernels, reboot etc. I can probably swing that, at least for a time, in 3 or 4 weeks. We have hardware on order that I can use to test with for a short while before it goes into production. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 11, 2011 6:07 AM, Tim Gustafson t...@soe.ucsc.edu wrote: I'm not sure what cards you can get now with the LSI 1068E chip. As LSI branded cards cost more, I went for for the LSI SAS2008 based Supermicro AOC-USAS2-L8i as I knew I wasn't going to use port expanders. It could be hard to get cards with the older chip now (you might have to get something second hand). I'm not at all wedded to that card; any card that has two external ports will do for me. The bigger requirement is that it works well with FreeBSD 8.2 and eventually 9.0. If you had your pick of any (reasonably priced) card that had two external ports and would work in my configuration, which would it be? I don't know what's out there having chosen only one such card for home use. So you'll need to do your own research. Start with looking at any card with the right chip and then look for evidence that people have used said card with FreeBSD. A port expander would be required and just a few older drives in the enclosure. A developer (of which I'm not) would need console access and ability to install new kernels, reboot etc. I can probably swing that, at least for a time, in 3 or 4 weeks. We have hardware on order that I can use to test with for a short while before it goes into production. You should contact the driver maintainer and see if they're available inclined to take up your offer of hardware availability. You may also have access to some talented young students who might be interested in driver programming who could help. As a production user of FreeBSD it's always great if you can find a way to contribute back to the project in areas that help you too. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 8, 2011 12:33 AM, Tim Gustafson t...@soe.ucsc.edu wrote: Advice is: Use -STABLE and not -RELEASE Upgrade firmware Avoid port multipliers As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 second head parking and I also had to use gnop to force my ZFS pool to use 4K transfers. We're already using -STABLE; we update to RELENG_8 periodically. LSI's web site is a little bizarre when it comes to their downloads section. I searched their drivers section for my specific model number and got a bunch of firmware upgrades for other cards with different port configurations. We can't avoid port multipliers. Nobody makes a 32-port SAS/SATA controller. And anyhow, the hardware is already purchased so I need to figure out how to make it work. :) WDC's web site says that the wdidle3.exe utility you suggested is not for this drive; the site says it's only for WD1000FYPS-01ZKB0, WD7500AYPS-01ZKB0, and WD7501AYPS-01ZKB0. I'm not sure what you mean about using gnop to force 4K transfers. The mps driver has problems with the LSI SAS2008 when using port multipliers (which are in the enclosures). If you go to the previous SAS 3G version of that chip I think you'll be OK. When you say go to the previous SAS 3G version of that chip, do you mean buy an older version of that controller card? Or are you talking about downgrading, rather than upgrading, the firmware? There are newer LSI cards out there as well. Would upgrading the card help any? The LSI SAS 9205-8e seems to be a workable solution, and not too expensive. Tim, The reference to wdidle3 is specific to my situation with the home user grade WDC20EARS drive. You have server class drives but are affected by a problem with the FreeBSD driver with port multipliers. Easiest solutions to your situation are: A) Don't use FreeBSD B) Switch to hardware that works with FreeBSD (the SAS 3G version of that LSI HBA chip) Harder solutions are: A) Fix the driver ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On 9 September 2011 18:32, Matt Thyer matt.th...@gmail.com wrote: Harder solutions are: A) Fix the driver .. which is the only way FreeBSD improves, so. You choose. :) Also: A1) Post lots of debugging info to the list, be very friendly and helpful, see if any developers are willing to help you figure and fix it A2) If not, look at paying a small (say $1k) bounty to get it fixed. :) Adrian ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 9, 2011 8:38 PM, Adrian Chadd adr...@freebsd.org wrote: On 9 September 2011 18:32, Matt Thyer matt.th...@gmail.com wrote: Harder solutions are: A) Fix the driver .. which is the only way FreeBSD improves, so. You choose. :) Also: A1) Post lots of debugging info to the list, be very friendly and helpful, see if any developers are willing to help you figure and fix it A2) If not, look at paying a small (say $1k) bounty to get it fixed. :) Adrian Yes, Helping to fix the driver is a thing that Tim is in the unusual situation to be able to do as he has access to the affected hardware. However, if paid work demands a quicker solution, I'm hoping they'll fund use of the SAS 3G card (cheap) whilst allowing Tim to occasionally work with the SAS 6G card to work on a final solution! Ideally we don't want Tim to have to move away from FreeBSD. We want him to help fix the driver. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
If not, look at paying a small (say $1k) bounty to get it fixed. :) Unfortunately, our budget situation would not allow this sort of thing right now. :\ Buying hardware is a lot easier than paying for something like this. Helping to fix the driver is a thing that Tim is in the unusual situation to be able to do as he has access to the affected hardware. However, if paid work demands a quicker solution, I'm hoping they'll fund use of the SAS 3G card (cheap) whilst allowing Tim to occasionally work with the SAS 6G card to work on a final solution! I can most likely switch to a different card. Just to make sure I get the right one, do you have a part number of the card that you are recommending? As I mentioned earlier, I was looking around on the LSI site and they have lots of options, but none with a port configuration that I need (2 external ports only). I'd be happy to help with debugging the 6G problem. I could probably install that card into another box and give some developers access to it, but I'd have to rustle up some disks and port expanders to make it a fair test. Ideally we don't want Tim to have to move away from FreeBSD. We want him to help fix the driver. I've been a FreeBSD man since 2.2.5, and I won't be switching off any time soon. :) We have several other FreeBSD servers at this point - 5 to be exact, plus my workstation, and there's talk of adopting it more because of Soracle's abandonment of various projects. We're primarily using them for bulk storage - most of them are ZFS with multi-terabyte ZFS file systems - but I've got one that's a workhorse for web and other such things. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On 10 September 2011 01:19, Tim Gustafson t...@soe.ucsc.edu wrote: I can most likely switch to a different card. Just to make sure I get the right one, do you have a part number of the card that you are recommending? As I mentioned earlier, I was looking around on the LSI site and they have lots of options, but none with a port configuration that I need (2 external ports only). I'm not sure what cards you can get now with the LSI 1068E chip. As LSI branded cards cost more, I went for for the LSI SAS2008 based Supermicro AOC-USAS2-L8i as I new I wasn't going to use port expanders. It could be hard to get cards with the older chip now (you might have to get something second hand). The Supermicro AOC-USAS-L4i wouldn't be enough for you as it's only got 1 external connector. http://www.supermicro.com/products/accessories/addon/AOC-USAS-L4i_R.cfm I'd be happy to help with debugging the 6G problem. I could probably install that card into another box and give some developers access to it, but I'd have to rustle up some disks and port expanders to make it a fair test. A port expander would be required and just a few older drives in the enclosure. A developer (of which I'm not) would need console access and ability to install new kernels, reboot etc. Good luck... ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On 7 September 2011 13:54, Tim Gustafson t...@soe.ucsc.edu wrote: What are the drives exactly? You may have issues like TLER or frequent head parking. Are these SATA, SCSI or SAS and are port multipliers in use? root@bsd-03: dmesg | grep da6 da6 at mpt0 bus 0 scbus1 target 1 lun 0 da6: ATA WDC WD2003FYYS-0 1D01 Fixed Direct Access SCSI-5 device da6: 300.000MB/s transfers da6: Command Queueing enabled da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) The drives are housed in two of the following enclosures: ses0 at mpt0 bus 0 scbus1 target 32 lun 0 ses0: PROMISE 3U-SAS-16-D BP 0107 Fixed Enclosure Services SCSI-5 device ses0: 300.000MB/s transfers ses0: Command Queueing enabled ses0: SCSI-3 SES Device Each enclosure is directly connected by a dedicated cable to the 2-port controller: mps0: LSI SAS2008 port 0xfc00-0xfcff mem 0xef5f-0xef5f,0xef58-0xef5b irq 44 at device 0.0 on pci1 mps0: Firmware: 07.15.04.00 mps0: IOCCapabilities: 185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR mps0: [ITHREAD] -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafson t...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- You'll be interested in the thread PCIe SATA HBA for ZFS on -STABLE on the FreeBSD-STABLE list between 31 May 2011 and 12 June 2011. Jeremy Chadwick's post on the 1st of June is particularly enlightening. Advice is: Use -STABLE and not -RELEASE Upgrade firmware Avoid port multipliers I'm having no troubles but with 8 identical SATA disks instead of SAS. As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 second head parking and I also had to use gnop to force my ZFS pool to use 4K transfers. mps0: LSI SAS2008 port 0xee00-0xeeff mem 0xfbdfc000-0xfbdf,0xfbd8-0xfbdb irq 16 at device 0.0 on pci1 mps0: Firmware: 07.00.00.00 da0 at mps0 bus 0 scbus0 target 0 lun 0 da0: ATA WDC WD20EARS-00M AB51 Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On 7 September 2011 19:07, Matt Thyer matt.th...@gmail.com wrote: On 7 September 2011 13:54, Tim Gustafson t...@soe.ucsc.edu wrote: What are the drives exactly? You may have issues like TLER or frequent head parking. Are these SATA, SCSI or SAS and are port multipliers in use? root@bsd-03: dmesg | grep da6 da6 at mpt0 bus 0 scbus1 target 1 lun 0 da6: ATA WDC WD2003FYYS-0 1D01 Fixed Direct Access SCSI-5 device da6: 300.000MB/s transfers da6: Command Queueing enabled da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) The drives are housed in two of the following enclosures: ses0 at mpt0 bus 0 scbus1 target 32 lun 0 ses0: PROMISE 3U-SAS-16-D BP 0107 Fixed Enclosure Services SCSI-5 device ses0: 300.000MB/s transfers ses0: Command Queueing enabled ses0: SCSI-3 SES Device Each enclosure is directly connected by a dedicated cable to the 2-port controller: mps0: LSI SAS2008 port 0xfc00-0xfcff mem 0xef5f-0xef5f,0xef58-0xef5b irq 44 at device 0.0 on pci1 mps0: Firmware: 07.15.04.00 mps0: IOCCapabilities: 185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR mps0: [ITHREAD] -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafson t...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- You'll be interested in the thread PCIe SATA HBA for ZFS on -STABLE on the FreeBSD-STABLE list between 31 May 2011 and 12 June 2011. Jeremy Chadwick's post on the 1st of June is particularly enlightening. Advice is: Use -STABLE and not -RELEASE Upgrade firmware Avoid port multipliers I'm having no troubles but with 8 identical SATA disks instead of SAS. As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 second head parking and I also had to use gnop to force my ZFS pool to use 4K transfers. mps0: LSI SAS2008 port 0xee00-0xeeff mem 0xfbdfc000-0xfbdf,0xfbd8-0xfbdb irq 16 at device 0.0 on pci1 mps0: Firmware: 07.00.00.00 da0 at mps0 bus 0 scbus0 target 0 lun 0 da0: ATA WDC WD20EARS-00M AB51 Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) A bit more info... The mps driver has problems with the LSI SAS2008 when using port multipliers (which are in the enclosures). If you go to the previous SAS 3G version of that chip I think you'll be OK. Either that or run Solaris Express or fix the driver. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
Advice is: Use -STABLE and not -RELEASE Upgrade firmware Avoid port multipliers As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 second head parking and I also had to use gnop to force my ZFS pool to use 4K transfers. We're already using -STABLE; we update to RELENG_8 periodically. LSI's web site is a little bizarre when it comes to their downloads section. I searched their drivers section for my specific model number and got a bunch of firmware upgrades for other cards with different port configurations. We can't avoid port multipliers. Nobody makes a 32-port SAS/SATA controller. And anyhow, the hardware is already purchased so I need to figure out how to make it work. :) WDC's web site says that the wdidle3.exe utility you suggested is not for this drive; the site says it's only for WD1000FYPS-01ZKB0, WD7500AYPS-01ZKB0, and WD7501AYPS-01ZKB0. I'm not sure what you mean about using gnop to force 4K transfers. The mps driver has problems with the LSI SAS2008 when using port multipliers (which are in the enclosures). If you go to the previous SAS 3G version of that chip I think you'll be OK. When you say go to the previous SAS 3G version of that chip, do you mean buy an older version of that controller card? Or are you talking about downgrading, rather than upgrading, the firmware? There are newer LSI cards out there as well. Would upgrading the card help any? The LSI SAS 9205-8e seems to be a workable solution, and not too expensive. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On 9/6/2011 4:04 PM, Tim Gustafson wrote: Hi all, I'm running RELENG_8: -- ... So, is this an OS/driver issue? Is it a bad controller? Bad cables? Bad disks? As always, any help is greatly appreciated. Thanks! Likely some problem in the external box. Note that you get a 'POR' check condition- something reset out there. Possibly cables. Remotely possible firmware. Very unlikely to be an OS or driver issue. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
On Sep 7, 2011 8:53 AM, Tim Gustafson t...@soe.ucsc.edu wrote: Hi all, I'm running RELENG_8: -- root@bsd-03: uname -a FreeBSD bsd-03 8.2-STABLE FreeBSD 8.2-STABLE #0: Mon Aug 22 14:58:58 PDT 2011 root@bsd-03:/usr/obj/usr/src/sys/GENERIC amd64 -- We've got an MPT controller installed with 32 drives attached: -- root@bsd-03: dmesg | grep mpt mpt0: LSILogic SAS/SATA Adapter port 0xec00-0xecff mem 0xef3fc000-0xef3f,0xef3e-0xef3e irq 32 at device 0.0 on pci3 mpt0: [ITHREAD] mpt0: MPI Version=1.5.19.0 ses0 at mpt0 bus 0 scbus1 target 32 lun 0 ses1 at mpt0 bus 0 scbus1 target 33 lun 0 da5 at mpt0 bus 0 scbus1 target 0 lun 0 .SNIP. da36 at mpt0 bus 0 scbus1 target 31 lun 0 -- We have a zpool on those drives configured into one large zfs file system: [snip] We're seeing some occasional oddness. About every two weeks it seems the controller temporarily loses connectivity with the drives and the zpool goes a bit bonkers and reports a dozen or so corrupted files. A zpool scrub goes through and reports that everything's been fixed and everything seems OK again (although I have not 100% confirmed that there is no file corruption yet, but I'm giving ZFS's check-summing logic the benefit of the doubt here). [snip] So, is this an OS/driver issue? Is it a bad controller? Bad cables? Bad disks? As always, any help is greatly appreciated. Thanks! -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafson t...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- What are the drives exactly? You may have issues like TLER or frequent head parking. Are these SATA, SCSI or SAS and are port multipliers in use? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: RELENG_8 / mpt / zpool Errors
What are the drives exactly? You may have issues like TLER or frequent head parking. Are these SATA, SCSI or SAS and are port multipliers in use? root@bsd-03: dmesg | grep da6 da6 at mpt0 bus 0 scbus1 target 1 lun 0 da6: ATA WDC WD2003FYYS-0 1D01 Fixed Direct Access SCSI-5 device da6: 300.000MB/s transfers da6: Command Queueing enabled da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) The drives are housed in two of the following enclosures: ses0 at mpt0 bus 0 scbus1 target 32 lun 0 ses0: PROMISE 3U-SAS-16-D BP 0107 Fixed Enclosure Services SCSI-5 device ses0: 300.000MB/s transfers ses0: Command Queueing enabled ses0: SCSI-3 SES Device Each enclosure is directly connected by a dedicated cable to the 2-port controller: mps0: LSI SAS2008 port 0xfc00-0xfcff mem 0xef5f-0xef5f,0xef58-0xef5b irq 44 at device 0.0 on pci1 mps0: Firmware: 07.15.04.00 mps0: IOCCapabilities: 185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR mps0: [ITHREAD] -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
