Re: [zfs-discuss] mpt_sas multipath problem?
j...@opensolaris.org said: > Output from 'prtconf -v' would help, as would a cogent description of what > you are looking at to determine that MPxIO isn't working. Sorry James, I must've made a cut-and-paste-o and left out my description of the symptom. That being, 40 new drives show up as 80 new disk devices at the OS level (in "format", in "cfgadm -alv", in "ls /dev/dsk" and in "prtconf -Dv" listings). Adding the drives' string to a white-list in scsi_vhci.conf got us going, thanks to Richard's reminder. I do have before and after prtconf listings, if anyone is interested. Regards, Marion ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] mpt_sas multipath problem?
richard.ell...@gmail.com said: > Sometimes the mpxio detection doesn't work properly. You can try to whitelist > them, https://www.illumos.org/issues/644 And I said: > Thanks Richard, I was hoping I hadn't just made up my vague memory of such > functionality. We'll give it a try. That did the trick. I added these lines to /kernel/drv/scsi_vhci.conf, at the end of the file: scsi-vhci-failover-override = "WD WD4001FYYG-01SL3", "f_sym"; # WD RE 4TB SAS HDD A reboot was involved, as I wasn't able to coax the system into re-reading the scsi_vhci.conf file using "update_drv scsi_vhci", nor by unplugging and replugging the JBOD's SAS cables, "cfgadm -c unconfigure c49", etc. I'm off to exercise it with filebench tomorrow Thanks and regards, Marion ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] mpt_sas multipath problem?
On 8/01/13 07:20 AM, Marion Hakanson wrote: Greetings, We're trying out a new JBOD here. Multipath (mpxio) is not working, and we could use some feedback and/or troubleshooting advice. Output from 'prtconf -v' would help, as would a cogent description of what you are looking at to determine that MPxIO isn't working. James C. McPherson -- Oracle Systems / Solaris / Core http://www.jmcpdotcom.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] mpt_sas multipath problem?
> On Jan 7, 2013, at 1:20 PM, Marion Hakanson wrote: > Greetings, > We're trying out a new JBOD here. Multipath (mpxio) is not working, and we > could use some feedback and/or troubleshooting advice. > . . . richard.ell...@gmail.com said: > Sometimes the mpxio detection doesn't work properly. You can try to whitelist > them, https://www.illumos.org/issues/644 Thanks Richard, I was hoping I hadn't just made up my vague memory of such functionality. We'll give it a try. Regards, Marion ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] mpt_sas multipath problem?
On Jan 7, 2013, at 1:20 PM, Marion Hakanson wrote: > Greetings, > > We're trying out a new JBOD here. Multipath (mpxio) is not working, > and we could use some feedback and/or troubleshooting advice. Sometimes the mpxio detection doesn't work properly. You can try to whitelist them, https://www.illumos.org/issues/644 -- richard > > The OS is oi151a7, running on an existing server with a 54TB pool > of internal drives. I believe the server hardware is not relevant > to the JBOD issue, although the internal drives do appear to the > OS with multipath device names (despite the fact that these > internal drives are cabled up in a single-path configuration). If > anything, this does confirm that multipath is enabled in mpt_sas.conf > via the mpxio-disable="no" directive (internal HBA's are LSI SAS, > 2x 9201-16i and 1x 9211-8i). > > The JBOD is a SuperMicro 847E26-RJBOD1, with the front backplane > daisy-chained to the rear backplane (both expanders). Each of the two > expander chains is connected to one port of an LSI SAS 9200-8e HBA. So > far, all this hardware has appeared as working for others and well-supported, > and this 9200-8e is running the -IT firmware, version 15.0.0.0. > > The drives are 40x of the WD4001FYYG SAS 4TB variety, firmware VR02. > The spot-checks I've done so far seem to show that both device instances > of a drive show up in "prtconf -Dv" with identical serial numbers and > identical "devid" and "guid" values, so I'm not sure what might be > missing to allow mpxio to recognize them as the same device. > > Has anyone out there got this type of hardware working? In a multipath > configuration? Suggestions on mdb or dtrace code I can use to debug? > Are there "secrets" to the internal daisy-chain cabling that our vendor > is not aware of? > > Thanks and regards, > > Marion > > > ___ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- richard.ell...@richardelling.com +1-760-896-4422 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Has anyone used a Dell with a PERC H310?
On 07/01/13 21:16, Sašo Kiselkov wrote: On 01/07/2013 09:32 PM, Tim Fletcher wrote: On 07/01/13 14:01, Andrzej Sochon wrote: Hello *Sašo*! I found you here: http://mail.opensolaris.org/pipermail/zfs-discuss/2012-May/051546.html “How about reflashing LSI firmware to the card? I read on Dell's spec sheets that the card runs an LSISAS2008 chip, so chances are that standard LSI firmware will work on it. I can send you all the required bits to do the reflash, if you like.” I got Dell Perc H310 controller for do-it-yourself experiments, I tried to run it on non-Dell PC platforms like Asus P5Q and Foxconn G31MX. Without success. I will appreciate very much any hint how to get LSI firmware and reflash Dell H310. I've successfully crossflashed Dell H200 cards with this method http://forums.servethehome.com/showthread.php?467-DELL-H200-Flash-to-IT-firmware-Procedure-for-DELL-servers PERC H200 are well behaved cards that are easy to reflash and work well (even in JBOD mode) on Illumos - they are essentially a LSI SAS 9211. If you can get them, they're one heck of a reliable beast, and cheap too! The modular version of the card is often cheaper and takes 2 minutes with a torx driver to take off the black plastic L. I've bought one of these before and it worked well: http://www.ebay.co.uk/itm/170888398081 -- Tim Fletcher ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] mpt_sas multipath problem?
Greetings, We're trying out a new JBOD here. Multipath (mpxio) is not working, and we could use some feedback and/or troubleshooting advice. The OS is oi151a7, running on an existing server with a 54TB pool of internal drives. I believe the server hardware is not relevant to the JBOD issue, although the internal drives do appear to the OS with multipath device names (despite the fact that these internal drives are cabled up in a single-path configuration). If anything, this does confirm that multipath is enabled in mpt_sas.conf via the mpxio-disable="no" directive (internal HBA's are LSI SAS, 2x 9201-16i and 1x 9211-8i). The JBOD is a SuperMicro 847E26-RJBOD1, with the front backplane daisy-chained to the rear backplane (both expanders). Each of the two expander chains is connected to one port of an LSI SAS 9200-8e HBA. So far, all this hardware has appeared as working for others and well-supported, and this 9200-8e is running the -IT firmware, version 15.0.0.0. The drives are 40x of the WD4001FYYG SAS 4TB variety, firmware VR02. The spot-checks I've done so far seem to show that both device instances of a drive show up in "prtconf -Dv" with identical serial numbers and identical "devid" and "guid" values, so I'm not sure what might be missing to allow mpxio to recognize them as the same device. Has anyone out there got this type of hardware working? In a multipath configuration? Suggestions on mdb or dtrace code I can use to debug? Are there "secrets" to the internal daisy-chain cabling that our vendor is not aware of? Thanks and regards, Marion ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Has anyone used a Dell with a PERC H310?
On 01/07/2013 09:32 PM, Tim Fletcher wrote: > On 07/01/13 14:01, Andrzej Sochon wrote: >> Hello *Sašo*! >> >> I found you here: >> http://mail.opensolaris.org/pipermail/zfs-discuss/2012-May/051546.html >> >> “How about reflashing LSI firmware to the card? I read on Dell's spec >> >> sheets that the card runs an LSISAS2008 chip, so chances are that >> >> standard LSI firmware will work on it. I can send you all the required >> >> bits to do the reflash, if you like.” >> >> I got Dell Perc H310 controller for do-it-yourself experiments, I tried >> to run it on non-Dell PC platforms like Asus P5Q and Foxconn G31MX. >> Without success. >> >> I will appreciate very much any hint how to get LSI firmware and reflash >> Dell H310. > > > I've successfully crossflashed Dell H200 cards with this method > > http://forums.servethehome.com/showthread.php?467-DELL-H200-Flash-to-IT-firmware-Procedure-for-DELL-servers PERC H200 are well behaved cards that are easy to reflash and work well (even in JBOD mode) on Illumos - they are essentially a LSI SAS 9211. If you can get them, they're one heck of a reliable beast, and cheap too! -- Saso ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Has anyone used a Dell with a PERC H310?
On 07/01/13 14:01, Andrzej Sochon wrote: Hello *Sašo*! I found you here: http://mail.opensolaris.org/pipermail/zfs-discuss/2012-May/051546.html “How about reflashing LSI firmware to the card? I read on Dell's spec sheets that the card runs an LSISAS2008 chip, so chances are that standard LSI firmware will work on it. I can send you all the required bits to do the reflash, if you like.” I got Dell Perc H310 controller for do-it-yourself experiments, I tried to run it on non-Dell PC platforms like Asus P5Q and Foxconn G31MX. Without success. I will appreciate very much any hint how to get LSI firmware and reflash Dell H310. I've successfully crossflashed Dell H200 cards with this method http://forums.servethehome.com/showthread.php?467-DELL-H200-Flash-to-IT-firmware-Procedure-for-DELL-servers -- Tim Fletcher ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Has anyone used a Dell with a PERC H310?
Hello Sašo! I found you here: http://mail.opensolaris.org/pipermail/zfs-discuss/2012-May/051546.html "How about reflashing LSI firmware to the card? I read on Dell's spec sheets that the card runs an LSISAS2008 chip, so chances are that standard LSI firmware will work on it. I can send you all the required bits to do the reflash, if you like." I got Dell Perc H310 controller for do-it-yourself experiments, I tried to run it on non-Dell PC platforms like Asus P5Q and Foxconn G31MX. Without success. I will appreciate very much any hint how to get LSI firmware and reflash Dell H310. Best Regards, Andrzej Sochon ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
