See the soluion at https://www.illumos.org/issues/644 -- richard
On May 25, 2012, at 10:07 AM, Sašo Kiselkov wrote: > I'm currently trying to get a SuperMicro JBOD with dual SAS expander > chips running in MPxIO, but I'm a total amateur to this and would like > to ask about how to detect whether MPxIO is working (or not). > > My SAS topology is: > > *) One LSI SAS2008-equipped HBA (running the latest IT firmware from > LSI) with two external ports. > *) Two SAS cables running from the HBA to the SuperMicro JBOD, where > they enter the JBOD's rear backplane (which is equipped with two > LSI SAS expander chips). > *) From the rear backplane, via two internal SAS cables to the front > backplane (also with two SAS expanders on it) > *) The JBOD is populated with 45 2TB Toshiba SAS 7200rpm drives > > The machine also has a PERC H700 for the boot media, configured into a > hardware RAID-1 (on which rpool resides). > > Here is the relevant part from cfgadm -al for the MPxIO bits: > > c5 scsi-sas connected configured > unknown > c5::dsk/c5t50000393D8CB4452d0 disk connected configured > unknown > c5::dsk/c5t50000393E8C90CF2d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2A6d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2AAd0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2BEd0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2C6d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2E2d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF2F2d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF5C6d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF28Ad0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF32Ed0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF35Ad0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF35Ed0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF36Ad0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF36Ed0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF52Ed0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF53Ad0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF53Ed0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF312d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF316d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF506d0 disk connected configured > unknown > c5::dsk/c5t50000393E8CAF546d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C84F5Ed0 disk connected configured > unknown > c5::dsk/c5t50000393F8C84FBAd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C851EEd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C852A6d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C852C2d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C852CAd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C852EAd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C854BAd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C854E2d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C855AAd0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8509Ad0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8520Ad0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8528Ad0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8530Ed0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8531Ed0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8557Ed0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8558Ed0 disk connected configured > unknown > c5::dsk/c5t50000393F8C8560Ad0 disk connected configured > unknown > c5::dsk/c5t50000393F8C85106d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C85222d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C85246d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C85366d0 disk connected configured > unknown > c5::dsk/c5t50000393F8C85636d0 disk connected configured > unknown > c5::es/ses0 ESI connected configured > unknown > c5::es/ses1 ESI connected configured > unknown > c5::smp/expd0 smp connected configured > unknown > c5::smp/expd1 smp connected configured > unknown > c6 scsi-sas connected configured > unknown > c6::dsk/c6t50000393D8CB4453d0 disk connected configured > unknown > c6::dsk/c6t50000393E8C90CF3d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2A7d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2ABd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2BFd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2C7d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2E3d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF2F3d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF5C7d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF28Bd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF32Fd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF35Bd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF35Fd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF36Bd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF36Fd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF52Fd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF53Bd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF53Fd0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF313d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF317d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF507d0 disk connected configured > unknown > c6::dsk/c6t50000393E8CAF547d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C84F5Fd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C84FBBd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C851EFd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C852A7d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C852C3d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C852CBd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C852EBd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C854BBd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C854E3d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C855ABd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8509Bd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8520Bd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8528Bd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8530Fd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8531Fd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8557Fd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8558Fd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C8560Bd0 disk connected configured > unknown > c6::dsk/c6t50000393F8C85107d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C85223d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C85247d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C85367d0 disk connected configured > unknown > c6::dsk/c6t50000393F8C85637d0 disk connected configured > unknown > c6::es/ses2 ESI connected configured > unknown > c6::es/ses3 ESI connected configured > unknown > c6::smp/expd2 smp connected configured > unknown > c6::smp/expd3 smp connected configured > unknown > > I can see all drives in format(1M), but "mpathadm list lu" doesn't show > anything, even after I did "stmsboot -e" (and rebooted). Can anybody > please help me find out whether MPxIO is properly enabled and how I can > start using it? My understanding is that MPxIO should mask each drive > under some common name (e.g. c5t20d0) and underneath handle all of the > multipathing internally, but maybe I'm wrong and it behaves completely > differently. I'd like to create a 5x 9-drive raidz's on the JBOD, but > I'm not sure how to do it now that I can see each drive twice... > > All help greatly appreciated! > > Cheers, > -- > Saso > _______________________________________________ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- ZFS Performance and Training richard.ell...@richardelling.com +1-760-896-4422
_______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
