I'm currently trying to get a SuperMicro JBOD with dual SAS expander
chips running in MPxIO, but I'm a total amateur to this and would like
to ask about how to detect whether MPxIO is working (or not).
My SAS topology is:
*) One LSI SAS2008-equipped HBA (running the latest IT firmware from
LSI) with two external ports.
*) Two SAS cables running from the HBA to the SuperMicro JBOD, where
they enter the JBOD's rear backplane (which is equipped with two
LSI SAS expander chips).
*) From the rear backplane, via two internal SAS cables to the front
backplane (also with two SAS expanders on it)
*) The JBOD is populated with 45 2TB Toshiba SAS 7200rpm drives
The machine also has a PERC H700 for the boot media, configured into a
hardware RAID-1 (on which rpool resides).
Here is the relevant part from cfgadm -al for the MPxIO bits:
c5 scsi-sas connected configured
unknown
c5::dsk/c5t50000393D8CB4452d0 disk connected configured
unknown
c5::dsk/c5t50000393E8C90CF2d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2A6d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2AAd0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2BEd0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2C6d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2E2d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF2F2d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF5C6d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF28Ad0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF32Ed0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF35Ad0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF35Ed0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF36Ad0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF36Ed0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF52Ed0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF53Ad0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF53Ed0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF312d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF316d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF506d0 disk connected configured
unknown
c5::dsk/c5t50000393E8CAF546d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C84F5Ed0 disk connected configured
unknown
c5::dsk/c5t50000393F8C84FBAd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C851EEd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C852A6d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C852C2d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C852CAd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C852EAd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C854BAd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C854E2d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C855AAd0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8509Ad0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8520Ad0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8528Ad0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8530Ed0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8531Ed0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8557Ed0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8558Ed0 disk connected configured
unknown
c5::dsk/c5t50000393F8C8560Ad0 disk connected configured
unknown
c5::dsk/c5t50000393F8C85106d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C85222d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C85246d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C85366d0 disk connected configured
unknown
c5::dsk/c5t50000393F8C85636d0 disk connected configured
unknown
c5::es/ses0 ESI connected configured
unknown
c5::es/ses1 ESI connected configured
unknown
c5::smp/expd0 smp connected configured
unknown
c5::smp/expd1 smp connected configured
unknown
c6 scsi-sas connected configured
unknown
c6::dsk/c6t50000393D8CB4453d0 disk connected configured
unknown
c6::dsk/c6t50000393E8C90CF3d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2A7d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2ABd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2BFd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2C7d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2E3d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF2F3d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF5C7d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF28Bd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF32Fd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF35Bd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF35Fd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF36Bd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF36Fd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF52Fd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF53Bd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF53Fd0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF313d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF317d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF507d0 disk connected configured
unknown
c6::dsk/c6t50000393E8CAF547d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C84F5Fd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C84FBBd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C851EFd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C852A7d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C852C3d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C852CBd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C852EBd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C854BBd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C854E3d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C855ABd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8509Bd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8520Bd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8528Bd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8530Fd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8531Fd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8557Fd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8558Fd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C8560Bd0 disk connected configured
unknown
c6::dsk/c6t50000393F8C85107d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C85223d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C85247d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C85367d0 disk connected configured
unknown
c6::dsk/c6t50000393F8C85637d0 disk connected configured
unknown
c6::es/ses2 ESI connected configured
unknown
c6::es/ses3 ESI connected configured
unknown
c6::smp/expd2 smp connected configured
unknown
c6::smp/expd3 smp connected configured
unknown
I can see all drives in format(1M), but "mpathadm list lu" doesn't show
anything, even after I did "stmsboot -e" (and rebooted). Can anybody
please help me find out whether MPxIO is properly enabled and how I can
start using it? My understanding is that MPxIO should mask each drive
under some common name (e.g. c5t20d0) and underneath handle all of the
multipathing internally, but maybe I'm wrong and it behaves completely
differently. I'd like to create a 5x 9-drive raidz's on the JBOD, but
I'm not sure how to do it now that I can see each drive twice...
All help greatly appreciated!
Cheers,
--
Saso
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
