This looks like it probably is an error that should never happen. Note that I can't see how this error could occur with existing illumos, assuming that the disk targets are managed by "sd". (I am thinking the assertion from ZFS is indicating a non-zero return from strategy(), which should not be possible under any circumstance.)
I've not checked Joyent's tree, but I'd *really* like to know if this is reproducible under stock illumos. (The backtrace you showed have line addresses that don't make sense for illumos-gate, so this is conjecture on my part.) On Fri, Jan 10, 2014 at 5:11 AM, Franz Schober <[email protected]>wrote: > Hi ! > > I am running a custom-compiled Smartos derivate (based on illumos-joyent > 122a8174b71285518bd85f331726b936b11de455 2013/12/02) > on two Supermicro Servers with X9DR7-TF+ with 6 Supermicro SAS disk shelfs > SC826BE26-R1K28LP for every system. > There is no SAS connection between the systems. > > Configuration: > > Every disk shelf is connected dual-path to one LSI 9207e HBA controller, > the shelfs are SAS-chained from top to bottom for the first HBA, from > bottom to top for the second HBA, > so every disk in every chassis is connected dual path. We use Seagate 2TB > Constellation.ES3 disks and > 2 Stec ZEUS Ram for ZIL. The systems are also exporting and importing LUNs > via FC. > > To archive disk shelf redundancy in case of one disk shelf dying > completely, > we arranged a ZFS disk pool with 9 RAIDZ2 vdevs consisting of 6 disks, > with every disk of one RAIDZ2 vdev located in a different shelf. > There are also spare disks in the shelfs. > > Test: > > To test this configuration, we switched off one disk shelf in the middle > of both SAS-chains, > the multi-path degraded for all disks, every vdev degraded, the pool > continued to work and used the spare disks in > the remaining 5 online disk shelfs. > > This worked on the first of the two identical systems, on the second > system a kernel panic occured, > the system was not able to write a dump, trace is in a screenshot. (please > see in https://www.illumos.org/issues/4454). > > On trying again the disk shelf shutdown after reboot on the second system > with the same disk shelf, > everything worked as expected. > > 2.) > The two systems are using vice versa FC exported LUNs based on ZFS ZVols. > Every system has a zpool with 2 mirrored FC devices for providing NFS > shares with synchronous storage backend, > both zpools are imported for active-active configuration. > > If the second system dies on a kernel panic as described above, the first > system only coupled > by FC Luns also happened to panic. > > Please see the attached crash dump file and screenshot in > https://www.illumos.org/issues/4455. > > Thx a lot for your suggestions. > > Regards, > Franz > > > -- > > --------------------------------------------------------------------- > Dipl.-Ing. Franz Schober > [email protected] > FirmOS Business Solutions Gmbh > Obstweg 4 > A-8073 Graz-Neupirka > Tel +43 316 242322-10 > Fax +43 316 242322-99 > http://www.firmos.at > FN 278321x, Lg für ZRS Graz UID-Nr: ATU62657119 > > Dieses eMail ist vertraulich und nur für die genannten Empfänger bestimmt. > Sollten Sie nicht der gewünschte Adressat sein, bitten wir Sie, uns > umgehend zu informieren sowie vorliegende Nachricht zu löschen ohne vorher > einen Ausdruck oder eine Kopie anzufertigen. > > This message and any attached files are confidential and intended solely > for the adressee(s). Any publication, transmission or other use of the > information by a person or entity other than the intended addressee(s) is > prohibited. If you receive this in error please contact the sender and > delete the material. The sender does not accept liability for any errors or > omissions as a result of the transmission. > > > > ------------------------------------------- > illumos-discuss > Archives: https://www.listbox.com/member/archive/182180/=now > RSS Feed: https://www.listbox.com/member/archive/rss/182180/ > 22003744-9012f59c > Modify Your Subscription: https://www.listbox.com/ > member/?& > Powered by Listbox: http://www.listbox.com > ------------------------------------------- illumos-discuss Archives: https://www.listbox.com/member/archive/182180/=now RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be Modify Your Subscription: https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4 Powered by Listbox: http://www.listbox.com
