Reset failure looks particularly evil. Could be a driver bug. Could be a broken hba. Or both.
Sent from my iPhone > On Nov 27, 2014, at 8:43 AM, Keith Wesolowski via smartos-discuss > <[email protected]> wrote: > >> On Thu, Nov 27, 2014 at 12:20:35PM +0100, Blake Irvin via smartos-discuss >> wrote: >> >> There hopefully is a core file on your dump device. You should see if you >> can coordinate sending that file to Joyent for analysis. The core file will >> contain some sensitive information, so don’t post it publicly. See `man >> coreadm` for more on dump devices and coredump settings in SmartOS. > > You probably want dumpadm(1m) for this, actually. That, and > savecore(1m). Crash dumps should already be enabled by the OS setup > utility; dumpadm should confirm that for you. > > As for the original problem, I'm not sure. You clearly are having a > problem between your SAS HBA and one of the targets; you can try to > decode those codes using the information in the mpt_sas header files. > As a result of that problem, the HBA's I/O controller was reset. I do > not know why or how that induced a panic; hopefully that information can > be gleaned from the crash dump. If you want to debug it yourself, run > savecore on it and then mdb <number>, where the number is the > highest-numbered crash dump present (i.e., vmcore.3 -> mdb 3). > > Also, if it's the same target every time this happens, you probably have > a bad disk or possibly a bad disk bay. Replacing that device may work > around this by avoiding the trigger for the bug (it's still a bug, > though). > >>> On Nov 27, 2014, at 12:17 PM, Len Weincier via smartos-discuss >>> <[email protected]> wrote: >>> >>> Hi >>> >>> We have a host with some decent supermicro kit that has spontaneously >>> rebooted twice in the last week under normal conditions. We see the >>> following in the logs : >>> >>> 2014-11-22T01:43:09.000Z c4a scsi: [ID 107833 kern.warning] WARNING: >>> /pci@0,0/pci8086,e08@3/pci15d9,400@0 (mpt_sas0):#012#011Disconnected >>> command timeout for target 19 w5000c50067158c6f. >>> 2014-11-22T01:43:09.000Z c4a scsi: [ID 107833 kern.notice] >>> /pci@0,0/pci8086,e08@3/pci15d9,400@0 (mpt_sas0):#012#011Timeout of 10 >>> seconds expired with 1 commands on target 19 lun 0. >>> 2014-11-22T01:43:10.000Z c4a scsi: [ID 243001 kern.warning] WARNING: >>> /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011mptsas_handle_event_sync: IOCStatus=0x8000, >>> IOCLogInfo=0x31170000 >>> 2014-11-22T01:43:13.000Z c4a scsi: [ID 107833 kern.warning] WARNING: >>> /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011mptsas_check_task_mgt: Task 0x3 failed. IOCStatus=0x4a >>> IOCLogInfo=0x0 target=19#012 >>> 2014-11-22T01:43:13.000Z c4a scsi: [ID 365881 kern.info >>> <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011Log info 0x31140000 received for target 19 >>> w5000c50067158c6f.#012#011scsi_status=0x0, ioc_status=0x8048, scsi_state=0xc >>> 2014-11-22T01:43:13.000Z c4a scsi: [ID 107833 kern.warning] WARNING: >>> /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011mptsas_ioc_task_management failed try to reset ioc to >>> recovery! >>> 2014-11-22T01:43:14.000Z c4a scsi: [ID 365881 kern.info >>> <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011MPT Firmware version v16.0.1.0 (SAS2008) >>> 2014-11-22T01:43:14.000Z c4a scsi: [ID 365881 kern.info >>> <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011mpt0 MPI Version 0x200 >>> 2014-11-22T01:43:15.000Z c4a scsi: [ID 365881 kern.info >>> <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 >>> (mpt_sas0):#012#011mpt0: IOC Operational. >>> >>> The next entry in the logs is the machine starting up. >>> >>> This happened again this morning. >>> >>> Any ideas on what might be happening ? >>> >>> Thanks >>> Len >>> >>> smartos-discuss | Archives >>> <https://www.listbox.com/member/archive/184463/=now> >>> <https://www.listbox.com/member/archive/rss/184463/26679658-d7bb2457> | >>> Modify <https://www.listbox.com/member/?&;> Your Subscription >>> <http://www.listbox.com/> >> >> >> >> ------------------------------------------- >> smartos-discuss >> Archives: https://www.listbox.com/member/archive/184463/=now >> RSS Feed: https://www.listbox.com/member/archive/rss/184463/22141660-bde6cadb >> Modify Your Subscription: https://www.listbox.com/member/?&; >> Powered by Listbox: http://www.listbox.com > > > ------------------------------------------- > smartos-discuss > Archives: https://www.listbox.com/member/archive/184463/=now > RSS Feed: https://www.listbox.com/member/archive/rss/184463/22103350-51080293 > Modify Your Subscription: https://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
