On Thu, Nov 27, 2014 at 12:20:35PM +0100, Blake Irvin via smartos-discuss wrote:
> There hopefully is a core file on your dump device. You should see if you > can coordinate sending that file to Joyent for analysis. The core file will > contain some sensitive information, so don’t post it publicly. See `man > coreadm` for more on dump devices and coredump settings in SmartOS. You probably want dumpadm(1m) for this, actually. That, and savecore(1m). Crash dumps should already be enabled by the OS setup utility; dumpadm should confirm that for you. As for the original problem, I'm not sure. You clearly are having a problem between your SAS HBA and one of the targets; you can try to decode those codes using the information in the mpt_sas header files. As a result of that problem, the HBA's I/O controller was reset. I do not know why or how that induced a panic; hopefully that information can be gleaned from the crash dump. If you want to debug it yourself, run savecore on it and then mdb <number>, where the number is the highest-numbered crash dump present (i.e., vmcore.3 -> mdb 3). Also, if it's the same target every time this happens, you probably have a bad disk or possibly a bad disk bay. Replacing that device may work around this by avoiding the trigger for the bug (it's still a bug, though). > > On Nov 27, 2014, at 12:17 PM, Len Weincier via smartos-discuss > > <[email protected]> wrote: > > > > Hi > > > > We have a host with some decent supermicro kit that has spontaneously > > rebooted twice in the last week under normal conditions. We see the > > following in the logs : > > > > 2014-11-22T01:43:09.000Z c4a scsi: [ID 107833 kern.warning] WARNING: > > /pci@0,0/pci8086,e08@3/pci15d9,400@0 (mpt_sas0):#012#011Disconnected > > command timeout for target 19 w5000c50067158c6f. > > 2014-11-22T01:43:09.000Z c4a scsi: [ID 107833 kern.notice] > > /pci@0,0/pci8086,e08@3/pci15d9,400@0 (mpt_sas0):#012#011Timeout of 10 > > seconds expired with 1 commands on target 19 lun 0. > > 2014-11-22T01:43:10.000Z c4a scsi: [ID 243001 kern.warning] WARNING: > > /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011mptsas_handle_event_sync: IOCStatus=0x8000, > > IOCLogInfo=0x31170000 > > 2014-11-22T01:43:13.000Z c4a scsi: [ID 107833 kern.warning] WARNING: > > /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011mptsas_check_task_mgt: Task 0x3 failed. IOCStatus=0x4a > > IOCLogInfo=0x0 target=19#012 > > 2014-11-22T01:43:13.000Z c4a scsi: [ID 365881 kern.info > > <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011Log info 0x31140000 received for target 19 > > w5000c50067158c6f.#012#011scsi_status=0x0, ioc_status=0x8048, scsi_state=0xc > > 2014-11-22T01:43:13.000Z c4a scsi: [ID 107833 kern.warning] WARNING: > > /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011mptsas_ioc_task_management failed try to reset ioc to > > recovery! > > 2014-11-22T01:43:14.000Z c4a scsi: [ID 365881 kern.info > > <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011MPT Firmware version v16.0.1.0 (SAS2008) > > 2014-11-22T01:43:14.000Z c4a scsi: [ID 365881 kern.info > > <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011mpt0 MPI Version 0x200 > > 2014-11-22T01:43:15.000Z c4a scsi: [ID 365881 kern.info > > <http://kern.info/>] /pci@0,0/pci8086,e08@3/pci15d9,400@0 > > (mpt_sas0):#012#011mpt0: IOC Operational. > > > > The next entry in the logs is the machine starting up. > > > > This happened again this morning. > > > > Any ideas on what might be happening ? > > > > Thanks > > Len > > > > smartos-discuss | Archives > > <https://www.listbox.com/member/archive/184463/=now> > > <https://www.listbox.com/member/archive/rss/184463/26679658-d7bb2457> | > > Modify <https://www.listbox.com/member/?&> Your Subscription > > <http://www.listbox.com/> > > > > ------------------------------------------- > smartos-discuss > Archives: https://www.listbox.com/member/archive/184463/=now > RSS Feed: https://www.listbox.com/member/archive/rss/184463/22141660-bde6cadb > Modify Your Subscription: https://www.listbox.com/member/?& > Powered by Listbox: http://www.listbox.com ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
