Hi Jarrod, I'll try to upgrade to this firmware level in a bit. Re. meeting today, here is 8:36 right now. I am available any time today. Any of the options with addition of hangouts will/should work for me. If screen sharing does not work, I can create an account for you and we can do terminal screen share.
Thank you so much. Damir On Fri, Aug 14, 2015 at 7:49 AM Jarrod Johnson <[email protected]> wrote: > FYI, what we are using right now is: > > > http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.bin > > (doc at > http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.txt > and changelog at > http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.chg > ) > > > > Compared to your version, it contains a fix I have been suspecting to be > related to your difficulties: > > > > Fixes: > > - Fixed issue where the system boot hangs when Legacy BIOS is disabled > > (using HII) on certain UEFI systems. (SCGCQ00637088) > > > > # sas3flash.x86_64 -list -c 0 > LSI Corporation SAS3 Flash Utility > Version 07.00.00.00 (2014.08.14) > Copyright (C) 2008-2014 LSI Corporation. All rights reserved > > Adapter Selected is a LSI SAS: SAS3008(C0) > > Controller Number : 0 > Controller : SAS3008(C0) > PCI Address : 00:08:00:00 > SAS Address : 500605b-0-0812-5070 > NVDATA Version (Default) : 07.01.00.07 > NVDATA Version (Persistent) : 07.01.00.08 > Firmware Product ID : 0x2221 (IT) > Firmware Version : 07.00.01.00 > NVDATA Vendor : LSI > NVDATA Product ID : N2226 HBA > BIOS Version : 08.15.00.00 > UEFI BSD Version : 08.00.00.00 > > > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 5:43 PM > > > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > Sure call would be great > > On Thu, Aug 13, 2015 at 16:37 Jarrod Johnson <[email protected]> wrote: > > Odd... I don't anticipate driver issue (6.6 built in should suffice). > I'll double check when I get back to office in 15 hours or so. If you have > time we can arrange a call to just look at it live... > > On Aug 13, 2015 5:07 PM, Damir Krstic <[email protected]> wrote: > > firmware version: MPT3BIOS*8.07.01.00 (2013.11.15) > > I think in my last email I was not clear. With following disabled, system > did boot but did not see any of the LUNs: > > > > DevicesandIOPorts.UEFI_Slot4 disable > > DevicesandIOPorts.UEFI_Slot1 disable > > DevicesandIOPorts.Legacy_Slot4 disable > > DevicesandIOPorts.Legacy_Slot1 disable > > So you are probably right about drivers but...I did little bit of > searching on the internet for the drivers I would need for these cards, and > hits suggest that I need following drivers (both are loaded according to > modprobe): > > modprobe --list |grep mptsas > > kernel/drivers/message/fusion/mptsas.ko > > [root@qstorage23 ~]# !252 > > modprobe --list |grep mptctl > > kernel/drivers/message/fusion/mptctl.ko > > Also this is what's showing in lspci of the booted system with these two > HBAs: > > 06:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 > PCI-Express Fusion-MPT SAS-3 (rev 02) > > 10:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 > PCI-Express Fusion-MPT SAS-3 (rev 02) > > > > On Thu, Aug 13, 2015 at 3:54 PM Jarrod Johnson <[email protected]> > wrote: > > I meant to query the current version… > > > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 4:48 PM > > > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > it was looping again but with what seemed more of a delay before a reboot. > model of the sas controller is LSI3008. if you need anything else, please > let me know. I really appreciate all your help. > > > > Damir > > > > On Thu, Aug 13, 2015 at 3:44 PM Jarrod Johnson <[email protected]> > wrote: > > If the symptom changed from looping to hanging, then I'll need the adapter > model of the slot1/slot4 SAS cards to give precise guidance. Probably a > good idea to let me know that anyway. > > > > *From:* Jarrod Johnson [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 4:37 PM > > > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > Does it loop failing to boot or does it hang trying to boot? > > > > *From:* Damir Krstic [mailto:[email protected] > <[email protected]>] > *Sent:* Thursday, August 13, 2015 4:26 PM > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > we initially disabled > > DevicesandIOPorts.EnableDisableOnboardDevices_Slot1=Disabled > > and > > DevicesandIOPorts.EnableDisableOnboardDevices_Slot4=Disabled > > With this setting system booted but did not see any LUNs. > > After your email, we re-enabled aforementioned settings and disabled > following: > > DevicesandIOPorts.UEFI_Slot1=Disable > > DevicesandIOPorts.UEFI_Slot4=Disable > > DevicesandIOPorts.Legacy_Slot1=Disable > > DevicesandIOPorts.Legacy_Slot4=Disable > > And system now is again not booting. > > Thanks, > > Damir > > > > On Thu, Aug 13, 2015 at 3:06 PM Jarrod Johnson <[email protected]> > wrote: > > Did you disable the slots or just the 'Legacy' and 'UEFI' items? The > 'Legacy' and 'UEFI' items control how it can boot, but: > > x1: DevicesandIOPorts.EnableDisableOnboardDevices_Slot2=Enable > > If that is not 'Enable' for the slot, then the OS won't see it either. > > > > So that should be 'Enable', and the other two things should be 'Disable' > for easiest scenario. Is this currently the situation? > > > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 3:59 PM > > > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > that worked in terms of getting the nsd server to boot but since both sas > controllers are disabled, i can't see the LUNs. So how do I get this server > to boot AND see all the LUNs i.e. have SAS HBAs enabled? > > > > thanks, > > Damir > > > > On Thu, Aug 13, 2015 at 2:29 PM Jarrod Johnson <[email protected]> > wrote: > > So first is to get the asu utility: > > https://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=LNVO-ASU > > > > There is 'pasu' frontend in latest latest xCAT that will work with that > package. If installing that rpm, try: > > pasu <nodename> show all > > > > As an example > > > > Failing that: > > asu64 --host <immhostorip> --username USERID --password Passw0rdhere show > oll > > > > So I have a x3650 M5 here, I don't know which slots are installed where in > yours. > > (edited) > > # pasu x1 show all|grep Slot > x1: DevicesandIOPorts.UEFI_Slot1=Enable > x1: DevicesandIOPorts.UEFI_Slot2=Enable > x1: DevicesandIOPorts.UEFI_Slot3=Enable > x1: DevicesandIOPorts.UEFI_Slot4=Enable > x1: DevicesandIOPorts.UEFI_Slot5=Enable > x1: DevicesandIOPorts.UEFI_Slot9=Enable > x1: DevicesandIOPorts.Legacy_Slot1=Enable > x1: DevicesandIOPorts.Legacy_Slot2=Enable > x1: DevicesandIOPorts.Legacy_Slot3=Enable > x1: DevicesandIOPorts.Legacy_Slot4=Enable > x1: DevicesandIOPorts.Legacy_Slot5=Enable > x1: DevicesandIOPorts.Legacy_Slot9=Enable > > > > So let's say that my SAS hba was in slot5: > > # pasu x1 set DevicesandIOPorts.Legacy_Slot5 Disable > > # pasu x1 set DevicesandIOPorts.UEFI_Slot5 Disable > > > > Rinse and repeat per relevant HBA. > > > > UEFI style boot is meant to simplify this scenario, but this is a way to > make things back to as simple as they were before external block devices > start mucking about. > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 2:59 PM > > > *To:* xCAT Users Mailing list > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > not sure how to do that - i have listed all of the asu options on the > server and disabling non-raid sas adapters i am not sure how to do? do you > have an example of 3650m5 with sas hba cards boot manager options and > settings? > > > > thanks, > > damir > > > > On Thu, Aug 13, 2015 at 12:43 PM Jarrod Johnson <[email protected]> > wrote: > > Ok, so it must have bios booted then…. > > > > How about using asu to disable the boot firmware for the non-RAID SAS > adapters? That may simplify things back down to reason. > > > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 12:26 PM > > > *To:* xCAT Users Mailing list > > *Subject:* Re: [xcat-user] frustration with booting of x3650m5 > > > > Hi Jarrod, > > > > Thanks so much for your reply. Here is the output of the command you > requested: > > > > [xCAT Genesis running on qstorage24 /]# efibootmgr -v > > Fatal: Couldn't open either sysfs or procfs directories for accessing EFI > variables. > > Try 'modprobe efivars' as root. > > > > I did try modprobe efivars but it tells me that module efivars is not > available. > > Thanks, > > Damir > > > > On Thu, Aug 13, 2015 at 10:39 AM Jarrod Johnson <[email protected]> > wrote: > > I'll try to do this through email, but may break down to a direct > conversation (if you like). > > > > If you can 'nodeset shell' and boot the system to network, I'm interested > in "efibootmgr -v" output. Usually in a UEFI style boot, you'll get an > entry like: > > Boot0009* Red Hat Enterprise Linux 6 > HD(1,800,19000,2737e48b-741f-461b-8ab1-7c7ea9ef8706)File(\EFI\redhat\grub.efi) > > > > If legacy booting and/or wanting the generic style options to work > straightforward way without having to contend with external LUNs confusing > things too much, the easiest thing to do would be to disable the boot > support of the uefi/option rom for the adapter. For example (adjust for > your slot). > > > > n1: DevicesandIOPorts.UEFI_Slot1=Disable > > n1: DevicesandIOPorts.Legacy_Slot1=Disable > > *From:* Damir Krstic [mailto:[email protected]] > *Sent:* Thursday, August 13, 2015 11:15 AM > *To:* xCAT Users Mailing list > *Subject:* [xcat-user] frustration with booting of x3650m5 > > > > I just finished installing couple of new NSD servers using RH6.6. After > the installation they would not boot from the local hard drive(s) (LSI > M5210 RAID1). I went into bios and added boot option "generic" and added > hard disk 0 through 4 and the servers booted fine after that. > > > > However, after plugging in SAS cables to DCS3700 controller and zonning > the LUNs on the 3700 servers are not booting (constant boot loop). I've > added and removed generic boot option (hdd) and I've changed boot mode from > UEFI to legacy and still can't get them to boot. It's been very frustrating > morning to say the least. > > > > Anyone else experience anything like this on 3650M5? > > > > Thanks, > > Damir > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > ------------------------------------------------------------------------------ > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user >
------------------------------------------------------------------------------
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
