FYI, what we are using right now is:
http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.bin
(doc at
http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.txt
and changelog at
http://download4.boulder.ibm.com/sar/CMA/XSA/lnvgy_fw_mpt3sas_n2200-1.07_linux_32-64.chg)
Compared to your version, it contains a fix I have been suspecting to be
related to your difficulties:
Fixes:
- Fixed issue where the system boot hangs when Legacy BIOS is disabled
(using HII) on certain UEFI systems. (SCGCQ00637088)
# sas3flash.x86_64 -list -c 0
LSI Corporation SAS3 Flash Utility
Version 07.00.00.00 (2014.08.14)
Copyright (C) 2008-2014 LSI Corporation. All rights reserved
Adapter Selected is a LSI SAS: SAS3008(C0)
Controller Number : 0
Controller : SAS3008(C0)
PCI Address : 00:08:00:00
SAS Address : 500605b-0-0812-5070
NVDATA Version (Default) : 07.01.00.07
NVDATA Version (Persistent) : 07.01.00.08
Firmware Product ID : 0x2221 (IT)
Firmware Version : 07.00.01.00
NVDATA Vendor : LSI
NVDATA Product ID : N2226 HBA
BIOS Version : 08.15.00.00
UEFI BSD Version : 08.00.00.00
From: Damir Krstic [mailto:[email protected]]
Sent: Thursday, August 13, 2015 5:43 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
Sure call would be great
On Thu, Aug 13, 2015 at 16:37 Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
Odd... I don't anticipate driver issue (6.6 built in should suffice). I'll
double check when I get back to office in 15 hours or so. If you have time we
can arrange a call to just look at it live...
On Aug 13, 2015 5:07 PM, Damir Krstic
<[email protected]<mailto:[email protected]>> wrote:
firmware version: MPT3BIOS*8.07.01.00 (2013.11.15)
I think in my last email I was not clear. With following disabled, system did
boot but did not see any of the LUNs:
DevicesandIOPorts.UEFI_Slot4 disable
DevicesandIOPorts.UEFI_Slot1 disable
DevicesandIOPorts.Legacy_Slot4 disable
DevicesandIOPorts.Legacy_Slot1 disable
So you are probably right about drivers but...I did little bit of searching on
the internet for the drivers I would need for these cards, and hits suggest
that I need following drivers (both are loaded according to modprobe):
modprobe --list |grep mptsas
kernel/drivers/message/fusion/mptsas.ko
[root@qstorage23 ~]# !252
modprobe --list |grep mptctl
kernel/drivers/message/fusion/mptctl.ko
Also this is what's showing in lspci of the booted system with these two HBAs:
06:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008
PCI-Express Fusion-MPT SAS-3 (rev 02)
10:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008
PCI-Express Fusion-MPT SAS-3 (rev 02)
On Thu, Aug 13, 2015 at 3:54 PM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
I meant to query the current version…
From: Damir Krstic
[mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 4:48 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
it was looping again but with what seemed more of a delay before a reboot.
model of the sas controller is LSI3008. if you need anything else, please let
me know. I really appreciate all your help.
Damir
On Thu, Aug 13, 2015 at 3:44 PM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
If the symptom changed from looping to hanging, then I'll need the adapter
model of the slot1/slot4 SAS cards to give precise guidance. Probably a good
idea to let me know that anyway.
From: Jarrod Johnson [mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 4:37 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
Does it loop failing to boot or does it hang trying to boot?
From: Damir Krstic [mailto:[email protected]]
Sent: Thursday, August 13, 2015 4:26 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
we initially disabled
DevicesandIOPorts.EnableDisableOnboardDevices_Slot1=Disabled
and
DevicesandIOPorts.EnableDisableOnboardDevices_Slot4=Disabled
With this setting system booted but did not see any LUNs.
After your email, we re-enabled aforementioned settings and disabled following:
DevicesandIOPorts.UEFI_Slot1=Disable
DevicesandIOPorts.UEFI_Slot4=Disable
DevicesandIOPorts.Legacy_Slot1=Disable
DevicesandIOPorts.Legacy_Slot4=Disable
And system now is again not booting.
Thanks,
Damir
On Thu, Aug 13, 2015 at 3:06 PM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
Did you disable the slots or just the 'Legacy' and 'UEFI' items? The 'Legacy'
and 'UEFI' items control how it can boot, but:
x1: DevicesandIOPorts.EnableDisableOnboardDevices_Slot2=Enable
If that is not 'Enable' for the slot, then the OS won't see it either.
So that should be 'Enable', and the other two things should be 'Disable' for
easiest scenario. Is this currently the situation?
From: Damir Krstic
[mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 3:59 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
that worked in terms of getting the nsd server to boot but since both sas
controllers are disabled, i can't see the LUNs. So how do I get this server to
boot AND see all the LUNs i.e. have SAS HBAs enabled?
thanks,
Damir
On Thu, Aug 13, 2015 at 2:29 PM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
So first is to get the asu utility:
https://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=LNVO-ASU
There is 'pasu' frontend in latest latest xCAT that will work with that
package. If installing that rpm, try:
pasu <nodename> show all
As an example
Failing that:
asu64 --host <immhostorip> --username USERID --password Passw0rdhere show oll
So I have a x3650 M5 here, I don't know which slots are installed where in
yours.
(edited)
# pasu x1 show all|grep Slot
x1: DevicesandIOPorts.UEFI_Slot1=Enable
x1: DevicesandIOPorts.UEFI_Slot2=Enable
x1: DevicesandIOPorts.UEFI_Slot3=Enable
x1: DevicesandIOPorts.UEFI_Slot4=Enable
x1: DevicesandIOPorts.UEFI_Slot5=Enable
x1: DevicesandIOPorts.UEFI_Slot9=Enable
x1: DevicesandIOPorts.Legacy_Slot1=Enable
x1: DevicesandIOPorts.Legacy_Slot2=Enable
x1: DevicesandIOPorts.Legacy_Slot3=Enable
x1: DevicesandIOPorts.Legacy_Slot4=Enable
x1: DevicesandIOPorts.Legacy_Slot5=Enable
x1: DevicesandIOPorts.Legacy_Slot9=Enable
So let's say that my SAS hba was in slot5:
# pasu x1 set DevicesandIOPorts.Legacy_Slot5 Disable
# pasu x1 set DevicesandIOPorts.UEFI_Slot5 Disable
Rinse and repeat per relevant HBA.
UEFI style boot is meant to simplify this scenario, but this is a way to make
things back to as simple as they were before external block devices start
mucking about.
From: Damir Krstic
[mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 2:59 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
not sure how to do that - i have listed all of the asu options on the server
and disabling non-raid sas adapters i am not sure how to do? do you have an
example of 3650m5 with sas hba cards boot manager options and settings?
thanks,
damir
On Thu, Aug 13, 2015 at 12:43 PM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
Ok, so it must have bios booted then….
How about using asu to disable the boot firmware for the non-RAID SAS adapters?
That may simplify things back down to reason.
From: Damir Krstic
[mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 12:26 PM
To: xCAT Users Mailing list
Subject: Re: [xcat-user] frustration with booting of x3650m5
Hi Jarrod,
Thanks so much for your reply. Here is the output of the command you requested:
[xCAT Genesis running on qstorage24 /]# efibootmgr -v
Fatal: Couldn't open either sysfs or procfs directories for accessing EFI
variables.
Try 'modprobe efivars' as root.
I did try modprobe efivars but it tells me that module efivars is not available.
Thanks,
Damir
On Thu, Aug 13, 2015 at 10:39 AM Jarrod Johnson
<[email protected]<mailto:[email protected]>> wrote:
I'll try to do this through email, but may break down to a direct conversation
(if you like).
If you can 'nodeset shell' and boot the system to network, I'm interested in
"efibootmgr -v" output. Usually in a UEFI style boot, you'll get an entry like:
Boot0009* Red Hat Enterprise Linux 6
HD(1,800,19000,2737e48b-741f-461b-8ab1-7c7ea9ef8706)File(\EFI\redhat\grub.efi)
If legacy booting and/or wanting the generic style options to work
straightforward way without having to contend with external LUNs confusing
things too much, the easiest thing to do would be to disable the boot support
of the uefi/option rom for the adapter. For example (adjust for your slot).
n1: DevicesandIOPorts.UEFI_Slot1=Disable
n1: DevicesandIOPorts.Legacy_Slot1=Disable
From: Damir Krstic
[mailto:[email protected]<mailto:[email protected]>]
Sent: Thursday, August 13, 2015 11:15 AM
To: xCAT Users Mailing list
Subject: [xcat-user] frustration with booting of x3650m5
I just finished installing couple of new NSD servers using RH6.6. After the
installation they would not boot from the local hard drive(s) (LSI M5210
RAID1). I went into bios and added boot option "generic" and added hard disk 0
through 4 and the servers booted fine after that.
However, after plugging in SAS cables to DCS3700 controller and zonning the
LUNs on the 3700 servers are not booting (constant boot loop). I've added and
removed generic boot option (hdd) and I've changed boot mode from UEFI to
legacy and still can't get them to boot. It's been very frustrating morning to
say the least.
Anyone else experience anything like this on 3650M5?
Thanks,
Damir
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/xcat-user
