Odd... I don't anticipate driver issue (6.6 built in should suffice). I'll double check when I get back to office in 15 hours or so. If you have time we can arrange a call to just look at it live...
On Aug 13, 2015 5:07 PM, Damir Krstic <[email protected]> wrote: firmware version: MPT3BIOS*8.07.01.00 (2013.11.15) I think in my last email I was not clear. With following disabled, system did boot but did not see any of the LUNs: DevicesandIOPorts.UEFI_Slot4 disable DevicesandIOPorts.UEFI_Slot1 disable DevicesandIOPorts.Legacy_Slot4 disable DevicesandIOPorts.Legacy_Slot1 disable So you are probably right about drivers but...I did little bit of searching on the internet for the drivers I would need for these cards, and hits suggest that I need following drivers (both are loaded according to modprobe): modprobe --list |grep mptsas kernel/drivers/message/fusion/mptsas.ko [root@qstorage23 ~]# !252 modprobe --list |grep mptctl kernel/drivers/message/fusion/mptctl.ko Also this is what's showing in lspci of the booted system with these two HBAs: 06:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02) 10:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02) On Thu, Aug 13, 2015 at 3:54 PM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: I meant to query the current version… From: Damir Krstic [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 4:48 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 it was looping again but with what seemed more of a delay before a reboot. model of the sas controller is LSI3008. if you need anything else, please let me know. I really appreciate all your help. Damir On Thu, Aug 13, 2015 at 3:44 PM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: If the symptom changed from looping to hanging, then I'll need the adapter model of the slot1/slot4 SAS cards to give precise guidance. Probably a good idea to let me know that anyway. From: Jarrod Johnson [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 4:37 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 Does it loop failing to boot or does it hang trying to boot? From: Damir Krstic [mailto:[email protected]] Sent: Thursday, August 13, 2015 4:26 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 we initially disabled DevicesandIOPorts.EnableDisableOnboardDevices_Slot1=Disabled and DevicesandIOPorts.EnableDisableOnboardDevices_Slot4=Disabled With this setting system booted but did not see any LUNs. After your email, we re-enabled aforementioned settings and disabled following: DevicesandIOPorts.UEFI_Slot1=Disable DevicesandIOPorts.UEFI_Slot4=Disable DevicesandIOPorts.Legacy_Slot1=Disable DevicesandIOPorts.Legacy_Slot4=Disable And system now is again not booting. Thanks, Damir On Thu, Aug 13, 2015 at 3:06 PM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: Did you disable the slots or just the 'Legacy' and 'UEFI' items? The 'Legacy' and 'UEFI' items control how it can boot, but: x1: DevicesandIOPorts.EnableDisableOnboardDevices_Slot2=Enable If that is not 'Enable' for the slot, then the OS won't see it either. So that should be 'Enable', and the other two things should be 'Disable' for easiest scenario. Is this currently the situation? From: Damir Krstic [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 3:59 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 that worked in terms of getting the nsd server to boot but since both sas controllers are disabled, i can't see the LUNs. So how do I get this server to boot AND see all the LUNs i.e. have SAS HBAs enabled? thanks, Damir On Thu, Aug 13, 2015 at 2:29 PM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: So first is to get the asu utility: https://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=LNVO-ASU There is 'pasu' frontend in latest latest xCAT that will work with that package. If installing that rpm, try: pasu <nodename> show all As an example Failing that: asu64 --host <immhostorip> --username USERID --password Passw0rdhere show oll So I have a x3650 M5 here, I don't know which slots are installed where in yours. (edited) # pasu x1 show all|grep Slot x1: DevicesandIOPorts.UEFI_Slot1=Enable x1: DevicesandIOPorts.UEFI_Slot2=Enable x1: DevicesandIOPorts.UEFI_Slot3=Enable x1: DevicesandIOPorts.UEFI_Slot4=Enable x1: DevicesandIOPorts.UEFI_Slot5=Enable x1: DevicesandIOPorts.UEFI_Slot9=Enable x1: DevicesandIOPorts.Legacy_Slot1=Enable x1: DevicesandIOPorts.Legacy_Slot2=Enable x1: DevicesandIOPorts.Legacy_Slot3=Enable x1: DevicesandIOPorts.Legacy_Slot4=Enable x1: DevicesandIOPorts.Legacy_Slot5=Enable x1: DevicesandIOPorts.Legacy_Slot9=Enable So let's say that my SAS hba was in slot5: # pasu x1 set DevicesandIOPorts.Legacy_Slot5 Disable # pasu x1 set DevicesandIOPorts.UEFI_Slot5 Disable Rinse and repeat per relevant HBA. UEFI style boot is meant to simplify this scenario, but this is a way to make things back to as simple as they were before external block devices start mucking about. From: Damir Krstic [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 2:59 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 not sure how to do that - i have listed all of the asu options on the server and disabling non-raid sas adapters i am not sure how to do? do you have an example of 3650m5 with sas hba cards boot manager options and settings? thanks, damir On Thu, Aug 13, 2015 at 12:43 PM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: Ok, so it must have bios booted then…. How about using asu to disable the boot firmware for the non-RAID SAS adapters? That may simplify things back down to reason. From: Damir Krstic [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 12:26 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] frustration with booting of x3650m5 Hi Jarrod, Thanks so much for your reply. Here is the output of the command you requested: [xCAT Genesis running on qstorage24 /]# efibootmgr -v Fatal: Couldn't open either sysfs or procfs directories for accessing EFI variables. Try 'modprobe efivars' as root. I did try modprobe efivars but it tells me that module efivars is not available. Thanks, Damir On Thu, Aug 13, 2015 at 10:39 AM Jarrod Johnson <[email protected]<mailto:[email protected]>> wrote: I'll try to do this through email, but may break down to a direct conversation (if you like). If you can 'nodeset shell' and boot the system to network, I'm interested in "efibootmgr -v" output. Usually in a UEFI style boot, you'll get an entry like: Boot0009* Red Hat Enterprise Linux 6 HD(1,800,19000,2737e48b-741f-461b-8ab1-7c7ea9ef8706)File(\EFI\redhat\grub.efi) If legacy booting and/or wanting the generic style options to work straightforward way without having to contend with external LUNs confusing things too much, the easiest thing to do would be to disable the boot support of the uefi/option rom for the adapter. For example (adjust for your slot). n1: DevicesandIOPorts.UEFI_Slot1=Disable n1: DevicesandIOPorts.Legacy_Slot1=Disable From: Damir Krstic [mailto:[email protected]<mailto:[email protected]>] Sent: Thursday, August 13, 2015 11:15 AM To: xCAT Users Mailing list Subject: [xcat-user] frustration with booting of x3650m5 I just finished installing couple of new NSD servers using RH6.6. After the installation they would not boot from the local hard drive(s) (LSI M5210 RAID1). I went into bios and added boot option "generic" and added hard disk 0 through 4 and the servers booted fine after that. However, after plugging in SAS cables to DCS3700 controller and zonning the LUNs on the 3700 servers are not booting (constant boot loop). I've added and removed generic boot option (hdd) and I've changed boot mode from UEFI to legacy and still can't get them to boot. It's been very frustrating morning to say the least. Anyone else experience anything like this on 3650M5? Thanks, Damir ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
