Hi there,
The Setup
---------
I've got a Sun X4200M2 in which there is an LSI SAS1064 RAID card providing
connection to two pairs of internal SAS disks arranged in two RAID1 arrays.
The OS is RHEL5.5 x86_64 (fully updated, running -194 kernel).
Before the second card was installed /var/log/messages showed the following
on boot:
Mar 29 17:59:37 sigma kernel: SCSI subsystem initialized
Mar 29 17:59:37 sigma kernel: Fusion MPT base driver 3.04.07rh
Mar 29 17:59:38 sigma kernel: Copyright (c) 1999-2008 LSI Corporation
Mar 29 17:59:38 sigma kernel: Fusion MPT SAS Host driver 3.04.07rh
Mar 29 17:59:38 sigma kernel: GSI 18 sharing vector 0x42 and IRQ 18
Mar 29 17:59:38 sigma kernel: ACPI: PCI Interrupt 0000:86:02.0[A] -> GSI 58
(level, low) -> IRQ 66
Mar 29 17:59:38 sigma kernel: mptbase: ioc0: Initiating bringup
Mar 29 17:59:38 sigma kernel: ioc0: LSISAS1064 A3: Capabilities={Initiator}
Mar 29 17:59:38 sigma kernel: scsi0 : ioc0: LSISAS1064 A3, FwRev=011b0000h,
Ports=1, MaxQ=478, IRQ=66
Mar 29 17:59:38 sigma kernel: Vendor: SEAGATE Model: ST914602SSUN146G Rev:
0603
Mar 29 17:59:38 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 05
Mar 29 17:59:38 sigma kernel: Vendor: SEAGATE Model: ST914602SSUN146G Rev:
0603
Mar 29 17:59:38 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 05
Mar 29 17:59:38 sigma kernel: Vendor: FUJITSU Model: MBB2147RCSUN146G Rev:
0505
Mar 29 17:59:38 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 04
Mar 29 17:59:38 sigma kernel: Vendor: FUJITSU Model: MBB2147RCSUN146G Rev:
0505
Mar 29 17:59:39 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 04
Mar 29 17:59:39 sigma kernel: Vendor: LSILOGIC Model: Logical Volume Rev:
3000
Mar 29 17:59:39 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 02
Mar 29 17:59:39 sigma kernel: SCSI device sda: 285155328 512-byte hdwr sectors
(146000 MB)
Mar 29 17:59:39 sigma kernel: sda: Write Protect is off
Mar 29 17:59:39 sigma kernel: SCSI device sda: drive cache: write through
Mar 29 17:59:39 sigma kernel: SCSI device sda: 285155328 512-byte hdwr sectors
(146000 MB)
Mar 29 17:59:39 sigma kernel: sda: Write Protect is off
Mar 29 17:59:39 sigma kernel: SCSI device sda: drive cache: write through
Mar 29 17:59:39 sigma kernel: sda: sda1 sda2
Mar 29 17:59:39 sigma kernel: sd 0:1:0:0: Attached scsi disk sda
Mar 29 17:59:39 sigma kernel: Vendor: LSILOGIC Model: Logical Volume Rev:
3000
Mar 29 17:59:39 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 02
Mar 29 17:59:39 sigma kernel: SCSI device sdb: 285155328 512-byte hdwr sectors
(146000 MB)
Mar 29 17:59:39 sigma kernel: sdb: Write Protect is off
Mar 29 17:59:39 sigma kernel: SCSI device sdb: drive cache: write through
Mar 29 17:59:39 sigma kernel: SCSI device sdb: 285155328 512-byte hdwr sectors
(146000 MB)
Mar 29 17:59:39 sigma kernel: sdb: Write Protect is off
Mar 29 17:59:39 sigma kernel: SCSI device sdb: drive cache: write through
Mar 29 17:59:39 sigma kernel: sdb: sdb1
Mar 29 17:59:39 sigma kernel: sd 0:1:2:0: Attached scsi disk sdb
[...]
An installed QLogic QLA2342 FC HBA came up as scsi1.
Using mpt-status_1.2.0-RC7 (from RPM) to monitor both RAID1 arrays we would
get
[r...@sigma ~]# mpt-status -i 0 -s
log_id 0 OPTIMAL
phys_id 1 ONLINE
phys_id 0 ONLINE
[r...@sigma ~]# mpt-status -i 2 -s
log_id 2 OPTIMAL
phys_id 3 ONLINE
phys_id 2 ONLINE
[r...@sigma ~]#
which was fine and dandy. Recently we decided to add a tape library. This
required the installation of another SAS card for which we chose an LSI
SAS1068E. This was installed and subsequently updated to (I think) the most
recent MPTBIOS and firmware.
At boot:
LSI Corporation MPT SAS BIOS
MPTBIOS-6.24.00.00 (2008.07.01)
Copyright 2000-2008 LSI Corporation.
Adapter configuration may have changed, reconfiguration is suggested!
Searching for devices at HBA 0...
SLOT ID LUN VENDOR PRODUCT REVISION SIZE \ NV
---- --- --- -------- ---------------- ---------- ---------
0 0 0 LSILOGIC Logical Volume 3000 135 GB
0 2 0 LSILOGIC Logical Volume 3000 135 GB
0 LSILogic SAS1064-IR 1.27.00.00 NV 2D:08
(I haven't been able to get rid of that configuration message, any
suggestions?)
Inside the LSI BIOS utility:
Adapter PCI PCI PCI PCI FW Revision Status Boot
Bus Dev Fnc Slot Order
SAS3440X 86 02 00 00 1.27.00.00-IR Enabled 0
SAS3801E 83 00 00 04 1.26.03.00-IT Enabled
(SAS3440X is also known as SAS1064, SAS3801E is also know as SAS1068E)
The Problem
-----------
Unfortunately after booting the server with the additional LSI card in we
get not output from mpt-status.
/var/log/messages now reports:
Apr 28 12:09:48 sigma kernel: SCSI subsystem initialized
Apr 28 12:09:48 sigma kernel: Fusion MPT base driver 3.04.13rh
Apr 28 12:09:48 sigma kernel: Copyright (c) 1999-2008 LSI Corporation
Apr 28 12:09:48 sigma kernel: Fusion MPT SAS Host driver 3.04.13rh
Apr 28 12:09:48 sigma kernel: ACPI: PCI Interrupt Link [LN2D] enabled at IRQ 43
Apr 28 12:09:48 sigma kernel: GSI 18 sharing vector 0x42 and IRQ 18
Apr 28 12:09:48 sigma kernel: ACPI: PCI Interrupt 0000:83:00.0[A] -> Link [LN2D]
-> GSI 43 (level, low) -> IRQ 66
Apr 28 12:09:48 sigma kernel: mptbase: ioc0: Initiating bringup
Apr 28 12:09:48 sigma kernel: ioc0: LSISAS1068E B3: Capabilities={Initiator}
Apr 28 12:09:49 sigma kernel: scsi0 : ioc0: LSISAS1068E B3, FwRev=011a0300h,
Ports=1, MaxQ=336, IRQ=66
Apr 28 12:09:49 sigma kernel: mptsas: ioc0: attaching ssp device: fw_channel 0,
fw_id 2, phy 0, sas_addr 0x500110a00094f8c2
Apr 28 12:09:49 sigma kernel: Vendor: HP Model: Ultrium 4-SCSI Rev:
U51W
Apr 28 12:09:49 sigma kernel: Type: Sequential-Access ANSI
SCSI revision: 05
Apr 28 12:09:49 sigma kernel: Vendor: HP Model: MSL G3 Series Rev:
D.70
Apr 28 12:09:49 sigma kernel: Type: Medium Changer ANSI
SCSI revision: 05
Apr 28 12:09:49 sigma kernel: GSI 19 sharing vector 0x4A and IRQ 19
Apr 28 12:09:49 sigma kernel: ACPI: PCI Interrupt 0000:86:02.0[A] -> GSI 58
(level, low) -> IRQ 74
Apr 28 12:09:49 sigma kernel: mptbase: ioc1: Initiating bringup
Apr 28 12:09:49 sigma kernel: ioc1: LSISAS1064 A3: Capabilities={Initiator}
Apr 28 12:09:49 sigma kernel: scsi1 : ioc1: LSISAS1064 A3, FwRev=011b0000h,
Ports=1, MaxQ=478, IRQ=74
Apr 28 12:09:50 sigma kernel: mptsas: ioc1: attaching ssp device: fw_channel 0,
fw_id 4, phy 0, sas_addr 0x5000c5000825cf01
Apr 28 12:09:50 sigma kernel: Vendor: SEAGATE Model: ST914602SSUN146G Rev:
0603
Apr 28 12:09:50 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 05
Apr 28 12:09:50 sigma kernel: mptsas: ioc1: attaching ssp device: fw_channel 0,
fw_id 1, phy 1, sas_addr 0x5000c5000825cc49
Apr 28 12:09:50 sigma kernel: Vendor: SEAGATE Model: ST914602SSUN146G Rev:
0603
Apr 28 12:09:50 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 05
Apr 28 12:09:50 sigma kernel: mptsas: ioc1: attaching ssp device: fw_channel 0,
fw_id 5, phy 2, sas_addr 0x500000e01974bcf2
Apr 28 12:09:50 sigma kernel: Vendor: FUJITSU Model: MBB2147RCSUN146G Rev:
0505
Apr 28 12:09:50 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 04
Apr 28 12:09:50 sigma kernel: mptsas: ioc1: attaching ssp device: fw_channel 0,
fw_id 3, phy 3, sas_addr 0x500000e019660ac2
Apr 28 12:09:50 sigma kernel: Vendor: FUJITSU Model: MBB2147RCSUN146G Rev:
0505
Apr 28 12:09:50 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 04
Apr 28 12:09:50 sigma kernel: mptsas: ioc1: attaching raid volume, channel 1,
id 0
Apr 28 12:09:50 sigma kernel: Vendor: LSILOGIC Model: Logical Volume Rev:
3000
Apr 28 12:09:50 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 02
Apr 28 12:09:50 sigma kernel: SCSI device sda: 285155328 512-byte hdwr sectors
(146000 MB)
Apr 28 12:09:50 sigma kernel: sda: Write Protect is off
Apr 28 12:09:50 sigma kernel: SCSI device sda: drive cache: write through
Apr 28 12:09:50 sigma kernel: SCSI device sda: 285155328 512-byte hdwr sectors
(146000 MB)
Apr 28 12:09:50 sigma kernel: sda: Write Protect is off
Apr 28 12:09:50 sigma kernel: SCSI device sda: drive cache: write through
Apr 28 12:09:50 sigma kernel: sda: sda1 sda2
Apr 28 12:09:51 sigma kernel: sd 1:1:0:0: Attached scsi disk sda
Apr 28 12:09:51 sigma kernel: mptsas: ioc1: attaching raid volume, channel 1,
id 2
Apr 28 12:09:51 sigma kernel: Vendor: LSILOGIC Model: Logical Volume Rev:
3000
Apr 28 12:09:51 sigma kernel: Type: Direct-Access ANSI
SCSI revision: 02
Apr 28 12:09:51 sigma kernel: SCSI device sdb: 285155328 512-byte hdwr sectors
(146000 MB)
Apr 28 12:09:51 sigma kernel: sdb: Write Protect is off
Apr 28 12:09:51 sigma kernel: SCSI device sdb: drive cache: write through
Apr 28 12:09:51 sigma kernel: SCSI device sdb: 285155328 512-byte hdwr sectors
(146000 MB)
Apr 28 12:09:51 sigma kernel: sdb: Write Protect is off
Apr 28 12:09:51 sigma kernel: SCSI device sdb: drive cache: write through
Apr 28 12:09:51 sigma kernel: sdb: sdb1
Apr 28 12:09:51 sigma kernel: sd 1:1:2:0: Attached scsi disk sdb
[...]
The QLogic FC HBA is now scsi2.
The above shows that the SAS1064 is now scsi1/ioc1. Running
[r...@sigma ~]# mpt-status
[r...@sigma ~]#
Shows no results but this shows up in /var/log/messages:
Apr 28 22:27:15 sigma kernel: mptbase: ioc0: LogInfo(0x30030108):
Originator={IOP}, Code={Invalid Page}, SubCode(0x0108)
Further attempts:
[r...@sigma ~]# mpt-status -u 0 -p
Checking for SCSI ID:0
Nothing found, contact the author
[r...@sigma ~]# mpt-status -u 1 -p
Checking for SCSI ID:0
Checking for SCSI ID:1
Checking for SCSI ID:2
Checking for SCSI ID:3
Checking for SCSI ID:4
Checking for SCSI ID:5
Checking for SCSI ID:6
Checking for SCSI ID:7
Checking for SCSI ID:8
Checking for SCSI ID:9
Checking for SCSI ID:10
Checking for SCSI ID:11
Checking for SCSI ID:12
Checking for SCSI ID:13
Checking for SCSI ID:14
Checking for SCSI ID:15
Nothing found, contact the author
[r...@sigma ~]# mpt-status -u 0 -i 0
[r...@sigma ~]# mpt-status -u 0 -i 2
[r...@sigma ~]# mpt-status -u 1 -i 0
You seem to have no SCSI disks attached to your HBA or you have
them on a different scsi_id. To get your SCSI id, run:
mpt-status -p
[r...@sigma ~]# mpt-status -u 1 -i 2
You seem to have no SCSI disks attached to your HBA or you have
them on a different scsi_id. To get your SCSI id, run:
mpt-status -p
[r...@sigma ~]#
show there's nothing being detected. I have no idea how to get mpt-status
to show the status of the RAID1 arrays connected to the SAS1064 again.
Further information
-------------------
Selected lspci output:
83:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express
Fusion-MPT SAS (rev 08)
85:01.0 Fibre Channel: QLogic Corp. ISP2312-based 2Gb Fibre Channel to PCI-X
HBA (rev 02)
85:01.1 Fibre Channel: QLogic Corp. ISP2312-based 2Gb Fibre Channel to PCI-X
HBA (rev 02)
86:02.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1064 PCI-X
Fusion-MPT SAS (rev 02)
MegaCli-2.00.15-1 is installed from RPM. It seems to be unable to show any
output for anything. If you have a suggested set of options to pass it,
please let me know.
I've been told that adding a pair of udev rules might help:
BUS="pci",ID="86:02.0",NAME="scsi0"
BUS="pci",ID="83:00.0",NAME="scsi1"
in a file called 90-persistent-pci.rules in /etc/udev/rules.d but I don't
know much about udev at this juncture and I'm not entirely sure it's fixing
the right problem.
Any ideas anyone can offer would be greatly appreciated.
With thanks for reading this far,
Ben
--
Unix Support, MISD, University of Cambridge, England
Plugger of wire, typer of keyboard, imparter of Clue
Life Is Short. It's All Good.
_______________________________________________
rhelv5-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/rhelv5-list
