Hi list,
Today one of our first Dell 1950 crashed in a strange way. I asked non
IT people to restart it that's why I dont have console traces of the
problem.
Before the server became unresponsitive, I could see this in
/var/log/messages :
May 11 04:50:55 fw1 /bsd: sd0: not queued, error 5
May 11 04:51:26 fw1 last message repeated 89 times
May 11 04:51:26 fw1 last message repeated 34 times
Googling for "sd0: not queued, error 5" I found a thread with a
similar
log. http://readlist.com/lists/openbsd.org/misc/11/56564.html
It seems the problem is not fixed for the release installed on this
firewall (4.1). It's the first time in around 1 year that I got this
problem.
During the problem, "telnet server 22" opened and closed the
connection
without displaying ssh banner. The network stack was still running
and the carp interfaces did not change to BACKUP mode.
As this firewall is used for tests it did not impact any users
(exept myself ;)) but permits to run debug commands if suggested.
I'll update the perc firmware as mentionned on the thread posted
above.
The server will be upgraded soon to 4.3 too.
Any help on how to avoid this problem is welcome.
Claer
dmeg :
OpenBSD 4.1-stable (GENERIC) #1: Fri Aug 17 23:55:00 CEST 2007
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Xeon(R) CPU 5110 @ 1.60GHz ("GenuineIntel" 686-class)
1.60 GHz
cpu0:
FPU
,V86
,DE
,PSE
,TSC
,MSR
,PAE
,MCE
,CX8
,APIC
,SEP
,MTRR
,PGE
,MCA
,CMOV
,PAT
,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-
CPL,VMX,TM2,CX16,xTPR
real mem = 1072955392 (1047808K)
avail mem = 971632640 (948860K)
using 4278 buffers containing 53772288 bytes (52512K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+ BIOS, date 03/26/07, BIOS32 rev. 0 @
0xffe90,
SMBIOS rev. 2.4 @ 0x3ffbc000 (62 entries)
bios0: Dell Inc. PowerEdge 1950
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfaa60/368 (21 entries)
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 6321ESB LPC" rev
0x00)
pcibios0: PCI bus #22 is the last bus
bios0: ROM list: 0xc0000/0x9000! 0xc9000/0x1000 0xca000/0x1800
0xcb800/0x5200 0xec000/0x4000!
acpi at mainbus0 not configured
ipmi0 at mainbus0: version 2.0 interface KCS iobase 0xca8/8 spacing 4
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel 5000X Host" rev 0x12
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE" rev 0x12
pci1 at ppb0 bus 6
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 7
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci3 at ppb2 bus 8
ppb3 at pci3 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
pci4 at ppb3 bus 9
bnx0 at pci4 dev 0 function 0 "Broadcom BCM5708" rev 0x12: irq 5
ppb4 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 10
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 11
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0x12
pci7 at ppb6 bus 1
ppb7 at pci7 dev 0 function 0 "Intel IOP333 PCIE-PCIX" rev 0x00
pci8 at ppb7 bus 2
mfi0 at pci8 dev 14 function 0 "Dell PERC 5" rev 0x00: irq 6
mfi0: logical drives 1, version 5.1.1-0040, 256MB RAM
scsibus0 at mfi0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <DELL, PERC 5/i, 1.03> SCSI3 0/direct
fixed
sd0: 69376MB, 69376 cyl, 64 head, 32 sec, 512 bytes/sec, 142082048 sec
total
ppb8 at pci7 dev 0 function 2 "Intel IOP333 PCIE-PCIX" rev 0x00
pci9 at ppb8 bus 3
ppb9 at pci0 dev 4 function 0 "Intel 5000 PCIE" rev 0x12
pci10 at ppb9 bus 12
ppb10 at pci10 dev 0 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci11 at ppb10 bus 13
ppb11 at pci11 dev 0 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci12 at ppb11 bus 14
em0 at pci12 dev 0 function 0 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 5, address 00:15:17:3e:c8:dc
em1 at pci12 dev 0 function 1 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 11, address 00:15:17:3e:c8:dd
ppb12 at pci11 dev 1 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci13 at ppb12 bus 15
em2 at pci13 dev 0 function 0 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 11, address 00:15:17:3e:c8:de
em3 at pci13 dev 0 function 1 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 6, address 00:15:17:3e:c8:df
ppb13 at pci0 dev 5 function 0 "Intel 5000 PCIE" rev 0x12
pci14 at ppb13 bus 16
ppb14 at pci0 dev 6 function 0 "Intel 5000 PCIE" rev 0x12
pci15 at ppb14 bus 17
ppb15 at pci15 dev 0 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci16 at ppb15 bus 18
ppb16 at pci16 dev 0 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci17 at ppb16 bus 19
em4 at pci17 dev 0 function 0 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 5, address 00:15:17:3e:c6:0c
em5 at pci17 dev 0 function 1 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 11, address 00:15:17:3e:c6:0d
ppb17 at pci16 dev 1 function 0 vendor "IDT", unknown product 0x8018
rev
0x04
pci18 at ppb17 bus 20
em6 at pci18 dev 0 function 0 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 11, address 00:15:17:3e:c6:0e
em7 at pci18 dev 0 function 1 "Intel PRO/1000 QP (82571EB)" rev 0x06:
irq 6, address 00:15:17:3e:c6:0f
ppb18 at pci0 dev 7 function 0 "Intel 5000 PCIE" rev 0x12
pci19 at ppb18 bus 21
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0x12
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0x12
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0x12
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0x12
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0x12
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0x12
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0x12
ppb19 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09
pci20 at ppb19 bus 4
ppb20 at pci20 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
pci21 at ppb20 bus 5
bnx1 at pci21 dev 0 function 0 "Broadcom BCM5708" rev 0x12: irq 5
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: irq 11
usb0 at uhci0: USB revision 1.0
uhub0 at usb0
uhub0: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: irq 10
usb1 at uhci1: USB revision 1.0
uhub1 at usb1
uhub1: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: irq 11
usb2 at uhci2: USB revision 1.0
uhub2 at usb2
uhub2: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: irq 11
usb3 at ehci0: USB revision 2.0
uhub3 at usb3
uhub3: Intel EHCI root hub, rev 2.00/1.00, addr 1
uhub3: 6 ports with 6 removable, self powered
ppb21 at pci0 dev 30 function 0 "Intel 82801BA AGP" rev 0xd9
pci22 at ppb21 bus 22
vga1 at pci22 dev 13 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ichpcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09: PM
disabled
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <Optiarc, DVD+-RW AD-5540A, 102C> SCSI0
5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
pciide0: channel 1 ignored (disabled)
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
biomask ffc5 netmask ffe5 ttymask ffe7
pctr: 686-class user-level performance counters enabled
mtrr: Pentium Pro MTRR support
uhub4 at uhub3 port 5
uhub4: Cypress Semiconductor USB2 Hub, rev 2.00/0.0b, addr 2
uhub4: 4 ports with 4 removable, self powered, multiple transaction
translators
uhidev0 at uhub4 port 2 configuration 1 interface 0
uhidev0: Dell Dell USB Keyboard, rev 1.10/3.01, addr 3, iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
dkcsum: sd0 matches BIOS drive 0x80
root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02
WARNING: / was not properly unmounted
bnx1: address 00:19:b9:eb:d7:64
brgphy0 at bnx1 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
bnx0: address 00:19:b9:eb:d7:66
brgphy1 at bnx0 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
carp: carp2 demoted group carp to 129
carp: carp3 demoted group carp to 130
carp: carp2 demoted group carp to 129
carp: carp3 demoted group carp to 128
em1: watchdog timeout -- resetting
em2: watchdog timeout -- resetting
em3: watchdog timeout -- resetting
uhidev0: at uhub4 port 2 (addr 3) disconnected
wskbd1: disconnecting from wsdisplay0
wskbd1 detached
ukbd0 detached
uhidev0 detached
