We are trying to update our border firewall with a new Sun x4100 server,
but unfortunately whenever we put load on it it rudely dies :(.
The server has four onboard Intel gigabit ethernet copper ports. We have
also installed an Intel single mode fiber adapter, and an Intel dual-port
multimode fiber adapter. Full dmesg output is included below.
I installed OpenBSD 4.0-stable using one of the onboard copper ports with
no problems. The system ran almost a week with no issues, including
rebuilding from source. We then hooked up the single mode fiber to one of
our existing firewalls to allow state to synchronize. After about 20
minutes, we switched production load onto the server via the dual-port
multimode card.
within a couple of minutes, the following appeared on the console:
NMI ... going to debugger
Stopped at cpu_switch+0xc5: nop
We rebooted the server and tried again, with the exact same error after a
couple of minutes. Just for fun, I tried booting with the single processor
kernel, with the same result.
The system is completely stock except for adding
"net.inet.ip.ifq.maxlen=250" to /etc/sysctl.conf.
When booting, "RTC BIOS diagnostic error 2" is displayed, I'm not sure if
that's relevant.
After the NMI, the system is at the ddb prompt, but the virtual console is
unresponsive and I can't type anything at it. So far I haven't been able to
get the serial console working, so I'm not sure if the unresponsiveness is
due to the USB virtual console, or if the system is just plain hung up.
Another possibly unrelated datum -- we originally tried to install a
dual-port Sysconnect card (one of the newer Marvell variants) but the box
would crashed during boot with it installed. The operating system didn't
log anything, but the system event log indicated there was a "hyper
transport sync flood error". We didn't seem to have that problem with the
Intel card.
Any thoughts? Thanks much...
----------------------------------------------------------------------
OpenBSD 4.0-stable (GENERIC.MP) #0: Wed Nov 8 18:42:47 PST 2006
[EMAIL PROTECTED]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4160262144 (4062756K)
avail mem = 3573342208 (3489592K)
using 22937 buffers containing 416235520 bytes (406480K) of memory
RTC BIOS diagnostic error 2
mainbus0 (root)
bios0 at mainbus0: SMBIOS rev. 2.3 @ 0xf90e0 (65 entries)
bios0: Sun Microsystems Sun Fire X4100 Server
ipmi0 at mainbus0: version 2.0 interface KCS iobase 0xca2/2 spacing 1
mainbus0: Intel MP Specification (Version 1.4) (SUN X4200 )
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Dual Core AMD Opteron(tm) Processor 280, 2393.50 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu0: apic clock running at 199MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Dual Core AMD Opteron(tm) Processor 280, 2393.18 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu1: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu1: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Dual Core AMD Opteron(tm) Processor 280, 2393.18 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu2: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu2: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu2: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Dual Core AMD Opteron(tm) Processor 280, 2393.18 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu3: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu3: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu3: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
mpbios: bus 0 is type PCI
mpbios: bus 1 is type PCI
mpbios: bus 2 is type PCI
mpbios: bus 3 is type PCI
mpbios: bus 4 is type PCI
mpbios: bus 5 is type PCI
mpbios: bus 6 is type PCI
mpbios: bus 7 is type ISA
ioapic0 at mainbus0 apid 4 pa 0xfec00000, version 11, 24 pins
ioapic1 at mainbus0 apid 5 pa 0xfe3ff000, version 11, 4 pins
ioapic2 at mainbus0 apid 6 pa 0xfe3fe000, version 11, 4 pins
ioapic3 at mainbus0 apid 7 pa 0xfe9ff000, version 11, 4 pins
ioapic4 at mainbus0 apid 8 pa 0xfe9fe000, version 11, 4 pins
pci0 at mainbus0 bus 0: configuration mode 1
ppb0 at pci0 dev 1 function 0 "AMD 8131 PCIX" rev 0x13
pci1 at ppb0 bus 1
em0 at pci1 dev 1 function 0 "Intel PRO/1000MT (82546EB)" rev 0x03: apic 5
int 2 (irq 10), address 00:14:4f:20:98:90
em1 at pci1 dev 1 function 1 "Intel PRO/1000MT (82546EB)" rev 0x03: apic 5
int 3 (irq 11), address 00:14:4f:20:98:91
em2 at pci1 dev 2 function 0 "Intel PRO/1000MT (82546EB)" rev 0x03: apic 5
int 0 (irq 11), address 00:14:4f:20:98:96
em3 at pci1 dev 2 function 1 "Intel PRO/1000MT (82546EB)" rev 0x03: apic 5
int 1 (irq 9), address 00:14:4f:20:98:97
aapic0 at pci0 dev 1 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
ppb1 at pci0 dev 2 function 0 "AMD 8131 PCIX" rev 0x13
pci2 at ppb1 bus 2
em4 at pci2 dev 1 function 0 "Intel PRO/1000MF (82545GM)" rev 0x04: apic 6
int 0 (irq 11), address 00:04:23:ce:03:78
mpi0 at pci2 dev 3 function 0 "Symbios Logic SAS1064" rev 0x02: apic 6 int
0 (irq 11)
scsibus0 at mpi0: 63 targets
sd0 at scsibus0 targ 0 lun 0: <LSILOGIC, Logical Volume, 3000> SCSI2
0/direct fixed
sd0: 34332MB, 34332 cyl, 16 head, 128 sec, 512 bytes/sec, 70311936 sec
total
aapic1 at pci0 dev 2 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
ppb2 at pci0 dev 6 function 0 "AMD 8111 PCI-PCI" rev 0x07
pci3 at ppb2 bus 3
ohci0 at pci3 dev 0 function 0 "AMD 8111 USB" rev 0x0b: apic 4 int 19 (irq
11), version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: AMD OHCI root hub, rev 1.00/1.00, addr 1
uhub0: 3 ports with 3 removable, self powered
ohci1 at pci3 dev 0 function 1 "AMD 8111 USB" rev 0x0b: apic 4 int 19 (irq
11), version 1.0, legacy support
usb1 at ohci1: USB revision 1.0
uhub1 at usb1
uhub1: AMD OHCI root hub, rev 1.00/1.00, addr 1
uhub1: 3 ports with 3 removable, self powered
vga1 at pci3 dev 3 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
pcib0 at pci0 dev 7 function 0 "AMD AMD8111 LPC" rev 0x05
pciide0 at pci0 dev 7 function 1 "AMD 8111 IDE" rev 0x03: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
pciide0: channel 1 ignored (disabled)
amdiic0 at pci0 dev 7 function 2 "AMD 8111 SMBus" rev 0x02: SCI
iic0 at amdiic0: disabled to avoid ipmi0 interactions
amdpm0 at pci0 dev 7 function 3 "AMD 8111 Power" rev 0x05: rng active
iic1 at amdpm0: disabled to avoid ipmi0 interactions
pchb0 at pci0 dev 24 function 0 "AMD AMD64 HyperTransport" rev 0x00
pci4 at pchb0 bus 4
ppb3 at pci4 dev 1 function 0 "AMD 8131 PCIX" rev 0x13
pci5 at ppb3 bus 5
aapic2 at pci4 dev 1 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
ppb4 at pci4 dev 2 function 0 "AMD 8131 PCIX" rev 0x13
pci6 at ppb4 bus 6
em5 at pci6 dev 1 function 0 "Intel PRO/1000MF (82546GB)" rev 0x03: apic 8
int 1 (irq 9), address 00:04:23:c2:e0:ac
em6 at pci6 dev 1 function 1 "Intel PRO/1000MF (82546GB)" rev 0x03: apic 8
int 2 (irq 10), address 00:04:23:c2:e0:ad
aapic3 at pci4 dev 2 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
pchb1 at pci0 dev 24 function 1 "AMD AMD64 Address Map" rev 0x00
pchb2 at pci0 dev 24 function 2 "AMD AMD64 DRAM Cfg" rev 0x00
pchb3 at pci0 dev 24 function 3 "AMD AMD64 Misc Cfg" rev 0x00
pchb4 at pci0 dev 25 function 0 "AMD AMD64 HyperTransport" rev 0x00
pchb5 at pci0 dev 25 function 1 "AMD AMD64 Address Map" rev 0x00
pchb6 at pci0 dev 25 function 2 "AMD AMD64 DRAM Cfg" rev 0x00
pchb7 at pci0 dev 25 function 3 "AMD AMD64 Misc Cfg" rev 0x00
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
uhidev0 at uhub0 port 3 configuration 1 interface 0umass0 at uhub1 port 1
configuration 1 interface 0
uhidev0: American Megatrends Inc. Virtual Keyboard and Mouse, rev
1.10/1.00, addr 2, iclass 3/1
umass0: American Megatrends Inc. Virtual Cdrom Device, rev 1.10/1.00, addr
2
umass0: using ATAPI over Bulk-Only
scsibus1 at umass0: 2 targets
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev1 at uhub0 port 3 configuration 1 interface 1
uhidev1: American Megatrends Inc. Virtual Keyboard and Mouse, rev
1.10/1.00, addr 2, iclass 3/1
ums0 at uhidev1
ums0: X report 0x0002 not supported
cd0 at scsibus1 targ 1 lun 0: <AMI, Virtual CDROM, 1.00> SCSI0 5/cdrom
removable
umass1 at uhub1 port 2 configuration 1 interface 0
umass1: American Megatrends Inc. Virtual Floppy Device, rev 1.10/1.00, addr
3
umass1: using UFI over CBI with CCI
scsibus2 at umass1: 2 targets
sd1 at scsibus2 targ 1 lun 0: <AMI, Virtual Floppy, 1.00> SCSI0 0/direct
removable
sd1: drive offline
dkcsum: sd0 matches BIOS drive 0x80
root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02
--
Paul B. Henson | (909) 979-6361 | http://www.csupomona.edu/~henson/
Operating Systems and Network Analyst | [EMAIL PROTECTED]
California State Polytechnic University | Pomona CA 91768
