Hi
I have a T5240 SPARC server running OpenSolaris 2009.06 (build 111b), which is
configured with LDoms, and otherwise is pretty stock. There are no services
running in the primary domain except for those activated after an installation.
This morning when I turned the machine on after having it powered off over the
weekend (it is currently used for testing, so not i production), it failed to
boot and ended up with what looks like a kernel panic, before it reboots and
the same then happens again.
I don't really know how to debug this issue, other than to enable verbose boot,
which doesn't really help me much further. So I was wondering if you have any
hints on debugging this issue, or maybe a solution?
I have attached the output from the verbose boot, so you can see what I'm
talking about.
Kind regards
Jeppe Toustrup
--
This message posted from opensolaris.org
-------------- next part --------------
Boot device: /pci at 400/pci at 0/pci at 8/scsi at 0/disk at 0,0:a File and
args: -v
module /platform/SUNW,T5240/kernel/sparcv9/unix: text at [0x1000000, 0x10d192f]
data at 0x1800000
module /platform/SUNW,T5240/kernel/sparcv9/genunix: text at [0x10d1930,
0x12b149f] data at 0x189f540
module /platform/SUNW,T5240/kernel/misc/sparcv9/platmod: text at [0x12b14a0,
0x12b14a7] data at 0x18fb190
module /platform/SUNW,T5240/kernel/cpu/sparcv9/SUNW,UltraSPARC-T2+: text at
[0x12b14c0, 0x12b71ff] data at 0x18fb880
SunOS Release 5.11 Version snv_111b 64-bit
Copyright 1983-2009 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
Ethernet address = 0:21:28:34:c3:de
mem = 4194304K (0x100000000)
avail mem = 3970211840
root nexus = T5240
pseudo0 at root
pseudo0 is /pseudo
scsi_vhci0 at root
scsi_vhci0 is /scsi_vhci
px0 at root: 0x400 0x0
px0 is /pci at 400
PCI Express-device: pci at 0, pxb_plx0
pxb_plx0 is /pci at 400/pci at 0
PCI-device: pci at 8, pxb_plx2
pxb_plx2 is /pci at 400/pci at 0/pci at 8
/pci at 400/pci at 0/pci at 8/scsi at 0 (mpt0):
initiator SCSI ID now 7
/pci at 400/pci at 0/pci at 8/scsi at 0 (mpt0):
Rev. 4 LSI, Inc. 1068E found.
/pci at 400/pci at 0/pci at 8/scsi at 0 (mpt0):
mpt0 supports power management.
/pci at 400/pci at 0/pci at 8/scsi at 0 (mpt0):
mpt0 Firmware version v1.27.0.0 (IR)
/pci at 400/pci at 0/pci at 8/scsi at 0 (mpt0):
mpt0: IOC Operational.
PCI-device: scsi at 0, mpt0
mpt0 is /pci at 400/pci at 0/pci at 8/scsi at 0
sd2 at mpt0: target 0 lun 0
sd2 is /pci at 400/pci at 0/pci at 8/scsi at 0/sd at 0,0
/pci at 400/pci at 0/pci at 8/scsi at 0/sd at 0,0 (sd2) online
root on rpool/ROOT/opensolaris fstype zfs
virtual-device: cnex0
cnex0 is /virtual-devices at 100/channel-devices at 200
channel-device: vds0
channel-device: vsw0
vsw0 is /virtual-devices at 100/channel-devices at 200/virtual-network-switch
at 0
channel-device: vsw1
vsw1 is /virtual-devices at 100/channel-devices at 200/virtual-network-switch
at 1
channel-device: vsw2
vsw2 is /virtual-devices at 100/channel-devices at 200/virtual-network-switch
at 2
pseudo-device: dld0
dld0 is /pseudo/dld at 0
PCI-device: pci at 1, pxb_plx1
pxb_plx1 is /pci at 400/pci at 0/pci at 1
PCI-device: pci at 0, px_pci0
px_pci0 is /pci at 400/pci at 0/pci at 1/pci at 0
PCI-device: usb at 0,2, ehci0
ehci0 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2
PCI-device: usb at 0, ohci0
ohci0 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0
PCI-device: usb at 0,1, ohci1
ohci1 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,1
cpu0: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu1: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu2: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu3: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu4: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu5: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu6: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
cpu7: UltraSPARC-T2+ (chipid 0, clock 1415 MHz)
PCI-device: pci at 9, pxb_plx3
pxb_plx3 is /pci at 400/pci at 0/pci at 9
USB 2.0 device (usb4b4,6560) operating at hi speed (USB 2.x) on USB 2.0 root
hub: hub at 4, hubd0 at bus address 2
hubd0 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4
/pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4 (hubd0) online
PCI-device: pci at c, pxb_plx4
pxb_plx4 is /pci at 400/pci at 0/pci at c
PCI-device: pci at d, pxb_plx5
pxb_plx5 is /pci at 400/pci at 0/pci at d
px1 at root: 0x500 0x0
px1 is /pci at 500
PCI Express-device: pci at 0, pxb_plx6
pxb_plx6 is /pci at 500/pci at 0
PCI-device: pci at 8, pxb_plx7
pxb_plx7 is /pci at 500/pci at 0/pci at 8
PCI-device: pci at 9, pxb_plx8
pxb_plx8 is /pci at 500/pci at 0/pci at 9
PCI-device: pci at c, pxb_plx9
pxb_plx9 is /pci at 500/pci at 0/pci at c
PCI-device: pci at d, pxb_plx10
pxb_plx10 is /pci at 500/pci at 0/pci at d
USB 2.0 device (usb928,0) operating at hi speed (USB 2.x) on USB 2.0 external
hub: device at 4, usb_mid1 at bus address 3
OEM Mass Storage plus ABCDEF0123456789
usb_mid1 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device
at 4
/pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at 4
(usb_mid1) online
USB 2.0 interface (usbif928,0.config1.0) operating at hi speed (USB 2.x) on USB
2.0 external hub: storage at 0, scsa2usb1 at bus address 3
OEM Mass Storage plus ABCDEF0123456789
scsa2usb1 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device
at 4/storage at 0
/pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at 4/storage
at 0 (scsa2usb1) online
USB 2.0 interface (usbif928,0.config1.1) operating at hi speed (USB 2.x) on USB
2.0 external hub: input at 1, hid1 at bus address 3
OEM Mass Storage plus ABCDEF0123456789
hid1 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at
4/input at 1
/pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at 4/input at
1 (hid1) online
sd0 at scsa2usb1: target 0 lun 0
sd0 is /pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at
4/storage at 0/disk at 0,0
/pci at 400/pci at 0/pci at 1/pci at 0/usb at 0,2/hub at 4/device at 4/storage
at 0/disk at 0,0 (sd0) online
panic[cpu4]/thread=300078b1760: recursive mutex_enter, lp=30001d00b58
owner=300078b1760 thread=300078b1760
000002a101667800 unix:mutex_vector_enter+330 (300078b1760, 300078b1760,
30001d00b58, 18fcfd0, 300078b1760, 0)
%l0-3: 0000000000000000 000000000106fed4 0000000000000304 0000000000000001
%l4-7: 000000000182b258 000000000182b250 0000000000000002 000002a101351ca0
000002a1016678b0 vsw:vsw_m_stat+8 (30001d00a80, 3e8, 2a101667a18, 30000120240,
1, 30001d00b58)
%l0-3: 00000300001201f0 000003000e92e6c0 0000030000120340 0000000000000000
%l4-7: 000000000000010c 0000000004000000 0000000000000001 0000000000000000
000002a101667960 mac:mac_stat_get+94 (30005d7b0d0, 3e8, 30008122fc0, 7be57aa4,
7beb2be0, 1964228)
%l0-3: 000003000e9d6e80 0000000000000001 00000000000003e8 0000000000000001
%l4-7: 000003000e92e6c0 0000000000000010 0000030005d7b0d0 000000000000010c
000002a101667a20 vsw:vsw_m_stat+34 (30001d00c40, 3e8, 2a101667b88, 0, 1c,
30001d00d18)
%l0-3: 0000000000000000 0000000000000001 00000300081238b4 000002a101668150
%l4-7: 0000000000000000 000003000361e470 0000030005d7b0d0 0000000000000002
000002a101667ad0 mac:mac_stat_get+94 (30005d7b7c8, 3e8, 3fe85d00000000, 0,
7beb2be0, 1964228)
%l0-3: 0000000000000710 0000000000000610 00000000000003e8 0000000040000000
%l4-7: 0000000000000610 0000070003fbf0a0 00000000000003ff 00000000007fd0ba
000002a101667b90 vsw:vsw_m_stat+34 (30001d00a80, 3e8, 2a101667cf8, 4,
3000e9284f8, 30001d00b58)
%l0-3: 00000300000f21f0 00000300000f2218 0000000000000002 0000000000000001
%l4-7: 00000300000f2240 0000000000000005 00000000000000a6 000003000e9283f8
000002a101667c40 mac:mac_stat_get+94 (30005d7b0d0, 3e8, 0, 3000e929fb8,
7beb2be0, 1964228)
%l0-3: 0000000000000001 000000245ca44dc7 00000000000003e8 000000005458d748
%l4-7: 0000000001899c00 0000000002809400 0000000000000cc9 0000000000000cc8
000002a101667d00 mac:mac_client_ifspeed+8 (3000e9d6e20, 3e8, 1, 1, 0, 0)
%l0-3: 00000300001201f0 0000030000120218 0000000000000000 0000030000120340
%l4-7: 0000030000120240 ffffffffffffffff 0000000000000000 0000000000000007
000002a101667db0 mac:mac_compute_soft_ring_count+cc (30008122fb0, 0, 8, 0,
18a6c00, 1)
%l0-3: 00000300078b1760 00000000018ac400 0000000000000304 000000000182b800
%l4-7: 0000000000000303 0000000000000002 000000000187c180 000002a101351ca0
000002a101667e60 mac:mac_flow_cpu_init+28 (30008122fb0, 30008122fc0, 1,
30000120240, 1, 0)
%l0-3: 00000300001201f0 000003000e92e6c0 0000030000120340 0000000000000000
%l4-7: 000000000000010c 0000000004000000 0000000000000001 0000000000000000
000002a101667f10 mac:mac_fanout_setup+5c (3000e9d6e20, 30008122fb0,
30008122fc0, 7be57aa4, 3000e9d6e20, 0)
%l0-3: 000003000e9d6e80 0000000000000001 0000000000000005 0000000000000001
%l4-7: 000003000e92e6c0 0000000000000010 0000030005d7b0d0 000000000000010c
000002a101667fd0 mac:mac_datapath_setup+ec (3000e9d6e20, 30008122fb0,
30005d7b0d0, 0, 1c, 2a101668148)
%l0-3: 0000000000000000 0000000000000001 00000300081238b4 000002a101668150
%l4-7: 0000000000000000 000003000361e470 0000030005d7b0d0 0000000000000002
000002a101668090 mac:i_mac_unicast_add+3c8 (3000e9d6e20, 30001d00d68, 10c,
30001d00d38, 0, 1)
%l0-3: 000000000000001a 0000030005d7b0d0 0000000000000000 0000000000000000
%l4-7: 0000000000000008 0000000000000001 0000030007292cf8 0000000000000056
000002a101668580 mac:mac_unicast_add+2c (3000e9d6e20, 30001d00d68, 30,
30001d00d38, 0, 2a1016686e4)
%l0-3: 0000000000000100 0000000000000000 0000000000000000 0000000000000000
%l4-7: 0000000000020000 0000000000000000 0000000000000000 0000030005d7b0d0
000002a101668630 vsw:vsw_set_if_hw_addr+e0 (0, 30001d00c40, 4, 30001d00c40,
30001d00d68, 30)
%l0-3: 0000000000000001 0000000000000000 000000007bebec00 0000000000000003
%l4-7: 0000000000000000 0000000000000008 000003000684c000 0000030007292d08
000002a1016686f0 vsw:vsw_mac_client_init+64 (30001d00c40, 0, 4, 30007293fb8,
30001d00d18, 0)
%l0-3: 0000000000000038 0000000000000000 0000000000000007 0000000060010247
%l4-7: 000000000000003f 000000000000000b 00000000ffffffff 000003000134ada0
000002a1016687a0 vsw:vsw_m_start+4c (30001d00c40, 0, 30001d00d70, 16, 1, 3)
%l0-3: 00000300000ce1f0 00000300000ce218 0000000000000000 00000300000ce340
%l4-7: 00000300000ce240 ffffffffffffffff 00000000ffffffff 0000030005d7b0d0
000002a101668850 mac:mac_start+20 (30005d7b7c8, 30001d00ba8, 0, 0, 1, 0)
%l0-3: 000003000523c1f0 000003000523c218 0000000000000000 000003000523c340
%l4-7: 000003000523c240 0000000000000001 0000000000000000 0000000000000000
000002a101668900 mac:i_mac_unicast_add+26c (3000e9d9078, 30001d00ba8, 30,
30001d00b78, 11, 2a101668f54)
%l0-3: 0000000000000000 0000030005d7b7c8 0000000000000000 0000000000000000
%l4-7: 0000000000000006 0000000000000000 0000030007292d10 0000000000000030
000002a101668df0 mac:mac_unicast_add+2c (3000e9d9078, 30001d00ba8, 30,
30001d00b78, 0, 2a101668f54)
%l0-3: 0000000000000100 0000000000000000 0000000000000000 0000000000000000
%l4-7: 000000000000042d 0000000000000000 0000000000000000 0000030005d7b7c8
000002a101668ea0 vsw:vsw_set_if_hw_addr+e0 (0, 30001d00a80, 4, 30001d00a80,
30001d00ba8, 30)
%l0-3: 0000000000000001 0000000000000000 000000007bebec00 0000000000000003
%l4-7: 0000000000000001 0000000000000008 00000000012536d4 0000000000000013
000002a101668f60 vsw:vsw_mac_client_init+64 (30001d00a80, 0, 4, 0, 30001d00b58,
0)
%l0-3: 00000000000003b8 00000000000001dc 0000000000000001 0000000040000000
%l4-7: 0000000000020000 0000000000002000 0000000000000041 0000000000000043
000002a101669010 vsw:vsw_m_start+4c (30001d00a80, 0, 30001d00bb0, 1, 1, 3)
%l0-3: 0000030005792c40 0000000000000001 0000000000000000 0000000000000001
%l4-7: 0000000000000000 000003000129f298 00000000012536d4 0000030005d7b7c8
000002a1016690c0 mac:mac_start+20 (30005d7b0d0, 30005cc9ccc, 2a101669218, 0, 1,
0)
%l0-3: 0000000000000000 0000000001964228 0000030005d7b0d0 00000300001a0340
%l4-7: 0000000000000000 00000000018321f8 00000000018af400 000003000e9174a0
000002a101669170 dls:dls_open+30 (30005cc7ce8, 30005cc9cc8, 3000e915e68,
30005cc7ce8, 2, 0)
%l0-3: 0000000000000001 0000000000000001 000000007be41c00 00000300012baf78
%l4-7: 0000000001950e88 0000000001950c00 0000000001950c00 0000000000000000
000002a101669220 dld:dld_str_attach+150 (3000e915e68, 1, 44, 0, 2, 0)
%l0-3: 00000300044d81f0 00000300044d8218 0000000000000000 00000300044d8340
%l4-7: 00000300044d8240 0000000001965150 0000000001965000 0000000001965000
000002a1016692f0 dld:dld_open+a4 (3000e9174a8, 2a101669630, 44, 0, 3000e915e68,
1)
%l0-3: 0000000000004000 000003000e9176d0 0000000000000000 0000000000007fff
%l4-7: ffffffffffffffff 0000000000204022 0000000000000000 0000000000000002
000002a1016693a0 genunix:qattach+11c (3000e917738, 2a101669630, 3, 30003627748,
0, 30005253180)
%l0-3: 000000007bec3620 0000000000000000 000003000e9174a8 000003000e9175a0
%l4-7: 0000000000000000 000000000000ff00 0000000000204000 0000030005487930
000002a101669460 genunix:stropen+4b8 (30007d33680, 2a101669630, 3, 30003627748,
18a7000, 300080c5390)
%l0-3: 000000000000004f 0000000000000000 000003000e917738 0000000000000001
%l4-7: 000003000e917830 0000000001909800 000000000000000b 0000000000000000
000002a101669580 specfs:spec_open+19c (2a101669898, 4, 30003627748, 0,
30007d33680, 300077ed440)
%l0-3: 0000030007d33780 0000000000000161 0000000000000003 0000030001cf0a18
%l4-7: 0000000000000044 0000000000002000 0000004400000002 00000300077ed4d8
000002a101669640 genunix:fop_open+a4 (2a101669898, 3, 30003627748, 0, 2,
30007d33780)
%l0-3: 0000030007d33780 00000000012bb010 0000030004366480 000003000526e040
%l4-7: 0000000000000000 0000000000002000 0000000000000000 0000000000000004
000002a1016696f0 genunix:vn_openat+580 (30007d33780, 0, 3, 180, 0, 0)
%l0-3: 0000000000000000 0000000000000000 0000000000000000 0000000000000001
%l4-7: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
000002a101669940 genunix:copen+3a0 (0, ffbff258, 3, ffffffffffbff26a, 0, 6)
%l0-3: 0000000000000000 0000000000000006 0000000000000012 00000300075c9840
%l4-7: 0000000000000000 000000000000245d 00000000ffd19553 00000000ffd19400
syncing file systems... done
skipping system dump - no dump device configured
rebooting...
Resetting...
