I thought to include the Sun response to this case, in case anyone else
a similar issue:
>>> >>>The issue is caused by a third party module. Contact the vendor who
>>> >>>supports ipfilter and pfil for an updated module.
core file: /cores/dir3/65341698/vmcore.2
user: Cores User (cores:911)
release: 5.9 (64-bit)
version: Generic_118558-39
machine: sun4u
node name: fox
hw_provider: Sun_Microsystems
system type: SUNW,Sun-Fire-V890 (UltraSPARC-IV)
hostid: 83b034a3
dump_conflags: 0x10000 (DUMP_KERNEL) on /dev/dsk/c1t0d0s3(16G)
time of crash: Thu Feb 8 08:00:17 MST 2007
age of system: 15 hours 13 minutes 56.23 seconds
panic CPU: 17 (8 CPUs, 16G memory)
panic string: sync initiated (OBP breakpoint)
sanity checks: settings...
NOTE: /etc/system: noexec_user_stack set to 0x1 3 times
NOTE: /etc/system: noexec_user_stack_log set to 0x1 3 times
NOTE: /etc/system: nfssrv:nfs_portmon set to 0x1 3 times
vmem...CPU...
WARNING: CPU3 has cpu_intr_actv for PIL 6
WARNING: CPU17 has cpu_intr_actv for PIL 10
sysent...
WARNING: unknown module afs seen 6 times in sysent table
clock...
WARNING: SUNW,UltraSPARC-IV:cheetah_nudge_buddy+0x0 omni[CPU3] cyclic
pend: 70821 (13h52m11.121129984s)
misc...
WARNING: 3 severe kstat errors (run "kstat xck")
WARNING: 269 expired realtime (max -13h52m11.22s) callouts
WARNING: 8 pending softcalls (softlevel1 queued on CPU3)
done
SolarisCAT(vmcore.2/9U)> thread summary
reference clock = panic_lbolt: 0x53ac67, panic_hrtime:
0x31ed0a91435c
16 threads ran since 1 second before current tick (0 user, 16
kernel)
38 threads ran since 1 minute before current tick (4 user, 34
kernel)
2 TS_RUN threads (0 user, 2 kernel)
1 TS_STOPPED threads (0 user, 1 kernel)
78 TS_FREE threads (0 user, 78 kernel)
0 !TS_LOAD (swapped) threads
0 threads trying to get a mutex
2* threads trying to get an rwlock (0 user, 2 kernel)
longest sleeping 13 hours 52 minutes 15.41 seconds earlier
506 threads waiting for a condition variable (314 user, 192 kernel)
1 threads sleeping on a semaphore (0 user, 1 kernel)
longest sleeping 12.29 seconds earlier
261 threads sleeping on a user-level sobj (261 user, 0 kernel)
15 threads sleeping on a shuttle (door) (15 user, 0 kernel)
0 threads in biowait()
1* threads in entersq() (0 user, 1 kernel)
2 threads in dispatch queues (0 user, 2 kernel)
1* threads in dispq of CPU running idle thread (0 user, 1 kernel)
2* interrupt threads running (0 user, 2 kernel)
1* interrupt threads active but sleeping (0 user, 1 kernel)
1* threads with > 90% CPU (1 user, 0 kernel)
883 total threads in allthreads list (590 user, 293 kernel)
9 thread_reapcnt
0 lwp_reapcnt
892 nthread
SolarisCAT(vmcore.2/9U)> cpu
CPU thread pri PID cmd
3 @ 0x1400000 0x2a10001fd40 -1 (idle)
0 @ 0x300060d0000 0x2a100013d40 -1 (idle)
1 @ 0x300060ac000 0x2a10000bd40 -1 (idle)
2 @ 0x300060a2000 0x2a100003d40 -1 (idle)
16 @ 0x3000611c000 0x2a1004fbd40 -1 (idle)
17 @ 0x30006114000 P 0x2a10058bd40 P 169 0 sched (PIL10
interrupt)
18 @ 0x3000610e000 0x2a1004ebd40 -1 (idle)
19 @ 0x30006108000 0x2a1004e3d40 -1 (idle)
WARNING: CPU3 has cpu_intr_actv for PIL 6
WARNING: CPU17 has cpu_intr_actv for PIL 10
sysent...
WARNING: unknown module afs seen 6 times in sysent table
clock...
WARNING: SUNW,UltraSPARC-IV:cheetah_nudge_buddy+0x0 omni[CPU3] cyclic
pend: 70821 (13h52m11.121129984s)
CPU 17
intr addr PIL pend handler
============= === ==== =======
0x30006114418 1 1 unix:cbe_level1(0)
0x30006114448 4 0
pcisch:pci_intr_wrapper(qlc:qlc_intr(0x300002837a8))
0x30006114428 6 0
pcisch:pci_intr_wrapper(eri:eri_intr(*eri(data):eriup))
>>> >>>This shows eri is at PIL 6.
SUNW,eri0 : 100 Mbps full duplex link up
pseudo-device: devinfo0
devinfo0 is /pseudo/[EMAIL PROTECTED]
dump on /dev/dsk/c1t0d0s3 size 16386 MB
IP Filter: v4.1.13, running.
WARNING: /[EMAIL PROTECTED],700000/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd0):
transport rejected bad packet
Starting AFS cache scan...found 13 non-empty cache files (0%).
pseudo-device: vol0
vol0 is /pseudo/[EMAIL PROTECTED]
panic[cpu17]/thread=2a10058bd40: sync initiated
SolarisCAT(vmcore.2/9U)> callout
callout ID time offset function(arg)
============= ================== =============== =============
0x300063ea5a0 0xbfffffffffffff8b -15h13m20.20s X
pfil:qif_callback(0x0)
0x30006c17460 0xbffffffffff38e9c -13h52m11.22s X ipf:fr_slowtimer(0x0)
SolarisCAT(vmcore.2/9U)> modinfo pfil
ID flags modctl textaddr size cnt name
124 LI 0x300060da420 0x7857c000 0x8312 1 pfil (pfil Streams
module 2.1.9)
SolarisCAT(vmcore.2/9U)> modinfo ipf
ID flags modctl textaddr size cnt name
146 LIN 0x30014be3c48 0x785ae000 0x478b2 1 ipf (IP Filter:
v4.1.13)
SolarisCAT(vmcore.2/9U)> tlist findcall eri_intr
==== interrupt thread: 0x2a10007dd40 PID: 0 bound to CPU: 3 PIL: 6
====
cmd: sched
t_wchan: 0x785fa5e0 sobj: reader/writer lock owner: (reader locked)
t_procp: 0x1438788(proc_sched)
p_as: 0x1438670(kas)
t_stk: 0x2a10007db50 sp: 0x2a10007b4f1 t_stkbase: 0x2a10007a000
t_pri: 165(SYS) pctcpu: 0.000000
t_lwp: 0x0psrset: 0 last CPU: 3
idle: 4993541 ticks (13 hours 52 minutes 15.41 seconds)
start: Wed Dec 31 17:00:01 1969
age: 1170946816 seconds (13552 days 15 hours 16 seconds)
tstate: TS_SLEEP - awaiting an event
tflg: T_INTR_THREAD - thread is an interrupt thread
T_TALLOCSTK - thread structure allocated from stk
tpflg: none set
tsched: TS_LOAD - thread is in memory
TS_DONT_SWAP - thread/LWP should not be swapped
TS_SIGNALLED - thread was awakened by cv_signal()
pflag: SSYS - system resident process
SLOAD - in core
SLOCK - process cannot be swapped
pc: 0x113fdf0 genunix:turnstile_block+0x5ec: call
unix:swtch
startpc: 0x113e720 genunix:thread_create_intr+0x0: save %sp,
-0xc0, %sp
genunix:turnstile_block+0x5ec(0x300212f4a80, 0x1, 0x785fa5e0, 0x140ea38,
0x0)
unix:rw_enter_sleep+0x128(, 0x1, 0x20, 0x5, 0xb, 0x13)
unix:rw_enter(0x785fa5e0, 0x1) - frame recycled
ipf:fr_check+0x90(0x30018cc3238, 0x14, 0x30006c15ed8, 0x1,
0x2a10007c198, 0x2a10007c458)
pfil:pfil_precheck+0xeb0(0x3000654cdd8, 0x2a10007c458, 0x2,
0x30006c15ed8, 0x1e03c5d2, 0x0)
pfil:pfilmodwput+0x288(0x3000654cdd8, 0x30033bb4140, 0x20, 0x8000000,
0x800, 0xbab034a30800)
unix:putnext+0x21c(0x3000654cb48?, 0x30033bb4140, , 0x0, 0x8, 0x8)
ip:ip_wput_ire+0x1470(0x3000654cb48, 0x300245f7d00, 0x30006c1bcc8, 0x0,
0x0)
ip:ip_wput+0x1050(0x3000654cb48?, 0x300245f7d00)
unix:putnext+0x21c(0x30006c13070, 0x300245f7d00, , 0x4, 0x28, 0x0)
arp:ar_query_reply+0x160(0x300055f33a0, 0x0, 0x30022d149f0, 0x4,
0x300055feb89, 0x5)
arp:ar_entry_query+0x168(0x30006c12f80?, 0x30036066c40?, , 0x0, 0x8,
0x8)
arp:ar_cmd_dispatch(, 0x30036066c40) - frame recycled
arp:ar_rput+0x148(0x30006c12f80?, 0x30036066c40)
unix:putnext+0x21c(0x3000654ca58, 0x30036066c40, , 0x30022d149b8, 0x0,
0x0)
pfil:pfil_makearpreq+0x21c(0x300000d02b0, 0x0, 0x3000654ca58,
0x300245f7d00, 0x0, 0x0)
pfil:pfil_sendbuf+0x2ac(0x30006c15ed8, 0x300245f7d00, 0x30022598778,
0x2a10007ce4c, 0x18dc6b5ae0000, 0x0)
ipf:fr_fastroute+0x388(0x300245f7d00, 0x2a10007d1a0, 0x2a10007cf68, 0x0,
0x100c7c8, 0x0)
ipf:fr_send_ip+0x2e8(0x2a10007d2b8, 0x300245f7d00, 0x2a10007d1a0,
0x3002259878c, 0x28, 0x0)
ipf:fr_send_reset+0x424(0x2a10007d2b8, 0x0, 0x23, 0x1, 0x8, 0x8)
ipf:fr_check+0x9f4(0x30006c88e90, 0x14, 0x30006c15ed8, 0x0,
0x2a10007d528, 0x2a10007d7f8)
pfil:pfil_precheck+0xeb0(0x3000654cce8, 0x2a10007d7f8, 0x9,
0x30006c15ed8, 0xc2, 0x0)
pfil:pfilmodrput+0x530(0x3000654cce8, 0x30009f636c0, 0x20, 0x0,
0xa1d0300, 0x0)
unix:putnext+0x21c(0x3000654d208, 0x30009f636c0?, , 0x30006c88e82,
0x800, 0x1)
eri:eri_sendup+0x23c(0x30006566000, 0x30021669640, 0x78575600?)
eri:eri_read_dma+0x3cc(0x30006566000, 0x30006219460, 0xc6, 0x10000?, ,
0x1)
eri:eri_intr+0x434(0x30006566000)
pcisch:pci_intr_wrapper+0x7c(, 0x25d, 0x1400000, 0x2a10007dd40, 0x4ba0,
0x13e5680)
unix:intr_thread+0x130(0x0, 0x1400000, 0x1438788, 0x1438788,
0x2a10084fd40, 0x0)
unix:ktl0+0x48()
-- interrupt data rp: 0x2a10001fa00
pc: 0x10462b4 unix:idle+0x120: ba unix:idle+0x74
npc: 0x10462b8 unix:idle+0x124: lduh [%l2 + 0x8], %g2
global: %g1 0x142e6b8
%g2 0x1438400 %g3 0x1f0000
%g4 0x6 %g5 0x2a10001fa00
%g6 0x1400000 %g7 0x1400000
out: %o0 0x1438788 %o1 0x1438788
%o2 0 %o3 0
%o4 0x2a10001f2a1 %o5 0x104625c
%sp 0x2a10001f2a1 %o7 0x10462ac
loc: %l0 0x1047b90 %l1 0x1
%l2 0x1400000 %l3 0xffffffffffffffff
%l4 0x1400090 %l5 0x2a100157b40
%l6 0x2a100157b42 %l7 0x14ab130
in: %i0 0 %i1 0
%i2 0x1438788 %i3 0x1438788
%i4 0x144e8ea %i5 0
%fp 0x2a10001f351 %i7 0x102d744
<intr trap>unix:idle+0x120(0x0, 0x0, 0x1438788, 0x1438788, 0x144e8ea,
0x0)
unix:thread_start+0x4()
-- end of CPU3 idle thread stack --
1 thread with that call found.
fs-cores-brm-sc3b% grep 112965 patch_date.out
drwxr-xr-- 2 root root 512 Jul 7 2005 112965-05
drwxr-xr-- 2 root other 512 Dec 4 06:05 112965-06
>>> >>>Eri patch is current.
