seen while running iozone -a in one window, then running fstat in another.
uvm_fault(0xda013188, 0x0, 0, 1) -> e
kernel: page fault trap, code=0
Stopped at fill_file2+0x346: movl 0x44(%edx),%eax
ddb> [-- st...@localhost attached -- Mon Jul 20 18:36:40 2009]
tr
fill_file2(d4fa8c00,d9960948,da52fcf4,6,0,da42458c,da0c6850) at fill_file2+0x34
6
sysctl_file2(e06faee0,4,84a3e000,e06faed4,da0c6850) at sysctl_file2+0x469
kern_sysctl(e06faedc,5,84a3e000,e06faed4,0) at kern_sysctl+0x7fd
sys___sysctl(da0c6850,e06faf68,e06faf58,cfbc4d80,c1) at sys___sysctl+0x113
syscall() at syscall+0x24e
--- syscall (number 202) ---
0x89b10ed:
ddb> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
22516 12870 27586 1000 3 0x4082 piperd grep
*27586 12870 27586 1000 7 0x4002 fstat
23552 1 19567 79 2 0x180 tftpd
12870 25362 12870 1000 3 0x4082 pause ksh
17904 6576 17904 1000 3 0x4002 ffs_fsync iozone
6576 25362 6576 1000 3 0x4082 pause ksh
10013 16183 16183 507 3 0x4180 kqread anvil
17481 25362 17481 1000 3 0x4082 ttyin ksh
21046 25362 21046 1000 3 0x4082 ttyin ksh
8530 16183 16183 507 3 0x4180 kqread pickup
23668 15851 15851 0 3 0x180 select smbd
30435 25362 30435 1000 3 0x4082 ttyin ksh
11081 13491 13491 518 3 0x4180 kqread imap-login
430 19154 19154 67 3 0x180 netcon httpd
10333 19154 19154 67 3 0x180 netcon httpd
16714 22011 16714 1000 3 0x4082 poll tmux
23862 1 23862 1000 3 0x40180 select ssh-agent
22011 12710 22011 1000 3 0x4082 pause ksh
12710 10489 10489 1000 3 0x180 select sshd
10489 9672 10489 0 3 0x4180 netio sshd
18980 19154 19154 67 3 0x180 netcon httpd
8952 1 210 8085 3 0x80 poll python2.5
11045 19154 19154 67 3 0x180 netcon httpd
9052 15851 15851 0 3 0x180 select smbd
27311 19154 19154 67 3 0x180 netcon httpd
32044 13491 13491 1000 3 0x44180 kqread imap
8479 21806 8479 1000 3 0x80508a poll mutt
5277 13491 13491 518 3 0x4180 kqread imap-login
10767 13491 13491 518 3 0x4180 kqread imap-login
2119 13491 13491 518 3 0x4180 kqread imap-login
25096 13491 13491 0 3 0x4180 kqread dovecot-auth
13491 1 13491 0 3 0x80 kqread dovecot
11241 1 11241 1000 3 0x88 select fetchmail
21806 25362 21806 1000 3 0x4082 pause ksh
25362 1 25362 1000 2 0x480 tmux
2733 1 2733 0 3 0x4082 ttyin getty
17689 1 17689 0 3 0x4082 ttyin getty
29509 1 29509 0 3 0x4082 ttyin getty
20429 1 20429 0 3 0x4082 ttyin getty
6376 1 6376 0 3 0x4082 ttyin getty
7781 1 7781 0 3 0x4082 ttyin getty
18999 1 18999 0 3 0x80 select cron
14164 1 14164 0 3 0x80080 nanosleep sensorsd
17420 1 17420 0 3 0x80 kqread apmd
19905 1 19905 1000 3 0x40180 select ssh-agent
11782 1 19679 0 3 0x4082 netcon vsftpd
15027 1 15027 0 3 0x80 poll bacula-fd
3780 13348 13348 0 3 0x44080 poll mysqld
13348 1 13348 0 3 0x180 select perl
30825 15851 15851 0 3 0x180 pause smbd
27035 1 27035 0 3 0x80 select nmbd
15851 1 15851 0 3 0x180 select smbd
7600 1 30016 490 3 0x180 poll cvsyncd
25027 1 25027 578 3 0x80 nanosleep perl
9774 28417 28417 0 3 0x80 select conserver
21991 28417 28417 0 3 0x80 select conserver
28417 1 28417 0 3 0x80 select conserver
28568 1 28568 562 3 0x180 nanosleep perl
21754 25328 21754 503 3 0x88 poll postgres
22829 25328 22829 503 3 0x88 select postgres
11469 25328 11469 503 3 0x88 select postgres
22372 25328 22372 503 3 0x88 select postgres
7435 1 7435 601 3 0x180 kqread unbound
19794 1 19794 535 3 0x180 nanosleep symon
32577 1 32577 5350 3 0x80 select symux
20470 3926 19679 502 3 0x4182 poll mysqld
3926 1 19679 0 3 0x4082 pause sh
25328 1 19679 503 3 0x408a select postgres
11684 1 11684 0 3 0x80 poll rpc.bootparamd
24470 1 24470 0 3 0x80 select rarpd
9672 1 9672 0 3 0x80 select sshd
32358 19154 19154 67 3 0x180 netcon httpd
10526 19154 19154 67 3 0x180 netcon httpd
16955 19154 19154 67 3 0x180 netcon httpd
28675 19154 19154 67 3 0x180 netcon httpd
27904 19154 19154 67 3 0x180 netcon httpd
14350 1 14350 0 3 0x180 select inetd
19154 1 19154 0 3 0x80 select httpd
23930 16183 16183 507 3 0x4180 kqread qmgr
16183 1 16183 0 3 0x4188 kqread master
28308 1 28308 0 3 0x80 poll ntpd
23928 20783 23928 83 3 0x180 poll ntpd
20783 1 20783 83 3 0x180 poll ntpd
25167 0 0 0 3 0x100280 nfsidl nfsio
20655 0 0 0 3 0x100280 nfsidl nfsio
20789 0 0 0 3 0x100280 nfsidl nfsio
16312 0 0 0 3 0x100280 nfsidl nfsio
9274 1 19679 0 3 0x80 select amd
5707 1 5707 0 3 0x80088 poll rpc.statd
4551 1 4551 0 3 0x80 poll rpc.lockd
19054 16509 16509 0 3 0x80 nfsd nfsd
20207 16509 16509 0 3 0x80 nfsd nfsd
30535 16509 16509 0 3 0x80 nfsd nfsd
730 16509 16509 0 3 0x80 nfsd nfsd
4443 16509 16509 0 3 0x80 nfsd nfsd
9145 16509 16509 0 3 0x80 nfsd nfsd
16509 1 16509 0 3 0x80 netcon nfsd
23020 1 23020 0 3 0x80 select mountd
30376 1 30376 28 3 0x180 poll portmap
24962 23979 23979 68 3 0x180 select isakmpd
23979 1 23979 0 3 0x80 netio isakmpd
13407 16738 16738 74 3 0x180 bpf pflogd
16738 1 16738 0 3 0x80 netio pflogd
2313 25691 25691 73 2 0x180 syslogd
25691 1 25691 0 3 0x88 netio syslogd
1075 1 1075 0 3 0x80 mfsidl mount_mfs
16 0 0 0 3 0x100200 bored crypto
15 0 0 0 3 0x100200 aiodoned aiodoned
14 0 0 0 3 0x100200 biowait update
13 0 0 0 3 0x100200 cleaner cleaner
12 0 0 0 3 0x100200 reaper reaper
11 0 0 0 3 0x100200 pgdaemon pagedaemon
10 0 0 0 3 0x100200 pftm pfpurge
9 0 0 0 3 0x100200 usbevt usb2
8 0 0 0 3 0x100200 usbevt usb1
7 0 0 0 3 0x100200 usbtsk usbtask
6 0 0 0 3 0x100200 usbevt usb0
5 0 0 0 3 0x100200 acpi_idle acpi0
4 0 0 0 2 0x100200 syswq
3 0 0 0 3 0x40100200 idle0
2 0 0 0 3 0x100200 kmalloc kmthread
1 0 1 0 3 0x4080 wait init
0 -1 0 0 3 0x80200 scheduler swapper
ddb> show proc
PROC (fstat) pid=27586 stat=onproc flags=4002<CONTROLT,EXEC>
pri=61, usrpri=61, nice=20
forw=0xffffffff, list=0xda0c66f4,0xda0c6444
user=0xe06f9000, vmspace=0xda013188
estcpu=11, cpticks=6, pctcpu=0.0, swtime=0
user=0, sys=6, intr=0
ddb> boot r
panic: wdc_exec_command: polled command not done
Stopped at Debugger+0x4: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb> boot r
rebooting...
OpenBSD 4.6-current (GENERIC) #2: Thu Jul 16 23:33:49 BST 2009
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: AMD Opteron(tm) Processor 146 ("AuthenticAMD" 686-class, 1024KB L2 cache)
2 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3
real mem = 4227362816 (4031MB)
avail mem = 4111392768 (3920MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 07/15/06, BIOS32 rev. 0 @ 0xf0010, SMBIOS
rev. 2.4 @ 0xf8e00 (50 entries)
bios0: vendor American Megatrends Inc. version "080011" date 07/15/2006
bios0: Supermicro H8SSL
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP APIC OEMB
acpi0: wakeup devices P1P2(S4) USB0(S1) USB1(S1) USB2(S1) PS2K(S4) PS2M(S4)
SLPB(S1)
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD erratum 89 present, BIOS upgrade may be required
cpu0: apic clock running at 199MHz
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 16 pins
ioapic1 at mainbus0: apid 2 pa 0xfec01000, version 11, 16 pins
ioapic2 at mainbus0: apid 3 pa 0xfec02000, version 11, 16 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (P0P1)
acpiprt2 at acpi0: bus 2 (P1P2)
acpicpu0 at acpi0: PSS
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: SLPB
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x2000! 0xca000/0x1600 0xcb800/0x1600
0xcd000/0x2200 0xcf800/0x1000
cpu0: Cool'n'Quiet K8 1996 MHz: speeds: 2000 1800 1000 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
ppb0 at pci0 dev 1 function 0 "ServerWorks HT-1000 PCI" rev 0x00
pci1 at ppb0 bus 1
ppb1 at pci1 dev 13 function 0 "ServerWorks HT-1000 PCIX" rev 0xb2
pci2 at ppb1 bus 2
ppb2 at pci2 dev 1 function 0 "Intel IOP331 PCIX-PCIX" rev 0x07
pci3 at ppb2 bus 3
ami0 at pci3 dev 14 function 0 "Symbios Logic MegaRAID SATA 4x/8x" rev 0x07:
apic 2 int 4 (irq 9)
ami0: LSI 3008, 32b, FW 814B, BIOS vH431, 128MB RAM
ami0: 1 channels, 0 FC loops, 1 logical drives
scsibus0 at ami0: 40 targets
sd0 at scsibus0 targ 0 lun 0: <AMI, Host drive #00, > SCSI2 0/direct fixed
sd0: 1424784MB, 512 bytes/sec, 2917957632 sec total
scsibus1 at ami0: 16 targets
bge0 at pci2 dev 3 function 0 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
(0x2100): apic 2 int 8 (irq 5), address 00:30:48:58:86:40
brgphy0 at bge0 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
bge1 at pci2 dev 3 function 1 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
(0x2100): apic 2 int 9 (irq 7), address 00:30:48:58:86:41
brgphy1 at bge1 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
pciide0 at pci1 dev 14 function 0 "ServerWorks HT-1000 SATA" rev 0x00: DMA
pciide0: using apic 1 int 11 (irq 11) for native-PCI interrupt
pciide0: port 0: device present, speed: 1.5Gb/s
wd0 at pciide0 channel 0 drive 0: <OCZ-VERTEX 1275>
wd0: 16-sector PIO, LBA48, 30533MB, 62533296 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: port 1: PHY offline
pciide0: port 2: PHY offline
pciide0: port 3: PHY offline
pciide1 at pci1 dev 14 function 1 "ServerWorks HT-1000 SATA" rev 0x00
piixpm0 at pci0 dev 2 function 0 "ServerWorks HT-1000" rev 0x00: polling
iic0 at piixpm0
admcts0 at iic0 addr 0x2c
spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem1 at iic0 addr 0x51: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem3 at iic0 addr 0x53: 1GB DDR SDRAM ECC PC3200CL3.0
pciide2 at pci0 dev 2 function 1 "ServerWorks HT-1000 IDE" rev 0x00: DMA
pcib0 at pci0 dev 2 function 2 "ServerWorks HT-1000 LPC" rev 0x00
ohci0 at pci0 dev 3 function 0 "ServerWorks HT-1000 USB" rev 0x01: apic 1 int
10 (irq 10), version 1.0, legacy support
ohci1 at pci0 dev 3 function 1 "ServerWorks HT-1000 USB" rev 0x01: apic 1 int
10 (irq 10), version 1.0, legacy support
ehci0 at pci0 dev 3 function 2 "ServerWorks HT-1000 USB" rev 0x01: apic 1 int
10 (irq 10)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "ServerWorks EHCI root hub" rev 2.00/1.00 addr 1
vga1 at pci0 dev 5 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
puc0 at pci0 dev 8 function 0 "NetMos Nm9835" rev 0x01: ports: 2 com, 1 lpt
com3 at puc0 port 0 apic 2 int 0 (irq 9): ns16550a, 16 byte fifo
com4 at puc0 port 1 apic 2 int 0 (irq 9): ns16550a, 16 byte fifo
lpt3 at puc0 port 2 apic 2 int 0 (irq 9)
pchb0 at pci0 dev 24 function 0 "AMD AMD64 0Fh HyperTransport" rev 0x00
pchb1 at pci0 dev 24 function 1 "AMD AMD64 0Fh Address Map" rev 0x00
pchb2 at pci0 dev 24 function 2 "AMD AMD64 0Fh DRAM Cfg" rev 0x00
kate0 at pci0 dev 24 function 3 "AMD AMD64 0Fh Misc Cfg" rev 0x00
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
usb1 at ohci0: USB revision 1.0
uhub1 at usb1 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
usb2 at ohci1: USB revision 1.0
uhub2 at usb2 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
mtrr: Pentium Pro MTRR support
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
