march 7th snapshot and before, no problem
next upgrade was april 9th snapshot, nfsd usage for more than a minute
or so will bring down the system reproducibly.
tried again with a bit ago (april 12th) snapshot, still crashing
OpenBSD/amd64 (largemarge.arikui.org) (tty00)
login: panic: nfs getstream
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{0}> trace
Debugger() at Debugger+0x5
panic() at panic+0xfe
nfsrv_getstream() at nfsrv_getstream+0x29c
nfsrv_rcv() at nfsrv_rcv+0x1b3
tcp_input() at tcp_input+0x1db7
ip_ours() at ip_ours+0x1e9
ipv4_input() at ipv4_input+0x362
ipintr() at ipintr+0x7f
netintr() at netintr+0x85
softintr_dispatch() at softintr_dispatch+0x5d
Xsoftnet() at Xsoftnet+0x2d
--- interrupt ---
end trace frame: 0x0, count: -11
0x8:
ddb{0}> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
9810 1 9810 0 3 0x83 ttyin getty
29792 16634 29792 1000 3 0x82 select sftp-server
16634 27591 27591 1000 3 0x90 select sshd
27591 29836 27591 0 3 0x92 poll sshd
4876 11443 4876 1000 3 0x83 kqread rtorrent
27561 11443 4876 1000 3 0x4000083 kqread rtorrent
11443 18917 11443 1000 3 0x83 wait bash
18917 1 18917 1000 3 0x80 kqread tmux
24815 1 24815 0 3 0x83 ttyin getty
18426 1 18426 0 3 0x83 ttyin getty
12379 1 12379 0 3 0x83 ttyin getty
27121 1 27121 0 3 0x83 ttyin getty
17905 1 17905 0 3 0x83 ttyin getty
24907 1 24907 0 3 0x80 select cron
28934 1 20764 0 3 0x83 select pure-ftpd
10153 1 10153 0 3 0x90 select inetd
31647 11720 11720 95 3 0x90 kqread smtpd
1481 11720 11720 95 3 0x90 kqread smtpd
20694 11720 11720 95 3 0x90 kqread smtpd
24315 11720 11720 95 3 0x90 kqread smtpd
25769 11720 11720 103 3 0x90 kqread smtpd
11720 1 11720 0 3 0x80 kqread smtpd
29836 1 29836 0 3 0x80 select sshd
12327 28181 28181 0 3 0x80 nfsd nfsd
21316 28181 28181 0 3 0x80 nfsd nfsd
13858 28181 28181 0 3 0x80 nfsd nfsd
29176 28181 28181 0 3 0x80 nfsd nfsd
1601 28181 28181 0 3 0x80 nfsd nfsd
19203 28181 28181 0 3 0x80 nfsd nfsd
15666 28181 28181 0 3 0x80 nfsd nfsd
13843 28181 28181 0 3 0x80 nfsd nfsd
806 28181 28181 0 3 0x80 nfsd nfsd
22719 28181 28181 0 3 0x80 nfsd nfsd
9017 28181 28181 0 3 0x80 nfsd nfsd
18849 28181 28181 0 3 0x80 nfsd nfsd
19076 28181 28181 0 3 0x80 nfsd nfsd
14770 28181 28181 0 3 0x80 nfsd nfsd
24711 28181 28181 0 7 0 nfsd
24641 28181 28181 0 7 0 nfsd
2477 28181 28181 0 7 0 nfsd
22796 28181 28181 0 3 0 inode nfsd
10309 28181 28181 0 3 0x80 nfsd nfsd
13059 28181 28181 0 3 0x80 nfsd nfsd
28181 1 28181 0 3 0x80 netcon nfsd
29980 1 29980 0 3 0x80 select mountd
31870 1 31870 28 3 0x90 poll portmap
22012 16162 24028 83 3 0x90 poll ntpd
16162 24028 24028 83 3 0x90 poll ntpd
24028 1 24028 0 3 0x80 poll ntpd
21717 27834 27834 74 3 0x90 bpf pflogd
27834 1 27834 0 3 0x80 netio pflogd
21943 24943 24943 73 3 0x90 poll syslogd
24943 1 24943 0 3 0x80 netio syslogd
30933 0 0 0 3 0x4200 bored ttm_swap
16463 0 0 0 3 0x4200 aiodoned aiodoned
1141 0 0 0 3 0x4200 syncer update
25787 0 0 0 3 0x4200 cleaner cleaner
5411 0 0 0 3 0x4200 reaper reaper
1280 0 0 0 3 0x4200 pgdaemon pagedaemon
16289 0 0 0 3 0x4200 bored crypto
11666 0 0 0 3 0x4200 pftm pfpurge
3147 0 0 0 3 0x4200 usbtsk usbtask
32235 0 0 0 3 0x4200 usbatsk usbatsk
10510 0 0 0 3 0x40004200 acpi0 acpi0
440 0 0 0 3 0x40004200 idle3
15913 0 0 0 3 0x40004200 idle2
10567 0 0 0 3 0x40004200 idle1
25003 0 0 0 3 0x4200 bored sensors
7839 0 0 0 3 0x4200 bored systq
19961 0 0 0 3 0x4200 bored syswq
*14835 0 0 0 7 0x40004200 idle0
1 0 1 0 3 0x82 wait init
0 -1 0 0 3 0x200 scheduler swapper
ddb{0}> mach ddbcpu 1
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{1}> trace
Debugger() at Debugger+0x5
x86_ipi_handler() at x86_ipi_handler+0x64
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1b
--- interrupt ---
Bad frame pointer: 0xffff80002435ab10
end trace frame: 0xffff80002435ab10, count: -3
__mp_lock+0x37:
ddb{1}> mach ddbcpu 2
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{2}> trace
Debugger() at Debugger+0x5
x86_ipi_handler() at x86_ipi_handler+0x64
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1b
--- interrupt ---
Bad frame pointer: 0xffff800024355a60
end trace frame: 0xffff800024355a60, count: -3
__mp_lock+0x35:
ddb{2}> mach ddbcpu 3
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{3}> trace
Debugger() at Debugger+0x5
x86_ipi_handler() at x86_ipi_handler+0x64
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1b
--- interrupt ---
Bad frame pointer: 0xffff80002435fa60
end trace frame: 0xffff80002435fa60, count: -3
__mp_lock+0x37:
ddb{3}>
# dmesg
OpenBSD 5.5-current (GENERIC.MP) #65: Sat Apr 12 10:08:00 MDT 2014
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 34338045952 (32747MB)
avail mem = 33415208960 (31867MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fb9c000 (67 entries)
bios0: vendor Dell Inc. version "2.7.0" date 10/30/2010
bios0: Dell Inc. PowerEdge 2950
acpi0 at bios0: rev 2
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG WD__ SLIC ERST HEST BERT
EINJ TCPA SSDT SSDT SSDT SSDT SSDT
acpi0: wakeup devices PCI0(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz, 2992.93 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,NXE,LOF
cpu0: 4MB 64b/line 16-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 332MHz
cpu0: mwait min=64, max=64, C-substates=0.2.0.0.0, IBE
cpu1 at mainbus0: apid 6 (application processor)
cpu1: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz, 2992.50 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,NXE,LOF
cpu1: 4MB 64b/line 16-way L2 cache
cpu1: smt 0, core 0, package 3
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz, 2992.50 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,NXE,LOF
cpu2: 4MB 64b/line 16-way L2 cache
cpu2: smt 0, core 1, package 0
cpu3 at mainbus0: apid 7 (application processor)
cpu3: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz, 2992.50 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,NXE,LOF
cpu3: 4MB 64b/line 16-way L2 cache
cpu3: smt 0, core 1, package 3
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 0, remapped to apid 8
ioapic1 at mainbus0: apid 9 pa 0xfec81000, version 20, 24 pins
ioapic1: misconfigured as apic 0, remapped to apid 9
acpihpet0 at acpi0: 14318179 Hz
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 6 (PEX2)
acpiprt2 at acpi0: bus 7 (UPST)
acpiprt3 at acpi0: bus 8 (DWN1)
acpiprt4 at acpi0: bus 10 (DWN2)
acpiprt5 at acpi0: bus 1 (PEX3)
acpiprt6 at acpi0: bus 2 (PE2P)
acpiprt7 at acpi0: bus 12 (PEX4)
acpiprt8 at acpi0: bus 14 (PEX6)
acpiprt9 at acpi0: bus 4 (SBEX)
acpiprt10 at acpi0: bus 16 (COMP)
acpicpu0 at acpi0: C1, PSS
acpicpu1 at acpi0: C1, PSS
acpicpu2 at acpi0: C1, PSS
acpicpu3 at acpi0: C1, PSS
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2992 MHz: speeds: 3000, 2667, 2333, 2000 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000X Host" rev 0x12
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE" rev 0x12
pci1 at ppb0 bus 6
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 7
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci3 at ppb2 bus 8
ppb3 at pci3 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
pci4 at ppb3 bus 9
bnx0 at pci4 dev 0 function 0 "Broadcom BCM5708" rev 0x12: apic 8 int 16
ppb4 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: msi
pci5 at ppb4 bus 10
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 11
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0x12
pci7 at ppb6 bus 1
ppb7 at pci7 dev 0 function 0 "Intel IOP333 PCIE-PCIX" rev 0x00
pci8 at ppb7 bus 2
mfi0 at pci8 dev 14 function 0 "Dell PERC 5" rev 0x00: apic 9 int 14
mfi0: "PERC 5/i Integrated", firmware 5.2.2-0072, 256MB cache
scsibus1 at mfi0: 64 targets
sd0 at scsibus1 targ 0 lun 0: <DELL, PERC 5/i, 1.03> SCSI3 0/direct
fixed naa.60019b90c3691800174702a3594f9123
sd0: 3574400MB, 512 bytes/sector, 7320371200 sectors
ppb8 at pci7 dev 0 function 2 "Intel IOP333 PCIE-PCIX" rev 0x00
pci9 at ppb8 bus 3
ppb9 at pci0 dev 4 function 0 "Intel 5000 PCIE x8" rev 0x12: msi
pci10 at ppb9 bus 12
ppb10 at pci0 dev 5 function 0 "Intel 5000 PCIE" rev 0x12
pci11 at ppb10 bus 13
ppb11 at pci0 dev 6 function 0 "Intel 5000 PCIE x8" rev 0x12: msi
pci12 at ppb11 bus 14
ppb12 at pci0 dev 7 function 0 "Intel 5000 PCIE" rev 0x12
pci13 at ppb12 bus 15
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0x12
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0x12
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0x12
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0x12
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0x12
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0x12
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0x12
ppb13 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09
pci14 at ppb13 bus 4
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 21
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 20
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 21
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 21
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb14 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
pci15 at ppb14 bus 16
radeondrm0 at pci15 dev 13 function 0 "ATI ES1000" rev 0x02
drm0 at radeondrm0
radeondrm0: apic 8 int 19
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus2 at atapiscsi0: 2 targets
cd0 at scsibus2 targ 0 lun 0: <TSSTcorp, CDRW/DVD TSL462D, DE01> ATAPI
5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
pciide0: channel 1 ignored (disabled)
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
uhub4 at uhub0 port 1 "Dell product 0xa001" rev 2.00/0.00 addr 2
uhidev0 at uhub4 port 1 configuration 1 interface 0 "Dell DRAC5" rev
1.10/0.00 addr 3
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
uhidev1 at uhub4 port 1 configuration 1 interface 1 "Dell DRAC5" rev
1.10/0.00 addr 3
uhidev1: iclass 3/1
ums0 at uhidev1: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
umass0 at uhub4 port 2 configuration 1 interface 0 "DELL INC. DRAC5
VIRTUAL MEDIA" rev 2.00/0.00 addr 4
umass0: using SCSI over Bulk-Only
scsibus3 at umass0: 2 targets, initiator 0
cd1 at scsibus3 targ 1 lun 0: <Dell, Virtual CDROM, 123> SCSI0 5/cdrom
removable serial.413c00011028_123456
umass1 at uhub4 port 2 configuration 1 interface 1 "DELL INC. DRAC5
VIRTUAL MEDIA" rev 2.00/0.00 addr 4
umass1: using SCSI over Bulk-Only
scsibus4 at umass1: 2 targets, initiator 0
sd1 at scsibus4 targ 1 lun 0: <Dell, Virtual Floppy, 123> SCSI0
0/direct removable serial.413c00011028_123456
uhub5 at uhub0 port 5 "Cypress Semiconductor USB2 Hub" rev 2.00/0.0b addr 5
uhidev2 at uhub2 port 2 configuration 1 interface 0 "American Power
Conversion Smart-UPS 1500 FW:601.3.D USB FW:8.1" rev 1.10/0.06 addr 2
uhidev2: iclass 3/0, 54 report ids
upd0 at uhidev2
vscsi0 at root
scsibus5 at vscsi0: 256 targets
softraid0 at root
scsibus6 at softraid0: 256 targets
root on sd0a (49fddf7906041e4a.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
bnx0: address 00:19:b9:bf:95:b0
brgphy0 at bnx0 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
drm: initializing kernel modesetting (RV100 0x1002:0x515E 0x1028:0x01B2).
radeondrm0: VRAM: 128M 0x00000000D0000000 - 0x00000000D7FFFFFF (16M used)
radeondrm0: GTT: 512M 0x00000000B0000000 - 0x00000000CFFFFFFF
drm: PCI GART of 512M enabled (table at 0x0000000002111000).
radeondrm0: 1280x1024
wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using wskbd0
wskbd1: connecting to wsdisplay0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
# cat /etc/rc.conf.local
ntpd_flags=""
portmap_flags=""
mountd_flags=""
nfsd_flags="-t -u -n 20"
inetd_flags=""
sndiod_flags=NO
# cat /etc/exports
# $OpenBSD: exports,v 1.2 2002/05/31 08:15:44 pjanzen Exp $
#
# See exports(5) for more information. Be very careful: misconfiguration
# of this file can result in your filesystems being readable by the world.
/var/data/a -alldirs -network 192.168.0.0 -mask 255.255.255.0 -mapall=me:jerks
/var/data/b -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/c -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/d -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/e -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/f -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/g -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/h -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/i -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/j -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/k -ro -network 192.168.0.0 -mask 255.255.255.0 -mapall=nobody:nobody
/var/data/ -ro -network 192.168.0.0 -mask 255.255.255.0 -alldirs
-mapall=nobody:nobody
