Hi,
just another crash...
After that I upgraded my sys to OpenBSD 7.2-beta (GENERIC.MP) #705: Mon Aug 22
12:25:07 MDT 2022
I'll let you know if anything changes.
ddb{2}> show panic
the kernel did not panic
ddb{2}> trace
tdb_hash(349a9a42,ffff8000225d2b50,32) at tdb_hash+0x9d
gettdb_dir(0,349a9a42,ffff8000225d2b50,32,0) at gettdb_dir+0x85
ipsec_common_input(ffff8000225d2e08,14,9,2,32,0) at ipsec_common_input+0x2f3
esp46_input(ffff8000225d2e08,ffff8000225d2e14,32,2) at esp46_input+0xee
ip_deliver(ffff8000225d2e08,ffff8000225d2e14,32,2) at ip_deliver+0x103
ip_ours(ffff8000225d2e08,ffff8000225d2e14,fffffd80a642badc,0) at ip_ours+0x184
ip_input_if(ffff8000225d2e08,ffff8000225d2e14,4,0,ffff8000000ab048) at ip_input
_if+0x19d
ipv4_input(ffff8000000ab048,fffffd80c610db00) at ipv4_input+0x39
ether_input(ffff8000000ab048,fffffd80c610db00) at ether_input+0x3a2
if_input_process(ffff8000000ab048,ffff8000225d2ef8) at if_input_process+0x6f
ifiq_process(ffff8000000ab458) at ifiq_process+0x69
taskq_thread(ffff80000002b080) at taskq_thread+0x100
end trace frame: 0x0, count: -12
ddb{2}> mach ddbpcu 0
No such command
ddb{2}> mach ddbcpu 0
Stopped at x86_ipi_db+0x12: leave
ddb{0}> trace
x86_ipi_db(ffffffff822c6ff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x11f
sched_idle(ffffffff822c6ff0) at sched_idle+0x280
end trace frame: 0x0, count: -5
ddb{0}> mach ddbcpu 1
Stopped at x86_ipi_db+0x12: leave
ddb{1}> trace
x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x11f
sched_idle(ffff800022408ff0) at sched_idle+0x280
end trace frame: 0x0, count: -5
ddb{1}> mach ddbcpu 2
Stopped at tdb_hash+0x9d: movzbl 0(%r14),%r8d
ddb{2}> trace
tdb_hash(349a9a42,ffff8000225d2b50,32) at tdb_hash+0x9d
gettdb_dir(0,349a9a42,ffff8000225d2b50,32,0) at gettdb_dir+0x85
ipsec_common_input(ffff8000225d2e08,14,9,2,32,0) at ipsec_common_input+0x2f3
esp46_input(ffff8000225d2e08,ffff8000225d2e14,32,2) at esp46_input+0xee
ip_deliver(ffff8000225d2e08,ffff8000225d2e14,32,2) at ip_deliver+0x103
ip_ours(ffff8000225d2e08,ffff8000225d2e14,fffffd80a642badc,0) at ip_ours+0x184
ip_input_if(ffff8000225d2e08,ffff8000225d2e14,4,0,ffff8000000ab048) at ip_input
_if+0x19d
ipv4_input(ffff8000000ab048,fffffd80c610db00) at ipv4_input+0x39
ether_input(ffff8000000ab048,fffffd80c610db00) at ether_input+0x3a2
if_input_process(ffff8000000ab048,ffff8000225d2ef8) at if_input_process+0x6f
ifiq_process(ffff8000000ab458) at ifiq_process+0x69
taskq_thread(ffff80000002b080) at taskq_thread+0x100
end trace frame: 0x0, count: -12
ddb{2}> mach ddbcpu 3
Stopped at x86_ipi_db+0x12: leave
ddb{3}> trace
x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x11f
sched_idle(ffff80002241aff0) at sched_idle+0x280
end trace frame: 0x0, count: -5
ddb{3}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
75864 281064 42991 74 3 0x1100092 bpf pflogd
42991 25090 1 0 3 0x80 netio pflogd
72099 365712 1 0 3 0x100083 ttyin getty
75850 250115 1 0 3 0x100098 kqread cron
34840 92342 1 0 3 0x80 ugenrintr apcupsd
34840 102465 1 0 3 0x4000088 sigwait apcupsd
34840 507125 1 0 3 0x4000080 nanoslp apcupsd
53220 174176 1 99 3 0x1100090 kqread sndiod
99208 383592 1 110 3 0x100090 kqread sndiod
53667 31408 64688 95 3 0x1100092 kqread smtpd
1513 485354 64688 103 3 0x1100092 kqread smtpd
30381 7936 64688 95 3 0x1100092 kqread smtpd
48867 487651 64688 95 3 0x100092 kqread smtpd
94459 415826 64688 95 3 0x1100092 kqread smtpd
39840 345575 64688 95 3 0x1100092 kqread smtpd
64688 148096 1 0 3 0x100080 kqread smtpd
27519 138514 1 77 3 0x1100090 kqread dhcpd
81524 360290 1 0 3 0x88 kqread sshd
35735 95051 81607 68 3 0x1000090 kqread isakmpd
81607 191046 1 0 3 0x80 netio isakmpd
36275 457664 1 0 3 0x100080 kqread ntpd
25071 35250 94020 83 3 0x100092 kqread ntpd
94020 410848 1 83 3 0x1100092 kqread ntpd
44006 213133 48231 73 3 0x1100090 kqread syslogd
48231 256037 1 0 3 0x100082 netio syslogd
73507 496689 1 0 3 0x100080 kqread resolvd
67362 447196 67708 77 3 0x100092 kqread dhcpleased
99425 70674 67708 77 3 0x100092 kqread dhcpleased
67708 42030 1 0 3 0x80 kqread dhcpleased
14253 229600 54605 115 3 0x100092 kqread slaacd
59290 328417 54605 115 3 0x100092 kqread slaacd
54605 382578 1 0 3 0x100080 kqread slaacd
40140 477173 0 0 3 0x14200 bored smr
13169 515011 0 0 3 0x14200 pgzero zerothread
70741 286268 0 0 3 0x14200 aiodoned aiodoned
22262 523138 0 0 3 0x14200 syncer update
55315 11693 0 0 3 0x14200 cleaner cleaner
13014 46639 0 0 3 0x14200 reaper reaper
99696 248500 0 0 3 0x14200 pgdaemon pagedaemon
4036 435036 0 0 3 0x14200 bored sensors
52961 129109 0 0 3 0x14200 mmctsk sdmmc0
54928 403836 0 0 3 0x14200 usbtsk usbtask
86091 351722 0 0 3 0x14200 usbatsk usbatsk
82545 400402 0 0 3 0x40014200 acpi0 acpi0
*45002 129141 0 0 7 0x40014200 idle3
3471 379382 0 0 3 0x40014200 idle2
42187 52020 0 0 7 0x40014200 idle1
96610 510216 0 0 7 0x14200 softnet
95999 33367 0 0 3 0x14200 bored systqmp
97474 508742 0 0 3 0x14200 bored systq
50252 158317 0 0 3 0x40014200 bored softclock
96621 271336 0 0 7 0x40014200 idle0
1 263074 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{3}> show uvm
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
1006341 VM pages: 9873 active, 132147 inactive, 1 wired, 684296 free (85551 z
ero)
min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
freemin=33544, free-target=44725, inactive-target=0, wired-max=335447
faults=1723990, traps=1499809, intrs=759136311, ctxswitch=266994038 fpuswitch
=0
softint=27307528, syscalls=7962707, kmapent=12
fault counts:
noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
ok relocks(total)=179713(182778), anget(retries)=844072(0), amapcopy=267845
neighbor anon/obj pg=382709/862581, gets(lock/unlock)=439081/182818
cases: anon=730755, anoncow=113317, obj=385183, prcopy=50793, przero=443928
daemon and swap counts:
woke=0, revs=0, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=0
pageouts=0, pending=0, nswget=0
nswapdev=1
swpages=130304, swpginuse=0, swpgonly=0 paging=0
kernel pointers:
objs(kern)=0xffffffff82336f90
ddb{3}> show bcstats
Current Buffer Cache status:
numbufs 40685 busymapped 0, delwri 0
kvaslots 6553 avail kva slots 6553
bufpages 162705, dmapages 162705, dirtypages 0
pendingreads 0, pendingwrites 0
highflips 0, highflops 0, dmaflips 0
ddb{3}> show reg
rdi 0xffff80002241aff0
rsi 0
rbp 0xffff8000225e5a70
rbx 0xffffffff82286148 ipifunc+0x38
rdx 0
rcx 0x7
rax 0xffffff7f
r8 0
r9 0
r10 0
r11 0xec7e8a66c2e385b6
r12 0x7
r13 0
r14 0xffff80002241aff0
r15 0
rip 0xffffffff81cfecf2 x86_ipi_db+0x12
cs 0x8
rflags 0x282
rsp 0xffff8000225e5a60
ss 0x10
x86_ipi_db+0x12: leave
On Sat, 20 Aug 2022 14:06:05 +0200
Radek <[email protected]> wrote:
> Hi,
> my router works as a gateway and it is the one end of site-to-site IPSec VPN
> tunnel. The crash usually occurs when LAN client is downloading ~40Mbps over
> IPsec tunnel, but it always takes from a few to a dozen hours of pulling data
> over VPN to crash.
> On the far end of VPN tunnel there is the same hardware and the same OS
> configuration (there is running OpenBSD 6.8 (GENERIC.MP) #4: Thu Aug 5
> 11:02:18 MDT 2021) - that system has never crash.
>
> I attached dmesg and ddb console outputs of my last 4 crashes.
>
> ################################
> ## 1 crash
> ################################
> ddb{0}> show panic
> *cpu3: uvm_fault(0xffffffff823e5c70, 0x1b, 0, 1) -> e
> ddb{3}>
>
> ddb{2}> trace
> art_bindex(ffff800000093380,ffff8000225d313c,ffff8000225d3070) at
> art_bindex+0x
> 17
> rtable_match(0,ffff8000225d3138,fffffd80c909d470) at rtable_match+0x93
> rtalloc_mpath(ffff8000225d3138,fffffd80c909d470,0) at rtalloc_mpath+0x2e
> in_ouraddr(fffffd80c7fccd00,ffff8000000ee000,ffff8000225d31b8) at
> in_ouraddr+0x
> 84
> ip_input_if(ffff8000225d3678,ffff8000225d3684,4,2,ffff8000000ee000) at
> ip_input
> _if+0x1c4
> ipip_input_if(ffff8000225d3678,ffff8000225d3684,4,2,ffff8000000ee000) at
> ipip_i
> nput_if+0x478
> ipip_input(ffff8000225d3678,ffff8000225d3684,4,2) at ipip_input+0x60
> in_gif_input(ffff8000225d3678,ffff8000225d3684,4,2) at in_gif_input+0x71
> ip_deliver(ffff8000225d3678,ffff8000225d3684,32,2) at ip_deliver+0x103
> ip_ours(ffff8000225d3678,ffff8000225d3684,fffffd80c909d45c,0) at ip_ours+0x184
> ip_input_if(ffff8000225d3678,ffff8000225d3684,4,0,ffff8000000ab048) at
> ip_input
> _if+0x19d
> ipv4_input(ffff8000000ab048,fffffd80c9072e00) at ipv4_input+0x39
> ether_input(ffff8000000ab048,fffffd80c9072e00) at ether_input+0x3a2
> if_input_process(ffff8000000ab048,ffff8000225d3768) at if_input_process+0x6f
> ifiq_process(ffff8000000ab458) at ifiq_process+0x69
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: -16
> ddb{3}>
>
> ddb{3}> mach ddbcpu 0
> Stopped at x86_ipi_db+0x12: leave
> TID PID UID PRFLAGS PFLAGS CPU COMMAND
> 199559 83430 0 0x14000 0x200 2 softnet
> x86_ipi_db(ffffffff82287ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff82287ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> https://www.openbsd.org/ddb.html describes the minimum info required in bug
> reports. Insufficient info makes it difficult to find and fix bugs.
> ddb{3}>
>
> ddb{0}> mach ddbcpu 1
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff800022408ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{3}>
>
> ddb{1}> mach ddbcpu 2
> Stopped at art_bindex+0x17: movzbl 0x15(%rdi),%r9d
> art_bindex(ffff800000093380,ffff8000225d313c,ffff8000225d3070) at
> art_bindex+0x
> 17
> rtable_match(0,ffff8000225d3138,fffffd80c909d470) at rtable_match+0x93
> rtalloc_mpath(ffff8000225d3138,fffffd80c909d470,0) at rtalloc_mpath+0x2e
> in_ouraddr(fffffd80c7fccd00,ffff8000000ee000,ffff8000225d31b8) at
> in_ouraddr+0x
> 84
> ip_input_if(ffff8000225d3678,ffff8000225d3684,4,2,ffff8000000ee000) at
> ip_input
> _if+0x1c4
> ipip_input_if(ffff8000225d3678,ffff8000225d3684,4,2,ffff8000000ee000) at
> ipip_i
> nput_if+0x478
> ipip_input(ffff8000225d3678,ffff8000225d3684,4,2) at ipip_input+0x60
> in_gif_input(ffff8000225d3678,ffff8000225d3684,4,2) at in_gif_input+0x71
> ip_deliver(ffff8000225d3678,ffff8000225d3684,32,2) at ip_deliver+0x103
> ip_ours(ffff8000225d3678,ffff8000225d3684,fffffd80c909d45c,0) at ip_ours+0x184
> ip_input_if(ffff8000225d3678,ffff8000225d3684,4,0,ffff8000000ab048) at
> ip_input
> _if+0x19d
> ipv4_input(ffff8000000ab048,fffffd80c9072e00) at ipv4_input+0x39
> ether_input(ffff8000000ab048,fffffd80c9072e00) at ether_input+0x3a2
> if_input_process(ffff8000000ab048,ffff8000225d3768) at if_input_process+0x6f
> end trace frame: 0xffff8000225d37b0, count: 0
> ddb{3}>
>
> ddb{2}> mach ddbcpu 3
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{3}>
>
> ddb{3}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 3841 289083 93672 74 3 0x1100092 bpf pflogd
> 93672 382807 1 0 3 0x80 netio pflogd
> 59011 256012 1 0 3 0x100083 ttyin getty
> 43477 366284 1 0 3 0x100098 kqread cron
> 44103 402689 1 0 3 0x80 ugenrintr apcupsd
> 44103 713 1 0 3 0x4000088 sigwait apcupsd
> 44103 150015 1 0 3 0x4000080 nanoslp apcupsd
> 50965 3323 1 99 3 0x1100090 kqread sndiod
> 71867 276765 1 110 3 0x100090 kqread sndiod
> 34357 67095 26179 95 3 0x1100092 kqread smtpd
> 10 513680 26179 103 3 0x1100092 kqread smtpd
> 52452 160022 26179 95 3 0x1100092 kqread smtpd
> 90405 278010 26179 95 3 0x100092 kqread smtpd
> 72697 376232 26179 95 3 0x1100092 kqread smtpd
> 34913 341651 26179 95 3 0x1100092 kqread smtpd
> 26179 215702 1 0 3 0x100080 kqread smtpd
> 93820 493698 1 77 3 0x1100090 kqread dhcpd
> 64394 151208 1 0 3 0x88 kqread sshd
> 97278 107684 59093 68 3 0x1000090 kqread isakmpd
> 59093 449646 1 0 3 0x80 netio isakmpd
> 49802 149663 1 0 3 0x100080 kqread ntpd
> 44659 508754 57384 83 3 0x100092 kqread ntpd
> 57384 404430 1 83 3 0x1100092 kqread ntpd
> 64027 105440 36503 73 3 0x1100090 kqread syslogd
> 36503 201216 1 0 3 0x100082 netio syslogd
> 11381 331748 1 0 3 0x100080 kqread resolvd
> 9570 311813 57274 77 3 0x100092 kqread dhcpleased
> 87989 131244 57274 77 3 0x100092 kqread dhcpleased
> 57274 255861 1 0 3 0x80 kqread dhcpleased
> 31477 195931 39386 115 3 0x100092 kqread slaacd
> 57270 49119 39386 115 3 0x100092 kqread slaacd
> 39386 347806 1 0 3 0x100080 kqread slaacd
> 42711 64581 0 0 3 0x14200 bored smr
> 82209 488050 0 0 3 0x14200 pgzero zerothread
> 88827 110871 0 0 3 0x14200 aiodoned aiodoned
> 79017 103378 0 0 3 0x14200 syncer update
> 73621 411381 0 0 3 0x14200 cleaner cleaner
> 95505 482237 0 0 3 0x14200 reaper reaper
> 43884 106144 0 0 3 0x14200 pgdaemon pagedaemon
> 66804 226805 0 0 3 0x14200 bored sensors
> 14651 267317 0 0 3 0x14200 mmctsk sdmmc0
> 54291 355121 0 0 3 0x14200 usbtsk usbtask
> 13264 391780 0 0 3 0x14200 usbatsk usbatsk
> 82631 61778 0 0 3 0x40014200 acpi0 acpi0
> *65427 93856 0 0 7 0x40014200 idle3
> 70369 130362 0 0 3 0x40014200 idle2
> 64733 171406 0 0 7 0x40014200 idle1
> 83430 199559 0 0 7 0x14200 softnet
> 9252 434573 0 0 3 0x14200 bored systqmp
> 62894 461297 0 0 3 0x14200 bored systq
> 12125 366427 0 0 3 0x40014200 bored softclock
> 448 399780 0 0 7 0x40014200 idle0
> 1 316948 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{3}>
>
> ddb{3}> show uvm
> Current UVM status:
> pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
> 1006345 VM pages: 9696 active, 131983 inactive, 1 wired, 684760 free (85603
> z
> ero)
> min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
> freemin=33544, free-target=44725, inactive-target=0, wired-max=335448
> faults=798205, traps=744681, intrs=585221521, ctxswitch=205790919
> fpuswitch=0
>
> softint=6176968, syscalls=3428885, kmapent=10
> fault counts:
> noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
> ok relocks(total)=179579(182635), anget(retries)=295524(0),
> amapcopy=103808
>
> neighbor anon/obj pg=141748/311391, gets(lock/unlock)=279954/182674
> cases: anon=252356, anoncow=43168, obj=258019, prcopy=18840, przero=225802
> daemon and swap counts:
> woke=0, revs=0, scans=0, obscans=0, anscans=0
> busy=0, freed=0, reactivate=0, deactivate=0
> pageouts=0, pending=0, nswget=0
> nswapdev=1
> swpages=130304, swpginuse=0, swpgonly=0 paging=0
> kernel pointers:
> objs(kern)=0xffffffff822e6290
> ddb{3}>
>
> ddb{3}> show bcstats
> Current Buffer Cache status:
> numbufs 40685 busymapped 0, delwri 0
> kvaslots 6553 avail kva slots 6553
> bufpages 162704, dmapages 162704, dirtypages 0
> pendingreads 0, pendingwrites 0
> highflips 0, highflops 0, dmaflips 0
> ddb{3}>
>
> ddb{0}> show registers
> rdi 0xffffffff82287ff0 cpu_info_full_primary+0x1ff0
> rsi 0
> rbp 0xffff8000225bbbb0
> rbx 0xffffffff82292fe8 ipifunc+0x38
> rdx 0
> rcx 0x7
> rax 0xffffff7f
> r8 0
> r9 0
> r10 0
> r11 0xa442baf413a7822
> r12 0x7
> r13 0
> r14 0xffffffff82287ff0 cpu_info_full_primary+0x1ff0
> r15 0
> rip 0xffffffff812d7f72 x86_ipi_db+0x12
> cs 0x8
> rflags 0x206
> rsp 0xffff8000225bbba0
> ss 0x10
> x86_ipi_db+0x12: leave
> ddb{0}>
>
> ################################
> ## 2 crash
> ################################
> ddb{2}> show panic
> *cpu2: uvm_fault(0xffffffff823e7b78, 0xffffffffffffffa1, 0, 1) -> e
> ddb{2}> trace
> pf_test(2,1,ffff8000000b0048,ffff8000225d3908) at pf_test+0xd3f
> ip_input_if(ffff8000225d3908,ffff8000225d3914,4,0,ffff8000000b0048) at
> ip_input
> _if+0xcd
> ipv4_input(ffff8000000b0048,fffffd80a65daa00) at ipv4_input+0x39
> ether_input(ffff8000000b0048,fffffd80a65daa00) at ether_input+0x3a2
> if_input_process(ffff8000000b0048,ffff8000225d39f8) at if_input_process+0x6f
> ifiq_process(ffff8000000b0458) at ifiq_process+0x69
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: -7
> ddb{2}>
>
> ddb{2}> mach ddbcpu 0
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffffffff82278ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff82278ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{0}> trace
> x86_ipi_db(ffffffff82278ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff82278ff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{0}>
>
> ddb{0}> mach ddbcpu 1
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> _kernel_lock() at _kernel_lock+0xa9
> vn_ioctl(fffffd810b500170,80045572,ffff80002272a670,ffff8000226d8fc8) at
> vn_ioc
> tl+0x3b
> sys_ioctl(ffff8000226d8fc8,ffff80002272a780,ffff80002272a7d0) at
> sys_ioctl+0x2c
> 4
> syscall(ffff80002272a840) at syscall+0x374
> Xsyscall() at Xsyscall+0x128
> end of kernel
> end trace frame: 0x7f7ffffe6eb0, count: 7
> ddb{1}> trace
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> _kernel_lock() at _kernel_lock+0xa9
> vn_ioctl(fffffd810b500170,80045572,ffff80002272a670,ffff8000226d8fc8) at
> vn_ioc
> tl+0x3b
> sys_ioctl(ffff8000226d8fc8,ffff80002272a780,ffff80002272a7d0) at
> sys_ioctl+0x2c
> 4
> syscall(ffff80002272a840) at syscall+0x374
> Xsyscall() at Xsyscall+0x128
> end of kernel
> end trace frame: 0x7f7ffffe6eb0, count: -8
> ddb{1}>
>
> ddb{1}> mach ddbcpu 2
> Stopped at pf_test+0xd3f: cmpq $0,0xffffffffffffffa0(%rbp)
> pf_test(2,1,ffff8000000b0048,ffff8000225d3908) at pf_test+0xd3f
> ip_input_if(ffff8000225d3908,ffff8000225d3914,4,0,ffff8000000b0048) at
> ip_input
> _if+0xcd
> ipv4_input(ffff8000000b0048,fffffd80a65daa00) at ipv4_input+0x39
> ether_input(ffff8000000b0048,fffffd80a65daa00) at ether_input+0x3a2
> if_input_process(ffff8000000b0048,ffff8000225d39f8) at if_input_process+0x6f
> ifiq_process(ffff8000000b0458) at ifiq_process+0x69
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: 8
> ddb{2}> trace
> pf_test(2,1,ffff8000000b0048,ffff8000225d3908) at pf_test+0xd3f
> ip_input_if(ffff8000225d3908,ffff8000225d3914,4,0,ffff8000000b0048) at
> ip_input
> _if+0xcd
> ipv4_input(ffff8000000b0048,fffffd80a65daa00) at ipv4_input+0x39
> ether_input(ffff8000000b0048,fffffd80a65daa00) at ether_input+0x3a2
> if_input_process(ffff8000000b0048,ffff8000225d39f8) at if_input_process+0x6f
> ifiq_process(ffff8000000b0458) at ifiq_process+0x69
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: -7
> ddb{2}>
>
> ddb{2}> mach ddbcpu 3
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{3}> trace
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{3}>
>
> ddb{3}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 18786 192709 58761 74 3 0x1100092 bpf pflogd
> 58761 278832 1 0 3 0x80 netio pflogd
> 17095 346121 1 0 3 0x100083 ttyin getty
> 28647 296658 1 0 3 0x100098 kqread cron
> 3840 195417 1 0 7 0 apcupsd
> 3840 195403 1 0 3 0x4000088 sigwait apcupsd
> 3840 66907 1 0 3 0x4000080 nanoslp apcupsd
> 5575 145972 1 99 3 0x1100090 kqread sndiod
> 82712 271463 1 110 3 0x100090 kqread sndiod
> 3292 494927 47783 95 3 0x1100092 kqread smtpd
> 19851 345753 47783 103 3 0x1100092 kqread smtpd
> 25487 6386 47783 95 3 0x1100092 kqread smtpd
> 95553 317440 47783 95 3 0x100092 kqread smtpd
> 5728 467970 47783 95 3 0x1100092 kqread smtpd
> 87187 40306 47783 95 3 0x1100092 kqread smtpd
> 47783 97182 1 0 3 0x100080 kqread smtpd
> 36618 311703 1 77 3 0x1100090 kqread dhcpd
> 90948 99767 1 0 3 0x88 kqread sshd
> 71427 143135 75087 68 3 0x1000090 kqread isakmpd
> 75087 313435 1 0 3 0x80 netio isakmpd
> 48951 335246 1 0 3 0x100080 kqread ntpd
> 59031 181420 22560 83 3 0x100092 kqread ntpd
> 22560 184395 1 83 3 0x1100092 kqread ntpd
> 54363 325963 43364 73 3 0x1100090 kqread syslogd
> 43364 155395 1 0 3 0x100082 netio syslogd
> 72590 263691 1 0 3 0x100080 kqread resolvd
> 35205 317766 57940 77 3 0x100092 kqread dhcpleased
> 89271 383411 57940 77 3 0x100092 kqread dhcpleased
> 57940 51069 1 0 3 0x80 kqread dhcpleased
> 19406 55970 11913 115 3 0x100092 kqread slaacd
> 84290 255466 11913 115 3 0x100092 kqread slaacd
> 11913 108823 1 0 3 0x100080 kqread slaacd
> 53785 231640 0 0 3 0x14200 bored smr
> 55421 149133 0 0 3 0x14200 pgzero zerothread
> 88299 299282 0 0 3 0x14200 aiodoned aiodoned
> 6579 306203 0 0 3 0x14200 syncer update
> 38245 142963 0 0 3 0x14200 cleaner cleaner
> 53139 161000 0 0 3 0x14200 reaper reaper
> 27845 474222 0 0 3 0x14200 pgdaemon pagedaemon
> 8021 412594 0 0 3 0x14200 bored sensors
> 54071 194050 0 0 3 0x14200 mmctsk sdmmc0
> 31760 433436 0 0 3 0x14200 usbtsk usbtask
> 40004 488655 0 0 3 0x14200 usbatsk usbatsk
> 82770 151352 0 0 3 0x40014200 acpi0 acpi0
> *77371 6778 0 0 7 0x40014200 idle3
> 1274 278498 0 0 3 0x40014200 idle2
> 57696 475518 0 0 3 0x40014200 idle1
> 3301 438670 0 0 7 0x14200 softnet
> 74095 211587 0 0 3 0x14200 bored systqmp
> 77838 22650 0 0 3 0x14200 bored systq
> 46410 326261 0 0 3 0x40014200 bored softclock
> 87979 107563 0 0 7 0x40014200 idle0
> 1 407722 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{3}>
>
> ddb{3}> show uvm
> Current UVM status:
> pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
> 1006345 VM pages: 9715 active, 145048 inactive, 1 wired, 668912 free (83616
> z
> ero)
> min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
> freemin=33544, free-target=44725, inactive-target=0, wired-max=335448
> faults=1231983, traps=1139724, intrs=934900696, ctxswitch=336921912
> fpuswitch
> =0
> softint=12182175, syscalls=7400742, kmapent=10
> fault counts:
> noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
> ok relocks(total)=192531(195581), anget(retries)=504593(0),
> amapcopy=179652
>
> neighbor anon/obj pg=264949/543704, gets(lock/unlock)=363650/195619
> cases: anon=426082, anoncow=78511, obj=329440, prcopy=31122, przero=366813
> daemon and swap counts:
> woke=0, revs=0, scans=0, obscans=0, anscans=0
> busy=0, freed=0, reactivate=0, deactivate=0
> pageouts=0, pending=0, nswget=0
> nswapdev=1
> swpages=130304, swpginuse=0, swpgonly=0 paging=0
> kernel pointers:
> objs(kern)=0xffffffff823bac88
> ddb{3}>
>
> ddb{3}> show bcstats
> Current Buffer Cache status:
> numbufs 40682 busymapped 0, delwri 0
> kvaslots 6553 avail kva slots 6553
> bufpages 162689, dmapages 162689, dirtypages 0
> pendingreads 1, pendingwrites 0
> highflips 0, highflops 0, dmaflips 0
> ddb{3}>
>
> ddb{3}> show reg
> rdi 0xffff80002241aff0
> rsi 0
> rbp 0xffff8000225e4f10
> rbx 0xffffffff8227a5e8 ipifunc+0x38
> rdx 0
> rcx 0x7
> rax 0xffffff7f
> r8 0
> r9 0
> r10 0
> r11 0x907fee6b3ddd881e
> r12 0x7
> r13 0
> r14 0xffff80002241aff0
> r15 0
> rip 0xffffffff81e7bfd2 x86_ipi_db+0x12
> cs 0x8
> rflags 0x286
> rsp 0xffff8000225e4f00
> ss 0x10
> x86_ipi_db+0x12: leave
> ddb{3}>
>
> ################################
> ## 3 crash
> ################################
> ddb{2}> show panic
> *cpu2: uvm_fault(0xffffffff8235a498, 0x89bd, 0, 1) -> e
> ddb{2}>
>
> ddb{2}> trace
> db_read_bytes(89bd,8,ffff8000225d3088) at db_read_bytes+0x3f
> db_get_value(89bd,8,0) at db_get_value+0x3f
> db_stack_trace_print(ffffffff81e48786,0,e,ffffffff81fb3c4c,ffffffff81778930)
> at
> db_stack_trace_print+0x2ed
> db_trap(6,0) at db_trap+0xeb
> db_ktrap(6,0,ffff8000225d3280) at db_ktrap+0x112
> kerntrap(ffff8000225d3280) at kerntrap+0xa2
> alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
> end of kernel
> end trace frame: 0x89c5, count: -7
> ddb{2}>
>
> ddb{2}> mach ddbcpu 0
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffffffff82281ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff82281ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{0}> trace
> x86_ipi_db(ffffffff82281ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff82281ff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{0}>
>
> ddb{0}> mach ddbcpu 1
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff800022408ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{1}> trace
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff800022408ff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{1}>
>
> ddb{1}> mach ddbcpu 2
> Stopped at db_read_bytes+0x3f: movq 0(%rdi),%rax
> db_read_bytes(89bd,8,ffff8000225d3088) at db_read_bytes+0x3f
> db_get_value(89bd,8,0) at db_get_value+0x3f
> db_stack_trace_print(ffffffff81e48786,0,e,ffffffff81fb3c4c,ffffffff81778930)
> at
> db_stack_trace_print+0x2ed
> db_trap(6,0) at db_trap+0xeb
> db_ktrap(6,0,ffff8000225d3280) at db_ktrap+0x112
> kerntrap(ffff8000225d3280) at kerntrap+0xa2
> alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
> end of kernel
> end trace frame: 0x89c5, count: 8
> ddb{2}> trace
> db_read_bytes(89bd,8,ffff8000225d3088) at db_read_bytes+0x3f
> db_get_value(89bd,8,0) at db_get_value+0x3f
> db_stack_trace_print(ffffffff81e48786,0,e,ffffffff81fb3c4c,ffffffff81778930)
> at
> db_stack_trace_print+0x2ed
> db_trap(6,0) at db_trap+0xeb
> db_ktrap(6,0,ffff8000225d3280) at db_ktrap+0x112
> kerntrap(ffff8000225d3280) at kerntrap+0xa2
> alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
> end of kernel
> end trace frame: 0x89c5, count: -7
> ddb{2}>
>
> ddb{2}> mach ddbcpu 3
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{3}> trace
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{3}>
>
> ddb{3}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 79014 416712 65657 74 3 0x1100092 bpf pflogd
> 65657 347637 1 0 3 0x80 netio pflogd
> 99536 127723 1 0 3 0x100083 ttyin getty
> 17245 179106 1 0 3 0x100098 kqread cron
> 81219 315921 1 0 3 0x80 ugenrintr apcupsd
> 81219 304309 1 0 3 0x4000088 sigwait apcupsd
> 81219 156503 1 0 3 0x4000080 nanoslp apcupsd
> 29392 407694 1 99 3 0x1100090 kqread sndiod
> 63914 60013 1 110 3 0x100090 kqread sndiod
> 87931 185938 79197 95 3 0x1100092 kqread smtpd
> 37085 232910 79197 103 3 0x1100092 kqread smtpd
> 67230 290647 79197 95 3 0x1100092 kqread smtpd
> 51322 318211 79197 95 3 0x100092 kqread smtpd
> 44307 463998 79197 95 3 0x1100092 kqread smtpd
> 5234 483121 79197 95 3 0x1100092 kqread smtpd
> 79197 128782 1 0 3 0x100080 kqread smtpd
> 17165 33988 1 77 3 0x1100090 kqread dhcpd
> 11574 497080 1 0 3 0x88 kqread sshd
> 58677 112506 99364 68 3 0x1000090 kqread isakmpd
> 99364 243216 1 0 3 0x80 netio isakmpd
> 78684 227237 1 0 3 0x100080 kqread ntpd
> 542 322951 55981 83 3 0x100092 kqread ntpd
> 55981 207242 1 83 3 0x1100092 kqread ntpd
> 77744 397820 1068 73 3 0x1100090 kqread syslogd
> 1068 503039 1 0 3 0x100082 netio syslogd
> 84435 394340 1 0 3 0x100080 kqread resolvd
> 17354 21607 21991 77 3 0x100092 kqread dhcpleased
> 13064 145618 21991 77 3 0x100092 kqread dhcpleased
> 21991 116344 1 0 3 0x80 kqread dhcpleased
> 71436 74891 70077 115 3 0x100092 kqread slaacd
> 89524 100253 70077 115 3 0x100092 kqread slaacd
> 70077 44664 1 0 3 0x100080 kqread slaacd
> 32640 354572 0 0 3 0x14200 bored smr
> 3455 264355 0 0 3 0x14200 pgzero zerothread
> 21852 348005 0 0 3 0x14200 aiodoned aiodoned
> 36709 308551 0 0 3 0x14200 syncer update
> 17283 238283 0 0 3 0x14200 cleaner cleaner
> 53378 451381 0 0 3 0x14200 reaper reaper
> 96540 135829 0 0 3 0x14200 pgdaemon pagedaemon
> 67122 171859 0 0 3 0x14200 bored sensors
> 16000 159573 0 0 3 0x14200 mmctsk sdmmc0
> 31587 510293 0 0 3 0x14200 usbtsk usbtask
> 55536 481444 0 0 3 0x14200 usbatsk usbatsk
> 3087 321641 0 0 3 0x40014200 acpi0 acpi0
> *53694 258769 0 0 7 0x40014200 idle3
> 24798 484852 0 0 3 0x40014200 idle2
> 2562 435576 0 0 7 0x40014200 idle1
> 29705 327571 0 0 7 0x14200 softnet
> 27662 22864 0 0 3 0x14200 bored systqmp
> 90168 425267 0 0 3 0x14200 bored systq
> 46019 433630 0 0 3 0x40014200 bored softclock
> 18421 237450 0 0 7 0x40014200 idle0
> 1 366738 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{3}>
>
> ddb{3}> show uvm
> Current UVM status:
> pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
> 1006343 VM pages: 9698 active, 131975 inactive, 1 wired, 684726 free (85599
> z
> ero)
> min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
> freemin=33544, free-target=44725, inactive-target=0, wired-max=335447
> faults=1761361, traps=1526308, intrs=1545994524, ctxswitch=542163391
> fpuswitc
> h=0
> softint=28714660, syscalls=12205806, kmapent=12
> fault counts:
> noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
> ok relocks(total)=179507(182644), anget(retries)=875330(0),
> amapcopy=265888
>
> neighbor anon/obj pg=382845/847748, gets(lock/unlock)=441654/182680
> cases: anon=761974, anoncow=113356, obj=387006, prcopy=51475,
> przero=447534
>
> daemon and swap counts:
> woke=0, revs=0, scans=0, obscans=0, anscans=0
> busy=0, freed=0, reactivate=0, deactivate=0
> pageouts=0, pending=0, nswget=0
> nswapdev=1
> swpages=130304, swpginuse=0, swpgonly=0 paging=0
> kernel pointers:
> objs(kern)=0xffffffff823e6b00
> ddb{3}>
>
> ddb{3}> show bcstats
> Current Buffer Cache status:
> numbufs 40684 busymapped 0, delwri 0
> kvaslots 6553 avail kva slots 6553
> bufpages 162700, dmapages 162700, dirtypages 0
> pendingreads 0, pendingwrites 0
> highflips 0, highflops 0, dmaflips 0
> ddb{3}>
>
> ddb{3}> show reg
> rdi 0xffff80002241aff0
> rsi 0
> rbp 0xffff8000225e50b0
> rbx 0xffffffff822a84d8 ipifunc+0x38
> rdx 0
> rcx 0x7
> rax 0xffffff7f
> r8 0
> r9 0
> r10 0
> r11 0x5547eccdef67c11
> r12 0x7
> r13 0
> r14 0xffff80002241aff0
> r15 0
> rip 0xffffffff81ae5fe2 x86_ipi_db+0x12
> cs 0x8
> rflags 0x206
> rsp 0xffff8000225e50a0
> ss 0x10
> x86_ipi_db+0x12: leave
> ddb{3}>
>
> ################################
> ## 4 crash
> ################################
> ddb{2}> show panic
> the kernel did not panic
>
> ddb{2}> trace
> priq_deq_commit(ffff8000000b02f8,fffffd80afb3e500,ffff8000000af248) at
> priq_deq
> _commit+0xc
> ifq_dequeue(ffff8000000b02f8) at ifq_dequeue+0x6d
> em_start(ffff8000000b02f8) at em_start+0xc9
> ifq_serialize(ffff8000000b02f8,ffff8000000b03d8) at ifq_serialize+0xfd
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: -5
> ddb{2}>
>
> ddb{2}> mach ddbcpu 0
> Stopped at x86_ipi_db+0x12: leave
> ddb{0}> trace
> x86_ipi_db(ffffffff8228eff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffffffff8228eff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{0}>
>
> ddb{0}> mach ddbcpu 1
> Stopped at x86_ipi_db+0x12: leave
> ddb{1}> trace
> x86_ipi_db(ffff800022408ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff800022408ff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
>
> ddb{1}> mach ddbcpu 2
> Stopped at priq_deq_commit+0xc: orl %ecx,0xffffffffffffff89(%rax)
> ddb{2}> trace
> priq_deq_commit(ffff8000000b02f8,fffffd80afb3e500,ffff8000000af248) at
> priq_deq
> _commit+0xc
> ifq_dequeue(ffff8000000b02f8) at ifq_dequeue+0x6d
> em_start(ffff8000000b02f8) at em_start+0xc9
> ifq_serialize(ffff8000000b02f8,ffff8000000b03d8) at ifq_serialize+0xfd
> taskq_thread(ffff80000002b080) at taskq_thread+0x100
> end trace frame: 0x0, count: -5
> ddb{2}>
>
> ddb{2}> mach ddbcpu 3
> Stopped at x86_ipi_db+0x12: leave
> ddb{3}> trace
> x86_ipi_db(ffff80002241aff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x11f
> sched_idle(ffff80002241aff0) at sched_idle+0x280
> end trace frame: 0x0, count: -5
> ddb{3}>
>
> ddb{3}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 54672 437739 35970 74 3 0x1100092 bpf pflogd
> 35970 75737 1 0 3 0x80 netio pflogd
> 37199 96409 1 0 3 0x100083 ttyin getty
> 34736 511693 1 0 3 0x100098 kqread cron
> 97426 122242 1 0 3 0x80 ugenrintr apcupsd
> 97426 165201 1 0 3 0x4000088 sigwait apcupsd
> 97426 409034 1 0 3 0x4000080 nanoslp apcupsd
> 19440 85167 1 99 3 0x1100090 kqread sndiod
> 44234 55565 1 110 3 0x100090 kqread sndiod
> 49727 9761 72142 95 3 0x1100092 kqread smtpd
> 80258 258604 72142 103 3 0x1100092 kqread smtpd
> 61732 83846 72142 95 3 0x1100092 kqread smtpd
> 67778 134104 72142 95 3 0x100092 kqread smtpd
> 35331 250319 72142 95 3 0x1100092 kqread smtpd
> 99139 254870 72142 95 3 0x1100092 kqread smtpd
> 72142 177112 1 0 3 0x100080 kqread smtpd
> 56759 488754 1 77 3 0x1100090 kqread dhcpd
> 41174 451846 1 0 3 0x88 kqread sshd
> 83303 485394 55282 68 3 0x1000090 kqread isakmpd
> 55282 493724 1 0 3 0x80 netio isakmpd
> 21061 339564 1 0 3 0x100080 kqread ntpd
> 10097 505523 22051 83 3 0x100092 kqread ntpd
> 22051 287415 1 83 3 0x1100092 kqread ntpd
> 43588 377847 49522 73 3 0x1100090 kqread syslogd
> 49522 37942 1 0 3 0x100082 netio syslogd
> 71772 290534 1 0 3 0x100080 kqread resolvd
> 18256 458360 69343 77 3 0x100092 kqread dhcpleased
> 86232 517402 69343 77 3 0x100092 kqread dhcpleased
> 69343 190272 1 0 3 0x80 kqread dhcpleased
> 19918 380912 48178 115 3 0x100092 kqread slaacd
> 80026 367398 48178 115 3 0x100092 kqread slaacd
> 48178 472412 1 0 3 0x100080 kqread slaacd
> 76527 259498 0 0 3 0x14200 bored smr
> 35416 105047 0 0 3 0x14200 pgzero zerothread
> 5511 448547 0 0 3 0x14200 aiodoned aiodoned
> 6827 203110 0 0 3 0x14200 syncer update
> 53801 350200 0 0 3 0x14200 cleaner cleaner
> 62618 417979 0 0 3 0x14200 reaper reaper
> 91441 2826 0 0 3 0x14200 pgdaemon pagedaemon
> 43405 94588 0 0 3 0x14200 bored sensors
> 95974 519356 0 0 3 0x14200 mmctsk sdmmc0
> 41069 149071 0 0 3 0x14200 usbtsk usbtask
> 76531 18008 0 0 3 0x14200 usbatsk usbatsk
> 58530 41343 0 0 3 0x40014200 acpi0 acpi0
> *75950 437023 0 0 7 0x40014200 idle3
> 33463 321155 0 0 3 0x40014200 idle2
> 45113 356836 0 0 7 0x40014200 idle1
> 43620 246068 0 0 7 0x14200 softnet
> 6931 54440 0 0 3 0x14200 bored systqmp
> 59718 516285 0 0 3 0x14200 bored systq
> 50734 254599 0 0 3 0x40014200 bored softclock
> 59304 521790 0 0 7 0x40014200 idle0
> 1 502891 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{3}>
>
> ddb{3}> show uvm
> Current UVM status:
> pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
> 1006342 VM pages: 9821 active, 145263 inactive, 1 wired, 668541 free (83571
> z
> ero)
> min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
> freemin=33544, free-target=44725, inactive-target=0, wired-max=335447
> faults=3507732, traps=2962222, intrs=455318619, ctxswitch=201742416
> fpuswitch
> =0
> softint=57900283, syscalls=15893029, kmapent=10
> fault counts:
> noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
> ok relocks(total)=193138(196147), anget(retries)=1862579(0),
> amapcopy=57930
> 7
> neighbor anon/obj pg=862175/1884542, gets(lock/unlock)=740311/196197
> cases: anon=1611813, anoncow=250766, obj=630478, prcopy=106774,
> przero=9078
> 87
> daemon and swap counts:
> woke=0, revs=0, scans=0, obscans=0, anscans=0
> busy=0, freed=0, reactivate=0, deactivate=0
> pageouts=0, pending=0, nswget=0
> nswapdev=1
> swpages=130304, swpginuse=0, swpgonly=0 paging=0
> kernel pointers:
> objs(kern)=0xffffffff823cc670
> ddb{3}> show bcstats
> Current Buffer Cache status:
> numbufs 40687 busymapped 0, delwri 0
> kvaslots 6553 avail kva slots 6553
> bufpages 162705, dmapages 162705, dirtypages 0
> pendingreads 2, pendingwrites 0
> highflips 0, highflops 0, dmaflips 0
> ddb{3}> show reg
> rdi 0xffff80002241aff0
> rsi 0
> rbp 0xffff8000225e5a80
> rbx 0xffffffff8228a0e8 ipifunc+0x38
> rdx 0
> rcx 0x7
> rax 0xffffff7f
> r8 0
> r9 0
> r10 0
> r11 0x8711cf1e35cc6dbc
> r12 0x7
> r13 0
> r14 0xffff80002241aff0
> r15 0
> rip 0xffffffff8157e612 x86_ipi_db+0x12
> cs 0x8
> rflags 0x282
> rsp 0xffff8000225e5a70
> ss 0x10
> x86_ipi_db+0x12: leave
> ddb{3}>
>
> ################################
> ## mount
> ################################
> /dev/sd0a on / type ffs (local)
> /dev/sd0k on /home type ffs (local, nodev, nosuid)
> /dev/sd0d on /tmp type ffs (local, nodev, nosuid)
> /dev/sd0f on /usr type ffs (local, nodev)
> /dev/sd0g on /usr/X11R6 type ffs (local, nodev)
> /dev/sd0h on /usr/local type ffs (local, nodev, wxallowed)
> /dev/sd0j on /usr/obj type ffs (local, nodev, nosuid)
> /dev/sd0i on /usr/src type ffs (local, nodev, nosuid)
> /dev/sd0e on /var type ffs (local, nodev, nosuid)
>
> ################################
> ## DMESG:
> ################################
> OpenBSD 7.1 (GENERIC.MP) #3: Sun May 15 10:27:01 MDT 2022
>
> [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 4259897344 (4062MB)
> avail mem = 4113489920 (3922MB)
> random: good seed from bootblocks
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 3.0 @ 0xcfe92040 (13 entries)
> bios0: vendor coreboot version "v4.17.0.1" date 06/22/2022
> bios0: PC Engines apu4
> acpi0 at bios0: ACPI 6.0
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP SSDT MCFG TPM2 APIC HEST SSDT SSDT DRTM HPET
> acpi0: wakeup devices PBR4(S4) PBR5(S4) PBR6(S4) PBR7(S4) PBR8(S4) UOH1(S3)
> UOH2(S3) UOH3(S3) UOH4(S3) UOH5(S3) UOH6(S3) XHC0(S4)
> acpitimer0 at acpi0: 3579545 Hz, 32 bits
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xf8000000, bus 0-63
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: AMD GX-412TC SOC, 998.28 MHz, 16-30-01
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TOPEXT,DBKP,PERFTSC,PCTRL3,ITSC,BMI1,XSAVEOPT
> cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 2MB 64b/line
> 16-way L2 cache
> cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
> cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> cpu0: apic clock running at 99MHz
> cpu0: mwait min=64, max=64, IBE
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: AMD GX-412TC SOC, 998.14 MHz, 16-30-01
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TOPEXT,DBKP,PERFTSC,PCTRL3,ITSC,BMI1,XSAVEOPT
> cpu1: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 2MB 64b/line
> 16-way L2 cache
> cpu1: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
> cpu1: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 2 (application processor)
> cpu2: AMD GX-412TC SOC, 998.14 MHz, 16-30-01
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TOPEXT,DBKP,PERFTSC,PCTRL3,ITSC,BMI1,XSAVEOPT
> cpu2: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 2MB 64b/line
> 16-way L2 cache
> cpu2: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
> cpu2: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 3 (application processor)
> cpu3: AMD GX-412TC SOC, 998.14 MHz, 16-30-01
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TOPEXT,DBKP,PERFTSC,PCTRL3,ITSC,BMI1,XSAVEOPT
> cpu3: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 2MB 64b/line
> 16-way L2 cache
> cpu3: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
> cpu3: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
> cpu3: smt 0, core 3, package 0
> ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 21, 24 pins
> ioapic1 at mainbus0: apid 5 pa 0xfec20000, version 21, 32 pins
> acpihpet0 at acpi0: 14318180 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (PBR4)
> acpiprt2 at acpi0: bus 2 (PBR5)
> acpiprt3 at acpi0: bus 3 (PBR6)
> acpiprt4 at acpi0: bus 4 (PBR7)
> acpiprt5 at acpi0: bus -1 (PBR8)
> acpicpu0 at acpi0: C2(0@400 io@0x1771), C1(@1 halt!), PSS
> acpicpu1 at acpi0: C2(0@400 io@0x1771), C1(@1 halt!), PSS
> acpicpu2 at acpi0: C2(0@400 io@0x1771), C1(@1 halt!), PSS
> acpicpu3 at acpi0: C2(0@400 io@0x1771), C1(@1 halt!), PSS
> acpicpu4 at acpi0: no cpu matching ACPI ID 4
> acpicpu5 at acpi0: no cpu matching ACPI ID 5
> acpicpu6 at acpi0: no cpu matching ACPI ID 6
> acpicpu7 at acpi0: no cpu matching ACPI ID 7
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> com0 at acpi0 COM1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at acpi0 COM2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
> amdgpio0 at acpi0 GPIO uid 0 addr 0xfed81500/0x300 irq 7, 184 pins
> "PRP0001" at acpi0 not configured
> "PRP0001" at acpi0 not configured
> "PRP0001" at acpi0 not configured
> "PRP0001" at acpi0 not configured
> "PRP0001" at acpi0 not configured
> "PRP0001" at acpi0 not configured
> "BOOT0000" at acpi0 not configured
> acpitz0 at acpi0: critical temperature is 115 degC
> cpu0: 998 MHz: speeds: 1000 800 600 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "AMD 16h Root Complex" rev 0x00
> vendor "AMD", unknown product 0x1567 (class system subclass IOMMU, rev 0x00)
> at pci0 dev 0 function 2 not configured
> pchb1 at pci0 dev 2 function 0 "AMD 16h Host" rev 0x00
> ppb0 at pci0 dev 2 function 1 "AMD 16h PCIE" rev 0x00: msi
> pci1 at ppb0 bus 1
> em0 at pci1 dev 0 function 0 "Intel I211" rev 0x03: msi, address
> 00:0d:b9:59:e0:e4
> ppb1 at pci0 dev 2 function 2 "AMD 16h PCIE" rev 0x00: msi
> pci2 at ppb1 bus 2
> em1 at pci2 dev 0 function 0 "Intel I211" rev 0x03: msi, address
> 00:0d:b9:59:e0:e5
> ppb2 at pci0 dev 2 function 3 "AMD 16h PCIE" rev 0x00: msi
> pci3 at ppb2 bus 3
> em2 at pci3 dev 0 function 0 "Intel I211" rev 0x03: msi, address
> 00:0d:b9:59:e0:e6
> ppb3 at pci0 dev 2 function 4 "AMD 16h PCIE" rev 0x00: msi
> pci4 at ppb3 bus 4
> em3 at pci4 dev 0 function 0 "Intel I211" rev 0x03: msi, address
> 00:0d:b9:59:e0:e7
> ccp0 at pci0 dev 8 function 0 "AMD 16h Crypto" rev 0x00
> xhci0 at pci0 dev 16 function 0 "AMD Bolton xHCI" rev 0x11: msi, xHCI 1.0
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "AMD xHCI root hub" rev 3.00/1.00
> addr 1
> ahci0 at pci0 dev 17 function 0 "AMD Hudson-2 SATA" rev 0x40: apic 4 int 19,
> AHCI 1.3
> ahci0: port 0: 6.0Gb/s
> scsibus1 at ahci0: 32 targets
> sd0 at scsibus1 targ 0 lun 0: <ATA, Hoodisk SSD, SBFM>
> t10.ATA_Hoodisk_SSD_L7DTC7A11208345_
> sd0: 15272MB, 512 bytes/sector, 31277232 sectors, thin
> ehci0 at pci0 dev 18 function 0 "AMD Hudson-2 USB2" rev 0x39: apic 4 int 18
> usb1 at ehci0: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "AMD EHCI root hub" rev 2.00/1.00
> addr 1
> ehci1 at pci0 dev 19 function 0 "AMD Hudson-2 USB2" rev 0x39: apic 4 int 18
> usb2 at ehci1: USB revision 2.0
> uhub2 at usb2 configuration 1 interface 0 "AMD EHCI root hub" rev 2.00/1.00
> addr 1
> piixpm0 at pci0 dev 20 function 0 "AMD Hudson-2 SMBus" rev 0x42: SMI
> iic0 at piixpm0
> iic1 at piixpm0
> iic1: addr 0x4c 3e=00 48=00 4a=00 4e=00 fc=00 fe=00 words 00=ffff 01=ffff
> 02=ffff 03=ffff 04=ffff 05=ffff 06=ffff 07=ffff
> pcib0 at pci0 dev 20 function 3 "AMD Hudson-2 LPC" rev 0x11
> sdhc0 at pci0 dev 20 function 7 "AMD Bolton SD/MMC" rev 0x01: apic 4 int 16
> sdhc0: SDHC 2.0, 50 MHz base clock
> sdmmc0 at sdhc0: 4-bit, sd high-speed, mmc high-speed, dma
> pchb2 at pci0 dev 24 function 0 "AMD 16h Link Cfg" rev 0x00
> pchb3 at pci0 dev 24 function 1 "AMD 16h Address Map" rev 0x00
> pchb4 at pci0 dev 24 function 2 "AMD 16h DRAM Cfg" rev 0x00
> km0 at pci0 dev 24 function 3 "AMD 16h Misc Cfg" rev 0x00
> pchb5 at pci0 dev 24 function 4 "AMD 16h CPU Power" rev 0x00
> pchb6 at pci0 dev 24 function 5 "AMD 16h Misc Cfg" rev 0x00
> isa0 at pcib0
> isadma0 at isa0
> com2 at isa0 port 0x3e8/8 irq 5: ns16550a, 16 byte fifo
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> lpt0 at isa0 port 0x378/4 irq 7
> intr_establish: pic ioapic0 pin 7: can't share type 3 with 2
> wbsio0 at isa0 port 0x2e/2: NCT5104D rev 0x53
> vmm0 at mainbus0: SVM/RVI
> ugen0 at uhub0 port 3 "American Power Conversion Back-UPS CS 350 FW:807.q10
> .I USB FW:q10" rev 1.10/0.06 addr 2
> uhub3 at uhub1 port 1 configuration 1 interface 0 "Advanced Micro Devices
> Hub" rev 2.00/0.18 addr 2
> uhub4 at uhub2 port 1 configuration 1 interface 0 "Advanced Micro Devices
> Hub" rev 2.00/0.18 addr 2
> vscsi0 at root
> scsibus2 at vscsi0: 256 targets
> softraid0 at root
> scsibus3 at softraid0: 256 targets
> root on sd0a (32f9bdbf62dd1c51.a) swap on sd0b dump on sd0b
>
> --
> Radek
>
Radek
