On 31/01/22(Mon) 00:54, Thomas Frohwein wrote:
> On Sat, 29 Jan 2022 12:15:10 -0300
> Martin Pieuchot <[email protected]> wrote:
>
> > On 28/01/22(Fri) 23:03, Thomas Frohwein wrote:
> > > On Sat, 29 Jan 2022 15:19:20 +1100
> > > Jonathan Gray <[email protected]> wrote:
> > >
> > > > does this diff to revert uvm_fault.c rev 1.124 change anything?
> > >
> > > Unfortunately no. Same pmap error as in the original bug report occurs
> > > with a kernel with this diff.
> >
> > Could you submit a new bug report? Could you manage to include ps and the
> > trace of all the CPUs when the pmap corruption occurs?
>
> See below
>
> >
> > Do you have some steps to reproduce the corruption? Which program is
> > currently running? Is it multi-threaded? What is the simplest scenario
> > to trigger the corruption?
>
> It's during boot of the MP kernel. The only scenario I can provide is
> booting this machine with an MP kernel from January 18 or newer. If I
> boot SP kernel, or build an MP kernel with jsg@'s diff that adds
> `pool_debug = 2`, the panic does _not_ occur.
This indicates some race is present and not triggered if more context
switches occur.
> Here some new (hand-typed from a picture) output when I boot a freshly
> downloaded snapshot MP kernel from January 30th (note this is an 8 core/16
> hyperthreads CPU; I have _not_ enabled hyperthreading). I attached dmesg from
> booting bsd.sp, too.
Thanks, so most CPUs already reached the idle loop and are not yet running
anything.
Nobody is running the KERNEL_LOCK(), the faulting process obviously
isn't and I don't understand which one it is.
Note that the corruption occurred on CPU2. We don't know where it
occurred the previous time. This is interesting to watch to understand
between which CPUs the race is occurring.
> ... (boot, see dmesg in original bugs@ submission)
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
> iwm0: hw rev 0x200, fw ver 36.ca7b901d.0, address [...]
> va 7f7fffffb000 ppa ffffffffff000
^^^^^^^^^^^^
That the faulting address, right? This is the same as in the first
report. It seems to be inside the level 1 page table range, is it?
What does that mean?
I don't understand which process is triggering the fault. Maybe
somebody (jsg@?) could craft a diff to figure out if this same address
fault and which thread/context is faulting it in SP and/or with
pool_debug = 2.
Something like:
if (va == 0x7f7fffffb000)
db_enter();
> panic: pmap_get_ptp: unmanaged user PTP
> Stopped at db_enter+0x10: popq %rbp
> TID PID UID PRFLAGS PFLAGS CPU COMMAND
> * 28644 1 0 0 0 2K swapper
> db_enter() at db_enter+0x10
> panic(ffffffff81f3dd1f) at panic+0xbf
> pmap_get_ptp(fffffd888e52ee58,7f7fffffb000) at pmap_get_ptp+0x303
> pmap_enter(fffffd888e52ee58,7f7fffffb000,13d151000,3,22) at pmap_enter+0x188
> uvm_fault_lower(ffff8000156852a0,ffff8000156852d8,ffff800015685220,0) at
> uvm_fault_lower+0x63d
> uvm_fault(fffffd888e52fdd0,7f7fffffb000,0,2) at uvm_fault+0x1b3
> kpageflttrap(ffff800015685420,7f7fffffbff5) at kpageflttrap+0x12c
> kerntrap(ffff800015685420) at kerntrap+0x91
> alltraps_kern_meltdown() at alltraps_kern_meltdown+0x7b
> copyout() at copyout+0x53
> end trace frame: 0x0, count: 5
> https://www.openbsd.org/ [...]
> ddb{2}> show panic
> *cpu2: pmap_get_ptp: unmanaged user PTP
> ddb{2}> mach ddbcpu 0
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffffffff822acff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(fffffffff822acff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{0}> mach ddbcpu 1
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800015363ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff800015363ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{1}> mach ddbcpu 3
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800015375ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff800015375ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{3}> mach ddbcpu 4
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff80001537eff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff80001537eff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{4}> mach ddbcpu 5
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800015387ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff800015387ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{5}> mach ddbcpu 6
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800015390ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff800015390ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{6}> mach ddbcpu 7
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff800015399ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff800015399ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{7}> mach ddbcpu 8
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153a2ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153a2ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{8}> mach ddbcpu 9
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153abff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153abff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{9}> mach ddbcpu 0xa
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153b4ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153b4ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{10}> mach ddbcpu 0xb
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153bdff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153bdff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{11}> mach ddbcpu 0xc
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153c6ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153c6ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{12}> mach ddbcpu 0xd
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153cfff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153cfff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{13}> mach ddbcpu 0xe
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153d8ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153d8ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{14}> mach ddbcpu 0xf
> Stopped at x86_ipi_db+0x12: leave
> x86_ipi_db(ffff8000153e1ff0) at x86_ipi_db+0x12
> x86_ipi_handler() at x86_ipi_handler+0x80
> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
> acpicpu_idle() at acpicpu_idle+0x203
> sched_idle(ffff8000153e1ff0) at sched_idle+0x280
> end trace frame: 0x0, count: 10
> ddb{15}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 34992 268880 0 0 3 0x14200 bored drm_dp_mst_wq
> 19546 295894 0 0 3 0x14200 bored drm_dp_mst_wq
> 32041 452681 0 0 3 0x14200 bored drm_dp_mst_wq
> 44841 231463 0 0 3 0x14200 bored i915_flip
> 99773 112648 0 0 3 0x14200 bored i915_modeset
> 75904 392172 0 0 3 0x14200 bored card0-crtc3
> 67421 60840 0 0 3 0x14200 bored card0-crtc2
> 21945 150670 0 0 3 0x14200 bored card0-crtc1
> 21171 342272 0 0 3 0x14200 bored card0-crtc0
> 28777 169581 0 0 3 0x14200 bored i915-dp
> 78178 475921 0 0 3 0x14200 bored i915
> 20530 135091 0 0 3 0x14200 bored smr
> 66512 222112 0 0 3 0x14200 pgzero zerothread
> 54969 227961 0 0 3 0x14200 aiodoned aiodoned
> 77902 425591 0 0 3 0x14200 syncer update
> 47313 344254 0 0 3 0x14200 cleaner cleaner
> 60499 262965 0 0 3 0x14200 reaper reaper
> 6817 430730 0 0 3 0x14200 pgdaemon pagedaemon
> 40269 322341 0 0 3 0x14200 bored srdis
> 41877 427340 0 0 3 0x14200 bored iwmns
> 13971 504248 0 0 3 0x14200 usbtsk usbtask
> 93006 202648 0 0 3 0x14200 usbatsk usbatsk
> 84901 500969 0 0 3 0x14200 bored drmtskl
> 49897 391877 0 0 3 0x14200 bored drmlwq
> 97178 399831 0 0 3 0x14200 bored drmlwq
> 35775 464943 0 0 3 0x14200 bored drmlwq
> 52494 425212 0 0 3 0x14200 bored drmlwq
> 97895 483706 0 0 3 0x14200 bored drmubwq
> 18246 380280 0 0 3 0x14200 bored drmubwq
> 99173 4346 0 0 3 0x14200 bored drmubwq
> 86349 342816 0 0 3 0x14200 bored drmubwq
> 66334 165604 0 0 3 0x14200 bored drmhpwq
> 12695 160194 0 0 3 0x14200 bored drmhpwq
> 68941 131580 0 0 3 0x14200 bored drmhpwq
> 89929 180404 0 0 3 0x14200 bored drmhpwq
> 14996 361589 0 0 3 0x14200 bored drmwq
> 20554 308229 0 0 3 0x14200 bored drmwq
> 58272 379826 0 0 3 0x14200 bored drmwq
> 89009 395625 0 0 3 0x14200 bored drmwq
> 71852 36823 0 0 3 0x40014200 acpi0 acpi0
> *77503 500831 0 0 7 0x40014200 idle15
> 18007 10163 0 0 7 0x40014200 idle14
> 50231 828 0 0 7 0x40014200 idle13
> 87222 219074 0 0 7 0x40014200 idle12
> 60504 123009 0 0 7 0x40014200 idle11
> 62458 65307 0 0 7 0x40014200 idle10
> 54799 80897 0 0 7 0x40014200 idle9
> 59482 433632 0 0 7 0x40014200 idle8
> 48340 504611 0 0 7 0x40014200 idle7
> 19443 463425 0 0 7 0x40014200 idle6
> 95515 10299 0 0 7 0x40014200 idle5
> 15505 468886 0 0 7 0x40014200 idle4
> 5311 295352 0 0 7 0x40014200 idle3
> 99707 280936 0 0 3 0x40014200 idle2
> 8604 505068 0 0 7 0x40014200 idle1
> 82775 425930 0 0 3 0x14200 bored sensors
> 86936 516370 0 0 3 0x14200 bored softnet
> 55585 496329 0 0 3 0x14200 bored systqmp
> 57589 294244 0 0 3 0x14200 bored systq
> 83109 97072 0 0 3 0x40014200 bored softclock
> 7510 212996 0 0 7 0x40014200 idle0
> 1 28644 0 0 7 0 swapper
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{15}>
>
> OpenBSD 7.0-current (GENERIC) #288: Sat Jan 29 13:33:19 MST 2022
> [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC
> real mem = 33493360640 (31941MB)
> avail mem = 32461189120 (30957MB)
> random: good seed from bootblocks
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 3.2 @ 0x3e39c000 (76 entries)
> bios0: vendor Dell Inc. version "1.7.0" date 12/10/2021
> bios0: Dell Inc. Precision 7560
> acpi0 at bios0: ACPI 6.1
> acpi0: sleep states S0 S4 S5
> acpi0: tables DSDT FACP SSDT SSDT SSDT HPET APIC MCFG SSDT NHLT SSDT SSDT
> SSDT SSDT LPIT WSMT SSDT SSDT DBGP DBG2 BOOT SSDT SSDT SSDT PTDT BGRT FPDT
> acpi0: wakeup devices GLAN(S4) XHCI(S0) XDCI(S4) HDAS(S4) RP01(S4) PXSX(S4)
> RP02(S4) PXSX(S4) RP03(S4) PXSX(S4) RP04(S4) PXSX(S4) RP05(S4) PXSX(S4)
> RP06(S4) PXSX(S4) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpihpet0 at acpi0: 19200000 Hz
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) W-11955M CPU @ 2.60GHz, 4988.50 MHz, 06-8d-01
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,PT,AVX512CD,SHA,AVX512BW,AVX512VL,AVX512VBMI,UMIP,PKU,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
> cpu0: 256KB 64b/line disabled L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 38MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.0.1.2.1.1.1, IBE
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> cpu at mainbus0: not configured
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 120 pins
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xc0000000, bus 0-255
> acpiprt0 at acpi0: bus 0 (PC00)
> acpiprt1 at acpi0: bus -1 (RP01)
> acpiprt2 at acpi0: bus 147 (RP02)
> acpiprt3 at acpi0: bus 148 (RP03)
> acpiprt4 at acpi0: bus -1 (RP04)
> acpiprt5 at acpi0: bus -1 (RP05)
> acpiprt6 at acpi0: bus -1 (RP06)
> acpiprt7 at acpi0: bus -1 (RP07)
> acpiprt8 at acpi0: bus -1 (RP08)
> acpiprt9 at acpi0: bus 149 (RP09)
> acpiprt10 at acpi0: bus -1 (RP10)
> acpiprt11 at acpi0: bus -1 (RP11)
> acpiprt12 at acpi0: bus -1 (RP12)
> acpiprt13 at acpi0: bus -1 (RP13)
> acpiprt14 at acpi0: bus -1 (RP14)
> acpiprt15 at acpi0: bus -1 (RP15)
> acpiprt16 at acpi0: bus -1 (RP16)
> acpiprt17 at acpi0: bus -1 (RP17)
> acpiprt18 at acpi0: bus -1 (RP18)
> acpiprt19 at acpi0: bus -1 (RP19)
> acpiprt20 at acpi0: bus -1 (RP20)
> acpiprt21 at acpi0: bus 146 (RP21)
> acpiprt22 at acpi0: bus -1 (RP22)
> acpiprt23 at acpi0: bus -1 (RP23)
> acpiprt24 at acpi0: bus -1 (RP24)
> acpiprt25 at acpi0: bus 2 (TRP0)
> acpiprt26 at acpi0: bus 74 (TRP1)
> acpiec0 at acpi0
> acpipci0 at acpi0 PC00: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> "INTC1043" at acpi0 not configured
> "INTC1043" at acpi0 not configured
> "INTC1043" at acpi0 not configured
> "INTC1043" at acpi0 not configured
> "INTC1043" at acpi0 not configured
> "DELL0A69" at acpi0 not configured
> "ACPI000E" at acpi0 not configured
> pchgpio0 at acpi0 GPI0 addr 0xfd6e0000/0x10000 0xfd6d0000/0x10000
> 0xfd6b0000/0x10000 0xfd6a0000/0x10000 irq 14, 480 pins
> "PNP0C14" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> "INT33A1" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> acpibtn0 at acpi0: LID0
> acpibtn1 at acpi0: PBTN
> acpiac0 at acpi0: AC unit online
> acpibat0 at acpi0: BAT0 model "DELL 17C0616" serial 989 type LiP oem "SMP"
> "INTC1051" at acpi0 not configured
> "INTC1040" at acpi0 not configured
> "USBC000" at acpi0 not configured
> acpipwrres0 at acpi0: BTRT
> acpipwrres1 at acpi0: MRST
> acpipwrres2 at acpi0: DRST
> acpipwrres3 at acpi0: PXP_, resource for RP01, PXSX
> acpipwrres4 at acpi0: WRST
> acpipwrres5 at acpi0: DRST
> acpipwrres6 at acpi0: V0PR
> acpipwrres7 at acpi0: V1PR
> acpipwrres8 at acpi0: V2PR
> acpipwrres9 at acpi0: WRST
> acpipwrres10 at acpi0: TBT0, resource for TDM0, TRP0, TRP1
> acpipwrres11 at acpi0: TBT1, resource for TDM1, TRP2, TRP3
> acpipwrres12 at acpi0: D3C_, resource for TXHC, TDM0, TDM1, TRP0, TRP1, TRP2,
> TRP3
> acpicpu0 at acpi0: C3(200@1048 mwait.1@0x60), C2(200@253 mwait.1@0x31),
> C1(1000@1 mwait.1), PSS
> acpipwrres13 at acpi0: PIN_
> acpivideo0 at acpi0: PEGP
> acpivideo1 at acpi0: GFX0
> acpivout0 at acpivideo1: LCD_
> cpu0: Enhanced SpeedStep 4988 MHz: speeds: 2601, 2600, 2500, 2300, 2200,
> 2100, 2000, 1800, 1700, 1600, 1400, 1300, 1200, 1100, 900, 800 MHz
> pci0 at mainbus0 bus 0
> 0:31:5: mem address conflict 0xfe010000/0x1000
> pchb0 at pci0 dev 0 function 0 "Intel Core 11G Host" rev 0x05
> inteldrm0 at pci0 dev 2 function 0 "Intel UHD Graphics" rev 0x01
> drm0 at inteldrm0
> inteldrm0: msi, TIGERLAKE, gen 12
> "Intel Core 11G DTT" rev 0x05 at pci0 dev 4 function 0 not configured
> ppb0 at pci0 dev 6 function 0 "Intel Core 11G PCIE" rev 0x05: msi
> pci1 at ppb0 bus 1
> nvme0 at pci1 dev 0 function 0 "ADATA Technology SX8200 Pro" rev 0x03: msix,
> NVMe 1.3
> nvme0: ADATA SX8200PNP, firmware 32B3T8EA, serial 2L232L2S85NR
> scsibus1 at nvme0: 2 targets, initiator 0
> sd0 at scsibus1 targ 1 lun 0: <NVMe, ADATA SX8200PNP, 32B3>
> sd0: 1953514MB, 512 bytes/sector, 4000797360 sectors
> ppb1 at pci0 dev 7 function 0 "Intel Core 11G PCIE" rev 0x05: msi
> pci2 at ppb1 bus 2
> ppb2 at pci0 dev 7 function 1 "Intel Core 11G PCIE" rev 0x05: msi
> pci3 at ppb2 bus 74
> "Intel Core 11G SRAM" rev 0x01 at pci0 dev 10 function 0 not configured
> xhci0 at pci0 dev 13 function 0 "Intel Core 11G xHCI" rev 0x05: msi, xHCI 1.20
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
> addr 1
> "Intel Core 11G TBT" rev 0x05 at pci0 dev 13 function 2 not configured
> "Intel 500 Series ISH" rev 0x11 at pci0 dev 18 function 0 not configured
> xhci1 at pci0 dev 20 function 0 "Intel 500 Series xHCI" rev 0x11: msi, xHCI
> 1.20
> usb1 at xhci1: USB revision 3.0
> uhub1 at usb1 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
> addr 1
> "Intel 500 Series Shared SRAM" rev 0x11 at pci0 dev 20 function 2 not
> configured
> dwiic0 at pci0 dev 21 function 0 "Intel 500 Series I2C" rev 0x11: apic 2 int
> 27
> iic0 at dwiic0
> dwiic1 at pci0 dev 21 function 1 "Intel 500 Series I2C" rev 0x11: apic 2 int
> 40
> iic1 at dwiic1
> ihidev0 at iic1 addr 0x2c irq 96, vendor 0x488 product 0x120a, DELL0A69
> ihidev0: 12 report ids
> imt0 at ihidev0: touchpad, 5 contacts
> wsmouse0 at imt0 mux 0
> ims0 at ihidev0 reportid 1: 3 buttons, Z and W dir
> wsmouse1 at ims0 mux 0
> hid at ihidev0 reportid 3 not configured
> hid at ihidev0 reportid 4 not configured
> hid at ihidev0 reportid 5 not configured
> hid at ihidev0 reportid 6 not configured
> hid at ihidev0 reportid 7 not configured
> hid at ihidev0 reportid 10 not configured
> hid at ihidev0 reportid 12 not configured
> "Intel 500 Series HECI" rev 0x11 at pci0 dev 22 function 0 not configured
> dwiic2 at pci0 dev 25 function 0 "Intel 500 Series I2C" rev 0x11: apic 2 int
> 31
> iic2 at dwiic2
> ppb3 at pci0 dev 27 function 0 "Intel 500 Series PCIE" rev 0x11: msi
> pci4 at ppb3 bus 146
> nvme1 at pci4 dev 0 function 0 "Kioxia BG4" rev 0x00: msix, NVMe 1.3
> nvme1: KBG40ZNS256G NVMe KIOXIA 256GB, firmware 10410106, serial 716PG8H1QXA3
> scsibus2 at nvme1: 2 targets, initiator 0
> sd1 at scsibus2 targ 1 lun 0: <NVMe, KBG40ZNS256G NVM, 1041>
> sd1: 244198MB, 512 bytes/sector, 500118192 sectors
> ppb4 at pci0 dev 28 function 0 "Intel 500 Series PCIE" rev 0x11: msi
> pci5 at ppb4 bus 147
> iwm0 at pci5 dev 0 function 0 "Intel AC 8260" rev 0x3a, msi
> ppb5 at pci0 dev 28 function 2 "Intel 500 Series PCIE" rev 0x11: msi
> pci6 at ppb5 bus 148
> "Realtek RTS5260 Card Reader" rev 0x01 at pci6 dev 0 function 0 not configured
> ppb6 at pci0 dev 29 function 0 "Intel 500 Series PCIE" rev 0x11: msi
> pci7 at ppb6 bus 149
> nvme2 at pci7 dev 0 function 0 vendor "Phison", unknown product 0x5012 rev
> 0x01: msix, NVMe 1.3
> nvme2: TEAM TM8FPJ4000G, firmware ECFM53.0, serial TPBF2104230020600011
> scsibus3 at nvme2: 2 targets, initiator 0
> sd2 at scsibus3 targ 1 lun 0: <NVMe, TEAM TM8FPJ4000G, ECFM>
> sd2: 3815447MB, 512 bytes/sector, 7814037168 sectors
> pcib0 at pci0 dev 31 function 0 "Intel WM590 eSPI" rev 0x11
> azalia0 at pci0 dev 31 function 3 "Intel 500 Series HD Audio" rev 0x11: msi
> azalia0: codecs: Realtek/0x0289, Intel/0x2812, using Realtek/0x0289
> audio0 at azalia0
> ichiic0 at pci0 dev 31 function 4 "Intel 500 Series SMBus" rev 0x11: apic 2
> int 16
> iic3 at ichiic0
> "Intel 500 Series SPI" rev 0x11 at pci0 dev 31 function 5 not configured
> em0 at pci0 dev 31 function 6 "Intel I219-LM" rev 0x11: msi, address
> a0:29:19:27:03:07
> isa0 at pcib0
> isadma0 at isa0
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard
> pms0 at pckbc0 (aux slot)
> wsmouse2 at pms0 mux 0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> efifb at mainbus0 not configured
> uhub2 at uhub0 port 3 configuration 1 interface 0 "Dell Inc. Dell dock" rev
> 3.10/1.47 addr 2
> uhub3 at uhub2 port 3 configuration 1 interface 0 "Dell Inc. Dell dock" rev
> 3.10/1.21 addr 3
> ure0 at uhub2 port 4 configuration 1 interface 0 "Realtek USB 10/100/1000
> LAN" rev 3.00/31.11 addr 4
> ure0: RTL8153B (0x6010), address 90:8d:6e:2f:6c:29
> rgephy0 at ure0 phy 0: RTL8251 PHY, rev. 0
> uvideo0 at uhub1 port 3 configuration 1 interface 0 "CNFHH52R1964204CCC40
> Integrated_Webcam_HD" rev 2.01/82.62 addr 2
> video0 at uvideo0
> uhub4 at uhub1 port 12 configuration 1 interface 0 "Dell Inc. Dell dock" rev
> 2.10/1.47 addr 3
> uhub5 at uhub4 port 3 configuration 1 interface 0 "Dell Inc. Dell dock" rev
> 2.10/1.21 addr 4
> uhidev0 at uhub5 port 1 configuration 1 interface 0 "Razer Razer DeathAdder
> V2" rev 2.00/2.00 addr 5
> uhidev0: iclass 3/1
> ums0 at uhidev0: 5 buttons, Z dir
> wsmouse3 at ums0 mux 0
> uhidev1 at uhub5 port 1 configuration 1 interface 1 "Razer Razer DeathAdder
> V2" rev 2.00/2.00 addr 5
> uhidev1: iclass 3/0, 5 report ids
> ukbd0 at uhidev1 reportid 1: 8 variable keys, 6 key codes
> wskbd1 at ukbd0 mux 1
> ucc0 at uhidev1 reportid 2: 573 usages, 18 keys, array
> wskbd2 at ucc0 mux 1
> uhid0 at uhidev1 reportid 3: input=15, output=0, feature=0
> uhid1 at uhidev1 reportid 4: input=15, output=0, feature=0
> uhid2 at uhidev1 reportid 5: input=15, output=0, feature=0
> uhidev2 at uhub5 port 1 configuration 1 interface 2 "Razer Razer DeathAdder
> V2" rev 2.00/2.00 addr 5
> uhidev2: iclass 3/1
> ukbd1 at uhidev2: 8 variable keys, 6 key codes
> wskbd3 at ukbd1 mux 1
> uhidev3 at uhub5 port 1 configuration 1 interface 3 "Razer Razer DeathAdder
> V2" rev 2.00/2.00 addr 5
> uhidev3: iclass 3/0, 7 report ids
> uhid3 at uhidev3 reportid 1: input=0, output=0, feature=22
> uhid4 at uhidev3 reportid 2: input=0, output=0, feature=2
> uhid5 at uhidev3 reportid 3: input=0, output=0, feature=27
> uhid6 at uhidev3 reportid 4: input=0, output=0, feature=42
> uhid7 at uhidev3 reportid 5: input=0, output=0, feature=8
> uhid8 at uhidev3 reportid 6: input=0, output=0, feature=1
> uhid9 at uhidev3 reportid 7: input=0, output=0, feature=63
> uhidev4 at uhub5 port 5 configuration 1 interface 0 "Dell Dell dock" rev
> 2.01/1.01 addr 6
> uhidev4: iclass 3/0
> uhid10 at uhidev4: input=192, output=192, feature=0
> uhidev5 at uhub4 port 5 configuration 1 interface 0 "Dell Dell dock" rev
> 2.01/1.01 addr 7
> uhidev5: iclass 3/0
> uhid11 at uhidev5: input=192, output=192, feature=0
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> softraid0: sd3 was not shutdown properly
> sd3 at scsibus5 targ 1 lun 0: <OPENBSD, SR CRYPTO, 006>
> sd3: 1953513MB, 512 bytes/sector, 4000795775 sectors
> root on sd3a (66c54421b07c8a9f.a) swap on sd3b dump on sd3b
> drm:pid0:intel_ddi_sanitize_encoder_pll_mapping *NOTICE* [drm]
> [ENCODER:316:DDI I\M^MxA\M^MN] is disabled/in DSI mode with an ungated DDI
> clock, gate it
> inteldrm0: 1920x1080, 32bpp
> wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation), using wskbd0
> wskbd1: connecting to wsdisplay0
> wskbd2: connecting to wsdisplay0
> wskbd3: connecting to wsdisplay0
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
> iwm0: hw rev 0x200, fw ver 36.ca7b901d.0, address a4:34:d9:9f:c7:e3
