> Date: Wed, 27 Apr 2022 13:52:28 -0400 (EDT) > From: [email protected] > > >Synopsis: Witnesss lock order reversal in radeondrm > >Category: kernel > >Environment: > System : OpenBSD 7.1 > Details : OpenBSD 7.1-current (CUSTOM.MP) #14: Wed Apr 27 13:22:39 > EDT 2022 > > [email protected]:/usr/src/sys/arch/amd64/compile/CUSTOM.MP > > Architecture: OpenBSD.amd64 > Machine : amd64 > >Description: > > Noticed this on a fresh kernel I built while hacking on some vmm/vmd > stuff. Probably related to the MP_LOCKDEBUG spinout I reported > previously and since bumped the spinout counter to INT_MAX.
I doubt it. The missing lock order data means we can't know for sure, but since pretty much all of the drm code still runs under the kernel lock, lock order reversals aren't necessarily problematic. > The following was in my kernel buffer after rebooting and logging > into my box: > > witness: lock order reversal: > 1st 0xfffffd91bffda1d0 uobjlk (&uobj->vmobjlock) > 2nd 0xffff800000430b78 mclk (&rdev->pm.mclk_lock) > lock order data w2 -> w1 missing > lock order "&uobj->vmobjlock"(rwlock) -> "&rdev->pm.mclk_lock"(rwlock) first > seen at: > #0 rw_enter_read+0x38 > #1 radeon_gem_fault+0x4e > #2 uvm_fault+0x179 > #3 upageflttrap+0x62 > #4 usertrap+0x129 > #5 recall_trap+0x8 > > >How-To-Repeat: > My kernel config: > > include "arch/amd64/conf/GENERIC" > > #option VMM_DEBUG > option MULTIPROCESSOR > option MP_LOCKDEBUG > option WITNESS > > cpu* at mainbus? > > >Fix: > TBD > > -dv > > dmesg: > OpenBSD 7.1-current (CUSTOM.MP) #14: Wed Apr 27 13:22:39 EDT 2022 > [email protected]:/usr/src/sys/arch/amd64/compile/CUSTOM.MP > real mem = 85769121792 (81795MB) > avail mem = 82520170496 (78697MB) > random: good seed from bootblocks > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xec0f0 (105 entries) > bios0: vendor Dell Inc. version "A32" date 09/25/2019 > bios0: Dell Inc. Precision Tower 7810 > acpi0 at bios0: ACPI 5.0 > acpi0: sleep states S0 S3 S4 S5 > acpi0: tables DSDT FACP APIC FPDT FIDT MCFG UEFI HPET MSCT SLIT SRAT SRAT > WDDT SSDT NITR SLIC MSDM DMAR ASF! > acpi0: wakeup devices IP2P(S3) RP01(S4) RP02(S4) RP03(S4) RP04(S4) RP06(S4) > RP07(S4) RP08(S4) BR1A(S4) BR1B(S4) BR2A(S4) BR2B(S4) BR2C(S4) BR2D(S4) > BR3A(S4) BR3B(S4) [...] > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.63 MHz, 06-3f-02 > cpu0: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu0: 256KB 64b/line 8-way L2 cache > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges > cpu0: apic clock running at 99MHz > cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE > cpu1 at mainbus0: apid 2 (application processor) > cpu1: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02 > cpu1: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu1: 256KB 64b/line 8-way L2 cache > cpu1: disabling user TSC (skew=9173028) > cpu1: smt 0, core 1, package 0 > cpu2 at mainbus0: apid 4 (application processor) > cpu2: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02 > cpu2: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu2: 256KB 64b/line 8-way L2 cache > cpu2: disabling user TSC (skew=9880086) > cpu2: smt 0, core 2, package 0 > cpu3 at mainbus0: apid 6 (application processor) > cpu3: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02 > cpu3: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu3: 256KB 64b/line 8-way L2 cache > cpu3: disabling user TSC (skew=8299192) > cpu3: smt 0, core 3, package 0 > cpu4 at mainbus0: apid 8 (application processor) > cpu4: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02 > cpu4: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu4: 256KB 64b/line 8-way L2 cache > cpu4: disabling user TSC (skew=3997120) > cpu4: smt 0, core 4, package 0 > cpu5 at mainbus0: apid 10 (application processor) > cpu5: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.17 MHz, 06-3f-02 > cpu5: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu5: 256KB 64b/line 8-way L2 cache > cpu5: disabling user TSC (skew=9998996) > cpu5: smt 0, core 5, package 0 > cpu6 at mainbus0: apid 16 (application processor) > cpu6: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3387.08 MHz, 06-3f-02 > cpu6: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu6: 256KB 64b/line 8-way L2 cache > cpu6: disabling user TSC (skew=10340900) > cpu6: smt 0, core 0, package 1 > cpu7 at mainbus0: apid 18 (application processor) > cpu7: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3389.31 MHz, 06-3f-02 > cpu7: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu7: 256KB 64b/line 8-way L2 cache > cpu7: disabling user TSC (skew=10266758) > cpu7: smt 0, core 1, package 1 > cpu8 at mainbus0: apid 20 (application processor) > cpu8: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu8: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu8: 256KB 64b/line 8-way L2 cache > cpu8: disabling user TSC (skew=3219982) > cpu8: smt 0, core 2, package 1 > cpu9 at mainbus0: apid 22 (application processor) > cpu9: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu9: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu9: 256KB 64b/line 8-way L2 cache > cpu9: disabling user TSC (skew=10757530) > cpu9: smt 0, core 3, package 1 > cpu10 at mainbus0: apid 24 (application processor) > cpu10: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu10: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu10: 256KB 64b/line 8-way L2 cache > cpu10: disabling user TSC (skew=10800906) > cpu10: smt 0, core 4, package 1 > cpu11 at mainbus0: apid 26 (application processor) > cpu11: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu11: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu11: 256KB 64b/line 8-way L2 cache > cpu11: disabling user TSC (skew=9320480) > cpu11: smt 0, core 5, package 1 > cpu12 at mainbus0: apid 1 (application processor) > cpu12: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.14 MHz, 06-3f-02 > cpu12: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu12: 256KB 64b/line 8-way L2 cache > cpu12: disabling user TSC (skew=177628) > cpu12: smt 1, core 0, package 0 > cpu13 at mainbus0: apid 3 (application processor) > cpu13: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu13: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu13: 256KB 64b/line 8-way L2 cache > cpu13: disabling user TSC (skew=5318056) > cpu13: smt 1, core 1, package 0 > cpu14 at mainbus0: apid 5 (application processor) > cpu14: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu14: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu14: 256KB 64b/line 8-way L2 cache > cpu14: disabling user TSC (skew=6881176) > cpu14: smt 1, core 2, package 0 > cpu15 at mainbus0: apid 7 (application processor) > cpu15: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu15: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu15: 256KB 64b/line 8-way L2 cache > cpu15: disabling user TSC (skew=10747998) > cpu15: smt 1, core 3, package 0 > cpu16 at mainbus0: apid 9 (application processor) > cpu16: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu16: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu16: 256KB 64b/line 8-way L2 cache > cpu16: disabling user TSC (skew=8146560) > cpu16: smt 1, core 4, package 0 > cpu17 at mainbus0: apid 11 (application processor) > cpu17: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu17: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu17: 256KB 64b/line 8-way L2 cache > cpu17: disabling user TSC (skew=10306570) > cpu17: smt 1, core 5, package 0 > cpu18 at mainbus0: apid 17 (application processor) > cpu18: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu18: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu18: 256KB 64b/line 8-way L2 cache > cpu18: disabling user TSC (skew=9196448) > cpu18: smt 1, core 0, package 1 > cpu19 at mainbus0: apid 19 (application processor) > cpu19: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu19: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu19: 256KB 64b/line 8-way L2 cache > cpu19: disabling user TSC (skew=9794816) > cpu19: smt 1, core 1, package 1 > cpu20 at mainbus0: apid 21 (application processor) > cpu20: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu20: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu20: 256KB 64b/line 8-way L2 cache > cpu20: disabling user TSC (skew=2824680) > cpu20: smt 1, core 2, package 1 > cpu21 at mainbus0: apid 23 (application processor) > cpu21: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu21: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu21: 256KB 64b/line 8-way L2 cache > cpu21: disabling user TSC (skew=10888274) > cpu21: smt 1, core 3, package 1 > cpu22 at mainbus0: apid 25 (application processor) > cpu22: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02 > cpu22: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu22: 256KB 64b/line 8-way L2 cache > cpu22: disabling user TSC (skew=5803028) > cpu22: smt 1, core 4, package 1 > cpu23 at mainbus0: apid 27 (application processor) > cpu23: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.14 MHz, 06-3f-02 > cpu23: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN > cpu23: 256KB 64b/line 8-way L2 cache > cpu23: disabling user TSC (skew=7716472) > cpu23: smt 1, core 5, package 1 > ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 20, 24 pins > ioapic1 at mainbus0: apid 2 pa 0xfec01000, version 20, 24 pins > ioapic2 at mainbus0: apid 3 pa 0xfec40000, version 20, 24 pins > acpimcfg0 at acpi0 > acpimcfg0: addr 0xd0000000, bus 0-255 > acpihpet0 at acpi0: 14318179 Hz > acpiprt0 at acpi0: bus 255 (UNC1) > acpiprt1 at acpi0: bus 223 (UNC0) > acpiprt2 at acpi0: bus 0 (PCI0) > acpiprt3 at acpi0: bus 9 (RP02) > acpiprt4 at acpi0: bus -1 (RP03) > acpiprt5 at acpi0: bus 1 (BR1A) > acpiprt6 at acpi0: bus 2 (BR1B) > acpiprt7 at acpi0: bus 3 (BR2A) > acpiprt8 at acpi0: bus -1 (BR2B) > acpiprt9 at acpi0: bus -1 (BR2C) > acpiprt10 at acpi0: bus -1 (BR2D) > acpiprt11 at acpi0: bus 4 (BR3A) > acpiprt12 at acpi0: bus -1 (BR3B) > acpiprt13 at acpi0: bus -1 (BR3C) > acpiprt14 at acpi0: bus -1 (BR3D) > acpiprt15 at acpi0: bus 11 (RP05) > acpiprt16 at acpi0: bus 224 (PCI1) > acpipci0 at acpi0 UNC1: 0x00000010 0x00000011 0x00000000 > acpipci1 at acpi0 UNC0: 0x00000010 0x00000011 0x00000000 > "ACPI0004" at acpi0 not configured > "ACPI0004" at acpi0 not configured > "ACPI0004" at acpi0 not configured > "ACPI0004" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpipci2 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000 > "PNP0003" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpicmos0 at acpi0 > com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo > acpipci3 at acpi0 PCI1: 0x00000010 0x00000011 0x00000000 > acpibtn0 at acpi0: PWRB > "PNP0C14" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS > cpu0: using VERW MDS workaround (except on vmm entry) > cpu0: Enhanced SpeedStep 3392 MHz: speeds: 3401, 3400, 3200, 3100, 2900, > 2800, 2600, 2500, 2300, 2100, 2000, 1800, 1700, 1500, 1400, 1200 MHz > pci0 at mainbus0 bus 255 > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 3 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 3 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 0 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 1 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 0 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 1 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 3 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 4 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 5 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 6 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 7 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 0 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 1 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 4 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 5 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 6 not configured > "Intel E5 v3 PCIE Ring" rev 0x02 at pci0 dev 16 function 0 not configured > "Intel E5 v3 PCIE Monitor" rev 0x02 at pci0 dev 16 function 1 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 5 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 6 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 7 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 0 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 1 not configured > "Intel E5 v3 Memory" rev 0x02 at pci0 dev 19 function 0 not configured > "Intel E5 v3 RAS" rev 0x02 at pci0 dev 19 function 1 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 2 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 3 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 4 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 5 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 3 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 3 not configured > "Intel E5 v3 TA" rev 0x02 at pci0 dev 22 function 0 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 23 function 0 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 7 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 0 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 1 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 2 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 3 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 4 not configured > "Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 0 not configured > "Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 2 not configured > pci1 at mainbus0 bus 223 > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 3 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 3 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 0 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 1 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 0 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 1 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 3 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 4 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 5 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 6 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 7 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 0 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 1 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 4 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 5 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 6 not configured > "Intel E5 v3 PCIE Ring" rev 0x02 at pci1 dev 16 function 0 not configured > "Intel E5 v3 PCIE Monitor" rev 0x02 at pci1 dev 16 function 1 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 5 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 6 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 7 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 0 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 1 not configured > "Intel E5 v3 Memory" rev 0x02 at pci1 dev 19 function 0 not configured > "Intel E5 v3 RAS" rev 0x02 at pci1 dev 19 function 1 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 2 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 3 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 4 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 5 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 3 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 3 not configured > "Intel E5 v3 TA" rev 0x02 at pci1 dev 22 function 0 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 23 function 0 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 7 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 0 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 1 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 2 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 3 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 4 not configured > "Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 0 not configured > "Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 2 not configured > pci2 at mainbus0 bus 0 > pchb0 at pci2 dev 0 function 0 "Intel E5 v3 Host" rev 0x02 > ppb0 at pci2 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci3 at ppb0 bus 1 > ppb1 at pci2 dev 1 function 1 "Intel E5 v3 PCIE" rev 0x02: msi > pci4 at ppb1 bus 2 > nvme0 at pci4 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, > NVMe 1.2 > nvme0: Samsung SSD 960 PRO 512GB, firmware 2B6QCXP7, serial S3EWNX0J512049D > scsibus1 at nvme0: 2 targets, initiator 0 > sd0 at scsibus1 targ 1 lun 0: <NVMe, Samsung SSD 960, 2B6Q> > sd0: 488386MB, 512 bytes/sector, 1000215216 sectors > ppb2 at pci2 dev 2 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci5 at ppb2 bus 3 > radeondrm0 at pci5 dev 0 function 0 "ATI Bonaire" rev 0x81 > drm0 at radeondrm0 > radeondrm0: msi > azalia0 at pci5 dev 0 function 1 vendor "ATI", unknown product 0xaac0 rev > 0x00: msi > azalia0: no supported codecs > ppb3 at pci2 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci6 at ppb3 bus 4 > ppb4 at pci6 dev 0 function 0 vendor "PLX", unknown product 0x8718 rev 0xab > pci7 at ppb4 bus 5 > ppb5 at pci7 dev 1 function 0 vendor "PLX", unknown product 0x8718 rev 0xab: > msi > pci8 at ppb5 bus 6 > nvme1 at pci8 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, > NVMe 1.2 > nvme1: SAMSUNG MZ1LW960HMJP-00003, firmware CXV8401Q, serial S2X6NB0JA00696 > scsibus2 at nvme1: 2 targets, initiator 0 > sd1 at scsibus2 targ 1 lun 0: <NVMe, SAMSUNG MZ1LW960, CXV8> > sd1: 915715MB, 512 bytes/sector, 1875385008 sectors > ppb6 at pci7 dev 2 function 0 vendor "PLX", unknown product 0x8718 rev 0xab: > msi > pci9 at ppb6 bus 7 > nvme2 at pci9 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, > NVMe 1.2 > nvme2: SAMSUNG MZ1LW960HMJP-00003, firmware CXV8401Q, serial S2X6NB0JA00679 > scsibus3 at nvme2: 2 targets, initiator 0 > sd2 at scsibus3 targ 1 lun 0: <NVMe, SAMSUNG MZ1LW960, CXV8> > sd2: 915715MB, 512 bytes/sector, 1875385008 sectors > "Intel E5 v3 Address Map" rev 0x02 at pci2 dev 5 function 0 not configured > "Intel E5 v3 Hot Plug" rev 0x02 at pci2 dev 5 function 1 not configured > "Intel E5 v3 Error Reporting" rev 0x02 at pci2 dev 5 function 2 not configured > "Intel E5 v3 I/O APIC" rev 0x02 at pci2 dev 5 function 4 not configured > "Intel C610 MS SPSR" rev 0x05 at pci2 dev 17 function 0 not configured > ahci0 at pci2 dev 17 function 4 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 > ahci0: port 0: 1.5Gb/s > scsibus4 at ahci0: 32 targets > cd0 at scsibus4 targ 0 lun 0: <hp, BD MLT UJ260AF, FW06> removable > xhci0 at pci2 dev 20 function 0 "Intel C610 xHCI" rev 0x05: apic 1 int 19, > xHCI 1.0 > usb0 at xhci0: USB revision 3.0 > uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00 > addr 1 > "Intel C610 MEI" rev 0x05 at pci2 dev 22 function 0 not configured > em0 at pci2 dev 25 function 0 "Intel I217-LM" rev 0x05: msi, address > 98:90:96:dc:72:1b > ehci0 at pci2 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 1 int 18 > usb1 at ehci0: USB revision 2.0 > uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > azalia1 at pci2 dev 27 function 0 "Intel C610 HD Audio" rev 0x05: msi > azalia1: codecs: Realtek ALC280 > audio0 at azalia1 > ppb7 at pci2 dev 28 function 0 "Intel C610 PCIE" rev 0xd5: msi > pci10 at ppb7 bus 8 > ppb8 at pci2 dev 28 function 1 "Intel C610 PCIE" rev 0xd5: msi > pci11 at ppb8 bus 9 > ppb9 at pci11 dev 0 function 0 "TI XIO2001 PCIE-PCI" rev 0x00 > pci12 at ppb9 bus 10 > ppb10 at pci2 dev 28 function 4 "Intel C610 PCIE" rev 0xd5: msi > pci13 at ppb10 bus 11 > iwx0 at pci13 dev 0 function 0 "Intel Wi-Fi 6 AX200" rev 0x1a, msix > ehci1 at pci2 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 1 int 18 > usb2 at ehci1: USB revision 2.0 > uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > pcib0 at pci2 dev 31 function 0 "Intel C610 LPC" rev 0x05 > ahci1 at pci2 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 > ahci1: port 0: 6.0Gb/s > scsibus5 at ahci1: 32 targets > sd3 at scsibus5 targ 0 lun 0: <ATA, WDC WD40PURX-64G, 80.0> > naa.50014ee2b7c94ed4 > sd3: 3815447MB, 512 bytes/sector, 7814037168 sectors > ichiic0 at pci2 dev 31 function 3 "Intel C610 SMBus" rev 0x05: apic 1 int 18 > iic0 at ichiic0 > isa0 at pcib0 > isadma0 at isa0 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pckbd0 at pckbc0 (kbd slot) > wskbd0 at pckbd0: console keyboard > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > pci14 at mainbus0 bus 224 > "Intel E5 v3 Address Map" rev 0x02 at pci14 dev 5 function 0 not configured > "Intel E5 v3 Hot Plug" rev 0x02 at pci14 dev 5 function 1 not configured > "Intel E5 v3 Error Reporting" rev 0x02 at pci14 dev 5 function 2 not > configured > "Intel E5 v3 I/O APIC" rev 0x02 at pci14 dev 5 function 4 not configured > vmm0 at mainbus0: VMX/EPT > uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.05 addr 2 > uhub4 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.05 addr 2 > vscsi0 at root > scsibus6 at vscsi0: 256 targets > softraid0 at root > scsibus7 at softraid0: 256 targets > softraid0: trying to bring up sd4 degraded > sd4 at scsibus7 targ 1 lun 0: <OPENBSD, SR RAID 1, 006> > sd4: 915715MB, 512 bytes/sector, 1875384353 sectors > softraid0: roaming device -> sd2a > root on sd0a (c4bd76ea8f35417b.a) swap on sd0b dump on sd0b > radeondrm0: BONAIRE > radeondrm0: 1024x768, 32bpp > wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using wskbd0 > wsdisplay0: screen 1-5 added (std, vt100 emulation) > iwx0: hw rev 0x340, fw ver 67.8f59b80b.0, address b0:7d:64:86:b7:80 > > usbdevs: > Controller /dev/usb0: > addr 01: 8086:0000 Intel, xHCI root hub > super speed, self powered, config 1, rev 1.00 > driver: uhub0 > Controller /dev/usb1: > addr 01: 8086:0000 Intel, EHCI root hub > high speed, self powered, config 1, rev 1.00 > driver: uhub1 > addr 02: 8087:800a Intel, Rate Matching Hub > high speed, self powered, config 1, rev 0.05 > driver: uhub3 > Controller /dev/usb2: > addr 01: 8086:0000 Intel, EHCI root hub > high speed, self powered, config 1, rev 1.00 > driver: uhub2 > addr 02: 8087:8002 Intel, Rate Matching Hub > high speed, self powered, config 1, rev 0.05 > driver: uhub4 > >
