On 21.4.2021. 21:36, Alexander Bluhm wrote:
> Hi,
>
> For a while we are running network without kernel lock, but with a
> network lock. The latter is an exclusive sleeping rwlock.
>
> It is possible to run the forwarding path in parallel on multiple
> cores. I use ix(4) interfaces which provide one input queue for
> each CPU. For that we have to start multiple softnet tasks and
> replace the exclusive lock with a shared lock. This works for IP
> and IPv6 input and forwarding, but not for higher protocols.
>
> So I implement a queue between IP and higher layers. We had that
> before when we were using netlock for IP and kernel lock for TCP.
> Now we have shared lock for IP and exclusive lock for TCP. By using
> a queue, we can upgrade the lock once for multiple packets.
>
> As you can see here, forwardings performance doubles from 4.5x10^9
> to 9x10^9 . Left column is current, right column is with my diff.
> The other dots at 2x10^9 are with socket splicing which is not
> affected.
> http://bluhm.genua.de/perform/results/2021-04-21T10%3A50%3A37Z/gnuplot/forward.png
>
> Here are all numbers with various network tests.
> http://bluhm.genua.de/perform/results/2021-04-21T10%3A50%3A37Z/perform.html
> TCP performance gets less deterministic due to the addition queue.
>
> Kernel stack flame graph looks like this. Machine uses 4 CPU.
> http://bluhm.genua.de/files/kstack-multiqueue-forward.svg
>
> Note the kernel lock around nd6_resolve(). I hat to put it there
> as I have seen an MP related crash there. This can be fixed
> independently of this diff.
>
> We need more MP preassure to find such bugs and races. I think now
> is a good time to give this diff broader testing and commit it.
> You need interfaces with multiple queues to see a difference.
>
> ok?
Hi,
with this diff i'm getting panic when i'm pushing traffic over that box.
This is plain forwarding. To compile with witness ?
I'm sending traffic from host connected on ix0 from address 10.10.0.1 to
host connected to ix1 to addresses 10.11.0.1 - 10.11.255.255 at cca 10Mpps
x3550m4# cat /etc/hostname.ix0
inet 192.168.10.1/24
!route add 10.10/16 192.168.10.11
up
x3550m4# cat /etc/hostname.ix1
192.168.11.1/24
!route add 10.11/16 192.168.11.11
up
10.10/16 192.168.10.11 UGS 0 0 - 8 ix0
10.11/16 192.168.11.11 UGS 0 0 - 8 ix1
x3550m4# panic: pool_cache_item_magic_check: mbufpl cpu free list
modified: item addr 0xfffffd8066bbd6
00+16 0xfffffd80669b017e!=0x2e1e87c6c9cef869
Stopped at db_enter+0x10: popq %rbp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
392766 26556 0 0x14000 0x200 1 softnet
201422 58655 0 0x14000 0x200 2 softnet
510972 89691 0 0x14000 0x200 4 softnet
175943 76775 0 0x14000 0x200 3 softnet
db_enter() at db_enter+0x10
panic(ffffffff81ded24c) at panic+0x12a
pool_cache_get(ffffffff8212a2c8) at pool_cache_get+0x25b
pool_get(ffffffff8212a2c8,2) at pool_get+0x5e
m_clget(0,2,802) at m_clget+0xce
ixgbe_get_buf(ffff80000015b2b8,11) at ixgbe_get_buf+0xa3
ixgbe_rxfill(ffff80000015b2b8) at ixgbe_rxfill+0xae
ixgbe_queue_intr(ffff80000011acc0) at ixgbe_queue_intr+0x4f
intr_handler(ffff800026e7d8f0,ffff8000000bfd00) at intr_handler+0x6e
Xintr_ioapic_edge4_untramp() at Xintr_ioapic_edge4_untramp+0x18f
acpicpu_idle() at acpicpu_idle+0x1ea
sched_idle(ffff800021a61ff0) at sched_idle+0x27e
end trace frame: 0x0, count: 3
https://www.openbsd.org/ddb.html describes the minimum info required in
bug reports. Insufficient info makes it difficult to find and fix bugs.
ddb{9}>
ddb{9}> show panic
pool_cache_item_magic_check: mbufpl cpu free list modified: item addr
0xfffffd8
066bbd600+16 0xfffffd80669b017e!=0x2e1e87c6c9cef869
ddb{9}> trace
db_enter() at db_enter+0x10
panic(ffffffff81ded24c) at panic+0x12a
pool_cache_get(ffffffff8212a2c8) at pool_cache_get+0x25b
pool_get(ffffffff8212a2c8,2) at pool_get+0x5e
m_clget(0,2,802) at m_clget+0xce
ixgbe_get_buf(ffff80000015b2b8,11) at ixgbe_get_buf+0xa3
ixgbe_rxfill(ffff80000015b2b8) at ixgbe_rxfill+0xae
ixgbe_queue_intr(ffff80000011acc0) at ixgbe_queue_intr+0x4f
intr_handler(ffff800026e7d8f0,ffff8000000bfd00) at intr_handler+0x6e
Xintr_ioapic_edge4_untramp() at Xintr_ioapic_edge4_untramp+0x18f
acpicpu_idle() at acpicpu_idle+0x1ea
sched_idle(ffff800021a61ff0) at sched_idle+0x27e
end trace frame: 0x0, count: -12
ddb{9}>
x3550m4$ vmstat -iz
interrupt total rate
irq0/clock 197062 1152
irq0/ipi 6271 36
irq96/acpi0 0 0
irq97/ppb0 0 0
irq114/ixl0 21 0
irq115/ixl0:0 5 0
irq116/ixl0:1 0 0
irq117/ixl0:2 0 0
irq118/ixl0:3 0 0
irq119/ixl0:4 0 0
irq120/ixl0:5 3 0
irq121/ixl0:6 0 0
irq122/ixl0:7 0 0
irq123/ixl1 21 0
irq124/ixl1:0 5 0
irq125/ixl1:1 0 0
irq126/ixl1:2 0 0
irq127/ixl1:3 0 0
irq128/ixl1:4 0 0
irq129/ixl1:5 3 0
irq130/ixl1:6 0 0
irq131/ixl1:7 0 0
irq98/ppb1 0 0
irq132/mcx0 79 0
irq133/mcx0:0 7 0
irq134/mcx0:1 0 0
irq135/mcx0:2 0 0
irq136/mcx0:3 0 0
irq137/mcx0:4 0 0
irq138/mcx0:5 0 0
irq139/mcx0:6 0 0
irq140/mcx0:7 0 0
irq141/mcx1 79 0
irq142/mcx1:0 7 0
irq143/mcx1:1 0 0
irq144/mcx1:2 0 0
irq145/mcx1:3 0 0
irq146/mcx1:4 0 0
irq147/mcx1:5 0 0
irq148/mcx1:6 0 0
irq149/mcx1:7 0 0
irq99/ppb2 0 0
irq150/ix0:0 7 0
irq151/ix0:1 0 0
irq152/ix0:2 0 0
irq153/ix0:3 0 0
irq154/ix0:4 0 0
irq155/ix0:5 0 0
irq156/ix0:6 0 0
irq157/ix0:7 0 0
irq158/ix0:8 0 0
irq159/ix0:9 0 0
irq160/ix0:10 0 0
irq161/ix0:11 0 0
irq162/ix0 2 0
irq163/ix1:0 7 0
irq164/ix1:1 0 0
irq165/ix1:2 0 0
irq166/ix1:3 0 0
irq167/ix1:4 0 0
irq168/ix1:5 0 0
irq169/ix1:6 0 0
irq170/ix1:7 0 0
irq171/ix1:8 0 0
irq172/ix1:9 0 0
irq173/ix1:10 0 0
irq174/ix1:11 0 0
irq175/ix1 2 0
irq100/ppb3 0 0
irq101/mfii0 160476 938
irq102/ehci0 23 0
irq103/ppb5 0 0
irq176/em0 648 3
irq177/em1 0 0
irq178/em2 0 0
irq179/em3 0 0
irq104/ppb6 0 0
irq105/ehci1 127 0
irq106/ichiic0 0 0
irq180/com0 597 3
irq181/com1 0 0
irq107/ppb13 0 0
Total 365452 2137
x3550m4$
OpenBSD 6.9-current (GENERIC.MP) #52: Wed Apr 21 23:07:31 CEST 2021
[email protected]:/sys/arch/amd64/compile/GENERIC.MP
real mem = 34314809344 (32725MB)
avail mem = 33259458560 (31718MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0x7e67b000 (84 entries)
bios0: vendor IBM version "-[D7E174BUS-3.20]-" date 06/15/2020
bios0: IBM IBM System x3550 M4 -[791425Z]-
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP TCPA ERST HEST HPET APIC MCFG OEM0 OEM1 SLIT
SRAT SLIC SSDT SSDT SSDT SSDT DMAR
acpi0: wakeup devices MRP1(S4) DCC0(S4) MRP3(S4) MRP5(S4) EHC2(S5)
PEX0(S5) PEX7(S5) EHC1(S5) IP2P(S3) MRPB(S4) MRPC(S4) MRPD(S4) MRPF(S4)
MRPG(S4) MRPH(S4) MRPI(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.31 MHz, 06-3e-04
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
cpu4: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 256KB 64b/line 8-way L2 cache
cpu4: smt 0, core 4, package 0
cpu5 at mainbus0: apid 10 (application processor)
cpu5: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 256KB 64b/line 8-way L2 cache
cpu5: smt 0, core 5, package 0
cpu6 at mainbus0: apid 32 (application processor)
cpu6: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 256KB 64b/line 8-way L2 cache
cpu6: disabling user TSC (skew=-119)
cpu6: smt 0, core 0, package 1
cpu7 at mainbus0: apid 34 (application processor)
cpu7: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 256KB 64b/line 8-way L2 cache
cpu7: disabling user TSC (skew=-142)
cpu7: smt 0, core 1, package 1
cpu8 at mainbus0: apid 36 (application processor)
cpu8: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu8:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu8: 256KB 64b/line 8-way L2 cache
cpu8: disabling user TSC (skew=-139)
cpu8: smt 0, core 2, package 1
cpu9 at mainbus0: apid 38 (application processor)
cpu9: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu9:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu9: 256KB 64b/line 8-way L2 cache
cpu9: smt 0, core 3, package 1
cpu10 at mainbus0: apid 40 (application processor)
cpu10: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu10:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu10: 256KB 64b/line 8-way L2 cache
cpu10: smt 0, core 4, package 1
cpu11 at mainbus0: apid 42 (application processor)
cpu11: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu11:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu11: 256KB 64b/line 8-way L2 cache
cpu11: disabling user TSC (skew=-156)
cpu11: smt 0, core 5, package 1
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins
ioapic2 at mainbus0: apid 10 pa 0xfec40000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 0 (IOH0)
acpiprt1 at acpi0: bus 12 (MRP1)
acpiprt2 at acpi0: bus 17 (DCC0)
acpiprt3 at acpi0: bus 22 (MRP3)
acpiprt4 at acpi0: bus 27 (MRP5)
acpiprt5 at acpi0: bus 6 (PEX0)
acpiprt6 at acpi0: bus 128 (IOH1)
acpiprt7 at acpi0: bus 134 (MRPD)
acpipci0 at acpi0 IOH0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
tpm0 at acpi0 TPM_ addr 0x4e/0x2, device 0xffffffff rev 0xff
acpipci1 at acpi0 IOH1: 0x00000010 0x00000011 0x00000000
acpicpu0 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu1 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu2 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu3 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu4 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu5 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu6 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu7 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu8 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu9 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu10 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu11 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel E5 v2 Host" rev 0x04
ppb0 at pci0 dev 1 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci1 at ppb0 bus 12
12:0:0: rom address conflict 0xfff80000/0x80000
12:0:1: rom address conflict 0xfff80000/0x80000
ixl0 at pci1 dev 0 function 0 "Intel X710 SFP+" rev 0x02: port 0, FW
8.2.64244 API 1.13, msix, 8 queues, address 00:1b:21:b9:06:24
ixl1 at pci1 dev 0 function 1 "Intel X710 SFP+" rev 0x02: port 1, FW
8.2.64244 API 1.13, msix, 8 queues, address 00:1b:21:b9:06:26
ppb1 at pci0 dev 2 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci2 at ppb1 bus 17
17:0:0: rom address conflict 0xfff00000/0x100000
17:0:1: rom address conflict 0xfff00000/0x100000
mcx0 at pci2 dev 0 function 0 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.28.2006, msix, address 98:03:9b:0e:d7:66
mcx1 at pci2 dev 0 function 1 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.28.2006, msix, address 98:03:9b:0e:d7:67
ppb2 at pci0 dev 3 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci3 at ppb2 bus 22
22:0:0: rom address conflict 0xfff80000/0x80000
22:0:1: rom address conflict 0xfff80000/0x80000
ix0 at pci3 dev 0 function 0 "Intel 82599" rev 0x01, msix, 12 queues,
address a0:36:9f:2e:96:a0
ix1 at pci3 dev 0 function 1 "Intel 82599" rev 0x01, msix, 12 queues,
address a0:36:9f:2e:96:a1
ppb3 at pci0 dev 3 function 2 "Intel E5 v2 PCIE" rev 0x04: msi
pci4 at ppb3 bus 27
mfii0 at pci4 dev 0 function 0 "Symbios Logic MegaRAID SAS2208" rev
0x05: msi
mfii0: "ServeRAID M5110", firmware 23.34.0-0023, 512MB cache
scsibus1 at mfii0: 64 targets
sd0 at scsibus1 targ 0 lun 0: <IBM, ServeRAID M5110, 3.46>
naa.600605b006c3a0b01a582bd010e4c053
sd0: 952720MB, 512 bytes/sector, 1951170560 sectors
scsibus2 at mfii0: 256 targets
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 0 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 1 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 2 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 3 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 4 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 5 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 6 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 7 not configured
"Intel E5 v2 Address Map" rev 0x04 at pci0 dev 5 function 0 not configured
"Intel E5 v2 IIO RAS" rev 0x04 at pci0 dev 5 function 2 not configured
ppb4 at pci0 dev 17 function 0 "Intel C600 Virtual PCIE" rev 0x06
pci5 at ppb4 bus 32
ehci0 at pci0 dev 26 function 0 "Intel C600 USB" rev 0x06: apic 8 int 19
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb5 at pci0 dev 28 function 0 "Intel C600 PCIE" rev 0xb6: msi
pci6 at ppb5 bus 6
em0 at pci6 dev 0 function 0 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:12
em1 at pci6 dev 0 function 1 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:13
em2 at pci6 dev 0 function 2 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:14
em3 at pci6 dev 0 function 3 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:15
ppb6 at pci0 dev 28 function 7 "Intel C600 PCIE" rev 0xb6: msi
pci7 at ppb6 bus 1
ppb7 at pci7 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci8 at ppb7 bus 2
ppb8 at pci8 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci9 at ppb8 bus 3
ppb9 at pci9 dev 0 function 0 "Renesas SH7757 PCIE-PCI" rev 0x00
pci10 at ppb9 bus 4
vga1 at pci10 dev 0 function 0 "Matrox MGA G200eR" rev 0x00
wsdisplay at vga1 not configured
ppb10 at pci8 dev 1 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci11 at ppb10 bus 5
ehci1 at pci0 dev 29 function 0 "Intel C600 USB" rev 0x06: apic 8 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb11 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa6
pci12 at ppb11 bus 33
pcib0 at pci0 dev 31 function 0 "Intel C600 LPC" rev 0x06
ichiic0 at pci0 dev 31 function 3 "Intel C600 SMBus" rev 0x06: apic 8 int 11
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
kbc selftest: ffffffff
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci13 at mainbus0 bus 128
128:4:0: mem address conflict 0x90000000/0x4000
128:4:1: mem address conflict 0x90004000/0x4000
128:4:2: mem address conflict 0x90008000/0x4000
128:4:3: mem address conflict 0x9000c000/0x4000
128:4:4: mem address conflict 0x90010000/0x4000
128:4:5: mem address conflict 0x90014000/0x4000
128:4:6: mem address conflict 0x90018000/0x4000
128:4:7: mem address conflict 0x9001c000/0x4000
ppb12 at pci13 dev 0 function 0 "Intel E5 v2 PCIE" rev 0x04
pci14 at ppb12 bus 129
ppb13 at pci13 dev 2 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci15 at ppb13 bus 134
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 0 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 1 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 2 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 3 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 4 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 5 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 6 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 7 not configured
"Intel E5 v2 Address Map" rev 0x04 at pci13 dev 5 function 0 not configured
"Intel E5 v2 IIO RAS" rev 0x04 at pci13 dev 5 function 2 not configured
vmm0 at mainbus0: VMX/EPT
uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
uhub4 at uhub3 port 1 configuration 1 interface 0 "no manufacturer
Gadget USB HUB" rev 2.00/0.00 addr 3
uhub4: device problem, disabling port 5
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (c1aa6fe2c9e6520c.a) swap on sd0b dump on sd0b
urndis0 at uhub4 port 5 configuration 2 interface 0 "IBM RNDIS/Ethernet
Gadget" rev 2.00/3.25 addr 4
urndis0: using Vendor, address 42:f2:e9:ec:b4:11
OpenBSD 6.9-current (GENERIC.MP) #52: Wed Apr 21 23:07:31 CEST 2021
[email protected]:/sys/arch/amd64/compile/GENERIC.MP
real mem = 34314489856 (32724MB)
avail mem = 33259167744 (31718MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0x7e67b000 (84 entries)
bios0: vendor IBM version "-[D7E174BUS-3.20]-" date 06/15/2020
bios0: IBM IBM System x3550 M4 -[791425Z]-
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP TCPA ERST HEST HPET APIC MCFG OEM0 OEM1 SLIT
SRAT SLIC SSDT SSDT SSDT SSDT DMAR
acpi0: wakeup devices MRP1(S4) DCC0(S4) MRP3(S4) MRP5(S4) EHC2(S5)
PEX0(S5) PEX7(S5) EHC1(S5) IP2P(S3) MRPB(S4) MRPC(S4) MRPD(S4) MRPF(S4)
MRPG(S4) MRPH(S4) MRPI(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.36 MHz, 06-3e-04
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 100MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
cpu4: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 256KB 64b/line 8-way L2 cache
cpu4: smt 0, core 4, package 0
cpu5 at mainbus0: apid 10 (application processor)
cpu5: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 256KB 64b/line 8-way L2 cache
cpu5: smt 0, core 5, package 0
cpu6 at mainbus0: apid 32 (application processor)
cpu6: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 256KB 64b/line 8-way L2 cache
cpu6: smt 0, core 0, package 1
cpu7 at mainbus0: apid 34 (application processor)
cpu7: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.00 MHz, 06-3e-04
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 256KB 64b/line 8-way L2 cache
cpu7: disabling user TSC (skew=-147)
cpu7: smt 0, core 1, package 1
cpu8 at mainbus0: apid 36 (application processor)
cpu8: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.00 MHz, 06-3e-04
cpu8:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu8: 256KB 64b/line 8-way L2 cache
cpu8: smt 0, core 2, package 1
cpu9 at mainbus0: apid 38 (application processor)
cpu9: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.01 MHz, 06-3e-04
cpu9:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu9: 256KB 64b/line 8-way L2 cache
cpu9: disabling user TSC (skew=-142)
cpu9: smt 0, core 3, package 1
cpu10 at mainbus0: apid 40 (application processor)
cpu10: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.00 MHz, 06-3e-04
cpu10:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu10: 256KB 64b/line 8-way L2 cache
cpu10: smt 0, core 4, package 1
cpu11 at mainbus0: apid 42 (application processor)
cpu11: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz, 2400.00 MHz, 06-3e-04
cpu11:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu11: 256KB 64b/line 8-way L2 cache
cpu11: smt 0, core 5, package 1
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins
ioapic2 at mainbus0: apid 10 pa 0xfec40000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 0 (IOH0)
acpiprt1 at acpi0: bus 12 (MRP1)
acpiprt2 at acpi0: bus 17 (DCC0)
acpiprt3 at acpi0: bus 22 (MRP3)
acpiprt4 at acpi0: bus 27 (MRP5)
acpiprt5 at acpi0: bus 6 (PEX0)
acpiprt6 at acpi0: bus 128 (IOH1)
acpiprt7 at acpi0: bus 134 (MRPD)
acpipci0 at acpi0 IOH0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
tpm0 at acpi0 TPM_ addr 0x4e/0x2, device 0xffffffff rev 0xff
acpipci1 at acpi0 IOH1: 0x00000010 0x00000011 0x00000000
acpicpu0 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu1 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu2 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu3 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu4 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu5 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu6 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu7 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu8 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu9 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu10 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
acpicpu11 at acpi0: C2(500@59 mwait.3@0x10), C1(1000@3 mwait.1)
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel E5 v2 Host" rev 0x04
ppb0 at pci0 dev 1 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci1 at ppb0 bus 12
12:0:0: rom address conflict 0xfff80000/0x80000
12:0:1: rom address conflict 0xfff80000/0x80000
ixl0 at pci1 dev 0 function 0 "Intel X710 SFP+" rev 0x02: port 0, FW
8.2.64244 API 1.13, msix, 8 queues, address 00:1b:21:b9:06:24
ixl1 at pci1 dev 0 function 1 "Intel X710 SFP+" rev 0x02: port 1, FW
8.2.64244 API 1.13, msix, 8 queues, address 00:1b:21:b9:06:26
ppb1 at pci0 dev 2 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci2 at ppb1 bus 17
17:0:0: rom address conflict 0xfff00000/0x100000
17:0:1: rom address conflict 0xfff00000/0x100000
mcx0 at pci2 dev 0 function 0 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.28.2006, msix, address 98:03:9b:0e:d7:66
mcx1 at pci2 dev 0 function 1 "Mellanox ConnectX-4 Lx" rev 0x00: FW
14.28.2006, msix, address 98:03:9b:0e:d7:67
ppb2 at pci0 dev 3 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci3 at ppb2 bus 22
22:0:0: rom address conflict 0xfff80000/0x80000
22:0:1: rom address conflict 0xfff80000/0x80000
ix0 at pci3 dev 0 function 0 "Intel 82599" rev 0x01, msix, 12 queues,
address a0:36:9f:2e:96:a0
ix1 at pci3 dev 0 function 1 "Intel 82599" rev 0x01, msix, 12 queues,
address a0:36:9f:2e:96:a1
ppb3 at pci0 dev 3 function 2 "Intel E5 v2 PCIE" rev 0x04: msi
pci4 at ppb3 bus 27
mfii0 at pci4 dev 0 function 0 "Symbios Logic MegaRAID SAS2208" rev
0x05: msi
mfii0: "ServeRAID M5110", firmware 23.34.0-0023, 512MB cache
scsibus1 at mfii0: 64 targets
sd0 at scsibus1 targ 0 lun 0: <IBM, ServeRAID M5110, 3.46>
naa.600605b006c3a0b01a582bd010e4c053
sd0: 952720MB, 512 bytes/sector, 1951170560 sectors
scsibus2 at mfii0: 256 targets
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 0 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 1 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 2 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 3 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 4 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 5 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 6 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci0 dev 4 function 7 not configured
"Intel E5 v2 Address Map" rev 0x04 at pci0 dev 5 function 0 not configured
"Intel E5 v2 IIO RAS" rev 0x04 at pci0 dev 5 function 2 not configured
ppb4 at pci0 dev 17 function 0 "Intel C600 Virtual PCIE" rev 0x06
pci5 at ppb4 bus 32
ehci0 at pci0 dev 26 function 0 "Intel C600 USB" rev 0x06: apic 8 int 19
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb5 at pci0 dev 28 function 0 "Intel C600 PCIE" rev 0xb6: msi
pci6 at ppb5 bus 6
em0 at pci6 dev 0 function 0 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:12
em1 at pci6 dev 0 function 1 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:13
em2 at pci6 dev 0 function 2 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:14
em3 at pci6 dev 0 function 3 "Intel I350" rev 0x01: msi, address
40:f2:e9:ec:b4:15
ppb6 at pci0 dev 28 function 7 "Intel C600 PCIE" rev 0xb6: msi
pci7 at ppb6 bus 1
ppb7 at pci7 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci8 at ppb7 bus 2
ppb8 at pci8 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci9 at ppb8 bus 3
ppb9 at pci9 dev 0 function 0 "Renesas SH7757 PCIE-PCI" rev 0x00
pci10 at ppb9 bus 4
vga1 at pci10 dev 0 function 0 "Matrox MGA G200eR" rev 0x00
wsdisplay at vga1 not configured
ppb10 at pci8 dev 1 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
pci11 at ppb10 bus 5
ehci1 at pci0 dev 29 function 0 "Intel C600 USB" rev 0x06: apic 8 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb11 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa6
pci12 at ppb11 bus 33
pcib0 at pci0 dev 31 function 0 "Intel C600 LPC" rev 0x06
ichiic0 at pci0 dev 31 function 3 "Intel C600 SMBus" rev 0x06: apic 8 int 11
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
kbc selftest: ffffffff
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci13 at mainbus0 bus 128
128:4:0: mem address conflict 0x90000000/0x4000
128:4:1: mem address conflict 0x90004000/0x4000
128:4:2: mem address conflict 0x90008000/0x4000
128:4:3: mem address conflict 0x9000c000/0x4000
128:4:4: mem address conflict 0x90010000/0x4000
128:4:5: mem address conflict 0x90014000/0x4000
128:4:6: mem address conflict 0x90018000/0x4000
128:4:7: mem address conflict 0x9001c000/0x4000
ppb12 at pci13 dev 0 function 0 "Intel E5 v2 PCIE" rev 0x04
pci14 at ppb12 bus 129
ppb13 at pci13 dev 2 function 0 "Intel E5 v2 PCIE" rev 0x04: msi
pci15 at ppb13 bus 134
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 0 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 1 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 2 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 3 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 4 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 5 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 6 not configured
"Intel E5 v2 I/OAT" rev 0x04 at pci13 dev 4 function 7 not configured
"Intel E5 v2 Address Map" rev 0x04 at pci13 dev 5 function 0 not configured
"Intel E5 v2 IIO RAS" rev 0x04 at pci13 dev 5 function 2 not configured
vmm0 at mainbus0: VMX/EPT
uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
uhub4 at uhub3 port 1 configuration 1 interface 0 "no manufacturer
Gadget USB HUB" rev 2.00/0.00 addr 3
uhub4: device problem, disabling port 5
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (c1aa6fe2c9e6520c.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
urndis0 at uhub4 port 5 configuration 2 interface 0 "IBM RNDIS/Ethernet
Gadget" rev 2.00/3.25 addr 4
urndis0: using Vendor, address 42:f2:e9:ec:b4:11
