On Mon, Mar 22, 2021 at 11:34:25AM +0100, Mischa wrote:
> > On 21 Mar 2021, at 02:31, Theo de Raadt <dera...@openbsd.org> wrote:
> > Otto Moerbeek <o...@drijf.net> wrote:
> >> On Fri, Mar 19, 2021 at 04:15:31PM +0000, Stuart Henderson wrote:
> >>
> >>> On 2021/03/19 17:05, Jan Klemkow wrote:
> >>>> Hi,
> >>>>
> >>>> I had the same issue a few days ago a server hardware of mine. I just
> >>>> ran 'cvs up'. So, it looks like a generic bug in FFS and not related to
> >>>> vmm.
> >>>
> >>> This panic generally relates to filesystem corruption. If fsck doesn't
> >>> help then recreating which filesystem is triggering it is usually needed.
> >>
> >> Yeah, once in a while we see reports of it. It seems to be some nasty
> >> conspiracy between the generic filesystem code, ffs and fsck_ffs.
> >> Maybe even the device (driver) itself is involved. A possible
> >> underlying issue may be that some operation are re-ordered while they
> >> should not.
> >
> > Yes, it does hint at a reordering.
> >
> >> Now the strange thing is, fsck_ffs *should* be able to repair the
> >> inconsistency, but it appears in some cases it is not, and some bits
> >> on the disk remain to trigger it again.
> >
> > fsck_ffs can only repair one inconsistancy. There are a number of lockstep
> > operations, I suppose we can call them acid-in-lowercase, which allow fsck
> > to determine at which point the crashed system gave up the ghost. fsck then
> > removes the partial operations, leaving a viable filesystem. But if the
> > disk
> > layer lands later writes but not earlier writes, fsck cannot handle it.
>
> I managed to re-create the issue.
>
> Created a fresh install qcow2 image and derived 35 new VMs from it.
> Then I started all the VMs in four cycles, 10 VMs per cycle and waiting 240
> seconds after each cycle.
> Similar to the staggered start based on the amount of CPUs.
>
> This time it was “only” one VM that was affected by this. VM four that got
> started.
>
> ddb> show panic
> ffs_valloc: dup alloc
> ddb> trace
> db_enter() at db_enter+0x10
> panic(ffffffff81dc21b2) at panic+0x12a
> ffs_inode_alloc(fffffd803c94ef00,81a4,fffffd803f7bbf00,ffff800014d728b8) at
> ffs
> _inode_alloc+0x442
> ufs_makeinode(81a4,fffffd803c930908,ffff800014d72bb0,ffff800014d72c00) at
> ufs_m
> akeinode+0x7f
> ufs_create(ffff800014d72960) at ufs_create+0x3c
> VOP_CREATE(fffffd803c930908,ffff800014d72bb0,ffff800014d72c00,ffff800014d729c0)
> at VOP_CREATE+0x4a
> vn_open(ffff800014d72b80,602,1a4) at vn_open+0x182
> doopenat(ffff8000ffffc778,ffffff9c,f8fc28f00f4,601,1b6,ffff800014d72d80) at
> doo
> penat+0x1d0
> syscall(ffff800014d72df0) at syscall+0x315
> Xsyscall() at Xsyscall+0x128
> end of kernel
> end trace frame: 0x7f7ffffbe450, count: -10
>
> dmesg of the host below.
For me this is not enough info to even try to reproduce, I know little
of vmm or vmd and have no idea what "derive" means in this context.
Would it be possiblet for you to show the exact steps (preferably a
script) to reproduce the issue?
Though the specific hardware might play a role as well...
-Otto
>
> Mischa
>
> OpenBSD 6.9-beta (GENERIC.MP) #421: Sun Mar 21 13:17:22 MDT 2021
> dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 137374924800 (131010MB)
> avail mem = 133196165120 (127025MB)
> random: good seed from bootblocks
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xbf42c000 (99 entries)
> bios0: vendor Dell Inc. version "2.8.0" date 06/26/2019
> bios0: Dell Inc. PowerEdge R620
> acpi0 at bios0: ACPI 3.0
> acpi0: sleep states S0 S4 S5
> acpi0: tables DSDT FACP APIC SPCR HPET DMAR MCFG WD__ SLIC ERST HEST BERT
> EINJ TCPA PC__ SRAT SSDT
> acpi0: wakeup devices PCI0(S5) PCI1(S5)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.34 MHz, 06-2d-07
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu0: 256KB 64b/line 8-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 99MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.1.1.2, IBE
> cpu1 at mainbus0: apid 32 (application processor)
> cpu1: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 1200.02 MHz, 06-2d-07
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu1: 256KB 64b/line 8-way L2 cache
> cpu1: smt 0, core 0, package 1
> cpu2 at mainbus0: apid 2 (application processor)
> cpu2: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu2: 256KB 64b/line 8-way L2 cache
> cpu2: smt 0, core 1, package 0
> cpu3 at mainbus0: apid 34 (application processor)
> cpu3: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu3: 256KB 64b/line 8-way L2 cache
> cpu3: smt 0, core 1, package 1
> cpu4 at mainbus0: apid 4 (application processor)
> cpu4: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu4:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu4: 256KB 64b/line 8-way L2 cache
> cpu4: smt 0, core 2, package 0
> cpu5 at mainbus0: apid 36 (application processor)
> cpu5: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu5:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu5: 256KB 64b/line 8-way L2 cache
> cpu5: smt 0, core 2, package 1
> cpu6 at mainbus0: apid 6 (application processor)
> cpu6: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu6:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu6: 256KB 64b/line 8-way L2 cache
> cpu6: smt 0, core 3, package 0
> cpu7 at mainbus0: apid 38 (application processor)
> cpu7: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.02 MHz, 06-2d-07
> cpu7:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu7: 256KB 64b/line 8-way L2 cache
> cpu7: smt 0, core 3, package 1
> cpu8 at mainbus0: apid 8 (application processor)
> cpu8: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu8:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu8: 256KB 64b/line 8-way L2 cache
> cpu8: smt 0, core 4, package 0
> cpu9 at mainbus0: apid 40 (application processor)
> cpu9: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.02 MHz, 06-2d-07
> cpu9:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu9: 256KB 64b/line 8-way L2 cache
> cpu9: smt 0, core 4, package 1
> cpu10 at mainbus0: apid 10 (application processor)
> cpu10: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu10:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu10: 256KB 64b/line 8-way L2 cache
> cpu10: smt 0, core 5, package 0
> cpu11 at mainbus0: apid 42 (application processor)
> cpu11: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.03 MHz, 06-2d-07
> cpu11:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu11: 256KB 64b/line 8-way L2 cache
> cpu11: smt 0, core 5, package 1
> cpu12 at mainbus0: apid 1 (application processor)
> cpu12: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.20 MHz, 06-2d-07
> cpu12:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu12: 256KB 64b/line 8-way L2 cache
> cpu12: smt 1, core 0, package 0
> cpu13 at mainbus0: apid 33 (application processor)
> cpu13: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu13:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu13: 256KB 64b/line 8-way L2 cache
> cpu13: smt 1, core 0, package 1
> cpu14 at mainbus0: apid 3 (application processor)
> cpu14: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu14:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu14: 256KB 64b/line 8-way L2 cache
> cpu14: smt 1, core 1, package 0
> cpu15 at mainbus0: apid 35 (application processor)
> cpu15: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu15:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu15: 256KB 64b/line 8-way L2 cache
> cpu15: smt 1, core 1, package 1
> cpu16 at mainbus0: apid 5 (application processor)
> cpu16: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu16:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu16: 256KB 64b/line 8-way L2 cache
> cpu16: smt 1, core 2, package 0
> cpu17 at mainbus0: apid 37 (application processor)
> cpu17: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.02 MHz, 06-2d-07
> cpu17:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu17: 256KB 64b/line 8-way L2 cache
> cpu17: smt 1, core 2, package 1
> cpu18 at mainbus0: apid 7 (application processor)
> cpu18: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu18:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu18: 256KB 64b/line 8-way L2 cache
> cpu18: smt 1, core 3, package 0
> cpu19 at mainbus0: apid 39 (application processor)
> cpu19: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu19:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu19: 256KB 64b/line 8-way L2 cache
> cpu19: smt 1, core 3, package 1
> cpu20 at mainbus0: apid 9 (application processor)
> cpu20: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu20:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu20: 256KB 64b/line 8-way L2 cache
> cpu20: smt 1, core 4, package 0
> cpu21 at mainbus0: apid 41 (application processor)
> cpu21: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu21:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu21: 256KB 64b/line 8-way L2 cache
> cpu21: smt 1, core 4, package 1
> cpu22 at mainbus0: apid 11 (application processor)
> cpu22: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu22:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu22: 256KB 64b/line 8-way L2 cache
> cpu22: smt 1, core 5, package 0
> cpu23 at mainbus0: apid 43 (application processor)
> cpu23: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz, 2600.01 MHz, 06-2d-07
> cpu23:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
> cpu23: 256KB 64b/line 8-way L2 cache
> cpu23: smt 1, core 5, package 1
> ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 20, 24 pins
> ioapic1 at mainbus0: apid 1 pa 0xfec3f000, version 20, 24 pins, remapped
> ioapic2 at mainbus0: apid 2 pa 0xfec7f000, version 20, 24 pins, remapped
> acpihpet0 at acpi0: 14318179 Hz
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xe0000000, bus 0-255
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (PEX1)
> acpiprt2 at acpi0: bus -1 (PE1C)
> acpiprt3 at acpi0: bus 3 (PEX2)
> acpiprt4 at acpi0: bus 2 (PEX3)
> acpiprt5 at acpi0: bus 4 (PEX4)
> acpiprt6 at acpi0: bus -1 (PEX5)
> acpiprt7 at acpi0: bus 7 (PEX6)
> acpiprt8 at acpi0: bus -1 (PEX7)
> acpiprt9 at acpi0: bus 64 (PCI1)
> acpiprt10 at acpi0: bus 65 (PEXB)
> acpiprt11 at acpi0: bus -1 (PEXC)
> acpiprt12 at acpi0: bus 66 (PEXD)
> acpiprt13 at acpi0: bus -1 (PEXE)
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> acpipci1 at acpi0 PCI1: 0x00000000 0x00000011 0x00000001
> acpipci2 at acpi0 P0B1: 0x00000000 0x00000011 0x00000001
> acpipci3 at acpi0 P1B1: 0x00000000 0x00000011 0x00000001
> "PNP0C14" at acpi0 not configured
> acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1)
> ipmi at mainbus0 not configured
> cpu0: using VERW MDS workaround (except on vmm entry)
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel E5 Host" rev 0x07
> ppb0 at pci0 dev 1 function 0 "Intel E5 PCIE" rev 0x07
> pci1 at ppb0 bus 1
> em0 at pci1 dev 0 function 0 "Intel I350" rev 0x01: msi, address
> b8:ca:3a:61:3d:10
> em1 at pci1 dev 0 function 1 "Intel I350" rev 0x01: msi, address
> b8:ca:3a:61:3d:11
> em2 at pci1 dev 0 function 2 "Intel I350" rev 0x01: msi, address
> b8:ca:3a:61:3d:12
> em3 at pci1 dev 0 function 3 "Intel I350" rev 0x01: msi, address
> b8:ca:3a:61:3d:13
> ppb1 at pci0 dev 2 function 0 "Intel E5 PCIE" rev 0x07
> pci2 at ppb1 bus 3
> ppb2 at pci0 dev 2 function 2 "Intel E5 PCIE" rev 0x07
> pci3 at ppb2 bus 2
> mfii0 at pci3 dev 0 function 0 "Symbios Logic MegaRAID SAS2208" rev 0x05: msi
> mfii0: "PERC H710 Mini", firmware 21.3.5-0002, 512MB cache
> scsibus1 at mfii0: 64 targets
> sd0 at scsibus1 targ 0 lun 0: <DELL, PERC H710, 3.13>
> naa.644a8420008b8b001c8674a0033b0241
> sd0: 139392MB, 512 bytes/sector, 285474816 sectors
> sd1 at scsibus1 targ 1 lun 0: <DELL, PERC H710, 3.13>
> naa.644a8420008b8b001c8674a6039c0d9a
> sd1: 857856MB, 512 bytes/sector, 1756889088 sectors
> scsibus2 at mfii0: 256 targets
> ppb3 at pci0 dev 3 function 0 "Intel E5 PCIE" rev 0x07: msi
> pci4 at ppb3 bus 4
> "Intel E5 Address Map" rev 0x07 at pci0 dev 5 function 0 not configured
> "Intel E5 Error Reporting" rev 0x07 at pci0 dev 5 function 2 not configured
> ppb4 at pci0 dev 17 function 0 "Intel C600 Virtual PCIE" rev 0x05
> pci5 at ppb4 bus 5
> "Intel C600 MEI" rev 0x05 at pci0 dev 22 function 0 not configured
> "Intel C600 MEI" rev 0x05 at pci0 dev 22 function 1 not configured
> ehci0 at pci0 dev 26 function 0 "Intel C600 USB" rev 0x05: apic 0 int 23
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
> addr 1
> ppb5 at pci0 dev 28 function 0 "Intel C600 PCIE" rev 0xb5
> pci6 at ppb5 bus 6
> ppb6 at pci0 dev 28 function 7 "Intel C600 PCIE" rev 0xb5
> pci7 at ppb6 bus 7
> ppb7 at pci7 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
> pci8 at ppb7 bus 8
> ppb8 at pci8 dev 0 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
> pci9 at ppb8 bus 9
> ppb9 at pci9 dev 0 function 0 "Renesas SH7757 PCIE-PCI" rev 0x00
> pci10 at ppb9 bus 10
> vga1 at pci10 dev 0 function 0 "Matrox MGA G200eR" rev 0x00
> wsdisplay at vga1 not configured
> ppb10 at pci8 dev 1 function 0 "Renesas SH7757 PCIE Switch" rev 0x00
> pci11 at ppb10 bus 11
> ehci1 at pci0 dev 29 function 0 "Intel C600 USB" rev 0x05: apic 0 int 22
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
> addr 1
> ppb11 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa5
> pci12 at ppb11 bus 12
> pcib0 at pci0 dev 31 function 0 "Intel C600 LPC" rev 0x05
> ahci0 at pci0 dev 31 function 2 "Intel C600 AHCI" rev 0x05: msi, AHCI 1.3
> ahci0: port 4: 1.5Gb/s
> scsibus3 at ahci0: 32 targets
> cd0 at scsibus3 targ 4 lun 0: <HL-DT-ST, DVD-ROM DU60N, D301> removable
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> pci13 at mainbus0 bus 64
> ppb12 at pci13 dev 1 function 0 "Intel E5 PCIE" rev 0x07: msi
> pci14 at ppb12 bus 65
> ppb13 at pci13 dev 3 function 0 "Intel E5 PCIE" rev 0x07: msi
> pci15 at ppb13 bus 66
> "Intel E5 Address Map" rev 0x07 at pci13 dev 5 function 0 not configured
> "Intel E5 Error Reporting" rev 0x07 at pci13 dev 5 function 2 not configured
> pci16 at mainbus0 bus 63
> "Intel E5 QPI Link" rev 0x07 at pci16 dev 8 function 0 not configured
> "Intel E5 QPI Link" rev 0x07 at pci16 dev 9 function 0 not configured
> "Intel E5 PCU" rev 0x07 at pci16 dev 10 function 0 not configured
> "Intel E5 PCU" rev 0x07 at pci16 dev 10 function 1 not configured
> "Intel E5 PCU" rev 0x07 at pci16 dev 10 function 2 not configured
> "Intel E5 PCU" rev 0x07 at pci16 dev 10 function 3 not configured
> "Intel E5 Scratch" rev 0x07 at pci16 dev 11 function 0 not configured
> "Intel E5 Scratch" rev 0x07 at pci16 dev 11 function 3 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 12 function 0 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 12 function 1 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 12 function 2 not configured
> "Intel E5 SAD" rev 0x07 at pci16 dev 12 function 6 not configured
> "Intel E5 SAD" rev 0x07 at pci16 dev 12 function 7 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 13 function 0 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 13 function 1 not configured
> "Intel E5 Unicast" rev 0x07 at pci16 dev 13 function 2 not configured
> "Intel E5 Broadcast" rev 0x07 at pci16 dev 13 function 6 not configured
> "Intel E5 Home Agent" rev 0x07 at pci16 dev 14 function 0 not configured
> "Intel E5 Home Agent" rev 0x07 at pci16 dev 14 function 1 not configured
> "Intel E5 TA" rev 0x07 at pci16 dev 15 function 0 not configured
> "Intel E5 RAS" rev 0x07 at pci16 dev 15 function 1 not configured
> "Intel E5 TAD" rev 0x07 at pci16 dev 15 function 2 not configured
> "Intel E5 TAD" rev 0x07 at pci16 dev 15 function 3 not configured
> "Intel E5 TAD" rev 0x07 at pci16 dev 15 function 4 not configured
> "Intel E5 TAD" rev 0x07 at pci16 dev 15 function 5 not configured
> "Intel E5 TAD" rev 0x07 at pci16 dev 15 function 6 not configured
> "Intel E5 Thermal" rev 0x07 at pci16 dev 16 function 0 not configured
> "Intel E5 Thermal" rev 0x07 at pci16 dev 16 function 1 not configured
> "Intel E5 Error" rev 0x07 at pci16 dev 16 function 2 not configured
> "Intel E5 Error" rev 0x07 at pci16 dev 16 function 3 not configured
> "Intel E5 Thermal" rev 0x07 at pci16 dev 16 function 4 not configured
> "Intel E5 Thermal" rev 0x07 at pci16 dev 16 function 5 not configured
> "Intel E5 Error" rev 0x07 at pci16 dev 16 function 6 not configured
> "Intel E5 Error" rev 0x07 at pci16 dev 16 function 7 not configured
> "Intel E5 DDRIO" rev 0x07 at pci16 dev 17 function 0 not configured
> "Intel E5 R2PCIE" rev 0x07 at pci16 dev 19 function 0 not configured
> "Intel E5 PCIE Monitor" rev 0x07 at pci16 dev 19 function 1 not configured
> "Intel E5 QPI" rev 0x07 at pci16 dev 19 function 4 not configured
> "Intel E5 QPI Link Monitor" rev 0x07 at pci16 dev 19 function 5 not configured
> "Intel E5 QPI Link Monitor" rev 0x07 at pci16 dev 19 function 6 not configured
> pci17 at mainbus0 bus 127
> "Intel E5 QPI Link" rev 0x07 at pci17 dev 8 function 0 not configured
> "Intel E5 QPI Link" rev 0x07 at pci17 dev 9 function 0 not configured
> "Intel E5 PCU" rev 0x07 at pci17 dev 10 function 0 not configured
> "Intel E5 PCU" rev 0x07 at pci17 dev 10 function 1 not configured
> "Intel E5 PCU" rev 0x07 at pci17 dev 10 function 2 not configured
> "Intel E5 PCU" rev 0x07 at pci17 dev 10 function 3 not configured
> "Intel E5 Scratch" rev 0x07 at pci17 dev 11 function 0 not configured
> "Intel E5 Scratch" rev 0x07 at pci17 dev 11 function 3 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 12 function 0 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 12 function 1 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 12 function 2 not configured
> "Intel E5 SAD" rev 0x07 at pci17 dev 12 function 6 not configured
> "Intel E5 SAD" rev 0x07 at pci17 dev 12 function 7 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 13 function 0 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 13 function 1 not configured
> "Intel E5 Unicast" rev 0x07 at pci17 dev 13 function 2 not configured
> "Intel E5 Broadcast" rev 0x07 at pci17 dev 13 function 6 not configured
> "Intel E5 Home Agent" rev 0x07 at pci17 dev 14 function 0 not configured
> "Intel E5 Home Agent" rev 0x07 at pci17 dev 14 function 1 not configured
> "Intel E5 TA" rev 0x07 at pci17 dev 15 function 0 not configured
> "Intel E5 RAS" rev 0x07 at pci17 dev 15 function 1 not configured
> "Intel E5 TAD" rev 0x07 at pci17 dev 15 function 2 not configured
> "Intel E5 TAD" rev 0x07 at pci17 dev 15 function 3 not configured
> "Intel E5 TAD" rev 0x07 at pci17 dev 15 function 4 not configured
> "Intel E5 TAD" rev 0x07 at pci17 dev 15 function 5 not configured
> "Intel E5 TAD" rev 0x07 at pci17 dev 15 function 6 not configured
> "Intel E5 Thermal" rev 0x07 at pci17 dev 16 function 0 not configured
> "Intel E5 Thermal" rev 0x07 at pci17 dev 16 function 1 not configured
> "Intel E5 Error" rev 0x07 at pci17 dev 16 function 2 not configured
> "Intel E5 Error" rev 0x07 at pci17 dev 16 function 3 not configured
> "Intel E5 Thermal" rev 0x07 at pci17 dev 16 function 4 not configured
> "Intel E5 Thermal" rev 0x07 at pci17 dev 16 function 5 not configured
> "Intel E5 Error" rev 0x07 at pci17 dev 16 function 6 not configured
> "Intel E5 Error" rev 0x07 at pci17 dev 16 function 7 not configured
> "Intel E5 DDRIO" rev 0x07 at pci17 dev 17 function 0 not configured
> "Intel E5 R2PCIE" rev 0x07 at pci17 dev 19 function 0 not configured
> "Intel E5 PCIE Monitor" rev 0x07 at pci17 dev 19 function 1 not configured
> "Intel E5 QPI" rev 0x07 at pci17 dev 19 function 4 not configured
> "Intel E5 QPI Link Monitor" rev 0x07 at pci17 dev 19 function 5 not configured
> "Intel E5 QPI Link Monitor" rev 0x07 at pci17 dev 19 function 6 not configured
> vmm0 at mainbus0: VMX/EPT
> uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
> rev 2.00/0.00 addr 2
> uhub3 at uhub2 port 6 configuration 1 interface 0 "no manufacturer Gadget USB
> HUB" rev 2.00/0.00 addr 3
> uhidev0 at uhub3 port 1 configuration 1 interface 0 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0 mux 1
> uhidev1 at uhub3 port 1 configuration 1 interface 1 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhidev2 at uhub3 port 1 configuration 1 interface 2 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev2: iclass 3/1
> ums1 at uhidev2: 3 buttons, Z dir
> wsmouse1 at ums1 mux 0
> uhub4 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
> rev 2.00/0.00 addr 2
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> root on sd0a (67453fe93d5a531b.a) swap on sd0b dump on sd0b
> wskbd0 detached
> ukbd0 detached
> uhidev0 detached
> wsmouse0 detached
> ums0 detached
> uhidev1 detached
> wsmouse1 detached
> ums1 detached
> uhidev2 detached
> uhidev0 at uhub3 port 1 configuration 1 interface 0 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0 mux 1
> uhidev1 at uhub3 port 1 configuration 1 interface 1 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhidev2 at uhub3 port 1 configuration 1 interface 2 "Avocent Keyboard/Mouse
> Function" rev 2.00/0.00 addr 4
> uhidev2: iclass 3/1
> ums1 at uhidev2: 3 buttons, Z dir
> wsmouse1 at ums1 mux 0
