Hi all,
in production I have simple carp pfsync setup with
em0 - carp <- uplink
em1 - pfsync
ix0 - vlan - carp <- internal networks
ix1 - not used
and for vpn I have wireguard and people connects to em0 carp address.
There's no bridges or tunnels or any exotic pf feature in this setup.
Until this snapshot
OpenBSD 7.4-current (GENERIC.MP) #1587: Sat Dec 30 22:44:51 MST 2023
every this was fine,
but with and after
OpenBSD 7.4-current (GENERIC.MP) #1588: Thu Jan 4 20:58:35 MST 2024
em0 starts to go up/down spontaneously and em0 watchdog logs start to
appear in messages
em0: watchdog: head 113 tail 178 TDH 178 TDT 113
carp1: state transition: BACKUP -> MASTER
even with net.inet.tcp.tso=0
When reverting em TSO diffs if_em.c to r1.369 and if_em.h to r1.80
firewall starts to work normally and em0 is fine.
After rebooting firewall and promote it to carp master I've started to
collect kstat em0::: after em0 watchdog log
1) Jan 22 08:01:01 fw2 /bsd: em0: watchdog: head 473 tail 25 TDH 25 TDT 473
kstat em0::: - em0-1.txt
2) Jan 22 08:07:11 fw2 /bsd: em0: watchdog: head 114 tail 178 TDH 178
TDT 114
3) Jan 22 08:08:16 fw2 /bsd: em0: watchdog: head 61 tail 126 TDH 126 TDT 61
kstat em0::: - em0-3.txt
4) Jan 22 08:21:23 fw2 /bsd: em0: watchdog: head 452 tail 5 TDH 5 TDT 452
5) Jan 22 08:33:48 fw2 /bsd: em0: watchdog: head 352 tail 416 TDH 416
TDT 352
6) Jan 22 08:36:20 fw2 /bsd: em0: watchdog: head 446 tail 510 TDH 510
TDT 446
kstat em0::: - em0-6.txt
7) Jan 22 08:42:16 fw1 /bsd: em0: watchdog: head 385 tail 450 TDH 450
TDT 385
kstat em0::: - em0-7.txt
in the attachment you can find em0 txt kstat output and kstat-all.txt
which is kstat of all interfaces with TSO diff after 7th time em0
watchdog log
>From logs it seems that em0:0:txq:0 oactives counter, em0 watchdog and
em0 going up/down is somehow connected because every time I see em0
watchdog, oactives counter is increased by one
log on switch
I 01/22/24 08:01:01 00077 ports: port 2 is now off-line
I 01/22/24 08:01:05 00076 ports: port 2 is now on-line
I 01/22/24 08:07:11 00077 ports: port 2 is now off-line
I 01/22/24 08:07:14 00076 ports: port 2 is now on-line
I 01/22/24 08:08:16 00077 ports: port 2 is now off-line
I 01/22/24 08:08:20 00076 ports: port 2 is now on-line
I 01/22/24 08:21:23 00077 ports: port 2 is now off-line
I 01/22/24 08:21:26 00076 ports: port 2 is now on-line
I 01/22/24 08:33:47 00077 ports: port 2 is now off-line
I 01/22/24 08:33:51 00076 ports: port 2 is now on-line
I 01/22/24 08:36:20 00077 ports: port 2 is now off-line
I 01/22/24 08:36:24 00076 ports: port 2 is now on-line
I 01/22/24 08:42:16 00077 ports: port 2 is now off-line
I 01/22/24 08:42:20 00076 ports: port 2 is now on-line
em0 is connected to port 2
ix0 is connected to port 6 and it's up whole the time...
Packet processing and some little pressure need to be over em0 to
trigger em0 watchdog and only carp master is affected. Over night there
are 2 or 3 em0 watchdogs. Firewalls are more than underutilized cca 5k
states and under 100Mbps
To rule out em hardware problem, I've sysupdate second firewall and
problem was the same as on first one.
I am willing to debug this further but I don't know what to look any
more ...
And of course, thank you guys for carp and pfsync, without it this would
be a problem but it's not :)
kstat em0::: after day without TSO diffs
fw2# uptime
12:36AM up 1 day, 13:38, 2 users, load averages: 0.35, 0.23, 0.23
fw2# kstat em0:::
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 6361422 packets
rx 65-127B: 19106140 packets
rx 128-255B: 4430154 packets
rx 256-511B: 5116503 packets
rx 512-1023B: 7665843 packets
rx 1024-maxB: 86778341 packets
rx good: 129458403 packets
rx bcast: 147 packets
rx mcast: 112979 packets
tx good: 67968976 packets
rx good: 134077827262 bytes
tx good: 32314161469 bytes
rx no buffers: 4 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 134077827262 bytes
tx total: 32314161469 bytes
rx total: 129458403 packets
tx total: 67968976 packets
tx 64B: 8932448 packets
tx 65-127B: 31092764 packets
tx 128-255B: 3930861 packets
tx 256-511B: 2126737 packets
tx 512-1023B: 4009214 packets
tx 1024-maxB: 17876952 packets
tx mcast: 71830 packets
tx bcast: 144 packets
em0:0:rxq:0
packets: 129458403 packets
bytes: 133559993650 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 114415797
dequeues: 114407008
em0:0:txq:0
packets: 67968978 packets
bytes: 31989786911 bytes
qdrops: 2 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 0
OpenBSD 7.4-current (GENERIC.MP) #32: Mon Jan 22 10:57:01 CET 2024
[email protected]:/sys/arch/amd64/compile/GENERIC.MP
real mem = 17052467200 (16262MB)
avail mem = 16514764800 (15749MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xed9b0 (40 entries)
bios0: vendor American Megatrends Inc. version "2.1" date 11/22/2019
bios0: Supermicro Super Server
acpi0 at bios0: ACPI 5.0
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP APIC FPDT FIDT SPMI MCFG UEFI DBG2 HPET WDDT
SSDT SSDT SSDT PRAD DMAR HEST BERT ERST EINJ
acpi0: wakeup devices IP2P(S4) EHC1(S4) EHC2(S4) RP01(S4) RP02(S4)
RP03(S4) RP04(S4) RP05(S4) RP06(S4) RP07(S4) RP08(S4) BR1A(S4) BR1B(S4)
BR2A(S4) BR2B(S4) BR2C(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.04 MHz, 06-56-03,
patch 0700001c
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 100MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.07 MHz, 06-56-03,
patch 0700001c
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.15 MHz, 06-56-03,
patch 0700001c
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.20 MHz, 06-56-03,
patch 0700001c
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
cpu4: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.21 MHz, 06-56-03,
patch 0700001c
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu4: smt 0, core 4, package 0
cpu5 at mainbus0: apid 10 (application processor)
cpu5: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.22 MHz, 06-56-03,
patch 0700001c
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu5: smt 0, core 5, package 0
cpu6 at mainbus0: apid 12 (application processor)
cpu6: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.25 MHz, 06-56-03,
patch 0700001c
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu6: smt 0, core 6, package 0
cpu7 at mainbus0: apid 14 (application processor)
cpu7: Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz, 2100.38 MHz, 06-56-03,
patch 0700001c
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 12MB 64b/line 12-way L3 cache
cpu7: smt 0, core 7, package 0
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 255 (UNC0)
acpiprt1 at acpi0: bus 0 (PCI0)
acpiprt2 at acpi0: bus 5 (RP01)
acpiprt3 at acpi0: bus 6 (RP05)
acpiprt4 at acpi0: bus 7 (ASTB)
acpiprt5 at acpi0: bus 1 (BR1A)
acpiprt6 at acpi0: bus 3 (BR2C)
acpiprt7 at acpi0: bus 4 (BR3A)
acpipci0 at acpi0 UNC0: 0x00000010 0x00000011 0x00000000
"ACPI0004" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"ACPI0007" at acpi0 not configured
"PNP0C33" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpipci1 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpicmos0 at acpi0
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com1 at acpi0 UAR2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
com1: console
"IPI0001" at acpi0 not configured
acpibtn0 at acpi0: PWRB
acpicpu0 at acpi0: C1(1000@1 halt), PSS
acpicpu1 at acpi0: C1(1000@1 halt), PSS
acpicpu2 at acpi0: C1(1000@1 halt), PSS
acpicpu3 at acpi0: C1(1000@1 halt), PSS
acpicpu4 at acpi0: C1(1000@1 halt), PSS
acpicpu5 at acpi0: C1(1000@1 halt), PSS
acpicpu6 at acpi0: C1(1000@1 halt), PSS
acpicpu7 at acpi0: C1(1000@1 halt), PSS
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 2100 MHz: speeds: 2101, 2100, 2000, 1900, 1800,
1700, 1600, 1500, 1400, 1300, 1200, 1100, 1000, 900, 800 MHz
pci0 at mainbus0 bus 255
255:30:3: io address conflict 0x14/0x4
"Intel Xeon-D QPI Link" rev 0x03 at pci0 dev 11 function 0 not configured
"Intel Xeon-D QPI Link" rev 0x03 at pci0 dev 11 function 1 not configured
"Intel Xeon-D QPI Link" rev 0x03 at pci0 dev 11 function 2 not configured
"Intel Xeon-D QPI Debug" rev 0x03 at pci0 dev 11 function 3 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 12 function 0 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 12 function 1 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 12 function 2 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 12 function 3 not configured
"Intel E5 v4 Cache" rev 0x03 at pci0 dev 12 function 4 not configured
"Intel E5 v4 Cache" rev 0x03 at pci0 dev 12 function 5 not configured
vendor "Intel", unknown product 0x6fe6 (class system subclass
miscellaneous, rev 0x03) at pci0 dev 12 function 6 not configured
vendor "Intel", unknown product 0x6fe7 (class system subclass
miscellaneous, rev 0x03) at pci0 dev 12 function 7 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 15 function 0 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 15 function 4 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 15 function 5 not configured
"Intel Xeon-D Cache" rev 0x03 at pci0 dev 15 function 6 not configured
"Intel Xeon-D PCIE" rev 0x03 at pci0 dev 16 function 0 not configured
"Intel E5 v4 R2PCIe Agent" rev 0x03 at pci0 dev 16 function 1 not configured
"Intel Xeon-D Ubox" rev 0x03 at pci0 dev 16 function 5 not configured
"Intel Xeon-D Ubox" rev 0x03 at pci0 dev 16 function 6 not configured
"Intel Xeon-D Ubox" rev 0x03 at pci0 dev 16 function 7 not configured
"Intel Xeon-D Home Agent" rev 0x03 at pci0 dev 18 function 0 not configured
"Intel Xeon-D Home Agent" rev 0x03 at pci0 dev 18 function 1 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 0 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 1 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 2 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 3 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 4 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 5 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 6 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 19 function 7 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 0 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 1 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 2 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 3 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 4 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 5 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 6 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 20 function 7 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 21 function 0 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 21 function 1 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 21 function 2 not configured
"Intel Xeon-D Memory" rev 0x03 at pci0 dev 21 function 3 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 30 function 0 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 30 function 1 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 30 function 2 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 30 function 3 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 30 function 4 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 31 function 0 not configured
"Intel Xeon-D PCU" rev 0x03 at pci0 dev 31 function 2 not configured
pci1 at mainbus0 bus 0
pchb0 at pci1 dev 0 function 0 "Intel Xeon-D Host" rev 0x03
ppb0 at pci1 dev 1 function 0 "Intel Xeon-D PCIE" rev 0x03: msi
pci2 at ppb0 bus 1
ppb1 at pci1 dev 2 function 0 "Intel Xeon-D PCIE" rev 0x03
pci3 at ppb1 bus 2
"Intel Xeon-D QuickData" rev 0x00 at pci3 dev 0 function 0 not configured
"Intel Xeon-D QuickData" rev 0x00 at pci3 dev 0 function 1 not configured
"Intel Xeon-D QuickData" rev 0x00 at pci3 dev 0 function 2 not configured
"Intel Xeon-D QuickData" rev 0x00 at pci3 dev 0 function 3 not configured
ppb2 at pci1 dev 2 function 2 "Intel Xeon-D PCIE" rev 0x03
pci4 at ppb2 bus 3
vendor "Intel", unknown product 0x10a6 (class undefined unknown subclass
0x00, rev 0x00) at pci4 dev 0 function 0 not configured
ppb3 at pci1 dev 3 function 0 "Intel Xeon-D PCIE" rev 0x03: msi
pci5 at ppb3 bus 4
ix0 at pci5 dev 0 function 0 "Intel X540T" rev 0x01, msix, 8 queues,
address a0:36:9f:29:f3:28
ix1 at pci5 dev 0 function 1 "Intel X540T" rev 0x01, msix, 8 queues,
address a0:36:9f:29:f3:2a
"Intel Xeon-D Address Map" rev 0x03 at pci1 dev 5 function 0 not configured
"Intel Xeon-D Hot Plug" rev 0x03 at pci1 dev 5 function 1 not configured
"Intel Xeon-D RAS" rev 0x03 at pci1 dev 5 function 2 not configured
xhci0 at pci1 dev 20 function 0 "Intel 8 Series xHCI" rev 0x05: msi,
xHCI 1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
3.00/1.00 addr 1
"Intel 8 Series MEI" rev 0x04 at pci1 dev 22 function 0 not configured
"Intel 8 Series MEI" rev 0x04 at pci1 dev 22 function 1 not configured
ehci0 at pci1 dev 26 function 0 "Intel 8 Series USB" rev 0x05: apic 8 int 18
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb4 at pci1 dev 28 function 0 "Intel 8 Series PCIE" rev 0xd5: msi
pci6 at ppb4 bus 5
em0 at pci6 dev 0 function 0 "Intel I350" rev 0x01: msi, address
ac:1f:6b:14:bd:b2
em1 at pci6 dev 0 function 1 "Intel I350" rev 0x01: msi, address
ac:1f:6b:14:bd:b3
ppb5 at pci1 dev 28 function 4 "Intel 8 Series PCIE" rev 0xd5: msi
pci7 at ppb5 bus 6
ppb6 at pci7 dev 0 function 0 "ASPEED Technology AST1150 PCI" rev 0x03
pci8 at ppb6 bus 7
vga1 at pci8 dev 0 function 0 "ASPEED Technology AST2000" rev 0x30
wsdisplay at vga1 not configured
ehci1 at pci1 dev 29 function 0 "Intel 8 Series USB" rev 0x05: apic 8 int 18
usb2 at ehci1: USB revision 2.0
uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
pcib0 at pci1 dev 31 function 0 "Intel C224 LPC" rev 0x05
ahci0 at pci1 dev 31 function 2 "Intel 8 Series AHCI" rev 0x05: msi,
AHCI 1.3
ahci0: port 0: 6.0Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, MTFDDAV256TDL, M5M> naa.500a0751269794ce
sd0: 244198MB, 512 bytes/sector, 500118192 sectors, thin
ichiic0 at pci1 dev 31 function 3 "Intel 8 Series SMBus" rev 0x05: apic
8 int 18
iic0 at ichiic0
"Intel 8 Series Thermal" rev 0x05 at pci1 dev 31 function 6 not configured
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vmm0 at mainbus0: VMX/EPT
uhub3 at uhub0 port 3 configuration 1 interface 0 "Genesys Logic USB2.0
Hub" rev 2.00/32.98 addr 2
uhub4 at uhub0 port 4 configuration 1 interface 0 "ATEN International
product 0x7000" rev 2.00/0.00 addr 3
uhidev0 at uhub4 port 1 configuration 1 interface 0 "ATEN International
product 0x2419" rev 1.10/1.00 addr 4
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes
wskbd0 at ukbd0 mux 1
uhidev1 at uhub4 port 1 configuration 1 interface 1 "ATEN International
product 0x2419" rev 1.10/1.00 addr 4
uhidev1: iclass 3/1
ums0 at uhidev1: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
uhub5 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.05 addr 2
uhub6 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.05 addr 2
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on sd0a (65d02aa7010489f5.a) swap on sd0b dump on sd0b
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 12801 packets
rx 65-127B: 7385 packets
rx 128-255B: 2146 packets
rx 256-511B: 1926 packets
rx 512-1023B: 1272 packets
rx 1024-maxB: 192926 packets
rx good: 218456 packets
rx bcast: 0 packets
rx mcast: 221 packets
tx good: 88407 packets
rx good: 295570897 bytes
tx good: 10902682 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 295570897 bytes
tx total: 10902682 bytes
rx total: 218456 packets
tx total: 88407 packets
tx 64B: 27400 packets
tx 65-127B: 55743 packets
tx 128-255B: 1315 packets
tx 256-511B: 1301 packets
tx 512-1023B: 531 packets
tx 1024-maxB: 2117 packets
tx mcast: 292 packets
tx bcast: 4 packets
em0:0:rxq:0
packets: 605544 packets
bytes: 556889070 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 504148
dequeues: 503966
em0:0:txq:0
packets: 384818 packets
bytes: 211780564 bytes
qdrops: 653 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 3
carp1:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
carp1:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
carp2:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
carp2:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
carp3:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
carp3:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
carp4:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
carp4:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
carp5:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
carp5:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 38247 packets
rx 65-127B: 22814 packets
rx 128-255B: 5563 packets
rx 256-511B: 3733 packets
rx 512-1023B: 2925 packets
rx 1024-maxB: 206287 packets
rx good: 279569 packets
rx bcast: 8 packets
rx mcast: 8679 packets
tx good: 119476 packets
rx good: 319655129 bytes
tx good: 19745188 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 319655129 bytes
tx total: 19745188 bytes
rx total: 279569 packets
tx total: 119476 packets
tx 64B: 35584 packets
tx 65-127B: 69872 packets
tx 128-255B: 3959 packets
tx 256-511B: 2537 packets
tx 512-1023B: 1555 packets
tx 1024-maxB: 5969 packets
tx mcast: 931 packets
tx bcast: 14 packets
em0:0:rxq:0
packets: 942857 packets
bytes: 866440559 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 825812
dequeues: 825488
em0:0:txq:0
packets: 572851 packets
bytes: 250955657 bytes
qdrops: 2274 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 7
em1:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 0 packets
rx 65-127B: 24007 packets
rx 128-255B: 24032975 packets
rx 256-511B: 2436924 packets
rx 512-1023B: 388592 packets
rx 1024-maxB: 63818 packets
rx good: 26946316 packets
rx bcast: 0 packets
rx mcast: 26946316 packets
tx good: 26906718 packets
rx good: 4879163369 bytes
tx good: 3966678996 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 4879163538 bytes
tx total: 3966678996 bytes
rx total: 26946317 packets
tx total: 26906718 packets
tx 64B: 2 packets
tx 65-127B: 30498 packets
tx 128-255B: 26815175 packets
tx 256-511B: 31329 packets
tx 512-1023B: 8858 packets
tx 1024-maxB: 20856 packets
tx mcast: 26906718 packets
tx bcast: 0 packets
em1:0:rxq:0
packets: 26946316 packets
bytes: 4771378105 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 22750209
dequeues: 22750196
em1:0:txq:0
packets: 26906721 packets
bytes: 3859052782 bytes
qdrops: 3 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 0
enc0:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
enc0:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
ix0:0:ix-rxq:0
packets: 103395 packets
bytes: 13623132 bytes
qdrops: 0 packets
ix0:0:ix-rxq:1
packets: 35731 packets
bytes: 7889584 bytes
qdrops: 0 packets
ix0:0:ix-rxq:2
packets: 46561 packets
bytes: 8939453 bytes
qdrops: 0 packets
ix0:0:ix-rxq:3
packets: 67097 packets
bytes: 10931917 bytes
qdrops: 0 packets
ix0:0:ix-rxq:4
packets: 50523 packets
bytes: 9170313 bytes
qdrops: 0 packets
ix0:0:ix-rxq:5
packets: 54839 packets
bytes: 15564813 bytes
qdrops: 0 packets
ix0:0:ix-rxq:6
packets: 69092 packets
bytes: 8756106 bytes
qdrops: 0 packets
ix0:0:ix-rxq:7
packets: 70177 packets
bytes: 13530697 bytes
qdrops: 0 packets
ix0:0:ix-stats:0
crc errs: 0 packets
tx link xon: 0 packets
rx link xon: 0 packets
tx link xoff: 0 packets
rx link xoff: 0 packets
rx 64B: 10338 packets
rx 65-127B: 399065 packets
rx 128-255B: 33266 packets
rx 256-511B: 16561 packets
rx 512-1023B: 13646 packets
rx 1024-maxB: 24539 packets
tx good: 584080 packets
rx good: 90395675 bytes
tx good: 673276498 bytes
rx undersize: 0 packets
rx fragment: 0 packets
rx oversize: 0 packets
rx jabber: 0 packets
rx total: 90395675 bytes
rx total: 497415 packets
tx total: 584080 packets
rx good: 497415 packets
rx bcast: 39287 packets
rx mcast: 118472 packets
tx 64B: 21103 packets
tx 65-127B: 82865 packets
tx 128-255B: 19754 packets
tx 256-511B: 17073 packets
tx 512-1023B: 10395 packets
tx 1024-maxB: 432890 packets
tx mcast: 14841 packets
tx bcast: 651 packets
ix0:0:ix-txq:0
packets: 59265 packets
bytes: 60975126 bytes
ix0:0:ix-txq:1
packets: 135661 packets
bytes: 183001748 bytes
ix0:0:ix-txq:2
packets: 48174 packets
bytes: 44327749 bytes
ix0:0:ix-txq:3
packets: 105400 packets
bytes: 136015457 bytes
ix0:0:ix-txq:4
packets: 55374 packets
bytes: 59972618 bytes
ix0:0:ix-txq:5
packets: 41407 packets
bytes: 39271113 bytes
ix0:0:ix-txq:6
packets: 90307 packets
bytes: 105404197 bytes
ix0:0:ix-txq:7
packets: 48492 packets
bytes: 41920536 bytes
ix0:0:rxq:0
packets: 102680 packets
bytes: 13190654 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 98397
dequeues: 98393
ix0:0:rxq:1
packets: 35001 packets
bytes: 7704294 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 32470
dequeues: 32469
ix0:0:rxq:2
packets: 46113 packets
bytes: 8727451 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 42171
dequeues: 42166
ix0:0:rxq:3
packets: 66045 packets
bytes: 10604795 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 59982
dequeues: 59979
ix0:0:rxq:4
packets: 49130 packets
bytes: 8890741 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 46783
dequeues: 46780
ix0:0:rxq:5
packets: 54386 packets
bytes: 15319027 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 48300
dequeues: 48298
ix0:0:rxq:6
packets: 68583 packets
bytes: 8450746 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 64389
dequeues: 64388
ix0:0:rxq:7
packets: 69529 packets
bytes: 13212579 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 64066
dequeues: 64061
ix0:0:txq:0
packets: 59265 packets
bytes: 60739526 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:1
packets: 135661 packets
bytes: 182459104 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:2
packets: 48174 packets
bytes: 44135053 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:3
packets: 105400 packets
bytes: 135593857 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:4
packets: 55374 packets
bytes: 59751122 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:5
packets: 41407 packets
bytes: 39105485 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:6
packets: 90307 packets
bytes: 105042969 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix0:0:txq:7
packets: 48492 packets
bytes: 41726568 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:ix-rxq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:1
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:2
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:3
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:4
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:5
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:6
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-rxq:7
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
ix1:0:ix-stats:0
crc errs: 0 packets
tx link xon: 0 packets
rx link xon: 0 packets
tx link xoff: 0 packets
rx link xoff: 0 packets
rx 64B: 0 packets
rx 65-127B: 0 packets
rx 128-255B: 0 packets
rx 256-511B: 0 packets
rx 512-1023B: 0 packets
rx 1024-maxB: 0 packets
tx good: 0 packets
rx good: 0 bytes
tx good: 0 bytes
rx undersize: 0 packets
rx fragment: 0 packets
rx oversize: 0 packets
rx jabber: 0 packets
rx total: 0 bytes
rx total: 0 packets
tx total: 0 packets
rx good: 0 packets
rx bcast: 0 packets
rx mcast: 0 packets
tx 64B: 0 packets
tx 65-127B: 0 packets
tx 128-255B: 0 packets
tx 256-511B: 0 packets
tx 512-1023B: 0 packets
tx 1024-maxB: 0 packets
tx mcast: 0 packets
tx bcast: 0 packets
ix1:0:ix-txq:0
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:1
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:2
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:3
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:4
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:5
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:6
packets: 0 packets
bytes: 0 bytes
ix1:0:ix-txq:7
packets: 0 packets
bytes: 0 bytes
ix1:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:1
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:2
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:3
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:4
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:5
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:6
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:rxq:7
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
ix1:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:1
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:2
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:3
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:4
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:5
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:6
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
ix1:0:txq:7
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 255 packets
oactive: false
oactives: 0
lo0:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
lo0:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
pflog0:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
pflog0:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
pfsync0:0:pfsync-slice:0
locks: 23906037
contended: 962
write-nops: 0
send-sched: 22391232
send-run: 22374720
enqueues: 7849
dequeues: 7811
qdrops: 0 packets
defer-len: 0 packets
defer-add: 0
defer-ack: 0
defer-run: 0
defer-over: 0
pfsync0:0:pfsync-slice:1
locks: 6013090
contended: 4712
write-nops: 0
send-sched: 4489666
send-run: 4484667
enqueues: 8666
dequeues: 8575
qdrops: 0 packets
defer-len: 0 packets
defer-add: 0
defer-ack: 0
defer-run: 0
defer-over: 0
pfsync0:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
pfsync0:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
vlan2:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
vlan2:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
vlan3:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
vlan3:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
vlan4:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
vlan4:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
vlan5:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
vlan5:0:txq:0
packets: 0 packets
bytes: 0 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
wg0:0:rxq:0
packets: 0 packets
bytes: 0 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 0
dequeues: 0
wg0:0:txq:0
packets: 137573 packets
bytes: 171011958 bytes
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 256 packets
oactive: false
oactives: 0
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 28357 packets
rx 65-127B: 14338 packets
rx 128-255B: 4515 packets
rx 256-511B: 3172 packets
rx 512-1023B: 2246 packets
rx 1024-maxB: 200708 packets
rx good: 253336 packets
rx bcast: 1 packets
rx mcast: 478 packets
tx good: 109562 packets
rx good: 309834085 bytes
tx good: 16751134 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 309834085 bytes
tx total: 16751134 bytes
rx total: 253336 packets
tx total: 109562 packets
tx 64B: 32627 packets
tx 65-127B: 65871 packets
tx 128-255B: 3137 packets
tx 256-511B: 2118 packets
tx 512-1023B: 1172 packets
tx 1024-maxB: 4637 packets
tx mcast: 637 packets
tx bcast: 9 packets
em0:0:rxq:0
packets: 916624 packets
bytes: 856724447 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 800837
dequeues: 800518
em0:0:txq:0
packets: 563866 packets
bytes: 248072399 bytes
qdrops: 2274 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 7
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 10860 packets
rx 65-127B: 6331 packets
rx 128-255B: 1905 packets
rx 256-511B: 1842 packets
rx 512-1023B: 1197 packets
rx 1024-maxB: 192396 packets
rx good: 214531 packets
rx bcast: 0 packets
rx mcast: 171 packets
tx good: 86592 packets
rx good: 294514745 bytes
tx good: 10548770 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 294514745 bytes
tx total: 10548770 bytes
rx total: 214531 packets
tx total: 86592 packets
tx 64B: 27041 packets
tx 65-127B: 54665 packets
tx 128-255B: 1186 packets
tx 256-511B: 1218 packets
tx 512-1023B: 468 packets
tx 1024-maxB: 2014 packets
tx mcast: 232 packets
tx bcast: 2 packets
em0:0:rxq:0
packets: 588035 packets
bytes: 545687060 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 487562
dequeues: 487414
em0:0:txq:0
packets: 374938 packets
bytes: 209936469 bytes
qdrops: 218 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 1
em0:0:em-stats:0
rx crc errs: 0 packets
rx align errs: 0 packets
rx align errs: 0 packets
rx errs: 0 packets
rx missed: 0 packets
tx single coll: 0 packets
tx excess coll: 0 packets
tx multi coll: 0 packets
tx late coll: 0 packets
tx coll: 0
tx defers: 0
tx no CRS: 0 packets
seq errs: 0
carr ext errs: 0 packets
rx len errs: 0 packets
rx xon: 0 packets
tx xon: 0 packets
rx xoff: 0 packets
tx xoff: 0 packets
FC unsupported: 0 packets
rx 64B: 27069 packets
rx 65-127B: 13570 packets
rx 128-255B: 4212 packets
rx 256-511B: 3083 packets
rx 512-1023B: 2155 packets
rx 1024-maxB: 200436 packets
rx good: 250525 packets
rx bcast: 1 packets
rx mcast: 458 packets
tx good: 106810 packets
rx good: 309149842 bytes
tx good: 15485085 bytes
rx no buffers: 0 packets
rx undersize: 0 packets
rx fragments: 0 packets
rx oversize: 0 packets
rx jabbers: 0 packets
rx mgmt: 0 packets
rx mgmt drops: 0 packets
tx mgmt: 0 packets
rx total: 309149842 bytes
tx total: 15485085 bytes
rx total: 250525 packets
tx total: 106810 packets
tx 64B: 31894 packets
tx 65-127B: 64951 packets
tx 128-255B: 2949 packets
tx 256-511B: 2036 packets
tx 512-1023B: 1119 packets
tx 1024-maxB: 3861 packets
tx mcast: 619 packets
tx bcast: 7 packets
em0:0:rxq:0
packets: 884989 packets
bytes: 837697007 bytes
fdrops: 0 packets
qdrops: 0 packets
errors: 0 packets
qlen: 0 packets
enqueues: 771834
dequeues: 771515
em0:0:txq:0
packets: 547847 packets
bytes: 242611259 bytes
qdrops: 1784 packets
errors: 0 packets
qlen: 0 packets
maxqlen: 511 packets
oactive: false
oactives: 6
