Thanks for the cluestick. I don't disagree with anything you said btw.
Here's the dmesg. (attachment, can in-line if thats better)
---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-RELEASE-p8 #0: Tue Mar 15 09:36:28 UTC 2022
[email protected]:/usr/obj/usr/src/amd64.amd64/sys/GENERIC
amd64
FreeBSD clang version 11.0.1 ([email protected]:llvm/llvm-project.git
llvmorg-11.0.1-0-g43ff75f2c3fe)
VT(efifb): resolution 1024x768
CPU: AMD EPYC 7352 24-Core Processor (2295.74-MHz K8-class CPU)
Origin="AuthenticAMD" Id=0x830f10 Family=0x17 Model=0x31 Stepping=0
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x7ef8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD
Features2=0x75c237ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX,ADMSKX>
Structured Extended
Features=0x219c91a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,PQM,PQE,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,SHA>
Structured Extended Features2=0x400004<UMIP,RDPID>
XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
AMD Extended Feature Extensions ID
EBX=0x18cf757<CLZERO,IRPerf,XSaveErPtr,RDPRU,MCOMMIT,WBNOINVD,IBPB,IBRS,STIBP,PREFER_IBRS,PPIN,SSBD>
SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
TSC: P-state invariant, performance statistics
real memory = 549739036672 (524272 MB)
avail memory = 534988161024 (510204 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <DELL PE_SC3 >
FreeBSD/SMP: Multiprocessor System Detected: 96 CPUs
FreeBSD/SMP: 2 package(s) x 8 cache groups x 3 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 240 != hw id 0
ioapic1: MADT APIC ID 241 != hw id 0
ioapic2: MADT APIC ID 242 != hw id 0
ioapic3: MADT APIC ID 243 != hw id 0
ioapic4: MADT APIC ID 244 != hw id 0
ioapic5: MADT APIC ID 245 != hw id 0
ioapic6: MADT APIC ID 246 != hw id 0
ioapic7: MADT APIC ID 247 != hw id 0
ioapic8: MADT APIC ID 248 != hw id 0
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 120-151
ioapic2 <Version 2.1> irqs 88-119
ioapic3 <Version 2.1> irqs 56-87
ioapic4 <Version 2.1> irqs 24-55
ioapic5 <Version 2.1> irqs 248-279
ioapic6 <Version 2.1> irqs 216-247
ioapic7 <Version 2.1> irqs 184-215
ioapic8 <Version 2.1> irqs 152-183
Launching APs: 19 18 20 1 2 4 23 3 41 5 39 36 47 43 44 82 17 83 13 14 31 87 33
79 29 78 26 56 25 57 34 86 50 48 53 89 84 93 95 62 60 85 65 51 68 70 66 81 75
77 72 54 59 7 9 63 10 35 38 32 91 46 27 42 64 28 8 37 12 30 22 21 67 24 73 92
71 76 61 40 69 94 52 88 90 16 15 55 74 11 6 80 49 45 58
Timecounter "TSC-low" frequency 1147870878 Hz quality 1000
KTLS: Initialized 96 threads
random: entropy device external interface
[ath_hal] loaded
WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 14.0.
kbd0 at kbdmux0
000.000147 [4354] netmap_init netmap: loaded module
mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020)
nexus0
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
cryptosoft0: <software crypto>
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <DELL PE_SC3>
acpi0: Power Button (fixed)
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed001ff on acpi0
hpet0: memory region width 512 too small
device_attach: hpet0 attach returned 6
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
apei0: <ACPI Platform Error Interface> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci0: <ACPI PCI bus> numa-domain 0 on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.1 numa-domain 0 on pci0
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
nvme0: <Generic NVMe Device> mem 0xa4800000-0xa4807fff at device 0.0
numa-domain 0 on pci1
pcib2: <ACPI PCI-PCI bridge> at device 1.2 numa-domain 0 on pci0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
nvme1: <Generic NVMe Device> mem 0xa4700000-0xa4707fff at device 0.0
numa-domain 0 on pci2
pcib3: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 0 on pci0
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
pci3: <unknown> at device 0.0 (no driver attached)
pci3: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib4: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 0 on pci0
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
pci4: <unknown> at device 0.0 (no driver attached)
pci4: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xa4400000-0xa44fffff at device
0.3 numa-domain 0 on pci4
xhci0: 64 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
isab0: <PCI-ISA bridge> at device 20.3 numa-domain 0 on pci0
isa0: <ISA bus> numa-domain 0 on isab0
pcib5: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pci5: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib6: <ACPI PCI-PCI bridge> at device 3.1 numa-domain 0 on pci5
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
ixl0: <Intel(R) Ethernet Controller X710 for 10GBASE-T - 2.3.0-k> mem
0x98000000-0x98ffffff,0x99018000-0x9901ffff at device 0.0 numa-domain 0 on pci6
ixl0: fw 8.815.63341 api 1.12 nvm 8.15 etid 8000a103 oem 20.5120.17
ixl0: The driver for the device detected a newer version of the NVM image than
expected.
ixl0: Please install the most recent version of the network driver.
ixl0: PF-ID[0]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, MDIO shared
ixl0: Using 1024 TX descriptors and 1024 RX descriptors
ixl0: Using 24 RX queues 24 TX queues
ixl0: Using MSI-X interrupts with 25 vectors
ixl0: Ethernet address: b4:96:91:b5:5f:ac
ixl0: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
ixl0: SR-IOV ready
ixl0: netmap queues/slots: TX 24/1024, RX 24/1024
ixl1: <Intel(R) Ethernet Controller X710 for 10GBASE-T - 2.3.0-k> mem
0x97000000-0x97ffffff,0x99010000-0x99017fff at device 0.1 numa-domain 0 on pci6
ixl1: fw 8.815.63341 api 1.12 nvm 8.15 etid 8000a103 oem 20.5120.17
ixl1: The driver for the device detected a newer version of the NVM image than
expected.
ixl1: Please install the most recent version of the network driver.
ixl1: PF-ID[1]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, MDIO shared
ixl1: Using 1024 TX descriptors and 1024 RX descriptors
ixl1: Using 24 RX queues 24 TX queues
ixl1: Using MSI-X interrupts with 25 vectors
ixl1: Ethernet address: b4:96:91:b5:5f:ad
ixl1: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl1: PCI Express Bus: Speed 8.0GT/s Width x8
ixl1: SR-IOV ready
ixl1: netmap queues/slots: TX 24/1024, RX 24/1024
ixl2: <Intel(R) Ethernet Controller X710 for 10GBASE-T - 2.3.0-k> mem
0x96000000-0x96ffffff,0x99008000-0x9900ffff at device 0.2 numa-domain 0 on pci6
ixl2: fw 8.815.63341 api 1.12 nvm 8.15 etid 8000a103 oem 20.5120.17
ixl2: The driver for the device detected a newer version of the NVM image than
expected.
ixl2: Please install the most recent version of the network driver.
ixl2: PF-ID[2]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, MDIO shared
ixl2: Using 1024 TX descriptors and 1024 RX descriptors
ixl2: Using 24 RX queues 24 TX queues
ixl2: Using MSI-X interrupts with 25 vectors
ixl2: Ethernet address: b4:96:91:b5:5f:ae
ixl2: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl2: PCI Express Bus: Speed 8.0GT/s Width x8
ixl2: SR-IOV ready
ixl2: netmap queues/slots: TX 24/1024, RX 24/1024
ixl3: <Intel(R) Ethernet Controller X710 for 10GBASE-T - 2.3.0-k> mem
0x95000000-0x95ffffff,0x99000000-0x99007fff at device 0.3 numa-domain 0 on pci6
ixl3: fw 8.815.63341 api 1.12 nvm 8.15 etid 8000a103 oem 20.5120.17
ixl3: The driver for the device detected a newer version of the NVM image than
expected.
ixl3: Please install the most recent version of the network driver.
ixl3: PF-ID[3]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, MDIO shared
ixl3: Using 1024 TX descriptors and 1024 RX descriptors
ixl3: Using 24 RX queues 24 TX queues
ixl3: Using MSI-X interrupts with 25 vectors
ixl3: Ethernet address: b4:96:91:b5:5f:af
ixl3: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl3: PCI Express Bus: Speed 8.0GT/s Width x8
ixl3: SR-IOV ready
ixl3: netmap queues/slots: TX 24/1024, RX 24/1024
pcib7: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 0 on pci5
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
pci7: <unknown> at device 0.0 (no driver attached)
pci7: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib8: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 0 on pci5
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pci8: <unknown> at device 0.0 (no driver attached)
pci8: <encrypt/decrypt> at device 0.1 (no driver attached)
pci8: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci1: <XHCI (generic) USB 3.0 controller> mem 0x99100000-0x991fffff at device
0.3 numa-domain 0 on pci8
xhci1: 64 bytes context size, 64-bit DMA
usbus1 numa-domain 0 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
pcib9: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
pci9: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib10: <ACPI PCI-PCI bridge> at device 1.1 numa-domain 0 on pci9
pci10: <ACPI PCI bus> numa-domain 0 on pcib10
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 07.709.04.00-fbsd
mrsas0: <AVAGO Crusader SAS Controller> port 0x1000-0x10ff mem
0x9b600000-0x9b6fffff,0x9b700000-0x9b7fffff,0x9ba00000-0x9bafffff at device 0.0
numa-domain 0 on pci10
mrsas0: FW now in Ready state
mrsas0: Using MSI-X with 96 number of vectors
mrsas0: FW supports <128> MSIX vector,Online CPU 96 Current MSIX <96>
mrsas0: mrsas_init_adapter: sc->reply_q_depth 0xbe0,sc->request_alloc_sz
0x2f60, sc->reply_alloc_sz 0x5f00,sc->io_frames_alloc_sz 0x5ee00
mrsas0: max sge: 0x46, max chain frame size: 0x400, max fw cmd: 0x5ec
sc->chain_frames_alloc_sz: 0x17b000
mrsas0: Issuing IOC INIT command to FW.
mrsas0: IOC INIT response received from FW.
mrsas0: NVME page size : (4096)
mrsas0: FW supports JBOD Map
mrsas0: FW supports JBOD Map Ext
mrsas0: Jbod map is supported
mrsas0: System PD created target ID: 0x0
mrsas0: System PD created target ID: 0x1
mrsas0: System PD created target ID: 0x2
mrsas0: System PD created target ID: 0x3
mrsas0: System PD created target ID: 0x4
mrsas0: System PD created target ID: 0x5
mrsas0: System PD created target ID: 0x6
mrsas0: System PD created target ID: 0x7
mrsas0: FW supports: UnevenSpanSupport=1
mrsas0: max_fw_cmds: 1516 max_scsi_cmds: 1500
mrsas0: MSI-x interrupts setup success
mrsas0: mrsas_ocr_thread
pcib11: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 0 on pci9
pci11: <ACPI PCI bus> numa-domain 0 on pcib11
pci11: <unknown> at device 0.0 (no driver attached)
pci11: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib12: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 0 on pci9
pci12: <ACPI PCI bus> numa-domain 0 on pcib12
pci12: <unknown> at device 0.0 (no driver attached)
pci12: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib13: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci13: <ACPI PCI bus> numa-domain 0 on pcib13
pci13: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib14: <ACPI PCI-PCI bridge> at device 3.1 numa-domain 0 on pci13
pci14: <ACPI PCI bus> numa-domain 0 on pcib14
ixl4: <Intel(R) Ethernet Controller X710 for 10GbE SFP+ - 2.3.0-k> mem
0xa0000000-0xa0ffffff,0xa1018000-0xa101ffff at device 0.0 numa-domain 0 on pci14
ixl4: fw 8.815.63341 api 1.12 nvm 8.15 etid 80009b2f oem 20.5120.17
ixl4: The driver for the device detected a newer version of the NVM image than
expected.
ixl4: Please install the most recent version of the network driver.
ixl4: PF-ID[0]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, I2C
ixl4: Using 1024 TX descriptors and 1024 RX descriptors
ixl4: Using 24 RX queues 24 TX queues
ixl4: Using MSI-X interrupts with 25 vectors
ixl4: Ethernet address: 68:05:ca:c3:35:bc
ixl4: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl4: PCI Express Bus: Speed 8.0GT/s Width x8
ixl4: SR-IOV ready
ixl4: netmap queues/slots: TX 24/1024, RX 24/1024
ixl5: <Intel(R) Ethernet Controller X710 for 10GbE SFP+ - 2.3.0-k> mem
0x9f000000-0x9fffffff,0xa1010000-0xa1017fff at device 0.1 numa-domain 0 on pci14
ixl5: fw 8.815.63341 api 1.12 nvm 8.15 etid 80009b2f oem 20.5120.17
ixl5: The driver for the device detected a newer version of the NVM image than
expected.
ixl5: Please install the most recent version of the network driver.
ixl5: PF-ID[1]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, I2C
ixl5: Using 1024 TX descriptors and 1024 RX descriptors
ixl5: Using 24 RX queues 24 TX queues
ixl5: Using MSI-X interrupts with 25 vectors
ixl5: Ethernet address: 68:05:ca:c3:35:bd
ixl5: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl5: PCI Express Bus: Speed 8.0GT/s Width x8
ixl5: SR-IOV ready
ixl5: netmap queues/slots: TX 24/1024, RX 24/1024
ixl6: <Intel(R) Ethernet Controller X710 for 10GbE SFP+ - 2.3.0-k> mem
0x9e000000-0x9effffff,0xa1008000-0xa100ffff at device 0.2 numa-domain 0 on pci14
ixl6: fw 8.815.63341 api 1.12 nvm 8.15 etid 80009b2f oem 20.5120.17
ixl6: The driver for the device detected a newer version of the NVM image than
expected.
ixl6: Please install the most recent version of the network driver.
ixl6: PF-ID[2]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, I2C
ixl6: Using 1024 TX descriptors and 1024 RX descriptors
ixl6: Using 24 RX queues 24 TX queues
ixl6: Using MSI-X interrupts with 25 vectors
ixl6: Ethernet address: 68:05:ca:c3:35:be
ixl6: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl6: PCI Express Bus: Speed 8.0GT/s Width x8
ixl6: SR-IOV ready
ixl6: netmap queues/slots: TX 24/1024, RX 24/1024
ixl7: <Intel(R) Ethernet Controller X710 for 10GbE SFP+ - 2.3.0-k> mem
0x9d000000-0x9dffffff,0xa1000000-0xa1007fff at device 0.3 numa-domain 0 on pci14
ixl7: fw 8.815.63341 api 1.12 nvm 8.15 etid 80009b2f oem 20.5120.17
ixl7: The driver for the device detected a newer version of the NVM image than
expected.
ixl7: Please install the most recent version of the network driver.
ixl7: PF-ID[3]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384, I2C
ixl7: Using 1024 TX descriptors and 1024 RX descriptors
ixl7: Using 24 RX queues 24 TX queues
ixl7: Using MSI-X interrupts with 25 vectors
ixl7: Ethernet address: 68:05:ca:c3:35:bf
ixl7: Allocating 32 queues for PF LAN VSI; 24 queues active
ixl7: PCI Express Bus: Speed 8.0GT/s Width x8
ixl7: SR-IOV ready
ixl7: netmap queues/slots: TX 24/1024, RX 24/1024
pcib15: <ACPI PCI-PCI bridge> at device 5.2 numa-domain 0 on pci13
pci15: <ACPI PCI bus> numa-domain 0 on pcib15
pcib16: <PCI-PCI bridge> at device 0.0 numa-domain 0 on pci15
pci16: <PCI bus> numa-domain 0 on pcib16
vgapci0: <VGA-compatible display> mem
0x9c000000-0x9cffffff,0xa2008000-0xa200bfff,0xa1800000-0xa1ffffff at device 0.0
numa-domain 0 on pci16
vgapci0: Boot video device
pcib17: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 0 on pci13
pci17: <ACPI PCI bus> numa-domain 0 on pcib17
pci17: <unknown> at device 0.0 (no driver attached)
pci17: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib18: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 0 on pci13
pci18: <ACPI PCI bus> numa-domain 0 on pcib18
pci18: <unknown> at device 0.0 (no driver attached)
pci18: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib19: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci19: <ACPI PCI bus> numa-domain 1 on pcib19
pci19: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib20: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 1 on pci19
pci20: <ACPI PCI bus> numa-domain 1 on pcib20
pci20: <unknown> at device 0.0 (no driver attached)
pci20: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib21: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 1 on pci19
pci21: <ACPI PCI bus> numa-domain 1 on pcib21
pci21: <unknown> at device 0.0 (no driver attached)
pci21: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib22: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci22: <ACPI PCI bus> numa-domain 1 on pcib22
pci22: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib23: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 1 on pci22
pci23: <ACPI PCI bus> numa-domain 1 on pcib23
pci23: <unknown> at device 0.0 (no driver attached)
pci23: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib24: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 1 on pci22
pci24: <ACPI PCI bus> numa-domain 1 on pcib24
pci24: <unknown> at device 0.0 (no driver attached)
pci24: <encrypt/decrypt> at device 0.1 (no driver attached)
pci24: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib25: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci25: <ACPI PCI bus> numa-domain 1 on pcib25
pci25: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib26: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 1 on pci25
pci26: <ACPI PCI bus> numa-domain 1 on pcib26
pci26: <unknown> at device 0.0 (no driver attached)
pci26: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib27: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 1 on pci25
pci27: <ACPI PCI bus> numa-domain 1 on pcib27
pci27: <unknown> at device 0.0 (no driver attached)
pci27: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib28: <ACPI PCI-PCI bridge> at device 8.3 numa-domain 1 on pci25
pci28: <ACPI PCI bus> numa-domain 1 on pcib28
ahci0: <AMD KERNCZ AHCI SATA controller> mem 0x92500000-0x925007ff at device
0.0 numa-domain 1 on pci28
ahci0: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported with FBS
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahcich6: <AHCI channel> at channel 6 on ahci0
ahcich7: <AHCI channel> at channel 7 on ahci0
pcib29: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci29: <ACPI PCI bus> numa-domain 1 on pcib29
pci29: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib30: <ACPI PCI-PCI bridge> at device 5.1 numa-domain 1 on pci29
pci30: <ACPI PCI bus> numa-domain 1 on pcib30
bge0: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem
0x94830000-0x9483ffff,0x94840000-0x9484ffff,0x94850000-0x9485ffff at device 0.0
numa-domain 1 on pci30
bge0: APE FW version: NCSI v1.5.27.0
bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus0: <MII bus> numa-domain 1 on bge0
brgphy0: <BCM5720C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Using defaults for TSO: 65518/35/2048
bge0: Ethernet address: 70:b5:e8:f0:10:ec
bge1: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem
0x94800000-0x9480ffff,0x94810000-0x9481ffff,0x94820000-0x9482ffff at device 0.1
numa-domain 1 on pci30
bge1: APE FW version: NCSI v1.5.27.0
bge1: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus1: <MII bus> numa-domain 1 on bge1
brgphy1: <BCM5720C 1000BASE-T media interface> PHY 2 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Using defaults for TSO: 65518/35/2048
bge1: Ethernet address: 70:b5:e8:f0:10:ed
pcib31: <ACPI PCI-PCI bridge> at device 7.1 numa-domain 1 on pci29
pci31: <ACPI PCI bus> numa-domain 1 on pcib31
pci31: <unknown> at device 0.0 (no driver attached)
pci31: <encrypt/decrypt> at device 0.2 (no driver attached)
pcib32: <ACPI PCI-PCI bridge> at device 8.1 numa-domain 1 on pci29
pci32: <ACPI PCI bus> numa-domain 1 on pcib32
pci32: <unknown> at device 0.0 (no driver attached)
pci32: <encrypt/decrypt> at device 0.2 (no driver attached)
cpu0: <ACPI CPU> on acpi0
ixl0: Link is up, 10 Gbps Full Duplex, Requested FEC: None, Negotiated FEC:
CL74 FC-FEC/BASE-R, Autoneg: True, Flow Control: N
ixl0: link state changed to UP
one
debugnet_any_ifnet_update: Bad dn_init result from ixl0 (ifp
0xfffff801088f5800), ignoring.
ixl2: Link is up, 10 Gbps Full Duplex, Requested FEC: None, Negotiated FEC:
CL74 FC-FEC/BASE-R, Autoneg: True, Flow Control: N
ixl2: link state changed to UP
one
debugnet_any_ifnet_update: Bad dn_init result from ixl2 (ifp
0xfffff80112d37800), ignoring.
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROM> at iomem 0xed800-0xf17ff pnpid ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900
on isa0
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounters tick every 1.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ugen0.1: <0x1022 XHCI root HUB> at usbus0
ugen1.1: <0x1022 XHCI root HUB> at usbus1
uhub0 numa-domain 0 on usbus0
uhub0: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub1 numa-domain 0 on usbus1
uhub1: <0x1022 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
nvd0: <Dell Ent NVMe AGN MU U.2 1.6TB> NVMe namespace
nvd0: 1526185MB (3125627568 512 byte sectors)
nvd1: <Dell Ent NVMe AGN MU U.2 1.6TB> NVMe namespace
nvd1: 1526185MB (3125627568 512 byte sectors)
mrsas0: Disestablish mrsas intr hook
Trying to mount root from zfs:zroot/ROOT/default []...
Root mount waiting for: CAM
uhub0: 4 ports with 4 removable, self powered
uhub1: 4 ports with 4 removable, self powered
ugen1.2: <vendor 0x1604 product 0x10c0> at usbus1
uhub2 numa-domain 0 on uhub1
uhub2: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 1> on
usbus1
Root mount waiting for: CAM
Root mount waiting for: CAM
uhub2: 4 ports with 4 removable, self powered
Root mount waiting for: CAM
ugen1.3: <vendor 0x1604 product 0x10c0> at usbus1
uhub3 numa-domain 0 on uhub2
uhub3: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 2> on
usbus1
Root mount waiting for: CAM
Root mount waiting for: CAM
uhub3: 4 ports with 4 removable, self powered
Root mount waiting for: CAM
ugen1.4: <DELLEMC DRAC 5 Virtual Keyboard and Mouse> at usbus1
ukbd0 numa-domain 0 on uhub2
ukbd0: <HID Interface> on usbus1
kbd1 at ukbd0
Root mount waiting for: CAM
ugen1.5: <vendor 0x1604 product 0x10c0> at usbus1
uhub4 numa-domain 0 on uhub2
uhub4: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 4> on
usbus1
Root mount waiting for: CAM
Root mount waiting for: CAM
uhub4: 4 ports with 4 removable, self powered
Root mount waiting for: CAM
ugen1.6: <vendor 0x0424 product 0x2514> at usbus1
uhub5 numa-domain 0 on uhub1
uhub5: <vendor 0x0424 product 0x2514, class 9/0, rev 2.00/0.00, addr 5> on
usbus1
uhub5: MTT enabled
uhub5: 2 ports with 2 removable, self powered
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
mrsas0: Initiating Target RESET because of SCSI IO timeout!
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
mrsas0: Task management NOT SUPPORTED for CAM target:0
mrsas0: target reset FAIL!!
mrsas0: Initiaiting OCR because of TM FAILURE!
Root mount waiting for: CAM
mrsas0: [ 0]waiting for 8 commands to complete
Root mount waiting for: CAM
mrsas0: Reset Exit with 0.
da0 at mrsas0 bus 1 scbus1 target 0 lun 0
da0: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da0: Serial Number WS210GKV
da0: 150.000MB/s transfers
da0: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da1 at mrsas0 bus 1 scbus1 target 1 lun 0
da1: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da1: Serial Number WS210JBM
da1: 150.000MB/s transfers
da1: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da2 at mrsas0 bus 1 scbus1 target 2 lun 0
da2: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da2: Serial Number WS210EKR
da2: 150.000MB/s transfers
da2: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da3 at mrsas0 bus 1 scbus1 target 3 lun 0
da3: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da3: Serial Number WS210E0L
da3: 150.000MB/s transfers
da3: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da4 at mrsas0 bus 1 scbus1 target 4 lun 0
da4: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da4: Serial Number WS210F37
da4: 150.000MB/s transfers
da4: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da5 at mrsas0 bus 1 scbus1 target 5 lun 0
da5: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da5: Serial Number WS210HV3
da5: 150.000MB/s transfers
da5: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da6 at mrsas0 bus 1 scbus1 target 6 lun 0
da6: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da6: Serial Number WS210ELL
da6: 150.000MB/s transfers
da6: 3815447MB (7814037168 512 byte sectors, DIF type 2)
da7 at mrsas0 bus 1 scbus1 target 7 lun 0
da7: <SEAGATE ST4000NM017A CSJ7> Fixed Direct Access SPC-5 SCSI device
da7: Serial Number WS210FT1
da7: 150.000MB/s transfers
da7: 3815447MB (7814037168 512 byte sectors, DIF type 2)
intsmb0: <AMD FCH SMBus Controller> at device 20.0 numa-domain 0 on pci0
smbus0: <System Management Bus> numa-domain 0 on intsmb0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed001ff on acpi0
hpet0: memory region width 512 too small
device_attach: hpet0 attach returned 6
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: cannot find EC device
acpi_wmi0: Embedded MOF found
ACPI: \134_SB.AMW0.WQMO: 1 arguments were passed to a non-method ACPI object
(Buffer) (20201113/nsarguments-361)
lo0: link state changed to UP
ixl0: link state changed to DOWN
ixl2: link state changed to DOWN
ixl0: Link is up, 10 Gbps Full Duplex, Requested FEC: None, Negotiated FEC:
CL74 FC-FEC/BASE-R, Autoneg: True, Flow Control: N
ixl0: link state changed to UP
one
ums0 numa-domain 0 on uhub2
ums0: <HID Interface> on usbus1
ums0: 3 buttons and [Z] coordinates ID=0
ixl2: Link is up, 10 Gbps Full Duplex, Requested FEC: None, Negotiated FEC:
CL74 FC-FEC/BASE-R, Autoneg: True, Flow Control: None
ixl2: link state changed to UP
Security policy loaded: MAC/ntpd (mac_ntpd)
ugen1.4: <DELLEMC DRAC 5 Virtual Keyboard and Mouse> at usbus1 (disconnected)
ums0: at uhub2, port 2, addr 3 (disconnected)
ums0: detached
ukbd0: at uhub2, port 2, addr 3 (disconnected)
ukbd0: detached
