I believe I have found the problem with Stuart's /etc/rc.d/vmd diff to ensure that VMs are shutdown cleanly when the vmd host is shutdown. The /etc/rc script needs to be updated as well as /etc/rc.d/vmd.
vmd is not a package daemon. It is a network daemon. /etc/rc only stops package daemons when called with the "shutdown" argument. Some logic will need to be added to /etc/rc address the vmd daemon as a class of network daemon which requires a clean shutdown. As a temporary workaround, I have created /etc/rc.shutdown and added the line "/etc/rc.d/vmd stop". The log files of the vmd host and the test VM now indicate that the VM has been shutdown cleanly upon issuance of a reboot command on the vmd host. My first thought for a /etc/rc diff was to add something specifically for vmd just before the code which brings down carp interfaces. However, I do not know if it is more appropriate to develop a generalized approach similar to the package daemons shutdown code. Therefore, I will leave the diff to the experts, since I am uncertain what would be considered best practice. -Breen ________________________________ From: [email protected] <[email protected]> on behalf of openbsd2012 <[email protected]> Sent: March 1, 2018 10:29 AM To: [email protected] Cc: [email protected] Subject: '/etc/rc.d/vmd stop' not cleanly shutting down VM on vmd host reboot [This sender failed our fraud detection checks and may not be who they appear to be. Learn about spoofing at http://aka.ms/LearnAboutSpoofing] I've been testing Stuart's /etc/rc.d/vmd diff from Feb 20th, 2018. The diff is supposed to cause VMs to gracefully shutdown if the vmd host is rebooted. I have found that this is not happening on a VM I am testing. ## Rebooting the vmd host is not shutting down the VM cleanly ## My test VM is not shutting down cleanly if I reboot the vmd host. On next boot the VM gives the error "WARNING: / was not properly unmounted", and then all of the partitions mounted during the previous boot are checked by fsck. I also noticed that the VM /var/log/messages does not include any entries indicating that the VM was stopped. The VM log moves immediately to the dmesg of the VM booting. The vmd host /var/log/messages makes no mention of vmd when the system is shutting down to reboot. ## Running "/etc/rc.d/vmd stop" on vmd host is shutting down VM cleanly ## However, everything works as expected if I run "/etc/rc.d/vmd stop" from the vmd host. On next boot the VM skips fsck on all of the partitions mounted during the previous boot. Checking /var/log/messages on the VM shows these log entries just before the latest dmesg is logged: /bsd: Rebooting in response to request from vmmci0 host syslogd[35721]: restart syslogd[35721]: restart syslogd[35721]: exiting on signal 15 The vmd host /var/log/messages shows this log entry at the time that the "/etc/rc.d/vmd stop" command is given: vmd[25871]: parent terminating To be clear, none of the above log messages are present if I reboot the vmd host. They are only logged if I run "/etc/rc.d/vmd stop" on the vmd host. ## Summary of vmd host and VM configuration ## The vmd host is running -current as of a Feb 28 build. The VM is running 6.2-stable. The only thing potentially unique about my test VM is that I am booting from a softraid device with the crypto discipline using a keydisk. I have also attached an unencrypted disk image to the VM. However, none of the VM partitions which are mounted at the time of the vmd host reboot are unmounted cleanly, whether encrypted or not. Host dmesg and vm.conf are provided. I'll exclude the VM dmesg for now, but I can provide it if I am wrong that it is unnecessary. ## vmd host /etc/vm.conf contents ## switch "ext_switch" { interface bridge0 } vm "test" { memory 2G disk /home/vmd/test.vm.sd0.img disk /home/vmd/test.vm.sd1.img disk /root/vmd/test.vm.keydisk.img interface tap { lladdr 02:00:00:e7:4a:46 switch "ext_switch" } } ## vmd host dmesg output ## OpenBSD 6.2-current (GENERIC.MP) #0: Wed Feb 28 13:10:37 EST 2018 [email protected]:/usr/sources/src/sys/arch/amd64/compile/GENERIC.MP real mem = 68594323456 (65416MB) avail mem = 66508414976 (63427MB) mpath0 at root scsibus0 at mpath0: 256 targets mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xed9b0 (54 entries) bios0: vendor American Megatrends Inc. version "1.1" date 03/02/2016 bios0: Supermicro Super Server acpi0 at bios0: rev 2 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP APIC FPDT FIDT SPMI MCFG UEFI DBG2 HPET WDDT SSDT SSDT SSDT PRAD DMAR HEST BERT ERST EINJ acpi0: wakeup devices IP2P(S4) XHCI(S4) EHC1(S4) EHC2(S4) RP01(S4) RP02(S4) RP03(S4) RP04(S4) RP05(S4) RP06(S4) RP07(S4) RP08(S4) BR1A(S4) BR1B(S4) BR2A(S4) BR2B(S4) [...] acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.28 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu0: 256KB 64b/line 8-way L2 cache acpitimer0: recalibrated TSC frequency 2000005918 Hz cpu0: smt 0, core 0, package 0 mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges cpu0: apic clock running at 100MHz cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE cpu1 at mainbus0: apid 2 (application processor) cpu1: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu1: 256KB 64b/line 8-way L2 cache cpu1: smt 0, core 1, package 0 cpu2 at mainbus0: apid 4 (application processor) cpu2: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu2: 256KB 64b/line 8-way L2 cache cpu2: smt 0, core 2, package 0 cpu3 at mainbus0: apid 6 (application processor) cpu3: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu3: 256KB 64b/line 8-way L2 cache cpu3: smt 0, core 3, package 0 cpu4 at mainbus0: apid 8 (application processor) cpu4: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu4: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu4: 256KB 64b/line 8-way L2 cache cpu4: smt 0, core 4, package 0 cpu5 at mainbus0: apid 10 (application processor) cpu5: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu5: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu5: 256KB 64b/line 8-way L2 cache cpu5: smt 0, core 5, package 0 cpu6 at mainbus0: apid 12 (application processor) cpu6: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu6: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu6: 256KB 64b/line 8-way L2 cache cpu6: smt 0, core 6, package 0 cpu7 at mainbus0: apid 14 (application processor) cpu7: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu7: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu7: 256KB 64b/line 8-way L2 cache cpu7: smt 0, core 7, package 0 cpu8 at mainbus0: apid 1 (application processor) cpu8: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu8: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu8: 256KB 64b/line 8-way L2 cache cpu8: smt 1, core 0, package 0 cpu9 at mainbus0: apid 3 (application processor) cpu9: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu9: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu9: 256KB 64b/line 8-way L2 cache cpu9: smt 1, core 1, package 0 cpu10 at mainbus0: apid 5 (application processor) cpu10: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.01 MHz cpu10: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu10: 256KB 64b/line 8-way L2 cache cpu10: smt 1, core 2, package 0 cpu11 at mainbus0: apid 7 (application processor) cpu11: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.01 MHz cpu11: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu11: 256KB 64b/line 8-way L2 cache cpu11: smt 1, core 3, package 0 cpu12 at mainbus0: apid 9 (application processor) cpu12: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu12: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu12: 256KB 64b/line 8-way L2 cache cpu12: smt 1, core 4, package 0 cpu13 at mainbus0: apid 11 (application processor) cpu13: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu13: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu13: 256KB 64b/line 8-way L2 cache cpu13: smt 1, core 5, package 0 cpu14 at mainbus0: apid 13 (application processor) cpu14: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu14: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu14: 256KB 64b/line 8-way L2 cache cpu14: smt 1, core 6, package 0 cpu15 at mainbus0: apid 15 (application processor) cpu15: Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz, 2000.00 MHz cpu15: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,MELTDOWN cpu15: 256KB 64b/line 8-way L2 cache cpu15: smt 1, core 7, package 0 ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins acpimcfg0 at acpi0 addr 0x80000000, bus 0-255 acpihpet0 at acpi0: 14318179 Hz acpihpet0: recalibrated TSC frequency 2000013880 Hz acpiprt0 at acpi0: bus 255 (UNC0) acpiprt1 at acpi0: bus 0 (PCI0) acpiprt2 at acpi0: bus 5 (RP01) acpiprt3 at acpi0: bus 6 (RP05) acpiprt4 at acpi0: bus 7 (BR39) acpiprt5 at acpi0: bus 1 (BR1A) acpiprt6 at acpi0: bus 3 (BR2C) acpiprt7 at acpi0: bus 4 (BR3A) acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS "ACPI0004" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "ACPI0007" at acpi0 not configured "PNP0C33" at acpi0 not configured "PNP0C14" at acpi0 not configured "PNP0003" at acpi0 not configured "PNP0C14" at acpi0 not configured "IPI0001" at acpi0 not configured acpibtn0 at acpi0: PWRB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 2000 MHz: speeds: 2001, 2000, 1900, 1800, 1700, 1600, 1500, 1400, 1300, 1200, 1100, 1000, 900, 800 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel Xeon-D Host" rev 0x02 ppb0 at pci0 dev 1 function 0 "Intel Xeon-D PCIE" rev 0x02: msi pci1 at ppb0 bus 1 ppb1 at pci0 dev 2 function 0 "Intel Xeon-D PCIE" rev 0x02 pci2 at ppb1 bus 2 "Intel Xeon-D QuickData" rev 0x00 at pci2 dev 0 function 0 not configured "Intel Xeon-D QuickData" rev 0x00 at pci2 dev 0 function 1 not configured "Intel Xeon-D QuickData" rev 0x00 at pci2 dev 0 function 2 not configured "Intel Xeon-D QuickData" rev 0x00 at pci2 dev 0 function 3 not configured ppb2 at pci0 dev 2 function 2 "Intel Xeon-D PCIE" rev 0x02 pci3 at ppb2 bus 3 ix0 at pci3 dev 0 function 0 "Intel X552/X557-AT" rev 0x00: msi, address 0c:c4:7a:7b:6d:00 ix1 at pci3 dev 0 function 1 "Intel X552/X557-AT" rev 0x00: msi, address 0c:c4:7a:7b:6d:01 ppb3 at pci0 dev 3 function 0 "Intel Xeon-D PCIE" rev 0x02: msi pci4 at ppb3 bus 4 "Intel Xeon-D Address Map" rev 0x02 at pci0 dev 5 function 0 not configured "Intel Xeon-D Hot Plug" rev 0x02 at pci0 dev 5 function 1 not configured "Intel Xeon-D RAS" rev 0x02 at pci0 dev 5 function 2 not configured "Intel Xeon-D I/O APIC" rev 0x02 at pci0 dev 5 function 4 not configured xhci0 at pci0 dev 20 function 0 "Intel 8 Series xHCI" rev 0x05: msi usb0 at xhci0: USB revision 3.0 uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00 addr 1 "Intel 8 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured "Intel 8 Series MEI" rev 0x04 at pci0 dev 22 function 1 not configured ehci0 at pci0 dev 26 function 0 "Intel 8 Series USB" rev 0x05: apic 8 int 18 usb1 at ehci0: USB revision 2.0 uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb4 at pci0 dev 28 function 0 "Intel 8 Series PCIE" rev 0xd5: msi pci5 at ppb4 bus 5 em0 at pci5 dev 0 function 0 "Intel I350" rev 0x01: msi, address 0c:c4:7a:7b:69:18 em1 at pci5 dev 0 function 1 "Intel I350" rev 0x01: msi, address 0c:c4:7a:7b:69:19 ppb5 at pci0 dev 28 function 4 "Intel 8 Series PCIE" rev 0xd5: msi pci6 at ppb5 bus 6 ppb6 at pci6 dev 0 function 0 "ASPEED Technology AST1150 PCI" rev 0x03 pci7 at ppb6 bus 7 vga1 at pci7 dev 0 function 0 "ASPEED Technology AST2000" rev 0x30 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) ehci1 at pci0 dev 29 function 0 "Intel 8 Series USB" rev 0x05: apic 8 int 18 usb2 at ehci1: USB revision 2.0 uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 pcib0 at pci0 dev 31 function 0 "Intel C224 LPC" rev 0x05 ahci0 at pci0 dev 31 function 2 "Intel 8 Series AHCI" rev 0x05: msi, AHCI 1.3 ahci0: port 0: 6.0Gb/s ahci0: port 1: 6.0Gb/s ahci0: port 2: 6.0Gb/s ahci0: port 3: 6.0Gb/s scsibus1 at ahci0: 32 targets sd0 at scsibus1 targ 0 lun 0: <ATA, INTEL SSDSC2BB48, G201> SCSI3 0/direct fixed naa.55cd2e404c1c7b25 sd0: 457862MB, 512 bytes/sector, 937703088 sectors, thin sd1 at scsibus1 targ 1 lun 0: <ATA, INTEL SSDSC2BB48, G201> SCSI3 0/direct fixed naa.55cd2e404c1c60ab sd1: 457862MB, 512 bytes/sector, 937703088 sectors, thin sd2 at scsibus1 targ 2 lun 0: <ATA, HGST HUS724020AL, MF6O> SCSI3 0/direct fixed naa.5000cca24ed90cf0 sd2: 1907729MB, 512 bytes/sector, 3907029168 sectors sd3 at scsibus1 targ 3 lun 0: <ATA, HGST HUS724020AL, MF6O> SCSI3 0/direct fixed naa.5000cca24ed92bac sd3: 1907729MB, 512 bytes/sector, 3907029168 sectors ichiic0 at pci0 dev 31 function 3 "Intel 8 Series SMBus" rev 0x05: apic 8 int 18 iic0 at ichiic0 "Intel 8 Series Thermal" rev 0x05 at pci0 dev 31 function 6 not configured isa0 at pcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo pckbc0 at isa0 port 0x60/5 irq 1 irq 12 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 pci8 at mainbus0 bus 255 255:30:3: mem address conflict 0x10/0x10 "Intel Xeon-D QPI Link" rev 0x02 at pci8 dev 11 function 0 not configured "Intel Xeon-D QPI Link" rev 0x02 at pci8 dev 11 function 1 not configured "Intel Xeon-D QPI Link" rev 0x02 at pci8 dev 11 function 2 not configured "Intel Xeon-D QPI Debug" rev 0x02 at pci8 dev 11 function 3 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 12 function 0 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 12 function 1 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 12 function 2 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 12 function 3 not configured "Intel E5 v4 Cache" rev 0x02 at pci8 dev 12 function 4 not configured "Intel E5 v4 Cache" rev 0x02 at pci8 dev 12 function 5 not configured vendor "Intel", unknown product 0x6fe6 (class system subclass miscellaneous, rev 0x02) at pci8 dev 12 function 6 not configured vendor "Intel", unknown product 0x6fe7 (class system subclass miscellaneous, rev 0x02) at pci8 dev 12 function 7 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 15 function 0 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 15 function 4 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 15 function 5 not configured "Intel Xeon-D Cache" rev 0x02 at pci8 dev 15 function 6 not configured "Intel Xeon-D PCIE" rev 0x02 at pci8 dev 16 function 0 not configured "Intel E5 v4 R2PCIe Agent" rev 0x02 at pci8 dev 16 function 1 not configured "Intel Xeon-D Ubox" rev 0x02 at pci8 dev 16 function 5 not configured "Intel Xeon-D Ubox" rev 0x02 at pci8 dev 16 function 6 not configured "Intel Xeon-D Ubox" rev 0x02 at pci8 dev 16 function 7 not configured "Intel Xeon-D Home Agent" rev 0x02 at pci8 dev 18 function 0 not configured "Intel Xeon-D Home Agent" rev 0x02 at pci8 dev 18 function 1 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 0 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 1 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 2 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 3 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 4 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 5 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 6 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 19 function 7 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 0 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 1 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 2 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 3 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 4 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 5 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 6 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 20 function 7 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 21 function 0 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 21 function 1 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 21 function 2 not configured "Intel Xeon-D Memory" rev 0x02 at pci8 dev 21 function 3 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 30 function 0 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 30 function 1 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 30 function 2 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 30 function 3 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 30 function 4 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 31 function 0 not configured "Intel Xeon-D PCU" rev 0x02 at pci8 dev 31 function 2 not configured vmm0 at mainbus0: VMX/EPT uhub3 at uhub0 port 4 configuration 1 interface 0 "ATEN International product 0x7000" rev 2.00/0.00 addr 2 uhidev0 at uhub3 port 1 configuration 1 interface 0 "ATEN International product 0x2419" rev 1.10/1.00 addr 3 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 variable keys, 6 key codes wskbd0 at ukbd0: console keyboard, using wsdisplay0 uhidev1 at uhub3 port 1 configuration 1 interface 1 "ATEN International product 0x2419" rev 1.10/1.00 addr 3 uhidev1: iclass 3/1 ums0 at uhidev1: 3 buttons, Z dir wsmouse0 at ums0 mux 0 uhub4 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.05 addr 2 uhub5 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.05 addr 2 uhub6 at uhub5 port 3 configuration 1 interface 0 "Genesys Logic USB2.0 Hub" rev 2.00/32.98 addr 3 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets sd4 at scsibus3 targ 1 lun 0: <OPENBSD, SR RAID 1, 006> SCSI2 0/direct fixed sd4: 457860MB, 512 bytes/sector, 937697393 sectors sd5 at scsibus3 targ 2 lun 0: <OPENBSD, SR RAID 1, 006> SCSI2 0/direct fixed sd5: 1907726MB, 512 bytes/sector, 3907023473 sectors root on sd4a (3e85b97a1e90e64e.a) swap on sd4b dump on sd4b
