On Tue, Oct 2, 2018 at 8:02 PM, Greg Steuck <[email protected]> wrote:
> Dmitry, is there an easy way get at the VMs output?


You mean the test VM instances (vmd), right?

We capture vmm/kernel output for crashes, you can see it in the Log
columns for each crash here:
https://syzkaller.appspot.com/#openbsd

Also if syz-manager is started with -debug flag, then it dumps
everything into terminal in real time, including vmm/kernel output.
This is intended for debugging of reliable mis-behaviors (the thing is
not working at all).




> Here's dmesg from VMM_DEBUG-enabled kernel (built at "Add support for RT3290
> chipset by James Hastings."). No lockup thus far.
>
> OpenBSD 6.4 (VMM_DEBUG) #0: Tue Oct  2 10:37:13 PDT 2018
>
> [email protected]:/syzkaller/src/sys/arch/amd64/compile/VMM_DEBUG
> real mem = 17163079680 (16367MB)
> avail mem = 16633610240 (15863MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xbffffcf0 (20 entries)
> bios0: vendor Google version "Google" date 01/01/2011
> bios0: Google Google Compute Engine
> acpi0 at bios0: rev 0
> acpi0: sleep states S3 S4 S5
> acpi0: tables DSDT FACP SSDT APIC WAET SRAT
> acpi0: wakeup devices
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU @ 2.30GHz, 2300.55 MHz, 06-3f-00
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu0: 256KB 64b/line 8-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> cpu0: apic clock running at 990MHz
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.88 MHz, 06-3f-00
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu1: 256KB 64b/line 8-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 4 (application processor)
> cpu2: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.87 MHz, 06-3f-00
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu2: 256KB 64b/line 8-way L2 cache
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 6 (application processor)
> cpu3: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.89 MHz, 06-3f-00
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu3: 256KB 64b/line 8-way L2 cache
> cpu3: smt 0, core 3, package 0
> cpu4 at mainbus0: apid 1 (application processor)
> cpu4: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.88 MHz, 06-3f-00
> cpu4:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu4: 256KB 64b/line 8-way L2 cache
> cpu4: smt 1, core 0, package 0
> cpu5 at mainbus0: apid 3 (application processor)
> cpu5: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.88 MHz, 06-3f-00
> cpu5:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu5: 256KB 64b/line 8-way L2 cache
> cpu5: smt 1, core 1, package 0
> cpu6 at mainbus0: apid 5 (application processor)
> cpu6: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.94 MHz, 06-3f-00
> cpu6:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu6: 256KB 64b/line 8-way L2 cache
> cpu6: smt 1, core 2, package 0
> cpu7 at mainbus0: apid 7 (application processor)
> cpu7: Intel(R) Xeon(R) CPU @ 2.30GHz, 2276.91 MHz, 06-3f-00
> cpu7:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> cpu7: 256KB 64b/line 8-way L2 cache
> cpu7: smt 1, core 3, package 0
> ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpicpu0 at acpi0: C1(@1 halt!)
> acpicpu1 at acpi0: C1(@1 halt!)
> acpicpu2 at acpi0: C1(@1 halt!)
> acpicpu3 at acpi0: C1(@1 halt!)
> acpicpu4 at acpi0: C1(@1 halt!)
> acpicpu5 at acpi0: C1(@1 halt!)
> acpicpu6 at acpi0: C1(@1 halt!)
> acpicpu7 at acpi0: C1(@1 halt!)
> "ACPI0006" at acpi0 not configured
> acpicmos0 at acpi0
> "QEMU0001" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> pvbus0 at mainbus0: KVM
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
> pcib0 at pci0 dev 1 function 0 "Intel 82371AB PIIX4 ISA" rev 0x03
> piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: SMBus
> disabled
> virtio0 at pci0 dev 3 function 0 "Qumranet Virtio SCSI" rev 0x00
> vioscsi0 at virtio0: qsize 8192
> scsibus1 at vioscsi0: 253 targets
> sd0 at scsibus1 targ 1 lun 0: <Google, PersistentDisk, 1> SCSI4 0/direct
> fixed serial.Google_PersistentDisk_
> sd0: 10240MB, 512 bytes/sector, 20971520 sectors, thin
> sd1 at scsibus1 targ 2 lun 0: <Google, PersistentDisk, 1> SCSI4 0/direct
> fixed serial.Google_PersistentDisk_
> sd1: 1024000MB, 512 bytes/sector, 2097152000 sectors, thin
> virtio0: msix shared
> virtio1 at pci0 dev 4 function 0 "Qumranet Virtio Network" rev 0x00
> vio0 at virtio1: address 42:01:0a:80:00:3f
> virtio1: msix per-VQ
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> com2 at isa0 port 0x3e8/8 irq 5: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0 mux 1
> pms0 at pckbc0 (aux slot)
> wsmouse0 at pms0 mux 0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
> vscsi0 at root
> scsibus2 at vscsi0: 256 targets
> softraid0 at root
> scsibus3 at softraid0: 256 targets
> root on sd0a (dd61083aafe9fd0b.a) swap on sd0b dump on sd0b
> vm_impl_init_vmx: created vm_map @ 0xffff800000b27700
> vm_impl_init_vmx: created vm_map @ 0xffff800000b27200
> vm_impl_init_vmx: created vm_map @ 0xffff800000b27800
> vm_resetcpu: resetting vm 2 vcpu 0 to power on defaults
> Guest EPTP = 0x11f07101e
> vm_resetcpu: resetting vm 1 vcpu 0 to power on defaults
> Guest EPTP = 0x11f05b01e
> vm_resetcpu: resetting vm 3 vcpu 0 to power on defaults
> Guest EPTP = 0x3b688401e
> vmm_handle_cpuid: function 0x07 (SEFF) unsupported subleaf 0x6c65746e not
> supported
> vmm_handle_cpuid: function 0x07 (SEFF) unsupported subleaf 0x6c65746e not
> supported
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
> vmm_handle_cpuid: function 0x07 (SEFF) unsupported subleaf 0x6c65746e not
> supported
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
> vmx_handle_cr: mov to cr0 @ 100060a, data=0xe0010031
> vmx_handle_cr: mov to cr0 @ 100060a, data=0xe0010031
> vmx_handle_cr: mov to cr0 @ 100060a, data=0xe0010031
> vmm_handle_cpuid: unsupported rax=0x40000100
> vmm_handle_cpuid: unsupported rax=0x40000100
> vmm_handle_cpuid: unsupported rax=0x40000100
> vmm_handle_cpuid: function 0x06 (thermal/power mgt) not supported
> vmm_handle_cpuid: function 0x06 (thermal/power mgt) not supported
> vmm_handle_cpuid: invalid cpuid input leaf 0x15, guest
> rip=0xffffffff8138f075 - resetting to 0xd
> vmx_handle_wrmsr: wrmsr exit, msr=0x277, discarding data written from
> guest=0x70106:0x70106
> vmm_handle_cpuid: invalid cpuid input leaf 0x15, guest
> rip=0xffffffff8138f075 - resetting to 0xd
> vmx_handle_wrmsr: wrmsr exit, msr=0x277, discarding data written from
> guest=0x70106:0x70106
> vmm_handle_cpuid: function 0x06 (thermal/power mgt) not supported
> vmm_handle_cpuid: invalid cpuid input leaf 0x15, guest
> rip=0xffffffff8138f075 - resetting to 0xd
> vmx_handle_wrmsr: wrmsr exit, msr=0x277, discarding data written from
> guest=0x70106:0x70106
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
> vmm_handle_cpuid: function 0x0a (arch. perf mon) not supported
>
>
>
> On Tue, Oct 2, 2018 at 10:41 AM Reyk Floeter <[email protected]> wrote:
>>
>> Ok thanks.  I wonder if there is a tool that can log everything from
>> the VM's console ... It would be useful to see what happens to the VM
>> before it goes into zombie mode.
>>
>> Reyk
>>
>> On Tue, Oct 02, 2018 at 10:33:11AM -0700, Greg Steuck wrote:
>> > I believe I was unable to ssh into them or get cu to elicit any
>> > characters.
>> > I'll verify next time it happens.
>> >
>> > On Tue, Oct 2, 2018 at 10:20 AM Reyk Floeter <[email protected]> wrote:
>> >
>> > > On Tue, Oct 02, 2018 at 10:10:41AM -0700, Greg Steuck wrote:
>> > > > Naturally, bugs don't solve themselves :) Here's a log, it's not
>> > > > very
>> > > > useful due to the lack of debugging symbols. Notice, that runaway
>> > > > vmds
>> > > > don't die on their own, they just spin out of control. I'll do
>> > > > VMM_DEBUG
>> > > > next.
>> > > >
>> > >
>> > > "they just spin out of control" - maybe I've missed the previous
>> > > details, but do you know what happens to these VMs?  Are they stuck in
>> > > ddb or in a reboot loop?
>> > >
>> > > Reyk
>> > >
>> > > > ci-openbsd# sysctl kern.nosuidcoredump=3 && mkdir /var/crash/vmd
>> > > > kern.nosuidcoredump: 1 -> 3
>> > > > ci-openbsd#  sysctl kern.nosuidcoredump
>> > > > kern.nosuidcoredump=3
>> > > > ci-openbsd# ps ax | grep vmd
>> > > > 32653 ??  Isp     0:01.28 /usr/sbin/vmd
>> > > > 89585 ??  Is      0:00.14 vmd: priv (vmd)
>> > > > 50191 ??  Isp     0:01.88 vmd: control (vmd)
>> > > > 33160 ??  Isp     0:08.55 vmd: vmm (vmd)
>> > > > 52853 ??  Rp/1  280:12.56 vmd: ci-openbsd-main-1 (vmd)
>> > > >  3238 ??  Rp/2   48:56.13 vmd: ci-openbsd-main-0 (vmd)
>> > > > 44625 ??  Rp/0    2:54.05 vmd: ci-openbsd-main-2 (vmd)
>> > > > 42187 p5  R+p/0   0:00.00 grep vmd (ksh)
>> > > > ci-openbsd# vmctl status
>> > > >    ID   PID VCPUS  MAXMEM  CURMEM     TTY        OWNER NAME
>> > > >   239 44625     1    512M    181M   ttyp2    syzkaller
>> > > > ci-openbsd-main-2
>> > > >     1     -     1    512M       -       -    syzkaller syzkaller
>> > > > ci-openbsd# kill 52853
>> > > > ci-openbsd# ps ax | grep vmd
>> > > > 32653 ??  Ssp     0:01.28 /usr/sbin/vmd
>> > > > 89585 ??  Is      0:00.14 vmd: priv (vmd)
>> > > > 50191 ??  Ssp     0:01.88 vmd: control (vmd)
>> > > > 33160 ??  Ssp     0:08.55 vmd: vmm (vmd)
>> > > > 52853 ??  Rp/1  280:30.24 vmd: ci-openbsd-main-1 (vmd)
>> > > >  3238 ??  Rp/2   49:14.27 vmd: ci-openbsd-main-0 (vmd)
>> > > > 44625 ??  Rp/0    3:12.25 vmd: ci-openbsd-main-2 (vmd)
>> > > > 27783 p5  R+p/1   0:00.00 grep vmd (ksh)
>> > > > ci-openbsd# ps ax | grep syz
>> > > > 50771 ??  Is      0:00.01 /sbin/mount_mfs -s 10G /dev/sd0b
>> > > > /syzkaller/ramdisk
>> > > > 70067 ??  Is      0:00.16 sshd: syzkaller [priv] (sshd)
>> > > >   957 ??  S       0:01.09 sshd: syzkaller@ttyp3 (sshd)
>> > > > 28743 ??  I      18:00.14 syzkaller/current/bin/syz-manager -config
>> > > > /syzkaller/managers/main/current/manager.cfg
>> > > >  5869 ??  Ip      0:00.07 ssh -p 22 -i
>> > > /syzkaller/managers/main/current/key
>> > > > -F /dev/null -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o
>> > > > Identi
>> > > > 57895 ??  Is      0:00.08 sshd: syzkaller [priv] (sshd)
>> > > > 77889 ??  S       0:00.17 sshd: syzkaller@ttyp4 (sshd)
>> > > > 39218 p5  R+/0    0:00.00 grep syz
>> > > > 50644 00- D       4:09.87 ./syz-ci -config ./config-openbsd.ci
>> > > > 60603 00- Ip      0:00.05 tee syz-ci.log
>> > > > ci-openbsd# kill 50644 28743
>> > > > ci-openbsd# ps ax | grep syz
>> > > > 50771 ??  Is      0:00.01 /sbin/mount_mfs -s 10G /dev/sd0b
>> > > > /syzkaller/ramdisk
>> > > > 70067 ??  Is      0:00.16 sshd: syzkaller [priv] (sshd)
>> > > >   957 ??  I       0:01.09 sshd: syzkaller@ttyp3 (sshd)
>> > > > 57895 ??  Is      0:00.08 sshd: syzkaller [priv] (sshd)
>> > > > 77889 ??  S       0:00.18 sshd: syzkaller@ttyp4 (sshd)
>> > > > 15816 p5  R+/1    0:00.00 grep syz
>> > > > ci-openbsd# rcctl stop vmd
>> > > > vmd(ok)
>> > > > ci-openbsd# ps ax | grep vmd
>> > > > 52853 ??  Rp/1  281:59.20 vmd: ci-openbsd-main-1 (vmd)
>> > > >  3238 ??  Rp/2   50:42.87 vmd: ci-openbsd-main-0 (vmd)
>> > > > 19166 p5  R+/0    0:00.00 grep vmd
>> > > > ci-openbsd# kill -ABRT 52853
>> > > > ci-openbsd# ps ax | grep vmd
>> > > >  3238 ??  Rp/2   52:06.55 vmd: ci-openbsd-main-0 (vmd)
>> > > > 55423 p5  S+p     0:00.01 grep vmd
>> > > > ci-openbsd# dmesg | tail
>> > > > pms0 at pckbc0 (aux slot)
>> > > > wsmouse0 at pms0 mux 0
>> > > > pcppi0 at isa0 port 0x61
>> > > > spkr0 at pcppi0
>> > > > vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
>> > > > vscsi0 at root
>> > > > scsibus2 at vscsi0: 256 targets
>> > > > softraid0 at root
>> > > > scsibus3 at softraid0: 256 targets
>> > > > root on sd0a (dd61083aafe9fd0b.a) swap on sd0b dump on sd0b
>> > > > ci-openbsd# ps ax | grep vmd
>> > > >  3238 ??  Rp/2   52:06.88 vmd: ci-openbsd-main-0 (vmd)
>> > > > 19175 p5  R+/0    0:00.00 grep vmd
>> > > > ci-openbsd# kill 3238
>> > > > ci-openbsd# ps ax | grep vmd
>> > > >  3238 ??  Rp/2   52:18.52 vmd: ci-openbsd-main-0 (vmd)
>> > > > 27516 p5  R+/3    0:00.00 grep vmd
>> > > > ci-openbsd# kill -ABRT 3238
>> > > > ci-openbsd# ps ax | grep vmd
>> > > >  3238 ??  Rp/2   52:27.71 (vmd)
>> > > > 93083 p5  R+/3    0:00.00 grep vmd
>> > > > ci-openbsd# ps ax | grep vmd
>> > > > 95984 p5  S+p     0:00.01 grep vmd
>> > > > ci-openbsd# ls -l /var/crash/vmd
>> > > > total 668864
>> > > > -rw-------  1 root  wheel  200320568 Oct  2 09:47 3238.core
>> > > > -rw-------  1 root  wheel  141988032 Oct  2 09:46 52853.core
>> > > > ci-openbsd# gdb /usr/sb
>> > > > ci-openbsd# file /var/crash/vmd/52853.core
>> > > > /var/crash/vmd/52853.core: ELF 64-bit LSB core file x86-64, version
>> > > > 1
>> > > > ci-openbsd# gdb /usr/sbin/vmd /var/crash/vmd/52853.core
>> > > > GNU gdb 6.3
>> > > > Copyright 2004 Free Software Foundation, Inc.
>> > > > GDB is free software, covered by the GNU General Public License, and
>> > > > you
>> > > are
>> > > > welcome to change it and/or distribute copies of it under certain
>> > > > conditions.
>> > > > Type "show copying" to see the conditions.
>> > > > There is absolutely no warranty for GDB.  Type "show warranty" for
>> > > details.
>> > > > This GDB was configured as "amd64-unknown-openbsd6.4"...(no
>> > > > debugging
>> > > > symbols found)
>> > > >
>> > > > Core was generated by `vmd'.
>> > > > Program terminated with signal 6, Aborted.
>> > > > Reading symbols from /usr/lib/libpthread.so.25.1...done.
>> > > > Loaded symbols for /usr/lib/libpthread.so.25.1
>> > > > Loaded symbols for /usr/sbin/vmd
>> > > > Reading symbols from /usr/lib/libutil.so.13.0...done.
>> > > > Loaded symbols for /usr/lib/libutil.so.13.0
>> > > > Symbols already loaded for /usr/lib/libpthread.so.25.1
>> > > > Reading symbols from /usr/lib/libevent.so.4.1...done.
>> > > > Loaded symbols for /usr/lib/libevent.so.4.1
>> > > > Reading symbols from /usr/lib/libc.so.92.5...done.
>> > > > Loaded symbols for /usr/lib/libc.so.92.5
>> > > > Reading symbols from /usr/libexec/ld.so...done.
>> > > > Loaded symbols for /usr/libexec/ld.so
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > (gdb) where
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:896
>> > > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
>> > > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
>> > > available.
>> > > > ) at /usr/src/lib/librthread/rthread.c:96
>> > > > #4  0x0000158bc710206b in __tfork_thread () at
>> > > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
>> > > > #5  0x0000000000000000 in ?? ()
>> > > > (gdb) threads
>> > > > Undefined command: "threads".  Try "help".
>> > > > ci-openbsd# gdb /usr/sbin/vmd /var/crash/vmd/52853.core
>> > > > GNU gdb 6.3
>> > > > Copyright 2004 Free Software Foundation, Inc.
>> > > > GDB is free software, covered by the GNU General Public License, and
>> > > > you
>> > > are
>> > > > welcome to change it and/or distribute copies of it under certain
>> > > > conditions.
>> > > > Type "show copying" to see the conditions.
>> > > > There is absolutely no warranty for GDB.  Type "show warranty" for
>> > > details.
>> > > > This GDB was configured as "amd64-unknown-openbsd6.4"...(no
>> > > > debugging
>> > > > symbols found)
>> > > >
>> > > > Core was generated by `vmd'.
>> > > > Program terminated with signal 6, Aborted.
>> > > > Reading symbols from /usr/lib/libpthread.so.25.1...done.
>> > > > Loaded symbols for /usr/lib/libpthread.so.25.1
>> > > > Loaded symbols for /usr/sbin/vmd
>> > > > Reading symbols from /usr/lib/libutil.so.13.0...done.
>> > > > Loaded symbols for /usr/lib/libutil.so.13.0
>> > > > Symbols already loaded for /usr/lib/libpthread.so.25.1
>> > > > Reading symbols from /usr/lib/libevent.so.4.1...done.
>> > > > Loaded symbols for /usr/lib/libevent.so.4.1
>> > > > Reading symbols from /usr/lib/libc.so.92.5...done.
>> > > > Loaded symbols for /usr/lib/libc.so.92.5
>> > > > Reading symbols from /usr/libexec/ld.so...done.
>> > > > Loaded symbols for /usr/libexec/ld.so
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > (gdb) where
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:896
>> > > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
>> > > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
>> > > available.
>> > > > ) at /usr/src/lib/librthread/rthread.c:96
>> > > > #4  0x0000158bc710206b in __tfork_thread () at
>> > > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
>> > > > #5  0x0000000000000000 in ?? ()
>> > > > (gdb) threads
>> > > > Undefined command: "threads".  Try "help".
>> > > > (gdb) info threads
>> > > >   3 process 542900  futex () at -:3
>> > > >   2 process 253765  futex () at -:3
>> > > > * 1 process 281848  0x0000158be7eb96d0 in ?? () from
>> > > > /usr/lib/libevent.so.4.1
>> > > > Current language:  auto; currently asm
>> > > > (gdb) bt 2
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:896
>> > > > (More stack frames follow...)
>> > > > (gdb) bt 3
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:896
>> > > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
>> > > > (More stack frames follow...)
>> > > > (gdb) bt 1
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > (More stack frames follow...)
>> > > > (gdb) t 2
>> > > > [Switching to thread 2 (process 253765)]#0  futex () at -:3
>> > > > 3       -: No such file or directory.
>> > > >         in -
>> > > > (gdb) where
>> > > > #0  futex () at -:3
>> > > > #1  0x0000158bc70c5625 in _rthread_cond_timedwait
>> > > > (cond=0x158b93646260,
>> > > > mutexp=0x1589629b2ed0, abs=0x0) at tcb.h:43
>> > > > #2  0x000015896270d83c in ?? () from /usr/sbin/vmd
>> > > > #3  0x000015896270ca9f in ?? () from /usr/sbin/vmd
>> > > > #4  0x000015896270c03e in ?? () from /usr/sbin/vmd
>> > > > #5  0x000015896270b78b in ?? () from /usr/sbin/vmd
>> > > > #6  0x0000158962708acf in ?? () from /usr/sbin/vmd
>> > > > #7  0x0000158be7ebf64d in event_base_loop (base=0x158b87f78400,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:350
>> > > > #8  0x00001589627094d8 in ?? () from /usr/sbin/vmd
>> > > > #9  0x00001589627084ab in ?? () from /usr/sbin/vmd
>> > > > #10 0x00001589627039bd in ?? () from /usr/sbin/vmd
>> > > > #11 0x0000158962700d76 in ?? () from /usr/sbin/vmd
>> > > > #12 0x0000000000000000 in ?? ()
>> > > > (gdb) t 3
>> > > > [Switching to thread 3 (process 542900)]#0  futex () at -:3
>> > > > 3       in -
>> > > > (gdb) where
>> > > > #0  futex () at -:3
>> > > > #1  0x0000158bc70c5625 in _rthread_cond_timedwait
>> > > > (cond=0x158b936438b0,
>> > > > mutexp=0x1589629b2ee0, abs=0x0) at tcb.h:43
>> > > > #2  0x000015896270ebb8 in ?? () from /usr/sbin/vmd
>> > > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
>> > > available.
>> > > > ) at /usr/src/lib/librthread/rthread.c:96
>> > > > #4  0x0000158bc710206b in __tfork_thread () at
>> > > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
>> > > > #5  0x0000000000000000 in ?? ()
>> > > > (gdb) t 1
>> > > > [Switching to thread 1 (process 281848)]#0  0x0000158be7eb96d0 in ??
>> > > > ()
>> > > > from /usr/lib/libevent.so.4.1
>> > > > (gdb) where
>> > > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
>> > > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800,
>> > > > flags=0)
>> > > at
>> > > > /usr/src/lib/libevent/event.c:896
>> > > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
>> > > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
>> > > available.
>> > > > ) at /usr/src/lib/librthread/rthread.c:96
>> > > > #4  0x0000158bc710206b in __tfork_thread () at
>> > > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
>> > > > #5  0x0000000000000000 in ?? ()
>> > > > (gdb) q
>> > > > ci-openbsd#
>> > > > ci-openbsd$ tail -200 /var/log/daemon
>> > > > Oct  1 23:22:56 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 127
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  1 23:31:04 ci-openbsd vmd[12749]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  1 23:31:25 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 128
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  1 23:39:57 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 129
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  1 23:42:59 ci-openbsd vmd[14695]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  1 23:42:59 ci-openbsd vmd[14695]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  1 23:43:17 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 130
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  1 23:48:30 ci-openbsd vmd[49330]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  1 23:48:48 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 131
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  1 23:56:46 ci-openbsd vmd[94023]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  1 23:57:07 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 132
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 00:03:10 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 133
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:07:26 ci-openbsd vmd[68805]: ci-openbsd-main-1:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 00:07:47 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 134
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 00:11:15 ci-openbsd vmd[71074]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 00:11:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 135
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:14:59 ci-openbsd vmd[61869]: ci-openbsd-main-1: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 00:15:20 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 136
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 00:17:16 ci-openbsd ntpd[2907]: adjusting clock frequency by
>> > > > 0.066735 to -0.011194ppm
>> > > > Oct  2 00:18:52 ci-openbsd vmd[50408]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 00:19:10 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 137
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:22:42 ci-openbsd vmd[85645]: ci-openbsd-main-1: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 00:23:02 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 138
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 00:26:40 ci-openbsd vmd[73931]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 00:27:00 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 139
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:34:48 ci-openbsd vmd[21513]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 00:35:09 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 140
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:43:09 ci-openbsd vmd[27407]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 00:43:31 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 141
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 00:53:56 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 142
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 01:01:53 ci-openbsd vmd[88653]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 01:02:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 143
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 01:10:35 ci-openbsd vmd[20923]: ci-openbsd-main-0: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 01:10:35 ci-openbsd vmd[20923]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 01:10:35 ci-openbsd vmd[41352]: ci-openbsd-main-1: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 01:10:35 ci-openbsd vmd[32935]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 144
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 145
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 146
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 01:18:30 ci-openbsd vmd[60956]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 01:18:49 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 147
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 01:19:22 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 148
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 01:19:57 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 149
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 01:26:42 ci-openbsd vmd[58230]: ci-openbsd-main-1:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 01:27:03 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 150
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 01:33:49 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 151
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 01:42:14 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 152
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 01:50:23 ci-openbsd vmd[6179]: vcpu_run_loop: vm 149 / vcpu 0
>> > > > run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 01:50:23 ci-openbsd vmd[6179]: ci-openbsd-main-0:
>> > > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 149, vcpu_id 0
>> > > > Oct  2 01:50:47 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 153
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 01:58:55 ci-openbsd vmd[53479]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 01:59:13 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 154
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 02:07:48 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 155
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 02:15:58 ci-openbsd vmd[55924]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 02:16:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 156
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 02:22:16 ci-openbsd vmd[89663]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 02:22:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 157
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 02:24:25 ci-openbsd vmd[97898]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 02:24:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 158
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 02:28:57 ci-openbsd vmd[1226]: ci-openbsd-main-1: can't clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 02:29:18 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 159
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 02:30:11 ci-openbsd vmd[10203]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 02:30:31 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 160
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 02:36:15 ci-openbsd vmd[34907]: ci-openbsd-main-1: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 02:36:35 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 161
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 02:44:22 ci-openbsd vmd[86651]: vcpu_run_loop: vm 158 / vcpu
>> > > > 0 run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 02:44:41 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 162
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 02:49:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 163
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 02:58:07 ci-openbsd vmd[77821]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 02:58:28 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 164
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 03:06:33 ci-openbsd vmd[4903]: ci-openbsd-main-2: can't clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 03:06:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 165
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 03:15:34 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 166
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 03:23:40 ci-openbsd vmd[49598]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 03:24:03 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 167
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 03:27:10 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 168
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 03:32:22 ci-openbsd vmd[4160]: ci-openbsd-main-2: can't clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 03:32:42 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 169
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 03:33:17 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 170
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 03:44:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 171
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 03:52:57 ci-openbsd vmd[60131]: ci-openbsd-main-0: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 03:53:17 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 172
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 04:01:25 ci-openbsd vmd[69189]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 04:01:45 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 173
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 04:10:20 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 174
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 04:22:33 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 175
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 04:33:01 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 176
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 04:35:26 ci-openbsd vmd[5334]: vcpu_run_loop: vm 166 / vcpu 0
>> > > > run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 04:35:45 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 177
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 04:43:25 ci-openbsd vmd[32653]: ci-openbsd-main-test-2:
>> > > > started vm
>> > > > 178 successfully, tty /dev/ttyp2
>> > > > Oct  2 04:43:25 ci-openbsd vmd[32653]: ci-openbsd-main-test-1:
>> > > > started vm
>> > > > 179 successfully, tty /dev/ttyp4
>> > > > Oct  2 04:43:27 ci-openbsd vmd[32653]: ci-openbsd-main-test-0: user
>> > > > 1000
>> > > > cpu limit reached
>> > > > Oct  2 04:43:27 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-test-0
>> > > > Oct  2 04:44:25 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:44:25 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:45:13 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:45:13 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:46:11 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:46:11 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:46:58 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:46:58 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:47:35 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:47:35 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:48:17 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:48:17 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:48:57 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:48:57 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:49:37 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:49:37 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:50:19 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:50:19 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:51:02 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:51:02 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:51:44 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:51:44 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:52:27 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:52:27 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:53:06 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:53:06 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-1
>> > > > Oct  2 04:53:47 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 194
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 04:54:38 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:54:38 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:55:13 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:55:13 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:55:54 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:55:54 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:56:37 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:56:37 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:57:18 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:57:18 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:57:53 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:57:53 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:58:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:58:39 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:59:20 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000
>> > > > cpu
>> > > > limit reached
>> > > > Oct  2 04:59:20 ci-openbsd vmd[32653]: config_setvm: failed to start
>> > > > vm
>> > > > ci-openbsd-main-0
>> > > > Oct  2 04:59:39 ci-openbsd vmd[94868]: vcpu_run_loop: vm 176 / vcpu
>> > > > 0 run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 04:59:44 ci-openbsd vmd[39078]: ci-openbsd-main-test-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 04:59:51 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 203
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 05:00:04 ci-openbsd vmd[21591]: ci-openbsd-main-1: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 05:00:14 ci-openbsd vmd[45083]: ci-openbsd-main-0: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm
>> > > > 204
>> > > > successfully, tty /dev/ttyp0
>> > > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 205
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 206
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 05:11:52 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 207
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 05:36:32 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 208
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 06:06:47 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 209
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 06:13:35 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 210
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 06:13:47 ci-openbsd vmd[26018]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 06:14:06 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 211
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 06:20:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 212
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 06:39:05 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 213
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 06:47:01 ci-openbsd vmd[99939]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 06:47:01 ci-openbsd vmd[45529]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 06:48:28 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 214
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 06:48:28 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 215
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 07:00:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 216
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 07:15:29 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 217
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 07:22:17 ci-openbsd vmd[32248]: ci-openbsd-main-0:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 07:22:36 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 218
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 07:42:45 ci-openbsd vmd[62262]: ci-openbsd-main-2:
>> > > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 191, vcpu_id 0
>> > > > Oct  2 07:44:08 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 219
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 07:44:08 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 220
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 07:45:27 ci-openbsd vmd[18782]: vcpu_run_loop: vm 195 / vcpu
>> > > > 0 run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 07:45:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 221
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 07:45:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 222
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 07:52:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 223
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 07:57:21 ci-openbsd vmd[88211]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 07:57:35 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 224
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 08:02:33 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 225
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 08:07:59 ci-openbsd vmd[71528]: ci-openbsd-main-2:
>> > > > vcpu_assert_pic_irq: can't assert INTR
>> > > > Oct  2 08:08:18 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 226
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 08:14:28 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 227
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 08:20:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 228
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 08:27:04 ci-openbsd vmd[87075]: ci-openbsd-main-0:
>> > > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 202, vcpu_id 0
>> > > > Oct  2 08:27:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 229
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 08:33:48 ci-openbsd vmd[49729]: vcpu_run_loop: vm 203 / vcpu
>> > > > 0 run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 08:34:03 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 230
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 08:39:29 ci-openbsd vmd[28457]: ci-openbsd-main-0: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 08:39:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 231
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 08:45:10 ci-openbsd vmd[18437]: ci-openbsd-main-2:
>> > > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 205, vcpu_id 0
>> > > > Oct  2 08:45:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 232
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 08:52:14 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm
>> > > > 233
>> > > > successfully, tty /dev/ttyp1
>> > > > Oct  2 08:57:40 ci-openbsd vmd[62972]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 08:57:58 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 234
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:10:04 ci-openbsd vmd[1795]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > No
>> > > > such file or directory
>> > > > Oct  2 09:10:16 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 235
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:17:47 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 236
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:25:15 ci-openbsd vmd[94235]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 09:25:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 237
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:32:49 ci-openbsd vmd[63400]: ci-openbsd-main-2: can't set
>> > > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 09:33:01 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 238
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:40:21 ci-openbsd vmd[37476]: ci-openbsd-main-2: can't
>> > > > clear
>> > > INTR:
>> > > > No such file or directory
>> > > > Oct  2 09:40:33 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm
>> > > > 239
>> > > > successfully, tty /dev/ttyp2
>> > > > Oct  2 09:45:06 ci-openbsd vmd[44625]: vcpu_run_loop: vm 214 / vcpu
>> > > > 0 run
>> > > > ioctl failed: No such file or directory
>> > > > Oct  2 09:45:06 ci-openbsd vmd[44625]: ci-openbsd-main-2:
>> > > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 214, vcpu_id 0
>> > > > Oct  2 09:45:20 ci-openbsd vmd[32653]: parent terminating
>> > > > Oct  2 09:45:20 ci-openbsd vmd[50191]: control exiting, pid 50191
>> > > > Oct  2 09:45:20 ci-openbsd vmd[89585]: priv exiting, pid 89585
>> > > > Oct  2 09:45:20 ci-openbsd vmd[33160]: vmm exiting, pid 33160
>> > > > $ dmesg
>> > > > OpenBSD 6.4-beta (GENERIC.MP) #336: Sat Sep 29 08:13:15 MDT 2018
>> > > >
>> > > > [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>> > > > real mem = 17163079680 (16367MB)
>> > > > avail mem = 16633655296 (15863MB)
>> > > > mpath0 at root
>> > > > scsibus0 at mpath0: 256 targets
>> > > > mainbus0 at root
>> > > > bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xbffffcf0 (20 entries)
>> > > > bios0: vendor Google version "Google" date 01/01/2011
>> > > > bios0: Google Google Compute Engine
>> > > > acpi0 at bios0: rev 0
>> > > > acpi0: sleep states S3 S4 S5
>> > > > acpi0: tables DSDT FACP SSDT APIC WAET SRAT
>> > > > acpi0: wakeup devices
>> > > > acpitimer0 at acpi0: 3579545 Hz, 24 bits
>> > > > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>> > > > cpu0 at mainbus0: apid 0 (boot processor)
>> > > > cpu0: Intel(R) Xeon(R) CPU @ 2.30GHz, 2300.46 MHz, 06-3f-00
>> > > > cpu0:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu0: 256KB 64b/line 8-way L2 cache
>> > > > cpu0: smt 0, core 0, package 0
>> > > > mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
>> > > > cpu0: apic clock running at 969MHz
>> > > > cpu1 at mainbus0: apid 2 (application processor)
>> > > > cpu1: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.60 MHz, 06-3f-00
>> > > > cpu1:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu1: 256KB 64b/line 8-way L2 cache
>> > > > cpu1: smt 0, core 1, package 0
>> > > > cpu2 at mainbus0: apid 4 (application processor)
>> > > > cpu2: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.61 MHz, 06-3f-00
>> > > > cpu2:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu2: 256KB 64b/line 8-way L2 cache
>> > > > cpu2: smt 0, core 2, package 0
>> > > > cpu3 at mainbus0: apid 6 (application processor)
>> > > > cpu3: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.60 MHz, 06-3f-00
>> > > > cpu3:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu3: 256KB 64b/line 8-way L2 cache
>> > > > cpu3: smt 0, core 3, package 0
>> > > > cpu4 at mainbus0: apid 1 (application processor)
>> > > > cpu4: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.62 MHz, 06-3f-00
>> > > > cpu4:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu4: 256KB 64b/line 8-way L2 cache
>> > > > cpu4: smt 1, core 0, package 0
>> > > > cpu5 at mainbus0: apid 3 (application processor)
>> > > > cpu5: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.65 MHz, 06-3f-00
>> > > > cpu5:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu5: 256KB 64b/line 8-way L2 cache
>> > > > cpu5: smt 1, core 1, package 0
>> > > > cpu6 at mainbus0: apid 5 (application processor)
>> > > > cpu6: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.61 MHz, 06-3f-00
>> > > > cpu6:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu6: 256KB 64b/line 8-way L2 cache
>> > > > cpu6: smt 1, core 2, package 0
>> > > > cpu7 at mainbus0: apid 7 (application processor)
>> > > > cpu7: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.59 MHz, 06-3f-00
>>
>> > > > cpu7:
>> > > >
>> > >
>> > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
>> > > > cpu7: 256KB 64b/line 8-way L2 cache
>> > > > cpu7: smt 1, core 3, package 0
>> > > > ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins
>> > > > acpiprt0 at acpi0: bus 0 (PCI0)
>> > > > acpicpu0 at acpi0: C1(@1 halt!)
>> > > > acpicpu1 at acpi0: C1(@1 halt!)
>> > > > acpicpu2 at acpi0: C1(@1 halt!)
>> > > > acpicpu3 at acpi0: C1(@1 halt!)
>> > > > acpicpu4 at acpi0: C1(@1 halt!)
>> > > > acpicpu5 at acpi0: C1(@1 halt!)
>> > > > acpicpu6 at acpi0: C1(@1 halt!)
>> > > > acpicpu7 at acpi0: C1(@1 halt!)
>> > > > "ACPI0006" at acpi0 not configured
>> > > > acpicmos0 at acpi0
>> > > > "QEMU0001" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > "ACPI0007" at acpi0 not configured
>> > > > pvbus0 at mainbus0: KVM
>> > > > pci0 at mainbus0 bus 0
>> > > > pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
>> > > > pcib0 at pci0 dev 1 function 0 "Intel 82371AB PIIX4 ISA" rev 0x03
>> > > > piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03:
>> > > > SMBus
>> > > > disabled
>> > > > virtio0 at pci0 dev 3 function 0 "Qumranet Virtio SCSI" rev 0x00
>> > > > vioscsi0 at virtio0: qsize 8192
>> > > > scsibus1 at vioscsi0: 253 targets
>> > > > sd0 at scsibus1 targ 1 lun 0: <Google, PersistentDisk, 1> SCSI4
>> > > > 0/direct
>> > > > fixed serial.Google_PersistentDisk_
>> > > > sd0: 10240MB, 512 bytes/sector, 20971520 sectors, thin
>> > > > sd1 at scsibus1 targ 2 lun 0: <Google, PersistentDisk, 1> SCSI4
>> > > > 0/direct
>> > > > fixed serial.Google_PersistentDisk_
>> > > > sd1: 1024000MB, 512 bytes/sector, 2097152000 sectors, thin
>> > > > virtio0: msix shared
>> > > > virtio1 at pci0 dev 4 function 0 "Qumranet Virtio Network" rev 0x00
>> > > > vio0 at virtio1: address 42:01:0a:80:00:3f
>> > > > virtio1: msix per-VQ
>> > > > isa0 at pcib0
>> > > > isadma0 at isa0
>> > > > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
>> > > > com0: console
>> > > > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
>> > > > com2 at isa0 port 0x3e8/8 irq 5: ns16550a, 16 byte fifo
>> > > > pckbc0 at isa0 port 0x60/5 irq 1 irq 12
>> > > > pckbd0 at pckbc0 (kbd slot)
>> > > > wskbd0 at pckbd0 mux 1
>> > > > pms0 at pckbc0 (aux slot)
>> > > > wsmouse0 at pms0 mux 0
>> > > > pcppi0 at isa0 port 0x61
>> > > > spkr0 at pcppi0
>> > > > vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
>> > > > vscsi0 at root
>> > > > scsibus2 at vscsi0: 256 targets
>> > > > softraid0 at root
>> > > > scsibus3 at softraid0: 256 targets
>> > > > root on sd0a (dd61083aafe9fd0b.a) swap on sd0b dump on sd0b
>> > > >
>> > > >
>> > > > --
>> > > > nest.cx is Gmail hosted, use PGP for anything private. Key:
>> > > > http://goo.gl/6dMsr
>> > > > Fingerprint: 5E2B 2D0E 1E03 2046 BEC3  4D50 0B15 42BD 8DF5 A1B0
>> > >
>> > > --
>> > >
>> >
>> >
>> > --
>> > nest.cx is Gmail hosted, use PGP for anything private. Key:
>> > http://goo.gl/6dMsr
>> > Fingerprint: 5E2B 2D0E 1E03 2046 BEC3  4D50 0B15 42BD 8DF5 A1B0
>>
>> --
>
>
>
> --
> nest.cx is Gmail hosted, use PGP for anything private. Key:
> http://goo.gl/6dMsr
> Fingerprint: 5E2B 2D0E 1E03 2046 BEC3  4D50 0B15 42BD 8DF5 A1B0

Reply via email to