Ok thanks.  I wonder if there is a tool that can log everything from
the VM's console ... It would be useful to see what happens to the VM
before it goes into zombie mode.

Reyk

On Tue, Oct 02, 2018 at 10:33:11AM -0700, Greg Steuck wrote:
> I believe I was unable to ssh into them or get cu to elicit any characters.
> I'll verify next time it happens.
> 
> On Tue, Oct 2, 2018 at 10:20 AM Reyk Floeter <r...@openbsd.org> wrote:
> 
> > On Tue, Oct 02, 2018 at 10:10:41AM -0700, Greg Steuck wrote:
> > > Naturally, bugs don't solve themselves :) Here's a log, it's not very
> > > useful due to the lack of debugging symbols. Notice, that runaway vmds
> > > don't die on their own, they just spin out of control. I'll do VMM_DEBUG
> > > next.
> > >
> >
> > "they just spin out of control" - maybe I've missed the previous
> > details, but do you know what happens to these VMs?  Are they stuck in
> > ddb or in a reboot loop?
> >
> > Reyk
> >
> > > ci-openbsd# sysctl kern.nosuidcoredump=3 && mkdir /var/crash/vmd
> > > kern.nosuidcoredump: 1 -> 3
> > > ci-openbsd#  sysctl kern.nosuidcoredump
> > > kern.nosuidcoredump=3
> > > ci-openbsd# ps ax | grep vmd
> > > 32653 ??  Isp     0:01.28 /usr/sbin/vmd
> > > 89585 ??  Is      0:00.14 vmd: priv (vmd)
> > > 50191 ??  Isp     0:01.88 vmd: control (vmd)
> > > 33160 ??  Isp     0:08.55 vmd: vmm (vmd)
> > > 52853 ??  Rp/1  280:12.56 vmd: ci-openbsd-main-1 (vmd)
> > >  3238 ??  Rp/2   48:56.13 vmd: ci-openbsd-main-0 (vmd)
> > > 44625 ??  Rp/0    2:54.05 vmd: ci-openbsd-main-2 (vmd)
> > > 42187 p5  R+p/0   0:00.00 grep vmd (ksh)
> > > ci-openbsd# vmctl status
> > >    ID   PID VCPUS  MAXMEM  CURMEM     TTY        OWNER NAME
> > >   239 44625     1    512M    181M   ttyp2    syzkaller ci-openbsd-main-2
> > >     1     -     1    512M       -       -    syzkaller syzkaller
> > > ci-openbsd# kill 52853
> > > ci-openbsd# ps ax | grep vmd
> > > 32653 ??  Ssp     0:01.28 /usr/sbin/vmd
> > > 89585 ??  Is      0:00.14 vmd: priv (vmd)
> > > 50191 ??  Ssp     0:01.88 vmd: control (vmd)
> > > 33160 ??  Ssp     0:08.55 vmd: vmm (vmd)
> > > 52853 ??  Rp/1  280:30.24 vmd: ci-openbsd-main-1 (vmd)
> > >  3238 ??  Rp/2   49:14.27 vmd: ci-openbsd-main-0 (vmd)
> > > 44625 ??  Rp/0    3:12.25 vmd: ci-openbsd-main-2 (vmd)
> > > 27783 p5  R+p/1   0:00.00 grep vmd (ksh)
> > > ci-openbsd# ps ax | grep syz
> > > 50771 ??  Is      0:00.01 /sbin/mount_mfs -s 10G /dev/sd0b
> > > /syzkaller/ramdisk
> > > 70067 ??  Is      0:00.16 sshd: syzkaller [priv] (sshd)
> > >   957 ??  S       0:01.09 sshd: syzkaller@ttyp3 (sshd)
> > > 28743 ??  I      18:00.14 syzkaller/current/bin/syz-manager -config
> > > /syzkaller/managers/main/current/manager.cfg
> > >  5869 ??  Ip      0:00.07 ssh -p 22 -i
> > /syzkaller/managers/main/current/key
> > > -F /dev/null -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o Identi
> > > 57895 ??  Is      0:00.08 sshd: syzkaller [priv] (sshd)
> > > 77889 ??  S       0:00.17 sshd: syzkaller@ttyp4 (sshd)
> > > 39218 p5  R+/0    0:00.00 grep syz
> > > 50644 00- D       4:09.87 ./syz-ci -config ./config-openbsd.ci
> > > 60603 00- Ip      0:00.05 tee syz-ci.log
> > > ci-openbsd# kill 50644 28743
> > > ci-openbsd# ps ax | grep syz
> > > 50771 ??  Is      0:00.01 /sbin/mount_mfs -s 10G /dev/sd0b
> > > /syzkaller/ramdisk
> > > 70067 ??  Is      0:00.16 sshd: syzkaller [priv] (sshd)
> > >   957 ??  I       0:01.09 sshd: syzkaller@ttyp3 (sshd)
> > > 57895 ??  Is      0:00.08 sshd: syzkaller [priv] (sshd)
> > > 77889 ??  S       0:00.18 sshd: syzkaller@ttyp4 (sshd)
> > > 15816 p5  R+/1    0:00.00 grep syz
> > > ci-openbsd# rcctl stop vmd
> > > vmd(ok)
> > > ci-openbsd# ps ax | grep vmd
> > > 52853 ??  Rp/1  281:59.20 vmd: ci-openbsd-main-1 (vmd)
> > >  3238 ??  Rp/2   50:42.87 vmd: ci-openbsd-main-0 (vmd)
> > > 19166 p5  R+/0    0:00.00 grep vmd
> > > ci-openbsd# kill -ABRT 52853
> > > ci-openbsd# ps ax | grep vmd
> > >  3238 ??  Rp/2   52:06.55 vmd: ci-openbsd-main-0 (vmd)
> > > 55423 p5  S+p     0:00.01 grep vmd
> > > ci-openbsd# dmesg | tail
> > > pms0 at pckbc0 (aux slot)
> > > wsmouse0 at pms0 mux 0
> > > pcppi0 at isa0 port 0x61
> > > spkr0 at pcppi0
> > > vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
> > > vscsi0 at root
> > > scsibus2 at vscsi0: 256 targets
> > > softraid0 at root
> > > scsibus3 at softraid0: 256 targets
> > > root on sd0a (dd61083aafe9fd0b.a) swap on sd0b dump on sd0b
> > > ci-openbsd# ps ax | grep vmd
> > >  3238 ??  Rp/2   52:06.88 vmd: ci-openbsd-main-0 (vmd)
> > > 19175 p5  R+/0    0:00.00 grep vmd
> > > ci-openbsd# kill 3238
> > > ci-openbsd# ps ax | grep vmd
> > >  3238 ??  Rp/2   52:18.52 vmd: ci-openbsd-main-0 (vmd)
> > > 27516 p5  R+/3    0:00.00 grep vmd
> > > ci-openbsd# kill -ABRT 3238
> > > ci-openbsd# ps ax | grep vmd
> > >  3238 ??  Rp/2   52:27.71 (vmd)
> > > 93083 p5  R+/3    0:00.00 grep vmd
> > > ci-openbsd# ps ax | grep vmd
> > > 95984 p5  S+p     0:00.01 grep vmd
> > > ci-openbsd# ls -l /var/crash/vmd
> > > total 668864
> > > -rw-------  1 root  wheel  200320568 Oct  2 09:47 3238.core
> > > -rw-------  1 root  wheel  141988032 Oct  2 09:46 52853.core
> > > ci-openbsd# gdb /usr/sb
> > > ci-openbsd# file /var/crash/vmd/52853.core
> > > /var/crash/vmd/52853.core: ELF 64-bit LSB core file x86-64, version 1
> > > ci-openbsd# gdb /usr/sbin/vmd /var/crash/vmd/52853.core
> > > GNU gdb 6.3
> > > Copyright 2004 Free Software Foundation, Inc.
> > > GDB is free software, covered by the GNU General Public License, and you
> > are
> > > welcome to change it and/or distribute copies of it under certain
> > > conditions.
> > > Type "show copying" to see the conditions.
> > > There is absolutely no warranty for GDB.  Type "show warranty" for
> > details.
> > > This GDB was configured as "amd64-unknown-openbsd6.4"...(no debugging
> > > symbols found)
> > >
> > > Core was generated by `vmd'.
> > > Program terminated with signal 6, Aborted.
> > > Reading symbols from /usr/lib/libpthread.so.25.1...done.
> > > Loaded symbols for /usr/lib/libpthread.so.25.1
> > > Loaded symbols for /usr/sbin/vmd
> > > Reading symbols from /usr/lib/libutil.so.13.0...done.
> > > Loaded symbols for /usr/lib/libutil.so.13.0
> > > Symbols already loaded for /usr/lib/libpthread.so.25.1
> > > Reading symbols from /usr/lib/libevent.so.4.1...done.
> > > Loaded symbols for /usr/lib/libevent.so.4.1
> > > Reading symbols from /usr/lib/libc.so.92.5...done.
> > > Loaded symbols for /usr/lib/libc.so.92.5
> > > Reading symbols from /usr/libexec/ld.so...done.
> > > Loaded symbols for /usr/libexec/ld.so
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > (gdb) where
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:896
> > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
> > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
> > available.
> > > ) at /usr/src/lib/librthread/rthread.c:96
> > > #4  0x0000158bc710206b in __tfork_thread () at
> > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
> > > #5  0x0000000000000000 in ?? ()
> > > (gdb) threads
> > > Undefined command: "threads".  Try "help".
> > > ci-openbsd# gdb /usr/sbin/vmd /var/crash/vmd/52853.core
> > > GNU gdb 6.3
> > > Copyright 2004 Free Software Foundation, Inc.
> > > GDB is free software, covered by the GNU General Public License, and you
> > are
> > > welcome to change it and/or distribute copies of it under certain
> > > conditions.
> > > Type "show copying" to see the conditions.
> > > There is absolutely no warranty for GDB.  Type "show warranty" for
> > details.
> > > This GDB was configured as "amd64-unknown-openbsd6.4"...(no debugging
> > > symbols found)
> > >
> > > Core was generated by `vmd'.
> > > Program terminated with signal 6, Aborted.
> > > Reading symbols from /usr/lib/libpthread.so.25.1...done.
> > > Loaded symbols for /usr/lib/libpthread.so.25.1
> > > Loaded symbols for /usr/sbin/vmd
> > > Reading symbols from /usr/lib/libutil.so.13.0...done.
> > > Loaded symbols for /usr/lib/libutil.so.13.0
> > > Symbols already loaded for /usr/lib/libpthread.so.25.1
> > > Reading symbols from /usr/lib/libevent.so.4.1...done.
> > > Loaded symbols for /usr/lib/libevent.so.4.1
> > > Reading symbols from /usr/lib/libc.so.92.5...done.
> > > Loaded symbols for /usr/lib/libc.so.92.5
> > > Reading symbols from /usr/libexec/ld.so...done.
> > > Loaded symbols for /usr/libexec/ld.so
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > (gdb) where
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:896
> > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
> > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
> > available.
> > > ) at /usr/src/lib/librthread/rthread.c:96
> > > #4  0x0000158bc710206b in __tfork_thread () at
> > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
> > > #5  0x0000000000000000 in ?? ()
> > > (gdb) threads
> > > Undefined command: "threads".  Try "help".
> > > (gdb) info threads
> > >   3 process 542900  futex () at -:3
> > >   2 process 253765  futex () at -:3
> > > * 1 process 281848  0x0000158be7eb96d0 in ?? () from
> > > /usr/lib/libevent.so.4.1
> > > Current language:  auto; currently asm
> > > (gdb) bt 2
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:896
> > > (More stack frames follow...)
> > > (gdb) bt 3
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:896
> > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
> > > (More stack frames follow...)
> > > (gdb) bt 1
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > (More stack frames follow...)
> > > (gdb) t 2
> > > [Switching to thread 2 (process 253765)]#0  futex () at -:3
> > > 3       -: No such file or directory.
> > >         in -
> > > (gdb) where
> > > #0  futex () at -:3
> > > #1  0x0000158bc70c5625 in _rthread_cond_timedwait (cond=0x158b93646260,
> > > mutexp=0x1589629b2ed0, abs=0x0) at tcb.h:43
> > > #2  0x000015896270d83c in ?? () from /usr/sbin/vmd
> > > #3  0x000015896270ca9f in ?? () from /usr/sbin/vmd
> > > #4  0x000015896270c03e in ?? () from /usr/sbin/vmd
> > > #5  0x000015896270b78b in ?? () from /usr/sbin/vmd
> > > #6  0x0000158962708acf in ?? () from /usr/sbin/vmd
> > > #7  0x0000158be7ebf64d in event_base_loop (base=0x158b87f78400, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:350
> > > #8  0x00001589627094d8 in ?? () from /usr/sbin/vmd
> > > #9  0x00001589627084ab in ?? () from /usr/sbin/vmd
> > > #10 0x00001589627039bd in ?? () from /usr/sbin/vmd
> > > #11 0x0000158962700d76 in ?? () from /usr/sbin/vmd
> > > #12 0x0000000000000000 in ?? ()
> > > (gdb) t 3
> > > [Switching to thread 3 (process 542900)]#0  futex () at -:3
> > > 3       in -
> > > (gdb) where
> > > #0  futex () at -:3
> > > #1  0x0000158bc70c5625 in _rthread_cond_timedwait (cond=0x158b936438b0,
> > > mutexp=0x1589629b2ee0, abs=0x0) at tcb.h:43
> > > #2  0x000015896270ebb8 in ?? () from /usr/sbin/vmd
> > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
> > available.
> > > ) at /usr/src/lib/librthread/rthread.c:96
> > > #4  0x0000158bc710206b in __tfork_thread () at
> > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
> > > #5  0x0000000000000000 in ?? ()
> > > (gdb) t 1
> > > [Switching to thread 1 (process 281848)]#0  0x0000158be7eb96d0 in ?? ()
> > > from /usr/lib/libevent.so.4.1
> > > (gdb) where
> > > #0  0x0000158be7eb96d0 in ?? () from /usr/lib/libevent.so.4.1
> > > #1  0x0000158be7ebf48b in event_base_loop (base=0x158b87f7d800, flags=0)
> > at
> > > /usr/src/lib/libevent/event.c:896
> > > #2  0x000015896270ee4f in ?? () from /usr/sbin/vmd
> > > #3  0x0000158bf17a9dce in _rthread_start (v=Variable "v" is not
> > available.
> > > ) at /usr/src/lib/librthread/rthread.c:96
> > > #4  0x0000158bc710206b in __tfork_thread () at
> > > /usr/src/lib/libc/arch/amd64/sys/tfork_thread.S:75
> > > #5  0x0000000000000000 in ?? ()
> > > (gdb) q
> > > ci-openbsd#
> > > ci-openbsd$ tail -200 /var/log/daemon
> > > Oct  1 23:22:56 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 127
> > > successfully, tty /dev/ttyp1
> > > Oct  1 23:31:04 ci-openbsd vmd[12749]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  1 23:31:25 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 128
> > > successfully, tty /dev/ttyp1
> > > Oct  1 23:39:57 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 129
> > > successfully, tty /dev/ttyp1
> > > Oct  1 23:42:59 ci-openbsd vmd[14695]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  1 23:42:59 ci-openbsd vmd[14695]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  1 23:43:17 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 130
> > > successfully, tty /dev/ttyp0
> > > Oct  1 23:48:30 ci-openbsd vmd[49330]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  1 23:48:48 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 131
> > > successfully, tty /dev/ttyp1
> > > Oct  1 23:56:46 ci-openbsd vmd[94023]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  1 23:57:07 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 132
> > > successfully, tty /dev/ttyp1
> > > Oct  2 00:03:10 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 133
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:07:26 ci-openbsd vmd[68805]: ci-openbsd-main-1:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 00:07:47 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 134
> > > successfully, tty /dev/ttyp2
> > > Oct  2 00:11:15 ci-openbsd vmd[71074]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 00:11:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 135
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:14:59 ci-openbsd vmd[61869]: ci-openbsd-main-1: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 00:15:20 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 136
> > > successfully, tty /dev/ttyp2
> > > Oct  2 00:17:16 ci-openbsd ntpd[2907]: adjusting clock frequency by
> > > 0.066735 to -0.011194ppm
> > > Oct  2 00:18:52 ci-openbsd vmd[50408]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 00:19:10 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 137
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:22:42 ci-openbsd vmd[85645]: ci-openbsd-main-1: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 00:23:02 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 138
> > > successfully, tty /dev/ttyp2
> > > Oct  2 00:26:40 ci-openbsd vmd[73931]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 00:27:00 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 139
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:34:48 ci-openbsd vmd[21513]: ci-openbsd-main-2: can't set INTR:
> > > No such file or directory
> > > Oct  2 00:35:09 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 140
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:43:09 ci-openbsd vmd[27407]: ci-openbsd-main-2: can't set INTR:
> > > No such file or directory
> > > Oct  2 00:43:31 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 141
> > > successfully, tty /dev/ttyp0
> > > Oct  2 00:53:56 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 142
> > > successfully, tty /dev/ttyp1
> > > Oct  2 01:01:53 ci-openbsd vmd[88653]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 01:02:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 143
> > > successfully, tty /dev/ttyp1
> > > Oct  2 01:10:35 ci-openbsd vmd[20923]: ci-openbsd-main-0: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 01:10:35 ci-openbsd vmd[20923]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 01:10:35 ci-openbsd vmd[41352]: ci-openbsd-main-1: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 01:10:35 ci-openbsd vmd[32935]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 144
> > > successfully, tty /dev/ttyp0
> > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 145
> > > successfully, tty /dev/ttyp1
> > > Oct  2 01:10:55 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 146
> > > successfully, tty /dev/ttyp2
> > > Oct  2 01:18:30 ci-openbsd vmd[60956]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 01:18:49 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 147
> > > successfully, tty /dev/ttyp0
> > > Oct  2 01:19:22 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 148
> > > successfully, tty /dev/ttyp1
> > > Oct  2 01:19:57 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 149
> > > successfully, tty /dev/ttyp2
> > > Oct  2 01:26:42 ci-openbsd vmd[58230]: ci-openbsd-main-1:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 01:27:03 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 150
> > > successfully, tty /dev/ttyp1
> > > Oct  2 01:33:49 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 151
> > > successfully, tty /dev/ttyp0
> > > Oct  2 01:42:14 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 152
> > > successfully, tty /dev/ttyp0
> > > Oct  2 01:50:23 ci-openbsd vmd[6179]: vcpu_run_loop: vm 149 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 01:50:23 ci-openbsd vmd[6179]: ci-openbsd-main-0:
> > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 149, vcpu_id 0
> > > Oct  2 01:50:47 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 153
> > > successfully, tty /dev/ttyp0
> > > Oct  2 01:58:55 ci-openbsd vmd[53479]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 01:59:13 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 154
> > > successfully, tty /dev/ttyp0
> > > Oct  2 02:07:48 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 155
> > > successfully, tty /dev/ttyp0
> > > Oct  2 02:15:58 ci-openbsd vmd[55924]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 02:16:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 156
> > > successfully, tty /dev/ttyp0
> > > Oct  2 02:22:16 ci-openbsd vmd[89663]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 02:22:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 157
> > > successfully, tty /dev/ttyp2
> > > Oct  2 02:24:25 ci-openbsd vmd[97898]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 02:24:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 158
> > > successfully, tty /dev/ttyp0
> > > Oct  2 02:28:57 ci-openbsd vmd[1226]: ci-openbsd-main-1: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 02:29:18 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 159
> > > successfully, tty /dev/ttyp1
> > > Oct  2 02:30:11 ci-openbsd vmd[10203]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 02:30:31 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 160
> > > successfully, tty /dev/ttyp2
> > > Oct  2 02:36:15 ci-openbsd vmd[34907]: ci-openbsd-main-1: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 02:36:35 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 161
> > > successfully, tty /dev/ttyp1
> > > Oct  2 02:44:22 ci-openbsd vmd[86651]: vcpu_run_loop: vm 158 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 02:44:41 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 162
> > > successfully, tty /dev/ttyp1
> > > Oct  2 02:49:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 163
> > > successfully, tty /dev/ttyp2
> > > Oct  2 02:58:07 ci-openbsd vmd[77821]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 02:58:28 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 164
> > > successfully, tty /dev/ttyp2
> > > Oct  2 03:06:33 ci-openbsd vmd[4903]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 03:06:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 165
> > > successfully, tty /dev/ttyp2
> > > Oct  2 03:15:34 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 166
> > > successfully, tty /dev/ttyp2
> > > Oct  2 03:23:40 ci-openbsd vmd[49598]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 03:24:03 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 167
> > > successfully, tty /dev/ttyp2
> > > Oct  2 03:27:10 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 168
> > > successfully, tty /dev/ttyp0
> > > Oct  2 03:32:22 ci-openbsd vmd[4160]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 03:32:42 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 169
> > > successfully, tty /dev/ttyp1
> > > Oct  2 03:33:17 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 170
> > > successfully, tty /dev/ttyp2
> > > Oct  2 03:44:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 171
> > > successfully, tty /dev/ttyp0
> > > Oct  2 03:52:57 ci-openbsd vmd[60131]: ci-openbsd-main-0: can't set INTR:
> > > No such file or directory
> > > Oct  2 03:53:17 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 172
> > > successfully, tty /dev/ttyp0
> > > Oct  2 04:01:25 ci-openbsd vmd[69189]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 04:01:45 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 173
> > > successfully, tty /dev/ttyp0
> > > Oct  2 04:10:20 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 174
> > > successfully, tty /dev/ttyp0
> > > Oct  2 04:22:33 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 175
> > > successfully, tty /dev/ttyp2
> > > Oct  2 04:33:01 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 176
> > > successfully, tty /dev/ttyp0
> > > Oct  2 04:35:26 ci-openbsd vmd[5334]: vcpu_run_loop: vm 166 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 04:35:45 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 177
> > > successfully, tty /dev/ttyp1
> > > Oct  2 04:43:25 ci-openbsd vmd[32653]: ci-openbsd-main-test-2: started vm
> > > 178 successfully, tty /dev/ttyp2
> > > Oct  2 04:43:25 ci-openbsd vmd[32653]: ci-openbsd-main-test-1: started vm
> > > 179 successfully, tty /dev/ttyp4
> > > Oct  2 04:43:27 ci-openbsd vmd[32653]: ci-openbsd-main-test-0: user 1000
> > > cpu limit reached
> > > Oct  2 04:43:27 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-test-0
> > > Oct  2 04:44:25 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:44:25 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:45:13 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:45:13 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:46:11 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:46:11 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:46:58 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:46:58 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:47:35 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:47:35 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:48:17 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:48:17 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:48:57 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:48:57 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:49:37 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:49:37 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:50:19 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:50:19 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:51:02 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:51:02 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:51:44 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:51:44 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:52:27 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:52:27 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:53:06 ci-openbsd vmd[32653]: ci-openbsd-main-1: user 1000 cpu
> > > limit reached
> > > Oct  2 04:53:06 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-1
> > > Oct  2 04:53:47 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 194
> > > successfully, tty /dev/ttyp0
> > > Oct  2 04:54:38 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:54:38 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:55:13 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:55:13 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:55:54 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:55:54 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:56:37 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:56:37 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:57:18 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:57:18 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:57:53 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:57:53 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:58:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:58:39 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:59:20 ci-openbsd vmd[32653]: ci-openbsd-main-0: user 1000 cpu
> > > limit reached
> > > Oct  2 04:59:20 ci-openbsd vmd[32653]: config_setvm: failed to start vm
> > > ci-openbsd-main-0
> > > Oct  2 04:59:39 ci-openbsd vmd[94868]: vcpu_run_loop: vm 176 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 04:59:44 ci-openbsd vmd[39078]: ci-openbsd-main-test-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 04:59:51 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 203
> > > successfully, tty /dev/ttyp1
> > > Oct  2 05:00:04 ci-openbsd vmd[21591]: ci-openbsd-main-1: can't set INTR:
> > > No such file or directory
> > > Oct  2 05:00:14 ci-openbsd vmd[45083]: ci-openbsd-main-0: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-1: started vm 204
> > > successfully, tty /dev/ttyp0
> > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 205
> > > successfully, tty /dev/ttyp1
> > > Oct  2 05:00:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 206
> > > successfully, tty /dev/ttyp2
> > > Oct  2 05:11:52 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 207
> > > successfully, tty /dev/ttyp2
> > > Oct  2 05:36:32 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 208
> > > successfully, tty /dev/ttyp1
> > > Oct  2 06:06:47 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 209
> > > successfully, tty /dev/ttyp1
> > > Oct  2 06:13:35 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 210
> > > successfully, tty /dev/ttyp2
> > > Oct  2 06:13:47 ci-openbsd vmd[26018]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 06:14:06 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 211
> > > successfully, tty /dev/ttyp1
> > > Oct  2 06:20:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 212
> > > successfully, tty /dev/ttyp2
> > > Oct  2 06:39:05 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 213
> > > successfully, tty /dev/ttyp1
> > > Oct  2 06:47:01 ci-openbsd vmd[99939]: ci-openbsd-main-2: can't set INTR:
> > > No such file or directory
> > > Oct  2 06:47:01 ci-openbsd vmd[45529]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 06:48:28 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 214
> > > successfully, tty /dev/ttyp1
> > > Oct  2 06:48:28 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 215
> > > successfully, tty /dev/ttyp2
> > > Oct  2 07:00:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 216
> > > successfully, tty /dev/ttyp2
> > > Oct  2 07:15:29 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 217
> > > successfully, tty /dev/ttyp1
> > > Oct  2 07:22:17 ci-openbsd vmd[32248]: ci-openbsd-main-0:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 07:22:36 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 218
> > > successfully, tty /dev/ttyp1
> > > Oct  2 07:42:45 ci-openbsd vmd[62262]: ci-openbsd-main-2:
> > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 191, vcpu_id 0
> > > Oct  2 07:44:08 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 219
> > > successfully, tty /dev/ttyp1
> > > Oct  2 07:44:08 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 220
> > > successfully, tty /dev/ttyp2
> > > Oct  2 07:45:27 ci-openbsd vmd[18782]: vcpu_run_loop: vm 195 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 07:45:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 221
> > > successfully, tty /dev/ttyp1
> > > Oct  2 07:45:54 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 222
> > > successfully, tty /dev/ttyp2
> > > Oct  2 07:52:39 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 223
> > > successfully, tty /dev/ttyp1
> > > Oct  2 07:57:21 ci-openbsd vmd[88211]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 07:57:35 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 224
> > > successfully, tty /dev/ttyp2
> > > Oct  2 08:02:33 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 225
> > > successfully, tty /dev/ttyp1
> > > Oct  2 08:07:59 ci-openbsd vmd[71528]: ci-openbsd-main-2:
> > > vcpu_assert_pic_irq: can't assert INTR
> > > Oct  2 08:08:18 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 226
> > > successfully, tty /dev/ttyp2
> > > Oct  2 08:14:28 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 227
> > > successfully, tty /dev/ttyp1
> > > Oct  2 08:20:36 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 228
> > > successfully, tty /dev/ttyp2
> > > Oct  2 08:27:04 ci-openbsd vmd[87075]: ci-openbsd-main-0:
> > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 202, vcpu_id 0
> > > Oct  2 08:27:19 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 229
> > > successfully, tty /dev/ttyp1
> > > Oct  2 08:33:48 ci-openbsd vmd[49729]: vcpu_run_loop: vm 203 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 08:34:03 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 230
> > > successfully, tty /dev/ttyp2
> > > Oct  2 08:39:29 ci-openbsd vmd[28457]: ci-openbsd-main-0: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 08:39:44 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 231
> > > successfully, tty /dev/ttyp1
> > > Oct  2 08:45:10 ci-openbsd vmd[18437]: ci-openbsd-main-2:
> > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 205, vcpu_id 0
> > > Oct  2 08:45:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 232
> > > successfully, tty /dev/ttyp2
> > > Oct  2 08:52:14 ci-openbsd vmd[32653]: ci-openbsd-main-0: started vm 233
> > > successfully, tty /dev/ttyp1
> > > Oct  2 08:57:40 ci-openbsd vmd[62972]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 08:57:58 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 234
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:10:04 ci-openbsd vmd[1795]: ci-openbsd-main-2: can't set INTR:
> > No
> > > such file or directory
> > > Oct  2 09:10:16 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 235
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:17:47 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 236
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:25:15 ci-openbsd vmd[94235]: ci-openbsd-main-2: can't set INTR:
> > > No such file or directory
> > > Oct  2 09:25:27 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 237
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:32:49 ci-openbsd vmd[63400]: ci-openbsd-main-2: can't set INTR:
> > > No such file or directory
> > > Oct  2 09:33:01 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 238
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:40:21 ci-openbsd vmd[37476]: ci-openbsd-main-2: can't clear
> > INTR:
> > > No such file or directory
> > > Oct  2 09:40:33 ci-openbsd vmd[32653]: ci-openbsd-main-2: started vm 239
> > > successfully, tty /dev/ttyp2
> > > Oct  2 09:45:06 ci-openbsd vmd[44625]: vcpu_run_loop: vm 214 / vcpu 0 run
> > > ioctl failed: No such file or directory
> > > Oct  2 09:45:06 ci-openbsd vmd[44625]: ci-openbsd-main-2:
> > > vcpu_deassert_pic_irq: can't deassert INTR for vm_id 214, vcpu_id 0
> > > Oct  2 09:45:20 ci-openbsd vmd[32653]: parent terminating
> > > Oct  2 09:45:20 ci-openbsd vmd[50191]: control exiting, pid 50191
> > > Oct  2 09:45:20 ci-openbsd vmd[89585]: priv exiting, pid 89585
> > > Oct  2 09:45:20 ci-openbsd vmd[33160]: vmm exiting, pid 33160
> > > $ dmesg
> > > OpenBSD 6.4-beta (GENERIC.MP) #336: Sat Sep 29 08:13:15 MDT 2018
> > >     dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> > > real mem = 17163079680 (16367MB)
> > > avail mem = 16633655296 (15863MB)
> > > mpath0 at root
> > > scsibus0 at mpath0: 256 targets
> > > mainbus0 at root
> > > bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xbffffcf0 (20 entries)
> > > bios0: vendor Google version "Google" date 01/01/2011
> > > bios0: Google Google Compute Engine
> > > acpi0 at bios0: rev 0
> > > acpi0: sleep states S3 S4 S5
> > > acpi0: tables DSDT FACP SSDT APIC WAET SRAT
> > > acpi0: wakeup devices
> > > acpitimer0 at acpi0: 3579545 Hz, 24 bits
> > > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> > > cpu0 at mainbus0: apid 0 (boot processor)
> > > cpu0: Intel(R) Xeon(R) CPU @ 2.30GHz, 2300.46 MHz, 06-3f-00
> > > cpu0:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu0: 256KB 64b/line 8-way L2 cache
> > > cpu0: smt 0, core 0, package 0
> > > mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> > > cpu0: apic clock running at 969MHz
> > > cpu1 at mainbus0: apid 2 (application processor)
> > > cpu1: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.60 MHz, 06-3f-00
> > > cpu1:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu1: 256KB 64b/line 8-way L2 cache
> > > cpu1: smt 0, core 1, package 0
> > > cpu2 at mainbus0: apid 4 (application processor)
> > > cpu2: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.61 MHz, 06-3f-00
> > > cpu2:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu2: 256KB 64b/line 8-way L2 cache
> > > cpu2: smt 0, core 2, package 0
> > > cpu3 at mainbus0: apid 6 (application processor)
> > > cpu3: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.60 MHz, 06-3f-00
> > > cpu3:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu3: 256KB 64b/line 8-way L2 cache
> > > cpu3: smt 0, core 3, package 0
> > > cpu4 at mainbus0: apid 1 (application processor)
> > > cpu4: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.62 MHz, 06-3f-00
> > > cpu4:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu4: 256KB 64b/line 8-way L2 cache
> > > cpu4: smt 1, core 0, package 0
> > > cpu5 at mainbus0: apid 3 (application processor)
> > > cpu5: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.65 MHz, 06-3f-00
> > > cpu5:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu5: 256KB 64b/line 8-way L2 cache
> > > cpu5: smt 1, core 1, package 0
> > > cpu6 at mainbus0: apid 5 (application processor)
> > > cpu6: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.61 MHz, 06-3f-00
> > > cpu6:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu6: 256KB 64b/line 8-way L2 cache
> > > cpu6: smt 1, core 2, package 0
> > > cpu7 at mainbus0: apid 7 (application processor)
> > > cpu7: Intel(R) Xeon(R) CPU @ 2.30GHz, 2230.59 MHz, 06-3f-00
> > > cpu7:
> > >
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,XSAVEOPT,MELTDOWN
> > > cpu7: 256KB 64b/line 8-way L2 cache
> > > cpu7: smt 1, core 3, package 0
> > > ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins
> > > acpiprt0 at acpi0: bus 0 (PCI0)
> > > acpicpu0 at acpi0: C1(@1 halt!)
> > > acpicpu1 at acpi0: C1(@1 halt!)
> > > acpicpu2 at acpi0: C1(@1 halt!)
> > > acpicpu3 at acpi0: C1(@1 halt!)
> > > acpicpu4 at acpi0: C1(@1 halt!)
> > > acpicpu5 at acpi0: C1(@1 halt!)
> > > acpicpu6 at acpi0: C1(@1 halt!)
> > > acpicpu7 at acpi0: C1(@1 halt!)
> > > "ACPI0006" at acpi0 not configured
> > > acpicmos0 at acpi0
> > > "QEMU0001" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > "ACPI0007" at acpi0 not configured
> > > pvbus0 at mainbus0: KVM
> > > pci0 at mainbus0 bus 0
> > > pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
> > > pcib0 at pci0 dev 1 function 0 "Intel 82371AB PIIX4 ISA" rev 0x03
> > > piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: SMBus
> > > disabled
> > > virtio0 at pci0 dev 3 function 0 "Qumranet Virtio SCSI" rev 0x00
> > > vioscsi0 at virtio0: qsize 8192
> > > scsibus1 at vioscsi0: 253 targets
> > > sd0 at scsibus1 targ 1 lun 0: <Google, PersistentDisk, 1> SCSI4 0/direct
> > > fixed serial.Google_PersistentDisk_
> > > sd0: 10240MB, 512 bytes/sector, 20971520 sectors, thin
> > > sd1 at scsibus1 targ 2 lun 0: <Google, PersistentDisk, 1> SCSI4 0/direct
> > > fixed serial.Google_PersistentDisk_
> > > sd1: 1024000MB, 512 bytes/sector, 2097152000 sectors, thin
> > > virtio0: msix shared
> > > virtio1 at pci0 dev 4 function 0 "Qumranet Virtio Network" rev 0x00
> > > vio0 at virtio1: address 42:01:0a:80:00:3f
> > > virtio1: msix per-VQ
> > > isa0 at pcib0
> > > isadma0 at isa0
> > > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> > > com0: console
> > > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> > > com2 at isa0 port 0x3e8/8 irq 5: ns16550a, 16 byte fifo
> > > pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> > > pckbd0 at pckbc0 (kbd slot)
> > > wskbd0 at pckbd0 mux 1
> > > pms0 at pckbc0 (aux slot)
> > > wsmouse0 at pms0 mux 0
> > > pcppi0 at isa0 port 0x61
> > > spkr0 at pcppi0
> > > vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
> > > vscsi0 at root
> > > scsibus2 at vscsi0: 256 targets
> > > softraid0 at root
> > > scsibus3 at softraid0: 256 targets
> > > root on sd0a (dd61083aafe9fd0b.a) swap on sd0b dump on sd0b
> > >
> > >
> > > --
> > > nest.cx is Gmail hosted, use PGP for anything private. Key:
> > > http://goo.gl/6dMsr
> > > Fingerprint: 5E2B 2D0E 1E03 2046 BEC3  4D50 0B15 42BD 8DF5 A1B0
> >
> > --
> >
> 
> 
> -- 
> nest.cx is Gmail hosted, use PGP for anything private. Key:
> http://goo.gl/6dMsr
> Fingerprint: 5E2B 2D0E 1E03 2046 BEC3  4D50 0B15 42BD 8DF5 A1B0

-- 

Reply via email to