Penned by Matthieu Herrb on 20180102 14:55.22, we have: | On Tue, Jan 02, 2018 at 08:37:04PM +0100, Landry Breuil wrote: | > On Sat, Dec 30, 2017 at 09:23:03PM -0800, Mike Larkin wrote: | > > On Tue, Jan 02, 2018 at 11:30:47AM -0500, Brian Rak wrote: | > > > | > > > | > > The only thing I can say is that recently I've been noticing an uptick in the | > > quantity of KVM related issues on OpenBSD. Whether this is due to some recent | > > changes in KVM, or maybe due to more people running OpenBSD on KVM (and thus | > > increasing the number of reports), I'm not sure. But kettenis@ did note a few | > > days ago in a reply to a different KVM related issue that it seems their local | > > APIC emulation code isn't behaving exactly as we expect. But that code hasn't | > > changed in OpenBSD since, well, forever, so it's likely a KVM issue there. | > > Whether this is your issue or not I don't know. You might bring this up on | > > the KVM mailing lists and see if someone can shed light on it. If you search | > > the tech@/misc@ archives for proxmox related threads, there was a KVM option | > > reported a week or so back that seemed to fix the issue kettenis@ was commenting | > > on; perhaps this can help you. | > | > ftr that option was kvm-intel.preemption_timer=0 on the host kernel | > commandline. | | FWIW, I'm running OpenBSD-current in qemu / KVM using libvirt and | virt-manager for some years now. Current -current still works OK for | me. /var/run/ntpd.drift is 0.47 which doesn't look bad. | | Here are dmesg from the VM and the xml file for libvirt. | | OpenBSD 6.2-current (GENERIC.MP) #28: Fri Dec 29 18:10:50 CET 2017 | [email protected]:/usr/obj/GENERIC.MP | real mem = 2130698240 (2031MB) | avail mem = 2059264000 (1963MB) | mpath0 at root | scsibus0 at mpath0: 256 targets | mainbus0 at root | bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xf1430 (13 entries) | bios0: vendor Bochs version "Bochs" date 01/01/2011 | bios0: Bochs Bochs | acpi0 at bios0: rev 0 | acpi0: sleep states S3 S4 S5 | acpi0: tables DSDT FACP SSDT APIC HPET | acpi0: wakeup devices | acpitimer0 at acpi0: 3579545 Hz, 24 bits | acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat | cpu0 at mainbus0: apid 0 (boot processor) | cpu0: Intel Xeon E3-12xx v2 (Ivy Bridge), 772.12 MHz | cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,VMX,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,RDTSCP,LONG,LAHF,PERF,FSGSBASE,SMEP,ERMS | cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache | cpu0: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu0: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu0: smt 0, core 0, package 0 | mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges | cpu0: apic clock running at 1000MHz | cpu1 at mainbus0: apid 1 (application processor) | cpu1: Intel Xeon E3-12xx v2 (Ivy Bridge), 919.08 MHz | cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,VMX,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,RDTSCP,LONG,LAHF,PERF,FSGSBASE,SMEP,ERMS | cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache | cpu1: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu1: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu1: smt 0, core 0, package 1 | cpu2 at mainbus0: apid 2 (application processor) | cpu2: Intel Xeon E3-12xx v2 (Ivy Bridge), 1016.77 MHz | cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,VMX,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,RDTSCP,LONG,LAHF,PERF,FSGSBASE,SMEP,ERMS | cpu2: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache | cpu2: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu2: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu2: smt 0, core 0, package 2 | cpu3 at mainbus0: apid 3 (application processor) | cpu3: Intel Xeon E3-12xx v2 (Ivy Bridge), 968.46 MHz | cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,VMX,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,RDTSCP,LONG,LAHF,PERF,FSGSBASE,SMEP,ERMS | cpu3: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache | cpu3: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu3: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped | cpu3: smt 0, core 0, package 3 | ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins | acpihpet0 at acpi0: 100000000 Hz | acpiprt0 at acpi0: bus 0 (PCI0) | acpicpu0 at acpi0: C1(@1 halt!) | acpicpu1 at acpi0: C1(@1 halt!) | acpicpu2 at acpi0: C1(@1 halt!) | acpicpu3 at acpi0: C1(@1 halt!) | "ACPI0006" at acpi0 not configured | "ACPI0007" at acpi0 not configured | "ACPI0007" at acpi0 not configured | "ACPI0007" at acpi0 not configured | "ACPI0007" at acpi0 not configured | pvbus0 at mainbus0: KVM | pci0 at mainbus0 bus 0 | pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02 | pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00 | pciide0 at pci0 dev 1 function 1 "Intel 82371SB IDE" rev 0x00: DMA, channel 0 wired to compatibility, channel 1 wired to compatibility | pciide0: channel 0 disabled (no drives) | atapiscsi0 at pciide0 channel 1 drive 0 | scsibus1 at atapiscsi0: 2 targets | cd0 at scsibus1 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 1.0> ATAPI 5/cdrom removable | cd0(pciide0:1:0): using PIO mode 4, DMA mode 2 | uhci0 at pci0 dev 1 function 2 "Intel 82371SB USB" rev 0x01: apic 0 int 11 | piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: apic 0 int 9 | iic0 at piixpm0 | vga1 at pci0 dev 2 function 0 "Red Hat QXL Video" rev 0x03 | wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) | wsdisplay0: screen 1-5 added (80x25, vt100 emulation) | virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Network" rev 0x00 | vio0 at virtio0: address 52:54:00:04:d9:6d | virtio0: msix shared | azalia0 at pci0 dev 4 function 0 "Intel 82801FB HD Audio" rev 0x01: apic 0 int 11 | azalia0: No codecs found | virtio1 at pci0 dev 5 function 0 "Qumranet Virtio Memory" rev 0x00 | viomb0 at virtio1 | virtio1: apic 0 int 10 | virtio2 at pci0 dev 6 function 0 "Qumranet Virtio Storage" rev 0x00 | vioblk0 at virtio2 | scsibus2 at vioblk0: 2 targets | sd0 at scsibus2 targ 0 lun 0: <VirtIO, Block Device, > SCSI3 0/direct fixed | sd0: 20480MB, 512 bytes/sector, 41943040 sectors | virtio2: msix shared | isa0 at pcib0 | isadma0 at isa0 | fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 | com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo | com0: console | pckbc0 at isa0 port 0x60/5 irq 1 irq 12 | pckbd0 at pckbc0 (kbd slot) | wskbd0 at pckbd0: console keyboard, using wsdisplay0 | pms0 at pckbc0 (aux slot) | wsmouse0 at pms0 mux 0 | pcppi0 at isa0 port 0x61 | spkr0 at pcppi0 | usb0 at uhci0: USB revision 1.0 | uhub0 at usb0 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1 | vmm0 at mainbus0: VMX/EPT | vscsi0 at root | scsibus3 at vscsi0: 256 targets | softraid0 at root | scsibus4 at softraid0: 256 targets | root on sd0a (f5535e6a0e453526.a) swap on sd0b dump on sd0b | fd0 at fdc0 drive 1: density unknown | | <!-- | WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO BE | OVERWRITTEN AND LOST. Changes to this xml configuration should be made using: | virsh edit obsd64-current | or other application using the libvirt API. | --> | | <domain type='kvm'> | <name>obsd64-current</name> | <uuid>dce76d73-7af5-fb02-1389-4cb713dd99b4</uuid> | <memory unit='KiB'>2097152</memory> | <currentMemory unit='KiB'>2097152</currentMemory> | <vcpu placement='static'>4</vcpu> | <os> | <type arch='x86_64' machine='pc-1.0'>hvm</type> | <boot dev='hd'/> | <boot dev='cdrom'/> | <boot dev='network'/> | <bootmenu enable='yes'/> | </os> | <features> | <acpi/> | <apic/> | <pae/> | </features> | <cpu mode='host-model'> | <model fallback='allow'/> | </cpu> | <clock offset='utc'/> | <on_poweroff>destroy</on_poweroff> | <on_reboot>restart</on_reboot> | <on_crash>restart</on_crash> | <devices> | <emulator>/usr/bin/kvm</emulator> | <disk type='block' device='disk'> | <driver name='qemu' type='raw'/> | <source dev='/dev/vm/obsd64-current'/> | <target dev='vda' bus='virtio'/> | <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> | </disk> | <disk type='file' device='cdrom'> | <driver name='qemu' type='raw'/> | <target dev='hdc' bus='ide'/> | <readonly/> | <address type='drive' controller='0' bus='1' target='0' unit='0'/> | </disk> | <controller type='ide' index='0'> | <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> | </controller> | <controller type='usb' index='0'> | <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> | </controller> | <controller type='pci' index='0' model='pci-root'/> | <interface type='bridge'> | <mac address='52:54:00:01:02:03'/> | <source bridge='br0'/> | <model type='virtio'/> | <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> | </interface> | <serial type='pty'> | <target port='0'/> | </serial> | <console type='pty'> | <target type='serial' port='0'/> | </console> | <input type='mouse' bus='ps2'/> | <input type='keyboard' bus='ps2'/> | <graphics type='vnc' port='-1' autoport='yes'/> | <sound model='ich6'> | <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> | </sound> | <video> | <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1'/> | <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> | </video> | <memballoon model='virtio'> | <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> | </memballoon> | </devices> | </domain> | | -- | Matthieu Herrb
I've been running OpenBSD under kvm using proxmox for a few years now for my own hosting setup. I've recently figured out that iothreads are not to be used as it stalls disk io with heavy work loads (mail servers and btcd for example!). So do not add '-object iothread,id=iothread-virtio0' or similar ... in my experience! Here is a sample commandline for that if it helps: /usr/bin/kvm -id 803 -chardev socket,id=qmp,path=/var/run/qemu-server/803.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/803.pid -daemonize -smbios type=1,uuid=d5514989-ddb4-4003-a55e-c84710a72f24 -name www0 -smp 2,sockets=2,cores=1,maxcpus=2 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg -vga std -vnc unix:/var/run/qemu-server/803.vnc,x509,password -cpu host,+kvm_pv_unhalt,+kvm_pv_eoi -m 256 -k en-us -device pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f -device pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -chardev socket,id=serial0,path=/var/run/qemu-server/803.serial0,server,nowait -device isa-serial,chardev=serial0 -chardev socket,path=/var/run/qemu-server/803.qga,server,nowait,id=qga0 -device virtio-serial,id=qga0,bus=pci.0,addr=0x8 -device virtserialport,chardev=qga0,name=org.qemu.guest_agent.0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:d1d0239e1e2c -device ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7 -drive file=/dev/zvol/rpool/data/vm-803-disk-1,if=none,id=drive-sata0,format=raw,cache=none,aio=native,detect-zeroes=on -device ide-drive,bus=ahci0.0,drive=drive-sata0,id=sata0,bootindex=100 -netdev type=tap,id=net0,ifname=tap803i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=3A:37:31:66:63:63,netdev=net0,bus=pci.0,addr=0x12,id=net0 I know your host cpu is likely different, but this is /proc/cpuinfo for one cpu for the system running this vm: processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 26 model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz stepping : 5 microcode : 0x11 cpu MHz : 3074.418 cache size : 8192 KB physical id : 0 siblings : 8 core id : 0 cpu cores : 4 apicid : 0 initial apicid : 0 fpu : yes fpu_exception : yes cpuid level : 11 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm tpr_shadow vnmi flexpriority ept vpid dtherm ida bugs : bogomips : 6148.83 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: -- Todd T. Fries . http://todd.fries.net/pgp.txt . @unix2mars . github:toddfries
