2.11 is not terribly old but since then QEMU has made big improvements affecting OSv boot time (even non-microvm machine). If you do not want to upgrade your machine to newer Ubuntu - 19.10 comes with QEMU 4.0) or build qemu from source, you may also consider running qemu and OSv on it in a Fedora 31 docker container (Fedora 31 comes with qemu 4.1). You can use this docker file as an example to create the corresponding image:
FROM fedora:31 RUN yum install -y git python3 qemu-system-x86 qemu-img # - prepare directories RUN mkdir /git-repos # - clone OSv WORKDIR /git-repos RUN git clone --depth 1 https://github.com/cloudius-systems/osv.git CMD /bin/bash Also, I am interested in how fast the same benchmark app boots on the firecracker (light KVM-based hypervisor) on your machine (scripts/firecracker.py will automatically pull firecracker binary). I would expect it to boot in 5-10 ms. Lastly, could you tell us a bit more about the specs of the hardware you are running your Linux host on? My laptop is 7 years old macbook pro with i7 2.3GHz 4-core cpu. On Wednesday, February 26, 2020 at 6:18:22 AM UTC-5, [email protected] wrote: > > I am running OSv on Ubuntu 18.04 through a VM, hyperthreading is enabled, > and my qemu version is: > > /usr/bin/qemu-system-x86_64 --version > QEMU emulator version 2.11.1(Debian 1:2.11+dfsg-1ubuntu7.23) > > Which that explains why I don't have qemu microvm.....mine says latest > version and you say I need 4.1>=??? > > On Tuesday, February 25, 2020 at 11:24:54 PM UTC-5, Waldek Kozaczuk wrote: >> >> Can you also tell us a bit more about your setup - machine (VM or bare >> metal), linux host (version), hyperthreading, version of QEMU, etc. >> >> When you run on Linux, you mean on the host or on the Linux guest? >> >> On Tuesday, February 25, 2020 at 11:11:31 PM UTC-5, Waldek Kozaczuk wrote: >>> >>> I see that you are running OSv on regular QEMU (see '-p kvm' unlike '-p >>> qemu_microvm') hence very slow boot time. But when I run the same OSv guest >>> command like yours on regular qemu on my laptop I get boot time around >>> 120ms which is 3 times faster than yours: >>> >>> ./scripts/run.py -p kvm -V --nics 0 --nogdb -m 1G -c 1 >>> --block-device-cache writeback,aio=threads -e '/radix -p 1 -n16777216' >>> OSv v0.54.0-119-g4ee4b788 >>> 1 CPUs detected >>> Firmware vendor: SeaBIOS >>> bsd: initializing - done >>> VFS: mounting ramfs at / >>> VFS: mounting devfs at /dev >>> net: initializing - done >>> vga: Add VGA device instance >>> virtio-blk: Add blk device instances 0 as vblk0, devsize=6480896 >>> random: virtio-rng registered as a source. >>> random: intel drng, rdrand registered as a source. >>> random: <Software, Yarrow> initialized >>> VFS: unmounting /dev >>> VFS: mounting rofs at /rofs >>> VFS: mounting devfs at /dev >>> VFS: mounting procfs at /proc >>> VFS: mounting sysfs at /sys >>> VFS: mounting ramfs at /tmp >>> Booted up in 126.02 ms >>> Cmdline: /radix -p 1 -n16777216 >>> >>> Integer Radix Sort >>> 16777216 Keys >>> 1 Processors >>> Radix = 1024 >>> Max key = 524288 >>> >>> random: device unblocked. >>> >>> PROCESS STATISTICS >>> Total Rank Sort >>> Proc Time Time Time >>> 0 459824 131091 328714 >>> >>> TIMING INFORMATION >>> Start time : 1582690117331280 >>> Initialization finish time : 1582690120377120 >>> Overall finish time : 1582690120836944 >>> Total time with initialization : 3505664 >>> Total time without initialization : 459824 >>> >>> program exited with status 0 >>> VFS: unmounting /dev >>> VFS: unmounting /proc >>> VFS: unmounting / >>> ROFS: spent 0.28 ms reading from disk >>> ROFS: read 84 512-byte blocks from disk >>> ROFS: allocated 81 512-byte blocks of cache memory >>> ROFS: hit ratio is 94.12% >>> Powering off. >>> >>> Could it be that you run OSv in a nested virtualization setup? >>> >>> On Tuesday, February 25, 2020 at 7:12:50 PM UTC-5, [email protected] >>> wrote: >>>> >>>> 1 cpu on linux: >>>> >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 1 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 1510833 311553 1199271 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675055600374 >>>> Initialization finish time : 1582675061040740 >>>> Overall finish time : 1582675062551573 >>>> Total time with initialization : 6951199 >>>> Total time without initialization : 1510833 >>>> >>>> >>>> >>>> >>>> 2cpu on linux: >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 2 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 760267 159099 597266 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675165095355 >>>> Initialization finish time : 1582675167810016 >>>> Overall finish time : 1582675168570283 >>>> Total time with initialization : 3474928 >>>> Total time without initialization : 760267 >>>> >>>> >>>> 4cpu on linux: >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 4 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 463616 104424 358749 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675303803195 >>>> Initialization finish time : 1582675305167855 >>>> Overall finish time : 1582675305631471 >>>> Total time with initialization : 1828276 >>>> Total time without initialization : 463616 >>>> >>>> >>>> 8cpu on linux >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 8 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 247667 57513 162350 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675359221291 >>>> Initialization finish time : 1582675359903200 >>>> Overall finish time : 1582675360150867 >>>> Total time with initialization : 929576 >>>> Total time without initialization : 247667 >>>> >>>> >>>> 1cpu on osv: >>>> ./scripts/run.py -p kvm -V --nics 0 --nogdb -m 1G -c 1 >>>> --block-device-cache >>>> writeback,aio=threads -e '/radix -p 1 -n16777216' >>>> OSv v0.54.0-108-g69486729 >>>> 1 CPUs detected >>>> Firmware vendor: SeaBIOS >>>> bsd: initializing - done >>>> VFS: mounting ramfs at / >>>> VFS: mounting devfs at /dev >>>> net: initializing - done >>>> vga: Add VGA device instance >>>> virtio-blk: Add blk device instances 0 as vblk0, devsize=4357632 >>>> random: virtio-rng registered as a source. >>>> random: <Software, Yarrow> initialized >>>> VFS: unmounting /dev >>>> VFS: mounting rofs at /rofs >>>> VFS: mounting devfs at /dev >>>> VFS: mounting procfs at /proc >>>> VFS: mounting sysfs at /sys >>>> VFS: mounting ramfs at /tmp >>>> Booted up in 320.89 ms >>>> Cmdline: /radix -p 1 -n16777216 >>>> >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 1 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> random: device unblocked. >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 1536974 312648 1224318 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675604420160 >>>> Initialization finish time : 1582675609828738 >>>> Overall finish time : 1582675611365712 >>>> Total time with initialization : 6945552 >>>> Total time without initialization : 1536974 >>>> >>>> program exited with status 0 >>>> VFS: unmounting /dev >>>> VFS: unmounting /proc >>>> VFS: unmounting / >>>> ROFS: spent 2.42 ms reading from disk >>>> ROFS: read 76 512-byte blocks from disk >>>> ROFS: allocated 73 512-byte blocks of cache memory >>>> ROFS: hit ratio is 91.89% >>>> Powering off. >>>> 2cpu osv: >>>> ./scripts/run.py -p kvm -V --nics 0 --nogdb -m 1G -c 2 >>>> --block-device-cache >>>> writeback,aio=threads -e '/radix -p 2 -n16777216' >>>> OSv v0.54.0-108-g69486729 >>>> 2 CPUs detected >>>> Firmware vendor: SeaBIOS >>>> bsd: initializing - done >>>> VFS: mounting ramfs at / >>>> VFS: mounting devfs at /dev >>>> net: initializing - done >>>> vga: Add VGA device instance >>>> virtio-blk: Add blk device instances 0 as vblk0, devsize=4357632 >>>> random: virtio-rng registered as a source. >>>> random: <Software, Yarrow> initialized >>>> VFS: unmounting /dev >>>> VFS: mounting rofs at /rofs >>>> VFS: mounting devfs at /dev >>>> VFS: mounting procfs at /proc >>>> VFS: mounting sysfs at /sys >>>> VFS: mounting ramfs at /tmp >>>> Booted up in 329.94 ms >>>> Cmdline: /radix -p 2 -n16777216 >>>> >>>> Integer Radix Sort >>>> 16777216 Keys >>>> 2 Processors >>>> Radix = 1024 >>>> Max key = 524288 >>>> >>>> random: device unblocked. >>>> >>>> PROCESS STATISTICS >>>> Total Rank Sort >>>> Proc Time Time Time >>>> 0 897061 172935 721892 >>>> >>>> TIMING INFORMATION >>>> Start time : 1582675669879986 >>>> Initialization finish time : 1582675672671371 >>>> Overall finish time : 1582675673568432 >>>> Total time with initialization : 3688446 >>>> Total time without initialization : 897061 >>>> >>>> program exited with status 0 >>>> VFS: unmounting /dev >>>> VFS: unmounting /proc >>>> VFS: unmounting / >>>> ROFS: spent 1.48 ms reading from disk >>>> ROFS: read 76 512-byte blocks from disk >>>> ROFS: allocated 73 512-byte blocks of cache memory >>>> ROFS: hit ratio is 91.89% >>>> Powering off. >>>> >>>> 4 cpu OSV: >>>> ./scripts/run.py -p kvm -V --nics 0 --nogdb -m 1G -c 4 >>>> --block-device-cache >>>> writeback,aio=threads -e '/radix -p 4 -n16777216' >>>> OSv v0.54.0-108-g69486729 >>>> 4 CPUs detected >>>> Firmware vendor: SeaBIOS >>>> bsd: initializing - done >>>> VFS: mounting ramfs at / >>>> VFS: mounting devfs at /dev >>>> net: initializing - done >>>> vga: Add VGA device instance >>>> virtio-blk: Add blk device instances 0 as vblk0, devsize=4357632 >>>> random: virtio-rng registered <span s >>>> >>> -- You received this message because you are subscribed to the Google Groups "OSv Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/osv-dev/8c05f413-4366-4a51-8900-8bfaa9e955a2%40googlegroups.com.
