Fwd: bhyve clock jitter
Hi ...
I have a strange issue about the clock of some FreeBSD Bhyve guests, maybe
someone of you can help me to diagnose it and work on a solution.
In detail, sometimes (without an apparent regularity) one of four bhyve guest's
clock goes exactly 7 minutes and 10 seconds in the future.
This clock stays unaligned for about 20 minutes, then, without any human
intervention, the clock realign to proper condition.
My configuration is:
envrm02 (bhyve HOST, 10.2-RELEASE-p14)
-> og-qa (bhyve guest - 10.2-RELEASE-p14)
-> og-ci (bhyve guest - 10.2-RELEASE-p14)
-> og-test (bhyve guest - 10.2-RELEASE-p14)
-> og-prod-rm (bhyve guest - 10.2-RELEASE-p14)
All the og-* machines just have a running copy of tomcat.
I built a simple test to catch the error with python/fabric... the test is:
fab -R ENV,OG,OG-PROD -- date | awk -F ': ' '/2016/{print $2, $1}'
which simply run the command "date" on all hosts.
So, the result is:
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 17:38:00 CEST 2016 [envrm02] out
Thu Apr 7 17:38:00 CEST 2016 [og-qa] out
Thu Apr 7 17:38:00 CEST 2016 [og-ci] out
Thu Apr 7 17:38:00 CEST 2016 [og-test] out
Thu Apr 7 17:38:00 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:38:00 CEST 2016 [envrm02] out
Thu Apr 7 18:45:10 CEST 2016 [og-qa] out
Thu Apr 7 18:38:00 CEST 2016 [og-ci] out
Thu Apr 7 18:38:00 CEST 2016 [og-test] out
Thu Apr 7 18:38:00 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:41:05 CEST 2016 [envrm02] out
Thu Apr 7 18:48:15 CEST 2016 [og-qa] out
Thu Apr 7 18:41:05 CEST 2016 [og-ci] out
Thu Apr 7 18:41:05 CEST 2016 [og-test] out
Thu Apr 7 18:41:05 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:46:51 CEST 2016 [envrm02] out
Thu Apr 7 18:46:52 CEST 2016 [og-qa] out
Thu Apr 7 18:46:52 CEST 2016 [og-ci] out
Thu Apr 7 18:46:53 CEST 2016 [og-test] out
Thu Apr 7 18:46:53 CEST 2016 [og-prod-rm] out
The configuration is the same for all hosts and is this:
@Mac-mini ~/p/f/> fab -R ENV,OG,OG-PROD -- cat /etc/rc.conf | grep ntpd
[envrm02] out: ntpd_enable="YES"
[og-qa] out: ntpd_enable="YES"
[og-qa] out: ntpd_sync_on_start="YES"
[og-ci] out: ntpd_enable="YES"
[og-ci] out: ntpd_sync_on_start="YES"
[og-test] out: ntpd_enable="YES"
[og-test] out: ntpd_sync_on_start="YES"
[og-prod-rm] out: ntpd_enable="YES"
[og-prod-rm] out: ntpd_sync_on_start="YES"
@Mac-mini ~/p/f/> fab -R ENV,OG,OG-PROD -- cat /etc/ntp.conf | grep -v 'out: #'
[envrm02] Executing task ''
[envrm02] run: cat /etc/ntp.conf
[envrm02] out:
[envrm02] out: server 0.freebsd.pool.ntp.org iburst
[envrm02] out: server 1.freebsd.pool.ntp.org iburst
[envrm02] out: server 2.freebsd.pool.ntp.org iburst
[envrm02] out:
[envrm02] out: restrict default limited kod nomodify notrap nopeer noquery
[envrm02] out: restrict -6 default limited kod nomodify notrap nopeer noquery
[envrm02] out: restrict 127.0.0.1
[envrm02] out: restrict -6 ::1
[envrm02] out: restrict 127.127.1.0
[og-qa] Executing task ''
[og-qa] run: cat /etc/ntp.conf
[og-qa] out:
[og-qa] out: server 0.freebsd.pool.ntp.org iburst
[og-qa] out: server 1.freebsd.pool.ntp.org iburst
[og-qa] out: server 2.freebsd.pool.ntp.org iburst
[og-qa] out:
[og-qa] out: restrict default limited kod nomodify notrap nopeer noquery
[og-qa] out: restrict -6 default limited kod nomodify notrap nopeer noquery
[og-qa] out: restrict 127.0.0.1
[og-qa] out: restrict -6 ::1
[og-qa] out: restrict 127.127.1.0
[og-ci] Executing task ''
[og-ci] run: cat /etc/ntp.conf
[og-ci] out:
[og-ci] out: server 0.freebsd.pool.ntp.org iburst
[og-ci] out: server 1.freebsd.pool.ntp.org iburst
[og-ci] out: server 2.freebsd.pool.ntp.org iburst
[og-ci] out:
[og-ci] out: restrict default limited kod nomodify notrap nopeer noquery
[og-ci] out: restrict -6 default limited kod nomodify notrap nopeer noquery
[og-ci] out: restrict 127.0.0.1
[og-ci] out: restrict -6 ::1
[og-ci] out: restrict 127.127.1.0
[og-test] Executing task ''
[og-test] run: cat /etc/ntp.conf
[og-test] out:
[og-test] out: server 0.freebsd.pool.ntp.org iburst
[og-test] out: server 1.freebsd.pool.ntp.org iburst
[og-test] out: server 2.freebsd.pool.ntp.org iburst
[og-test] out:
[og-test] out: restrict default limited kod nomodify notrap nopeer noquery
[og-test] out: restrict -6 default limited kod nomodify notrap nopeer noquery
[og-test] out: restrict 127.0.0.1
[og-test] out: restrict -6 ::1
[og-test] out: restrict 127.127.1.0
Some observation:
* The clock of envrm02 (the HOST) always seems to be correct.
* The issue happens on a (apparently) random guest (not always the same one).
* The issue happens always on one host at a time.
The bhyve command line is, roughly, this one:
/usr/sbin/bhyveload -m 2048 -d /san_storage/VMfs/$machine/$machine.img $machine
/usr/sbin/bhyve -c 2 -m 2048 -A -H -P -s 0,hostbridge -s
2,ahci-hd,/san_storag
bhyve clock jitter
Hi ...
I have a strange issue about the clock of some FreeBSD Bhyve guests,
maybe someone of you can help me to diagnose it and work on a solution.
In detail, sometimes (without an apparent regularity) one of four bhyve
guest's clock goes exactly 7 minutes and 10 seconds in the future.
This clock stays unaligned for about 20 minutes, then, without any human
intervention, the clock realign to proper condition.
My configuration is:
envrm02 (bhyve HOST, 10.2-RELEASE-p14)
-> og-qa (bhyve guest - 10.2-RELEASE-p14)
-> og-ci (bhyve guest - 10.2-RELEASE-p14)
-> og-test (bhyve guest - 10.2-RELEASE-p14)
-> og-prod-rm (bhyve guest - 10.2-RELEASE-p14)
All the og-* machines just have a running copy of tomcat.
I built a simple test to catch the error with python/fabric... the test
is:
fab -R ENV,OG,OG-PROD -- date | awk -F ': ' '/2016/{print $2, $1}'
which simply run the command "date" on all hosts.
So, the result is:
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 17:38:00 CEST 2016 [envrm02] out
Thu Apr 7 17:38:00 CEST 2016 [og-qa] out
Thu Apr 7 17:38:00 CEST 2016 [og-ci] out
Thu Apr 7 17:38:00 CEST 2016 [og-test] out
Thu Apr 7 17:38:00 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:38:00 CEST 2016 [envrm02] out
Thu Apr 7 18:45:10 CEST 2016 [og-qa] out
Thu Apr 7 18:38:00 CEST 2016 [og-ci] out
Thu Apr 7 18:38:00 CEST 2016 [og-test] out
Thu Apr 7 18:38:00 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:41:05 CEST 2016 [envrm02] out
Thu Apr 7 18:48:15 CEST 2016 [og-qa] out
Thu Apr 7 18:41:05 CEST 2016 [og-ci] out
Thu Apr 7 18:41:05 CEST 2016 [og-test] out
Thu Apr 7 18:41:05 CEST 2016 [og-prod-rm] out
@Mac-mini ~/p/f/> ./check_clock.sh
Thu Apr 7 18:46:51 CEST 2016 [envrm02] out
Thu Apr 7 18:46:52 CEST 2016 [og-qa] out
Thu Apr 7 18:46:52 CEST 2016 [og-ci] out
Thu Apr 7 18:46:53 CEST 2016 [og-test] out
Thu Apr 7 18:46:53 CEST 2016 [og-prod-rm] out
The configuration is the same for all hosts and is this:
@Mac-mini ~/p/f/> fab -R ENV,OG,OG-PROD -- cat /etc/rc.conf | grep ntpd
[envrm02] out: ntpd_enable="YES"
[og-qa] out: ntpd_enable="YES"
[og-qa] out: ntpd_sync_on_start="YES"
[og-ci] out: ntpd_enable="YES"
[og-ci] out: ntpd_sync_on_start="YES"
[og-test] out: ntpd_enable="YES"
[og-test] out: ntpd_sync_on_start="YES"
[og-prod-rm] out: ntpd_enable="YES"
[og-prod-rm] out: ntpd_sync_on_start="YES"
@Mac-mini ~/p/f/> fab -R ENV,OG,OG-PROD -- cat /etc/ntp.conf | grep -v
'out: #'
[envrm02] Executing task ''
[envrm02] run: cat /etc/ntp.conf
[envrm02] out:
[envrm02] out: server 0.freebsd.pool.ntp.org iburst
[envrm02] out: server 1.freebsd.pool.ntp.org iburst
[envrm02] out: server 2.freebsd.pool.ntp.org iburst
[envrm02] out:
[envrm02] out: restrict default limited kod nomodify notrap nopeer
noquery
[envrm02] out: restrict -6 default limited kod nomodify notrap nopeer
noquery
[envrm02] out: restrict 127.0.0.1
[envrm02] out: restrict -6 ::1
[envrm02] out: restrict 127.127.1.0
[og-qa] Executing task ''
[og-qa] run: cat /etc/ntp.conf
[og-qa] out:
[og-qa] out: server 0.freebsd.pool.ntp.org iburst
[og-qa] out: server 1.freebsd.pool.ntp.org iburst
[og-qa] out: server 2.freebsd.pool.ntp.org iburst
[og-qa] out:
[og-qa] out: restrict default limited kod nomodify notrap nopeer noquery
[og-qa] out: restrict -6 default limited kod nomodify notrap nopeer
noquery
[og-qa] out: restrict 127.0.0.1
[og-qa] out: restrict -6 ::1
[og-qa] out: restrict 127.127.1.0
[og-ci] Executing task ''
[og-ci] run: cat /etc/ntp.conf
[og-ci] out:
[og-ci] out: server 0.freebsd.pool.ntp.org iburst
[og-ci] out: server 1.freebsd.pool.ntp.org iburst
[og-ci] out: server 2.freebsd.pool.ntp.org iburst
[og-ci] out:
[og-ci] out: restrict default limited kod nomodify notrap nopeer noquery
[og-ci] out: restrict -6 default limited kod nomodify notrap nopeer
noquery
[og-ci] out: restrict 127.0.0.1
[og-ci] out: restrict -6 ::1
[og-ci] out: restrict 127.127.1.0
[og-test] Executing task ''
[og-test] run: cat /etc/ntp.conf
[og-test] out:
[og-test] out: server 0.freebsd.pool.ntp.org iburst
[og-test] out: server 1.freebsd.pool.ntp.org iburst
[og-test] out: server 2.freebsd.pool.ntp.org iburst
[og-test] out:
[og-test] out: restrict default limited kod nomodify notrap nopeer
noquery
[og-test] out: restrict -6 default limited kod nomodify notrap nopeer
noquery
[og-test] out: restrict 127.0.0.1
[og-test] out: restrict -6 ::1
[og-test] out: restrict 127.127.1.0
Some observation:
* The clock of envrm02 (the HOST) always seems to be correct.
* The issue happens on a (apparently) random guest (not always the same
one).
* The issue happens always on one host at a time.
The bhyve command line is, roughly, this one:
/usr/sbin/bhyveload -m 2048 -d /san_storage/VMfs/$machine/$machine.img
$machine
/usr/sbin/bhyve -c 2 -m 2048 -A -H -P -s 0,hostbridge -s
2,ahci-hd,/san_storage/VMfs
bhyve stuck
Hello everybody. I had () a VM doing some intense work over an volume that, on the host, is mapped on a iSCSI volume. After some hours of correct work the machine hang displaying… ahcich0: Timeout on slot 29 port 0 ahcich0: is cs ss f007 rs f007 tfd 50 serr cmd 1000c217 (ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 40 e2 b9 7e 40 38 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: Command timeout (ada0:ahcich0:0:0:0): Retrying command ahcich0: Timeout on slot 2 port 0 ahcich0: is cs ss 01fc rs 01fc tfd 50 serr cmd 1000c817 (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 00 e2 4e 3c 40 10 00 00 01 00 00 (ada0:ahcich0:0:0:0): CAM status: Command timeout (ada0:ahcich0:0:0:0): Retrying command ahcich0: Timeout on slot 8 port 0 ahcich0: is cs ss 7f00 rs 7f00 tfd 50 serr cmd 1000ce17 (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 00 e2 4e 3c 40 10 00 00 01 00 00 (ada0:ahcich0:0:0:0): CAM status: Command timeout (ada0:ahcich0:0:0:0): Retrying command ahcich0: Timeout on slot 14 port 0 ahcich0: is cs ss 001fc000 rs 001fc000 tfd 50 serr cmd 1000d417 (ada0:ahcich0:0:0:0): READ_FPDMA_QUEUED. ACB: 60 00 e2 4e 3c 40 10 00 00 01 00 00 (ada0:ahcich0:0:0:0): CAM status: Command timeout (ada0:ahcich0:0:0:0): Retrying command Assertion failed: (aior != NULL), function ahci_handle_dma, file /usr/src/usr.sbin/bhyve/pci_ahci.c, line 494. Now the VM is totally hang. Trying to kill bhyve doesn’t work, not even kill -9. I tries do to do a bhyvectl —destroy and the VM disappeared from /dev/vmm but I am strongly uncomfortable with what to do now. The process is still there. Can I restart the VM? Obviously I cannot restart the physical machine. This is the state of the process: root@environment-rm-01:/san_storage/VMfs/cloud31Slave # ps -ax | grep 91715 91715 5 T+ 1465:19.24 bhyve: cloud31Slave (bhyve) 18037 14 S+ 0:00.00 grep 91715 root@environment-rm-01:/san_storage/VMfs/cloud31Slave # procstat -t 91715 PID TID COMM TDNAME CPU PRI STATE WCHAN 91715 100129 bhyve mevent 2 120 stop - 91715 100246 bhyve blk-2:0 7 121 stop getblk 91715 100247 bhyve vtnet-4:0 tx 6 120 stop - 91715 100248 bhyve vcpu 0 8 120 stop - 91715 100249 bhyve vcpu 1 4 120 stop - root@environment-rm-01:/san_storage/VMfs/cloud31Slave # procstat -kk 91715 PID TID COMM TDNAME KSTACK 91715 100129 bhyve mevent mi_switch+0xe1 thread_suspend_check+0x317 ast+0x4f5 doreti_ast+0x1f 91715 100246 bhyve blk-2:0 mi_switch+0xe1 sleepq_wait+0x3a sleeplk+0x15d __lockmgr_args+0xc9e getblk+0x131 cluster_read+0xd0 ffs_read+0x1a9 VOP_READ_APV+0xa1 vn_read+0x165 vn_io_fault_doio+0x22 vn_io_fault1+0x7c vn_io_fault+0x18b dofileread+0x95 kern_preadv+0x92 sys_preadv+0x3a amd64_syscall+0x351 Xfast_syscall+0xfb 91715 100247 bhyve vtnet-4:0 tx mi_switch+0xe1 thread_suspend_check+0x317 ast+0x4f5 doreti_ast+0x1f 91715 100248 bhyve vcpu 0 mi_switch+0xe1 thread_suspend_check+0x317 ast+0x4f5 doreti_ast+0x1f 91715 100249 bhyve vcpu 1 mi_switch+0xe1 thread_suspend_switch+0x170 thread_single+0x357 sigexit+0x4e postsig+0x361 ast+0x427 Xfast_syscall+0x160 root@environment-rm-01:/san_storage/VMfs/cloud31Slave # kill -CONT 91715 root@environment-rm-01:/san_storage/VMfs/cloud31Slave # kill -9 91715 root@environment-rm-01:/san_storage/VMfs/cloud31Slave # ps -ax | grep 91715 91715 5 T+ 1465:19.24 bhyve: cloud31Slave (bhyve) 18041 14 S+ 0:00.00 grep 91715 --- Andrea Brancatelli ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: bhyve stuck
Hello Peter. The host is a FreeBSD 10.1-p3. I tried to restart the VM, but it hung after bhyveload. I had to reboot the physical host and what's worst is that the MySQL instance inside of the VM was trashed. Luckily I has backups. Sent from my iPad On 07/gen/2015, at 18:45, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, Assertion failed: (aior != NULL), function ahci_handle_dma, file /usr/src/usr.sbin/bhyve/pci_ahci.c, line 494. Ok - this should result in the bhyve process exiting. Now the VM is totally hang. Trying to kill bhyve doesn’t work, not even kill -9. I tries do to do a bhyvectl —destroy and the VM disappeared from /dev/vmm but I am strongly uncomfortable with what to do now. The process is still there. Can I restart the VM? It should be fine to restart after a bhyvectl --destroy This is the state of the process: ... 91715 100246 bhyve blk-2:0 7 121 stop getblk This seems to be the culprit. What's the version of FreeBSD running on the host ? tychon@ did quite a bit of work recently on making the block layer more robust in the face of guest controller timeouts. This made it in to CURRENT as of r274330, and was MFCd to 10-STABLE with r276429. That change may help with your issue. later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: bhyve machine not starting after upgrading
Type '?' for a list of commands, 'help' for more detailed help.
OK show
LINES=24
boot_serial=1
console=userboot
currdev=zfs:repository:
interpret=OK
loaddev=zfs:repository:
prompt=${interpret}
rootdev=disk0p2
smbios.bios.vendor=BHYVE
OK
How about if you set loaddev to disk0p2, and see if that allows a boot ?
“loaddev seems to be a read only property… :(
Another solution, though not pretty, is to build a version of userboot that
doesn't have ZFS enabled. Modify sys/boot/userboot/userboot/Makefile and
remove the MK_ZFS section, and copy userboot.so from the build to
/boot/userboot.so and the host. This should give you back the behaviour from
10.0.
OK, I had no sources to compile so I did a very bad thing and I know I’ll go in
hell for this but…
I copied userboot.so from another FreeBSD 10.0 machine and substituted
/boot/userboot.so from the host. Restarted the VM and it worked like a charm.
You’re going to fix this before 10.1 final, RIGHT?? :-)
Do you think this modification may result in a non-booting host machine?
___
freebsd-virtualization@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
To unsubscribe, send any mail to
freebsd-virtualization-unsubscr...@freebsd.org
Clock in bhyve
Hello everybody. I have a stupid question for you :) Is the clock in bhyve virtual or just a hook the host? I mean, should I run ntpd inside the VMs as I would do, let's say, with VMWare, or is it enough to run it on the host? -- Andrea Brancatelli ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
bhyve core dump...
Hello guys. I was installing mysql56 in a freebsd10 inside freebsd 10 and while doing the install the machine bombed out. In the console this is what I got: Assertion failed: (aior != NULL), function ahci_handle_dma, file /usr/src/usr.sbin/bhyve/pci_ahci.c, line 445. Abort trap (core dumped) The VM was calculating the SHA256 of the distfile when it bombed out. Nothing else was going on inside the VM at that time. I even have the .core if it matters. Any idea? -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
bhyvectl
I just throw away at least one hour because I was running bhyvectl destroy --vm=something instead of bhyvectl --destroy --vm=something. Bhyvectl just silently ignored the wrong destroy instead of --destroy. Maybe it's worth printing out something in such circumstances??? :-) Thanks... -- *Andrea Brancatelli* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
bhyve upgrade
Hello all, given that I'm not confortable with unofficial upgrades, I was wondering if, say, a 10-p1 would contain any new bhyve upgrade or should we wait for an official 10.1 ? -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
bhyve - vm shutdown
Tonight we forgot a freebsd vm in shutdown state - i mean, we run shutdown -p now and the VM stopped at the press enter to reboot. Nobody pressed enter because we forgot, so the bhyve process kept running, this morning we realized that the host's CPU kept 120% all the night long, until we just pressed enter in the vm console and the vm shut down. It was the only VM running. 2 CPU, no -P, standard command line, usual FreeBSD 10's plain bhyve. Maybe it's worth checking? p.s.: we almost finished round 2 of tests for bhyve vs esxi, I hope today we'll publish the results. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
BHyVe - ESXi comparison
Hello everybody. We did a very rough comparison betweend BHyVe and VMWare ESXi. Maybe you want to give it a read and let me know if I did write a bunch of sh!t :-) http://andrea.brancatelli.it/2014/01/28/freebsd-10-0-bhyve-vmware-esxi-5-5-comparison/ I must say I'm very pleased with BHyVe performances! Very good work!! Thanks for your time. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
Yes, I tried to emphasized that both at the beginning and at the end of the post... On Tue, Jan 28, 2014 at 12:39 PM, Matthias Gamsjager mgamsja...@gmail.comwrote: And lets not forget the head start vmware has (bhyve is what? 1-2 years old?) and the size of it. Less then 1mb in code. On Tue, Jan 28, 2014 at 12:27 PM, Łukasz Wąsikowski luk...@wasikowski.net wrote: W dniu 2014-01-28 12:18, Andrea Brancatelli pisze: We did a very rough comparison betweend BHyVe and VMWare ESXi. Maybe you want to give it a read and let me know if I did write a bunch of sh!t :-) http://andrea.brancatelli.it/2014/01/28/freebsd-10-0-bhyve-vmware-esxi-5-5-comparison/ I must say I'm very pleased with BHyVe performances! Very good work!! Thanks for your time. You've wrote: BHyVe took 332 seconds VMWare took 313 seconds The difference is about 106.7%. I think that the correct conclusion should state: if we assume VMware's time as a reference than BHyVe was 6.7% slower (not 106.7%). And it should be 6,41% really :) -- best regards, Lukasz Wasikowski ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
Fixed, thanks. On Tue, Jan 28, 2014 at 1:16 PM, Mark Martinec mark.martinec+free...@ijs.si wrote: http://andrea.brancatelli.it/2014/01/28/freebsd-10-0-bhyve- vmware-esxi-5-5-comparison/ the seconds you see is a medium of all the values from the different machines medium??? A median or an average? If you have any question on the datas Plural of datum is data, not datas. Mark ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization- unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
I'd have to find a different workload (compiling a port under linux makes no sense), but that something I was already thinking about. Anybody has any idea about that? It must be something that get's done the same way (so for example if we are compiling it has to be gcc vs. gcc, but gcc is not the same on the two platforms)... I don't know...? Any benchmarking suite? But I don't want to benchmark the OS that is in the middle... On Tue, Jan 28, 2014 at 3:57 PM, Lars Engels lars.eng...@0x20.net wrote: Am 2014-01-28 13:21, schrieb Andrea Brancatelli: Fixed, thanks. Could you also compare two instances of Linux inside bhyve and VMware? ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization- unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
Oh sorry you mean linux vs. linux! Then yes, I can do that! On Tue, Jan 28, 2014 at 4:02 PM, Andrea Brancatelli abrancate...@schema31.it wrote: I'd have to find a different workload (compiling a port under linux makes no sense), but that something I was already thinking about. Anybody has any idea about that? It must be something that get's done the same way (so for example if we are compiling it has to be gcc vs. gcc, but gcc is not the same on the two platforms)... I don't know...? Any benchmarking suite? But I don't want to benchmark the OS that is in the middle... On Tue, Jan 28, 2014 at 3:57 PM, Lars Engels lars.eng...@0x20.net wrote: Am 2014-01-28 13:21, schrieb Andrea Brancatelli: Fixed, thanks. Could you also compare two instances of Linux inside bhyve and VMware? ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization- unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio Unico Responsabile IT ROMA - FIRENZE - PALERMO ITALY Tel: +39. 06.98.358.472* *Cell: +39 331.2488468 Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA * -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
Hello Peter, unfortunately we've been a bit sloppy in tracking the time output because initially it was just an internal test, thus we don't have the details. We're setting up a new round of tests we'll run tomorrow and we'll track user/system/real in a more precise way; I will also publish a graph with the three stacked piles. Hyperthreading should hopefully be enable on the host, frankly I didn't check it out, I will tomorrow. KVM and QEMU are a bit out of our scope, so we didn't have plans for that. If I can fine some spare time we'll try. On Tue, Jan 28, 2014 at 5:10 PM, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, We did a very rough comparison betweend BHyVe and VMWare ESXi. Maybe you want to give it a read and let me know if I did write a bunch of sh!t :-) Looks good to me :) Thanks for running the tests. Would you be able to list the command options you used with bhyve when running these tests ? What I couldn’t really understand (but that’s something not related to bhyve or VMWare) is how a multiprocessor machine is slower than a singleprocessor machine in doing the compilation… any idea? Is hyper-threading enabled on your system ? If not, then with a host only having 2 CPUs and a 2 vCPU guest, there isn't as much opportunity to overlap host i/o threads with vCPU threads. It would be interesting to see your time results when running bhyve to show %user/%system etc - that may give an indication of how much time is spent on 'overhead' CPU usage as opposed to pure vCPU usage. 20 VM – 2 CPUs – 2GB RAM Interesting result to say the least :) I'll try and repro this and see if it's something simple. At first guess I'd say it's the classic 'lock-holder-preemption' issue that the ESXi scheduler has a lot of smarts to avoid. Another interesting test would be Qemu/KVM VMs on Linux to see if it has the same issue. later, Peter. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
Unfortunately these are pre-production environments thus installing something fancy wasn't in our scope. If I can allocate some time and some hardware I'll try to. On Tue, Jan 28, 2014 at 5:49 PM, Neel Natu neeln...@gmail.com wrote: Hi Andrea, On Tue, Jan 28, 2014 at 3:18 AM, Andrea Brancatelli abrancate...@schema31.it wrote: Hello everybody. We did a very rough comparison betweend BHyVe and VMWare ESXi. Maybe you want to give it a read and let me know if I did write a bunch of sh!t :-) Looks good to me :-) http://andrea.brancatelli.it/2014/01/28/freebsd-10-0-bhyve-vmware-esxi-5-5-comparison/ I must say I'm very pleased with BHyVe performances! Very good work!! Thanks for your time. Could you see if you can reproduce the hang with 20VMs with the host running FreeBSD current? Another thing you could do is compile the host with KTR and then when you see the hangexecute the following command on the host: sudo ktrdump -crto /tmp/ktrdump.out kernel options to enable KTR: options KTR options KTR_ENTRIES=(4*1024*1024) options KTR_MASK=(KTR_GEN) best Neel -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
OK, tomorrow I'll check. Today we tried the standard compile approach, compiling PERL to have something that would work at least a few minutes. To give you a fast anticipation, debian on bhyve took 2 minutes 23, while debian on vmware took 2 minutes and 7 seconds. Will update my post tomorrow morning with more details. On Tue, Jan 28, 2014 at 5:39 PM, Michael Berman michael.ber...@tidalscale.com wrote: parsec and stresslinux may be of interest. On 1/28/14, 7:02 AM, Andrea Brancatelli abrancate...@schema31.it wrote: I'd have to find a different workload (compiling a port under linux makes no sense), but that something I was already thinking about. Anybody has any idea about that? It must be something that get's done the same way (so for example if we are compiling it has to be gcc vs. gcc, but gcc is not the same on the two platforms)... I don't know...? Any benchmarking suite? But I don't want to benchmark the OS that is in the middle... On Tue, Jan 28, 2014 at 3:57 PM, Lars Engels lars.eng...@0x20.net wrote: Am 2014-01-28 13:21, schrieb Andrea Brancatelli: Fixed, thanks. Could you also compare two instances of Linux inside bhyve and VMware? ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization- unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
That's a lot of interesting input. Tomorrow we'll rearrange everything and redo all the testing. On Tue, Jan 28, 2014 at 9:50 PM, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, unfortunately we've been a bit sloppy in tracking the time output because initially it was just an internal test, thus we don't have the details. No problems. We're setting up a new round of tests we'll run tomorrow and we'll track user/system/real in a more precise way; I will also publish a graph with the three stacked piles. Thanks, that'd be great. Some suggestions: if you're not already, I'd recommend using ahci-hd for disk images instead of virtio-blk. The AHCI emulation uses a thread for block i/o so won't block the VM on reads. Also, I'd recommend using a network login to the guest rather than running something from the console. The UART emulation in bhyve will result in a lot of VM exits, which can impact performance. later, Peter. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
BHyVe as non root
Hello, do you see any particolar problem (devices who need to have the owner changed, limitations of any kind...?) in running BHyVe as non-root? -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Bhyve infos about a vm
Is this thread moving to a try and guess? :-) Btw, this one doesn't work either. [root@environment-rm-01 ~]# ps -ax | grep bhyve 7942 0 R+ 2:49.28 bhyve: lin1 (bhyve) 7980 2 S+ 0:00.00 grep bhyve [root@environment-rm-01 ~]# mdconfig -lv [root@environment-rm-01 ~]# On Tue, Jan 14, 2014 at 8:25 PM, dte...@freebsd.org wrote: -Original Message- From: Andrea Brancatelli [mailto:abrancate...@schema31.it] Sent: Tuesday, January 14, 2014 9:27 AM To: Markiyan Kushnir Cc: freebsd-virtualization@freebsd.org Subject: Re: Bhyve infos about a vm I don't think so. I'm interested in seeing what ISO or IMG are attached i dont' see any such info here... mdconfig -lv ? -- Devin [root@environment-rm-01 /repository]# fstat -p `pgrep bhyve` USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root bhyve 4212 text /1044852 -r-xr-xr-x 318469 r root bhyve 4212 ctty /dev132 crw--w pts/3 rw root bhyve 4212 wd /repository 14 drwxr-xr-x 6 r root bhyve 4212 root / 2 drwxr-xr-x1024 r root bhyve 42120 /dev132 crw--w pts/3 rw root bhyve 42121 /dev132 crw--w pts/3 rw root bhyve 42122 /dev132 crw--w pts/3 rw root bhyve 42123 /dev138 crw--- vmm/lin1 rw root bhyve 42124 /repository 34 -rw-r--r-- 10737418240 rw root bhyve 42125 /dev140 crw---tap1 rw root bhyve 42126 /repository 45 -rw-r--r-- 652214272 rw root bhyve 42127 root bhyve 42128* pipe f80021dbf000 - f80021dbf160 0 rw root bhyve 42129* pipe f80021dbf160 - f80021dbf000 0 rw On Tue, Jan 14, 2014 at 5:54 PM, Markiyan Kushnir markiyan.kush...@gmail.com wrote: may be fstat -p `pgrep bhyve` would give you some info? -- Markiyan 2014/1/14 Andrea Brancatelli abrancate...@schema31.it: How should I see it with ps? [root@environment-rm-01 ~]# ps -aux | grep bhyve root 88142.4 0.0 4221912 60804 3 D+1:15PM 3:11.43 bhyve: lin3 (bhyve) root 61870.0 0.0 4221784 34900 0 D+ 11:09AM 0:52.81 bhyve: FreeBSD10.5RC5.img (bhyve) root 88630.0 0.0 18724 2156 4 S+1:22PM 0:00.00 grep bhyve root 80080.0 0.0 4221912 54324 2 D+ 12:50PM 0:48.50 bhyve: lin1 (bhyve) [root@environment-rm-01 ~]# cat /proc/6187/cmdline bhyve: FreeBSD10.5RC5.img I'm out of ideas... :) On Mon, Jan 13, 2014 at 8:29 PM, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, Whats the command to list all the attached devices to a vm? The only way currently is to list the bhyve command line using ps. Any preferences for how you'd like to see this ? later, Peter. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization- unsubscr...@freebsd.org _ The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Bhyve infos about a vm
How should I see it with ps? [root@environment-rm-01 ~]# ps -aux | grep bhyve root 88142.4 0.0 4221912 60804 3 D+1:15PM3:11.43 bhyve: lin3 (bhyve) root 61870.0 0.0 4221784 34900 0 D+ 11:09AM0:52.81 bhyve: FreeBSD10.5RC5.img (bhyve) root 88630.0 0.0 18724 2156 4 S+1:22PM0:00.00 grep bhyve root 80080.0 0.0 4221912 54324 2 D+ 12:50PM0:48.50 bhyve: lin1 (bhyve) [root@environment-rm-01 ~]# cat /proc/6187/cmdline bhyve: FreeBSD10.5RC5.img I'm out of ideas... :) On Mon, Jan 13, 2014 at 8:29 PM, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, Whats the command to list all the attached devices to a vm? The only way currently is to list the bhyve command line using ps. Any preferences for how you'd like to see this ? later, Peter. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Bhyve infos about a vm
I don't think so. I'm interested in seeing what ISO or IMG are attached i dont' see any such info here... [root@environment-rm-01 /repository]# fstat -p `pgrep bhyve` USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root bhyve 4212 text /1044852 -r-xr-xr-x 318469 r root bhyve 4212 ctty /dev132 crw--w pts/3 rw root bhyve 4212 wd /repository 14 drwxr-xr-x 6 r root bhyve 4212 root / 2 drwxr-xr-x1024 r root bhyve 42120 /dev132 crw--w pts/3 rw root bhyve 42121 /dev132 crw--w pts/3 rw root bhyve 42122 /dev132 crw--w pts/3 rw root bhyve 42123 /dev138 crw--- vmm/lin1 rw root bhyve 42124 /repository 34 -rw-r--r-- 10737418240 rw root bhyve 42125 /dev140 crw---tap1 rw root bhyve 42126 /repository 45 -rw-r--r-- 652214272 rw root bhyve 42127 root bhyve 42128* pipe f80021dbf000 - f80021dbf160 0 rw root bhyve 42129* pipe f80021dbf160 - f80021dbf000 0 rw On Tue, Jan 14, 2014 at 5:54 PM, Markiyan Kushnir markiyan.kush...@gmail.com wrote: may be fstat -p `pgrep bhyve` would give you some info? -- Markiyan 2014/1/14 Andrea Brancatelli abrancate...@schema31.it: How should I see it with ps? [root@environment-rm-01 ~]# ps -aux | grep bhyve root 88142.4 0.0 4221912 60804 3 D+1:15PM3:11.43 bhyve: lin3 (bhyve) root 61870.0 0.0 4221784 34900 0 D+ 11:09AM0:52.81 bhyve: FreeBSD10.5RC5.img (bhyve) root 88630.0 0.0 18724 2156 4 S+1:22PM0:00.00 grep bhyve root 80080.0 0.0 4221912 54324 2 D+ 12:50PM0:48.50 bhyve: lin1 (bhyve) [root@environment-rm-01 ~]# cat /proc/6187/cmdline bhyve: FreeBSD10.5RC5.img I'm out of ideas... :) On Mon, Jan 13, 2014 at 8:29 PM, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, Whats the command to list all the attached devices to a vm? The only way currently is to list the bhyve command line using ps. Any preferences for how you'd like to see this ? later, Peter. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Bhyve infos about a vm
Hello, Whats the command to list all the attached devices to a vm? Bhyctl --vm=vm0 --get-all seemsto write of funny but totally irrelevant info for an user (instead of a developer...) Is there a way to get a list of the attached devices, say virtio-blk, ethernet stuff... Andrea Brancatelli Schema31 ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Bhyve infos about a vm
Hello Peter. Funny but my ps doesn't seem to report it, it only shows bhyve vm0. Maybe it is because it was run as Bhyve vm0 \ -something \ -something Btw I think the bhyvectl is the candidate for this, maybe bhyvectl --vm=vm0 --get-devices ? Is devices the correct name for those parameters? Or maybe just --get-parms ? Thank you very much. Bhyve is coming on as a great project (performances are great!), we now just have to work a lot to make it friendly!!! Andrea Mr.SK Brancatelli On 13/gen/2014, at 20:29, Peter Grehan gre...@freebsd.org wrote: Hi Andrea, Whats the command to list all the attached devices to a vm? The only way currently is to list the bhyve command line using ps. Any preferences for how you'd like to see this ? later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Real Device with BHyve
Forgive me, but I can't understand what you mean. Are we talking of using something like /dev/cciss (just to say...) instead of /dev/da2 as the device shared with the VM? Won't the VM and the real system clash in using the same device? On Thu, Jan 2, 2014 at 9:29 PM, Nikolai Lifanov lifa...@mail.lifanov.comwrote: On 01/02/14 15:22, freebsd-virtualization-requ...@freebsd.org wrote: Hello everybody. I'm doing some experiments with bhyve on 10.0-RC3 and I got stuck at a certain point. I was trying to have a VM use a direct device (/dev/da2) instead of a disk image. I was trying it in order to understand if there was any real performance difference between using a raw drive or an image-disk on the same drive. Well, the machine starts ok but when the child FreeBSD starts installation something strange happens. When I get to the partitioning screen I can see the device avaiable as /dev/vtdb0 with the correct size and such. I choose autopartitioning, the installer writes the partition table but when it start to write /dev/vtdb0p2 a very cryptic error appears about being unable to write - sorry, did not write it down. The installer then stops. If I do a fdisk /dev/vtdb0 in the VM I can see the GPT partition being there. If I do a fdisk /dev/da2 on the host machine, I can see the GPT partition as well, but the VM just doesn't want to write on it. I even tried changing kern.geom.debugflags=16 as I thought the host machine could be locking somehow the drive, but that didn't seem to make any difference. I know it was a lame check but I was out of ideas. So I just wanted to understand if such a scenario is supposed to be supported What I was thinking of, for example, was of having an external iSCSI device connected on the hostmachine mapped as a virtual disk for a specific VM, in order to speed the VM disk performances. Just another quick question... I have seen some improvements by having the VM's virtual disk on ZFS against UFS. Is it just me or is there any real improvement by using ZFS? Thanks a lot. -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Societ? del Gruppo SC31 ITALIA* I'm not answering your question precisely, but can you pass through the disk controller to the virtual machine instead? I also know that zvol and iscsi backends work, at least the last time I checked. - Nikolai Lifanov ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org -- *Andrea BrancatelliSchema 31 S.r.l. - Socio UnicoResponsabile ITROMA - FIRENZE - PALERMO ITALYTel: +39. 06.98.358.472* *Cell: +39 331.2488468Fax: +39. 055.71.880.466Società del Gruppo SC31 ITALIA* ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
