Re: UEFI -l com1, stdio floods console/Windows Server SAC with "rdmsr to register 0x198 on vcpu..."
On 1/17/21 1:21 AM, Peter Grehan wrote: Can the "rdmsr to register 0x198 on vcpu..." and similar messages on a -l com1,stdio console when using UEFI firmware be redirected or suppressed? The -w flag does not silence them, assuming, perhaps incorrectly, they are unsupported MSRs. If redirected, should these be logged? Please file a PR (https://www.freebsd.org/support/bugreports.html) A simple workaround is to use an nmdm or pty device for com1 output. PR filed and indeed! https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=252768 All the best, Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
UEFI -l com1,stdio floods console/Windows Server SAC with "rdmsr to register 0x198 on vcpu..."
Hello all, Can the "rdmsr to register 0x198 on vcpu..." and similar messages on a -l com1,stdio console when using UEFI firmware be redirected or suppressed? The -w flag does not silence them, assuming, perhaps incorrectly, they are unsupported MSRs. If redirected, should these be logged? Thank you! Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: VM Panic with FreeBSD-13.0-CURRENT-362037-amd64-vm.raw
On 6/12/20 9:56 PM, Michael Dexter wrote: The official FreeBSD snapshot FreeBSD-13.0-CURRENT-362037-amd64-vm.raw appears to panic as a guest under 12.1p5 and 12.1p1. A participant on #bhyve reports that this revision may fix it: https://svnweb.freebsd.org/base?view=revision=date=362065 They had luck with 6 and 8 vCPUs, but that didn't work for me. Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
VM Panic with FreeBSD-13.0-CURRENT-362037-amd64-vm.raw
Hello, The official FreeBSD snapshot FreeBSD-13.0-CURRENT-362037-amd64-vm.raw appears to panic as a guest under 12.1p5 and 12.1p1. Boot syntax: sh /usr/share/examples/bhyve/vmrun.sh -c 1 -t tap0 -d vm I have tried it with one and two vCPUs, and the -a and -A flags to vmrun.sh. Most boots panic at: btext() at btext+0x2c KDB: enter: panic Some get to this until destroyed externally: Trying to mount root from ufs:/dev/gpt/rootfs [rw]... Assertion failed: (error == 0), function emulate_inout, file /usr/src/usr.sbin/bhyve/inout.c, line 232. Abort trap I have tried both the unmodified image and it truncated to 10G. Full output below. Any suggestions? Thank you! Michael Dexter Loading kernel... /boot/kernel/kernel text=0x15a2f10 data=0x140 data=0x1b7f58+0x4470a8 syms=[0x8+0x17bb60+0x8+0x19bc58] Loading configured modules... can't find '/boot/entropy' can't find '/etc/hostid' GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT-362037 #0 r362037: Fri Jun 12 19:15:16 PDT 2020 root@update:/pub/build/362037/obj/pub/build/362037/src/amd64.amd64/sys/GENERIC amd64 FreeBSD clang version 10.0.1 (g...@github.com:llvm/llvm-project.git llvmorg-10.0.1-rc1-0-gf79cd71e145) WARNING: WITNESS option enabled, expect reduced performance. VT: init without driver. CPU: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz (2593.44-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0x9f83fbff Features2=0x9e9e6217 AMD Features=0x24100800 AMD Features2=0x1 Structured Extended Features3=0x400 XSAVE Features=0x1 TSC: P-state invariant Hypervisor: Origin = "bhyve bhyve " real memory = 536870912 (512 MB) avail memory = 478793728 (456 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: < > kernel trap 12 with interrupts disabled Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x0 fault code = supervisor read data, page not present instruction pointer = 0x20:0x80c23677 stack pointer = 0x28:0x8211db90 frame pointer = 0x28:0x8211db90 code segment= base 0x0, limit 0xf, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags= resume, IOPL = 0 current process = 0 () trap number = 12 panic: page fault cpuid = 0 time = 1 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0x8211d840 vpanic() at vpanic+0x182/frame 0x8211d890 panic() at panic+0x43/frame 0x8211d8f0 trap_fatal() at trap_fatal+0x387/frame 0x8211d950 trap_pfault() at trap_pfault+0x99/frame 0x8211d9b0 trap() at trap+0x2a5/frame 0x8211dac0 calltrap() at calltrap+0x8/frame 0x8211dac0 --- trap 0xc, rip = 0x80c23677, rsp = 0x8211db90, rbp = 0x8211db90 --- topo_promote_child() at topo_promote_child+0x7/frame 0x8211db90 topo_probe() at topo_probe+0x3e2/frame 0x8211dc40 cpu_mp_start() at cpu_mp_start+0x2dc/frame 0x8211dc50 mp_start() at mp_start+0x9a/frame 0x8211dc60 mi_startup() at mi_startup+0xec/frame 0x8211dcb0 btext() at btext+0x2c KDB: enter: panic [ thread pid 0 tid 0 ] Stopped at kdb_enter+0x37: movq$0,0x10c8846(%rip) db> [1] 0:bhyve* "update" 20:04 12-Jun-20 ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: ARMv8 development board with GICv3
On 6/13/18 12:37 AM, Rodney W. Grimes wrote: I believe the Chromebook SNOW meets the criteria, not exactly a "board" but I have one on loan from Michael Dexter that was originally purhased to support ARMv8 bhyve work. Peter Grehan handed one to Ruslan at AsiaBSDCon a few years back which led to basic FreeBSD support. "Spurious interrupts" soon became an issue with later versions of FreeBSD and I don't believe anyone has resolved it. This model was very much the one to get for its virtualization potential at a low price. Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
[Differential] D5473: ATA/ATAPI6 device emulation in bhyve
editor_callfortesting.org added a comment. In my testing, this appears to be based on FreeBSD 10.1, which is well supported by AHCI emulation. Supporting back to 5.0 or earlier would make this much more useful. REVISION DETAIL https://reviews.freebsd.org/D5473 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: iateaca, grehan, tychon, neel, mav Cc: editor_callfortesting.org, freebsd-virtualization-list ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
[Differential] D5473: ATA/ATAPI6 device emulation in bhyve
editor_callfortesting.org added a comment. iateaca, Several people would like to see this through. Please add a copyright and license to the work. Thanks! dexter REVISION DETAIL https://reviews.freebsd.org/D5473 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: iateaca, grehan, tychon, neel, mav Cc: editor_callfortesting.org, freebsd-virtualization-list ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
bhyvecon Tokyo 2017
Hello all, If you will be in Tokyo during AsiaBSDCon, you are welcome to attend the 4th annual bhyvecon, the only conference dedicated to BSD hypervisors. The growing list of talks includes: Roger Pau Monné: FreeBSD/Xen Status Report Mihai Carabas: FreeBSD bhyve/ARM Status Report Benedict Reuschling: Browser-based RDP, VNC, and SSH access using Guacamole Michael Dexter: FreeBSD bhyve/AMD64 Status Report More information is at http://bhyvecon.org I hope you can make it! Michael Dexter bhyve Volunteer ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve and bootable usb image
On 9/4/16 11:47 AM, Gabor Radnai wrote: I have a bootable usb image file which I would like to use as an installer medium under byhve, a Linux based stuff. Using dd to write image file to an usb stick and installing stuff from it works ok. However under bhyve accessing the image as ahci-hd or virtio-blk and using grub-bhyve, guest does not boot up. What is the proper way to use bootable image file? Will it work at all or it is not (yet) supported? Can someone please show me a how-to? What grub-bhyve and device.map syntax are you using for both? Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
[Differential] D5473: ATA/ATAPI6 device emulation in bhyve
editor_callfortesting.org added a comment. Support for FreeBSD 6 and older, even if for historical/academic purposes, is a topic that keeps coming up. Legacy systems come in all shapes and sizes and I can think of at least one point-of-sale vendor that spans generations of FreeBSD and other Unix systems. Is this code in a usable state? I think making it easy for the various interested parties to use it would better drive its direction. FYI: You can also use my account 'dexter' on this system. REVISION DETAIL https://reviews.freebsd.org/D5473 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: iateaca, neel, tychon, mav, grehan Cc: editor_callfortesting.org, freebsd-virtualization-list ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve graphics support
On 5/27/16 1:33 AM, Peter Grehan wrote: As of r300829, support for graphic output has been checked into the projects/bhyve_graphics branch... HUGE thanks to Leon and Peter for making this happen. We all owe them our gratitude as with all things bhyve, this is non-trivial code. There is a dedicated UEFI page on the wiki that would be suitable for the FAQ's that are starting to appear on this thread. I will sync it with Peter's original message and welcome others to contribute: https://wiki.freebsd.org/bhyve/UEFI I tested every major GNU/Linux distribution and a few variants and Windows up through 2016 TP5. The results have been great but I'm sure there are edge cases that need addressing. Please do test this with high CPU counts, RAM allocations and anything else you can think of. All the best, Michael Dexter ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
wiki.freebsd.org/bhyve feature matrix
Hello all, I have added a bhyve feature matrix/history to the official bhyve wiki page: https://wiki.freebsd.org/bhyve I cordially invite you to add or suggest what you consider to be key bhyve milestones, particular in 2015. Please file other tips and data as appropriate! Thank you, Michael ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
bhyvecon 2016 Tokyo Invitation
Dear list members and AsiaBSDCon attendees, The third annual bhyvecon Tokyo will take place March 11th just after the BSD Vendor Summit and is free of charge. Information and registration is at http://bhyvecon.org/ I hope to see you there and hope this message is not an intrusion! Michael Dexter bhyve Volunteer ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: docker info?
On 7/28/15 1:17 PM, Kegan Myers wrote: Make sure you have permissions. Docker isn't good at figuring out that you need sudo or other permissions to talk to the socket. Also, do make sure you are using a recent version of 11 CURRENT or a 10.2 BETA/RC. I do not know what errors will be thrown by older versions of FreeBSD with Linux images, though they will support FreeBSD images with some risk of ABI mismatch. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: docker info?
On 7/21/15 1:37 PM, Larry Rosenman wrote: When I try to run docker info (freshly installed): borg.lerctr.org /home/ler $ docker info Get http:///var/run/docker.sock/v1.19/info: EOF. Are you trying to connect to a TLS-enabled daemon without TLS? borg.lerctr.org /home/ler $ docker --tls info An error occurred trying to connect: Get https:///var/run/docker.sock/v1.19/info: tls: oversized record received with length 20527 borg.lerctr.org /home/ler $ Do you have the ca_root_nss package installed? Is the Docker daemon running? Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: xen_kernel, console and X11
On 5/4/15 7:24 AM, Roger Pau Monné wrote: Another user also reported a similar problem with Xen and X, and it was solved by the following patch: https://people.freebsd.org/~royger/0001-xen-introduce-a-newbus-function-to-allocate-unused-m.patch I got this built and installed and alas, the most I can get is a partial DomU boot with it always rebooting the Dom0 at a different stage of DomU boot. Note that it instantly panicked if the Dom0 has 8GB RAM which may relate to the 4GB mentioned in the patch. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: xen_kernel, console and X11
On 5/2/15 8:43 AM, Roman Bogorodskiy wrote: I'm having some problems with console. I'm wondering if it's possible to have X running on the same box running xen kernel? ... When I drop 'console=com1' from 'xen_cmdline', I cannot even see a login screen. All I can see is a black screen with a white cursor. From the Wiki document: Known Limitations Suppressed FreeBSD kernel messages during boot Inconsistent behavior under X11 Michael Dexter ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
wiki.freebsd.org/bhyve is now official
Hello all, I am posting to this list as a great many bhyve users and contributors are subscribed to it. I am pleased to report that wiki.freebsd.org/bhyve is now the official repository for miscellaneous bhyve information, specifically those topics that are not covered in the manual pages and the FreeBSD Handbook. The content at bhyve.org has been updated and merged into the previous /bhyve wiki page. The documentation team has been notified of this change and may choose to migrate it from the F.A.Q. format. The bhyve developers and I are discussing the future role of bhyve.org. One thought is to host even-more-miscellaneous bhyve-related content such as social media and videos. Thank you everyone who has contributed to this content. Michael Dexter bhyve Volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: CFT: vmrc Virtual Machine rc script
On 2/27/14 6:13 AM, Takuya ASADA wrote: Then I get an error: vm: provisioning VM openbsd6 /usr/local/vm//openbsd6/openbsd6.conf: 21: Syntax error: ( unexpected Note that because the OpenBSD VM is using a pre-made disk image, it will not support provision. You simply want start. Same as another images. Where this error coming from? From a typo on line 6: :( vm_console=nmdm rather than: vm_console=nmdm This is now fixed and thank you for testing it! Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: CFT: bhyve AMD snapshot
Willem, On 2/10/14 7:14 AM, Willem Jan Withagen wrote: I usually prefer to build my onw. So I tried that from a both basic 10-stable as well as the svn-url I got from Peter some time ago. But - building 10-stable did not give the amd svm stuff - building the previous svn-url on my 10-stable bombs out due to some missing net/ files. Need to rerun, to get the exact error. The snapshot was built from the SVM projects branch: http://svnweb.freebsd.org/base/projects/bhyve_svm/ I opted to build world with -j4 and kernel on -j2 on a dual-core system as per Glen Barber's suggestion of how he is building the official releases. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
CFT: bhyve AMD snapshot
Hello all, I have built and uploaded a bhyve SVM project branch snapshot of r261578 (February 4th, 2014, MFC @ r259205) that can be found at: http://mirrors.nycbug.org/pub/bhyve/r261578-svm/ Those with Barcelona class (http://en.wikipedia.org/wiki/AMD_10h) AMD hardware are invited to give this. So far I have had luck with my humble Athlon(tm) II Neo N36L Dual-Core Processor (1297.87-MHz K8-class CPU). All the best, Michael Dexter bhyve volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Report of my virtual network lab migrated from virtualbox to bhyve
On 2/8/14 1:57 PM, Aryeh Friedman wrote: Starting tomorrow (now that I got the evil empire OS out of the way) I am going to be adding both networking and storage... in that order but I plan to handle some low hanging things in storage before getting deep into networking like allowing any block device to be used (it is up to the host admin how they want to attach it all petitecloud will need is a /dev/ entry or a backing file [some remote storage solutions do present this way not just disk image files])... we do not preannounce features normally but since this is security related we felt it was important to answer with specific plans (no specific due date though since that is our primary reason for not preannouncing is avoiding missing promised dates)... long term see the draft of a white paper I posted a week or so here May I again suggest you take this type of message to a personal blog or the mailing list you suggested? http://lists.petitecloud.nyclocal.net/listinfo.cgi Your personal plans apply to you alone and not the FreeBSD operating system or its virtualization subsystems. You have posted 31 out of the 83 messages to date in February with the next closest person coming in at six messages and a total of 10 from the key bhyve developers on a list for all FreeBSD virtualization technologies. Please reconsider this strategy else a complaint will be registered with the list administrators. Michael Dexter bhyve volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Report of my virtual network lab migrated from virtualbox to bhyve
On 2/8/14 11:25 PM, Sami Halabi wrote: As long as its practical and related to the virtualizationn I think its okay. Correct but this has unfortunately not been the case. At least he provides a lot of info through his discussions. Off topic is off topic in accordance with the stated FreeBSD mailing list etiquette guidelines and you will find many corrections to his statements. Friend of yours? Michael Dexter bhyve volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: CFT: Very rough draft of PetiteCloud 0.2.4 (Linux as a host)
On 2/6/14 9:36 AM, Aryeh Friedman wrote: Due to scheduling reasons we decided to spin up a third instance at RootBSD dedicated to mail and our non open source work. We should have everything set up and ready to go in the next few days. But since I am always looking out for new tricks, thanks. This news does not, under any circumstances belong on a technical list relating to virtualization technologies in FreeBSD as per the project's published guidelines: http://www.freebsd.org/doc/en/articles/mailing-list-faq/etiquette.html#idp62859952 There are countless resources on the Internet to help you debug your systems and development work but this is not one of them. It is great that you have found bhyve useful and we all look forward to your bug reports, patches and success stories. So far you have inundated this list with broken download URL's, misnamed software archives, non-resolving hosts, proposals of marketing materials and my personal favorite, a request for a bhyve developer to sign an NDA to see these. Please hesitate before you write and determine if this is the correct list and your post is in accordance with the above policies. Michael Dexter bhyve volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: CFT: Very rough draft of PetiteCloud 0.2.4 (Linux as a host)
May I suggest you take this all to a personal blog? Michael On 2/2/14 2:22 PM, Aryeh Friedman wrote: Even though FreeBSD will always be my preferred OS for both personal and professional use it is sad to say in today's world if you do not support Linux and your run on Unix-like OS's then to everyone out side [insert favorite OS here] you don't exist. This is even more so for a effort like PetiteCloud that needs the widest possible user base to grow (the user base is what will attract apps which will attract more users and so forth). For the above reasons it is obvious that PetiteCloud *MUST* support linux as host or we simply are irrelevant to mainstream cloud computing users. It is likely less painful to do it now then later when we have more devices and drivers and such to have to sort out. Therefore I have posted a developer's snapshot of 0.2.4 with Linux hosting on the normal download link (don't worry the FreeBSD build still works fine). Take a look at the developers section of the site for details of how to install and test it. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: best way to add www to wheel
Wrong mailing list? Michael On 1/29/14 1:20 PM, Aryeh Friedman wrote: I have the following line in my pkg-install: pw groupmod wheel -m www The reason is I have files that are created by a user account that also gets made but are modified using it or tomcat... these particular files are shell scripts that must run as root (they are for controlling bhyve and other hyperv's as well as other rootly things like setting up and tarring down nic's) keep in mind also since almost all user level commands (including those that trigger rootly actions) are run via the web and that the data (except actual web content) should not be owned by www My gut says that the above while it works is almost certainly not the right way to do it. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: BHyVe - ESXi comparison
On 1/28/14 4:10 PM, Andrea Brancatelli wrote: That's a lot of interesting input. Do try the ahci-hd VirtIO and may I suggest you update BHyVe to the current bhyve? It is the first point on the FAQ: http://bhyve.org/faq/ Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
CFT: vmrc Virtual Machine rc script
Hello all, For the one-week anniversary of bhyve's release, I wish to share the next iteration of my virtual machine scripts that have evolved from a 2005 jail rc/disk image framework to a FreeBSD 9.0 bhyve binary and VM build script to a 10.* sequential provision script. It's primary purpose is to facilitate the exposure of bugs in bhyve and related FreeBSD components but you may find it useful for continuous VM use or for integration into your own scripts. Because bhyve is only the latest multiplicity solution on FreeBSD, this rc script includes basic jail and qemu support and could include chroot, simh and GXemul support. Of these, QEMU is intended to help prepare OSs like OpenBSD that require VirtIO and console adjustments prior to booting under bhyve. Synopsis: Unpack vmrc.tar Run 'sh install.sh' or perform the steps manually Verify your host_nic and host_zpool in /usr/local/etc/vm.conf /usr/local/etc/rc.d/vm(Show usage) /usr/local/etc/rc.d/vm provision vm0 (Note: /usr/local/vm/vm0/vm0.conf) (Fetches OS install media, formats disk, installs to disk) /usr/local/etc/rc.d/vm start vm0 (Loads and boots vm0) Alternatively: /usr/local/etc/rc.d/vm iso vm0(Fetches and boots and ISO image) ISO mode will prepare a disk image to install the OS to and includes fetch support for FreeBSD, Ubuntu and CentOS. Manual scripts exist in install/ to fetch FreeNAS, pfSense and OpenBSD. Status: Know issues and known desired features are at the end of instructions.txt plus various fix: notes throughout the script. This is not mature enough for packaging yet but does some things quite reliably and is ready for feedback. Because development is ongoing, I invite you to mail me about issues directly and I can post it to something like GitHub if there is interest. Please read the instructions.txt to avoid FAQ's and I have done my best to make the script itself readable. Site: http://bhyve.org/vmrc/ Download: http://bhyve.org/vmrc/vmrc.tar (latest version) Thank you Neel, Peter, John and Tycho for your hard work on bhyve. Thank you Devin for greatly improving this script and Allan at ScaleEngine for testing it and providing resources for bhyve's overall improvement. Thank you for testing bhyve! Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: bhyve with Xorg/kde
On 1/25/14 3:52 AM, Nicolas de Bari Embriz Garcia Rojas wrote: Hi, any idea of how to make Xorg + KDE run within an FreeBSD 10 instance running from bhyve? This is good reason to see what can and can't be done with PC-BSD/TrueOS under bhyve: http://iso.cdn.pcbsd.org/10.0-RELEASE/amd64/ Note that PC-BSD 10.0 is a great way to run bhyve given that it is is simply based on FreeBSD 10.0. Warden/bhyve integration is reportedly in the works along with FreeNAS 10.0 bhyve integration due in a month or two. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: rc.d scripts for starting BHyve from rc.d
On 1/23/14 8:01 PM, Aryeh Friedman wrote: Except for the consoles petitecloud does it much more smoothly... May I kindly suggest that you not use this list for PR or to slam the work of others? Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Public Service Announcement: The name is bhyve
On 1/24/14 2:53 AM, Michael Gmelin wrote: Recent bhyve progress is quite impressive by the way. The curse of making a list is... Tycho definitely deserves a huge thanks for his work and we all owe our thanks the original vendor that supported Neel and Peter's work on bhvye because they: 1. Wanted it to be a FreeBSD project, rather than a vendor project 2. They could have thrown it over the wall and not allowed the developers to make it more suitable for our needs on the outside 3. They could have gone with a more restrictive license 4. They could have gone open core 5. They could have patent-encumbered it at length This is a historic change of strategy in the world of open source. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Linux on BHyVe in 10.0-RELEASE
Here's what I've found so far: vmrun.sh does not like zvols and I am hoping for: sh vmrun.sh -m 1024 -d /dev/zvol/zroot/vm3 vm3 It gets as far as: Writing partition tables [In Progress ] Initializing ada0p2[ Failed ] I am trying to figure out why. What does work for me for FreeBSD VM's is to prepare /dev/zvol/zroot/vm3 using the bhyve-script approach and then boot it as usual. I will include this in an rc version of bhyve-script that I hope to release shortly. It may not be worth adding the functionality to bhyve-script as it is EOL. Michael On 1/22/14 11:26 PM, Jonas Bülow wrote: Yes, if using zvol is the same thing as using ZFS for the guest image. I tried setting DEVTYPE to with the same result. /J On Thu, Jan 23, 2014 at 8:16 AM, Peter Grehan gre...@freebsd.org wrote: Hi Jonas, Installation starts and everything looks good until it tries to install the grub boot loader. That last step fails. Exiting the installer and running: #sh lin1 start Gives a grub prompt. Any hints? Are you using a zvol for the guest disk image ? later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: [PATCH] Support for S5 (soft power off) in bhyve
On 12/27/13 8:46 AM, John Baldwin wrote: Can this be triggered from the host to shut down an unresponsive VM? It cannot. I will look into that. I've implemented this. You rock. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: [PATCH] Support for S5 (soft power off) in bhyve
John, This is awesome. Can this be triggered from the host to shut down an unresponsive VM? If so, syntax? Michael On 12/23/13 11:43 AM, John Baldwin wrote: To that end, I've implemented support for a few more registers (such of which are non-optional in ACPI) including the Reset Control register (0xcf9), ACPI Power Management 1 Event registers (PM1_EVT) and the ACPI Power Management 1 Control register (PM1_CNT). I added a valid _S5 package and catch writes of the value _S5 specifies to ask bhyve to exit gracefully but with an exit code of 1 (so the loop in vmrun terminates). ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Upcoming FreeBSD 10.x + bhyve ...
Marc, On 12/2/13 4:11 PM, Marc Fournier wrote: I just read through http://bhyve.org/bhyve-manual.txt, and one thing that doesn’t seem to be supported (or, I’ve missed it) is HeadLess support … I get the impression that using this on a remote server isn’t currently possible, or am I missing something in the docs? I have documented the null modem serial console access at bhyve.org/faq In short: -S 31,uart,stdio Becomes: -S 31,uart,/dev/nmdm0A Before starting the VM, run: kldload nmdm Start the VM but note that it will not display any output when booted. Connect to the serial interface with: cu -l /dev/nmdm0B -s 9600 nmdmN is a 32bit in so you should have plenty to work with. The pty style of console is more involved and I am experimenting with it. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: bhyve - non *bsd guests
On 11/26/13 8:04 PM, Scott Pilz wrote: Firstly I'd like to say thank you for those involved in the bhyve project. You're welcome! It has indeed come a long way and things are accelerating quickly. Hurah Neel and Peter. The error I'm getting is: VM unrestricted guest capability required Error in initializing VM That is a new one to me and given that you have FreeBSD VMs working, I personally don't know what might trigger this. I trust this is bare-metal and not under say, VMware nested VT-x? Hopefully the developers will chime in. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: RFD: Remote console access to bhyve guest instances?
Dee, Your needs are not unique and a solution is already in the works. Thank you for your use case examples and usability concerns. When you say write this addition, are you suggesting you have solid development resources to contribute to this effort? All the best, Michael Dexter bhyve Volunteer On 11/14/13 1:02 AM, Dee Nixon wrote: Problem scenario: A cloud provider (defined as someone who allows multiple end-users to create and manage their own guest instances without direct access to the host's operating system) needs to provide console access to each instance in a secure manner. If a cloud provider were to use bhyve in its current form, a cloud end-user could SSH into a guest instance, provided the instance is already installed and running, but the user could NOT do the following tasks, which can be performed only at the console: * OS installation * Recovering from a virtual “hardware” or OS failure * Rebooting a halted machine A cloud end-user needs to be able to perform the above tasks on a guest instance without compromising the security of the host. Thus the end-user needs access to a virtual guest “console” that enables the above tasks to be performed on a virtual machine – just as, on a physical machine, the above tasks could be performed via the physical machine's console. However, bhyve does not currently provide any means by which users can access a guest console without first logging into the host's console and/or performing some other task that is quite likely to have security issues. A few possible solutions: * Use some external program to pipe console I/O via a socket to the end-user? (but this would be hard to standardize) * Restricted login? (but this would have concurrency issues as to which user can access which guest instance) * Perhaps bhyve could add a console socket port for each guest instance? (Aryeh Friedman and I favor this idea, unless someone can suggest something better. If others think this is a good idea, we can write this addition to bhyve.) Does anyone have any other suggestions? The discussion of how to handle this problem should consider the following issues: * The solution must allow access to multiple guest consoles at once by multiple users * The solution must not require users of guest instances to have access to the host console, although these users may have limited access to the host by other means, such as SSH to a port dedicated to a specific guest. * The solution must not expose the host OS to other possible security issues either (remember, bhyve runs as root) * The solution must be scriptable. * A virtual machine should, as much as possible, behave like an actual physical machine in its interactions with its designated user, despite the user's lack of access to the host console. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Updated bhyve-script for FreeBSD, FreeNAS, pfSense, OpenBSD and Linux VMs
Hello all, I have posted an updated bhyve-script.tar to bhyve.org that collectively includes preliminary support for amd64 FreeNAS, pfSense, OpenBSD and Linux VMs in addition to FreeBSD 9, 10 and 11 ones. http://bhyve.org/bhyve-script.tar This is all experimental and you will probably encounter flaws from a myriad of sources such as your CPU clock speed in some cases or QA shortcomings for want of a larger pool of beta testers. Everything included in the set of scripts is designed to speed bhyve testing and provide ideas for configuration possibilities. If all requirements are met, you should be able to simply type as root: sh vm0 provision sh vm-hostprep.sh sh vm0 start ... and end up with a booting FreeBSD 11 VM on a 10-BETA2 or BETA3 host. Read the vm0 script for the documentation and customization options and I have included helper scripts such as vm-copy.sh to quickly make copies of a provisioned VM for stress testing. Reminder: bhyve requires Extended Page Tables (EPT) which accompany POPCNT in your dmesg and should available on any Intel Core i* CPU. Feedback welcome! Michael Dexter bhyve Volunteer ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Use of Floppy Drive with FreeBSD Virtual Machines
On 11/12/13 1:07 PM, Abhishek Gupta (LIS) wrote: Thanks for the response Michael! I understand now. Just wanted to let you know that Hyper-V Gen2 VMs do not have a virtual FDD. On the topic of passing a virtual FDD to a VM for a passed-through PCI* card BIOS update, a bhyve developer wrote: Strictly speaking, it depends on the device: some can restart with a function-level reset, but more than likely they would require a power-cycle, and most systems don't provide the ability to power-cycle an individual card. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Use of Floppy Drive with FreeBSD Virtual Machines
Abhishek, My single use case this last few years has been for BIOS updates and given that one could use PCI pass-through to expose say, an LSI storage controller to a virtual machine, there may indeed be a use case. Michael Dexter On 11/11/13 10:19 AM, Abhishek Gupta (LIS) wrote: Hi everyone, Is anybody using floppy disk drives with virtual machines on Hyper-V or any other hypervisor? I would be interested in knowing both common and obscure scenarios. Please let me know if you have any thoughts in this direction. Thanks, Abhishek Gupta Program Manager, BSD Integration Services Microsoft Corporation ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: Use of Floppy Drive with FreeBSD Virtual Machines
Hello Abhishek, On 11/11/13 11:37 AM, Abhishek Gupta (LIS) wrote: Thanks so much for replying. Some follow up questions: a) Is it not possible to use an ISO file to do the BIOS updates? I have not. b) I did not quite understand your second comment on why PCI pass through may promote floppy disk use. Please could you elaborate a bit more? The scenario I see the most is a virtualized (HyperV, VMware etc.) FreeNAS guest to which you pass a PCIe storage controller card to so that ZFS is given bare metal access to hardware disks yet has the benefit of the fast internal backplane if you will for networking, rather than going over copper or optical network interfaces. Because the FreeNAS guest may be one among many, it would not be desirable to reboot the whole system and boot to a floppy to apply a BIOS update to a PCIe controller card. Again, I have not tried anything like this but it is a possible use case of what you describe. Also mind you I never want to see another floppy-based BIOS again but they are still out there. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
rc-style script for bhyve VM provisioning and management
Hello all from the FreeBSD 20th Anniversary Party in San Francisco, I have published a bhyve virtual machine provisioning and management framework to simplify the building and deploying of bhyve VMs during the run-up to the FreeBSD 10.0 release. As you may know, bhyve is rapidly finalizing for release in FreeBSD 10.0 and most features are finally becoming stable enough to document in a canonical manner. These scripts demonstrate the many opportunities for customization of bhyve deployments and will embrace features like OpenBSD and Linux support as soon as key components like the userland grub* arrive (currently in final testing). It will also demonstrate the use of pf to allow bhyve networking on wireless interfaces. It can be downloaded from: http://bhyve.org/bhyve-script.tar It works like a rc script but does not comply with the FreeBSD way. I am working with several developers to determine to what degree it should be compatible with existing frameworks like ezjail. ./vm0 will give the usage: usage (start|stop|load|boot|destroy|restart|list|debug mount|umount|jail|format|fetch|install|provision|wipe) Some routines like provision include steps like fetch (distribution sets), format (disk images or volumes) and install them. The jail routine demonstrates how a virtual machine can be launched using the jail(8) command, because we can, given that bhyve FreeBSD VMs are simply instances of FreeBSD with the ABI limitations of different releases. bhyve will support any vision of FreeBSD with VirtIO, specifically FreeBSD 8.4 and 8-STABLE, 9.2 and 9-STABLE, and any recent version of 10 or 11. Detailed instructions are included in the vm0 script and it is designed to simply be copied to vm1, vm2 etc. with easily-configured global variables. While tmux(1) is optional and supports both captive and detached execution, a script is included to list and attach to running VMs/sessions. A script is also provided for the easy duplication of VMs and I have tested this with up to 15 X 16 vCPU instances though far more should work without issue. Please throw everything you can at bhyve to expose any remaining flaws prior to the FreeBSD 10.0 release. All the best, Michael Dexter ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: [SOLVED] Re: bhyve vmrum vm_setup_memory: Inappropriate ioctl for device
On 9/27/13 3:07 PM, Miguel Clara wrote: Btw, I guesss FreeBSD is the only guest type supported so far, are there plans for linux/windows? Whats the best place to get updates on this? Experimental Linux and OpenBSD soon. Windows to be determined. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: CFT: bhyve AMD SVM
On 8/25/13 1:04 AM, Jeremie Le Hen wrote: Please, avoid creating a new thread by following up another one and changing the subject. Or remove the In-Reply-To from your email. You are correct. Stale header info. Sorry. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
CFT: bhyve AMD SVM
Hello all, The r254677 commit to the FreeBSD bhyve SVM branch has significant AMD SVM/RVI improvements that deserve testing. http://svnweb.freebsd.org/base/projects/bhyve_svm/sys/?sortby=dateview=log Unofficial r254677 snapshots: USA: http://mirrors.nycbug.org/pub/bhyve/r254677-svm/ Europe: http://high5.nl/mirrors/bhyve/r254677-svm/ Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: installing 9.1-RELEASE guest on byhve
My mistake: 9-STABLE which is 9* (incl. 9.1) with VirtIO drivers. You can relatively easily backport VirtIO drivers to 9.1 if you really need 9.1 Yep. Linux and Windows support will be great and at least one is has been demonstrated. Michael On 6/23/13 5:34 PM, Aryeh Friedman wrote: This is a critical deficiency I need to be able to install *ANY* OS for what I have in mind. Note I do have 10-CURRENT up as a guest. I am attempting to use bhyve as the foundation of a cross platform testing lab and thus needs to support FB (8,9 and 10), Linux (Ubuntu 12.04 LTS at a min) and Windows. Also it is 9.1 not 9-RELEASE (I thought 9.1 was 9-RELEASE) On Sun, Jun 23, 2013 at 8:22 PM, Michael Dexter edi...@callfortesting.org wrote: On 6/23/13 4:52 PM, Aryeh Friedman wrote: I have byhve up and running on a 10-CURRENT machine and want to know the best way to install from CD 9.1 on it. Any references I should look at? You will need to install 9-CURRENT as 9.1 did not ship with VirtIO drivers. May I suggest: http://bhyve.org for information and installation scripts. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: installing 9.1-RELEASE guest on byhve
On 6/23/13 4:52 PM, Aryeh Friedman wrote: I have byhve up and running on a 10-CURRENT machine and want to know the best way to install from CD 9.1 on it. Any references I should look at? You will need to install 9-CURRENT as 9.1 did not ship with VirtIO drivers. May I suggest: http://bhyve.org for information and installation scripts. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: getting involved in bhyve projecct
On 1/3/13 4:41 AM, Harsh Bhatt wrote: I am very much interested and eager to get involved in bhyve project. I want to start with doing up something small initially. My strong parts are C and OS. So can someone suggest me what should i do and how i can get involved. Welcome! Testing is a great place to start because each person asks a question of it that no one else has thought of. Do you have it up and running? I have attempted to make this easy with the binaries and scripts at http://bhyve.org Non-FreeBSD experience is also welcome as we map out how to support other operating systems as guests. All the best, Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: question on bhyve + 9-stable
On 1/2/13 2:53 PM, Alfred Perlstein wrote: While the directions you and the rest of the bhyve developers put together were clear, comprehensive and well written... they still are a bit daunting for your average user... There-in is the challenge. You can try bhyve with simply a special snapshot and yes, user's will soon have it by default. Creating guests however opens up a can of worms of opportunities to tailor them to your needs. jail(8) is the same in this regard. I am however talking to Kris about integrating bhyve into PC-BSD's Warden so that there can be at least one turn-key experience out there. Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org
Re: question on bhyve + 9-stable
On 12/30/12 9:36 AM, marcos alves wrote: I also made a step-by step setup using zvols based on Michael Dexter's scripts. Maybe they will be usefull if you trying to understand or improve the scripts in the future. Check it out in http://www.emulsoft.com/bhyve-ufs.txt . I saw that. I didn't do more than a HelloWorld test of zvols and appreciate your input and experiences. I am hanging out in #bhyve on irc.freenode.net at the suggestion of a user. Happy New Year! Michael ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to freebsd-virtualization-unsubscr...@freebsd.org