Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[Jason Tubnor]

On 8 September 2017 at 00:28, Alan Somers  wrote:

>
>
> Do you have a semiautomated way to move bhyve instances between
> different hosts?  Without such a feature, we can't replace all of our
> ESXi machines.
>

We are not using bhyve for those workloads (yet).  Our vsphere environment
still has life left in it but we never want to bet on one horse (I've been
in too many positions where vendor lock has occurred and its been painful
and expensive).  However, where there are single hosts instances out at
remote branches, it is bhyve all the way where we use to use individual
instances of ESXi.

So for your use case, it isn't there yet, but, if you don't need live
migration, using zfs and/or iSCSI you could tool something together for
offline migration of guests between hosts.

Allowing you to get closer to the operating system (unlike the abstraction
that is vsphere/ESXi), gives you the ability to take the excellent tools
that FreeBSD has to offer and make them fit your application.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[Alan Somers]

On Wed, Sep 6, 2017 at 3:53 PM, Jason Tubnor  wrote:
> On 6 September 2017 at 22:15, tech-lists  wrote:
>
>>
>>
>> Have you encountered anything on openbsd in a bhyve that you've found
>> not to work?
>>
>>
> As Thomas mentioned, there is/was a bug with certain CPUs, but this was due
> to the strict checking of CPU features that OpenBSD introduced (
> https://marc.info/?l=openbsd-misc&m=149136173520510&w=2).  Peter explained
> the switch to get around that issue (-w).
>
> The only other thing is Jumbo frame support, but that is really down to
> limits in VirtIO and not really a show stopper and doesn't affect anything
> in production for us.
>
> Enjoy bhyve, it has been a drop in replacement for our individual ESXi
> instances and has been bulletproof, which is good as we have hypervisor
> hosts over 6 hour drives away! (Oh the uplift from 11.0 to 11.1 was done
> remotely without nuking the host).
>
> Cheers,
>
> Jason.

Do you have a semiautomated way to move bhyve instances between
different hosts?  Without such a feature, we can't replace all of our
ESXi machines.

-Alan
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[Jason Tubnor]

On 6 September 2017 at 22:15, tech-lists  wrote:

>
>
> Have you encountered anything on openbsd in a bhyve that you've found
> not to work?
>
>
As Thomas mentioned, there is/was a bug with certain CPUs, but this was due
to the strict checking of CPU features that OpenBSD introduced (
https://marc.info/?l=openbsd-misc&m=149136173520510&w=2).  Peter explained
the switch to get around that issue (-w).

The only other thing is Jumbo frame support, but that is really down to
limits in VirtIO and not really a show stopper and doesn't affect anything
in production for us.

Enjoy bhyve, it has been a drop in replacement for our individual ESXi
instances and has been bulletproof, which is good as we have hypervisor
hosts over 6 hour drives away! (Oh the uplift from 11.0 to 11.1 was done
remotely without nuking the host).

Cheers,

Jason.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[Jan Bramkamp]

On 06.09.17 17:45, tech-lists wrote:

On 06/09/2017 16:23, Jan Bramkamp wrote:

I'm running OpenBSD 6.1 (with two virtual CPU cores) as bhyve guest on
FreeBSD 11.1. The only problem I encountered is that it requires an
external grub bootloader because the OpenBSD EFI boot code is
incompatible with the bhyve EFI boot ROM.

Hi,

Which external grub bootloader did you use? Was it sysutils/grub2-bhyve ?
I use the sysutils/grub2-bhyve port to load the OpenBSD kernel and runit 
for process supervision to keep the bhyve guest running unless the bhyve 
exit code signals an intend to perform shutdown. This allows the VMs to 
reboot themselves.

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[tech-lists]

On 06/09/2017 16:23, Jan Bramkamp wrote:
> I'm running OpenBSD 6.1 (with two virtual CPU cores) as bhyve guest on
> FreeBSD 11.1. The only problem I encountered is that it requires an
> external grub bootloader because the OpenBSD EFI boot code is
> incompatible with the bhyve EFI boot ROM.

Hi,

Which external grub bootloader did you use? Was it sysutils/grub2-bhyve ?

thanks,
-- 
J.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[Jan Bramkamp]

On 05.09.17 19:21, tech-lists wrote:

Hello freebsd-virtualization@

[also cc'd to freebsd-current],

I'd like to run openbsd 6.0 or 6.1 guest under a 12-current bhyve
system. I'd like it to run two cpus, so to use the openbsd smp kernel. I
can see, from searching various mailing lists that there have been
issues in getting openbsd to boot. Have these issues been fixed?

Also, is there a howto for this? I found one here:
http://www.allanjude.com/bsd/virtualization-host-bhyve.html but there's
no date on the document, it's not on the official freebsd sites and so
have no idea if the information is still current.

I realise that HardenedBSD has fixed some issues with this, but I can't
easily change the host to that OS unfortunately.

thanks,
I'm running OpenBSD 6.1 (with two virtual CPU cores) as bhyve guest on 
FreeBSD 11.1. The only problem I encountered is that it requires an 
external grub bootloader because the OpenBSD EFI boot code is 
incompatible with the bhyve EFI boot ROM.

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: openbsd 6.0 or 6.1 guest on freebsd-12 (current) host

[tech-lists]

On 05/09/2017 22:56, Jason Tubnor wrote:
> I'm not sure of the exact issue you are referring to but I run a lot of
> OpenBSD 6.1 hosts under bhyve with GENERIC.MP .  You
> can use either the grub-bhyve style boot or UEFI, both work fine.
> 
> I have found the chyves framework (it is in packages) good for standing
> up and managing bhyve guests - with ZFS, especially for a team that are
> new to the platform.  You have to hack the following
> /usr/local/lib/chyves files:
> 
> chyves-guest-start
> chyves-properties
> chyves-resources
> 
> to get 6.1 to install and boot (I yet to push those patches upstream).
> 
> So to answer your question directly, there is currently no known issue
> in getting bhyve to run OpenBSD 6.1 on Intel or AMD platforms.  Enjoy!

Hi Jason, thanks for answering. I'll have a go at this. Up until now
I've run all my VMs longhand in a screen. Good to know openbsd works.
Have you encountered anything on openbsd in a bhyve that you've found
not to work?

thanks,
-- 
J.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"