Re: Bhyve and Ubuntu booting
On 2014-02-23 22:04, Willem Jan Withagen wrote: On 23-2-2014 18:26, Peter Grehan wrote: Against what current version did you merge/build the SVM branch? I'll either check that out, or try my subversion skills to see if that reduces the diff. My mistake - the sync was a r259205, which was from Dec 10 and predates the -w option (r259635, Dec 17). I manually added this patch... And then I can get 13.10 to boot. First I get 20* the msr ignore message, but now I in the installer. So you might want to put that in your SVM tree to get more mileage on the code in Linux envs. std-disclaimer: Running on AMD processor with SVM branch I've started the ubuntu install again, since last night it went into the dark hours. And my laptop shutdown the connection while I used console. So no recovery to the prompts :( Now I'm trying 2 Ubuntu installs: 13.10 12.04 And both run equally slow. And generate msr access that would otherwise be trapped. (running with 2 vCPUs, and 2G mem). From top: 67705 root 5 52 0 2081M 429M CPU1 1 74:38 147.66% bhyve: ubuntu-13.10 67881 root 5 52 0 2077M 194M CPU3 3 67:20 137.16% bhyve: ubuntu-12.04 And the load is always up in the 150% So obviously these 2 installers are doing a form sort of busy waiting? Are other people seeing the same on AMD cpus or on Intel CPUs? Thanx, --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 22:12, Peter Grehan wrote: >> On 23-2-2014 18:26, Peter Grehan wrote: Against what current version did you merge/build the SVM branch? I'll either check that out, or try my subversion skills to see if that reduces the diff. >>> >>> My mistake - the sync was a r259205, which was from Dec 10 and >>> predates the -w option (r259635, Dec 17). >> >> I manually added this patch... >> And then I can get 13.10 to boot. > > Great ! > >> First I get 20* the msr ignore message, but now I in the installer. > > Can you post the MSRs that were hit ? I'd be interested to see what > they are. This is the preamble before we get into the CD-installation. The process is really really slow, and consumes about 150% op CPU. aka 1,5 CPU --WjW rdmsr to register 0xc0010015 on vcpu 0 rdmsr to register 0xc0010112 on vcpu 0 rdmsr to register 0xc0010048 on vcpu 0 wrmsr to register 0xc0010048(0x400) on vcpu 0 rdmsr to register 0xc001102a on vcpu 0 wrmsr to register 0xc001102a(0) on vcpu 0 rdmsr to register 0xc0010140 on vcpu 0 rdmsr to register 0xc0010140 on vcpu 0 rdmsr to register 0xc001 on vcpu 0 rdmsr to register 0xc0010001 on vcpu 0 rdmsr to register 0xc0010002 on vcpu 0 rdmsr to register 0xc0010003 on vcpu 0 rdmsr to register 0xc0010004 on vcpu 0 wrmsr to register 0xc0010004(0x) on vcpu 0 rdmsr to register 0xc0010004 on vcpu 0 rdmsr to register 0xc0010048 on vcpu 1 wrmsr to register 0xc0010048(0x400) on vcpu 1 rdmsr to register 0xc001102a on vcpu 1 wrmsr to register 0xc001102a(0) on vcpu 1 rdmsr to register 0xc0010140 on vcpu 1 rdmsr to register 0xc0010140 on vcpu 1 rdmsr to register 0xc001001f on vcpu 1 wrmsr to register 0xc001001f(0x4000) on vcpu 1 rdmsr to register 0xc001001f on vcpu 0 wrmsr to register 0xc001001f(0x4000) on vcpu 0 rdmsr to register 0xc001103a on vcpu 0 Starting system log daemon: syslogd, klogd. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
> On 23-2-2014 18:26, Peter Grehan wrote: Against what current version did you merge/build the SVM branch? I'll either check that out, or try my subversion skills to see if that reduces the diff. My mistake - the sync was a r259205, which was from Dec 10 and predates the -w option (r259635, Dec 17). I manually added this patch... And then I can get 13.10 to boot. Great ! First I get 20* the msr ignore message, but now I in the installer. Can you post the MSRs that were hit ? I'd be interested to see what they are. So you might want to put that in your SVM tree to get more mileage on the code in Linux envs. I'll see if I can sync up to that point without messing anything up. Thanks for trying it out. later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 18:26, Peter Grehan wrote: >> Against what current version did you merge/build the SVM branch? >> I'll either check that out, or try my subversion skills to see if that >> reduces the diff. > > My mistake - the sync was a r259205, which was from Dec 10 and > predates the -w option (r259635, Dec 17). I manually added this patch... And then I can get 13.10 to boot. First I get 20* the msr ignore message, but now I in the installer. So you might want to put that in your SVM tree to get more mileage on the code in Linux envs. --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 17:35, Aryeh Friedman wrote: > > And I've seen discussions in other threads about reading/writing cpu > registers where some bits should be 0, but trap when being set > (Or something close to this...???) > > So it could again be due to the amdsrc tree differences? > > --WjW > > And again this is running on my AMD-board. > /dev/zvol/zfsroot/ubuntu is a 10G zvol > tap3 is created and up > and ./ubuntu-13.10.iso is the ubuntu server ISO suggested by Rudy. > > > 12.04.3 runs perfectly on the amd patch with no modification. are you > setting up the device map dir correctly? I've verbosely copied the scripts that Rudy has online. (Apart from using other names, and will review them again) Right I'll download that ubuntu one as well. --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
Against what current version did you merge/build the SVM branch? I'll either check that out, or try my subversion skills to see if that reduces the diff. My mistake - the sync was a r259205, which was from Dec 10 and predates the -w option (r259635, Dec 17). later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 18:09, Peter Grehan wrote: >> -w does not exist on my bhyve >> bhyve: illegal option -- w > > Hmmm, just checked and you're right. Looks like a mis-merge - this > change went into CURRENT in early December, and the most recent sync for > the SVM branch was from Jan 14 :( > > Now I'm wondering what else hasn't made it in :( Pervious time I tried diff between current and the SVM branch, but that was just a bit too much for me to sort out. If I feel up to it tonight, I'll go and digg some more, but big change it still is too much diff te really grasp. Against what current version did you merge/build the SVM branch? I'll either check that out, or try my subversion skills to see if that reduces the diff. --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
-w does not exist on my bhyve bhyve: illegal option -- w Hmmm, just checked and you're right. Looks like a mis-merge - this change went into CURRENT in early December, and the most recent sync for the SVM branch was from Jan 14 :( Now I'm wondering what else hasn't made it in :( later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 17:57, Peter Grehan wrote: >> It's a toy box here so if anything needs to be tested, worked out. >> Just let me know. And I'm willing to run the risk of lost work, because >> using the ignore option bites me > > You can try the "-w" option. Aryeh has reported that it works for him. -w does not exist on my bhyve bhyve: illegal option -- w --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
It's a toy box here so if anything needs to be tested, worked out. Just let me know. And I'm willing to run the risk of lost work, because using the ignore option bites me You can try the "-w" option. Aryeh has reported that it works for him. later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 17:40, Peter Grehan wrote: >> vm exit rdmsr 0xc0010015, cpu 0 >> --- >> >> And I've seen discussions in other threads about reading/writing cpu >> registers where some bits should be 0, but trap when being set >> (Or something close to this...???) >> >> So it could again be due to the amdsrc tree differences? > > It's Linux accessing different MSRs on AMD as opposed to Intel. There > is an option to ignore unknown MSRs with bhyve, but that probably > shouldn't be used on AMD systems until we've worked out if the MSRs need > to be emulated or not. Hopefully that will be in the next updated :) It's a toy box here so if anything needs to be tested, worked out. Just let me know. And I'm willing to run the risk of lost work, because using the ignore option bites me So if you want me to see how we fare, .. --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
vm exit rdmsr 0xc0010015, cpu 0 --- And I've seen discussions in other threads about reading/writing cpu registers where some bits should be 0, but trap when being set (Or something close to this...???) So it could again be due to the amdsrc tree differences? It's Linux accessing different MSRs on AMD as opposed to Intel. There is an option to ignore unknown MSRs with bhyve, but that probably shouldn't be used on AMD systems until we've worked out if the MSRs need to be emulated or not. Hopefully that will be in the next updated :) later, Peter. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
> And I've seen discussions in other threads about reading/writing cpu > registers where some bits should be 0, but trap when being set > (Or something close to this...???) > > So it could again be due to the amdsrc tree differences? > > --WjW > > And again this is running on my AMD-board. > /dev/zvol/zfsroot/ubuntu is a 10G zvol > tap3 is created and up > and ./ubuntu-13.10.iso is the ubuntu server ISO suggested by Rudy. > 12.04.3 runs perfectly on the amd patch with no modification. are you setting up the device map dir correctly? -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: Bhyve and Ubuntu booting
On 23-2-2014 15:57, Craig Rodrigues wrote: >> I'm also looking into running a Ubuntu vm. i want to test/use > zoneminder, and all my FreeBSD attempts run into trouble. >> So I'm also still looking for grub-bhyve. > > grub2-bhyve is in ports: http://www.freshports.org/sysutils/grub2-bhyve/ Yup, took me some time to realize that on this experimental box portsnap was not running nightly... > If you do a web search, you'll find several HOWTO articles for using it. > Recently, Rudy wrote a nice one: > http://lists.freebsd.org/pipermail/freebsd-virtualization/2014-February/002305.html I did have that, from his announcement, But trying to follow that, I get: --- freetest# bhyvectl --destroy --vm=ubuntu freetest# grub-bhyve -r cd0 -m ./device.map -M 2048 ubuntu GNU GRUB version 2.00 > [I select to install Ubuntu Server] freetest# bhyve -c 2 -m 2048M -H -P -A \ ? -s 0:0,hostbridge \ ? -s 1:0,lpc -s 2:0,virtio-net,tap3 \ ? -s 3,ahci-cd,ubuntu-13.10.iso -l com1,stdio \ ? -s 4,virtio-blk,/dev/zvol/zfsroot/ubuntu ubuntu vm exit rdmsr 0xc0010015, cpu 0 --- And I've seen discussions in other threads about reading/writing cpu registers where some bits should be 0, but trap when being set (Or something close to this...???) So it could again be due to the amdsrc tree differences? --WjW And again this is running on my AMD-board. /dev/zvol/zfsroot/ubuntu is a 10G zvol tap3 is created and up and ./ubuntu-13.10.iso is the ubuntu server ISO suggested by Rudy. ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
