Re: bhyve on AMD, linux and high load
On 22-5-2014 21:29, Nils Beyer wrote: > I suppose you start your bhyved Linux instances using the "-A" switch (ACPI > tables), right? If you feel interested, you can try to start them without the > "-A" switch. For me, the boot process is now stucked at "Calibrating delay > loop". As far as I understand, it probably has something to do with a borked > "jiffies" value and that has probably something to do with a borked "IRQ 0" > that modifes that "jiffies" value at every tick. Same here --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve on AMD, linux and high load
On 22-5-2014 21:29, Nils Beyer wrote: > Hi, > > Willem Jan Withagen wrote: >> I've just completed merging and patching with Anish patches... >> ONce that seems to run for my freebsd vm's, I'll start merging my >> patches. And hope that it still works. > > Sounds good. I've tried some Linux versions ranging from 2.6.32, 3.10.x, > 3.11.10 to 3.12.8 using an Anish's patched SVM+HEAD variant. They all > show the same behaviour being stucked during boot. > > I haven't tried your patches yet, though. Well I'm running Anish SVM+HEAD and I'm no longer able to my old FreeBSD vm's. And I can't even get vmrun.sh to build new ones It just doesn't show anything on the commandline output, even if I go: -l com1,stdio Strange part is that the Linux 14.04 VM just starts fine So I have a complete reverse situation. Linux runs, but I have a hard time getting FreeBSD to run. >> And best would be that the vlapic stuff gives a extra bit of speed, >> because we're not quite there yet. > > I suppose you start your bhyved Linux instances using the "-A" switch (ACPI > tables), right? If you feel interested, you can try to start them without the > "-A" switch. For me, the boot process is now stucked at "Calibrating delay > loop". As far as I understand, it probably has something to do with a borked > "jiffies" value and that has probably something to do with a borked "IRQ 0" > that modifes that "jiffies" value at every tick. Yes I use -A on all my boots. > But these are just wild guesses as I understand much too little about > kernels, virtualizing and stuff. I'm the last one suggesting that I know more that just a little bit, but I get by.. > For what it's worth, using an Intel i3 and without the "-A" switch, the > bhyved Linux instance just boots fine as it does with the "-A" switch. One of the reasons tinkering with AMD is that I don't have an i{3,5,7} cpus available. > BTW: you haven't the oppurtunity to try bhyve SVN on a Barcelona- or later > class Opteron, have you? Nope, just got a bunch of boards leftover from a previous project. And they are all: CPU: AMD Phenom(tm) II X6 1075T Processor (3013.83-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x100fa0 Family=0x10 Model=0xa Stepping=0 ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve on AMD, linux and high load
Hi, Willem Jan Withagen wrote: > I've just completed merging and patching with Anish patches... > ONce that seems to run for my freebsd vm's, I'll start merging my > patches. And hope that it still works. Sounds good. I've tried some Linux versions ranging from 2.6.32, 3.10.x, 3.11.10 to 3.12.8 using an Anish's patched SVM+HEAD variant. They all show the same behaviour being stucked during boot. I haven't tried your patches yet, though. > And best would be that the vlapic stuff gives a extra bit of speed, > because we're not quite there yet. I suppose you start your bhyved Linux instances using the "-A" switch (ACPI tables), right? If you feel interested, you can try to start them without the "-A" switch. For me, the boot process is now stucked at "Calibrating delay loop". As far as I understand, it probably has something to do with a borked "jiffies" value and that has probably something to do with a borked "IRQ 0" that modifes that "jiffies" value at every tick. But these are just wild guesses as I understand much too little about kernels, virtualizing and stuff. For what it's worth, using an Intel i3 and without the "-A" switch, the bhyved Linux instance just boots fine as it does with the "-A" switch. BTW: you haven't the oppurtunity to try bhyve SVN on a Barcelona- or later class Opteron, have you? Thanks again for all your work there. Looking forward to hearing your results... Regards, Nils ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve on AMD, linux and high load
On 2014-05-22 18:24, Nils Beyer wrote: Hi Willem, Willem Jan Withagen wrote: [...] With the new kernel, that is no longer the case. On a idle vm the CPU load is like 6-7% At the moment I'm running: linux-image-3.13.0-24-generic_3.13.0-24.46_amd64 Now, that looks promising. Is that with or without your own bhyve-/SVM-patches? If that's with your own patches, have you already integrated Anish's patches in them? I've started building a linux kernel like over a week ago So that is with my patches on the "basic" bhyve-svm. I've just completed merging and patching with Anish patches... ONce that seems to run for my freebsd vm's, I'll start merging my patches. And hope that it still works. And best would be that the vlapic stuff gives a extra bit of speed, because we're not quite there yet. I'll let you know how I fare --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: bhyve on AMD, linux and high load
Hi Willem, Willem Jan Withagen wrote: > [...] > With the new kernel, that is no longer the case. On a idle vm the CPU > load is like 6-7% > > At the moment I'm running: > linux-image-3.13.0-24-generic_3.13.0-24.46_amd64 Now, that looks promising. Is that with or without your own bhyve-/SVM-patches? If that's with your own patches, have you already integrated Anish's patches in them? Regards, Nils ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
bhyve on AMD, linux and high load
Hoi, Just a point on the timeline I think somebody asked why his CPU load was so high on AMD running linux. I've completed compiling a "fresh" linux-kernel on my Ubuntu 14.04 system, installed and rebooted it. And where previously a Linux-kernel would drain the CPUs it got assigned to the max... Aka 2 CPU would drive the load +2 and top would diskplay a 200% cpu. With the new kernel, that is no longer the case. On a idle vm the CPU load is like 6-7% At the moment I'm running: linux-image-3.13.0-24-generic_3.13.0-24.46_amd64 So somewhere in the interaction between bhyve idle detection and the older linux kernel things do not match... --WjW ___ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"