Re: XENHVM hang-up w/ "network_alloc_rx_buffers: m_cljget failed"
Hi Louis, Thank you very much for your response. kalessin> On Jan 6, 2013, at 1:39 AM, moto kawasaki wrote: kalessin> > kalessin> > - Those VMs hang up with the following messages on console: kalessin> > kalessin> > network_alloc_rx_buffers: m_cjlget failed kalessin> > kalessin> >This message is repeatedly shown so quickly, and I cannot get kalessin> >login prompt. kalessin> kalessin> I got this too (by starting too much torrents at once…) kalessin> kalessin> My understanding is that FreeBSD is not really dynamic concerning kalessin> memory allocations for the network, so I bumped up the limits in kalessin> /boot/loader.conf: kalessin> kalessin> kern.ipc.nmbclusters="51200" kalessin> kern.ipc.nmbjumbop="51200" In my case, kern.ipc.nmbclusters: 262144 <-- set in /etc/sysctl.conf kern.ipc.nmbjumbop: 12800 <-- OS default so, 'nmbjumbop' seems the key point. I will try to increase it. kalessin> netstat -m is really useful to see what's going on. Yes it really is. But it is not so well-documented, isn't it ? I'd really appreciate some documents/pointers describing it :-) kalessin> My dom0 is Linux 3.2, but I don't think that this problem is specific to kalessin> Xen in any way. I agree. Thank you very much -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
XENHVM hang-up w/ "network_alloc_rx_buffers: m_cljget failed"
Hello, Thank you very much for your effort to porting Xen to FreeBSD. I am so happy I can use FreeBSD instead of Linux on XenServer!! Today, I have encountered hang-ups as follows; - XenServer 6.1 * 3 hosts (HP DL360G7) - FreeBSD 9.0-RELEASE-p5 (customized XENHVM) * 2 VMs - Those VMs hang up with the following messages on console: network_alloc_rx_buffers: m_cjlget failed This message is repeatedly shown so quickly, and I cannot get login prompt. - During this issue, I cannot login via ssh over network, although TCP connection is established (I tried with telnet to ssh port). - I guess the trigger of this issue was something like broadcast storm, which was made by failed network configuration change. - This issue seems similar to exhausting mbuf(rx). Could you please advice me of countermeasure/prevention against this issue ? Also, I would like to know how to make it self-healing, I mean I want to make those VMs to recover automatically after the trigger had gone. Any suggestion/hint/reference is welcomed. Thank you very much. -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: 9.1R?
Jay, I wanted to mention "XenServer Tools", from Citrix, as a part of Official Support of FreeBSD as domU. # Didn't someone talk about it on this ML ?? or my imagination ?? Thank you! jwest> Moto wrote... jwest> >looking forward to FreeBSD 9.1 and Citrix official xen-tool for FreeBSD :-) jwest> jwest> "official" xen support at 9.1 doesn't currently exist. As I understand it... jwest> that's on the drawing board (including dom0 support) for release 10. -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: 9.1R?
Thank you very much for your list of bugs. I am running FreeBSD 8.2/9.0 (amd64 XENHVM) on XenServer 5.6SP2/6.0.2/6.1, feld> Also, if you aren't aware, here is my personal list of Xen bugs: feld> feld> - Shutdown via Xen fails to poweroff. It doesn't issue any normal shutdown commands, feld> but tells the Xen code in the kernel to start a shutdown. It's broken on the kernel feld> side. kern/171118 feld> Also, NetBSD's workaround for this is to enable powerd, but we can't feld> when we're running XENHVM and I suspect their powerd is a completely different beast. feld> feld> - If you use PF with Xen HVM your performance will suck. Known bug. feld> kern/154428 feld> Set net.inet.tcp.tso=0 as a workaround. It might be better to disable rxcsum, txcsum, and lro, too. My understanding is the point is the 'NIC hardware' is not the real one but emulation by Xen Host, so that those 'off loading' makes context switch storm between domU and dom0. # please kindly correct me if wrong. feld> - "Deactivating" a network interface is an option after enabling the xe-guest-utilities scripts. feld> Please don't do that. It seems to cause a panic every time. kern/171138 feld> Also, this happens when you try to change the VLAN assigned to an feld> interface. - FreeBSD 9.0 XENHVM panics during boot sequence if it runs on XenServer 6.1. Remove (virtual) CD/DVD drive from guest configuration. http://list-archives.org/2012/10/10/freebsd-xen-freebsd-org/xenbusb_nop_confighook_cb-timeout/f/4227874455 And Yes, I have some experience successful live-migration with those ports. Special Thanks to author! Thank you!! looking forward to FreeBSD 9.1 and Citrix official xen-tool for FreeBSD :-) -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Citrix Xenserver and FreeBSD migration/suspend scripts
Hi Mark-san, Thank you very much for your patch. I've applied that patch already, and seems fix the problem. Thank you very very much!! Sincerely, >> Let me check this please but surely it would be something easy to >> solve or something that is not complete on the installation > > He's using my modified version of the xen tools scripts and I just > caught this bug this morning. It appears to be fixed here: > > https://github.com/felderado/freebsd-xen-tools-scripts/commit/9250a10ae8a1ab1045f15964bd1cfce1124423bd#src/usr/local/sbin/xe-update-guest-attrs -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Citrix Xenserver and FreeBSD migration/suspend scripts
Hi Egoitz-san, Thank you very much for your reply!! Year, I've tried that in xe-update-guest-attrs: xenstore_write_cached "attr/PVAddons/MajorVersion" "6" xenstore_write_cached "attr/PVAddons/MinorVersion" "0" xenstore_write_cached "attr/PVAddons/MicroVersion" "2" But still XenCenter recognises it as old version of xenserver-tools. >>> was Xenserver 6.2.0 wasn't it?? >> No, it was 6.0.2. I haven't had a chance to figure this out as I >> don't have a 6.0.2 XenServer available right now. This is true. XenServer version is 6.0.2. just for clarification. Best Regards, -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Citrix Xenserver and FreeBSD migration/suspend scripts
Hi >> 1) XenCenter shows warning as; >> "XenServer Tools out of date (version 6.0 installed)" > On XenServer 6.0.0 the current settings work fine. I imagine we need > to investigate what version the tools are on other platforms and > emulate that version accordingly. Thanks, and I forgot to write that this message appears with CentOS 6.3 PV + XenServer Tools which is taken from XenServer 6.0.2. So, This might not be a bug in the script, but rather a bug in XenServer side. Sorry for late information. Thank you very much!! Sincerely, -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Citrix Xenserver and FreeBSD migration/suspend scripts
Hi, I'd just inform you of my first exprience. 0) My environment is: - XenServer 6.0.2 fully patched. - FreeBSD 9.0-RELEASE-p4 amd64 HVMXEN (to which PF entries added) - sysutils/xen-tools-4.0.1 ports installed. 1) XenCenter shows warning as; "XenServer Tools out of date (version 6.0 installed)" Changing MicroVersion from 0 to 2 in xe-update-guest-attr file doesn't have effect on this issue. xenstore_write_cached "attr/PVAddons/MicroVersion" "2" ^^^ 0 to 2 2) "Shutdown" button on XenCenter works but doesn't complete. I guess XenServer/XenCenter expect something like "shutdown -p now" on the FreeBSD VM, but actually it runs like "shutdown -h now". Thus, FreeBSD VM has shut down, but doesn't cut its power, thus XenCenter remains on the way shutting down (VM icon stays in green, not goes to red.). 3) Moving VM from one member host to another in the pool works. wow!! Thank you again. I am so happy with those scripts!! -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Citrix Xenserver and FreeBSD migration/suspend scripts
Hello Mr. Mark Felder, I'd say thank you again and again for your scripts. I am running several XenServer machines and dozens of amd64/HVMXEN VMs, hence longing to have XenTools for FreeBSD for months. Now I am going to have a test run of those scripts, and wish to do something I can do to make it a ports. Thank you very much. -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: kern/166174: [xen] Problems ROOT MOUNT ERROR
The following reply was made to PR kern/166174; it has been noted by GNATS. From: moto kawasaki To: bug-follo...@freebsd.org Cc: ilsuj...@gmail.com Subject: Re: kern/166174: [xen] Problems ROOT MOUNT ERROR Date: Tue, 01 May 2012 12:00:02 +0900 (JST) Hi, I'd report the similar case which I am facing. My envrionment is; XenServer 5.6 SP2 FreeBSD 8.3-RELEASE (amd64) -- XENHVM kernel when booting this FreeBSD VM, its kernel cannot mount root disk. (case 1: ad0s1a, from /etc/fstab) == ums0: : Mount using filesystem eg. ufs:/dev/da0s1a eg. cd9660:/deu/acd0 This is equivalent to: mount -t cd9660 /deu/acd0 / ? List valid disk boot devices Abort manual input mountroot> _ (case 2: xbd, entered by hand just after the case 1) === mountroot> ufs:/dev/xbd0s1a Trying to mount root from ufs:/dev/xbd0s1a ROOT MOUNT ERROR: If you have invalid mount options, reboot, and first try the following from the loader prompt: set ufs.root.mountfrom.options=rw and then remove invalid mount options from /ete/fstab. Loader variables: vfs.root.mountfrom=ufs:/dev/ad0s1a vfs.root.mountfrom.options=rw Manual root filesgstem specification: : Mount using filesystem eg. ufs:/dev/da0s1a eg. cd9660:/deu/acd0 This is equivalent to: mount -t cd9660 /deu/acd0 / ? List valid disk boot devices Abort manual input mountroot> _ HVMXEN kernel of FreeBSD 8.2-RELEASE-p6 works just fine in this environment. Also, I can try other "mountroot>" devices if you could tell me within a day or two. Thank you!! Best Regards, -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Xenmotion on Xenserver
Hi Yes, I strognly wish to have xentools for FreeBSD (guest). I'd contribute as far as I can !! Thanks. -- moto kawasaki > I talked some days ago at one of the Citryx mailing lists with one > systems architect in order to view if is planned to add support to > FreeBSD for XenCloud. They said me that there weren't plans but that > is totally possible to make Xenservertools to work with FreeBSD by > doing some little modifications. I'm planning to go with this > portability in following days... in fact... they told me that would be > nice to exist a contributed port for being able to use FreeBSD and > XenServerTools that basically is probably what you need. I'll tell > here how this project carries out :) ... And if I'm allowed to... I > will contribute the port. :) :) ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Q: speed and duplex of xn in amd64 XENHVM
Hi, Could you please advice me of the speed and duplex mode of the xn interface in XENHVM kernel (amd64)? With what command can I determine it ? I am testing XenServer 5.6 SP2, and FreeBSD 8.2-RELEASE-p6 (amd64, XENHVM), and ifconfig command shows me "media: Ethernet manual", instead of something like "media: Ethernet autoselect (100baseTX )". Thank you very much! Best Regards, -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Setup xen into FreeBSD
Hi > Currently there's no FreeBSD dom0 support in Xen. The iproute and > brigde-utils packages are Linux related ones afaik. Yep, but NetBSD can be Xen dom0, I believe. Please start from http://www.netbsd.org/ports/xen/howto.html , but this page might be obsolete. Please advice me how to, if you can set it up !! -- moto kawasaki 090-2464-8454 ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: XENHVM
Hi David, If you don't mind, could you please advice me; - what is your Dom0, Linux or NetBSD? and which version with waht kernel configuration, etc. - what is your DomU configuration? When I tried NetBSD 4.1 with Xen 3.0/3.3 (both) as Dom0 and FreeBSD 7.2-RELEASE (XENHVM), my DomU couldn't activate network interface. I have deleted this environment so that I cannot try right now, but I am eager to use FreeBSD as DomU (even if its Dom0 is Linux :-) Thank you in advance! Best Regards, -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
Re: Getting started with FreeBSD 8.0 RC2 on Xen
Hi, > You will need Xen 3.4 unless that changed recently. The easiest way > to get that and a matching Dom0 is installing Debian/unstable. I am just curious, is there any project to develop FreeBSD as Dom0? I am looking forward to it !! Thanks. -- moto kawasaki ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"
