[CentOS-virt] XEN multiple bridge problem - VM won' start!
Hi, I've been using CentOS Xen on a server that has 2 VM's configured. The default configuration includes one physical iface that is propagated (by a default bridge) to the VM's. Since I wanted to configure additional physical iface, define a new bridge and propagate it to the viface-s of the VM's, i configured the bridge/phys. iface and brought it up (here are configurations that I set up): - eth3 DEVICE=eth3 BOOTPROTO=static HWADDR=D4:85:64:4B:76:AB ONBOOT=yes #HOTPLUG=no #DHCP_HOSTNAME=kdr-3k-4r-3o-07 BRIDGE=br0 TYPE=Ethernet - br0 DEVICE=br0 TYPE=Bridge BOOTPROTO=none ONBOOT=yes Then I configured new virt. ifaces on VM's (using virsh edit, config is listed below): interface type='bridge' mac address='00:16:36:17:62:5d'/ source bridge='xenbr0'/ script path='vif-bridge'/ target dev='vif5.0'/ /interface interface type='bridge' mac address='00:16:3e:ca:63:39'/ source bridge='br0'/ script path='vif-bridge'/ target dev='vif5.1'/ /interface You can see the default bridge (xenbr0 - vif5.0) and my new bridge br0 connected to vif5.1. So, here I got stuck up - when I try tu start a VM (xm create VIRT_SRV), the VM starts booting but hangs up (I can ping it form another srv., but when I try SSH it says connection refused). When I remove configuration for vif5.1 the VM starts up normally. I actually managed to start VM with vif5.1 up once, but next time I restarted it, the problem was there :/ Furthermore, I noticed this in the Xen log: [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vif. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:166) Waiting for 0. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:544) hotplugStatusCallback /local/domain/0/backend/vif/1/0/hotplug-status. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:544) hotplugStatusCallback /local/domain/0/backend/vif/1/0/hotplug-status. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:558) hotplugStatusCallback 1. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:166) Waiting for 1. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:544) hotplugStatusCallback /local/domain/0/backend/vif/1/1/hotplug-status. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:558) hotplugStatusCallback 1. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices usb. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vbd. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:166) Waiting for 768. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:544) hotplugStatusCallback /local/domain/0/backend/vbd/1/768/hotplug-status. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:558) hotplugStatusCallback 1. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:166) Waiting for 5632. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:544) hotplugStatusCallback /local/domain/0/backend/vbd/1/5632/hotplug-status. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:558) hotplugStatusCallback 1. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices irq. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vkbd. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vfb. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices pci. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices ioports. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices tap. [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vtpm. So the boot process goes on regulary until the last line (Waiting for devices vtpm). It seems like TPM makes it impossible for VM's to start regulary. When I open the VM's console (with virt-manager) I see the whole boot process but it hangs when it tries to start iface eth2 (attached to the second bridge) ... Does anybody have a clue why is this happening? Thanks in advance .. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] XEN multiple bridge problem - VM won' start!
Hi, 2011/11/18 Matija Draganović mdra...@gmail.com: I've been using CentOS Xen on a server that has 2 VM's configured. The default configuration includes one physical iface that is propagated (by a default bridge) to the VM's. You do not mention which version of CentOS and Xen you are using? Since I wanted to configure additional physical iface, define a new bridge and propagate it to the viface-s of the VM's, i configured the bridge/phys. iface and brought it up (here are configurations that I set up): - eth3 DEVICE=eth3 BOOTPROTO=static HWADDR=D4:85:64:4B:76:AB ONBOOT=yes #HOTPLUG=no #DHCP_HOSTNAME=kdr-3k-4r-3o-07 BRIDGE=br0 TYPE=Ethernet - br0 DEVICE=br0 TYPE=Bridge BOOTPROTO=none ONBOOT=yes If this is a CentOS5 machine with the CentOS provided Xen 3.0 packages, then here is info how i got my bridges to work with that setup: * For dom0 I configured eth0 and eth1 as usual in /etc/sysconfig/network-scripts * I did not configure br0 or br1 in network-scripts, but instead I created a file called /etc/xen/scripts/my-network-script having this contents: #!/bin/sh dir=$(dirname $0) $dir/network-bridge $@ vifnum=0 netdev=eth0 bridge=xenbr0 $dir/network-bridge $@ vifnum=1 netdev=eth1 bridge=xenbr1 * Then I modified in dom0 the file /etc/xen/xend-config.sxp in the following way: #(network-script network-bridge) (network-script my-network-script) * Now rebooting dom0 made the bridges available * After that I could configure them in my domU config: vif = [ mac=00:16:3E:69:29:25,bridge=xenbr0,script=vif-bridge,mac=00:16:3E:E6:B0:6D,bridge=xenbr1,script=vif-bridge ] * After starting the domU I could configure the interfaces in network-scripts using the hardware addresses specified in the domU config It seems that configuring bridging is done a bit differently in different Xen versions, so this might not work if you are using some other kind of config. With CentOS6 and 3rd party Xen 4.1 packages this procedure did not work at all and instead I needed to do the following: * in dom0 create the br0 and br1 devices in network-scripts * in dom0 /etc/xen/xend-config.sxp put instead: #(network-script network-bridge) (network-script /bin/true) * and in dom0 use different configuration for the domU config files like this: vif = [ mac=00:16:3E:69:29:25,bridge=br0,mac=00:16:3E:E6:B0:6D,bridge=br1 ] Hope this helps, unfortuantely I am not familiar with virsh at all. Best, Peter ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] XEN multiple bridge problem - VM won' start!
Dear Peter, Thanks for your reply. I was so occupied with troubleshooting that I forgot to mention the OS Xen version :) My CentOS version is CentOS release 5.7 (Final) Linux 2.6.18-274.7.1.el5xen #1 SMP Thu Oct 20 17:06:34 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux and Xen v3.0. I tried creating bridges the same way you did and succedded. I also tried doing the same via ifcfg scripts, and it also worked. I have no problem with creating bridges and connecting them with physical ifaces, but I can't start my VM's (most of the time one VM start but the other one hangs while trying to initalize eth2 that is connected to my second (non default - xenbr1) bridge)). The only diference between your config and mine is that I have vifname-s listed (example below): vif = [ mac=00:16:36:72:35:e5,bridge=xenbr0,script=vif-bridge,vifname=vif4.0, mac=00:16:3e:57:de:0d,bridge=xenbr1,script=vif-bridge, vifname=vif4.1 ] I'm not saying that this could be the problem, but since I'm slowly running out of ideas - it's a longshot :) So, to sum it all up - I can create bridges properly, but my VM's hang when they try to bring up vifaces connected to the xenbr1. Also, I have no problem with having only one bridge active - problem appears when I have multiple bridges. Br, Matija ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] Bonds, VLANs, and Bridges on Centos 5.6
Running on Centos 5.6 with KVM... I was wondering if anyone had any luck configuring the NICs where eth0 and eth1 are bonded together with vlan support to a bridge? I noticed some threads show this as a possibility (http://lists.centos.org/pipermail/centos-virt/2009-November/001417.html), but haven't had any luck implementing it. There also seems to be a bug with 5.6 (http://bugs.centos.org/view.php?id=4801), but that post died the day it was created it. Any advice/working examples would be greatly appreciated. Regards, Jason ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] XEN multiple bridge problem - VM won' start!
I tried to remove vifname and vif-script but the problem remains. I think that the bridges are ok, but for some reason VM's hang when they try to connect their vifaces to them. I'll try some different configurations of the physical ifaces (an vifaces also), maybe I'll be able to find out something. Also, I'll focus on the vTPM, since the following line shows up in the Xen log when the VM tries to bring up the iface connected to the second bridge: [2011-11-18 09:27:16 xend 8213] DEBUG (DevController:160) Waiting for devices vtpm Furthermore, it appears that sometimes the VM's manage to start regulary, I just can't figure out when why :/ Tnx for your comments .. Br, M. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
