Does anyone have xen, channel bonding and vlans all working at the same time?
I am running RedHat EL 5.2 on two HP DL 360 G5s with conga. The two servers
are clustered together and were working fine when I had bonding ONLY configured
on the network interfaces.
After configuring VLANS clustering seems to be broken. Here is a snipet of the
log.
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] Members Joined:
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] CLM CONFIGURATION CHANGE
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] New Configuration:
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] r(0) ip(172.16.255.132)
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] r(0) ip(172.16.255.133)
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] Members Left:
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] Members Joined:
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] r(0) ip(172.16.255.133)
Jun 17 14:07:17 xen2 openais[11130]: [SYNC ] This node is within the primary
component and will provide service.
Jun 17 14:07:17 xen2 openais[11130]: [TOTEM] entering OPERATIONAL state.
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] got nodejoin message
172.16.255.132
Jun 17 14:07:17 xen2 openais[11130]: [CLM ] got nodejoin message
172.16.255.133
Jun 17 14:07:17 xen2 openais[11130]: [CPG ] got joinlist message from node 1
Jun 17 14:07:17 xen2 openais[11130]: [CMAN ] cman killed by node 2 because we
were killed by cman_tool or other application
Jun 17 14:07:17 xen2 gfs_controld[11164]: cman_start_notification error -1 104
Jun 17 14:07:44 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 30 seconds.
Jun 17 14:08:14 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 60 seconds.
Jun 17 14:08:44 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 90 seconds.
Jun 17 14:09:14 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 120 seconds.
Jun 17 14:09:44 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 150 seconds.
Jun 17 14:10:14 xen2 ccsd[11124]: Unable to connect to cluster infrastructure
after 180 seconds.
Here is my config. The two servers communicate over the bond0:0 interface
which is vlan 1, the native vlan for the bonded/trunk interface. Vlans 2 and
301 are for domUs. I modified the network-bridge script to the following to
provide xenbr0(vlan2) and
xenbr301(vlan301) for the domUs. The vlan communication works fine for the
domUs. The servers can communicated via vlan 1, ssh is working between them,
but clustering is broken. Any help would be appreciated!
Thanks,
Bill
cat /etc/xen/scripts/network-bridge-custom
op_start () {
/sbin/ifconfig bond0.2 down
/usr/sbin/brctl addbr xenbr0
/usr/sbin/brctl addif xenbr0 bond0.2
/sbin/ip link set bond0.2 up
/sbin/ip link set xenbr0 up
/sbin/route add default gw 172.16.255.254
/sbin/ifconfig bond0.301 down
/usr/sbin/brctl addbr xenbr301
/usr/sbin/brctl addif xenbr301 bond0.301
/sbin/ifconfig xenbr301 up
}
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth0
# Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet
DEVICE=eth0
BOOTPROTO=none
ONBOOT=yes
TYPE=Ethernet
USERCTL=no
MASTER=bond0
SLAVE=yes
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth1
# Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet
DEVICE=eth1
BOOTPROTO=none
ONBOOT=yes
TYPE=Ethernet
USERCTL=no
MASTER=bond0
SLAVE=yes
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-bond0
DEVICE=bond0
BOOTPROTO=none
ONBOOT=yes
TYPE=Ethernet
USERCTL=no
BONDING_OPTS="miimon=100 mode=2"
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-bond0:0
DEVICE=bond0:0
ONBOOT=yes
TYPE=ethernet
BOOTPROTO=static
#VLAN=yes
NETMASK=255.255.255.0
NETWORK=172.16.255.0
IPADDR=172.16.255.132
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-bond0.2
DEVICE=bond0.2
ONBOOT=yes
TYPE=ethernet
BOOTPROTO=static
VLAN=yes
[EMAIL PROTECTED] ~]# cat /etc/sysconfig/network-scripts/ifcfg-bond0.301
DEVICE=bond0.301
ONBOOT=yes
TYPE=ethernet
BOOTPROTO=static
VLAN=yes
[EMAIL PROTECTED] ~]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:1624 errors:0 dropped:0 overruns:0 frame:0
TX packets:331 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:144294 (140.9 KiB) TX bytes:64714 (63.1 KiB)
bond0.2 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:431 errors:0 dropped:0 overruns:0 frame:0
TX packets:37 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:37266 (36.3 KiB) TX bytes:9628 (9.4 KiB)
bond0:0 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet addr:172.16.255.132 Bcast:172.16.255.255 Mask:255.255.255.0
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
eth0 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:227 errors:0 dropped:0 overruns:0 frame:0
TX packets:233 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:27607 (26.9 KiB) TX bytes:37414 (36.5 KiB)
Interrupt:18 Memory:f8000000-f8012100
eth1 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:1397 errors:0 dropped:0 overruns:0 frame:0
TX packets:98 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:116687 (113.9 KiB) TX bytes:27300 (26.6 KiB)
Interrupt:19 Memory:fa000000-fa012100
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:1720 errors:0 dropped:0 overruns:0 frame:0
TX packets:1720 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2752660 (2.6 MiB) TX bytes:2752660 (2.6 MiB)
virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
inet6 addr: fe80::200:ff:fe00:0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:43 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:9560 (9.3 KiB)
xenbr0 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:406 errors:0 dropped:0 overruns:0 frame:0
TX packets:16 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:35118 (34.2 KiB) TX bytes:5135 (5.0 KiB)
xenbr301 Link encap:Ethernet HWaddr 00:1E:0B:5F:01:1A
inet6 addr: fe80::21e:bff:fe5f:11a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:195 errors:0 dropped:0 overruns:0 frame:0
TX packets:16 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:10268 (10.0 KiB) TX bytes:5135 (5.0 KiB)
_______________________________________________
rhelv5-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/rhelv5-list
