Hi folks,
I've been running into a problem every so often that I can't track down and
thought I'd just throw it out here to see if I get any bites.
I have 2 Gbit OSAs that I share among my guests and use VIPA to provide
failover in case one goes down. So, every guest has an eth0, eth1, and an
lo:1 interface. All access to the guests use the IP address assigned to
lo:1.
The problem is that sometimes a guest is unreachable using the lo:1 IP addr.
You can still access the guest through eth0 or eth1. I've found 2 ways to
get out of the situation. The first, is to drop all the interfaces and
bring them back up. The other is to use arping like so:
arping -U -c 1 -I eth0 -s 0x0a0e0321 255.255.255.255
I happen to have a guest in this state right now, and here's the current
picture:
stpaulus900d:/proc # ifconfig
eth0 Link encap:Ethernet HWaddr 00:02:55:9A:B6:93
inet addr:10.14.3.34 Bcast:10.14.3.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1492 Metric:1
RX packets:278 errors:0 dropped:0 overruns:0 frame:0
TX packets:357 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:100
RX bytes:29652 (28.9 Kb) TX bytes:45535 (44.4 Kb)
eth1 Link encap:Ethernet HWaddr 00:02:55:9A:B9:CA
inet addr:10.14.3.35 Bcast:10.14.3.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1492 Metric:1
RX packets:4 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:100
RX bytes:240 (240.0 b) TX bytes:0 (0.0 b)
Interrupt:3
lo:1 Link encap:Local Loopback
inet addr:10.14.3.33 Mask:255.255.255.255
UP LOOPBACK RUNNING MTU:16436 Metric:1
stpaulus900d:/proc # cat qeth
devnos (hex) CHPID device cardtype port chksum prio-q'ing rtr fsz C
cnt
-------------- --- ---------- -------------- -- -- ---------- --- --- -
---
1000/1001/1002 x05 eth0 OSD_1000 0 no always_q_2 no 64k
128
1100/1101/1102 x06 eth1 OSD_1000 0 no always_q_2 no 64k
128
1300/1301/1302 xE0 hsi0 HiperSockets 0 no always_q_2 no 64k
128
stpaulus900d:/proc # cat qeth_ipa_takeover
add_vipa4 0a0e0321:eth0
add_vipa4 0a0e0321:eth1
stpaulus900d:/proc # qetharp -nq eth0|more
Address HWaddress HWType Iface
10.14.3.1 00:04:4d:5f:3b:82 ether eth0
10.14.3.7 00:02:55:9a:b6:93 ether eth0
10.2.32.7 00:02:55:9a:b6:93 ether eth0
10.14.3.67 00:02:55:9a:b6:93 ether eth0
10.14.3.66 00:02:55:9a:b6:93 ether eth0
10.14.3.26 00:02:55:9a:b6:93 ether eth0
10.14.3.25 00:02:55:9a:b6:93 ether eth0
10.14.3.5 00:02:55:9a:b6:93 ether eth0
10.2.32.5 00:02:55:9a:b6:93 ether eth0
10.14.3.6 00:02:55:9a:b6:93 ether eth0
10.2.32.6 00:02:55:9a:b6:93 ether eth0
10.14.3.61 00:02:55:9a:b6:93 ether eth0
10.14.3.60 00:02:55:9a:b6:93 ether eth0
10.14.3.20 00:02:55:9a:b6:93 ether eth0
10.14.3.55 00:02:55:9a:b6:93 ether eth0
10.14.3.54 00:02:55:9a:b6:93 ether eth0
10.14.3.19 00:02:55:9a:b6:93 ether eth0
10.14.3.46 00:02:55:9a:b6:93 ether eth0
10.14.3.49 00:02:55:9a:b6:93 ether eth0
10.14.3.40 00:02:55:9a:b6:93 ether eth0
10.14.3.39 00:02:55:9a:b6:93 ether eth0
10.14.3.23 00:02:55:9a:b6:93 ether eth0
10.14.3.58 00:02:55:9a:b6:93 ether eth0
10.14.3.22 00:02:55:9a:b6:93 ether eth0
10.14.3.57 00:02:55:9a:b6:93 ether eth0
10.14.3.64 00:02:55:9a:b6:93 ether eth0
10.14.3.34 00:02:55:9a:b6:93 ether eth0
10.14.3.33 00:02:55:9a:b6:93 ether eth0
10.14.3.43 00:02:55:9a:b6:93 ether eth0
10.14.3.52 00:02:55:9a:b6:93 ether eth0
10.14.3.51 00:02:55:9a:b6:93 ether eth0
10.14.3.63 00:02:55:9a:b6:93 ether eth0
10.14.3.42 00:02:55:9a:b6:93 ether eth0
10.14.3.29 00:02:55:9a:b6:93 ether eth0
10.14.3.28 00:02:55:9a:b6:93 ether eth0
10.14.3.73 00:02:55:9a:b6:93 ether eth0
10.14.3.72 00:02:55:9a:b6:93 ether eth0
10.14.3.70 00:02:55:9a:b6:93 ether eth0
10.14.3.69 00:02:55:9a:b6:93 ether eth0
10.14.3.37 00:02:55:9a:b6:93 ether eth0
10.14.3.36 00:02:55:9a:b6:93 ether eth0
stpaulus900d:/proc # qetharp -nq eth1|more
Address HWaddress HWType Iface
10.14.3.1 00:04:4d:5f:3b:82 ether eth1
10.14.3.21 00:02:55:9a:b9:ca ether eth1
10.14.3.68 00:02:55:9a:b9:ca ether eth1
10.14.3.66 00:02:55:9a:b9:ca ether eth1
10.14.3.27 00:02:55:9a:b9:ca ether eth1
10.14.3.62 00:02:55:9a:b9:ca ether eth1
10.14.3.60 00:02:55:9a:b9:ca ether eth1
10.14.3.19 00:02:55:9a:b9:ca ether eth1
10.14.3.56 00:02:55:9a:b9:ca ether eth1
10.14.3.54 00:02:55:9a:b9:ca ether eth1
10.14.3.47 00:02:55:9a:b9:ca ether eth1
10.14.3.50 00:02:55:9a:b9:ca ether eth1
10.14.3.45 00:02:55:9a:b9:ca ether eth1
10.14.3.48 00:02:55:9a:b9:ca ether eth1
10.14.3.41 00:02:55:9a:b9:ca ether eth1
10.14.3.39 00:02:55:9a:b9:ca ether eth1
10.14.3.24 00:02:55:9a:b9:ca ether eth1
10.14.3.22 00:02:55:9a:b9:ca ether eth1
10.14.3.59 00:02:55:9a:b9:ca ether eth1
10.14.3.57 00:02:55:9a:b9:ca ether eth1
10.14.3.65 00:02:55:9a:b9:ca ether eth1
10.14.3.35 00:02:55:9a:b9:ca ether eth1
10.14.3.33 00:02:55:9a:b9:ca ether eth1
10.14.3.44 00:02:55:9a:b9:ca ether eth1
10.14.3.53 00:02:55:9a:b9:ca ether eth1
10.14.3.30 00:02:55:9a:b9:ca ether eth1
10.14.3.28 00:02:55:9a:b9:ca ether eth1
10.14.3.74 00:02:55:9a:b9:ca ether eth1
10.14.3.72 00:02:55:9a:b9:ca ether eth1
10.14.3.71 00:02:55:9a:b9:ca ether eth1
10.14.3.38 00:02:55:9a:b9:ca ether eth1
10.14.3.36 00:02:55:9a:b9:ca ether eth1
stpaulus900d:/proc # netstat -rn
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt
Iface
10.2.32.0 0.0.0.0 255.255.255.128 U 40 0 0
hsi0
10.14.3.0 0.0.0.0 255.255.255.0 U 40 0 0
eth1
10.14.3.0 0.0.0.0 255.255.255.0 U 40 0 0
eth0
0.0.0.0 10.14.3.1 0.0.0.0 UG 40 0 0
eth0
Fortunately, I can leave the guest like this as long as I want, so if you
folks have things to try, I'd be real happy to hear about em.
Any ideas would be greatly appreciated.
Thanks much,
Leland
CONFIDENTIALITY NOTICE: This e-mail communication and any attachments may
contain proprietary and privileged information for the use of the designated
recipients named above. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient, please
contact the sender by reply e-mail and destroy all copies of the original
message.
