FIXED, by echo 0>/proc/../conf/{all,default}/rp_filter, to turn off rp_filter.2010/12/14, Allen He <allenh...@gmail.com>: > Hi All, > > We have been running it with LVS-RD for a year, but when i add a > new real server , the new real server not work. while the other real > server works fine. > The problem is The real server can receive the package from LVS, > but the nginx > installed on the real server never received the package. > The real server: > ad...@speed:~$ uname -a > Linux speed 2.6.35-22-server #35-Ubuntu SMP Sat Oct 16 22:02:33 UTC > 2010 x86_64 GNU/Linux > > It has two ports, eth0 and eth1. The two cards talk to two > networks, one starting with 66. and going to the outside and the other > 192. and going to the inside. the VIP is 66.63.253.120 and > 67.249.117.56. Here is the result of ifconfig: > > ad...@speed:~$ ifconfig > eth0 Link encap:Ethernet HWaddr 00:1e:c9:ba:20:41 > inet addr:66.63.253.88 Bcast:66.63.253.127 Mask:255.255.255.192 > inet6 addr: fe80::21e:c9ff:feba:2041/64 Scope:Link > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > RX packets:94896 errors:0 dropped:0 overruns:0 frame:0 > TX packets:20648 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:1000 > RX bytes:10900353 (10.9 MB) TX bytes:4580223 (4.5 MB) > Interrupt:16 Memory:f8000000-f8012800 > > eth0:1 Link encap:Ethernet HWaddr 00:1e:c9:ba:20:41 > inet addr:67.249.117.24 Bcast:67.249.117.63 Mask:255.255.255.192 > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > Interrupt:16 Memory:f8000000-f8012800 > > eth1 Link encap:Ethernet HWaddr 00:1e:c9:ba:20:43 > inet addr:192.168.16.88 Bcast:192.168.16.255 Mask:255.255.255.0 > inet6 addr: fe80::21e:c9ff:feba:2043/64 Scope:Link > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > RX packets:126534 errors:0 dropped:0 overruns:0 frame:0 > TX packets:56944 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:1000 > RX bytes:28644545 (28.6 MB) TX bytes:5306425 (5.3 MB) > Interrupt:16 Memory:f4000000-f4012800 > > lo Link encap:Local Loopback > inet addr:127.0.0.1 Mask:255.0.0.0 > inet6 addr: ::1/128 Scope:Host > UP LOOPBACK RUNNING MTU:16436 Metric:1 > RX packets:680 errors:0 dropped:0 overruns:0 frame:0 > TX packets:680 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:0 > RX bytes:74461 (74.4 KB) TX bytes:74461 (74.4 KB) > > lo:0 Link encap:Local Loopback > inet addr:66.63.253.120 Mask:255.255.255.255 > UP LOOPBACK RUNNING MTU:16436 Metric:1 > > lo:1 Link encap:Local Loopback > inet addr:67.249.117.56 Mask:255.255.255.255 > UP LOOPBACK RUNNING MTU:16436 Metric:1 > > I have dumped the package on the real server port eth1, when i access > http://66.63.253.120 : > > ad...@speed:~$ sudo tcpdump -i eth1 dst host 66.63.253.120 -e > tcpdump: verbose output suppressed, use -v or -vv for full protocol decode > listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes > 10:37:19.438541 00:22:19:4f:64:70 (oui Unknown) > 00:1e:c9:ba:20:43 > (oui Unknown), ethertype IPv4 (0x0800), length 66: 126.89.61.122.54459 >> 66.63.253.120.www: Flags [S], seq 3247425561, win 8192, options [mss > 1460,nop,wscale 2,nop,nop,sackOK], length 0 > 10:37:22.437969 00:22:19:4f:64:70 (oui Unknown) > 00:1e:c9:ba:20:43 > (oui Unknown), ethertype IPv4 (0x0800), length 66: 126.89.61.122.54459 >> 66.63.253.120.www: Flags [S], seq 3247425561, win 8192, options [mss > 1460,nop,wscale 2,nop,nop,sackOK], length 0 > 10:37:28.442390 00:22:19:4f:64:70 (oui Unknown) > 00:1e:c9:ba:20:43 > (oui Unknown), ethertype IPv4 (0x0800), length 62: 126.89.61.122.54459 >> 66.63.253.120.www: Flags [S], seq 3247425561, win 8192, options [mss > 1460,nop,nop,sackOK], length 0 > ^C > 3 packets captured > 3 packets received by filter > 0 packets dropped by kernel > > > The following is the real server setup scritps: > > VIP1=66.63.253.120 > VIP2=67.249.117.56 > /sbin/ifconfig lo:0 $VIP1 broadcast $VIP1 netmask 255.255.255.255 up > /sbin/route add -host $VIP1 dev lo:0 > /sbin/ifconfig lo:1 $VIP2 broadcast $VIP2 netmask 255.255.255.255 up > /sbin/route add -host $VIP2 dev lo:1 > echo "1" >/proc/sys/net/ipv4/conf/lo/arp_ignore > echo "2" >/proc/sys/net/ipv4/conf/lo/arp_announce > echo "1" >/proc/sys/net/ipv4/conf/all/arp_ignore > echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce > /sbin/sysctl -p >/dev/null 2>&1 > > AND the route table: > ad...@speed:~$ route > Kernel IP routing table > Destination Gateway Genmask Flags Metric Ref Use > Iface > 66.249.117.56 * 255.255.255.255 UH 0 0 0 lo > 66.63.253.120 * 255.255.255.255 UH 0 0 0 lo > 66.249.117.0 * 255.255.255.192 U 0 0 0 > eth0 > localnet * 255.255.255.192 U 0 0 0 > eth0 > 192.168.16.0 * 255.255.255.0 U 0 0 0 > eth1 > default 66.63.253.65 0.0.0.0 UG 100 0 0 > eth0 > > > when i access http://66.63.253.88 , it works fine. > > > Any ideas? > > Best Regards. > _______________________________________________ Please read the documentation before posting - it's available at: http://www.linuxvirtualserver.org/ LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org Send requests to lvs-users-requ...@linuxvirtualserver.org or go to http://lists.graemef.net/mailman/listinfo/lvs-users
