I am having an issue with networking and believe that I understand the
issue but do not know how to fix the problem. I have two servers set
up in a carp + pfsync load balancer on 2 T2000 sparc servers.
Each server is configured identically.
First I have a physical interface em0 that is plugged into a switch
set up as a swithport that is on a vlan629
Second I have a physical interface em2 that is plugged into a switch
that is trunked to multiple different vlans including vlan629. The
em2 interface is the interface that all the vlans bind to, from there
each carp interface binds to appropriate vlan.
All of the other vlans are working as expected on the em2 interface
except for vlan629. For each vlan I have created a
/etc/hostname.vlan* and they all work. Where the problems comes in
when I try to ping one of the ip addresses that are assigned to
/etc/hostname.vlan629 on either server. I can see ICMP request come
in using tcpdump but the ICMP request is not returned. My assumption
is that the vlan629 interface does not know how to route back out
through the em2 physical interface. Also when using netstat -rn it
did not show any routes for vlan629 on em2 but did show the routes for
em0.
I did some testing by destroying the em0 interface on both servers and
rebooting each server. After rebooting the /etc/hostname.vlan629
routes showed up correctly in netstat -rn and I was able to
successfully ping each em2 vlan629 interface on both servers. I
would like to be able to keep the em0 interface because it has special
pf rules that are different than the em2 interface.
Any suggestions would be greatly helpful.
--jw
$ cat /var/run/dmesg.boot
console is /virtual-devi...@100/cons...@1
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
Copyright (c) 1995-2010 OpenBSD. All rights reserved. http://www.OpenBSD.org
OpenBSD 4.7-current (GENERIC.MP) #53: Mon Jul 12 04:40:58 MDT 2010
[email protected]:/usr/src/sys/arch/sparc64/compile/GENERIC.MP
real mem = 17045651456 (16256MB)
avail mem = 16762232832 (15985MB)
mainbus0 at root: SPARC Enterprise T2000
cpu0 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu1 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu2 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu3 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu4 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu5 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu6 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu7 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu8 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu9 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu10 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu11 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu12 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu13 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu14 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu15 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu16 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu17 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu18 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu19 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu20 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu21 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu22 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu23 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu24 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu25 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu26 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu27 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu28 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu29 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu30 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
cpu31 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1200 MHz
vbus0 at mainbus0
"flashprom" at vbus0 not configured
cbus0 at vbus0
"virtual-channel" at cbus0 not configured
"virtual-channel-client" at cbus0 not configured
"virtual-channel" at cbus0 not configured
vcons0 at vbus0: ivec 0x111
vrtc0 at vbus0
"fma" at vbus0 not configured
"sunvts" at vbus0 not configured
"sunmc" at vbus0 not configured
"explorer" at vbus0 not configured
"led" at vbus0 not configured
"flashupdate" at vbus0 not configured
"ncp" at vbus0 not configured
vpci0 at mainbus0: bus 2 to 7, dvma map 80000000-ffffffff
pci0 at vpci0
ppb0 at pci0 dev 0 function 0 "PLX PEX 8532" rev 0xbc
pci1 at ppb0 bus 3
ppb1 at pci1 dev 1 function 0 "PLX PEX 8532" rev 0xbc
pci2 at ppb1 bus 4
em0 at pci2 dev 0 function 0 "Intel PRO/1000 PT (82571EB)" rev 0x06:
ivec 0x795, address 00:14:4f:cb:95:e4
em1 at pci2 dev 0 function 1 "Intel PRO/1000 PT (82571EB)" rev 0x06:
ivec 0x796, address 00:14:4f:cb:95:e5
ppb2 at pci1 dev 2 function 0 "PLX PEX 8532" rev 0xbc
pci3 at ppb2 bus 5
ppb3 at pci1 dev 8 function 0 "PLX PEX 8532" rev 0xbc: ivec 0x794
pci4 at ppb3 bus 6
ppb4 at pci1 dev 9 function 0 "PLX PEX 8532" rev 0xbc
pci5 at ppb4 bus 7
mpi0 at pci5 dev 0 function 0 "Symbios Logic SAS1064E" rev 0x02: ivec 0x795
scsibus0 at mpi0: 63 targets
sd0 at scsibus0 targ 0 lun 0: <LSILOGIC, Logical Volume, 3000> SCSI2
0/direct fixed
sd0: 69943MB, 512 bytes/sec, 143243264 sec total
sd1 at scsibus0 targ 2 lun 0: <FUJITSU, MAY2073RCSUN72G, 0401> SCSI2
0/direct fixed
sd1: 70007MB, 512 bytes/sec, 143374738 sec total
sd2 at scsibus0 targ 3 lun 0: <FUJITSU, MAY2073RCSUN72G, 0401> SCSI2
0/direct fixed
sd2: 70007MB, 512 bytes/sec, 143374738 sec total
vpci1 at mainbus0: bus 2 to 9, dvma map 80000000-ffffffff
pci6 at vpci1
ppb5 at pci6 dev 0 function 0 "PLX PEX 8532" rev 0xbc
pci7 at ppb5 bus 3
ppb6 at pci7 dev 1 function 0 "PLX PEX 8532" rev 0xbc
pci8 at ppb6 bus 4
ppb7 at pci8 dev 0 function 0 "Intel 41210 PCIE-PCIX" rev 0x09
pci9 at ppb7 bus 5
ebus0 at pci9 dev 2 function 0 "Acer Labs M1533 ISA" rev 0x00
com0 at ebus0 addr 3f8-3ff ivec 0x2: ns16550a, 16 byte fifo
ohci0 at pci9 dev 5 function 0 "Acer Labs M5237 USB" rev 0x03: ivec
0x7c1, version 1.0, legacy support
ohci1 at pci9 dev 6 function 0 "Acer Labs M5237 USB" rev 0x03: ivec
0x7c3, version 1.0, legacy support
pciide0 at pci9 dev 8 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc4:
DMA, channel 0 configured to native-PCI, channel 1 configured to
native-PCI
pciide0: using ivec 0x7c4 for native-PCI interrupt
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <MATSHITA, CD-RW CW-8124, DZ13> ATAPI
5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
pciide0: channel 1 disabled (no drives)
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1
usb1 at ohci1: USB revision 1.0
uhub1 at usb1 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1
ppb8 at pci8 dev 0 function 2 "Intel 41210 PCIE-PCIX" rev 0x09
pci10 at ppb8 bus 6
ppb9 at pci7 dev 2 function 0 "PLX PEX 8532" rev 0xbc
pci11 at ppb9 bus 7
em2 at pci11 dev 0 function 0 "Intel PRO/1000 PT (82571EB)" rev 0x06:
ivec 0x7d6, address 00:14:4f:cb:95:e6
em3 at pci11 dev 0 function 1 "Intel PRO/1000 PT (82571EB)" rev 0x06:
ivec 0x7d7, address 00:14:4f:cb:95:e7
ppb10 at pci7 dev 8 function 0 "PLX PEX 8532" rev 0xbc: ivec 0x7d4
pci12 at ppb10 bus 8
ppb11 at pci7 dev 9 function 0 "PLX PEX 8532" rev 0xbc: ivec 0x7d6
pci13 at ppb11 bus 9
uhub2 at uhub1 port 1 "Atmel UHB124 hub" rev 1.10/3.00 addr 2
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
bootpath: /p...@780,0/p...@0,0/p...@9,0/s...@0,0/d...@0,0
root on sd0a swap on sd0b dump on sd0b
