Running 5.3 (release) i386 on a soekris net4521 with 2 connected
sis(4). The device is a router/firewall on a home network with a cable
Internet connection. One of these interfaces has in the last few weeks
started to build higher rates of input errors as time increases
between reboots. This seems to result in intermittent packet loss
(5-10%) or increased latency (3-4x RTT) for routed traffic. When the
situation is at it's worst we can reboot the host and then symptoms
are gone for a short time before starting to occur again. This
interface connects to an Ethernet tap that connects to a 10/100 LAN
switch.
Any idea what the issue could be?
## host inside firewall
$ ping -c 50 8.8.8.8
...
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=48 time=65.608 ms
Request timeout for icmp_seq 1
...
Request timeout for icmp_seq 34
...
Request timeout for icmp_seq 38
--- 8.8.8.8 ping statistics ---
50 packets transmitted, 47 packets received, 6.0% packet loss
round-trip min/avg/max/stddev = 49.390/66.420/260.966/46.609 ms
sis0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:00:24:c1:7d:80
description: Internal Net
priority: 0
media: Ethernet autoselect (100baseTX full-duplex)
status: active
inet 10.0.1.1 netmask 0xffffff00 broadcast 10.0.1.255
inet6 fe80::200:24ff:fec1:7d80%sis0 prefixlen 64 scopeid 0x1
Run several hours apart:
$ netstat -nI sis0
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Colls
sis0 1500 <Link> 00:00:24:c1:7d:80 382022 14727 763566 0 0
sis0 1500 10.0.1/24 10.0.1.1 382022 14727 763566 0 0
sis0 1500 fe80::%sis0 fe80::200:24ff:fe 382022 14727 763566 0 0
$ netstat -nI sis0
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Colls
sis0 1500 <Link> 00:00:24:c1:7d:80 719160 46107 1264243 0 0
sis0 1500 10.0.1/24 10.0.1.1 719160 46107 1264243 0 0
sis0 1500 fe80::%sis0 fe80::200:24ff:fe 719160 46107 1264243 0 0
$ sysctl -a |grep drop
net.inet.ip.ifq.drops=0
net.mpls.ifq.drops=0
$ vmstat -iz
interrupt total rate
irq10/ral0 96693 12
irq11/cbb0 0 0
irq11/cbb1 0 0
irq5/sis0 525786 65
irq9/sis1 580738 72
irq4/com0 87 0
irq3/com1 0 0
irq1/pckbc0 0 0
irq14/wdc0 60355 7
irq0/clock 802708 99
irq8/rtc 1030955 127
Total 3097322 384
$ uptime
8:50PM up 1 day, 23:16, 1 user, load averages: 0.18, 0.09, 0.09
$ vmstat -w 5 -c 10
procs memory page disk traps cpu
r b w avm fre flt re pi po fr sr wd0 int sys cs us sy id
0 0 0 12356 14544 3 0 0 0 0 0 0 268 11 9 0 1 99
0 0 0 12360 14540 7 0 0 0 0 0 0 246 27 10 0 1 99
0 0 0 12360 14540 3 0 0 0 0 0 0 253 15 11 0 1 99
0 0 0 12360 14540 2 0 0 0 0 0 0 246 10 10 0 1 99
0 0 0 12360 14540 2 0 0 0 0 0 0 267 12 10 0 2 98
0 0 0 12360 14540 2 0 0 0 0 0 0 278 12 11 0 2 98
0 0 0 12360 14540 2 0 0 0 0 0 0 329 12 10 0 3 97
0 0 0 12360 14540 2 0 0 0 0 0 0 249 11 10 0 0 100
0 0 0 12360 14540 2 0 0 0 0 0 0 255 10 10 0 0 100
0 0 0 12360 14540 2 0 0 0 0 0 0 258 10 10 0 1 99
$ netstat -m
153 mbufs in use:
146 mbufs allocated to data
2 mbufs allocated to packet headers
5 mbufs allocated to socket names and addresses
144/250/6144 mbuf 2048 byte clusters in use (current/peak/max)
0/8/6144 mbuf 4096 byte clusters in use (current/peak/max)
0/8/6144 mbuf 8192 byte clusters in use (current/peak/max)
0/8/6144 mbuf 9216 byte clusters in use (current/peak/max)
0/8/6144 mbuf 12288 byte clusters in use (current/peak/max)
0/8/6144 mbuf 16384 byte clusters in use (current/peak/max)
0/8/6144 mbuf 65536 byte clusters in use (current/peak/max)
760 Kbytes allocated to network (42% in use)
0 requests for memory denied
0 requests for memory delayed
0 calls to protocol drain routines
$ systat -b mbufs
1 users Load 0.12 0.11 0.08 Thu Sep 19 23:24:11 2013
IFACE LIVELOCKS SIZE ALIVE LWM HWM CWM
System 0 256 154 17
2k 145 125
lo0
sis0 2k 7 2 63 7
sis1 2k 9 2 63 9
enc0
ral0
pflow0
tun0
pflog0
# pfctl -si
Status: Enabled for 1 days 23:22:46 Debug: err
Interface Stats for sis1 IPv4 IPv6
Bytes In 1709471265 0
Bytes Out 57081488 64
Packets In
Passed 1237681 0
Blocked 9317 0
Packets Out
Passed 649955 1
Blocked 0 0
State Table Total Rate
current entries 43
searches 3869540 22.7/s
inserts 97241 0.6/s
removals 97198 0.6/s
Counters
match 113187 0.7/s
bad-offset 0 0.0/s
fragment 0 0.0/s
short 2 0.0/s
normalize 0 0.0/s
memory 0 0.0/s
bad-timestamp 0 0.0/s
congestion 0 0.0/s
ip-option 0 0.0/s
proto-cksum 0 0.0/s
state-mismatch 451 0.0/s
state-insert 0 0.0/s
state-limit 0 0.0/s
src-limit 0 0.0/s
synproxy 0 0.0/s
OpenBSD 5.3 (GENERIC) #50: Tue Mar 12 18:35:23 MDT 2013
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: AMD Am5x86 W/B 133/160 ("AuthenticAMD" 486-class)
cpu0: FPU
real mem = 66646016 (63MB)
avail mem = 54611968 (52MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 20/40/19, BIOS32 rev. 0 @ 0xf7840
pcibios0 at bios0: rev 2.0 @ 0xf0000/0x10000
pcibios0: pcibios_get_intr_routing - function not supported
pcibios0: PCI IRQ Routing information unavailable.
pcibios0: PCI bus #2 is the last bus
bios0: ROM list: 0xc8000/0x9000
cpu0 at mainbus0: (uniprocessor)
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
elansc0 at pci0 dev 0 function 0 "AMD ElanSC520 PCI" rev 0x00: product
0 stepping 1.1, CPU clock 133MHz, reset 40<SCP>
gpio0 at elansc0: 32 pins
ral0 at pci0 dev 16 function 0 "Ralink RT2860" rev 0x00: irq 10,
address 00:0e:8e:1d:a6:b1
ral0: MAC/BBP RT2860 (rev 0x0101), RF RT2820 (MIMO 2T3R)
cbb0 at pci0 dev 17 function 0 "TI PCI1420 CardBus" rev 0x00: irq 11
cbb1 at pci0 dev 17 function 1 "TI PCI1420 CardBus" rev 0x00: irq 11
sis0 at pci0 dev 18 function 0 "NS DP83815 10/100" rev 0x00, DP83815D:
irq 5, address 00:00:24:c1:7d:80
nsphyter0 at sis0 phy 0: DP83815 10/100 PHY, rev. 1
sis1 at pci0 dev 19 function 0 "NS DP83815 10/100" rev 0x00, DP83815D:
irq 9, address 00:00:24:c1:7d:81
nsphyter1 at sis1 phy 0: DP83815 10/100 PHY, rev. 1
cardslot0 at cbb0 slot 0 flags 0
cardbus0 at cardslot0: bus 1 device 0 cacheline 0x10, lattimer 0x3f
pcmcia0 at cardslot0
cardslot1 at cbb1 slot 1 flags 0
cardbus1 at cardslot1: bus 2 device 0 cacheline 0x10, lattimer 0x3f
pcmcia1 at cardslot1
isa0 at mainbus0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard
wdc0 at isa0 port 0x1f0/8 irq 14
wd0 at wdc0 channel 0 drive 0: <SanDisk SDCFH-004G>
wd0: 1-sector PIO, LBA48, 3815MB, 7813120 sectors
wd0(wdc0:0:0): using BIOS timings
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
vscsi0 at root
scsibus0 at vscsi0: 256 targets
softraid0 at root
scsibus1 at softraid0: 256 targets
root on wd0a (b68774c473e1555e.a) swap on wd0b dump on wd0b
--
Darren Spruell
[email protected]
