I'm working on increasing the performance of our firewalls, we picked up
two of the newer v2 syskonnect cards for testing, I was getting pretty
low performance from the bridge so I started testing things using a card
as an endpoint.
I was using Iperf to generate packets, but to make sure it wasn't iperf
causing a problem, I also did some quick tests with ping -f which exhibit
much the same behavior.
192.168.0.7 is an OpenBSD host running 3.7, fresh install, with the
network configured.
192.168.0.5 is a linux host used in this test.
If I run some udp packets, 1mbps with the bsd box receiving
no problems. But transmitting 1mbps stream eats up the CPU.
When increasing to higher levels of traffic RX performance
seems to get affected also, the cpu activity becomes very bursty.
I'm still trying to characterize that a bit better.
We have an older SK-9843 which has a fiber interface which works
normally. Has anybody seen this behavior or have any tips at how
I might find what the card/kernel is doing?
Michael Blodgett
UW-Madison, CS Dept.
iostat 1
-----------
5 136 0.00 0 0.00 0.00 0 0.00 0 0 0 0100
7 137 0.00 0 0.00 0.00 0 0.00 1 0 0 0 99
4 135 0.00 0 0.00 0.00 0 0.00 0 0 0 0100
3 447 0.00 0 0.00 0.00 0 0.00 12 0 21 0 67
0 1103 0.00 0 0.00 0.00 0 0.00 33 0 67 0 0
0 131 0.00 0 0.00 0.00 0 0.00 33 0 67 0 0
0 131 0.00 0 0.00 0.00 0 0.00 36 0 64 0 0
tty wd0 cd0 cpu
tin tout KB/t t/s MB/s KB/t t/s MB/s us ni sy in id
0 131 0.00 0 0.00 0.00 0 0.00 31 0 69 0 0
0 244 0.00 0 0.00 0.00 0 0.00 29 0 71 0 0
0 259 0.00 0 0.00 0.00 0 0.00 31 0 69 0 0
0 131 0.00 0 0.00 0.00 0 0.00 29 0 71 0 0
0 130 0.00 0 0.00 0.00 0 0.00 30 0 70 0 0
0 131 0.00 0 0.00 0.00 0 0.00 36 0 64 0 0
0 354 0.00 0 0.00 0.00 0 0.00 22 0 38 0 40
netstat -i -w 1
------------------
lo0 in lo0 out total in total out
packets errs packets errs colls packets errs packets errs coll
0 0 0 0 0 18 0 9 0 0
0 0 0 0 0 12 0 7 0 0
0 0 0 0 0 17 0 9 0 0
0 0 0 0 0 10 0 92 0 0
0 0 0 0 0 14 0 192 0 0
0 0 0 0 0 3 0 183 0 0
0 0 0 0 0 4 0 182 0 0
0 0 0 0 0 2 0 182 0 0
0 0 0 0 0 3 0 182 0 0
0 0 0 0 0 4 0 184 0 0
0 0 0 0 0 5 0 183 0 0
0 0 0 0 0 2 0 182 0 0
0 0 0 0 0 3 0 182 0 0
0 0 0 0 0 3 0 84 0 0
0 0 0 0 0 7 0 8 0 0
fuul# ./iperf -c 192.168.0.5 -u
------------------------------------------------------------
Client connecting to 192.168.0.5, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 9.00 KByte (default)
------------------------------------------------------------
[ 5] local 192.168.0.7 port 35103 connected with 192.168.0.5 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec 0.003 ms 0/ 893 (0%)
[ 5] Sent 893 datagrams
fuul# ^C
fuul#
full dmesg
------------
OpenBSD 3.7 (GENERIC) #50: Sun Mar 20 00:01:57 MST 2005
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) XEON(TM) CPU 1.80GHz ("GenuineIntel" 686-class) 1.79 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
real mem = 536453120 (523880K)
avail mem = 482713600 (471400K)
using 4278 buffers containing 26927104 bytes (26296K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(77) BIOS, date 01/07/02, BIOS32 rev. 0 @ 0xfb3b0
apm0 at bios0: Power Management spec V1.2
apm0: AC on, battery charge unknown
pcibios0 at bios0: rev 2.1 @ 0xf0000/0xdf84
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfded0/176 (9 entries)
pcibios0: PCI Exclusive IRQs: 5 10 11 12
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82371SB ISA" rev 0x00)
pcibios0: PCI bus #4 is the last bus
bios0: ROM list: 0xc0000/0x9400
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel 82860 Host" rev 0x04: rng active,
9Kb/sec
ppb0 at pci0 dev 1 function 0 "Intel 82850/82860 AGP" rev 0x04
pci1 at ppb0 bus 1
vga1 at pci1 dev 0 function 0 "Nvidia Vanta" rev 0x15
wsdisplay0 at vga1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ppb1 at pci0 dev 2 function 0 "Intel 82860 PCI-PCI" rev 0x04
pci2 at ppb1 bus 2
ppb2 at pci2 dev 31 function 0 "Intel 82806AA PCI64" rev 0x03
pci3 at ppb2 bus 3
"Intel 82806AA PCI64 APIC" rev 0x01 at pci3 dev 0 function 0 not configured
skc0 at pci3 dev 1 function 0 "Schneider & Koch SK-9821 v2.0" rev 0x20:
irq 11
skc0: Marvell Yukon Gigabit Ethernet (0x1)
sk0 at skc0 port A: address 00:00:5a:9f:37:88
eephy0 at sk0 phy 0: Marvell 88E1011 Gigabit PHY, rev. 3
ppb3 at pci0 dev 30 function 0 "Intel 82801BA AGP" rev 0x04
pci4 at ppb3 bus 4
skc1 at pci4 dev 2 function 0 "Schneider & Koch SK-9821 v2.0" rev 0x20:
irq 11
skc1: Marvell Yukon Gigabit Ethernet (0x1)
sk1 at skc1 port A: address 00:00:5a:9f:16:92
eephy1 at sk1 phy 0: Marvell 88E1011 Gigabit PHY, rev. 3
fxp0 at pci4 dev 4 function 0 "Intel 82557" rev 0x08, i82559: irq 10,
address 00:30:48:22:d2:d2
inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
ichpcib0 at pci0 dev 31 function 0 "Intel 82801BA LPC" rev 0x04
pciide0 at pci0 dev 31 function 1 "Intel 82801BA IDE" rev 0x04: DMA,
channel 0 wired to compatibility, channel 1 wired to compatibility
wd0 at pciide0 channel 0 drive 0: <Maxtor 6E040L0>
wd0: 16-sector PIO, LBA, 39205MB, 80293248 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <, 50X CD-ROM, 5.3A> SCSI0 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
"Intel 82801BA SMBus" rev 0x04 at pci0 dev 31 function 3 not configured
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0 (mux 1 ignored for console): console keyboard, using
wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
sysbeep0 at pcppi0
lm0 at isa0 port 0x290/8: W83627HF
npx0 at isa0 port 0xf0/16: using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
biomask f3fd netmask fffd ttymask ffff
pctr: user-level cycle counter enabled
dkcsum: wd0 matched BIOS disk 80
root on wd0a
rootdev=0x0 rrootdev=0x300 rawdev=0x302
