Hi Everyone
We recently purchased an Intel PRO/1000 GT Quad Port network card and
decided to run some stress tests to make sure it could maintain gigabit
connections on all four ports at the same time. I ran the test with five
computers and iperf-1.7.0 (newest version of iperf has speed issues with
OpenBSD). The computer with the NIC ran the iperf server in upd mode and
the four other machines ran as iperf upd clients.
The first test was using the GENERIC kernel
2 ports could sustain 900Mbit/s connections with about 30% packet drop rate
3 ports could sustain 900Mbit/s connections with about 80% packet drop rate
4 ports could sustain 900Mbit/s connections with about 95-99% packet drop
rate
The second test was using the GENERIC.MP kernel
2 ports could sustain 900Mbit/s connections with no dropped packets
3 ports could sustain 900Mbit/s connections with about 10% packet drop rate
4 ports could sustain 900Mbit/s connections with about 30-50% packet drop
rate
The only disturbing thing about these tests was that I also did the same
test on Gentoo, and I could sustain 4 900Mbit/s connections with only a 3%
drop rate. I found consisten results with the PRO/1000 MT Dual Port card
as well, which has the same controller, the Intel 82546GB. I then tried
the dual port card on FreeBSD FreeBSD 6.1 with the stock install which
does not appear to use multiprocessors and it could maintain 2 ports at
900Mbit/s without losing packets. Unfortunately FreeBSD 6.1 does not
appear to support the 4 port card.
I did some tests on an OpenBSD 3.8 machine and found the same problem.
Is there any explanation for the speed difference? I have tried tweeking
some sysctl values to no avail. Is there something else I can test for on
the card? I'd be happy to run these tests again for any changes that are
made.
Here is the demsg of the test machine:
OpenBSD 4.2-current (GENERIC) #9: Thu Oct 18 16:44:39 UTC 2007
[EMAIL PROTECTED]:/sysHEAD/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Core(TM)2 Quad CPU @ 2.40GHz ("GenuineIntel" 686-class)
2.40 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,CX16,
xTPR
real mem = 3756482560 (3582MB)
avail mem = 3648778240 (3479MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 08/25/07, BIOS32 rev. 0 @ 0xfd470,
SMBIOS rev. 2.51 @ 0xdfeea000 (31 entries)
bios0: vendor Phoenix Technologies LTD version "6.00" date 08/25/2007
bios0: Supermicro PDSMi
pcibios0 at bios0: rev 2.1 @ 0xfd470/0xb90
pcibios0: PCI BIOS has 20 Interrupt Routing table entries
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82801GB LPC" rev 0x00)
pcibios0: PCI bus #15 is the last bus
bios0: ROM list: 0xc0000/0xb000 0xcb000/0x1000 0xcc000/0x1000
acpi at mainbus0 not configured
ipmi at mainbus0 not configured
cpu0 at mainbus0
cpu0: Enhanced SpeedStep disabled by BIOS
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel E7230 MCH" rev 0xc0
ppb0 at pci0 dev 1 function 0 "Intel E7230 PCIE" rev 0xc0
pci1 at ppb0 bus 1
ppb1 at pci0 dev 28 function 0 "Intel 82801GB PCIE" rev 0x01
pci2 at ppb1 bus 9
ppb2 at pci2 dev 0 function 0 "Intel PCIE-PCIE" rev 0x09
pci3 at ppb2 bus 10
ppb3 at pci3 dev 1 function 0 "Pericom PI7C21P100 PCIX-PCIX" rev 0x01
pci4 at ppb3 bus 11
em0 at pci4 dev 4 function 0 "Intel PRO/1000MT QP (82546GB)" rev 0x03: irq
11, address 00:1b:21:0e:c2:ec
em1 at pci4 dev 4 function 1 "Intel PRO/1000MT QP (82546GB)" rev 0x03: irq
11, address 00:1b:21:0e:c2:ed
em2 at pci4 dev 6 function 0 "Intel PRO/1000MT QP (82546GB)" rev 0x03: irq
5, address 00:1b:21:0e:c2:ee
em3 at pci4 dev 6 function 1 "Intel PRO/1000MT QP (82546GB)" rev 0x03: irq
11, address 00:1b:21:0e:c2:ef
"Intel IOxAPIC" rev 0x09 at pci2 dev 0 function 1 not configured
ppb4 at pci0 dev 28 function 4 "Intel 82801G PCIE" rev 0x01
pci5 at ppb4 bus 13
em4 at pci5 dev 0 function 0 "Intel PRO/1000MT (82573E)" rev 0x03: irq 11,
address 00:30:48:8a:2e:7c
ppb5 at pci0 dev 28 function 5 "Intel 82801G PCIE" rev 0x01
pci6 at ppb5 bus 14
em5 at pci6 dev 0 function 0 "Intel PRO/1000MT (82573L)" rev 0x00: irq 11,
address 00:30:48:8a:2e:7d
uhci0 at pci0 dev 29 function 0 "Intel 82801GB USB" rev 0x01: irq 10
uhci1 at pci0 dev 29 function 1 "Intel 82801GB USB" rev 0x01: irq 11
uhci2 at pci0 dev 29 function 2 "Intel 82801GB USB" rev 0x01: irq 5
uhci3 at pci0 dev 29 function 3 "Intel 82801GB USB" rev 0x01: irq 11
ehci0 at pci0 dev 29 function 7 "Intel 82801GB USB" rev 0x01: irq 10
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BA AGP" rev 0xe1
pci7 at ppb6 bus 15
vga1 at pci7 dev 0 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ichpcib0 at pci0 dev 31 function 0 "Intel 82801GB LPC" rev 0x01: PM
disabled
pciide0 at pci0 dev 31 function 2 "Intel 82801GB SATA" rev 0x01: DMA,
channel 0 wired to compatibility, channel 1 wired to compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500YS-01SHB0>
wd0: 16-sector PIO, LBA48, 239372MB, 490234752 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <TEAC, CD-224E-N, 1.AA> SCSI0 5/cdrom
removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
ichiic0 at pci0 dev 31 function 3 "Intel 82801GB SMBus" rev 0x01: irq 11
iic0 at ichiic0
lm1 at iic0 addr 0x2d: W83627HF
wbng0 at iic0 addr 0x2f: w83793g
spdmem0 at iic0 addr 0x50: DDR2 SDRAM ECC PC2-5300CL5
spdmem1 at iic0 addr 0x51: DDR2 SDRAM ECC PC2-5300CL5
spdmem2 at iic0 addr 0x52: DDR2 SDRAM ECC PC2-5300CL5
spdmem3 at iic0 addr 0x53: DDR2 SDRAM ECC PC2-5300CL5
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
lm0 at isa0 port 0x290/8: W83627HF
lm1 detached
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
biomask ef65 netmask ef65 ttymask ffe7
pctr: 686-class user-level performance counters enabled
mtrr: Pentium Pro MTRR support
dkcsum: wd0 matches BIOS drive 0x80
root on wd0a swap on wd0b dump on wd0b
Thank You
Jonathan Steel
