Hello,
I am building a line of WAN emulators using Supermicro X9SCV-Q-0 motherboards
(82579LM and 82574L Gigabit Network Connections). This WAN emulator will not
be very good if it discards packets when the user has not asked for that
behavior. So, I am concerned about dropped packets. As a test of the NICs, I
am trying to transmit UDP packets from one system to another using netperf in
the following configuration:
first X9SCV-Q-0 motherboard -> eth1 -> 3ft cat6 cable -> eth0 -> second
X9SCV-Q-0 motherboard
A general summary of the testing is as follows:
test 880,000 packets from transmitter to receiver
transmitter:
880,021 packets sent total
880,002 of those were UDP
receiver:
879,999 packets received total
879,980 of those were udp
It appears that 22 of my packets have disappeared without a trace.
Below is a rather lengthy summary of the commands I have used to run the test
and look at the network statistics.
It is possible that I may have missed something so any help is appreciated.
Best,
Joe Wilhelmi
AMERGINT Technologies
The test results are as follows:
netperf -H 192.168.4.4 -b 440 -w 1 -t UDP_STREAM -- -m 1472
MIGRATED UDP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.4.4
() port 0 AF_INET : interval
Socket Message Elapsed Messages
Size Size Time Okay Errors Throughput
bytes bytes secs # # 10^6bits/sec
167772160 1472 10.00 440000 0 518.03
167772160 10.00 440000 518.03
netperf -H 192.168.4.4 -b 440 -w 1 -t UDP_STREAM -- -m 1472
MIGRATED UDP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.4.4
() port 0 AF_INET : interval
Socket Message Elapsed Messages
Size Size Time Okay Errors Throughput
bytes bytes secs # # 10^6bits/sec
167772160 1472 10.00 440000 0 517.95
167772160 10.00 439978 517.93
<----------------------------
Transmitter:
ifconfig:
Before:
eth0 Link encap:Ethernet HWaddr 00:25:90:54:5D:B2
inet addr:10.0.200.154 Bcast:10.0.255.255 Mask:255.255.0.0
inet6 addr: fe80::225:90ff:fe54:5db2/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:409166 errors:0 dropped:0 overruns:0 frame:0
TX packets:12651 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:60659152 (57.8 MiB) TX bytes:3546755 (3.3 MiB)
Interrupt:58 Memory:f7d00000-f7d20000
eth1 Link encap:Ethernet HWaddr 00:25:90:54:5D:B3
inet addr:192.168.4.1 Bcast:192.168.4.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe54:5db3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:157 errors:0 dropped:0 overruns:0 frame:0
TX packets:9018272 errors:0 dropped:0 overruns:0 carrier:0
<------------------
collisions:0 txqueuelen:10000
RX bytes:53786 (52.5 KiB) TX bytes:13512252008 (12.5 GiB)
Interrupt:177 Memory:f7c00000-f7c20000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:66786 errors:0 dropped:0 overruns:0 frame:0
TX packets:66786 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3779496 (3.6 MiB) TX bytes:3779496 (3.6 MiB)
After:
eth0 Link encap:Ethernet HWaddr 00:25:90:54:5D:B2
inet addr:10.0.200.154 Bcast:10.0.255.255 Mask:255.255.0.0
inet6 addr: fe80::225:90ff:fe54:5db2/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:409166 errors:0 dropped:0 overruns:0 frame:0
TX packets:12651 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:60659152 (57.8 MiB) TX bytes:3546755 (3.3 MiB)
Interrupt:58 Memory:f7d00000-f7d20000
eth1 Link encap:Ethernet HWaddr 00:25:90:54:5D:B3
inet addr:192.168.4.1 Bcast:192.168.4.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe54:5db3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:172 errors:0 dropped:0 overruns:0 frame:0
TX packets:9898293 errors:0 dropped:0 overruns:0 carrier:0
<------------------
collisions:0 txqueuelen:10000
RX bytes:58722 (57.3 KiB) TX bytes:14844575962 (13.8 GiB)
Interrupt:177 Memory:f7c00000-f7c20000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:66974 errors:0 dropped:0 overruns:0 frame:0
TX packets:66974 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3790118 (3.6 MiB) TX bytes:3790118 (3.6 MiB)
Transmitter:
netstat -s:
Before:
Ip:
320351 total packets received
2116 with invalid addresses
0 forwarded
0 incoming packets discarded
311945 incoming packets delivered
3377638 requests sent out
1 fragments dropped after timeout
1456 reassemblies required
343 packets reassembled ok
1 packet reassembles failed
130000 fragments received ok
5850000 fragments created
Icmp:
1 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
destination unreachable: 1
1 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 1
IcmpMsg:
InType3: 1
OutType3: 1
Tcp:
23 active connections openings
223 passive connection openings
0 failed connection attempts
0 connection resets received
4 connections established
90242 segments received
79569 segments send out
0 segments retransmited
0 bad segments received.
42 resets sent
Udp:
40167 packets received
0 packets to unknown port received.
0 packet receive errors
3298064 packets sent <------------------
TcpExt:
2 invalid SYN cookies received
24 TCP sockets finished time wait in fast timer
52 delayed acks sent
17091 packets directly queued to recvmsg prequeue.
117648 packets directly received from backlog
153514 packets directly received from prequeue
904 packets header predicted
30127 packets header predicted and directly queued to user
11534 acknowledgments not containing data received
33381 predicted acknowledgments
0 TCP data loss events
IpExt:
InMcastPkts: 92101
OutMcastPkts: 32
InBcastPkts: 135818
After:
Ip:
320549 total packets received
2116 with invalid addresses
0 forwarded
0 incoming packets discarded
312143 incoming packets delivered
4257842 requests sent out
1 fragments dropped after timeout
1456 reassemblies required
343 packets reassembled ok
1 packet reassembles failed
130000 fragments received ok
5850000 fragments created
Icmp:
1 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
destination unreachable: 1
1 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 1
IcmpMsg:
InType3: 1
OutType3: 1
Tcp:
25 active connections openings
223 passive connection openings
0 failed connection attempts
0 connection resets received
4 connections established
90440 segments received
79771 segments send out
0 segments retransmited
0 bad segments received.
42 resets sent
Udp:
40167 packets received
0 packets to unknown port received.
0 packet receive errors
4178066 packets sent <------------------
TcpExt:
2 invalid SYN cookies received
26 TCP sockets finished time wait in fast timer
52 delayed acks sent
17138 packets directly queued to recvmsg prequeue.
117954 packets directly received from backlog
153937 packets directly received from prequeue
908 packets header predicted
30208 packets header predicted and directly queued to user
11538 acknowledgments not containing data received
33473 predicted acknowledgments
0 TCP data loss events
IpExt:
InMcastPkts: 92101
OutMcastPkts: 32
InBcastPkts: 135818
Transmitter:
ethtool -S eth1
Before:
NIC statistics:
rx_packets: 157
tx_packets: 9018272 <------------------
rx_bytes: 54414
tx_bytes: 13548297981
rx_broadcast: 2
tx_broadcast: 11
rx_multicast: 0
tx_multicast: 39
rx_errors: 0
tx_errors: 0
tx_dropped: 0
multicast: 0
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 0
rx_frame_errors: 0
rx_no_buffer_count: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_window_errors: 0
tx_abort_late_coll: 0
tx_deferred_ok: 0
tx_single_coll_ok: 0
tx_multi_coll_ok: 0
tx_timeout_count: 0
tx_restart_queue: 196345
rx_long_length_errors: 0
rx_short_length_errors: 0
rx_align_errors: 0
tx_tcp_seg_good: 0
tx_tcp_seg_failed: 0
rx_flow_control_xon: 0
rx_flow_control_xoff: 0
tx_flow_control_xon: 0
tx_flow_control_xoff: 0
rx_long_byte_count: 54414
rx_csum_offload_good: 149
rx_csum_offload_errors: 0
rx_header_split: 0
alloc_rx_buff_failed: 0
tx_smbus: 0
rx_smbus: 0
dropped_smbus: 0
rx_dma_failed: 0
tx_dma_failed: 0
After:
NIC statistics:
rx_packets: 172
tx_packets: 9898293 <------------------
rx_bytes: 59410
tx_bytes: 14884136001
rx_broadcast: 2
tx_broadcast: 12
rx_multicast: 0
tx_multicast: 39
rx_errors: 0
tx_errors: 0
tx_dropped: 0
multicast: 0
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 0
rx_frame_errors: 0
rx_no_buffer_count: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_window_errors: 0
tx_abort_late_coll: 0
tx_deferred_ok: 0
tx_single_coll_ok: 0
tx_multi_coll_ok: 0
tx_timeout_count: 0
tx_restart_queue: 246972
rx_long_length_errors: 0
rx_short_length_errors: 0
rx_align_errors: 0
tx_tcp_seg_good: 0
tx_tcp_seg_failed: 0
rx_flow_control_xon: 0
rx_flow_control_xoff: 0
tx_flow_control_xon: 0
tx_flow_control_xoff: 0
rx_long_byte_count: 59410
rx_csum_offload_good: 163
rx_csum_offload_errors: 0
rx_header_split: 0
alloc_rx_buff_failed: 0
tx_smbus: 0
rx_smbus: 0
dropped_smbus: 0
rx_dma_failed: 0
tx_dma_failed: 0
Receiver:
ifconfig:
Before:
eth0 Link encap:Ethernet HWaddr 00:25:90:7B:77:88
inet addr:192.168.4.4 Bcast:192.168.4.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe7b:7788/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:318371976 errors:39 dropped:0 overruns:0 frame:23
<----------------------------
TX packets:400337 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:10000
RX bytes:473380019506 (440.8 GiB) TX bytes:26825164 (25.5 MiB)
Interrupt:58 Memory:f7d00000-f7d20000
eth1 Link encap:Ethernet HWaddr 00:25:90:7B:77:89
inet addr:192.168.5.4 Bcast:192.168.5.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe7b:7789/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:1408486 errors:0 dropped:0 overruns:0 frame:0
TX packets:502091 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:360505948 (343.8 MiB) TX bytes:153543638 (146.4 MiB)
Interrupt:177 Memory:f7c00000-f7c20000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:134980 errors:0 dropped:0 overruns:0 frame:0
TX packets:134980 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7632793 (7.2 MiB) TX bytes:7632793 (7.2 MiB)
After:
eth0 Link encap:Ethernet HWaddr 00:25:90:7B:77:88
inet addr:192.168.4.4 Bcast:192.168.4.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe7b:7788/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:319251975 errors:39 dropped:0 overruns:0 frame:23
<----------------------------
TX packets:400352 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:10000
RX bytes:474712310206 (442.1 GiB) TX bytes:26830082 (25.5 MiB)
Interrupt:58 Memory:f7d00000-f7d20000
eth1 Link encap:Ethernet HWaddr 00:25:90:7B:77:89
inet addr:192.168.5.4 Bcast:192.168.5.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe7b:7789/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:1408486 errors:0 dropped:0 overruns:0 frame:0
TX packets:502091 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:360505948 (343.8 MiB) TX bytes:153543638 (146.4 MiB)
Interrupt:177 Memory:f7c00000-f7c20000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:135748 errors:0 dropped:0 overruns:0 frame:0
TX packets:135748 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7676185 (7.3 MiB) TX bytes:7676185 (7.3 MiB)
Receiver:
netstat -s:
Before:
Ip:
319683146 total packets received
116238 with invalid addresses
0 forwarded
0 incoming packets discarded
202048032 incoming packets delivered
1036918 requests sent out
40 fragments dropped after timeout
119997677 reassemblies required
2714030 packets reassembled ok
2121 packet reassembles failed
Icmp:
21 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
destination unreachable: 9
echo requests: 4
echo replies: 8
469 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 457
echo request: 8
echo replies: 4
IcmpMsg:
InType0: 8
InType3: 9
InType8: 4
OutType0: 4
OutType3: 457
OutType8: 8
Tcp:
6 active connections openings
423 passive connection openings
1 failed connection attempts
1 connection resets received
6 connections established
1862551 segments received
1035613 segments send out
800 segments retransmited
0 bad segments received.
623 resets sent
Udp:
199990031 packets received <----------------------------
0 packets to unknown port received.
101316 packet receive errors
32 packets sent
TcpExt:
1 invalid SYN cookies received
1 resets received for embryonic SYN_RECV sockets
8 ICMP packets dropped because they were out-of-window
324 TCP sockets finished time wait in fast timer
421 delayed acks sent
Quick ack mode was activated 132 times
773764 packets directly queued to recvmsg prequeue.
42258403 packets directly received from backlog
1106777629 packets directly received from prequeue
257240 packets header predicted
843778 packets header predicted and directly queued to user
385486 acknowledgments not containing data received
72373 predicted acknowledgments
4 times recovered from packet loss due to SACK data
338 congestion windows recovered after partial ack
5 TCP data loss events
38 timeouts after SACK recovery
6 fast retransmits
735 other TCP timeouts
157 DSACKs sent for old packets
1 DSACKs received
1 connections aborted due to timeout
IpExt:
InMcastPkts: 104732
OutMcastPkts: 32
InBcastPkts: 44032
After:
Ip:
320563904 total packets received
116238 with invalid addresses
0 forwarded
0 incoming packets discarded
202928790 incoming packets delivered
1037692 requests sent out
40 fragments dropped after timeout
119997677 reassemblies required
2714030 packets reassembled ok
2121 packet reassembles failed
Icmp:
21 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
destination unreachable: 9
echo requests: 4
echo replies: 8
469 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 457
echo request: 8
echo replies: 4
IcmpMsg:
InType0: 8
InType3: 9
InType8: 4
OutType0: 4
OutType3: 457
OutType8: 8
Tcp:
6 active connections openings
425 passive connection openings
1 failed connection attempts
1 connection resets received
6 connections established
1863329 segments received
1036387 segments send out
800 segments retransmited
0 bad segments received.
623 resets sent
Udp:
200870011 packets received <----------------------------
0 packets to unknown port received.
101316 packet receive errors
32 packets sent
TcpExt:
1 invalid SYN cookies received
1 resets received for embryonic SYN_RECV sockets
8 ICMP packets dropped because they were out-of-window
324 TCP sockets finished time wait in fast timer
423 delayed acks sent
Quick ack mode was activated 132 times
773954 packets directly queued to recvmsg prequeue.
42259528 packets directly received from backlog
1106779339 packets directly received from prequeue
257240 packets header predicted
844093 packets header predicted and directly queued to user
385490 acknowledgments not containing data received
72759 predicted acknowledgments
4 times recovered from packet loss due to SACK data
338 congestion windows recovered after partial ack
5 TCP data loss events
38 timeouts after SACK recovery
6 fast retransmits
735 other TCP timeouts
157 DSACKs sent for old packets
1 DSACKs received
1 connections aborted due to timeout
IpExt:
InMcastPkts: 104732
OutMcastPkts: 32
InBcastPkts: 44032
Receiver:
ethtool -S eth0
Before:
NIC statistics:
rx_packets: 318320102 <----------------------------
tx_packets: 400337
rx_bytes: 474575517238
tx_bytes: 28430406
rx_broadcast: 13
tx_broadcast: 14
rx_multicast: 31
tx_multicast: 38
rx_errors: 39
tx_errors: 0
tx_dropped: 0
multicast: 31
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 23
rx_frame_errors: 0
rx_no_buffer_count: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_window_errors: 0
tx_abort_late_coll: 0
tx_deferred_ok: 0
tx_single_coll_ok: 0
tx_multi_coll_ok: 0
tx_timeout_count: 0
tx_restart_queue: 0
rx_long_length_errors: 0
rx_short_length_errors: 0
rx_align_errors: 0
tx_tcp_seg_good: 0
tx_tcp_seg_failed: 0
rx_flow_control_xon: 0
rx_flow_control_xoff: 0
tx_flow_control_xon: 0
tx_flow_control_xoff: 0
rx_long_byte_count: 474575517238
rx_csum_offload_good: 198375331
rx_csum_offload_errors: 0
rx_header_split: 0
alloc_rx_buff_failed: 0
tx_smbus: 0
rx_smbus: 0
dropped_smbus: 0
rx_dma_failed: 0
tx_dma_failed: 0
After:
NIC statistics:
rx_packets: 319200101 <----------------------------
tx_packets: 400352
rx_bytes: 475911327934
tx_bytes: 28435402
rx_broadcast: 14
tx_broadcast: 14
rx_multicast: 31
tx_multicast: 38
rx_errors: 39
tx_errors: 0
tx_dropped: 0
multicast: 31
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 23
rx_frame_errors: 0
rx_no_buffer_count: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_window_errors: 0
tx_abort_late_coll: 0
tx_deferred_ok: 0
tx_single_coll_ok: 0
tx_multi_coll_ok: 0
tx_timeout_count: 0
tx_restart_queue: 0
rx_long_length_errors: 0
rx_short_length_errors: 0
rx_align_errors: 0
tx_tcp_seg_good: 0
tx_tcp_seg_failed: 0
rx_flow_control_xon: 0
rx_flow_control_xoff: 0
tx_flow_control_xon: 0
tx_flow_control_xoff: 0
rx_long_byte_count: 475911327934
rx_csum_offload_good: 199255329
rx_csum_offload_errors: 0
rx_header_split: 0
alloc_rx_buff_failed: 0
tx_smbus: 0
rx_smbus: 0
dropped_smbus: 0
rx_dma_failed: 0
tx_dma_failed: 0
------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
