Hi,
I already dont know where to ask...so I will try it here :)...my problem is
called *rx_missed_errors* :), i've spent days trying to tune it somehow but
still with no success.
I've got 2 pretty nice computers - NUMA - 2x Xeon 5620 (quad-core)...2x dual
port 10GE NIC - Intel 82599 controller..
Lets imagine very simple scenario:
generator - sink
where generator and switch are computers running Linux 2.6.39 with 3.3.9
ixgbe driver
Using pktgen i generate 64B packets...lets say 10 Mpps - receiving port at
sink.
I generated 100M pacekts.
smp affinity is configured
flow control is off
At sink check ethtool -S eth0
NIC statistics:
rx_packets: 68097737
rx_missed_errors: 31902263
rx_pkts_nic: 68097737
Received packets are nicely balanced between 16 Rx queues...but 31M packets
is lost. CPUs are idle 90% times (you can check attached mpstat-rx.txt)
I wanted to tune a bit interrupt coalesce - but ethtool -C eth0 does not
allow me to set anything else than rx-usecs - i've increased it but with no
luck.
So my questions are:
1) is there any way how to tune interrupt moderation?
2) Am I missing something?? I would expect that since all cores are mostly
idle there should be a way how to tune driver so it actually can perform
well even under heavy load with 64B packets.
3) Another scenario is generator - (eth0)bridge - sink....in this case there
is 84% packet loss!! at the receiving interface and CPU cores are still
mostly idle (90%)
Please if you could help me a bit...I would be very happy :). Its almost
matter of life..
Thanks
Radim
--
Radim Roška
08:53:09 AM CPU %usr %nice %sys %iowait %irq %soft %steal
%guest %idle
08:53:14 AM all 0.00 0.00 0.00 0.00 0.00 10.49 0.00
0.00 89.51
08:53:14 AM 0 0.00 0.00 0.00 0.00 0.00 15.43 0.00
0.00 84.57
08:53:14 AM 1 0.00 0.00 0.00 0.00 0.00 12.20 0.00
0.00 87.80
08:53:14 AM 2 0.00 0.00 0.00 0.00 0.00 9.60 0.00
0.00 90.40
08:53:14 AM 3 0.00 0.00 0.00 0.00 0.00 10.77 0.00
0.00 89.23
08:53:14 AM 4 0.00 0.00 0.00 0.00 0.00 9.80 0.00
0.00 90.20
08:53:14 AM 5 0.00 0.00 0.00 0.00 0.00 9.88 0.00
0.00 90.12
08:53:14 AM 6 0.00 0.00 0.00 0.00 0.00 11.40 0.00
0.00 88.60
08:53:14 AM 7 0.00 0.00 0.00 0.00 0.00 10.20 0.00
0.00 89.80
08:53:14 AM 8 0.00 0.00 0.00 0.00 0.00 7.00 0.00
0.00 93.00
08:53:14 AM 9 0.00 0.00 0.00 0.00 0.00 11.80 0.00
0.00 88.20
08:53:14 AM 10 0.00 0.00 0.00 0.00 0.00 10.20 0.00
0.00 89.80
08:53:14 AM 11 0.00 0.00 0.00 0.00 0.00 8.67 0.00
0.00 91.33
08:53:14 AM 12 0.00 0.00 0.00 0.00 0.00 13.60 0.00
0.00 86.40
08:53:14 AM 13 0.00 0.00 0.00 0.00 0.00 7.91 0.00
0.00 92.09
08:53:14 AM 14 0.00 0.00 0.00 0.00 0.00 9.60 0.00
0.00 90.40
08:53:14 AM 15 0.00 0.00 0.00 0.00 0.00 9.74 0.00
0.00 90.26
------------------------------------------------------------------------------
What Every C/C++ and Fortran developer Should Know!
Read this article and learn how Intel has extended the reach of its
next-generation tools to help Windows* and Linux* C/C++ and Fortran
developers boost performance applications - including clusters.
http://p.sf.net/sfu/intel-dev2devmay
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired