Hi,
I'm working on an app that's supposed to process up to ~4Gbps per 10G
Intel NIC on an HP server (dl360p Gen 8 using Xeon E5-2665 CPUs).
We're using an HP-branded 10G Intel NIC (IIRC it's an X520-SR2, lspci
shows it as:
Ethernet controller: Intel Corporation 82599EB 10-Gigabit SFI/SFP+
Network Connection (rev 01)
Subsystem: Hewlett-Packard Company Ethernet 10Gb 2-port 560SFP+ Adapter)
I'm using Ubuntu 12.04 with the 3.11 kernel and PACKET_RX_RING and
fanout sockets for receiving packets; incoming traffic uses a
predefined set of IPs that are assigned to queues using 'ethtool -U
$DEV ipv4 src-ip ...', and then queues are assigned to cores using a
script that somewhat mimics set_irq_affinity (I can post details if
necessary). Then I have threads pinned to every core processing the
incoming traffic. The distribution logic seems to work as far as I can
tell.
Our problem is, we're trying the maximum workload we want to support
and we're seeing very inconsistent results - there can be a few runs
with no packet drops, and then another run we see rx_no_dma_resources
increment in 'ethtool -S'.
I've seen two older threads about this particular stat:
- one where I found docs for the stat, explaining what it means etc:
http://sourceforge.net/p/e1000/mailman/message/31419811
- one with a possible solution, down to a BIOS setting:
http://sourceforge.net/p/e1000/mailman/message/31900862/
The second looks more helpful to what I need, but I can't seem to find
anything related to ATR or "ageing timer rollover" in the HP BIOS
settings. I've set the "HP Power Profile" to "high performance" and
things got a bit better, but we're still seeing drops. We've tried
ixgbe 3.22.3 and our QA reported that it actually fared worse than the
default driver in the 3.11 Ubuntu kernel.
Any ideas?
We're looking at the DPDK for later releases, but I was wondering if
there's anything we can do about this with the current architecture...
Thanks in advance,
Stefan.
------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
