Hey Stefan, I'm not sure why you are seeing more rx_no_dma_resource on one version of Ubuntu than another. We sadly don't validate against Ubuntu.
What I can tell you is that this count goes up when ether: - The Rx queue is disabled (i.e. during a reset) - No free descriptors in the Rx queue Likewise ATR stands for Application Targeted Receive. It is on by default an attempts to direct patch flows to the CPU which the SYN was sent out on. It assumes a one to one mapping between queue number and CPU number (what the set_irq_affinity script does). If your script is not doing the same it would defiantly undermined ATF and could lead to flows being directed and in correct queue/CPU. Could differences in your script be causing an issue? Thanks, -Don Skidmore <donald.c.skidm...@intel.com> > -----Original Message----- > From: Stefan Puiu [mailto:stefan.p...@gmail.com] > Sent: Monday, December 08, 2014 6:04 AM > To: e1000-devel@lists.sourceforge.net > Subject: [E1000-devel] rx_no_dma_resources woes > > Hi, > > I'm working on an app that's supposed to process up to ~4Gbps per 10G Intel > NIC on an HP server (dl360p Gen 8 using Xeon E5-2665 CPUs). > We're using an HP-branded 10G Intel NIC (IIRC it's an X520-SR2, lspci shows it > as: > > Ethernet controller: Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network > Connection (rev 01) > Subsystem: Hewlett-Packard Company Ethernet 10Gb 2-port 560SFP+ > Adapter) > > I'm using Ubuntu 12.04 with the 3.11 kernel and PACKET_RX_RING and > fanout sockets for receiving packets; incoming traffic uses a predefined set > of IPs that are assigned to queues using 'ethtool -U $DEV ipv4 src-ip ...', > and > then queues are assigned to cores using a script that somewhat mimics > set_irq_affinity (I can post details if necessary). Then I have threads pinned > to every core processing the incoming traffic. The distribution logic seems to > work as far as I can tell. > > Our problem is, we're trying the maximum workload we want to support and > we're seeing very inconsistent results - there can be a few runs with no > packet drops, and then another run we see rx_no_dma_resources > increment in 'ethtool -S'. > > I've seen two older threads about this particular stat: > > - one where I found docs for the stat, explaining what it means etc: > http://sourceforge.net/p/e1000/mailman/message/31419811 > - one with a possible solution, down to a BIOS setting: > http://sourceforge.net/p/e1000/mailman/message/31900862/ > > The second looks more helpful to what I need, but I can't seem to find > anything related to ATR or "ageing timer rollover" in the HP BIOS settings. > I've > set the "HP Power Profile" to "high performance" and things got a bit better, > but we're still seeing drops. We've tried ixgbe 3.22.3 and our QA reported > that it actually fared worse than the default driver in the 3.11 Ubuntu > kernel. > > Any ideas? > > We're looking at the DPDK for later releases, but I was wondering if there's > anything we can do about this with the current architecture... > > Thanks in advance, > Stefan. > > ------------------------------------------------------------------------------ > Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from > Actuate! Instantly Supercharge Your Business Reports and Dashboards with > Interactivity, Sharing, Native Excel Exports, App Integration & more Get > technology previously reserved for billion-dollar corporations, FREE > http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.cl > ktrk > _______________________________________________ > E1000-devel mailing list > E1000-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/e1000-devel > To learn more about Intel® Ethernet, visit > http://communities.intel.com/community/wired ------------------------------------------------------------------------------ Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration & more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
