> -----Original Message----- > From: Hank Liu [mailto:hank.tz...@gmail.com] > Sent: Wednesday, September 07, 2016 9:37 AM > To: e1000-devel@lists.sourceforge.net > Subject: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP > performance issue > > I run into 10G card performance issue. Here is my test setup, > > . optical cable p2p between sender and receiver machines on eth2 port. > . both ends have Intel 82599 card with 4.x (4.0, 4.3.5, 4.4.6) ixgbe linux > driver . > host machines are 2 sockets E5 Intel server with 64G memory on board . OS is > Centos 7 build 1511. > . UDP multicast traffic sent from sender to receiver. Receiver has very little > send traffic . Packet payload size is 1316 or 1372. No small packet. > > Problem: Seeing a lot flow control packets sent from receiver end to sender, > hence performance drop when bw above 7 Gbps. If flow control is tuned off, > seeing a lot of rx_no_dma_resources. Note: Sender has no problem to catch up > BW request. > > Tune has been done in Rx side are, > . IRQ balance on / off > . RSC queue # > . Rx ring size - up to 4096 > . rx_back_log size > . interrupt modulation > . pin worker threads on right side CPUs (same socket) > > I was not able to make the BW go higher than 8 Gpbs reliably (no packet drop > or slow down). Any suggestion? Thanks! > > > Hank
If I had to guess what is happening it would be that all your traffic is going to one queue and thus you're work load is only being processed by one CPU. This would be easy to verify by looking that your interrupt distribution in /proc/interrupts both before and after your test. It would also be interesting to check for anything out of the ordinary in the system log as well as the bus layout (lspci -vvv). Thanks, -Don Skidmore <donald.c.skidm...@intel.com> ------------------------------------------------------------------------------ _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
