Thanks for the detailed report, we will try to reproduce this ASAP, but it may be a few days.
The behavior as described doesn't seem normal for the workload. The only other information I see that would be useful is the ethtool -S output from each of the active ports. -----Original Message----- From: Wim [mailto:wimwerk...@gmail.com] Sent: Tuesday, August 18, 2015 6:03 AM To: e1000-devel@lists.sourceforge.net Subject: [E1000-devel] i40e - enabling forwarding causes ~100% ksoftirqd on all CPU's Hi, We’re upgrading our (old) infrastructure with X520 cards to new servers with X710 cards. The system currently tested on is a NAT router with traffic around 3Gbps throughput. The moment I'm failing over from the old system to the new setup, the ksoftirqd/X on all cores (bound with the irq_affinity script) take ~100% CPU. (the old system has no noticeable ksoftirqd CPU usage) I tried different kernels (4.1.5, 3.18.20), using the in-kernel i40e driver or the out-of-tree on sf.net Debug information below is made using latest i40e on sf.net and 4.1.5 kernel Settings used: - ethtool -L $nic combined 24 (also tried with default settings (56 RSS)) - ethtool -K $nic gro off - ethtool -C $nic tx-usecs 512 rx-usecs 512 adaptive-rx off adaptive-tx off - ethtool -K $nic ntuple off - set_irq_affinity ALL $nic Driver/firmware kernel: i40e: Intel(R) Ethernet Connection XL710 Network Driver - version 1.3.38 kernel: i40e: Copyright (c) 2013 - 2015 Intel Corporation. kernel: i40e 0000:0b:00.0: fw 4.33.31377 api 1.2 nvm 4.42 0x8000191b 0.0.0 Kernel config http://pastebin.com/NTdqmuLb Dmesg http://pastebin.com/5rhJv2wg (old i40e driver is loaded in dmesg, is unloaded later and loaded by one specified above) CPU0 function trace : http://filebin.ca/2CZ3cOxWfB6d/cpu0-function CPU1 function trace: http://filebin.ca/2CZ3vRlf6DsM/cpu1-function CPU0 function-graph trace: http://filebin.ca/2CZ44BmJYzol/cpu0-function-graph CPU1 function-graph trace: http://filebin.ca/2CZ4IErnAFPr/cpu1-function-graph Let me know if you need more information or debugs Thanks, Wim ------------------------------------------------------------------------------ _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
