[repot. The original got messed up format] We have recently got some servers with dual E2620v3 CPUs. Each is equipped with two dual 10G SPF+ ports mezz cards (which are powered by 82599) and an Intel XL710 with Intel QSFP+ DACs. All notes run CentOS 7.1 updated (by me) with the latest stable i40e and ixgbe drivers. Examples:
[root@sc2u0n0 ~]# ethtool -i ens10f0|grep version version: 1.3.38 firmware-version: 4.24 0x800013fc 0.0.0 [root@sc2u0n0 ~]# ethtool -i ens20f0|grep version version: 4.1.2 firmware-version: 0x800004e0, 1.808.0 I have been using iperf3 to test the line rate this afternoon and kept seeing the following. Should I be concerned with such initial retries (which almost almost show up) and in-session retries (which sometimes don't show up). We used to have servers (E2620v2 CPU, so older) with dual 10GbaseT mezz cards powered by X540 chip. I don't recall such a "symptom". Notes: 1. All ports (40G and 10G) have their respective adapter ring buffer size adjusted to 4K 2. All ports have their flow-control turned off 3. I have not run the set_irq_affinity script that comes with the i40e and ixgbe driver sources. I don't quite understand its usage so prefer to know it before using it. The main application running on these servers are highly concurrent and uses a thread-pool. No where I can find info with such an application running, what is the proper way to set irq affinity for NIC cards. A pointer is appreciated. 4. All node's tuned-adm profile is set to network-throughput at this stage. XL710 pairs: $ iperf3 -c 192.168.11.100 -i 1 -t 10 Connecting to host 192.168.11.100, port 5201 [ 4] local 192.168.11.103 port 59351 connected to 192.168.11.100 port 5201 [ ID] Interval Transfer Bandwidth Retr Cwnd [ 4] 0.00-1.00 sec 2.77 GBytes 23.8 Gbits/sec 54 655 KBytes [ 4] 1.00-2.00 sec 4.26 GBytes 36.6 Gbits/sec 0 1.52 MBytes [ 4] 2.00-3.00 sec 4.61 GBytes 39.6 Gbits/sec 0 2.12 MBytes [ 4] 3.00-4.00 sec 4.53 GBytes 38.9 Gbits/sec 0 2.57 MBytes [ 4] 4.00-5.00 sec 4.00 GBytes 34.4 Gbits/sec 7 1.42 MBytes [ 4] 5.00-6.00 sec 4.61 GBytes 39.6 Gbits/sec 0 2.01 MBytes [ 4] 6.00-7.00 sec 4.61 GBytes 39.6 Gbits/sec 0 2.47 MBytes [ 4] 7.00-8.00 sec 4.61 GBytes 39.6 Gbits/sec 0 2.88 MBytes [ 4] 8.00-9.00 sec 4.61 GBytes 39.6 Gbits/sec 0 3.21 MBytes [ 4] 9.00-10.00 sec 4.61 GBytes 39.6 Gbits/sec 0 3.52 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 43.2 GBytes 37.1 Gbits/sec 61 sender [ 4] 0.00-10.00 sec 43.2 GBytes 37.1 Gbits/sec receiver 82599 powered 10G pairs: $ iperf3 -c 192.168.15.100 -i 1 -t 10 Connecting to host 192.168.15.100, port 5201 [ 4] local 192.168.16.101 port 53464 connected to 192.168.15.100 port 5201 [ ID] Interval Transfer Bandwidth Retr Cwnd [ 4] 0.00-1.00 sec 1.05 GBytes 9.05 Gbits/sec 722 1.97 MBytes [ 4] 1.00-2.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.80 MBytes [ 4] 2.00-3.00 sec 1.10 GBytes 9.42 Gbits/sec 23 2.15 MBytes [ 4] 3.00-4.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.16 MBytes [ 4] 4.00-5.00 sec 1.09 GBytes 9.41 Gbits/sec 0 2.16 MBytes [ 4] 5.00-6.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.17 MBytes [ 4] 6.00-7.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.18 MBytes [ 4] 7.00-8.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.22 MBytes [ 4] 8.00-9.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.27 MBytes [ 4] 9.00-10.00 sec 1.10 GBytes 9.42 Gbits/sec 0 2.34 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 10.9 GBytes 9.38 Gbits/sec 745 sender [ 4] 0.00-10.00 sec 10.9 GBytes 9.37 Gbits/sec receiver --Zack ------------------------------------------------------------------------------ _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
