Hi.
I have 3 Dell R620 systems that have dual Intel 10G X540-AT2 running
CentOS 7.1 and oVirt virtualization software.
One 10G port on each system is dedicated to the virtualization
management network and is connected to a Netgear XS712T 10G switch.
The CentOS servers are running the default RHEL7.1 ixgbe driver:
Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k-rh7.1
I'm trying to solve two problems, and I wonder if they are related:
First, I notice that there is a significant number of dropped RECEIVED
packets on each system:
virt1:
em1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::baca:3aff:fe69:3048 prefixlen 64 scopeid 0x20<link>
ether b8:ca:3a:69:30:48 txqueuelen 10000 (Ethernet)
RX packets 11903166 bytes 16774665073 (15.6 GiB)
RX errors 0 dropped 21963 overruns 0 frame 0
TX packets 5241750 bytes 7139913009 (6.6 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virt2:
em1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::baca:3aff:fe68:5a70 prefixlen 64 scopeid 0x20<link>
ether b8:ca:3a:68:5a:70 txqueuelen 10000 (Ethernet)
RX packets 6779020 bytes 8608967300 (8.0 GiB)
RX errors 0 dropped 31490 overruns 0 frame 0
TX packets 7959733 bytes 11385832910 (10.6 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virt3: (rebooted today so less dropped packets)
em1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::eef4:bbff:fecb:7d58 prefixlen 64 scopeid 0x20<link>
ether ec:f4:bb:cb:7d:58 txqueuelen 10000 (Ethernet)
RX packets 803 bytes 135730 (132.5 KiB)
RX errors 0 dropped 658 overruns 0 frame 0
TX packets 171 bytes 36333 (35.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
As far as the switch is concerned, there are no errors on any of the ports.
One point is that ovirt sets up the management network with a bridge:
So for example, for virt3 in /etc/sysconfig/network-scripts/ifcfg-em1 I
have:
# Generated by VDSM version 4.16.20-0.el7.centos
DEVICE=em1
HWADDR=ec:f4:bb:cb:7d:58
BRIDGE=ovirtmgmt
ONBOOT=yes
MTU=1500
NM_CONTROLLED=no
... whereis in ifcfg-ovirtmgmt I have:
# Generated by VDSM version 4.16.20-0.el7.centos
DEVICE=ovirtmgmt
TYPE=Bridge
DELAY=0
STP=off
ONBOOT=yes
IPADDR=192.168.0.36
NETMASK=255.255.255.0
GATEWAY=192.168.0.33
BOOTPROTO=none
MTU=1500
DEFROUTE=yes
NM_CONTROLLED=no
HOTPLUG=no
I wonder if this bridge has anything to do with the dropped packets.
I have a virtualization file server that is also connected to the same
management network (but it actually doesn't do much there). On the file
server, em1 is not a bridge, and there are no dropped received packets:
em1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.0.33 netmask 255.255.255.0 broadcast 192.168.0.255
inet6 fe80::eef4:bbff:fed3:6fa8 prefixlen 64 scopeid 0x20<link>
ether ec:f4:bb:d3:6f:a8 txqueuelen 10000 (Ethernet)
RX packets 6371 bytes 514069 (502.0 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 6098 bytes 676657 (660.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Here's the output of ethtool -S em1 on virt1:
NIC statistics:
rx_packets: 11903765
tx_packets: 5242302
rx_bytes: 16774764064
tx_bytes: 7140510813
rx_pkts_nic: 11905848
tx_pkts_nic: 5244053
rx_bytes_nic: 16822640074
tx_bytes_nic: 7162587035
lsc_int: 7
tx_busy: 0
non_eop_descs: 388
rx_errors: 0
tx_errors: 0
rx_dropped: 21977
tx_dropped: 0
multicast: 22179
broadcast: 373
rx_no_buffer_count: 0
collisions: 0
rx_over_errors: 0
rx_crc_errors: 0
rx_frame_errors: 0
hw_rsc_aggregated: 1065
hw_rsc_flushed: 590
fdir_match: 11881235
fdir_miss: 573
fdir_overflow: 0
rx_fifo_errors: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_timeout_count: 0
tx_restart_queue: 0
rx_long_length_errors: 0
rx_short_length_errors: 0
tx_flow_control_xon: 0
rx_flow_control_xon: 0
tx_flow_control_xoff: 0
rx_flow_control_xoff: 0
rx_csum_offload_errors: 0
alloc_rx_page_failed: 0
alloc_rx_buff_failed: 0
rx_no_dma_resources: 0
os2bmc_rx_by_bmc: 0
os2bmc_tx_by_bmc: 0
os2bmc_tx_by_host: 0
os2bmc_rx_by_host: 0
fcoe_bad_fccrc: 0
rx_fcoe_dropped: 0
rx_fcoe_packets: 0
rx_fcoe_dwords: 0
fcoe_noddp: 0
fcoe_noddp_ext_buff: 0
tx_fcoe_packets: 0
tx_fcoe_dwords: 0
tx_queue_0_packets: 347796
tx_queue_0_bytes: 508983990
tx_queue_0_ll_napi_yield: 0
tx_queue_0_ll_misses: 0
tx_queue_0_ll_cleaned: 0
tx_queue_1_packets: 283137
tx_queue_1_bytes: 427306907
tx_queue_1_ll_napi_yield: 0
tx_queue_1_ll_misses: 0
tx_queue_1_ll_cleaned: 0
tx_queue_2_packets: 53662
tx_queue_2_bytes: 55260882
tx_queue_2_ll_napi_yield: 0
tx_queue_2_ll_misses: 0
tx_queue_2_ll_cleaned: 0
tx_queue_3_packets: 1888
tx_queue_3_bytes: 2679299
tx_queue_3_ll_napi_yield: 0
tx_queue_3_ll_misses: 0
tx_queue_3_ll_cleaned: 0
tx_queue_4_packets: 673234
tx_queue_4_bytes: 934185161
tx_queue_4_ll_napi_yield: 0
tx_queue_4_ll_misses: 0
tx_queue_4_ll_cleaned: 0
tx_queue_5_packets: 66890
tx_queue_5_bytes: 59503741
tx_queue_5_ll_napi_yield: 0
tx_queue_5_ll_misses: 0
tx_queue_5_ll_cleaned: 0
tx_queue_6_packets: 131395
tx_queue_6_bytes: 156547126
tx_queue_6_ll_napi_yield: 0
tx_queue_6_ll_misses: 0
tx_queue_6_ll_cleaned: 0
tx_queue_7_packets: 16654
tx_queue_7_bytes: 19854675
tx_queue_7_ll_napi_yield: 0
tx_queue_7_ll_misses: 0
tx_queue_7_ll_cleaned: 0
tx_queue_8_packets: 340783
tx_queue_8_bytes: 479059566
tx_queue_8_ll_napi_yield: 0
tx_queue_8_ll_misses: 0
tx_queue_8_ll_cleaned: 0
tx_queue_9_packets: 29868
tx_queue_9_bytes: 27188814
tx_queue_9_ll_napi_yield: 0
tx_queue_9_ll_misses: 0
tx_queue_9_ll_cleaned: 0
tx_queue_10_packets: 45742
tx_queue_10_bytes: 44928771
tx_queue_10_ll_napi_yield: 0
tx_queue_10_ll_misses: 0
tx_queue_10_ll_cleaned: 0
tx_queue_11_packets: 3760
tx_queue_11_bytes: 3275079
tx_queue_11_ll_napi_yield: 0
tx_queue_11_ll_misses: 0
tx_queue_11_ll_cleaned: 0
tx_queue_12_packets: 308851
tx_queue_12_bytes: 436207881
tx_queue_12_ll_napi_yield: 0
tx_queue_12_ll_misses: 0
tx_queue_12_ll_cleaned: 0
tx_queue_13_packets: 1997
tx_queue_13_bytes: 2056924
tx_queue_13_ll_napi_yield: 0
tx_queue_13_ll_misses: 0
tx_queue_13_ll_cleaned: 0
tx_queue_14_packets: 323609
tx_queue_14_bytes: 455019640
tx_queue_14_ll_napi_yield: 0
tx_queue_14_ll_misses: 0
tx_queue_14_ll_cleaned: 0
tx_queue_15_packets: 784
tx_queue_15_bytes: 846742
tx_queue_15_ll_napi_yield: 0
tx_queue_15_ll_misses: 0
tx_queue_15_ll_cleaned: 0
tx_queue_16_packets: 445537
tx_queue_16_bytes: 602661853
tx_queue_16_ll_napi_yield: 0
tx_queue_16_ll_misses: 0
tx_queue_16_ll_cleaned: 0
tx_queue_17_packets: 316
tx_queue_17_bytes: 322086
tx_queue_17_ll_napi_yield: 0
tx_queue_17_ll_misses: 0
tx_queue_17_ll_cleaned: 0
tx_queue_18_packets: 306307
tx_queue_18_bytes: 432069919
tx_queue_18_ll_napi_yield: 0
tx_queue_18_ll_misses: 0
tx_queue_18_ll_cleaned: 0
tx_queue_19_packets: 213
tx_queue_19_bytes: 183595
tx_queue_19_ll_napi_yield: 0
tx_queue_19_ll_misses: 0
tx_queue_19_ll_cleaned: 0
tx_queue_20_packets: 189956
tx_queue_20_bytes: 258792354
tx_queue_20_ll_napi_yield: 0
tx_queue_20_ll_misses: 0
tx_queue_20_ll_cleaned: 0
tx_queue_21_packets: 1511
tx_queue_21_bytes: 2283163
tx_queue_21_ll_napi_yield: 0
tx_queue_21_ll_misses: 0
tx_queue_21_ll_cleaned: 0
tx_queue_22_packets: 38414
tx_queue_22_bytes: 25482126
tx_queue_22_ll_napi_yield: 0
tx_queue_22_ll_misses: 0
tx_queue_22_ll_cleaned: 0
tx_queue_23_packets: 93
tx_queue_23_bytes: 41830
tx_queue_23_ll_napi_yield: 0
tx_queue_23_ll_misses: 0
tx_queue_23_ll_cleaned: 0
tx_queue_24_packets: 241662
tx_queue_24_bytes: 323813370
tx_queue_24_ll_napi_yield: 0
tx_queue_24_ll_misses: 0
tx_queue_24_ll_cleaned: 0
tx_queue_25_packets: 9
tx_queue_25_bytes: 861
tx_queue_25_ll_napi_yield: 0
tx_queue_25_ll_misses: 0
tx_queue_25_ll_cleaned: 0
tx_queue_26_packets: 13614
tx_queue_26_bytes: 14194609
tx_queue_26_ll_napi_yield: 0
tx_queue_26_ll_misses: 0
tx_queue_26_ll_cleaned: 0
tx_queue_27_packets: 6
tx_queue_27_bytes: 800
tx_queue_27_ll_napi_yield: 0
tx_queue_27_ll_misses: 0
tx_queue_27_ll_cleaned: 0
tx_queue_28_packets: 246686
tx_queue_28_bytes: 315433800
tx_queue_28_ll_napi_yield: 0
tx_queue_28_ll_misses: 0
tx_queue_28_ll_cleaned: 0
tx_queue_29_packets: 1
tx_queue_29_bytes: 327
tx_queue_29_ll_napi_yield: 0
tx_queue_29_ll_misses: 0
tx_queue_29_ll_cleaned: 0
tx_queue_30_packets: 74866
tx_queue_30_bytes: 62069799
tx_queue_30_ll_napi_yield: 0
tx_queue_30_ll_misses: 0
tx_queue_30_ll_cleaned: 0
tx_queue_31_packets: 0
tx_queue_31_bytes: 0
tx_queue_31_ll_napi_yield: 0
tx_queue_31_ll_misses: 0
tx_queue_31_ll_cleaned: 0
tx_queue_32_packets: 743290
tx_queue_32_bytes: 1113863841
tx_queue_32_ll_napi_yield: 0
tx_queue_32_ll_misses: 0
tx_queue_32_ll_cleaned: 0
tx_queue_33_packets: 1
tx_queue_33_bytes: 42
tx_queue_33_ll_napi_yield: 0
tx_queue_33_ll_misses: 0
tx_queue_33_ll_cleaned: 0
tx_queue_34_packets: 54454
tx_queue_34_bytes: 42445885
tx_queue_34_ll_napi_yield: 0
tx_queue_34_ll_misses: 0
tx_queue_34_ll_cleaned: 0
tx_queue_35_packets: 5
tx_queue_35_bytes: 330
tx_queue_35_ll_napi_yield: 0
tx_queue_35_ll_misses: 0
tx_queue_35_ll_cleaned: 0
tx_queue_36_packets: 30543
tx_queue_36_bytes: 16814178
tx_queue_36_ll_napi_yield: 0
tx_queue_36_ll_misses: 0
tx_queue_36_ll_cleaned: 0
tx_queue_37_packets: 0
tx_queue_37_bytes: 0
tx_queue_37_ll_napi_yield: 0
tx_queue_37_ll_misses: 0
tx_queue_37_ll_cleaned: 0
tx_queue_38_packets: 224768
tx_queue_38_bytes: 317130847
tx_queue_38_ll_napi_yield: 0
tx_queue_38_ll_misses: 0
tx_queue_38_ll_cleaned: 0
tx_queue_39_packets: 0
tx_queue_39_bytes: 0
tx_queue_39_ll_napi_yield: 0
tx_queue_39_ll_misses: 0
tx_queue_39_ll_cleaned: 0
tx_queue_40_packets: 0
tx_queue_40_bytes: 0
tx_queue_40_ll_napi_yield: 0
tx_queue_40_ll_misses: 0
tx_queue_40_ll_cleaned: 0
tx_queue_41_packets: 0
tx_queue_41_bytes: 0
tx_queue_41_ll_napi_yield: 0
tx_queue_41_ll_misses: 0
tx_queue_41_ll_cleaned: 0
tx_queue_42_packets: 0
tx_queue_42_bytes: 0
tx_queue_42_ll_napi_yield: 0
tx_queue_42_ll_misses: 0
tx_queue_42_ll_cleaned: 0
tx_queue_43_packets: 0
tx_queue_43_bytes: 0
tx_queue_43_ll_napi_yield: 0
tx_queue_43_ll_misses: 0
tx_queue_43_ll_cleaned: 0
tx_queue_44_packets: 0
tx_queue_44_bytes: 0
tx_queue_44_ll_napi_yield: 0
tx_queue_44_ll_misses: 0
tx_queue_44_ll_cleaned: 0
tx_queue_45_packets: 0
tx_queue_45_bytes: 0
tx_queue_45_ll_napi_yield: 0
tx_queue_45_ll_misses: 0
tx_queue_45_ll_cleaned: 0
tx_queue_46_packets: 0
tx_queue_46_bytes: 0
tx_queue_46_ll_napi_yield: 0
tx_queue_46_ll_misses: 0
tx_queue_46_ll_cleaned: 0
tx_queue_47_packets: 0
tx_queue_47_bytes: 0
tx_queue_47_ll_napi_yield: 0
tx_queue_47_ll_misses: 0
tx_queue_47_ll_cleaned: 0
tx_queue_48_packets: 0
tx_queue_48_bytes: 0
tx_queue_48_ll_napi_yield: 0
tx_queue_48_ll_misses: 0
tx_queue_48_ll_cleaned: 0
tx_queue_49_packets: 0
tx_queue_49_bytes: 0
tx_queue_49_ll_napi_yield: 0
tx_queue_49_ll_misses: 0
tx_queue_49_ll_cleaned: 0
tx_queue_50_packets: 0
tx_queue_50_bytes: 0
tx_queue_50_ll_napi_yield: 0
tx_queue_50_ll_misses: 0
tx_queue_50_ll_cleaned: 0
tx_queue_51_packets: 0
tx_queue_51_bytes: 0
tx_queue_51_ll_napi_yield: 0
tx_queue_51_ll_misses: 0
tx_queue_51_ll_cleaned: 0
tx_queue_52_packets: 0
tx_queue_52_bytes: 0
tx_queue_52_ll_napi_yield: 0
tx_queue_52_ll_misses: 0
tx_queue_52_ll_cleaned: 0
tx_queue_53_packets: 0
tx_queue_53_bytes: 0
tx_queue_53_ll_napi_yield: 0
tx_queue_53_ll_misses: 0
tx_queue_53_ll_cleaned: 0
tx_queue_54_packets: 0
tx_queue_54_bytes: 0
tx_queue_54_ll_napi_yield: 0
tx_queue_54_ll_misses: 0
tx_queue_54_ll_cleaned: 0
tx_queue_55_packets: 0
tx_queue_55_bytes: 0
tx_queue_55_ll_napi_yield: 0
tx_queue_55_ll_misses: 0
tx_queue_55_ll_cleaned: 0
tx_queue_56_packets: 0
tx_queue_56_bytes: 0
tx_queue_56_ll_napi_yield: 0
tx_queue_56_ll_misses: 0
tx_queue_56_ll_cleaned: 0
tx_queue_57_packets: 0
tx_queue_57_bytes: 0
tx_queue_57_ll_napi_yield: 0
tx_queue_57_ll_misses: 0
tx_queue_57_ll_cleaned: 0
tx_queue_58_packets: 0
tx_queue_58_bytes: 0
tx_queue_58_ll_napi_yield: 0
tx_queue_58_ll_misses: 0
tx_queue_58_ll_cleaned: 0
tx_queue_59_packets: 0
tx_queue_59_bytes: 0
tx_queue_59_ll_napi_yield: 0
tx_queue_59_ll_misses: 0
tx_queue_59_ll_cleaned: 0
tx_queue_60_packets: 0
tx_queue_60_bytes: 0
tx_queue_60_ll_napi_yield: 0
tx_queue_60_ll_misses: 0
tx_queue_60_ll_cleaned: 0
tx_queue_61_packets: 0
tx_queue_61_bytes: 0
tx_queue_61_ll_napi_yield: 0
tx_queue_61_ll_misses: 0
tx_queue_61_ll_cleaned: 0
tx_queue_62_packets: 0
tx_queue_62_bytes: 0
tx_queue_62_ll_napi_yield: 0
tx_queue_62_ll_misses: 0
tx_queue_62_ll_cleaned: 0
tx_queue_63_packets: 0
tx_queue_63_bytes: 0
tx_queue_63_ll_napi_yield: 0
tx_queue_63_ll_misses: 0
tx_queue_63_ll_cleaned: 0
rx_queue_0_packets: 234478
rx_queue_0_bytes: 280390341
rx_queue_0_ll_poll_yield: 0
rx_queue_0_ll_misses: 0
rx_queue_0_ll_cleaned: 0
rx_queue_1_packets: 6626
rx_queue_1_bytes: 495976
rx_queue_1_ll_poll_yield: 0
rx_queue_1_ll_misses: 0
rx_queue_1_ll_cleaned: 0
rx_queue_2_packets: 54992
rx_queue_2_bytes: 10777217
rx_queue_2_ll_poll_yield: 0
rx_queue_2_ll_misses: 0
rx_queue_2_ll_cleaned: 0
rx_queue_3_packets: 398
rx_queue_3_bytes: 62726
rx_queue_3_ll_poll_yield: 0
rx_queue_3_ll_misses: 0
rx_queue_3_ll_cleaned: 0
rx_queue_4_packets: 1590200
rx_queue_4_bytes: 2278556061
rx_queue_4_ll_poll_yield: 0
rx_queue_4_ll_misses: 0
rx_queue_4_ll_cleaned: 0
rx_queue_5_packets: 80122
rx_queue_5_bytes: 13706434
rx_queue_5_ll_poll_yield: 0
rx_queue_5_ll_misses: 0
rx_queue_5_ll_cleaned: 0
rx_queue_6_packets: 664994
rx_queue_6_bytes: 954815815
rx_queue_6_ll_poll_yield: 0
rx_queue_6_ll_misses: 0
rx_queue_6_ll_cleaned: 0
rx_queue_7_packets: 16634
rx_queue_7_bytes: 2763942
rx_queue_7_ll_poll_yield: 0
rx_queue_7_ll_misses: 0
rx_queue_7_ll_cleaned: 0
rx_queue_8_packets: 480204
rx_queue_8_bytes: 659519874
rx_queue_8_ll_poll_yield: 0
rx_queue_8_ll_misses: 0
rx_queue_8_ll_cleaned: 0
rx_queue_9_packets: 31023
rx_queue_9_bytes: 5281197
rx_queue_9_ll_poll_yield: 0
rx_queue_9_ll_misses: 0
rx_queue_9_ll_cleaned: 0
rx_queue_10_packets: 57778
rx_queue_10_bytes: 22840487
rx_queue_10_ll_poll_yield: 0
rx_queue_10_ll_misses: 0
rx_queue_10_ll_cleaned: 0
rx_queue_11_packets: 3856
rx_queue_11_bytes: 655934
rx_queue_11_ll_poll_yield: 0
rx_queue_11_ll_misses: 0
rx_queue_11_ll_cleaned: 0
rx_queue_12_packets: 256982
rx_queue_12_bytes: 312270149
rx_queue_12_ll_poll_yield: 0
rx_queue_12_ll_misses: 0
rx_queue_12_ll_cleaned: 0
rx_queue_13_packets: 2306
rx_queue_13_bytes: 376620
rx_queue_13_ll_poll_yield: 0
rx_queue_13_ll_misses: 0
rx_queue_13_ll_cleaned: 0
rx_queue_14_packets: 485099
rx_queue_14_bytes: 668450999
rx_queue_14_ll_poll_yield: 0
rx_queue_14_ll_misses: 0
rx_queue_14_ll_cleaned: 0
rx_queue_15_packets: 706
rx_queue_15_bytes: 113439
rx_queue_15_ll_poll_yield: 0
rx_queue_15_ll_misses: 0
rx_queue_15_ll_cleaned: 0
rx_queue_16_packets: 1057202
rx_queue_16_bytes: 1528021771
rx_queue_16_ll_poll_yield: 0
rx_queue_16_ll_misses: 0
rx_queue_16_ll_cleaned: 0
rx_queue_17_packets: 248
rx_queue_17_bytes: 42723
rx_queue_17_ll_poll_yield: 0
rx_queue_17_ll_misses: 0
rx_queue_17_ll_cleaned: 0
rx_queue_18_packets: 454429
rx_queue_18_bytes: 632305836
rx_queue_18_ll_poll_yield: 0
rx_queue_18_ll_misses: 0
rx_queue_18_ll_cleaned: 0
rx_queue_19_packets: 122
rx_queue_19_bytes: 25058
rx_queue_19_ll_poll_yield: 0
rx_queue_19_ll_misses: 0
rx_queue_19_ll_cleaned: 0
rx_queue_20_packets: 444553
rx_queue_20_bytes: 615374563
rx_queue_20_ll_poll_yield: 0
rx_queue_20_ll_misses: 0
rx_queue_20_ll_cleaned: 0
rx_queue_21_packets: 21
rx_queue_21_bytes: 1386
rx_queue_21_ll_poll_yield: 0
rx_queue_21_ll_misses: 0
rx_queue_21_ll_cleaned: 0
rx_queue_22_packets: 734646
rx_queue_22_bytes: 1101935368
rx_queue_22_ll_poll_yield: 0
rx_queue_22_ll_misses: 0
rx_queue_22_ll_cleaned: 0
rx_queue_23_packets: 24
rx_queue_23_bytes: 9276
rx_queue_23_ll_poll_yield: 0
rx_queue_23_ll_misses: 0
rx_queue_23_ll_cleaned: 0
rx_queue_24_packets: 771829
rx_queue_24_bytes: 1132442605
rx_queue_24_ll_poll_yield: 0
rx_queue_24_ll_misses: 0
rx_queue_24_ll_cleaned: 0
rx_queue_25_packets: 0
rx_queue_25_bytes: 0
rx_queue_25_ll_poll_yield: 0
rx_queue_25_ll_misses: 0
rx_queue_25_ll_cleaned: 0
rx_queue_26_packets: 14553
rx_queue_26_bytes: 2981520
rx_queue_26_ll_poll_yield: 0
rx_queue_26_ll_misses: 0
rx_queue_26_ll_cleaned: 0
rx_queue_27_packets: 0
rx_queue_27_bytes: 0
rx_queue_27_ll_poll_yield: 0
rx_queue_27_ll_misses: 0
rx_queue_27_ll_cleaned: 0
rx_queue_28_packets: 1030142
rx_queue_28_bytes: 1521101454
rx_queue_28_ll_poll_yield: 0
rx_queue_28_ll_misses: 0
rx_queue_28_ll_cleaned: 0
rx_queue_29_packets: 0
rx_queue_29_bytes: 0
rx_queue_29_ll_poll_yield: 0
rx_queue_29_ll_misses: 0
rx_queue_29_ll_cleaned: 0
rx_queue_30_packets: 1418862
rx_queue_30_bytes: 2098502425
rx_queue_30_ll_poll_yield: 0
rx_queue_30_ll_misses: 0
rx_queue_30_ll_cleaned: 0
rx_queue_31_packets: 0
rx_queue_31_bytes: 0
rx_queue_31_ll_poll_yield: 0
rx_queue_31_ll_misses: 0
rx_queue_31_ll_cleaned: 0
rx_queue_32_packets: 207033
rx_queue_32_bytes: 278958071
rx_queue_32_ll_poll_yield: 0
rx_queue_32_ll_misses: 0
rx_queue_32_ll_cleaned: 0
rx_queue_33_packets: 0
rx_queue_33_bytes: 0
rx_queue_33_ll_poll_yield: 0
rx_queue_33_ll_misses: 0
rx_queue_33_ll_cleaned: 0
rx_queue_34_packets: 742052
rx_queue_34_bytes: 1091553722
rx_queue_34_ll_poll_yield: 0
rx_queue_34_ll_misses: 0
rx_queue_34_ll_cleaned: 0
rx_queue_35_packets: 0
rx_queue_35_bytes: 0
rx_queue_35_ll_poll_yield: 0
rx_queue_35_ll_misses: 0
rx_queue_35_ll_cleaned: 0
rx_queue_36_packets: 616129
rx_queue_36_bytes: 912056350
rx_queue_36_ll_poll_yield: 0
rx_queue_36_ll_misses: 0
rx_queue_36_ll_cleaned: 0
rx_queue_37_packets: 0
rx_queue_37_bytes: 0
rx_queue_37_ll_poll_yield: 0
rx_queue_37_ll_misses: 0
rx_queue_37_ll_cleaned: 0
rx_queue_38_packets: 445522
rx_queue_38_bytes: 648374725
rx_queue_38_ll_poll_yield: 0
rx_queue_38_ll_misses: 0
rx_queue_38_ll_cleaned: 0
rx_queue_39_packets: 0
rx_queue_39_bytes: 0
rx_queue_39_ll_poll_yield: 0
rx_queue_39_ll_misses: 0
rx_queue_39_ll_cleaned: 0
rx_queue_40_packets: 0
rx_queue_40_bytes: 0
rx_queue_40_ll_poll_yield: 0
rx_queue_40_ll_misses: 0
rx_queue_40_ll_cleaned: 0
rx_queue_41_packets: 0
rx_queue_41_bytes: 0
rx_queue_41_ll_poll_yield: 0
rx_queue_41_ll_misses: 0
rx_queue_41_ll_cleaned: 0
rx_queue_42_packets: 0
rx_queue_42_bytes: 0
rx_queue_42_ll_poll_yield: 0
rx_queue_42_ll_misses: 0
rx_queue_42_ll_cleaned: 0
rx_queue_43_packets: 0
rx_queue_43_bytes: 0
rx_queue_43_ll_poll_yield: 0
rx_queue_43_ll_misses: 0
rx_queue_43_ll_cleaned: 0
rx_queue_44_packets: 0
rx_queue_44_bytes: 0
rx_queue_44_ll_poll_yield: 0
rx_queue_44_ll_misses: 0
rx_queue_44_ll_cleaned: 0
rx_queue_45_packets: 0
rx_queue_45_bytes: 0
rx_queue_45_ll_poll_yield: 0
rx_queue_45_ll_misses: 0
rx_queue_45_ll_cleaned: 0
rx_queue_46_packets: 0
rx_queue_46_bytes: 0
rx_queue_46_ll_poll_yield: 0
rx_queue_46_ll_misses: 0
rx_queue_46_ll_cleaned: 0
rx_queue_47_packets: 0
rx_queue_47_bytes: 0
rx_queue_47_ll_poll_yield: 0
rx_queue_47_ll_misses: 0
rx_queue_47_ll_cleaned: 0
rx_queue_48_packets: 0
rx_queue_48_bytes: 0
rx_queue_48_ll_poll_yield: 0
rx_queue_48_ll_misses: 0
rx_queue_48_ll_cleaned: 0
rx_queue_49_packets: 0
rx_queue_49_bytes: 0
rx_queue_49_ll_poll_yield: 0
rx_queue_49_ll_misses: 0
rx_queue_49_ll_cleaned: 0
rx_queue_50_packets: 0
rx_queue_50_bytes: 0
rx_queue_50_ll_poll_yield: 0
rx_queue_50_ll_misses: 0
rx_queue_50_ll_cleaned: 0
rx_queue_51_packets: 0
rx_queue_51_bytes: 0
rx_queue_51_ll_poll_yield: 0
rx_queue_51_ll_misses: 0
rx_queue_51_ll_cleaned: 0
rx_queue_52_packets: 0
rx_queue_52_bytes: 0
rx_queue_52_ll_poll_yield: 0
rx_queue_52_ll_misses: 0
rx_queue_52_ll_cleaned: 0
rx_queue_53_packets: 0
rx_queue_53_bytes: 0
rx_queue_53_ll_poll_yield: 0
rx_queue_53_ll_misses: 0
rx_queue_53_ll_cleaned: 0
rx_queue_54_packets: 0
rx_queue_54_bytes: 0
rx_queue_54_ll_poll_yield: 0
rx_queue_54_ll_misses: 0
rx_queue_54_ll_cleaned: 0
rx_queue_55_packets: 0
rx_queue_55_bytes: 0
rx_queue_55_ll_poll_yield: 0
rx_queue_55_ll_misses: 0
rx_queue_55_ll_cleaned: 0
rx_queue_56_packets: 0
rx_queue_56_bytes: 0
rx_queue_56_ll_poll_yield: 0
rx_queue_56_ll_misses: 0
rx_queue_56_ll_cleaned: 0
rx_queue_57_packets: 0
rx_queue_57_bytes: 0
rx_queue_57_ll_poll_yield: 0
rx_queue_57_ll_misses: 0
rx_queue_57_ll_cleaned: 0
rx_queue_58_packets: 0
rx_queue_58_bytes: 0
rx_queue_58_ll_poll_yield: 0
rx_queue_58_ll_misses: 0
rx_queue_58_ll_cleaned: 0
rx_queue_59_packets: 0
rx_queue_59_bytes: 0
rx_queue_59_ll_poll_yield: 0
rx_queue_59_ll_misses: 0
rx_queue_59_ll_cleaned: 0
rx_queue_60_packets: 0
rx_queue_60_bytes: 0
rx_queue_60_ll_poll_yield: 0
rx_queue_60_ll_misses: 0
rx_queue_60_ll_cleaned: 0
rx_queue_61_packets: 0
rx_queue_61_bytes: 0
rx_queue_61_ll_poll_yield: 0
rx_queue_61_ll_misses: 0
rx_queue_61_ll_cleaned: 0
rx_queue_62_packets: 0
rx_queue_62_bytes: 0
rx_queue_62_ll_poll_yield: 0
rx_queue_62_ll_misses: 0
rx_queue_62_ll_cleaned: 0
rx_queue_63_packets: 0
rx_queue_63_bytes: 0
rx_queue_63_ll_poll_yield: 0
rx_queue_63_ll_misses: 0
rx_queue_63_ll_cleaned: 0
tx_pb_0_pxon: 0
tx_pb_0_pxoff: 0
tx_pb_1_pxon: 0
tx_pb_1_pxoff: 0
tx_pb_2_pxon: 0
tx_pb_2_pxoff: 0
tx_pb_3_pxon: 0
tx_pb_3_pxoff: 0
tx_pb_4_pxon: 0
tx_pb_4_pxoff: 0
tx_pb_5_pxon: 0
tx_pb_5_pxoff: 0
tx_pb_6_pxon: 0
tx_pb_6_pxoff: 0
tx_pb_7_pxon: 0
tx_pb_7_pxoff: 0
rx_pb_0_pxon: 0
rx_pb_0_pxoff: 0
rx_pb_1_pxon: 0
rx_pb_1_pxoff: 0
rx_pb_2_pxon: 0
rx_pb_2_pxoff: 0
rx_pb_3_pxon: 0
rx_pb_3_pxoff: 0
rx_pb_4_pxon: 0
rx_pb_4_pxoff: 0
rx_pb_5_pxon: 0
rx_pb_5_pxoff: 0
rx_pb_6_pxon: 0
rx_pb_6_pxoff: 0
rx_pb_7_pxon: 0
rx_pb_7_pxoff: 0
Note that "large receive offload" is off (because I've read that could
be a problem with bridges).
Additional network optimization includes the following in /etc/sysctl.conf:
net.core.rmem_max = 67108864
net.core.wmem_max = 67108864
net.ipv4.tcp_rmem = 4096 87380 33554432
net.ipv4.tcp_wmem = 4096 65536 33554432
net.core.netdev_max_backlog = 30000
I've also increased the txqueuelen from 1000 to 10000.
Now, if I can solve this problem, there's the second problem, and it may
or may not be related...
Each of the servers has idrac7 Express - the Dell Remote Access
Controller. Because it's express, and not "enterprise", it shares one
of the system network ports, which happens to be the management
network. I'm having a problem where-by, after some period of time
(could be a week, could be a month), the Dell Remote Access controller
stops responding to ping entirely (100% packet loss). I thought this
was unrelated to the 10G nic. If I hard reboot the idrac (with an ipmi
command under Linux), it reboots, but following the reboot, pinging it
drops 80-90% of all packets. It's the same every time the problem
occurs. Meanwhile, I can still ping the underlying management
interface, and all my packets get through. But here's the really weird
part -- if I reboot the SERVER (and not the idrac - the idrac runs
independent from the server of course), then the drac starts responding
to ping again, with no packet loss!! Dell hasn't been able to replicate
the problem in house, but to date, they're been working with idrac
Enterprise (which has a separate network port), and even if they were
working with the express, there's the issue of bridge versus
non-bridge. My virtualization servers have all got into this state.
The file server, which doesn't use the bridge, hasn't got into this
state... The virtualization servers all show dropped packets... the file
server doesn't... related????
Any assistance for either of these issues would be greatly appreciated...
Jason.
------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
