Hi,

it starts when you see heavy fragmention of

cat /proc/buddyinfo for dma32

Stefan
Am 26.08.2015 um 17:32 schrieb Stefan Priebe - Profihost AG:
> Another important thing seems to try to generate fragmented memory. If
> you have still large continuous space it still works.
> 
> Stefan
> 
> Excuse my typo sent from my mobile phone.
> 
> Am 26.08.2015 um 16:37 schrieb Rose, Gregory V <gregory.v.r...@intel.com
> <mailto:gregory.v.r...@intel.com>>:
> 
>>
>>
>>> -----Original Message-----
>>> From: Stefan Priebe - Profihost AG [mailto:s.pri...@profihost.ag]
>>> Sent: Wednesday, August 26, 2015 5:34 AM
>>> To: Rose, Gregory V
>>> Cc: e1000-devel@lists.sourceforge.net
>>> <mailto:e1000-devel@lists.sourceforge.net>
>>> Subject: Re: [E1000-devel] dropped rx with i40e
>>>
>>> I have a reproducer!! It happens under cache pressure.
>>>
>>> I can reproduce this with the following:
>>>
>>> 1.) start iperf -s on the system wird X710
>>> 2.) Start sending a lot of data to it i used 20 other servers using iperf
>>> -c TARGETIP -d -t 600
>>> 3.) read a lot of big files (i used find /DIRWITHBIGFILES ... -exec dd
>>> if=FILE of=/dev/zero bs=4M)
>>>
>>> I can trigger the drops with this code 100%.
>>
>> Great, I'll try to set up a similar environment today.  Finding 20
>> other servers won't work for me but I think I can certainly emulate a
>> similar traffic profile.
>>
>> I'll let you know how it goes.
>>
>> Thanks,
>>
>> - Greg
>>
>>>
>>> Mit freundlichen Grüßen
>>>  Stefan Priebe
>>> Bachelor of Science in Computer Science (BSCS) Vorstand (CTO)
>>>
>>> -------------------------------
>>> Profihost AG
>>> Expo Plaza 1
>>> 30539 Hannover
>>> Deutschland
>>>
>>> Tel.: +49 (511) 5151 8181     | Fax.: +49 (511) 5151 8282
>>> URL: http://www.profihost.com | E-Mail: i...@profihost.com
>>> <mailto:i...@profihost.com>
>>>
>>> Sitz der Gesellschaft: Hannover, USt-IdNr. DE813460827
>>> Registergericht: Amtsgericht Hannover, Register-Nr.: HRB 202350
>>> Vorstand: Cristoph Bluhm, Sebastian Bluhm, Stefan Priebe
>>> Aufsichtsrat: Prof. Dr. iur. Winfried Huck (Vorsitzender)
>>>
>>> Am 24.08.2015 um 19:40 schrieb Rose, Gregory V:
>>>> So if you swap one of the newer cards with one of the older cards do
>>>> the packet drops continue to follow the older card around?
>>>>
>>>>
>>>>
>>>> If so, then please get me the PBA of one of the newer cards and the
>>>> PBA of one of the older ones that fails.
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>>
>>>>
>>>> -        Greg
>>>>
>>>>
>>>>
>>>> *From:*Stefan Priebe - Profihost AG [mailto:s.pri...@profihost.ag]
>>>> *Sent:* Saturday, August 22, 2015 12:14 AM
>>>> *To:* Rose, Gregory V
>>>> *Cc:* e1000-devel@lists.sourceforge.net
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>> *Subject:* Re: [E1000-devel] dropped rx with i40e
>>>>
>>>>
>>>>
>>>> I still have those ugly drops. Generally it seems it takes 20-48 hours
>>>> before they occour but than it doesn't stop.
>>>>
>>>>
>>>>
>>>> The strange thing I've 8 newer boxes using same os and hw where I've
>>>> never seen those drops. Are there different xl 710 hw revisions? I
>>>> already checked hw revision of mainboard.
>>>>
>>>> Stefan
>>>>
>>>>
>>>>
>>>> Excuse my typo sent from my mobile phone.
>>>>
>>>>
>>>> Am 21.08.2015 um 02:51 schrieb Rose, Gregory V
>>>> <gregory.v.r...@intel.com <mailto:gregory.v.r...@intel.com>
>>>> <mailto:gregory.v.r...@intel.com>>:
>>>>
>>>>    Stefan,
>>>>
>>>>    Late update on this.  I'm being told know that there are additional
>>>>    parameters that may need to be changed.  Please hold until I get
>>>>    this updated information.
>>>>
>>>>    Thanks and regards,
>>>>
>>>>    - Greg
>>>>
>>>>
>>>>        -----Original Message-----
>>>>
>>>>        From: Rose, Gregory V [mailto:gregory.v.r...@intel.com]
>>>>
>>>>        Sent: Thursday, August 20, 2015 4:26 PM
>>>>
>>>>        To: Stefan Priebe
>>>>
>>>>        Cc: e1000-devel@lists.sourceforge.net
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>        <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>        Subject: Re: [E1000-devel] dropped rx with i40e
>>>>
>>>>
>>>>
>>>>        Stefan,
>>>>
>>>>
>>>>
>>>>        You will need to run the update utility again but this time
>>>> edit the
>>>>
>>>>        nvmupdate.cfg file to change this:
>>>>
>>>>
>>>>
>>>>        SKIP OROM: TRUE
>>>>
>>>>
>>>>
>>>>        to this:
>>>>
>>>>
>>>>
>>>>        SKIP OROM: FALSE
>>>>
>>>>
>>>>
>>>>        That should then also update the option ROM for the PXE utility.
>>>>
>>>>
>>>>
>>>>        Regards,
>>>>
>>>>
>>>>
>>>>        - Greg
>>>>
>>>>
>>>>
>>>>            -----Original Message-----
>>>>
>>>>            From: Stefan Priebe [mailto:s.pri...@profihost.ag]
>>>>
>>>>            Sent: Wednesday, August 19, 2015 10:40 AM
>>>>
>>>>            To: Rose, Gregory V
>>>>
>>>>            Cc: e1000-devel@lists.sourceforge.net
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>            <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>            Subject: Re: [E1000-devel] dropped rx with i40e
>>>>
>>>>
>>>>
>>>>            Correct message:
>>>>
>>>>            PXE-m10: The application for the device detected a newer
>>>>            version of
>>>>
>>>>            the nvm image than expexted.
>>>>
>>>>
>>>>
>>>>            So how do i update the application code of the XL710?
>>>>
>>>>
>>>>
>>>>            Stefan
>>>>
>>>>            Am 19.08.2015 um 19:04 schrieb Stefan Priebe - Profihost AG:
>>>>
>>>>                An additional question since I've updated to latest
>>>>                xl710 firmware
>>>>
>>>>                released 17 August the cards show at boot time (bios
>>>>                init/ post)
>>>>
>>>>                something like application code detected a newer nvm
>>>>                image than
>>>>
>>>>                expected please update application software. But I can't
>>>>                find an
>>>>
>>>>                application code update for the xl710 cards.
>>>>
>>>>
>>>>
>>>>                Stefan
>>>>
>>>>
>>>>
>>>>                Excuse my typo sent from my mobile phone.
>>>>
>>>>
>>>>
>>>>                Am 19.08.2015 um 18:20 schrieb Rose, Gregory V
>>>>
>>>>                <gregory.v.r...@intel.com
>>>> <mailto:gregory.v.r...@intel.com>
>>>> <mailto:gregory.v.r...@intel.com>
>>>>
>>>>                <mailto:gregory.v.r...@intel.com>>:
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>                        -----Original Message-----
>>>>
>>>>                        From: Stefan Priebe - Profihost AG
>>>>                        [mailto:s.pri...@profihost.ag]
>>>>
>>>>                        Sent: Wednesday, August 19, 2015 12:01 AM
>>>>
>>>>                        To: Rose, Gregory V;
>>>>                        e1000-devel@lists.sourceforge.net
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>                        <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>                        <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>                        Subject: Re: [E1000-devel] dropped rx with
>>>> i40e
>>>>
>>>>
>>>>
>>>>                        Hi,
>>>>
>>>>
>>>>
>>>>                        sad you are not able to reproduce. The good
>>>>                        thing i can't
>>>>
>>>>                        reproduce myself either ;-(
>>>>
>>>>
>>>>
>>>>                        it just happens out of nothing on the nodes. My
>>>>                        current expection
>>>>
>>>>                        is that it happens when spikes of packets occur
>>>>                        after being idle
>>>>
>>>>                        for some
>>>>
>>>>            time.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>                    OK, my traffic generation was fairly constant.  Let
>>>>                    me modify it to
>>>>
>>>>                    send bursts of traffic after long idle periods.
>>>>                     Maybe that will
>>>>
>>>>                    help to reproduce.
>>>>
>>>>
>>>>
>>>>                    Something you might try is examining your systems'
>>>>                    BIOS settings
>>>>
>>>>                    for sleep states and make sure the machines don't go
>>>>                    too deep into
>>>>
>>>>                    a sleep state when they're idle.  The time it takes
>>>>                    to come from
>>>>
>>>>                    sleep state to handling traffic bursts can cause
>>>>                    some dropped
>>>>
>>>>        packets.
>>>>
>>>>
>>>>
>>>>                    Thanks,
>>>>
>>>>
>>>>
>>>>                    - Greg
>>>>
>>>>
>>>>
>>>>                        The good news is after upgrading to the latest
>>>>                        intel fw released
>>>>
>>>>                        two days ago and to the latest 1.3.38 driver -
>>>>                        it works on 10 out
>>>>
>>>>                        of my
>>>>
>>>>                        18 testing hosts.
>>>>
>>>>
>>>>
>>>>                        Currently i've no idea why it does not on those
>>> 8.
>>>>
>>>>
>>>>
>>>>                        Stefan
>>>>
>>>>                        Am 19.08.2015 um 00:24 schrieb Rose, Gregory V:
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>                                -----Original Message-----
>>>>
>>>>                                From: Stefan Priebe - Profihost AG
>>>>
>>>>                                [mailto:s.pri...@profihost.ag]
>>>>
>>>>                                Sent: Tuesday, August 18, 2015 12:28
>>>> AM
>>>>
>>>>                                To: Rose, Gregory V;
>>>>                                e1000-devel@lists.sourceforge.net
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>                                Subject: Re: [E1000-devel] dropped rx
>>>>                                with i40e
>>>>
>>>>
>>>>
>>>>                                Hi Greg,
>>>>
>>>>
>>>>
>>>>                                could you tell me the output of ethtool
>>>>                                -i and ethtool -a and
>>>>
>>>>                                ethtool -c and ethtool -k?
>>>>
>>>>
>>>>
>>>>                            OK, I pasted it in below.  I ran traffic
>>>>                            overnight and there were
>>>>
>>>>                            no
>>>>
>>>>                        dropped packets or other errors.  Everything
>>>>                        seemed fine.
>>>>
>>>>
>>>>
>>>>                            - Greg
>>>>
>>>>
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -i bond0
>>>>
>>>>                            driver: bonding
>>>>
>>>>                            version: 3.7.1
>>>>
>>>>                            firmware-version: 2
>>>>
>>>>                            bus-info:
>>>>
>>>>                            supports-statistics: no
>>>>
>>>>                            supports-test: no
>>>>
>>>>                            supports-eeprom-access: no
>>>>
>>>>                            supports-register-dump: no
>>>>
>>>>                            supports-priv-flags: no
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -c bond0
>>>>                            Coalesce parameters for
>>>>
>>>>                            bond0:
>>>>
>>>>                            Cannot get device coalesce settings:
>>>>                            Operation not supported
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -k bond0
>>>>                            Features for bond0:
>>>>
>>>>                            rx-checksumming: off [fixed]
>>>>
>>>>                            tx-checksumming: on
>>>>
>>>>                                  tx-checksum-ipv4: off [fixed]
>>>>
>>>>                                  tx-checksum-ip-generic: on
>>>>
>>>>                                  tx-checksum-ipv6: off [fixed]
>>>>
>>>>                                  tx-checksum-fcoe-crc: off [fixed]
>>>>
>>>>                                  tx-checksum-sctp: off [fixed]
>>>>
>>>>                            scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather-fraglist: off
>>>>                            [requested on]
>>>>
>>>>                            tcp-segmentation-offload: on
>>>>
>>>>                                  tx-tcp-segmentation: on
>>>>
>>>>                                  tx-tcp-ecn-segmentation: on
>>>>
>>>>                                  tx-tcp6-segmentation: on
>>>>
>>>>                            udp-fragmentation-offload: off [fixed]
>>>>
>>>>                            generic-segmentation-offload: on
>>>>
>>>>                            generic-receive-offload: on
>>>>
>>>>                            large-receive-offload: off
>>>>
>>>>                            rx-vlan-offload: on
>>>>
>>>>                            tx-vlan-offload: on
>>>>
>>>>                            ntuple-filters: off [fixed]
>>>>
>>>>                            receive-hashing: off [fixed]
>>>>
>>>>                            highdma: on
>>>>
>>>>                            rx-vlan-filter: on
>>>>
>>>>                            vlan-challenged: off [fixed]
>>>>
>>>>                            tx-lockless: on [fixed]
>>>>
>>>>                            netns-local: on [fixed]
>>>>
>>>>                            tx-gso-robust: off [fixed]
>>>>
>>>>                            tx-fcoe-segmentation: off [fixed]
>>>>
>>>>                            tx-gre-segmentation: off [fixed]
>>>>
>>>>                            tx-ipip-segmentation: off [fixed]
>>>>
>>>>                            tx-sit-segmentation: off [fixed]
>>>>
>>>>                            tx-udp_tnl-segmentation: on
>>>>
>>>>                            tx-mpls-segmentation: off [fixed]
>>>>
>>>>                            fcoe-mtu: off [fixed]
>>>>
>>>>                            tx-nocache-copy: off
>>>>
>>>>                            loopback: off [fixed]
>>>>
>>>>                            rx-fcs: off [fixed]
>>>>
>>>>                            rx-all: off [fixed]
>>>>
>>>>                            tx-vlan-stag-hw-insert: off [fixed]
>>>>
>>>>                            rx-vlan-stag-hw-parse: off [fixed]
>>>>
>>>>                            rx-vlan-stag-filter: off [fixed]
>>>>
>>>>                            l2-fwd-offload: off [fixed]
>>>>
>>>>                            busy-poll: off [fixed]
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -i p4p1
>>>>
>>>>                            driver: i40e
>>>>
>>>>                            version: 1.2.47
>>>>
>>>>                            firmware-version: f4.40.35115 a1.4 n4.53
>>>> e1ce7
>>>>
>>>>                            bus-info: 0000:82:00.0
>>>>
>>>>                            supports-statistics: yes
>>>>
>>>>                            supports-test: yes
>>>>
>>>>                            supports-eeprom-access: yes
>>>>
>>>>                            supports-register-dump: yes
>>>>
>>>>                            supports-priv-flags: yes
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -c p4p1
>>>>                            Coalesce parameters for
>>>>
>>>>        p4p1:
>>>>
>>>>                            Adaptive RX: on  TX: on
>>>>
>>>>                            stats-block-usecs: 0
>>>>
>>>>                            sample-interval: 0
>>>>
>>>>                            pkt-rate-low: 0
>>>>
>>>>                            pkt-rate-high: 0
>>>>
>>>>
>>>>
>>>>                            rx-usecs: 62
>>>>
>>>>                            rx-frames: 0
>>>>
>>>>                            rx-usecs-irq: 0
>>>>
>>>>                            rx-frames-irq: 256
>>>>
>>>>
>>>>
>>>>                            tx-usecs: 122
>>>>
>>>>                            tx-frames: 0
>>>>
>>>>                            tx-usecs-irq: 0
>>>>
>>>>                            tx-frames-irq: 256
>>>>
>>>>
>>>>
>>>>                            rx-usecs-low: 0
>>>>
>>>>                            rx-frame-low: 0
>>>>
>>>>                            tx-usecs-low: 0
>>>>
>>>>                            tx-frame-low: 0
>>>>
>>>>
>>>>
>>>>                            rx-usecs-high: 0
>>>>
>>>>                            rx-frame-high: 0
>>>>
>>>>                            tx-usecs-high: 0
>>>>
>>>>                            tx-frame-high: 0
>>>>
>>>>
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -k p4p1
>>>>                            Features for p4p1:
>>>>
>>>>                            rx-checksumming: on
>>>>
>>>>                            tx-checksumming: on
>>>>
>>>>                                  tx-checksum-ipv4: on
>>>>
>>>>                                  tx-checksum-ip-generic: off [fixed]
>>>>
>>>>                                  tx-checksum-ipv6: on
>>>>
>>>>                                  tx-checksum-fcoe-crc: off [fixed]
>>>>
>>>>                                  tx-checksum-sctp: on
>>>>
>>>>                            scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather-fraglist: off
>>>> [fixed]
>>>>
>>>>                            tcp-segmentation-offload: on
>>>>
>>>>                                  tx-tcp-segmentation: on
>>>>
>>>>                                  tx-tcp-ecn-segmentation: on
>>>>
>>>>                                  tx-tcp6-segmentation: on
>>>>
>>>>                            udp-fragmentation-offload: off [fixed]
>>>>
>>>>                            generic-segmentation-offload: on
>>>>
>>>>                            generic-receive-offload: on
>>>>
>>>>                            large-receive-offload: off [fixed]
>>>>
>>>>                            rx-vlan-offload: on
>>>>
>>>>                            tx-vlan-offload: on
>>>>
>>>>                            ntuple-filters: on
>>>>
>>>>                            receive-hashing: on
>>>>
>>>>                            highdma: on
>>>>
>>>>                            rx-vlan-filter: on
>>>>
>>>>                            vlan-challenged: off [fixed]
>>>>
>>>>                            tx-lockless: off [fixed]
>>>>
>>>>                            netns-local: off [fixed]
>>>>
>>>>                            tx-gso-robust: off [fixed]
>>>>
>>>>                            tx-fcoe-segmentation: off [fixed]
>>>>
>>>>                            tx-gre-segmentation: off [fixed]
>>>>
>>>>                            tx-ipip-segmentation: off [fixed]
>>>>
>>>>                            tx-sit-segmentation: off [fixed]
>>>>
>>>>                            tx-udp_tnl-segmentation: on
>>>>
>>>>                            tx-mpls-segmentation: off [fixed]
>>>>
>>>>                            fcoe-mtu: off [fixed]
>>>>
>>>>                            tx-nocache-copy: off
>>>>
>>>>                            loopback: off [fixed]
>>>>
>>>>                            rx-fcs: off [fixed]
>>>>
>>>>                            rx-all: off [fixed]
>>>>
>>>>                            tx-vlan-stag-hw-insert: off [fixed]
>>>>
>>>>                            rx-vlan-stag-hw-parse: off [fixed]
>>>>
>>>>                            rx-vlan-stag-filter: off [fixed]
>>>>
>>>>                            l2-fwd-offload: off [fixed]
>>>>
>>>>                            busy-poll: off [fixed]
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -i p4p4
>>>>
>>>>                            driver: i40e
>>>>
>>>>                            version: 1.2.47
>>>>
>>>>                            firmware-version: f4.40.35115 a1.4 n4.53
>>>> e1ce7
>>>>
>>>>                            bus-info: 0000:82:00.3
>>>>
>>>>                            supports-statistics: yes
>>>>
>>>>                            supports-test: yes
>>>>
>>>>                            supports-eeprom-access: yes
>>>>
>>>>                            supports-register-dump: yes
>>>>
>>>>                            supports-priv-flags: yes
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -c p4p4
>>>>                            Coalesce parameters for
>>>>
>>>>        p4p4:
>>>>
>>>>                            Adaptive RX: on  TX: on
>>>>
>>>>                            stats-block-usecs: 0
>>>>
>>>>                            sample-interval: 0
>>>>
>>>>                            pkt-rate-low: 0
>>>>
>>>>                            pkt-rate-high: 0
>>>>
>>>>
>>>>
>>>>                            rx-usecs: 62
>>>>
>>>>                            rx-frames: 0
>>>>
>>>>                            rx-usecs-irq: 0
>>>>
>>>>                            rx-frames-irq: 256
>>>>
>>>>
>>>>
>>>>                            tx-usecs: 122
>>>>
>>>>                            tx-frames: 0
>>>>
>>>>                            tx-usecs-irq: 0
>>>>
>>>>                            tx-frames-irq: 256
>>>>
>>>>
>>>>
>>>>                            rx-usecs-low: 0
>>>>
>>>>                            rx-frame-low: 0
>>>>
>>>>                            tx-usecs-low: 0
>>>>
>>>>                            tx-frame-low: 0
>>>>
>>>>
>>>>
>>>>                            rx-usecs-high: 0
>>>>
>>>>                            rx-frame-high: 0
>>>>
>>>>                            tx-usecs-high: 0
>>>>
>>>>                            tx-frame-high: 0
>>>>
>>>>
>>>>
>>>>                            [root@paelab-gvrose ~]# ethtool -k p4p4
>>>>                            Features for p4p4:
>>>>
>>>>                            rx-checksumming: on
>>>>
>>>>                            tx-checksumming: on
>>>>
>>>>                                  tx-checksum-ipv4: on
>>>>
>>>>                                  tx-checksum-ip-generic: off [fixed]
>>>>
>>>>                                  tx-checksum-ipv6: on
>>>>
>>>>                                  tx-checksum-fcoe-crc: off [fixed]
>>>>
>>>>                                  tx-checksum-sctp: on
>>>>
>>>>                            scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather: on
>>>>
>>>>                                  tx-scatter-gather-fraglist: off
>>>> [fixed]
>>>>
>>>>                            tcp-segmentation-offload: on
>>>>
>>>>                                  tx-tcp-segmentation: on
>>>>
>>>>                                  tx-tcp-ecn-segmentation: on
>>>>
>>>>                                  tx-tcp6-segmentation: on
>>>>
>>>>                            udp-fragmentation-offload: off [fixed]
>>>>
>>>>                            generic-segmentation-offload: on
>>>>
>>>>                            generic-receive-offload: on
>>>>
>>>>                            large-receive-offload: off [fixed]
>>>>
>>>>                            rx-vlan-offload: on
>>>>
>>>>                            tx-vlan-offload: on
>>>>
>>>>                            ntuple-filters: on
>>>>
>>>>                            receive-hashing: on
>>>>
>>>>                            highdma: on
>>>>
>>>>                            rx-vlan-filter: on
>>>>
>>>>                            vlan-challenged: off [fixed]
>>>>
>>>>                            tx-lockless: off [fixed]
>>>>
>>>>                            netns-local: off [fixed]
>>>>
>>>>                            tx-gso-robust: off [fixed]
>>>>
>>>>                            tx-fcoe-segmentation: off [fixed]
>>>>
>>>>                            tx-gre-segmentation: off [fixed]
>>>>
>>>>                            tx-ipip-segmentation: off [fixed]
>>>>
>>>>                            tx-sit-segmentation: off [fixed]
>>>>
>>>>                            tx-udp_tnl-segmentation: on
>>>>
>>>>                            tx-mpls-segmentation: off [fixed]
>>>>
>>>>                            fcoe-mtu: off [fixed]
>>>>
>>>>                            tx-nocache-copy: off
>>>>
>>>>                            loopback: off [fixed]
>>>>
>>>>                            rx-fcs: off [fixed]
>>>>
>>>>                            rx-all: off [fixed]
>>>>
>>>>                            tx-vlan-stag-hw-insert: off [fixed]
>>>>
>>>>                            rx-vlan-stag-hw-parse: off [fixed]
>>>>
>>>>                            rx-vlan-stag-filter: off [fixed]
>>>>
>>>>                            l2-fwd-offload: off [fixed]
>>>>
>>>>                            busy-poll: off [fixed]
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>                                Another difference to the ixgbe is that
>>>>                                large-receive-offload is
>>>>
>>>>                                fixed to off in ethtool -k.
>>>>
>>>>
>>>>
>>>>                                Stefan
>>>>
>>>>                                Am 17.08.2015 um 23:46 schrieb Rose,
>>>>                                Gregory V:
>>>>
>>>>
>>>>
>>>>                                                -----Original
>>>> Message-----
>>>>
>>>>                                                From: Stefan Priebe
>>>>
>>>> [mailto:s.pri...@profihost.ag]
>>>>
>>>>                                                Sent: Thursday, August
>>>>                                                13, 2015 12:02 PM
>>>>
>>>>                                                To: Rose, Gregory V;
>>>>                                                e1000-
>>> de...@lists.sourceforge.net <mailto:de...@lists.sourceforge.net>
>>>>
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>
>>>> <mailto:e1000-devel@lists.sourceforge.net>
>>>>
>>>>                                                Subject: Re:
>>>>                                                [E1000-devel] dropped rx
>>>>                                                with i40e
>>>>
>>>>
>>>>
>>>>                                                Am 13.08.2015 um 20:59
>>>>                                                schrieb Rose, Gregory V:
>>>>
>>>>                                                    Thanks Stefan, I'll
>>>>                                                    set up a test to
>>>>                                                    replicate your
>>>> traffic
>>>>
>>>>                                                    profile as
>>>>
>>>>                                                closely as possible and
>>>>                                                let it run overnight to
>>>>                                                see if I can
>>>>
>>>>                                                repro and then update
>>>>                                                you tomorrow.
>>>>
>>>>
>>>>
>>>>                                                    It does seem that it
>>>>                                                    has nothing to do
>>>>                                                    with load so that
>>>>
>>>>                                                    makes it even
>>>>
>>>>                                                more curious.
>>>>
>>>>
>>>>
>>>>                                                May it be related to
>>>>                                                jumbo frames?
>>>>
>>>>
>>>>
>>>>                                    Stefan,
>>>>
>>>>
>>>>
>>>>                                    I've got the test up and running
>>>>                                    now.  Here's the interface
>>>>
>>>>        config:
>>>>
>>>>
>>>>
>>>>                                    6: bond0:
>>>>
>>> <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP>
>>>>                                    mtu 9000
>>>>
>>>>                                    qdisc
>>>>
>>>>                                noqueue state UP
>>>>
>>>>                                      link/ether 68:05:ca:2f:83:10 brd
>>>>                                    ff:ff:ff:ff:ff:ff
>>>>
>>>>                                      inet 200.0.0.10/24 brd 200.0.0.255
>>>>                                    scope global bond0
>>>>
>>>>                                         valid_lft forever preferred_lft
>>>>                                    forever
>>>>
>>>>                                      inet6 fe80::6a05:caff:fe2f:8310/64
>>>>                                    scope link
>>>>
>>>>                                         valid_lft forever preferred_lft
>>>>                                    forever
>>>>
>>>>                                    9: p4p1:
>>>>
>>> <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>
>>>>                                    mtu 9000 qdisc
>>>>
>>>>                                    mq
>>>>
>>>>                                master bond0 state UP qlen 1000
>>>>
>>>>                                      link/ether 68:05:ca:2f:83:10 brd
>>>>                                    ff:ff:ff:ff:ff:ff
>>>>
>>>>                                      inet6 fe80::6a05:caff:fe2f:8310/64
>>>>                                    scope link
>>>>
>>>>                                         valid_lft forever preferred_lft
>>>>                                    forever
>>>>
>>>>                                    12: p4p4:
>>>>
>>> <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>
>>>>                                    mtu 9000
>>>>
>>>>                                    qdisc mq
>>>>
>>>>                                master bond0 state UP qlen 1000
>>>>
>>>>                                      link/ether 68:05:ca:2f:83:10 brd
>>>>                                    ff:ff:ff:ff:ff:ff
>>>>
>>>>                                      inet6 fe80::6a05:caff:fe2f:8310/64
>>>>                                    scope link
>>>>
>>>>                                         valid_lft forever preferred_lft
>>>>                                    forever
>>>>
>>>>
>>>>
>>>>                                    p4p1 and p4p4 are the i40e
>>>>                                    interfaces bonded to the bond0
>>>> LACP
>>>>
>>>>                                interface.
>>>>
>>>>
>>>>
>>>>                                    Here's the traffic results from a
>>>>                                    transmitter:
>>>>
>>>>
>>>>
>>>>                                    Interim result: 9899.84 10^6bits/s
>>>>                                    over 5.001 seconds ending at
>>>>
>>>>                                    1439847706.406 Interim result:
>>>>                                    9900.15 10^6bits/s over 5.001
>>>>
>>>>                                    seconds ending at 1439847711.407
>>>>
>>>>
>>>>
>>>>                                    I have a script watching the dropped
>>>>                                    packets for the two slaved
>>>>
>>>>                                interfaces p4p1 and p4p4:
>>>>
>>>>
>>>>
>>>>                                    Every 1.0s: ./t1
>>>>
>>> Mon
>>>>                                    Aug
>>>>
>>>>        17
>>>>
>>>>                                14:43:31 2015
>>>>
>>>>
>>>>
>>>>                                       rx_dropped: 0
>>>>
>>>>                                       tx_dropped: 0
>>>>
>>>>                                       rx_fcoe_dropped: 0
>>>>
>>>>                                       port.rx_dropped: 0
>>>>
>>>>                                       port.tx_dropped_link_down: 0
>>>>
>>>>                                       rx_dropped: 0
>>>>
>>>>                                       tx_dropped: 0
>>>>
>>>>                                       rx_fcoe_dropped: 0
>>>>
>>>>                                       port.rx_dropped: 0
>>>>
>>>>                                       port.tx_dropped_link_down: 0
>>>>
>>>>
>>>>
>>>>                                    I'll let this run overnight and get
>>>>                                    back to you with results
>>>>
>>>>            tomorrow.
>>>>
>>>>
>>>>
>>>>                                    Regards,
>>>>
>>>>
>>>>
>>>>                                    - Greg
>>>>
>>>>
>>>>
>>>>
>>>> ----------------------------------------------------------------------
>>>> ----
>>>>
>>>>        ----
>>>>
>>>>        _______________________________________________
>>>>
>>>>        E1000-devel mailing list
>>>>
>>>>        E1000-devel@lists.sourceforge.net
>>>> <mailto:E1000-devel@lists.sourceforge.net>
>>>>        <mailto:E1000-devel@lists.sourceforge.net>
>>>>
>>>>        https://lists.sourceforge.net/lists/listinfo/e1000-devel
>>>>
>>>>        To learn more about Intel&#174; Ethernet, visit
>>>>
>>>>        http://communities.intel.com/community/wired
>>>>

------------------------------------------------------------------------------
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel&#174; Ethernet, visit 
http://communities.intel.com/community/wired

Reply via email to