On 08. aug. 2016 17:43, Skidmore, Donald C wrote:
>
>
>> -----Original Message-----
>> From: Andre Tomt [mailto:an...@tomt.net]
>> Sent: Sunday, August 07, 2016 12:27 AM
>> To: e1000-devel@lists.sourceforge.net
>> Subject: Re: [E1000-devel] X552 SFP+ link problems
>>
>> On 06. aug. 2016 09:16, Andre Tomt wrote:
>>> Hi
>>>
>>> I'm having some problems getting the X552 SFP+ to link to some link
>>> partners using 10G SR optics and 10G 1m passive DAC.
>>>
>>> When connecting it to a Zyxel XS1920-12 10G switch the link gets stuck
>>> in a loop. The link fails when connected directly to a Mellanox
>>> ConnectX-3 En Pro SFP+ PCIe card as well (but doesnt "loop")
>>
>> A very interesting observation.
>> Running "ethtool --test eno7 offline" fixes the link.
>>
>> "ip link set dev eno7 up && ethtool -t eno7 offline" also works. link comes 
>> up
>> fast and stays up.
>>
>> However if link is unplugged/disabled on switch and plugged in/turned back 
>> on,
>> it starts looping again.
>>
>> Link detection timing issue?
>>
>
> I haven't ever seen similar behavior but I also don't have a Broadcom switch. 
>  I'll see if our validation has such a switch and can attempt to recreate 
> what you're seeing.
>
> Have you attempted to limit "force" the link speed (i.e. only advertise one 
> speed)?  Also if you black list the driver (ixgbe) and cold boot the system 
> with the cable plugged into a live switch do you see the LED on port up or 
> does it link flap like you see when the driver is loaded?

Still loops/flaps as seen on the link/activity lights on the Xeon D's 
SFP+ cage. Tried booting with driver disabled + plugging in modules 
post-boot and leaving them in during power on.

Driver not loaded verified with dmesg/lsmod, started system from 
power-off (but IPMI active)

It does not let me set advertised speed or forced speed, but as the 
modules are 10G only, as long as the module EEPROM is read correctly 
(and it seems to be) it should be fine.

Switch side tested with fixed-10G and auto-10G (100/1000/10000), does 
not make a difference.

# ethtool -s eno7 advertise 0x1000
Cannot set new settings: Invalid argument
# ethtool -s eno7 advertise 0x80000
Cannot set new settings: Invalid argument
# ethtool -s eno7 advertise 0x80000
Cannot set new settings: Invalid argument
# ethtool -s eno7 speed 10000
Cannot set new settings: Invalid argument
   not setting speed
# ethtool eno7
Settings for eno7:
        Supported ports: [ FIBRE ]
        Supported link modes:   10000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: No
        Advertised link modes:  10000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Speed: Unknown!
        Duplex: Unknown! (255)
        Port: FIBRE
        PHYAD: 0
        Transceiver: external
        Auto-negotiation: off
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: no

I did a quick test with ixgbe backported from 4.8-rc1 to 4.7, same issues.

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity 
planning reports. http://sdm.link/zohodev2dev
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit 
http://communities.intel.com/community/wired

Reply via email to