> -----Original Message----- > From: Andre Tomt [mailto:an...@tomt.net] > Sent: Monday, August 08, 2016 4:41 PM > To: Skidmore, Donald C <donald.c.skidm...@intel.com>; e1000- > de...@lists.sourceforge.net > Subject: Re: [E1000-devel] X552 SFP+ link problems > > On 08. aug. 2016 17:43, Skidmore, Donald C wrote: > > > > > >> -----Original Message----- > >> From: Andre Tomt [mailto:an...@tomt.net] > >> Sent: Sunday, August 07, 2016 12:27 AM > >> To: e1000-devel@lists.sourceforge.net > >> Subject: Re: [E1000-devel] X552 SFP+ link problems > >> > >> On 06. aug. 2016 09:16, Andre Tomt wrote: > >>> Hi > >>> > >>> I'm having some problems getting the X552 SFP+ to link to some link > >>> partners using 10G SR optics and 10G 1m passive DAC. > >>> > >>> When connecting it to a Zyxel XS1920-12 10G switch the link gets > >>> stuck in a loop. The link fails when connected directly to a > >>> Mellanox > >>> ConnectX-3 En Pro SFP+ PCIe card as well (but doesnt "loop") > >> > >> A very interesting observation. > >> Running "ethtool --test eno7 offline" fixes the link. > >> > >> "ip link set dev eno7 up && ethtool -t eno7 offline" also works. link > >> comes up fast and stays up. > >> > >> However if link is unplugged/disabled on switch and plugged in/turned > >> back on, it starts looping again. > >> > >> Link detection timing issue? > >> > > > > I haven't ever seen similar behavior but I also don't have a Broadcom > > switch. > I'll see if our validation has such a switch and can attempt to recreate what > you're seeing. > > > > Have you attempted to limit "force" the link speed (i.e. only advertise one > speed)? Also if you black list the driver (ixgbe) and cold boot the system > with > the cable plugged into a live switch do you see the LED on port up or does it > link > flap like you see when the driver is loaded? > > Still loops/flaps as seen on the link/activity lights on the Xeon D's > SFP+ cage. Tried booting with driver disabled + plugging in modules > post-boot and leaving them in during power on. > > Driver not loaded verified with dmesg/lsmod, started system from > power-off (but IPMI active) > > It does not let me set advertised speed or forced speed, but as the > modules are 10G only, as long as the module EEPROM is read correctly > (and it seems to be) it should be fine. > > Switch side tested with fixed-10G and auto-10G (100/1000/10000), does > not make a difference. > > # ethtool -s eno7 advertise 0x1000 > Cannot set new settings: Invalid argument > # ethtool -s eno7 advertise 0x80000 > Cannot set new settings: Invalid argument > # ethtool -s eno7 advertise 0x80000 > Cannot set new settings: Invalid argument > # ethtool -s eno7 speed 10000 > Cannot set new settings: Invalid argument > not setting speed > # ethtool eno7 > Settings for eno7: > Supported ports: [ FIBRE ] > Supported link modes: 10000baseT/Full > Supported pause frame use: No > Supports auto-negotiation: No > Advertised link modes: 10000baseT/Full > Advertised pause frame use: No > Advertised auto-negotiation: No > Speed: Unknown! > Duplex: Unknown! (255) > Port: FIBRE > PHYAD: 0 > Transceiver: external > Auto-negotiation: off > Supports Wake-on: d > Wake-on: d > Current message level: 0x00000007 (7) > drv probe link > Link detected: no > > I did a quick test with ixgbe backported from 4.8-rc1 to 4.7, same issues.
The fact that you see the link flap even with the driver unloaded strongly points to either HW/FW. Since this is a Supermicro board I would approach them they should have the direct HW/FW contacts with in Intel as well as internally to root cause what is going on here. I approached our validation team and they don't have your switch and without a recreation it is difficult to get any traction here considering we seem to see the issue even without the driver loaded. Thanks, -Don Skidmore <donald.c.skidm...@intel.com> ------------------------------------------------------------------------------ What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic patterns at an interface-level. Reveals which users, apps, and protocols are consuming the most bandwidth. Provides multi-vendor support for NetFlow, J-Flow, sFlow and other flows. Make informed decisions using capacity planning reports. http://sdm.link/zohodev2dev _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
