The first thing I'd try is to boot into a Linux distro and see if you're having 
issues there as well, but that's because I'm much more familiar with Linux.

What is your link partner? What is the hardware you're using other than the NIC?

I think you'd have more luck on most of this if you asked the FreeBSD list or 
possibly supp...@intel.com.

Todd Fujinaka
Software Application Engineer
Networking Division (ND)
Intel Corporation
todd.fujin...@intel.com
(503) 712-4565

-----Original Message-----
From: Daniel Genis [mailto:daniel.ge...@gmx.de] 
Sent: Monday, January 16, 2017 6:10 AM
To: e1000-devel@lists.sourceforge.net
Subject: [E1000-devel] intel 82599ES freebsd 10.3-stable, no carrier

Hi everyone,

we're facing a very hard to debug problem with the our intel 82599ES 10gige 
cards on FreeBSD and would really appreciate your input.

The problem is that the cards enter a "no carrier" state, without network 
connectivity.
When in this state, the LEDs of the network cards are solid on (like in normal 
operation).

Network connectivity can be restored by either unplugging and replugging the 
network cable, or by fully shutting down and opening the port on the network 
switch.


root@storage ~ # pciconf -lv | grep -B3 network
ix0@pci0:1:0:0: class=0x020000 card=0xffffffff chip=0x10fb8086 rev=0x01
hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
--
ix1@pci0:1:0:1: class=0x020000 card=0xffffffff chip=0x10fb8086 rev=0x01
hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network

Our network is configured as follows (inside /etc/rc.conf):

cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto failover laggport ix0 laggport ix1 10.1.2.254/16"
ifconfig_ix0="up"
ifconfig_ix1="up"



We're using Freebsd, and i've rebuilt the 10.3-stable kernel with the following 
debug settings set to 1 (all 3 of them).
https://github.com/freebsd/freebsd/blob/3673260fc9cd940469688433ec5f09ca53d19107/sys/dev/ixgbe/ixgbe.h#L192
This is also the FreeBSD kernel which we're testing on. As far as the intel nic 
driver is concerned it's the same as 10.3-RELEASE.

We haven't seen this issue on 10.1
10.2 likely is not affected either, but we are not 100% certain of that.
10.3 definitely is showing this issue

10.1 uses intel nic driver 2.5.15
10.2 uses intel nic driver 2.8.3
10.3 uses intel nic driver 3.1.13-k

A full boot debug output of the 3.1.13-k driver booting into no carrier state + 
subsequent switch port shut/open of ix0/ix1 can be seen
here: https://nopaste.me/view/cca08cee

I've mailed this to the FreeBSD-stable mailing list also, however it does not 
appear that many others are facing this issue since we didn't get a response, 
it contains a little more information as well:
https://lists.freebsd.org/pipermail/freebsd-stable/2017-January/086578.html

Most interestingly, when we pxe boot through the network the carrier signal is 
available. When we boot from disk the nic's are in no carrier state. This can 
be repeated.

Do you guys have any suggestions as to how we can debug this? Any help would be 
highly appreciated!

With kind regards,

Daniel


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi 
processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi 
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit 
http://communities.intel.com/community/wired

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit 
http://communities.intel.com/community/wired

Reply via email to