Hi There,
We've got a SmartOS system running joyent_20180329T002644Z (and this issue
has existed since at least 2016 as we were running an older image
previously which exhibited the same issue), and we're trying to get an
Intel X520-DA2 card working with an SFP optic (1GBASE-LX10).
After boot, if I plug an optical cable in, the optic detects light, and the
link goes up, and works fine.
However if we reboot the system, the system comes back up with the link
down. Nothing I can do in the operating system brings the link back up.
If I physically unplug/replug the cable into the optic (or disable/enable
the switchport on the switch), it comes back up.
We've tried 4 different optics from different vendors (Prolabs, Solid
Optics, Juniper, and unbranded), the card exhibits exactly the same
behaviour with all of them.
If I boot a Linux Live image, it works fine.
This is unfortunately a major problem for us as we need this particular box
to work reliably after boot (it runs our out-of-band management network,
and the fibre runs off to a transit provider).
I don't believe the issue is that it's a non-intel optic, as there are no
warnings in dmesg, and I have tried using a grub module type=file override
to ixgbe.conf, setting "allow_unsupported_sfp=1". We've also swapped to a
different X520-DA2 card which did exactly the same thing.
Nothing I do in userland seems to make it spring into life, plumbing,
creating vnics, aggregations, etc, nothing except replugging the cable.
Here's some additional information, please let me know if anything else
would be helpful:
[root@oob-gz ~]# /usr/lib/dl/dltraninfo -v
ixgbe2: discovered 1 transceiver
transceiver 0 present: yes
transceiver 0 usable: yes
Identifier: 'SFP/SFP+/SFP28'
Extended Identifier: 4
Connector: 'LC (Lucent Connector)'
Ethernet Compliance Codes[0]: '1000BASE-LX'
Fibre Channel Link Lengths[0]: 'long distance (L)'
Fibre Channel Technology[0]: 'Longwave laser (LC)'
Fibre Channel Transmission Media[0]: 'Single Mode (SM)'
Fibre Channel Speed[0]: '100 MBytes/sec'
Encoding: '8B/10B'
BR, nominal: '1200 MBd'
Length SMF (km): '10 km'
Length SMF (m): '10000 m'
Length 50um OM2: '550 m'
Length 62.5um OM1: '550 m'
Vendor: 'CISCO-PROLABS'
OUI[0]: 0
OUI[1]: 0
OUI[2]: 0
Part Number: 'GLC-LH-SM-C'
Laser Wavelength: '1310 nm'
Options[0]: 'Rx_LOS implemented'
Options[1]: 'TX_DISABLE implemented'
Serial Number: 'PR04030006'
Date Code: '060215'
8472 Compliance: 'Not compliant'
[root@oob-gz ~]# dladm show-phys -m | egrep 'ixgbe2|^L'
LINK SLOT ADDRESS INUSE CLIENT
ixgbe2 primary 90:e2:ba:a1:53:98 yes ixgbe2
[root@oob-gz ~]# dladm show-phys | egrep 'ixgbe2|^L'
LINK MEDIA STATE SPEED DUPLEX DEVICE
ixgbe2 Ethernet down 0 unknown ixgbe2
[root@oob-gz ~]# dladm show-ether | egrep 'ixgbe2|^L'
LINK PTYPE STATE AUTO SPEED-DUPLEX
PAUSE
ixgbe2 current down yes 0G bi
[root@oob-gz ~]# ifconfig ixgbe2 plumb up
[root@oob-gz ~]# dladm show-phys | egrep 'ixgbe2|^L'
LINK MEDIA STATE SPEED DUPLEX DEVICE
ixgbe2 Ethernet down 0 unknown ixgbe2
[root@oob-gz ~]# dmesg | grep -i ixgbe2
2018-04-18T14:10:29.624591+00:00 oob-gz mac: [ID 469746 kern.info] NOTICE:
ixgbe2 registered
2018-04-18T14:10:29.624598+00:00 oob-gz ixgbe: [ID 611667 kern.info]
NOTICE: ixgbe2: Intel 10Gb Ethernet
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0
group: protocol version: 1 stability:
Private/Private
resource fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0
label string MB
FRU fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0
ASRU fmri dev:////pci@0,0/pci8086,6f04@2/pci8086,3@0
group: authority version: 1 stability:
Private/Private
product-id string SYS-1028R-WTRT
chassis-id string E15750126901315
server-id string oob-gz
group: io version: 1 stability:
Private/Private
dev string /pci@0,0/pci8086,6f04@2/pci8086,3@0
driver string ixgbe
module fmri mod:///mod-name=ixgbe/mod-id=242
group: pci version: 1 stability:
Private/Private
device-id string 10fb
extended-capabilities string pciexdev
class-code string 20000
vendor-id string 8086
assigned-addresses uint32[] [ 3271688208 0 4224188416 0 524288
2164391960 0 53280 0 32 3271688224 0 4224729088 0 16384 ]
vendor-name string Intel Corporation
device-name string 82599ES 10-Gigabit SFI/SFP+ Network
Connection
subsystem-name string Ethernet Server Adapter X520-2
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0/port=0
group: protocol version: 1 stability:
Private/Private
resource fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0/port=0
FRU fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0
group: authority version: 1 stability:
Private/Private
product-id string SYS-1028R-WTRT
chassis-id string E15750126901315
server-id string oob-gz
group: port version: 1 stability:
Private/Private
type string sff
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315:serial=PR04030006:part=GLC-LH-SM-C/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0/port=0/transceiver=0
group: protocol version: 1 stability:
Private/Private
resource fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315:serial=PR04030006:part=GLC-LH-SM-C/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0/port=0/transceiver=0
FRU fmri
hc://:product-id=SYS-1028R-WTRT:server-id=oob-gz:chassis-id=E15750126901315:serial=PR04030006:part=GLC-LH-SM-C/motherboard=0/hostbridge=1/pciexrc=1/pciexbus=2/pciexdev=0/pciexfn=0/port=0/transceiver=0
group: authority version: 1 stability:
Private/Private
product-id string SYS-1028R-WTRT
chassis-id string
server-id string oob-gz
group: transceiver version: 1 stability:
Private/Private
type string sff
usable string true
group: sff-transceiver version: 1 stability:
Private/Private
vendor string CISCO-PROLABS
part-number string GLC-LH-SM-C
serial-number string PR04030006
-------------------------------------------
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
Modify Your Subscription:
https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com
