On Wed, 2012-08-15 at 20:32 +0000, Multanen, Eric W wrote: > > >-----Original Message----- > >From: devel-boun...@open-fcoe.org [mailto:devel-boun...@open-fcoe.org] On > >Behalf Of Andrew Theurer > >Sent: Wednesday, August 15, 2012 1:13 PM > >To: Brattain, Ross B > >Cc: lldp-de...@open-lldp.org; devel@open-fcoe.org > >Subject: Re: [Open-FCoE] Having some trouble with FCoE with Intel 82599EB & > >BNT G1824 > > > >On Wed, 2012-08-15 at 10:00 -0700, Ross Brattain wrote: > >> On Wed, 15 Aug 2012 11:24:12 -0500 > >> Andrew Theurer <haban...@linux.vnet.ibm.com> wrote: > >> > >> > On Tue, 2012-08-14 at 14:19 -0700, Ross Brattain wrote: > >> > > On Tue, 14 Aug 2012 15:04:49 -0500 Andrew Theurer > >> > > <haban...@linux.vnet.ibm.com> wrote: > >> > > > >> > > > Hello, > >> > > > > >> > > > I am trying to get FCoE working, at least getting a initiator to > >> > > > exist at first (and eventually a target). I am having some > >> > > > trouble keeping a link up once lldpad has started. > >> > > > > >> > > > If I boot up and ifup the adapter for IP, but not start lldpad > >> > > > or fcoe yet, the interface is functional and I can ping other > >> > > > devices. However, once I start lldpad, the interface link > >> > > > cycles on/off in 20-30 second intervals. /var/log/messages simply > >> > > > has: > >> > > > > >> > > > > >> > > > > Aug 14 14:49:23 spv-20 kernel: ixgbe 0000:20:00.1: eth9: > >> > > > > detected SFP+: 4 Aug 14 14:49:27 spv-20 kernel: ixgbe > >> > > > > 0000:20:00.1: eth9: NIC Link is Up 10 Gbps, Flow Control: > >> > > > > RX/TX Aug 14 14:49:42 spv-20 kernel: ixgbe 0000:20:00.1: eth9: > >> > > > > detected SFP+: 4 Aug 14 14:49:44 spv-20 kernel: ixgbe > >> > > > > 0000:20:00.1: eth9: NIC Link is Up 10 Gbps, Flow Control: > >> > > > > RX/TX Aug 14 14:50:22 spv-20 kernel: ixgbe 0000:20:00.1: eth9: > >> > > > > detected SFP+: 4 Aug 14 14:50:22 spv-20 kernel: ixgbe > >> > > > > 0000:20:00.1: eth9: detected SFP+: 4 Aug 14 14:50:26 spv-20 > >> > > > > kernel: ixgbe 0000:20:00.1: eth9: NIC Link is Up 10 Gbps, Flow > >> > > > > Control: RX/TX Aug 14 14:50:41 spv-20 kernel: ixgbe > >> > > > > 0000:20:00.1: eth9: detected SFP+: 4 Aug 14 14:50:41 spv-20 > >> > > > > kernel: ixgbe 0000:20:00.1: eth9: NIC Link is Up 10 Gbps, Flow > >> > > > > Control: RX/TX > >> > > > > >> > > > >> > > Adding lldp-devel. > >> > > > >> > > Which distro and version of lldpad are you using? > >> > > >> > RHEL 6.3, lldpad-0.9.43-18.el6.x86_64 > >> > >> There should be an updated lldpad soon. See RHEL BZ 829857. > >> > >> > >> > > >> > > lldpad should start with IEEE DCBX by default and then downshift to > >> > > CEE > >DCBX. > >> > > > >> > > There was a link flap recently that was fixed with > >> > > http://www.open-lldp.org/patchwork/patch/2507/ > >> > > > >> > > Or, if you don't need IEEE you can force CEE which dcbtool sc dcbx > >> > > v:force- > >cee and then restart lldpad. > >> > > >> > Thanks, I think forcing CEE stopped the link down/up cycling. I > >> > seem to however run in to the next issue, which is probably a switch > >> > micconfiguration(?): > >> > > >> > > Aug 15 11:12:23 spv-20 fcoemon: /etc/fcoe/cfg-eth9: FCOE_ENABLE = > >"yes" > >> > > Aug 15 11:12:23 spv-20 fcoemon: /etc/fcoe/cfg-eth9: DCB_REQUIRED = > >"yes" > >> > > Aug 15 11:12:23 spv-20 fcoemon: /etc/fcoe/cfg-eth9: AUTO_VLAN = "yes" > >> > > Aug 15 11:12:23 spv-20 fcoemon: connected to lldpad Aug 15 > >> > > 11:12:23 spv-20 fcoemon: Successfully created socket, socket file > >> > > and binding Aug 15 11:12:23 spv-20 fcoemon: Link event: 16 flags > >> > > 10049 index 1 Aug 15 11:12:23 spv-20 fcoemon: Link event: 16 flags > >> > > 01002 index 2 Aug 15 11:12:23 spv-20 fcoemon: ifname eth0 Aug 15 > >> > > 11:12:23 spv-20 fcoemon: Link event: 16 flags 01002 index 3 Aug 15 > >> > > 11:12:23 spv-20 fcoemon: ifname eth1 Aug 15 11:12:23 spv-20 > >> > > fcoemon: Link event: 16 flags 01002 index 4 Aug 15 11:12:23 spv-20 > >> > > fcoemon: ifname eth6 Aug 15 11:12:23 spv-20 fcoemon: Link event: > >> > > 16 flags 01002 index 5 Aug 15 11:12:23 spv-20 fcoemon: ifname eth7 > >> > > Aug 15 11:12:23 spv-20 fcoemon: Link event: 16 flags 01002 index 6 > >> > > Aug 15 11:12:23 spv-20 fcoemon: ifname eth8 Aug 15 11:12:23 spv-20 > >> > > fcoemon: Link event: 16 flags 11043 index 7 Aug 15 11:12:23 spv-20 > >> > > fcoemon: ifname eth9 Aug 15 11:12:23 spv-20 fcoemon: eth9, > >> > > Monitoring port eth9 Aug 15 11:12:23 spv-20 fcoemon: eth9, INIT -> > >> > > GET_DCB_STATE Aug 15 11:12:23 spv-20 fcoemon: eth9, IEEE_INIT -> > >> > > IEEE_GET_STATE Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_DCB_STATE > >> > > -> GET_DCB_STATE Aug 15 11:12:23 spv-20 fcoemon: eth9, > >> > > IEEE_GET_STATE -> IEEE_GET_STATE Aug 15 11:12:23 spv-20 fcoemon: > >> > > Link event: 16 flags 11043 index 8 Aug 15 11:12:23 spv-20 fcoemon: > >> > > ifname eth2 Aug 15 11:12:23 spv-20 fcoemon: sent 'C301010004eth9', > >> > > rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: Link event: > >> > > 16 flags 01002 index 9 Aug 15 11:12:23 spv-20 fcoemon: ifname eth3 > >> > > Aug 15 11:12:23 spv-20 fcoemon: Link event: 16 flags 01002 index > >> > > 10 Aug 15 11:12:23 spv-20 fcoemon: ifname eth4 Aug 15 11:12:23 > >> > > spv-20 fcoemon: Link event: 16 flags 01002 index 11 Aug 15 > >> > > 11:12:23 spv-20 fcoemon: ifname eth5 Aug 15 11:12:23 spv-20 > >> > > fcoemon: Link event: 16 flags 01002 index 12 Aug 15 11:12:23 > >> > > spv-20 fcoemon: ifname usb0 Aug 15 11:12:23 spv-20 fcoemon: Link > >> > > event: 16 flags 11043 index 13 Aug 15 11:12:23 spv-20 fcoemon: > >> > > ifname br2 Aug 15 11:12:23 spv-20 fcoemon: fcm_process_ieee_msg: > >> > > eth9: FCoE pri mask = 0x08 Aug 15 11:12:23 spv-20 fcoemon: > >> > > received len 18 buf 'R00C301010004eth91' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_DCB_STATE -> > >> > > GET_PFC_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 > >> > > fcoemon: fcm_process_ieee_msg: eth9: FCoE pri mask = 0x08 Aug 15 > >> > > 11:12:23 spv-20 fcoemon: eth9, IEEE_GET_STATE -> IEEE_DONE Aug 15 > >11:12:23 spv-20 fcoemon: received len 29 buf > >'R00C301030004eth9111000000008' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> > >> > > GET_APP_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301050004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 24 buf 'R00C301050004eth91110208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_APP_CONFIG -> > >> > > GET_PFC_OPER Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C303030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 34 buf 'R00C303030004eth90000090100000000x' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer > >> > > error Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_OPER -> > >> > > GET_APP_OPER Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC feature is > >> > > synced Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC operating mode is > >> > > off Aug 15 11:12:23 spv-20 fcoemon: sent 'C303050004eth9', rc=14 > >> > > bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: received len 29 buf > >'R00C303050004eth9000008010208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, GET_APP_OPER -> DONE Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE feature is synced Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE operating mode is off Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: FCoE operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: APP:0 operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: PFC operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer error Aug > >> > > 15 11:12:23 spv-20 fcoemon: eth9, WARNING: APP:0 priority (0x08) > >> > > doesn't intersect with PFC priority (0x00) Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: DCB may be configured incorrectly Aug 15 > >> > > 11:12:23 spv-20 fcoemon: eth9, DONE -> ERROR Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, eth9: SETTING lldpad RETRY TIMER = 200000 > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9: lldpad retry TIMEOUT > >> > > occurred [1] Aug 15 11:12:23 spv-20 fcoemon: eth9, ERROR -> > >> > > GET_DCB_STATE Aug 15 11:12:23 spv-20 fcoemon: sent 'C301010004eth9', > >rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: received len 18 buf > >'R00C301010004eth91' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_DCB_STATE -> > >> > > GET_PFC_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 29 buf 'R00C301030004eth9111000000008' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> > >> > > GET_APP_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301050004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 24 buf 'R00C301050004eth91110208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_APP_CONFIG -> > >> > > GET_PFC_OPER Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C303030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 34 buf 'R00C303030004eth90000090100000000x' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer > >> > > error Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_OPER -> > >> > > GET_APP_OPER Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC feature is > >> > > synced Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC operating mode is > >> > > off Aug 15 11:12:23 spv-20 fcoemon: sent 'C303050004eth9', rc=14 > >> > > bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: received len 29 buf > >'R00C303050004eth9000008010208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, GET_APP_OPER -> DONE Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE feature is synced Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE operating mode is off Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: FCoE operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: APP:0 operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: PFC operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer error Aug > >> > > 15 11:12:23 spv-20 fcoemon: eth9, WARNING: APP:0 priority (0x08) > >> > > doesn't intersect with PFC priority (0x00) Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: DCB may be configured incorrectly Aug 15 > >> > > 11:12:23 spv-20 fcoemon: eth9, DONE -> ERROR Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, eth9: SETTING lldpad RETRY TIMER = 400000 > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9: lldpad retry TIMEOUT > >> > > occurred [2] Aug 15 11:12:23 spv-20 fcoemon: eth9, ERROR -> > >> > > GET_DCB_STATE Aug 15 11:12:23 spv-20 fcoemon: sent 'C301010004eth9', > >rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: received len 18 buf > >'R00C301010004eth91' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_DCB_STATE -> > >> > > GET_PFC_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 29 buf 'R00C301030004eth9111000000008' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> > >> > > GET_APP_CONFIG Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C301050004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 24 buf 'R00C301050004eth91110208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_APP_CONFIG -> > >> > > GET_PFC_OPER Aug 15 11:12:23 spv-20 fcoemon: sent > >> > > 'C303030004eth9', rc=14 bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: > >received len 34 buf 'R00C303030004eth90000090100000000x' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer > >> > > error Aug 15 11:12:23 spv-20 fcoemon: eth9, GET_PFC_OPER -> > >> > > GET_APP_OPER Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC feature is > >> > > synced Aug 15 11:12:23 spv-20 fcoemon: eth9, PFC operating mode is > >> > > off Aug 15 11:12:23 spv-20 fcoemon: sent 'C303050004eth9', rc=14 > >> > > bytes succeeded Aug 15 11:12:23 spv-20 fcoemon: received len 29 buf > >'R00C303050004eth9000008010208' > >> > > Aug 15 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, GET_APP_OPER -> DONE Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE feature is synced Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, FCoE operating mode is off Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: FCoE operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: APP:0 operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: PFC operational mode is false Aug 15 > >> > > 11:12:23 spv-20 fcoemon: 0x09 - mismatch with peer, peer error Aug > >> > > 15 11:12:23 spv-20 fcoemon: eth9, WARNING: APP:0 priority (0x08) > >> > > doesn't intersect with PFC priority (0x00) Aug 15 11:12:23 spv-20 > >> > > fcoemon: eth9, WARNING: DCB may be configured incorrectly Aug 15 > >> > > 11:12:23 spv-20 fcoemon: eth9, DONE -> ERROR Aug 15 11:12:23 > >> > > spv-20 fcoemon: eth9, eth9: SETTING lldpad RETRY TIMER = 600000 > >> > > Aug 15 11:12:24 spv-20 fcoemon: eth9: lldpad retry TIMEOUT > >> > > occurred [3] Aug 15 11:12:24 spv-20 fcoemon: eth9, ERROR -> > >> > > GET_DCB_STATE Aug 15 11:12:24 spv-20 fcoemon: sent 'C301010004eth9', > >rc=14 bytes succeeded Aug 15 11:12:24 spv-20 fcoemon: received len 18 buf > >'R00C301010004eth91' > >> > > Aug 15 11:12:24 spv-20 fcoemon: eth9, GET_DCB_STATE -> > >> > > GET_PFC_CONFIG Aug 15 11:12:24 spv-20 fcoemon: sent > >> > > 'C301030004eth9', rc=14 bytes succeeded Aug 15 11:12:24 spv-20 fcoemon: > >received len 29 buf 'R00C301030004eth9111000000008' > >> > > Aug 15 11:12:24 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> > >> > > GET_APP_CONFIG Aug 15 11:12:24 spv-20 fcoemon: sent > >> > > 'C301050004eth9', rc=14 bytes succeeded Aug 15 11:12:24 spv-20 fcoemon: > >received len 24 buf 'R00C301050004eth91110208' > >> > > Aug 15 11:12:24 spv-20 fcoemon: eth9, GET_APP_CONFIG -> > >> > > GET_PFC_OPER Aug 15 11:12:24 spv-20 fcoemon: sent > >> > > 'C303030004eth9', rc=14 bytes succeeded Aug 15 11:12:24 spv-20 fcoemon: > >received len 34 buf 'R00C303030004eth90000090100000000x' > >> > > Aug 15 11:12:24 spv-20 fcoemon: 0x09 - mismatch with peer, peer > >> > > error Aug 15 11:12:24 spv-20 fcoemon: eth9, GET_PFC_OPER -> > >> > > GET_APP_OPER Aug 15 11:12:24 spv-20 fcoemon: eth9, PFC feature is > >> > > synced Aug 15 11:12:24 spv-20 fcoemon: eth9, PFC operating mode is > >> > > off Aug 15 11:12:24 spv-20 fcoemon: sent 'C303050004eth9', rc=14 > >> > > bytes succeeded Aug 15 11:12:24 spv-20 fcoemon: received len 29 buf > >'R00C303050004eth9000008010208' > >> > > Aug 15 11:12:24 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:24 > >> > > spv-20 fcoemon: eth9, GET_APP_OPER -> DONE Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, FCoE feature is synced Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, FCoE operating mode is off Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, WARNING: FCoE operational mode is false Aug 15 > >> > > 11:12:24 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, WARNING: APP:0 operational mode is false Aug 15 > >> > > 11:12:24 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, WARNING: PFC operational mode is false Aug 15 > >> > > 11:12:24 spv-20 fcoemon: 0x09 - mismatch with peer, peer error Aug > >> > > 15 11:12:24 spv-20 fcoemon: eth9, WARNING: APP:0 priority (0x08) > >> > > doesn't intersect with PFC priority (0x00) Aug 15 11:12:24 spv-20 > >> > > fcoemon: eth9, WARNING: DCB may be configured incorrectly Aug 15 > >> > > 11:12:24 spv-20 fcoemon: eth9, DONE -> ERROR Aug 15 11:12:24 > >> > > spv-20 fcoemon: eth9, eth9: SETTING lldpad RETRY TIMER = 800000 > >> > > Aug 15 11:12:25 spv-20 fcoemon: eth9: lldpad retry TIMEOUT > >> > > occurred [4] Aug 15 11:12:25 spv-20 fcoemon: eth9, ERROR -> > >> > > GET_DCB_STATE Aug 15 11:12:25 spv-20 fcoemon: sent 'C301010004eth9', > >rc=14 bytes succeeded Aug 15 11:12:25 spv-20 fcoemon: received len 18 buf > >'R00C301010004eth91' > >> > > Aug 15 11:12:25 spv-20 fcoemon: eth9, GET_DCB_STATE -> > >> > > GET_PFC_CONFIG Aug 15 11:12:25 spv-20 fcoemon: sent > >> > > 'C301030004eth9', rc=14 bytes succeeded Aug 15 11:12:25 spv-20 fcoemon: > >received len 29 buf 'R00C301030004eth9111000000008' > >> > > Aug 15 11:12:25 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> > >> > > GET_APP_CONFIG Aug 15 11:12:25 spv-20 fcoemon: sent > >> > > 'C301050004eth9', rc=14 bytes succeeded Aug 15 11:12:25 spv-20 fcoemon: > >received len 24 buf 'R00C301050004eth91110208' > >> > > Aug 15 11:12:25 spv-20 fcoemon: eth9, GET_APP_CONFIG -> > >> > > GET_PFC_OPER Aug 15 11:12:25 spv-20 fcoemon: sent > >> > > 'C303030004eth9', rc=14 bytes succeeded Aug 15 11:12:25 spv-20 fcoemon: > >received len 34 buf 'R00C303030004eth90000090100000000x' > >> > > Aug 15 11:12:25 spv-20 fcoemon: 0x09 - mismatch with peer, peer > >> > > error Aug 15 11:12:25 spv-20 fcoemon: eth9, GET_PFC_OPER -> > >> > > GET_APP_OPER Aug 15 11:12:25 spv-20 fcoemon: eth9, PFC feature is > >> > > synced Aug 15 11:12:25 spv-20 fcoemon: eth9, PFC operating mode is > >> > > off Aug 15 11:12:25 spv-20 fcoemon: sent 'C303050004eth9', rc=14 > >> > > bytes succeeded Aug 15 11:12:25 spv-20 fcoemon: received len 29 buf > >'R00C303050004eth9000008010208' > >> > > Aug 15 11:12:25 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:25 > >> > > spv-20 fcoemon: eth9, GET_APP_OPER -> DONE Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, FCoE feature is synced Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, FCoE operating mode is off Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, WARNING: FCoE operational mode is false Aug 15 > >> > > 11:12:25 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, WARNING: APP:0 operational mode is false Aug 15 > >> > > 11:12:25 spv-20 fcoemon: 0x08 - peer error Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, WARNING: PFC operational mode is false Aug 15 > >> > > 11:12:25 spv-20 fcoemon: 0x09 - mismatch with peer, peer error Aug > >> > > 15 11:12:25 spv-20 fcoemon: eth9, WARNING: APP:0 priority (0x08) > >> > > doesn't intersect with PFC priority (0x00) Aug 15 11:12:25 spv-20 > >> > > fcoemon: eth9, WARNING: DCB may be configured incorrectly Aug 15 > >> > > 11:12:25 spv-20 fcoemon: eth9, DONE -> ERROR > >> > > >> > I assume the "WARNING: APP:0 priority (0x08) doesn't intersect with > >> > PFC priority (0x00)" is the main problem. I do have PFC enabled on > >> > the switch ports, but only "priority value 3" is enabled. Is this > >> > not correct? > >> > >> You may need to enable PFC and App:0 again. Try dcbtool sc eth9 pfc > >> e:1 ; dcbtool sc eth9 app:0 e:1 > > > >OK tried that, but seem to get the same error as before. > > > >> Can you provide the output from: > >> > > > >> lldptool -tni eth9 > > > > > >> [root@spv-20 fcoe]# lldptool -tni eth9 Chassis ID TLV > >> MAC: 08:17:f4:5e:35:00 > >> Port ID TLV > >> Local: 8 > >> Time to Live TLV > >> 120 > >> Port Description TLV > >> 8 > >> System Name TLV > >> > >> System Description TLV > >> IBM Networking Operating System RackSwitch G8124, flash image: > >> version 6.8.2, boot image: version 6.8.2 System Capabilities TLV > >> System capabilities: Bridge, Router > >> Enabled capabilities: Bridge, Router > >> Management Address TLV > >> IPv4: 10.0.1.243 > >> Ifindex: 127 > >> Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 1, Info: 0001 Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 2, Info: 020001 Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 2, Info: 0203ea Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 3, Info: 00010c44656661756c7420564c414e > >> Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 3, Info: 03ea09564c414e2031303032 > >> Unidentified Org Specific TLV > >> OUI: 0x0080c2, Subtype: 4, Info: 00 > >> MAC/PHY Configuration Status TLV > >> Auto-negotiation not supported and not enabled > >> PMD auto-negotiation capabilities: 0x8000 > >> MAU type: Unknown [0x0029] > >> Power via MDI TLV > >> Port class PD, PSE MDI power not supported, PSE pairs not > >> controllable, PSE Power pair: unkwown [0], Power class 1 Link Aggregation > >> TLV > >> Aggregation capable > >> Currently not aggregated > >> Aggregated Port ID: 0 > >> Maximum Frame Size TLV > >> 1522 > >> CEE DCBX TLV > >> Control TLV: > >> SeqNo: 2, AckNo: 2 > >> Priority Groups TLV: > >> Enabled, Willing, No Error > >> PGID Priorities: 2:[0,1,2] 3:[3] 4:[4,5,6] 15:[7] > >> PGID Percentages: 0:0% 1:0% 2:10% 3:50% 4:40% 5:0% 6:0% 7:0% > >> Number of TC's supported: 8 > >> Priority Flow Control TLV: > >> Enabled, Willing, Error > >> PFC enabled priorities: 3 > >> Number of TC's supported: 2 > >> Application TLV: > >> Enabled, Willing, Error > >> Ethertype: 0x8906, Priority Map: 0x08 > >> Ethertype: 0x8914, Priority Map: 0x08 End of LLDPDU TLV > > The switch DCB settings are 'Willing' - set them to 'Unwilling'
Thanks Eric, that allowed the the FCoE/DCB to configure correctly: > Aug 16 09:02:01 spv-20 fcoemon: sent 'C301010004eth9', rc=14 bytes succeeded > Aug 16 09:02:01 spv-20 fcoemon: received len 18 buf 'R00C301010004eth91' > Aug 16 09:02:01 spv-20 fcoemon: eth9, GET_DCB_STATE -> GET_PFC_CONFIG > Aug 16 09:02:01 spv-20 fcoemon: sent 'C301030004eth9', rc=14 bytes succeeded > Aug 16 09:02:01 spv-20 fcoemon: received len 29 buf > 'R00C301030004eth9111000000008' > Aug 16 09:02:01 spv-20 fcoemon: eth9, GET_PFC_CONFIG -> GET_APP_CONFIG > Aug 16 09:02:01 spv-20 fcoemon: sent 'C301050004eth9', rc=14 bytes succeeded > Aug 16 09:02:01 spv-20 fcoemon: received len 24 buf 'R00C301050004eth91110208' > Aug 16 09:02:01 spv-20 fcoemon: eth9, GET_APP_CONFIG -> GET_PFC_OPER > Aug 16 09:02:01 spv-20 fcoemon: sent 'C303030004eth9', rc=14 bytes succeeded > Aug 16 09:02:01 spv-20 fcoemon: received len 34 buf > 'R00C303030004eth90000001100010000x' > Aug 16 09:02:01 spv-20 fcoemon: eth9, GET_PFC_OPER -> GET_APP_OPER > Aug 16 09:02:01 spv-20 fcoemon: eth9, PFC feature is synced > Aug 16 09:02:01 spv-20 fcoemon: eth9, PFC operating mode is on > Aug 16 09:02:01 spv-20 fcoemon: sent 'C303050004eth9', rc=14 bytes succeeded > Aug 16 09:02:01 spv-20 fcoemon: received len 29 buf > 'R00C303050004eth9000000110208' > Aug 16 09:02:01 spv-20 fcoemon: eth9, GET_APP_OPER -> DONE > Aug 16 09:02:01 spv-20 fcoemon: eth9, FCoE feature is synced > Aug 16 09:02:01 spv-20 fcoemon: eth9, FCoE operating mode is on > Aug 16 09:02:01 spv-20 fcoemon: eth9, DCB is configured correctly > Aug 16 09:02:01 spv-20 fcoemon: eth9, DONE -> INIT I just need to get FIP VLAN requests to work now :) > Aug 16 09:02:02 spv-20 fcoemon: eth9: VLAN discovery TIMEOUT [1] > Aug 16 09:02:02 spv-20 fcoemon: creating netlink socket > Aug 16 09:02:02 spv-20 fcoemon: sending FIP VLAN request > Aug 16 09:02:03 spv-20 fcoemon: eth9: VLAN discovery TIMEOUT [2] > Aug 16 09:02:03 spv-20 fcoemon: creating netlink socket > Aug 16 09:02:03 spv-20 fcoemon: sending FIP VLAN request I assume this is a switch-side problem which I'll investigate. I am not using an FCF so I guess I need to manually create a VLAN for my FCoE ports? Thanks for the help! -Andrew _______________________________________________ devel mailing list devel@open-fcoe.org https://lists.open-fcoe.org/mailman/listinfo/devel
