Hi Dax, (Just catching up on list traffic after vacation.)
I had a similar experience the first time I used a Dell OEM 82599 on a R710. Problem was that I hadn't enabled SR-IOV in the system (BIOS) settings. The option was at the bottom of one of the menus and was only a recent addition at the time so easily missed. Regards, James > -----Original Message----- > From: Greg Rose [mailto:[email protected]] > Sent: 25 May 2012 16:26 > To: Dax Kelson > Cc: [email protected] > Subject: Re: [E1000-devel] Dell R720 SR-IOV failure with igb > > On Fri, 25 May 2012 09:03:21 -0600 > Dax Kelson <[email protected]> wrote: > > > On Fri, 2012-05-25 at 07:57 -0700, Greg Rose wrote: > > > > > I haven't seen one of these NIC daughterboards from Dell before but > > > I had heard about them. Could you please send along the output of > > > lspci -vvv -s 08:00.0 and lspci -vvv -s 08:00.1? > > > > Thanks for replying Greg. Here is the information requested: > > OK, that's what I suspected. Your config is missing the SR-IOV > capability structure. It would look something like this: > > Capabilities: [160] Single Root I/O Virtualization (SR-IOV) > IOVCap: Migration-, Interrupt Message Number: 000 > IOVCtl: Enable- Migration- Interrupt- MSE- > ARIHierarchy- > IOVSta: Migration- > Initial VFs: 8, Total VFs: 8, Number of VFs: 0, > Function Depende > ncy Link: 00 > VF offset: 384, stride: 4, Device ID: 1520 > Supported Page Size: 00000553, System Page Size: > 00000001 > VF Migration: offset: 00000000, BIR: 1 > > This is from a dump on an I350 controller on one of my lab systems. > > This is a feature that is controlled by EEPROM settings. I'm guessing > that Dell has decided to defeature SR-IOV support for the I350 devices > on their daughter card. Or they could have made a mistake in > programming the EEPROM. In either case the attempt to enable SR-IOV on > devices without the SR-IOV capability structure will fail. I'd suggest > contacting your Dell supplier and getting further information from > them. > > - Greg > > > > > # lspci -vvv -s 08:00.0 > > 08:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network > > Connection (rev 01) Subsystem: Dell Gigabit 4P X540/I350 rNDC > > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- > > ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- > > FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- > > INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin D routed > > to IRQ 19 Region 0: Memory at dae80000 (32-bit, non-prefetchable) > > [size=512K] Region 2: I/O ports at ecc0 [size=32] > > Region 3: Memory at daff8000 (32-bit, non-prefetchable) > > [size=16K] Expansion ROM at da000000 [disabled] [size=512K] > > Capabilities: [40] Power Management version 3 > > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA > > PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 NoSoftRst+ PME-Enable- > > DSel=0 DScale=1 PME- Capabilities: [50] MSI: Enable- Count=1/1 > > Maskable+ 64bit+ Address: 0000000000000000 Data: 0000 > > Masking: 00000000 Pending: 00000000 > > Capabilities: [70] MSI-X: Enable+ Count=10 Masked- > > Vector table: BAR=3 offset=00000000 > > PBA: BAR=3 offset=00002000 > > Capabilities: [a0] Express (v2) Endpoint, MSI 00 > > DevCap: MaxPayload 512 bytes, PhantFunc 0, > > Latency L0s <512ns, L1 <64us ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ > > FLReset+ DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ > > Unsupported+ RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset- > > MaxPayload 128 bytes, MaxReadReq 512 bytes > > DevSta: CorrErr+ UncorrErr- FatalErr- > > UnsuppReq+ AuxPwr+ TransPend- LnkCap: Port #0, Speed 5GT/s, > > Width x4, ASPM L0s L1, Latency L0 <4us, L1 <32us ClockPM- Surprise- > > LLActRep- BwNot- LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- > > Retrain- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > > LnkSta: Speed 5GT/s, Width x2, TrErr- Train- > > SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: > > Range ABCD, TimeoutDis+ DevCtl2: Completion Timeout: 65ms to 210ms, > > TimeoutDis- LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- > > SpeedDis-, Selectable De-emphasis: -6dB Transmit Margin: Normal > > Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance > > De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB > > Capabilities: [e0] Vital Product Data > > Product Name: I350 GbE Controller > > Read-only fields: > > [V0] Vendor specific: FFV13.1.10 > > [PN] Part number: G14843 > > [MN] Manufacture ID: 31 30 32 38 > > [V1] Vendor specific: DSV1028VPDR.VER1.0 > > [V3] Vendor specific: DTINIC > > [V4] Vendor specific: > > DCM1001008FC52101008FC53201008FC54301008FC5 [V5] Vendor specific: > NPY4 > > [V6] Vendor specific: PMT13 > > [V7] Vendor specific: NMVIntel Corp > > [RV] Reserved: checksum good, 1 byte(s) > > reserved End > > Capabilities: [100] Advanced Error Reporting > > UESta: DLP- SDES- TLP- FCP- CmpltTO- > > CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > > UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ > > RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES+ > > TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ > > UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- > > Timeout- NonFatalErr+ CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ > > Timeout+ NonFatalErr+ AERCap: First Error Pointer: 00, GenCap+ > > CGenEn- ChkCap+ ChkEn- Capabilities: [140] Device Serial Number > > bc-30-5b-ff-ff-ff-ff-03 Capabilities: [150] Alternative Routing-ID > > Interpretation (ARI) ARICap: MFVC- ACS-, Next Function: 1 > > ARICtl: MFVC- ACS-, Function Group: 0 Capabilities: [1a0] > > Transaction Processing Hints Device specific mode supported Steering > > table in TPH capability structure Capabilities: [1c0] Latency > > Tolerance Reporting Max snoop latency: 0ns > > Max no snoop latency: 0ns > > Capabilities: [1d0] Access Control Services > > ACSCap: SrcValid- TransBlk- ReqRedir- > > CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- ACSCtl: > > SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- > > DirectTrans- Kernel driver in use: igb Kernel modules: igb > > > > # lspci -vvv -s 08:00.1 > > 08:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network > > Connection (rev 01) Subsystem: Dell Gigabit 4P X540/I350 rNDC > > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- > > ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- > > FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- > > INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin C routed > > to IRQ 18 Region 0: Memory at daf00000 (32-bit, non-prefetchable) > > [size=512K] Region 2: I/O ports at ece0 [size=32] > > Region 3: Memory at daffc000 (32-bit, non-prefetchable) > > [size=16K] Expansion ROM at d5600000 [disabled] [size=512K] > > Capabilities: [40] Power Management version 3 > > Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA > > PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 NoSoftRst+ PME-Enable- > > DSel=0 DScale=1 PME- Capabilities: [50] MSI: Enable- Count=1/1 > > Maskable+ 64bit+ Address: 0000000000000000 Data: 0000 > > Masking: 00000000 Pending: 00000000 > > Capabilities: [70] MSI-X: Enable+ Count=10 Masked- > > Vector table: BAR=3 offset=00000000 > > PBA: BAR=3 offset=00002000 > > Capabilities: [a0] Express (v2) Endpoint, MSI 00 > > DevCap: MaxPayload 512 bytes, PhantFunc 0, > > Latency L0s <512ns, L1 <64us ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ > > FLReset+ DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ > > Unsupported+ RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset- > > MaxPayload 128 bytes, MaxReadReq 512 bytes > > DevSta: CorrErr+ UncorrErr- FatalErr- > > UnsuppReq+ AuxPwr+ TransPend- LnkCap: Port #0, Speed 5GT/s, > > Width x4, ASPM L0s L1, Latency L0 <4us, L1 <32us ClockPM- Surprise- > > LLActRep- BwNot- LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- > > Retrain- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > > LnkSta: Speed 5GT/s, Width x2, TrErr- Train- > > SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: > > Range ABCD, TimeoutDis+ DevCtl2: Completion Timeout: 65ms to 210ms, > > TimeoutDis- LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- > > SpeedDis-, Selectable De-emphasis: -6dB Transmit Margin: Normal > > Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance > > De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB > > Capabilities: [e0] Vital Product Data > > Product Name: I350 GbE Controller > > Read-only fields: > > [V0] Vendor specific: FFV13.1.10 > > [PN] Part number: G14843 > > [MN] Manufacture ID: 31 30 32 38 > > [V1] Vendor specific: DSV1028VPDR.VER1.0 > > [V3] Vendor specific: DTINIC > > [V4] Vendor specific: > > DCM1001008FC52101008FC53201008FC54301008FC5 [V5] Vendor specific: > NPY4 > > [V6] Vendor specific: PMT13 > > [V7] Vendor specific: NMVIntel Corp > > [RV] Reserved: checksum good, 1 byte(s) > > reserved End > > Capabilities: [100] Advanced Error Reporting > > UESta: DLP- SDES- TLP- FCP- CmpltTO- > > CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > > UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ > > RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES+ > > TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ > > UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- > > Timeout- NonFatalErr+ CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ > > Timeout+ NonFatalErr+ AERCap: First Error Pointer: 00, GenCap+ > > CGenEn- ChkCap+ ChkEn- Capabilities: [140] Device Serial Number > > bc-30-5b-ff-ff-ff-ff-03 Capabilities: [150] Alternative Routing-ID > > Interpretation (ARI) ARICap: MFVC- ACS-, Next Function: 0 > > ARICtl: MFVC- ACS-, Function Group: 0 Capabilities: [1a0] > > Transaction Processing Hints Device specific mode supported Steering > > table in TPH capability structure Capabilities: [1d0] Access Control > > Services ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- > > UpstreamFwd- EgressCtrl- DirectTrans- ACSCtl: SrcValid- > > TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- > > Kernel driver in use: igb Kernel modules: igb > > > > > > > ----------------------------------------------------------------------- > ------- > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. > Discussions > will include endpoint security, mobile security and the latest in > malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > E1000-devel mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/e1000-devel > To learn more about Intel® Ethernet, visit > http://communities.intel.com/community/wired ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ E1000-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
