*Hi Greg,*
I took so many days to figure out how to run Xen-supported kernel and then
I switched on CONFIG_PCI_REALLOC_ENABLE_AUTO=y also in kernel .config. But
still I see the same error :( (SR-IOV: bus number out of range)
I am attaching the .config file also.
dmesg | grep igb gives me following :
[ 9.193184] kobject: 'igb' (ffffffffa019a310): kobject_add_internal:
parent: 'module', set: 'module'
[ 9.193193] kobject: 'holders' (ffff880218de0f40): kobject_add_internal:
parent: 'igb', set: '<NULL>'
[ 9.193233] kobject: 'notes' (ffff8802169d69c0): kobject_add_internal:
parent: 'igb', set: '<NULL>'
[ 9.193239] kobject: 'igb' (ffffffffa019a310): kobject_uevent_env
[ 9.193244] kobject: 'igb' (ffffffffa019a310): fill_kobj_path: path =
'/module/igb'
[ 9.193925] igb: Intel(R) Gigabit Ethernet Network Driver - version
3.4.7-k
[ 9.193928] igb: Copyright (c) 2007-2012 Intel Corporation.
[ 9.193935] kobject: 'igb' (ffff88021aded5c0): kobject_add_internal:
parent: 'drivers', set: 'drivers'
[ 9.194698] igb 0000:03:00.0: SR-IOV: bus number out of range
[ 9.385286] igb 0000:03:00.0: added PHC on eth1
[ 9.385291] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network
Connection
[ 9.385296] igb 0000:03:00.0: eth1: (PCIe:2.5Gb/s:Width x4)
00:1b:21:8f:bd:20
[ 9.385381] igb 0000:03:00.0: eth1: PBA No: E66339-003
[ 9.385386] igb 0000:03:00.0: Using MSI-X interrupts. 2 rx queue(s), 1
tx queue(s)
[ 9.386267] igb 0000:03:00.1: SR-IOV: bus number out of range
[ 9.577215] igb 0000:03:00.1: added PHC on eth2
[ 9.577218] igb 0000:03:00.1: Intel(R) Gigabit Ethernet Network
Connection
[ 9.577222] igb 0000:03:00.1: eth2: (PCIe:2.5Gb/s:Width x4)
00:1b:21:8f:bd:21
[ 9.577306] igb 0000:03:00.1: eth2: PBA No: E66339-003
[ 9.577309] igb 0000:03:00.1: Using MSI-X interrupts. 2 rx queue(s), 1
tx queue(s)
[ 9.578086] igb 0000:04:00.0: SR-IOV: bus number out of range
[ 9.769213] igb 0000:04:00.0: added PHC on eth3
[ 9.769217] igb 0000:04:00.0: Intel(R) Gigabit Ethernet Network
Connection
[ 9.769221] igb 0000:04:00.0: eth3: (PCIe:2.5Gb/s:Width x4)
00:1b:21:8f:bd:24
[ 9.769305] igb 0000:04:00.0: eth3: PBA No: E66339-003
[ 9.769308] igb 0000:04:00.0: Using MSI-X interrupts. 2 rx queue(s), 1
tx queue(s)
[ 9.770095] igb 0000:04:00.1: SR-IOV: bus number out of range
[ 9.961215] igb 0000:04:00.1: added PHC on eth4
[ 9.961218] igb 0000:04:00.1: Intel(R) Gigabit Ethernet Network
Connection
[ 9.961221] igb 0000:04:00.1: eth4: (PCIe:2.5Gb/s:Width x4)
00:1b:21:8f:bd:25
[ 9.961306] igb 0000:04:00.1: eth4: PBA No: E66339-003
[ 9.961310] igb 0000:04:00.1: Using MSI-X interrupts. 2 rx queue(s), 1
tx queue(s)
[ 9.961354] kobject: 'drivers' (ffff88021a1b8600): kobject_add_internal:
parent: 'igb', set: '<NULL>'
[ 9.961368] kobject: 'igb' (ffff88021aded5c0): kobject_uevent_env
[ 9.961373] kobject: 'igb' (ffff88021aded5c0): fill_kobj_path: path =
'/bus/pci/drivers/igb'
[ 19.309312] igb: eth1 NIC Link is Up 100 Mbps Full Duplex, Flow Control:
RX
I am booting the kernel as following :
title Xen+ -- openSUSE 11.4 - 3.5.0-0.11 SR - IOV
root (hd0,6)
kernel /boot/xen.gz vga=mode-0x317 intel_iommu=on msi=on iommu=on
module /boot/vmlinuz-3.5.0-0.11-xen+
root=/dev/disk/by-id/ata-ST31000528AS_9VP9NG6C-part7
resume=/dev/disk/by-id/ata-ST31000528AS_9VP9NG6C-part5 splash=silent quiet
showopts vga=0x317
module /boot/initrd-3.5.0-0.11-xen+
Does that mean I can not run SR-IOV on this machine? :-\
*
----------------------------
Thanks & Regards
Mohit Dhingra
+919611190435*
On 30 August 2012 01:24, Greg Rose <gregory.v.r...@intel.com> wrote:
> On Thu, 30 Aug 2012 00:24:44 +0530
> Mohit Dhingra <mohitdhing...@gmail.com> wrote:
>
> > *Hi Greg,*
> >
> > I added pci=assign-busses, because I saw that in the discussion (
> >
> http://www.mail-archive.com/e1000-devel@lists.sourceforge.net/msg01763.html
> > )
> >
> > How do I know if it is a BIOS issue? BTW, I have upgraded my BIOS as
> > well!!
>
> You'll know its a BIOS issue if the options to the kernel to assign pci
> busses or realloc them don't work. There's nothing we can do about it
> in the driver. As I pointed out before it is a failure in the kernel.
>
> - Greg
>
> >
> > Yes that PCI_REALLOC is not there in the kernel config.. I will try to
> > build it again with that enabled.
> >
> > *
> > ----------------------------
> > Thanks & Regards
> > Mohit Dhingra
> > +919611190435*
> >
> >
> > On 29 August 2012 23:49, Greg Rose <gregory.v.r...@intel.com> wrote:
> >
> > > On Wed, 29 Aug 2012 23:02:41 +0530
> > > Mohit Dhingra <mohitdhing...@gmail.com> wrote:
> > >
> > > > *Hello Greg,*
> > > >
> > > > I have tried that as well. Also, PCIe x4 version 2.0 is available
> > > > in my system, and that's what is required for Intel 82576 SR-IOV
> > > > Card. But still I am having the same issue. If any other details
> > > > required, I will provide that.
> > > >
> > > > *
> > > > ----------------------------
> > > > Thanks & Regards
> > > > Mohit Dhingra
> > > > +919611190435*
> > >
> > > Well the error you're experiencing comes from the pci bus driver.
> > > In drivers/net/iov.c there is this bit of code:
> > >
> > > if (virtfn_bus(dev, nr_virtfn - 1) >
> > > dev->bus->busn_res.end) { dev_err(&dev->dev, "SR-IOV: bus number
> > > out of range\n"); return -ENOMEM;
> > > }
> > >
> > > It indicates that there is no space on the bus to allocate the
> > > additional virtual functions. I'm curious why you're using
> > > pci=assign-busses. Have you tried not using that?
> > >
> > > I'm afraid that it is most likely a BIOS issue.
> > >
> > > Also, you might want to look at the information in this patch:
> > >
> > > http://www.serverphorums.com/read.php?12,450840
> > >
> > > It might require a kernel rebuild though if PCI_REALLOC isn't
> > > configured in your kernel.
> > >
> > > - Greg
> > >
> > >
> > >
> > > >
> > > >
> > > > On 29 August 2012 22:37, Greg Rose <gregory.v.r...@intel.com>
> > > > wrote:
> > > >
> > > > > On Wed, 29 Aug 2012 13:27:03 +0530
> > > > > Mohit Dhingra <mohitdhing...@gmail.com> wrote:
> > > > >
> > > > > > *Hello,*
> > > > > >
> > > > > > I have gone through couple of mail chains with the same
> > > > > > problem title, but still I am out of clue, I have tried all
> > > > > > of what is mentioned.
> > > > > >
> > > > > > 1. I am using Intel i-7 WX58BP Motherboard, with Intel 82576
> > > > > > Quad Port SR-IOV NIC attached to x-16 PCI Express slot.
> > > > > >
> > > > > > 2. I am booting my Dom0 using following:
> > > > > > title Xen -- openSUSE 11.4 - 2.6.37.6-0.11 SR-IOV
> > > > > > root (hd0,6)
> > > > > > kernel /boot/xen.gz vga=mode-0x317 iommu=1 msi=1
> > > > > > pci=assign-busses module /boot/vmlinuz-2.6.37.6-0.11-xen
> > > > > > root=/dev/disk/by-id/ata-ST31000528AS_9VP9NG6C-part7
> > > > > > resume=/dev/disk/by-id/ata-ST31000528AS_9VP9NG6C-part5
> > > > > > splash=silent quiet showopts vga=0x317 pci_pt_e820_access=on
> > > > > >
> > > > > > 3. dmesg shows following about SR-IOV
> > > > > > [ 5.839750] igb 0000:05:00.0: SR-IOV: bus number out of
> > > > > > range [ 6.029886] igb 0000:05:00.1: SR-IOV: bus number out
> > > > > > of range [ 6.221602] igb 0000:06:00.0: SR-IOV: bus number
> > > > > > out of range [ 6.413736] igb 0000:06:00.1: SR-IOV: bus
> > > > > > number out of range
> > > > > >
> > > > >
> > > > > The x16 slots in a lot of mother boards are meant for graphics
> > > > > cards. I've seen some problems with putting network or other
> > > > > types of PCIe cards in them. Can you try moving the NIC to a
> > > > > different slot with a x4 or x8 connector?
> > > > >
> > > > > - Greg
> > > > >
> > > > > > 4. ifconfig shows eth1, eth2, eth3 and eth4 corresponding to 4
> > > > > > physical ports.
> > > > > >
> > > > > > 5. It doesn't show VFs
> > > > > > cadlab:/boot/grub # lspci | grep Eth
> > > > > > 00:19.0 Ethernet controller: Intel Corporation 82567LM-2
> > > > > > Gigabit Network Connection
> > > > > > 05:00.0 Ethernet controller: Intel Corporation 82576 Gigabit
> > > > > > Network Connection (rev 01)
> > > > > > 05:00.1 Ethernet controller: Intel Corporation 82576 Gigabit
> > > > > > Network Connection (rev 01)
> > > > > > 06:00.0 Ethernet controller: Intel Corporation 82576 Gigabit
> > > > > > Network Connection (rev 01)
> > > > > > 06:00.1 Ethernet controller: Intel Corporation 82576 Gigabit
> > > > > > Network Connection (rev 01)
> > > > > >
> > > > > > 6. lspci -vv shows following
> > > > > > 06:00.1 Ethernet controller: Intel Corporation 82576 Gigabit
> > > > > > Network Connection (rev 01)
> > > > > > Subsystem: Intel Corporation Gigabit ET Quad Port
> > > > > > Server Adapter Control: I/O+ Mem+ BusMaster+ SpecCycle-
> > > > > > MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
> > > > > > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast
> > > > > > >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> > > > > > Latency: 0, Cache Line Size: 64 bytes
> > > > > > Interrupt: pin B routed to IRQ 17
> > > > > > Region 0: Memory at e5800000 (32-bit,
> > > > > > non-prefetchable) [size=128K] Region 1: Memory at e5000000
> > > > > > (32-bit, non-prefetchable) [size=4M] Region 2: I/O ports at
> > > > > > 1000 [size=32] Region 3: Memory at e58c0000 (32-bit,
> > > > > > non-prefetchable) [size=16K] Capabilities: [40] Power
> > > > > > Management version 3 Flags: PMEClk- DSI+ D1- D2-
> > > > > > AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
> > > > > > Status: D0 NoSoftRst- PME-Enable- DSel=0
> > > > > > DScale=1 PME- Capabilities: [50] MSI: Enable- Count=1/1
> > > > > > Maskable+ 64bit+ Address: 0000000000000000 Data: 0000
> > > > > > Masking: 00000000 Pending: 00000000
> > > > > > Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
> > > > > > Vector table: BAR=3 offset=00000000
> > > > > > PBA: BAR=3 offset=00002000
> > > > > > Capabilities: [a0] Express (v2) Endpoint, MSI 00
> > > > > > DevCap: MaxPayload 512 bytes, PhantFunc 0,
> > > > > > Latency L0s <512ns, L1 <64us
> > > > > > ExtTag- AttnBtn- AttnInd- PwrInd- RBE+
> > > > > > FLReset+ DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+
> > > > > > Unsupported+
> > > > > > RlxdOrd+ ExtTag- PhantFunc- AuxPwr-
> > > > > > NoSnoop+ FLReset-
> > > > > > MaxPayload 128 bytes, MaxReadReq 512
> > > > > > bytes DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+
> > > > > > AuxPwr- TransPend-
> > > > > > LnkCap: Port #4, Speed 2.5GT/s, Width x4, ASPM
> > > > > > L0s L1, Latency L0 <4us, L1 <64us
> > > > > > ClockPM- Surprise- LLActRep- BwNot-
> > > > > > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled-
> > > > > > Retrain- CommClk+
> > > > > > ExtSynch- ClockPM- AutWidDis- BWInt-
> > > > > > AutBWInt- LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train-
> > > > > > SlotClk+ DLActive- BWMgmt- ABWMgmt-
> > > > > > DevCap2: Completion Timeout: Range ABCD,
> > > > > > TimeoutDis+ DevCtl2: Completion Timeout: 16ms to 55ms,
> > > > > > TimeoutDis- LnkCtl2: Target Link Speed: 2.5GT/s,
> > > > > > EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
> > > > > > Transmit Margin: Normal Operating
> > > > > > Range, EnterModifiedCompliance- ComplianceSOS-
> > > > > > Compliance De-emphasis: -6dB
> > > > > > LnkSta2: Current De-emphasis Level: -6dB
> > > > > > Capabilities: [100 v1] Advanced Error Reporting
> > > > > > UESta: DLP- SDES- TLP- FCP- CmpltTO-
> > > > > > CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> > > > > > UEMsk: DLP- SDES- TLP- FCP- CmpltTO-
> > > > > > CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> > > > > > UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO-
> > > > > > CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
> > > > > > CESta: RxErr- BadTLP- BadDLLP- Rollover-
> > > > > > Timeout- NonFatalErr+
> > > > > > CEMsk: RxErr- BadTLP- BadDLLP- Rollover-
> > > > > > Timeout- NonFatalErr+
> > > > > > AERCap: First Error Pointer: 00, GenCap-
> > > > > > CGenEn- ChkCap- ChkEn-
> > > > > > Capabilities: [140 v1] Device Serial Number
> > > > > > 00-1b-21-ff-ff-8f-bd-24 Capabilities: [150 v1] Alternative
> > > > > > Routing-ID Interpretation (ARI) ARICap: MFVC- ACS-, Next
> > > > > > Function: 0 ARICtl: MFVC- ACS-, Function Group: 0
> > > > > > Capabilities: [160 v1] Single Root I/O Virtualization
> > > > > > (SR-IOV) IOVCap: Migration-, Interrupt Message Number: 000
> > > > > > IOVCtl: Enable- Migration- Interrupt- MSE-
> > > > > > ARIHierarchy- IOVSta: Migration-
> > > > > > Initial VFs: 8, Total VFs: 8, Number of VFs:
> > > > > > 2, Function Dependency Link: 01
> > > > > > VF offset: 384, stride: 2, Device ID: 10ca
> > > > > > Supported Page Size: 00000553, System Page
> > > > > > Size: 00000001 Region 0: Memory at 00000000e5880000 (64-bit,
> > > > > > non-prefetchable)
> > > > > > Region 3: Memory at 00000000e58a0000 (64-bit,
> > > > > > non-prefetchable)
> > > > > > VF Migration: offset: 00000000, BIR: 0
> > > > > > Kernel driver in use: igb
> > > > > >
> > > > > >
> > > > > > Can somebody please help me out.?
> > > > > >
> > > > > >
> > > > > > *
> > > > > > ----------------------------
> > > > > > Thanks & Regards
> > > > > > Mohit Dhingra
> > > > > > +919611190435*
> > > > > >
> > > > >
> > > >
> > >
> >
>
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
