just sharing for info.
If I do :
modprobe ixgbe max_vfs=0,0,2,2
It will NOT create virtual functions for first two ports and it creates
Virtual functions for next ports.
Also, when it creates two vfs for next two ports , it creates as Greg said.
<<The VF stride is 2 for dual port 82599 so that means 25:10.0 and 25:10.2
are for the first port and
<<25:10.1 and 25:10.3 are for the second port.
Thanks !
On Fri, Jan 3, 2014 at 11:40 AM, Raj Ravi <[email protected]> wrote:
> Thanks.
> You are right. I think this is what you are talking about.
>
> for i in `seq 0 3`; do virsh nodedev-dumpxml pci_0000_25_10_$i;done |
> grep address;
> pci_0000_25_10_0
> <address domain='0x0000' bus='0x25' slot='0x00' function='0x0'/>
> pci_0000_25_10_1
> <address domain='0x0000' bus='0x25' slot='0x00' function='0x1'/>
> pci_0000_25_10_2
> <address domain='0x0000' bus='0x25' slot='0x00' function='0x0'/>
> pci_0000_25_10_3
> <address domain='0x0000' bus='0x25' slot='0x00' function='0x1'/>
>
>
>
>
>
> On Thu, Jan 2, 2014 at 10:37 PM, Greg Rose <[email protected]>wrote:
>
>> On Thu, 2 Jan 2014 22:22:27 +0530
>> Raj Ravi <[email protected]> wrote:
>>
>> > Hi,
>> > Thanks.
>> >
>> > I just tried this :
>> > modprobe ixgbe max_vfs=2,2
>> > But it creates 4 devices "ONLY " for the first port.
>> >
>> > # virsh nodedev-list | grep 25
>> > pci_0000_25_00_0
>> > pci_0000_25_00_1
>> > *pci_0000_25_10_0*
>> > *pci_0000_25_10_1*
>> > *pci_0000_25_10_2*
>> > *pci_0000_25_10_3*
>>
>> No, those are for the two ports. The VF stride is 2 for dual port
>> 82599 so that means 25:10.0 and 25:10.2 are for the first port and
>> 25:10.1 and 25:10.3 are for the second port.
>>
>> - Greg
>>
>> > #
>> >
>> > dmesg output while carrying out this :
>> >
>> > modprobe ixgbe max_vfs=2,2
>> >
>> > pps_core: LinuxPPS API ver. 1 registered
>> > pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <
>> > [email protected]>
>> > PTP clock support registered
>> > Intel(R) 10 Gigabit PCI Express Network Driver - version 3.18.7
>> > Copyright (c) 1999-2013 Intel Corporation.
>> > ixgbe 0000:25:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
>> > ixgbe: I/O Virtualization (IOV) set to 2
>> > ixgbe: 0000:25:00.0: ixgbe_check_options: FCoE Offload feature enabled
>> > ixgbe 0000:25:00.0: (unregistered net_device): SR-IOV enabled with 2
>> > VFs ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network
>> > Driver - version 2.11.3
>> > Copyright (c) 2009-2012 Intel Corporation.
>> > ixgbe 0000:25:00.0: (PCI Express:5.0GT/s:Width x8) 90:e2:ba:39:44:ac
>> > ixgbe 0000:25:00.0: eth0: MAC: 2, PHY: 12, SFP+: 5, PBA No: E66560-000
>> > ixgbe 0000:25:00.0: PCI Express bandwidth of 32GT/s available
>> > ixgbe 0000:25:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
>> > ixgbe 0000:25:00.0: eth0: Enabled Features: RxQ: 1 TxQ: 1 DCA
>> > ixgbe 0000:25:00.0: eth0: Intel(R) 10 Gigabit Network Connection
>> > ixgbevf 0000:25:10.0: enabling device (0000 -> 0002)
>> > ixgbevf 0000:25:10.0: PF still in reset state. Is the PF interface
>> > up? ixgbevf 0000:25:10.0: Assigning random MAC address
>> > ixgbevf: eth%d: ixgbevf_init_interrupt_scheme: Multiqueue Disabled: Rx
>> > Queue count = 1, Tx Queue count = 1
>> > ADDRCONF(NETDEV_UP): eth0: link is not ready
>> > 8021q: adding VLAN 0 to HW filter on device eth0
>> > ixgbevf: eth1: ixgbevf_probe: Intel(R) 82599 Virtual Function
>> > 4e:6b:80:df:b7:59
>> > ixgbevf: eth1: ixgbevf_probe: LRO is disabled
>> > ixgbevf: eth1: ixgbevf_probe: GRO is enabled
>> > ixgbevf: eth1: ixgbevf_probe: Intel(R) 10 Gigabit PCI Express Virtual
>> > Function Network Driver
>> > ixgbe 0000:25:00.1: PCI INT B -> GSI 36 (level, low) -> IRQ 36
>> > ixgbe: I/O Virtualization (IOV) set to 2
>> > ixgbe: 0000:25:00.1: ixgbe_check_options: FCoE Offload feature enabled
>> > ixgbe 0000:25:00.0: eth0: detected SFP+: 5
>> > ixgbe 0000:25:00.1: (unregistered net_device): SR-IOV enabled with 2
>> > VFs ixgbe 0000:25:00.1: (PCI Express:5.0GT/s:Width x8)
>> > 90:e2:ba:39:44:ad ixgbe 0000:25:00.1: eth2: MAC: 2, PHY: 12, SFP+: 6,
>> > PBA No: E66560-000 udev: renamed network interface eth2 to rename49
>> > ixgbe 0000:25:00.1: PCI Express bandwidth of 32GT/s available
>> > ixgbe 0000:25:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
>> > ixgbe 0000:25:00.1: rename49: Enabled Features: RxQ: 1 TxQ: 1 DCA
>> > ixgbe 0000:25:00.1: rename49: Intel(R) 10 Gigabit Network Connection
>> > ixgbe 0000:2d:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
>> > ixgbevf 0000:25:10.2: enabling device (0000 -> 0002)
>> > ixgbe: 0000:2d:00.0: ixgbe_check_options: FCoE Offload feature enabled
>> > ixgbe 0000:25:00.0: eth0: VF Reset msg received from vf 1
>> > ixgbe 0000:25:00.0: VF 1 has no MAC address assigned, you may have to
>> > assign one manually
>> > ixgbevf 0000:25:10.2: MAC address not assigned by administrator.
>> > ixgbevf 0000:25:10.2: Assigning random MAC address
>> > ixgbevf: eth%d: ixgbevf_init_interrupt_scheme: Multiqueue Enabled: Rx
>> > Queue count = 2, Tx Queue count = 2
>> > ixgbevf: eth2: ixgbevf_probe: Intel(R) 82599 Virtual Function
>> > c6:93:84:41:65:f1
>> > ixgbevf: eth2: ixgbevf_probe: LRO is disabled
>> > ixgbevf: eth2: ixgbevf_probe: GRO is enabled
>> > ixgbevf: eth2: ixgbevf_probe: Intel(R) 10 Gigabit PCI Express Virtual
>> > Function Network Driver
>> > ixgbevf 0000:25:10.1: enabling device (0000 -> 0002)
>> > ixgbevf 0000:25:10.1: PF still in reset state. Is the PF interface
>> > up? ixgbevf 0000:25:10.1: Assigning random MAC address
>> > ixgbevf: eth%d: ixgbevf_init_interrupt_scheme: Multiqueue Disabled: Rx
>> > Queue count = 1, Tx Queue count = 1
>> > ixgbe 0000:2d:00.0: (PCI Express:5.0GT/s:Width x8) 90:e2:ba:3e:7a:cc
>> > ixgbevf: eth8: ixgbevf_probe: Intel(R) 82599 Virtual Function
>> > 7e:ef:bb:24:eb:c1
>> > ixgbevf: eth8: ixgbevf_probe: LRO is disabled
>> > ixgbevf: eth8: ixgbevf_probe: GRO is enabled
>> > ixgbevf: eth8: ixgbevf_probe: Intel(R) 10 Gigabit PCI Express Virtual
>> > Function Network Driver
>> > ixgbevf 0000:25:10.3: enabling device (0000 -> 0002)
>> > udev: renamed network interface eth3 to rename51
>> > ixgbe 0000:2d:00.0: rename51: MAC: 2, PHY: 12, SFP+: 5, PBA No:
>> > E66560-000 ixgbe 0000:2d:00.0: PCI Express bandwidth of 32GT/s
>> > available ixgbevf 0000:25:10.3: PF still in reset state. Is the PF
>> > interface up? ixgbevf 0000:25:10.3: Assigning random MAC address
>> > ixgbevf: eth%d: ixgbevf_init_interrupt_scheme: Multiqueue Disabled: Rx
>> > Queue count = 1, Tx Queue count = 1
>> > ixgbevf: eth3: ixgbevf_probe: Intel(R) 82599 Virtual Function
>> > 36:b8:12:2e:b4:82
>> > ixgbevf: eth3: ixgbevf_probe: LRO is disabled
>> > ixgbevf: eth3: ixgbevf_probe: GRO is enabled
>> > ixgbevf: eth3: ixgbevf_probe: Intel(R) 10 Gigabit PCI Express Virtual
>> > Function Network Driver
>> > udev: renamed network interface eth1 to rename48
>> > udev: renamed network interface eth2 to eth9
>> > udev: renamed network interface eth8 to eth10
>> > udev: renamed network interface eth3 to eth13
>> > udev: renamed network interface rename49 to eth1
>> > udev: renamed network interface rename51 to eth2
>> > udev: renamed network interface rename48 to eth8
>> > ixgbe 0000:2d:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
>> > ixgbe 0000:2d:00.0: eth2: Enabled Features: RxQ: 32 TxQ: 32 FdirHash
>> > DCA ADDRCONF(NETDEV_UP): eth2: link is not ready
>> > 8021q: adding VLAN 0 to HW filter on device eth2
>> > ixgbe 0000:2d:00.0: eth2: Intel(R) 10 Gigabit Network Connection
>> > ixgbe 0000:2d:00.1: PCI INT B -> GSI 44 (level, low) -> IRQ 44
>> > ixgbe: 0000:2d:00.1: ixgbe_check_options: FCoE Offload feature enabled
>> > ixgbe 0000:2d:00.0: eth2: detected SFP+: 5
>> > ADDRCONF(NETDEV_UP): eth1: link is not ready
>> > 8021q: adding VLAN 0 to HW filter on device eth1
>> > ixgbe 0000:25:00.1: eth1: detected SFP+: 6
>> > ixgbe 0000:2d:00.1: (PCI Express:5.0GT/s:Width x8) 90:e2:ba:3e:7a:cd
>> > ixgbe 0000:2d:00.1: eth3: MAC: 2, PHY: 12, SFP+: 6, PBA No: E66560-000
>> > ixgbe 0000:2d:00.1: PCI Express bandwidth of 32GT/s available
>> > ixgbe 0000:2d:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
>> > ixgbe 0000:2d:00.1: eth3: Enabled Features: RxQ: 32 TxQ: 32 FdirHash
>> > DCA ixgbe 0000:2d:00.1: eth3: Intel(R) 10 Gigabit Network Connection
>> > [root@sv2-13 rules.d]# ixgbe 0000:2d:00.0: eth2: NIC Link is Up 10
>> > Gbps, Flow Control: RX/TX
>> > ADDRCONF(NETDEV_UP): eth3: link is not ready
>> > 8021q: adding VLAN 0 to HW filter on device eth3
>> > ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
>> > ixgbe 0000:2d:00.1: eth3: detected SFP+: 6
>> > ixgbe 0000:2d:00.1: eth3: NIC Link is Up 10 Gbps, Flow Control: RX/TX
>> > ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
>> >
>> ------------------------------------------------------------------------------------------------------------------
>> > There are actually four ixgbe ports present :
>> > [root@sv2-13 rules.d]# ethtool -i eth0
>> > driver: ixgbe
>> > version: 3.18.7
>> > firmware-version: 0x5e0b0001
>> > bus-info: 0000:25:00.0 <==
>> >
>> > [root@sv2-13 rules.d]# ethtool -i eth1
>> > driver: ixgbe
>> > version: 3.18.7
>> > firmware-version: 0x5e0b0001
>> > bus-info: 0000:25:00.1
>> >
>> > [root@sv2-13 rules.d]# ethtool -i eth2
>> > driver: ixgbe
>> > version: 3.18.7
>> > firmware-version: 0x5e0b0001
>> > bus-info: 0000:2d:00.0
>> >
>> > [root@sv2-13 rules.d]# ethtool -i eth3
>> > driver: ixgbe
>> > version: 3.18.7
>> > firmware-version: 0x5e0b0001
>> > bus-info: 0000:2d:00.1
>> >
>> ------------------------------------------------------------------------------------------------------------------
>> >
>> > All the Virtual functions are created for eth0 alone/
>> > Please refer bus-info for eth0.
>> > Please let me know how to avoid this and get VFs created for all
>> > interfaces.
>> >
>> >
>> > --
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Thu, Jan 2, 2014 at 10:11 PM, Greg Rose <[email protected]>
>> > wrote:
>> >
>> > > On Thu, 2 Jan 2014 22:01:50 +0530
>> > > Raj Ravi <[email protected]> wrote:
>> > >
>> > > > Hi,
>> > > > I am trying to update to these drivers(ixgbe-3.18.7.tar.gz
>> > > > , ixgbevf-2.11.3.tar.gz) from existing versions of drivers.
>> > > >
>> > > > With my existing drivers, I can see multiple virtual function for
>> > > > each physical port properly created.
>> > > >
>> > > > for eg: modprobe ixgbe max_vfs=2
>> > > > This creates two virtual functions for each Physical port.
>> > > > eth0, eth2, eth3 every physical contains two virtual functions. I
>> > > > can verify this with lspci, ethtool -i bus info.
>> > > >
>> > > > I have replaced existing drivers with ixgbe-3.18.7.tar.gz
>> > > > , ixgbevf-2.11.3.tar.gz, (by updating them in /lib/modules/.. )
>> > > > then tried , modprobe ixgbe max_vfs=2
>> > > >
>> > > > This creates two virtual function only for "FIRST PORT".
>> > > > In my case eth0 only contains two virtual function. eth2, eth3
>> > > > are not showing any Virtual function .
>> > > > Any idea about this ? Is there any issue with these drivers ?? I
>> > > > need to load them in any other way ??
>> > >
>> > > The out of tree drivers use positional paramater placement. If you
>> > > have four ports then the command using the OOT drivers would be like
>> > > this:
>> > >
>> > > modprobe ixgbe max_vfs=2,2,2,2
>> > >
>> > > It's an additional feature of the OOT driver that you're able to
>> > > create different numbers of VFs, or none at all, per port.
>> > >
>> > > - Greg
>> > >
>> >
>>
>
>
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
