Re: Is ixgbe usable with SR-IOV?
Unfortunately its a feature that was implemented, and worked, but it has not had a lot of use I suspect, and it has been in a limited number of setups. I know nothing about this Amazon provided hosting, is it linux/kvm or xen? I can see if we can get something set up and check it here. Jack On Wed, Dec 4, 2013 at 10:13 PM, Colin Percival cperc...@freebsd.orgwrote: Hi Jack, On 12/04/13 10:21, Jack Vogel wrote: Yes, the ixv code was specifically written to work in a guest with SRIOV, however our internal testing did not use DHCP, what if you assign it an address, will it work then? Hard-coding an IP address doesn't work either. Or rather, I can assign it an address, but it continues to not pass packets. Are there any diagnostic tunables/sysctls I should try turning on? Since this is in EC2 I'm unfortunately limited to printf-style debugging. -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org
Re: Is ixgbe usable with SR-IOV?
On 12/05/13 00:18, Jack Vogel wrote: Unfortunately its a feature that was implemented, and worked, but it has not had a lot of use I suspect, and it has been in a limited number of setups. I know nothing about this Amazon provided hosting, is it linux/kvm or xen? I can see if we can get something set up and check it here. This is Xen, running in this case using HVM: http://aws.amazon.com/ec2/ -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org
Re: Is ixgbe usable with SR-IOV?
OK, very different kettle of fish from anything that's been tested :) Let me talk about it with some people tomorrow and see what we can do. Jack On Thu, Dec 5, 2013 at 12:30 AM, Colin Percival cperc...@freebsd.orgwrote: On 12/05/13 00:18, Jack Vogel wrote: Unfortunately its a feature that was implemented, and worked, but it has not had a lot of use I suspect, and it has been in a limited number of setups. I know nothing about this Amazon provided hosting, is it linux/kvm or xen? I can see if we can get something set up and check it here. This is Xen, running in this case using HVM: http://aws.amazon.com/ec2/ -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org
Re: Is ixgbe usable with SR-IOV?
Hi Jack, On 12/04/13 10:21, Jack Vogel wrote: Yes, the ixv code was specifically written to work in a guest with SRIOV, however our internal testing did not use DHCP, what if you assign it an address, will it work then? Hard-coding an IP address doesn't work either. Or rather, I can assign it an address, but it continues to not pass packets. Are there any diagnostic tunables/sysctls I should try turning on? Since this is in EC2 I'm unfortunately limited to printf-style debugging. -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid ___ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org
Is ixgbe usable with SR-IOV?
Hi Xen people jfv,
Amazon's new C3 instance type has support for SR-IOV using ixgbe hardware;
our driver looks like it should support this, but when I turn it on it doesn't
seem to work. Boot dmesg: http://pastebin.com/1Kkpfzbi
The virtual hardware is recognized:
ix0: Intel(R) PRO/10GbE Virtual Function Network Driver, Version - 1.1.4
mem 0xf300-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0
ix0: Using MSIX interrupts with 2 vectors
ix0: Ethernet address: 02:91:23:76:38:77
And we seem to be able to send packets, but never see any responses:
ix0: link state changed to UP
Starting Network: lo0 ix0.
lo0: flags=8049UP,LOOPBACK,RUNNING,MULTICAST metric 0 mtu 16384
options=63RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
inet 127.0.0.1 netmask 0xff00
nd6 options=21PERFORMNUD,AUTO_LINKLOCAL
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST metric 0 mtu 1500
options=401bbRXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO
ether 02:91:23:76:38:77
nd6 options=29PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL
media: Ethernet autoselect
status: active
Starting devd.
Starting dhclient.
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 8
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 9
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10
DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10
No DHCPOFFERS received.
Under exactly the same Xen configuration except with SR-IOV turned off and
EC2 presenting a Xen netback to us instead, the DHCP works just fine.
Has anyone managed to use {FreeBSD, SR-IOV, ixgbe, Xen}? Was any magic
necessary in order to make it work?
--
Colin Percival
Security Officer Emeritus, FreeBSD | The power to serve
Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org
