Re: [Qemu-devel] Hitting 29 NIC limit (+Intel VT-c)

2010-10-28 Thread linux_kvm
On Thu, 14 Oct 2010 14:07 +0200, Avi Kivity a...@redhat.com wrote: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: What's the motivation for such a huge number of interfaces? Ultimately to bring multiple 10Gb bonds into a Vyatta guest. ---

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-18 Thread H. Peter Anvin
On 10/14/2010 05:57 AM, Anthony Liguori wrote: I've always been sceptical of this. When physical systems have a large number of NICs, it's via multiple functions, not a bunch of PCI bridges. Actually a lot of multiport PCI cards are in fact single or dual NICs behind PCI bridges.

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-15 Thread Markus Armbruster
Anthony Liguori anth...@codemonkey.ws writes: On 10/14/2010 07:36 AM, Markus Armbruster wrote: Avi Kivitya...@redhat.com writes: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Avi Kivity
On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no more than 29 are detected (that's because of the 32 PCI slot limit on a single bus- 3 are already taken

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Daniel P. Berrange
On Thu, Oct 14, 2010 at 02:07:17PM +0200, Avi Kivity wrote: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no more than 29 are detected (that's

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Markus Armbruster
Avi Kivity a...@redhat.com writes: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no more than 29 are detected (that's because of the 32 PCI slot limit

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 07:07 AM, Avi Kivity wrote: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no more than 29 are detected (that's because of the 32 PCI slot

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 07:10 AM, Daniel P. Berrange wrote: On Thu, Oct 14, 2010 at 02:07:17PM +0200, Avi Kivity wrote: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 07:36 AM, Markus Armbruster wrote: Avi Kivitya...@redhat.com writes: On 10/14/2010 12:54 AM, Anthony Liguori wrote: On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Avi Kivity
On 10/14/2010 02:54 PM, Anthony Liguori wrote: The key is to make the virtio-net devices multifunction and to fill out all 8 functions for each slot. This is unlikely to work right wrt pci hotplug. Yes. Our hotplug design is based on devices.. This is wrong, it should be based on

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 08:23 AM, Avi Kivity wrote: On 10/14/2010 02:54 PM, Anthony Liguori wrote: The key is to make the virtio-net devices multifunction and to fill out all 8 functions for each slot. This is unlikely to work right wrt pci hotplug. Yes. Our hotplug design is based on devices..

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Avi Kivity
On 10/14/2010 04:11 PM, Anthony Liguori wrote: On 10/14/2010 08:23 AM, Avi Kivity wrote: On 10/14/2010 02:54 PM, Anthony Liguori wrote: The key is to make the virtio-net devices multifunction and to fill out all 8 functions for each slot. This is unlikely to work right wrt pci hotplug.

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Richard W.M. Jones
On Thu, Oct 14, 2010 at 01:10:47PM +0100, Daniel P. Berrange wrote: Or a PCI bridge to wire up more PCI buses, so we raise the max limit for any type of device we emulate. Break the 29/30/31 virtio-blk limit ... please! Rich. -- Richard Jones, Virtualization Group, Red Hat

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anjali Kulkarni
Can you send me pointers to the qdev documentation? How can I use it? Will it allow us to scale above the 32 PCI limit? Anjali On 10/14/10 2:57 PM, Anthony Liguori anth...@codemonkey.ws wrote: On 10/14/2010 04:42 PM, Richard W.M. Jones wrote: On Thu, Oct 14, 2010 at 01:10:47PM +0100, Daniel

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Richard W.M. Jones
On Thu, Oct 14, 2010 at 04:57:36PM -0500, Anthony Liguori wrote: On 10/14/2010 04:42 PM, Richard W.M. Jones wrote: On Thu, Oct 14, 2010 at 01:10:47PM +0100, Daniel P. Berrange wrote: Or a PCI bridge to wire up more PCI buses, so we raise the max limit for any type of device we emulate. Break

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 05:00 PM, Anjali Kulkarni wrote: Can you send me pointers to the qdev documentation? How can I use it? Will it allow us to scale above the 32 PCI limit? It's all below. You just have to create a PCI device and mark the multifunction flag to on and then assign it a PCI

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anjali Kulkarni
Thanks. Does this work for e1000 as well? Also, does it support pci hotplug? Anjali On 10/14/10 3:09 PM, Anthony Liguori anth...@codemonkey.ws wrote: On 10/14/2010 05:00 PM, Anjali Kulkarni wrote: Can you send me pointers to the qdev documentation? How can I use it? Will it allow us to scale

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-14 Thread Anthony Liguori
On 10/14/2010 05:12 PM, Anjali Kulkarni wrote: Thanks. Does this work for e1000 as well? Haven't tried. I don't know how various e1000 drivers would react. Also, does it support pci hotplug? No, but that's fixable down the road. Regards, Anthony Liguori Anjali On 10/14/10

Re: [Qemu-devel] Hitting 29 NIC limit

2010-10-13 Thread Anthony Liguori
On 10/13/2010 05:32 PM, Anjali Kulkarni wrote: Hi, Using the legacy way of starting up NICs, I am hitting a limitation after 29 NICs ie no more than 29 are detected (that's because of the 32 PCI slot limit on a single bus- 3 are already taken up) I had initially increased the MAX_NICS to 48,