RE: [PATCH v16 14/17]Add a kconfig entry and make entry for mp device.

2010-12-01 Thread Xin, Xiaohui
-Original Message- From: Randy Dunlap [mailto:randy.dun...@oracle.com] Sent: Thursday, December 02, 2010 1:54 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb

RE: [PATCH v15 00/17] Provide a zero-copy method on KVM virtio-net.

2010-11-17 Thread Xin, Xiaohui
-Original Message- From: kvm-ow...@vger.kernel.org [mailto:kvm-ow...@vger.kernel.org] On Behalf Of Xin, Xiaohui Sent: Thursday, November 11, 2010 4:28 PM To: David Miller Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; herb

RE: [PATCH v15 00/17] Provide a zero-copy method on KVM virtio-net.

2010-11-11 Thread Xin, Xiaohui
-Original Message- From: David Miller [mailto:da...@davemloft.net] Sent: Thursday, November 11, 2010 1:47 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; herb...@gondor.apana.org.au; jd...@linux.intel.com

RE: Re:[PATCH v14 06/17] Use callback to deal with skb_release_data() specially.

2010-11-08 Thread Xin, Xiaohui
-Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Monday, November 08, 2010 4:25 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb...@gondor.apana.org.au

RE: [PATCH v13 10/16] Add a hook to intercept external buffers from NIC driver.

2010-11-07 Thread Xin, Xiaohui
I have addressed this issue in v14 patch set. Thanks Xiaohui -Original Message- From: David Miller [mailto:da...@davemloft.net] Sent: Saturday, October 30, 2010 4:29 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi

RE: [PATCH v13 10/16] Add a hook to intercept external buffers from NIC driver.

2010-10-26 Thread Xin, Xiaohui
-Original Message- From: David Miller [mailto:da...@davemloft.net] Sent: Tuesday, October 19, 2010 11:24 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; herb...@gondor.apana.org.au; jd...@linux.intel.com

RE: [PATCH v12 12/17] Add mp(mediate passthru) device.

2010-10-18 Thread Xin, Xiaohui
-Original Message- From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Sunday, October 03, 2010 9:13 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd

RE: [PATCH v12 06/17] Use callback to deal with skb_release_data() specially.

2010-10-11 Thread Xin, Xiaohui
-Original Message- From: David Miller [mailto:da...@davemloft.net] Sent: Friday, October 01, 2010 3:15 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; herb...@gondor.apana.org.au; jd...@linux.intel.com

RE: [PATCH v12 10/17] Add a hook to intercept external buffers from NIC driver.

2010-10-11 Thread Xin, Xiaohui
-Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Thursday, September 30, 2010 10:22 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb

RE: [PATCH v12 06/17] Use callback to deal with skb_release_data() specially.

2010-10-11 Thread Xin, Xiaohui
-Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Monday, October 11, 2010 11:42 PM To: David Miller Cc: Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; herb...@gondor.apana.org.au; jd

RE: [PATCH v12 00/17] Provide a zero-copy method on KVM virtio-net.

2010-09-30 Thread Xin, Xiaohui
Will be on leave during 10/01 ~ 10/07, and slow or no response to the comments. Thanks Xiaohui -Original Message- From: netdev-ow...@vger.kernel.org [mailto:netdev-ow...@vger.kernel.org] On Behalf Of xiaohui@intel.com Sent: Thursday, September 30, 2010 10:04 PM To:

RE: [PATCH v11 13/17] Add mp(mediate passthru) device.

2010-09-29 Thread Xin, Xiaohui
-Original Message- From: Ben Hutchings [mailto:bhutchi...@solarflare.com] Sent: Tuesday, September 28, 2010 5:24 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd

RE: [PATCH v11 12/17] Add a kconfig entry and make entry for mp device.

2010-09-29 Thread Xin, Xiaohui
Thanks, I will move this in order next version. Thanks Xiaohui -Original Message- From: Ben Hutchings [mailto:bhutchi...@solarflare.com] Sent: Monday, September 27, 2010 9:57 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu

RE: [PATCH v11 03/17] Add a ndo_mp_port_prep pointer to net_device_ops.

2010-09-29 Thread Xin, Xiaohui
Ok, I will comment it above the structure. Thanks Xiaohui -Original Message- From: Ben Hutchings [mailto:bhutchi...@solarflare.com] Sent: Monday, September 27, 2010 9:43 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da

RE: [PATCH v11 00/17] Provide a zero-copy method on KVM virtio-net.

2010-09-27 Thread Xin, Xiaohui
-Original Message- From: linux-kernel-ow...@vger.kernel.org [mailto:linux-kernel-ow...@vger.kernel.org] On Behalf Of Xin, Xiaohui Sent: Monday, September 27, 2010 8:45 AM To: Michael S. Tsirkin Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-26 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Sunday, September 26, 2010 7:50 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd...@linux.intel.com Subject: Re: [RFC PATCH

RE: [PATCH v11 00/17] Provide a zero-copy method on KVM virtio-net.

2010-09-26 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Monday, September 27, 2010 1:02 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd...@linux.intel.com Subject: Re: [PATCH v11

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-23 Thread Xin, Xiaohui
-Original Message- From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Wednesday, September 22, 2010 7:55 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-22 Thread Xin, Xiaohui
-Original Message- From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Tuesday, September 21, 2010 9:14 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-20 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Monday, September 20, 2010 7:37 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd...@linux.intel.com Subject: Re: [RFC PATCH

RE: [RFC PATCH 2/2] macvtap: TX zero copy between guest and host kernel

2010-09-16 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Wednesday, September 15, 2010 5:59 PM To: Xin, Xiaohui Cc: Shirley Ma; Arnd Bergmann; Avi Kivity; David Miller; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org Subject: Re: [RFC PATCH 2/2] macvtap: TX zero copy

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-16 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Wednesday, September 15, 2010 7:28 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd...@linux.intel.com Subject: Re: [RFC

RE: [RFC PATCH 2/2] macvtap: TX zero copy between guest and host kernel

2010-09-14 Thread Xin, Xiaohui
From: Shirley Ma [mailto:mashi...@us.ibm.com] Sent: Tuesday, September 14, 2010 11:05 PM To: Avi Kivity Cc: David Miller; a...@arndb.de; m...@redhat.com; Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org Subject: Re: [RFC PATCH 2/2] macvtap: TX zero copy

RE: [RFC PATCH 2/2] macvtap: TX zero copy between guest and host kernel

2010-09-14 Thread Xin, Xiaohui
From: Arnd Bergmann [mailto:a...@arndb.de] Sent: Tuesday, September 14, 2010 11:21 PM To: Shirley Ma Cc: Avi Kivity; David Miller; m...@redhat.com; Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org Subject: Re: [RFC PATCH 2/2] macvtap: TX zero copy between

RE: [RFC PATCH 2/2] macvtap: TX zero copy between guest and host kernel

2010-09-14 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Wednesday, September 15, 2010 12:30 AM To: Shirley Ma Cc: Arnd Bergmann; Avi Kivity; Xin, Xiaohui; David Miller; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org Subject: Re: [RFC PATCH 2/2] macvtap: TX zero copy

RE: [RFC PATCH 2/2] macvtap: TX zero copy between guest and host kernel

2010-09-14 Thread Xin, Xiaohui
From: Shirley Ma [mailto:mashi...@us.ibm.com] Sent: Wednesday, September 15, 2010 10:41 AM To: Xin, Xiaohui Cc: Avi Kivity; David Miller; a...@arndb.de; m...@redhat.com; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org Subject: RE: [RFC PATCH 2/2] macvtap: TX zero copy

RE: [RFC PATCH v10 00/16] Provide a zero-copy method on KVM virtio-net.

2010-09-14 Thread Xin, Xiaohui
Herbert, Any comments on the modifications of the net core and driver side of this patch? Thanks Xiaohui -Original Message- From: linux-kernel-ow...@vger.kernel.org [mailto:linux-kernel-ow...@vger.kernel.org] On Behalf Of xiaohui@intel.com Sent: Saturday, September 11, 2010 5:53 PM

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-14 Thread Xin, Xiaohui
From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Sunday, September 12, 2010 9:37 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; da...@davemloft.net; herb...@gondor.hengli.com.au; jd...@linux.intel.com Subject: Re: [RFC PATCH

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-11 Thread Xin, Xiaohui
Playing with rlimit on data path, transparently to the application in this way looks strange to me, I suspect this has unexpected security implications. Further, applications may have other uses for locked memory besides mpassthru - you should not just take it because it's there. Can we have an

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-11 Thread Xin, Xiaohui
+ + if (ctor-lock_pages + count lock_limit npages) { + printk(KERN_INFO exceed the locked memory rlimit.); + return NULL; + } + + info = kmem_cache_zalloc(ext_page_info_cache, GFP_KERNEL); You seem to fill in all memory, why zalloc? this is data path ... Ok,

RE: [RFC PATCH v9 12/16] Add mp(mediate passthru) device.

2010-09-10 Thread Xin, Xiaohui
Michael, Sorry to reply the mail late. So - does this driver help reduce service demand signifiantly? I'm looking at the performance now. Some comments from looking at the code: On Fri, Aug 06, 2010 at 05:23:41PM +0800, xiaohui@intel.com wrote: +static struct page_info

RE: [RFC PATCH v8 00/16] Provide a zero-copy method on KVM virtio-net.

2010-08-05 Thread Xin, Xiaohui
Herbert, The v8 patches are modified mostly based on your comments about napi_gro_frags interface. How do you think about the patches about net core system part? We know currently there are some comments about the mp device, such as to support zero-copy for tun/tap and macvtap. Since there isn't

RE: [RFC PATCH v8 00/16] Provide a zero-copy method on KVM virtio-net.

2010-08-03 Thread Xin, Xiaohui
-Original Message- From: Shirley Ma [mailto:mashi...@us.ibm.com] Sent: Friday, July 30, 2010 6:31 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb...@gondor.apana.org.au; jd

RE: [RFC PATCH v8 00/16] Provide a zero-copy method on KVM virtio-net.

2010-07-30 Thread Xin, Xiaohui
Hello Xiaohui, On Thu, 2010-07-29 at 19:14 +0800, xiaohui@intel.com wrote: The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-28 Thread Xin, Xiaohui
-Original Message- From: Herbert Xu [mailto:herb...@gondor.apana.org.au] Sent: Sunday, June 27, 2010 2:15 PM To: Dong, Eddie Cc: Xin, Xiaohui; Stephen Hemminger; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-24 Thread Xin, Xiaohui
] Sent: Thursday, June 24, 2010 6:09 PM To: Dong, Eddie Cc: Xin, Xiaohui; Stephen Hemminger; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; jd...@linux.intel.com Subject: Re: [RFC PATCH v7 01/19] Add a new structure

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-18 Thread Xin, Xiaohui
-Original Message- From: Herbert Xu [mailto:herb...@gondor.apana.org.au] Sent: Friday, June 18, 2010 1:59 PM To: Xin, Xiaohui Cc: Stephen Hemminger; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; jd

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-13 Thread Xin, Xiaohui
-Original Message- From: netdev-ow...@vger.kernel.org [mailto:netdev-ow...@vger.kernel.org] On Behalf Of Xin, Xiaohui Sent: Saturday, June 12, 2010 5:31 PM To: Herbert Xu Cc: Stephen Hemminger; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-12 Thread Xin, Xiaohui
-Original Message- From: Herbert Xu [mailto:herb...@gondor.apana.org.au] Sent: Friday, June 11, 2010 1:21 PM To: Xin, Xiaohui Cc: Stephen Hemminger; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; jd

RE: [RFC PATCH v7 11/19] Use callback to deal with skb_release_data() specially.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Saturday, June 05, 2010 10:56 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb...@gondor.apana.org.au; jd

RE: [RFC PATCH v7 08/19] Make __alloc_skb() to get external buffer.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Saturday, June 05, 2010 10:53 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb...@gondor.apana.org.au; jd

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: Stephen Hemminger [mailto:shemmin...@vyatta.com] Sent: Monday, June 07, 2010 7:14 AM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; herb...@gondor.apana.org.au

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: kvm-ow...@vger.kernel.org [mailto:kvm-ow...@vger.kernel.org] On Behalf Of Andi Kleen Sent: Monday, June 07, 2010 3:51 PM To: Stephen Hemminger Cc: Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: Mitchell Erblich [mailto:erbli...@earthlink.net] Sent: Monday, June 07, 2010 4:17 PM To: Andi Kleen Cc: Stephen Hemminger; Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net

RE: [RFC PATCH v7 01/19] Add a new structure for skb buffer from external.

2010-06-09 Thread Xin, Xiaohui
-Original Message- From: Herbert Xu [mailto:herb...@gondor.apana.org.au] Sent: Tuesday, June 08, 2010 1:28 PM To: Stephen Hemminger Cc: Xin, Xiaohui; net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; m...@redhat.com; mi...@elte.hu; da...@davemloft.net; jd

RE: issue about virtio-net driver to suppoprt vhost mergeable buffer with zero-copy to support PS mode

2010-05-27 Thread Xin, Xiaohui
-Original Message- From: kvm-ow...@vger.kernel.org [mailto:kvm-ow...@vger.kernel.org] On Behalf Of Michael S. Tsirkin Sent: Thursday, May 27, 2010 4:20 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; Herbert Xu Subject: Re: issue about

issue about virtio-net driver to suppoprt vhost mergeable buffer with zero-copy to support PS mode

2010-05-26 Thread Xin, Xiaohui
Michael, I'm now looking into the vhost mergeable buffer, and I tried to use it to support PS mode with zero-copy. And I found an issue there that I have to modify the guest virito-net driver. When guest virtio-net driver submits mergeable buffers, it submits multiple pages outside. In

RE: [RFC][PATCH v4 00/18] Provide a zero-copy method on KVM virtio-net.

2010-05-08 Thread Xin, Xiaohui
Michael, Sorry, somehow I missed this mail. :-( Here, we have ever considered 2 ways to utilize the page constructor API to dispense the user buffers. One: Modify __alloc_skb() function a bit, it can only allocate a structure of sk_buff, and the data pointer is pointing to a

RE: [RFC][PATCH v4 00/18] Provide a zero-copy method on KVM virtio-net.

2010-04-28 Thread Xin, Xiaohui
The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. Isn't it much easier to map the RX ring of the network device into the guest's address space, have DMA map calls translate guest addresses to physical/DMA addresses

RE: [RFC][PATCH v4 05/18] Add a function to indicate if device use external buffer.

2010-04-28 Thread Xin, Xiaohui
+static int dev_is_mpassthru(struct net_device *dev) bool return value should be better here. -- Regards, Changli Gao(xiao...@gmail.com) Thanks, would fix that. Thanks Xiaohui -- To unsubscribe from this list: send the line unsubscribe kvm in the body of a message to

RE: Re:[RFC][PATCH v3 1/3] A device for zero-copy based on KVM virtio-net.

2010-04-22 Thread Xin, Xiaohui
Michael, Sorry, it's based on the suggestion to hook an iocb completion callback to handle the iocb list in vhost-net. Thanks Xiaohui -Original Message- From: Xin, Xiaohui Sent: Thursday, April 22, 2010 4:24 PM To: m...@redhat.com Cc: a...@arndb.de; net...@vger.kernel.org; kvm

RE: [RFC][PATCH v2 0/3] Provide a zero-copy method on KVM virtio-net.

2010-04-22 Thread Xin, Xiaohui
Michael, Yes, I think this packet split mode probably maps well to mergeable buffer support. Note that 1. Not all devices support large packets in this way, others might map to indirect buffers better Do the indirect buffers accord to deal with the skb-frag_list? So we have to figure out

RE: [RFC][PATCH v2 0/3] Provide a zero-copy method on KVM virtio-net.

2010-04-19 Thread Xin, Xiaohui
Michael, The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops as sendmsg/recvmsg to vhost-net to send/recv directly to/from

RE: [RFC][PATCH v2 0/3] Provide a zero-copy method on KVM virtio-net.

2010-04-19 Thread Xin, Xiaohui
Michael, What we have not done yet: packet split support What does this mean, exactly? We can support 1500MTU, but for jumbo frame, since vhost driver before don't support mergeable buffer, we cannot try it for multiple sg. I do not see why, vhost currently supports 64K buffers with

RE: [RFC][PATCH v3 1/3] A device for zero-copy based on KVM virtio-net.

2010-04-15 Thread Xin, Xiaohui
Arnd, From: Xin Xiaohui xiaohui@intel.com Add a device to utilize the vhost-net backend driver for copy-less data transfer between guest FE and host NIC. It pins the guest user space to the host memory and provides proto_ops as sendmsg/recvmsg to vhost-net. Sorry for taking so long

RE: [RFC][PATCH v2 0/3] Provide a zero-copy method on KVM virtio-net.

2010-04-15 Thread Xin, Xiaohui
Michael, The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops as sendmsg/recvmsg to vhost-net to send/recv directly to/from the

RE: [RFC][PATCH v2 0/3] Provide a zero-copy method on KVM virtio-net.

2010-04-06 Thread Xin, Xiaohui
Sridhar, The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops as sendmsg/recvmsg to vhost-net to send/recv directly to/from the

RE: [RFC] [PATCH v2 3/3] Let host NIC driver to DMA to guest user space.

2010-04-06 Thread Xin, Xiaohui
From: Xin Xiaohui xiaohui@intel.com The patch let host NIC driver to receive user space skb, then the driver has chance to directly DMA to guest user space buffers thru single ethX interface. We want it to be more generic as a zero copy framework. Signed-off-by: Xin Xiaohui xiaohui

RE: [PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-04-06 Thread Xin, Xiaohui
Michael, For the write logging, do you have a function in hand that we can recompute the log? If that, I think I can use it to recompute the log info when the logging is suddenly enabled. For the outstanding requests, do you mean all the user buffers have submitted before the logging

RE: [PATCH 1/3] A device for zero-copy based on KVM virtio-net.

2010-04-06 Thread Xin, Xiaohui
Michael, Qemu needs a userspace write, is that a synchronous one or asynchronous one? It's a synchronous non-blocking write. Sorry, why the Qemu live migration needs the device have a userspace write? how does the write operation work? And why a read operation is not cared here? Thanks

RE: [PATCH 1/3] A device for zero-copy based on KVM virtio-net.

2010-04-05 Thread Xin, Xiaohui
Michael, For the DOS issue, I'm not sure how much the limit get_user_pages() can pin is reasonable, should we compute the bindwidth to make it? There's a ulimit for locked memory. Can we use this, decreasing the value for rlimit array? We can do this when backend is enabled and re-increment

RE: [PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-04-05 Thread Xin, Xiaohui
Michael, For the write logging, do you have a function in hand that we can recompute the log? If that, I think I can use it to recompute the log info when the logging is suddenly enabled. For the outstanding requests, do you mean all the user buffers have submitted before the logging ioctl

Re:[PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-04-01 Thread Xin Xiaohui
The vhost-net backend now only supports synchronous send/recv operations. The patch provides multiple submits and asynchronous notifications. This is needed for zero-copy case. Signed-off-by: Xin Xiaohui xiaohui@intel.com --- Michael, Now, I made vhost to alloc/destroy the kiocb

Re:[PATCH 1/3] A device for zero-copy based on KVM virtio-net.

2010-04-01 Thread Xin Xiaohui
Add a device to utilize the vhost-net backend driver for copy-less data transfer between guest FE and host NIC. It pins the guest user space to the host memory and provides proto_ops as sendmsg/recvmsg to vhost-net. Signed-off-by: Xin Xiaohui xiaohui@intel.com Signed-off-by: Zhao Yu yzha

RE: [PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-04-01 Thread Xin, Xiaohui
For the write logging, do you have a function in hand that we can recompute the log? If that, I think I can use it to recompute the log info when the logging is suddenly enabled. For the outstanding requests, do you mean all the user buffers have submitted before the logging ioctl changed?

RE: [PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-03-17 Thread Xin, Xiaohui
Michael, I don't use the kiocb comes from the sendmsg/recvmsg, since I have embeded the kiocb in page_info structure, and allocate it when page_info allocated. So what I suggested was that vhost allocates and tracks the iocbs, and passes them to your device with sendmsg/ recvmsg calls. This

Re:[PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-03-16 Thread Xin Xiaohui
The vhost-net backend now only supports synchronous send/recv operations. The patch provides multiple submits and asynchronous notifications. This is needed for zero-copy case. Signed-off-by: Xin Xiaohui xiaohui@intel.com --- Michael, I don't use the kiocb comes from the sendmsg/recvmsg

RE: [PATCH v1 2/3] Provides multiple submits and asynchronous notifications.

2010-03-15 Thread Xin, Xiaohui
+/* The structure to notify the virtqueue for async socket */ +struct vhost_notifier { +struct list_head list; +struct vhost_virtqueue *vq; +int head; +int size; +int log; +void *ctrl; +void (*dtor)(struct vhost_notifier *); +}; + So IMO, this is not the

RE: [PATCH v1 0/3] Provide a zero-copy method on KVM virtio-net.

2010-03-08 Thread Xin, Xiaohui
On Sat, Mar 06, 2010 at 05:38:35PM +0800, xiaohui@intel.com wrote: The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops as

RE: [PATCH 0/3] Provide a zero-copy method on KVM virtio-net.

2010-02-11 Thread Xin, Xiaohui
...@vger.kernel.org] On Behalf Of Xin Xiaohui Sent: Wednesday, February 10, 2010 7:49 PM To: net...@vger.kernel.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; m...@redhat.com; jd...@c2.user-mode-linux.org Subject: [PATCH 0/3] Provide a zero-copy method on KVM virtio-net. The idea is simple

[PATCH 3/3] Let host NIC driver to DMA to guest user space.

2010-02-10 Thread Xin Xiaohui
The patch let host NIC driver to receive user space skb, then the driver has chance to directly DMA to guest user space buffers thru single ethX interface. Signed-off-by: Xin Xiaohui xiaohui@intel.com Signed-off-by: Zhao Yu yzha...@gmail.com Sigend-off-by: Jeff Dike jd...@c2.user-mode

[PATCH 1/3] A device for zero-copy based on KVM virtio-net.

2010-02-10 Thread Xin Xiaohui
Add a device to utilize the vhost-net backend driver for copy-less data transfer between guest FE and host NIC. It pins the guest user space to the host memory and provides proto_ops as sendmsg/recvmsg to vhost-net. Signed-off-by: Xin Xiaohui xiaohui@intel.com Signed-off-by: Zhao Yu yzha

[PATCH 2/3] Provides multiple submits and asynchronous notifications.

2010-02-10 Thread Xin Xiaohui
The vhost-net backend now only supports synchronous send/recv operations. The patch provides multiple submits and asynchronous notifications. This is needed for zero-copy case. Signed-off-by: Xin Xiaohui xiaohui@intel.com --- drivers/vhost/net.c | 145

RE: [PATCH 1/3] A device for zero-copy based on KVM virtio-net.

2010-02-10 Thread Xin, Xiaohui
Eric, Thanks. I will look into that. But don't stop there. Please comments more. :-) Thanks Xiaohui -Original Message- From: Eric Dumazet [mailto:eric.duma...@gmail.com] Sent: Wednesday, February 10, 2010 11:18 PM To: Xin, Xiaohui Cc: net...@vger.kernel.org; kvm@vger.kernel.org; linux

RE: [PATCH 0/3] Provide a zero-copy method on KVM virtio-net.

2010-02-10 Thread Xin, Xiaohui
On Wednesday 10 February 2010, Xin Xiaohui wrote: The idea is simple, just to pin the guest VM user space and then let host NIC driver has the chance to directly DMA to it. The patches are based on vhost-net backend driver. We add a device which provides proto_ops as sendmsg/recvmsg to vhost

RE: [ANNOUNCE] KVM developer conference call

2010-01-11 Thread Xin, Xiaohui
Hi, Chris We are interested in joining the conference, since we are now working on the zero copy patch based on vhost-net. Thanks Xiaohui -Original Message- From: kvm-ow...@vger.kernel.org [mailto:kvm-ow...@vger.kernel.org] On Behalf Of Chris Wright Sent: Tuesday, January 12, 2010

RE: vhost-net patches

2009-11-02 Thread Xin, Xiaohui
Hi, Michael, What's your deferring skb allocation patch mentioned here, may you elaborate it a little more detailed? Thanks Xiaohui -Original Message- From: kvm-ow...@vger.kernel.org [mailto:kvm-ow...@vger.kernel.org] On Behalf Of Michael S. Tsirkin Sent: Tuesday, November 03, 2009

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-09-13 Thread Xin, Xiaohui
use in this function) Which qemu tree or patch do you use for kvm_irqfd and kvm_ioeventfd? Thanks Xiaohui -Original Message- From: Michael S. Tsirkin [mailto:m...@redhat.com] Sent: Sunday, September 13, 2009 1:46 PM To: Xin, Xiaohui Cc: Ira W. Snyder; net...@vger.kernel.org; virtualizat

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-09-11 Thread Xin, Xiaohui
Michael, We are very interested in your patch and want to have a try with it. I have collected your 3 patches in kernel side and 4 patches in queue side. The patches are listed here: PATCHv5-1-3-mm-export-use_mm-unuse_mm-to-modules.patch PATCHv5-2-3-mm-reduce-atomic-use-on-use_mm-fast-path.patch

RE: [RFC] Virtual Machine Device Queues(VMDq) support on KVM

2009-09-02 Thread Xin, Xiaohui
the page has been slower than copying It may be, we have not thought about this more . Thanks. Thanks Xiaohui -Original Message- From: Stephen Hemminger [mailto:shemmin...@vyatta.com] Sent: Wednesday, September 02, 2009 12:05 AM To: Xin, Xiaohui Cc: m...@redhat.com; net...@vger.kernel.org

[RFC] Virtual Machine Device Queues(VMDq) support on KVM

2009-09-01 Thread Xin, Xiaohui
[RFC] Virtual Machine Device Queues (VMDq) support on KVM Network adapter with VMDq technology presents multiple pairs of tx/rx queues, and renders network L2 sorting mechanism based on MAC addresses and VLAN tags for each tx/rx queue pair. Here we present a generic framework, in

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-09-01 Thread Xin, Xiaohui
: Arnd Bergmann [mailto:a...@arndb.de] Sent: Monday, August 31, 2009 11:24 PM To: Xin, Xiaohui Cc: m...@redhat.com; net...@vger.kernel.org; virtualizat...@lists.linux-foundation.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; linux...@kvack.org; a...@linux-foundation.org; h

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-09-01 Thread Xin, Xiaohui
-Original Message- From: Anthony Liguori [mailto:anth...@codemonkey.ws] Sent: Tuesday, September 01, 2009 5:57 AM To: Avi Kivity Cc: Xin, Xiaohui; m...@redhat.com; net...@vger.kernel.org; virtualizat...@lists.linux-foundation.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-08-31 Thread Xin, Xiaohui
Hi, Michael That's a great job. We are now working on support VMDq on KVM, and since the VMDq hardware presents L2 sorting based on MAC addresses and VLAN tags, our target is to implement a zero copy solution using VMDq. We stared from the virtio-net architecture. What we want to proposal is to

RE: [PATCHv5 3/3] vhost_net: a kernel-level virtio server

2009-08-31 Thread Xin, Xiaohui
, 2009 1:52 AM To: Xin, Xiaohui Cc: m...@redhat.com; net...@vger.kernel.org; virtualizat...@lists.linux-foundation.org; kvm@vger.kernel.org; linux-ker...@vger.kernel.org; mi...@elte.hu; linux...@kvack.org; a...@linux-foundation.org; h...@zytor.com; gregory.hask...@gmail.com Subject: Re: [PATCHv5 3