[dpdk-dev] Could virtio-net-pmd co-exist with virtio-net.ko?
Hi, Matthew, Thanks a lot, I will try it.
-Original Message-
From: Matthew Hall [mailto:mh...@mhcomputing.net]
Sent: Thursday, November 06, 2014 4:21 PM
To: GongJinrong
Cc: dev at dpdk.org
Subject: Re: [dpdk-dev] Could virtio-net-pmd co-exist with virtio-net.ko?
On Thu, Nov 06, 2014 at 10:24:11AM +0800, GongJinrong wrote:
> Hi, Guys
>
> When I run virtio-net-pmd in VM, I got "virtio-net device is
> already used by another driver" error message, after I removed the
> virtio-net.ko, it worked, but now I cannot use the virio-net driver
> for another virtual NIC, this cost that normal network
> performance(non-DPDK application) drops a lot, could the virtio-net-pmd
co-exist with standard virio-net driver?
>
> BR
> John Gong
I have no proof it will work perfectly, as I never got to use the virtio
PMDs because neither works in VirtualBox (developer-friendly / desktop
virtualization).
But there is a script included in DPDK, dpdk_nic_bind.py, which should let
you configure this more intelligently on a per-VNIC basis. You could try
something similar to this:
export RTE_SDK="${build_directory}/external/dpdk"
export RTE_TOOLS="${RTE_SDK}/tools"
export RTE_NIC_BIND="${RTE_TOOLS}/dpdk_nic_bind.py"
"${RTE_NIC_BIND}" --status | fgrep "${PCI_ID}"
"${RTE_NIC_BIND}" -b none "${PCI_ID}"
"${RTE_NIC_BIND}" -b igb_uio "${PCI_ID}"
"${RTE_NIC_BIND}" --status | fgrep "${PCI_ID}"
Good Luck!
Matthew.
[dpdk-dev] Could virtio-net-pmd co-exist with virtio-net.ko?
Hi, Guys When I run virtio-net-pmd in VM, I got "virtio-net device is already used by another driver" error message, after I removed the virtio-net.ko, it worked, but now I cannot use the virio-net driver for another virtual NIC, this cost that normal network performance(non-DPDK application) drops a lot, could the virtio-net-pmd co-exist with standard virio-net driver? BR John Gong
[dpdk-dev] How to improve the TX performance?
Hi, Guys I am using DPDK for the packet transmission, but rte_eth_tx_burst() seems drops too many packets, the NIC is 82574, anyone to help, thanks a lot. also, does DPDK has a reliable TX API for no packet drop? Best Regard John Gong
[dpdk-dev] How to use dpdk ring and mem lib in kernel level?
Thanks, Bruce, it's a good sample. -Original Message- From: Richardson, Bruce [mailto:bruce.richard...@intel.com] Sent: Monday, August 18, 2014 8:10 PM To: GongJinrong; dev at dpdk.org Subject: RE: [dpdk-dev] How to use dpdk ring and mem lib in kernel level? > -Original Message- > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of GongJinrong > Sent: Sunday, August 17, 2014 7:10 AM > To: dev at dpdk.org > Subject: [dpdk-dev] How to use dpdk ring and mem lib in kernel level? > > Hi, guys > >Can dpdk support allocate mempool and create ring in kernel level? > I know dpdk is user space driver, but many application need a channel > to transmit data from kernel to user space without any hardware > dependency(just like pf ring)? Anyone has a sample like this? > > Best Regards > John Gong Have you looked at the KNI kernel module and library, it might provide what you need? It is documented in the programmers guide, if you want to read up about it. Regards, /Bruce
[dpdk-dev] How to use dpdk ring and mem lib in kernel level?
Hi, guys Can dpdk support allocate mempool and create ring in kernel level? I know dpdk is user space driver, but many application need a channel to transmit data from kernel to user space without any hardware dependency(just like pf ring)? Anyone has a sample like this? Best Regards John Gong
[dpdk-dev] How to change the mbuf size
Thanks, Helin, I got it. -Original Message- From: Zhang, Helin [mailto:helin.zh...@intel.com] Sent: Tuesday, July 22, 2014 10:42 PM To: GongJinrong; dev at dpdk.org Subject: RE: [dpdk-dev] How to change the mbuf size Hi John No, you do not need to change the mbuf size, you just need to configure the maximum packet length and jumbo frame correctly. Of cause, if you want to put the whole packet into a mbuf, you can define size of mbuf you wanted when calling rte_mempool_create() during initialization. Regards, Helin > -Original Message- > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of GongJinrong > Sent: Tuesday, July 22, 2014 5:27 PM > To: dev at dpdk.org > Subject: [dpdk-dev] How to change the mbuf size > > Hi, guys > >I am using pmd driver to capture packets, the MTU is 8000, so I > want to change the dpdk memory block size to 8000, how can I do that? > > Best Regards > John Gong
[dpdk-dev] How to change the mbuf size
Hi, guys I am using pmd driver to capture packets, the MTU is 8000, so I want to change the dpdk memory block size to 8000, how can I do that? Best Regards John Gong
[dpdk-dev] Testing memnic for VM to VM transfer
Hi, Thomas, I cannot find the host-sim, where can I get it? -Original Message- From: dev [mailto:dev-boun...@dpdk.org] On Behalf Of GongJinrong Sent: Thursday, July 03, 2014 2:35 PM To: 'Thomas Monjalon'; 'Hiroshi Shimamoto' Cc: dev at dpdk.org Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer Thanks Thomas?I will try it^^ -Original Message- From: Thomas Monjalon [mailto:thomas.monja...@6wind.com] Sent: Wednesday, July 02, 2014 11:59 PM To: Hiroshi Shimamoto Cc: GongJinrong; dev at dpdk.org; 'John Joyce (joycej)'; Olivier MATZ Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer 2014-06-18 12:06, Hiroshi Shimamoto: > 2014-06-18 13:49, Thomas Monjalon: > > 2014-06-18 11:42, Hiroshi Shimamoto: > > > 2014-06-18 19:26, GongJinrong: > > > > Do you have any idea that how to write a host application to put > > > > the data to guest memnic PMD? > > > > > > Yes, basically I made the MEMNIC interface work with DPDK vSwitch. > > > > > > By the way, you can mmap() the shm which specified as the ivshmem > > > and put the proper data to send a packet to guest PMD. > > > I don't have time to make proper code, but can advise you; please > > > see common/memnic.h and the memory layout. > > > 1) Set magic and version in header on host. > > > 2) Initialize PMD on guest. > > > 3) Check the reset is 1 and set valid to 1, reset to 0 on host. > > > 4) Use uplink area the default block size 4K. > > > > > >Set len and fill ether frame data, then set the status to 2 on host. > > >Guest PMD may receive the packet. > > >Proceed to the next packet block. > > > > Such application should be integrated in memnic repository. > > I know Olivier wrote one which could be sent on next week. > > yeah, I just begin to feel to need such a software in the repository. I've pushed the test application (host-sim) that Olivier wrote. Feel free to improve it. I think that we could also use the PMD driver in host side with some modifications. -- Thomas
[dpdk-dev] Testing memnic for VM to VM transfer
Thanks Thomas?I will try it^^ -Original Message- From: Thomas Monjalon [mailto:thomas.monja...@6wind.com] Sent: Wednesday, July 02, 2014 11:59 PM To: Hiroshi Shimamoto Cc: GongJinrong; dev at dpdk.org; 'John Joyce (joycej)'; Olivier MATZ Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer 2014-06-18 12:06, Hiroshi Shimamoto: > 2014-06-18 13:49, Thomas Monjalon: > > 2014-06-18 11:42, Hiroshi Shimamoto: > > > 2014-06-18 19:26, GongJinrong: > > > > Do you have any idea that how to write a host application to put > > > > the data to guest memnic PMD? > > > > > > Yes, basically I made the MEMNIC interface work with DPDK vSwitch. > > > > > > By the way, you can mmap() the shm which specified as the ivshmem > > > and put the proper data to send a packet to guest PMD. > > > I don't have time to make proper code, but can advise you; please > > > see common/memnic.h and the memory layout. > > > 1) Set magic and version in header on host. > > > 2) Initialize PMD on guest. > > > 3) Check the reset is 1 and set valid to 1, reset to 0 on host. > > > 4) Use uplink area the default block size 4K. > > > > > >Set len and fill ether frame data, then set the status to 2 on host. > > >Guest PMD may receive the packet. > > >Proceed to the next packet block. > > > > Such application should be integrated in memnic repository. > > I know Olivier wrote one which could be sent on next week. > > yeah, I just begin to feel to need such a software in the repository. I've pushed the test application (host-sim) that Olivier wrote. Feel free to improve it. I think that we could also use the PMD driver in host side with some modifications. -- Thomas
[dpdk-dev] Testing memnic for VM to VM transfer
Thanks guys, I will try. -Original Message- From: Hiroshi Shimamoto [mailto:h-shimam...@ct.jp.nec.com] Sent: Wednesday, June 18, 2014 8:06 PM To: Thomas Monjalon; GongJinrong Cc: dev at dpdk.org; 'John Joyce (joycej)'; Olivier MATZ Subject: RE: [dpdk-dev] Testing memnic for VM to VM transfer Hi, > Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer > > 2014-06-18 11:42, Hiroshi Shimamoto: > > 2014-06-18 19:26, GongJinrong: > > > Do you have any idea that how to write a host application to put > > > the data to guest memnic PMD? > > > > Yes, basically I made the MEMNIC interface work with DPDK vSwitch. > > > > By the way, you can mmap() the shm which specified as the ivshmem > > and put the proper data to send a packet to guest PMD. > > I don't have time to make proper code, but can advise you; please > > see common/memnic.h and the memory layout. > > 1) Set magic and version in header on host. > > 2) Initialize PMD on guest. > > 3) Check the reset is 1 and set valid to 1, reset to 0 on host. > > 4) Use uplink area the default block size 4K. > >Set len and fill ether frame data, then set the status to 2 on host. > >Guest PMD may receive the packet. > >Proceed to the next packet block. > > Such application should be integrated in memnic repository. > I know Olivier wrote one which could be sent on next week. yeah, I just begin to feel to need such a software in the repository. thanks, Hiroshi > > -- > Thomas
[dpdk-dev] ##freemail## RE: Testing memnic for VM to VM transfer
Hi, Hiroshi Do you mean I must use DPDK vSwitch in host when I use MEMNIC PMD in guest VM? actually, I just want a channel which can put the data from host to guest quickly. Do you have any idea that how to write a host application to put the data to guest memnic PMD? -Original Message- From: Hiroshi Shimamoto [mailto:h-shimam...@ct.jp.nec.com] Sent: Wednesday, June 18, 2014 7:11 PM To: GongJinrong; 'John Joyce (joycej)'; dev at dpdk.org Subject: RE: ##freemail## RE: [dpdk-dev] Testing memnic for VM to VM transfer Hi, > Subject: ##freemail## RE: [dpdk-dev] Testing memnic for VM to VM > transfer > > Hi, Hiroshi > >I just start to learn DPDK and memnic, in memnic guide, you said > "On host, the shared memory must be initialized by an application > using memnic", I am not so clear that how to initialize the share > memory in host, do you means use posix API or DPDK API to create the > share memory?(it seems memnic guest side use rte_mbuf to transfer > data), do you have any sample code to demo how to use memnic in host? I don't have simple MEMNIC sample to use it on host. Could you please try DPDK vSwitch and enables MEMNIC vport? DPDK vSwitch must handle packets between physical NIC port and MEMNIC vport exposed to guest with dpdk.org memnic driver. thanks, Hiroshi > > -Original Message- > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Hiroshi Shimamoto > Sent: Wednesday, June 18, 2014 12:02 PM > To: John Joyce (joycej); dev at dpdk.org > Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer > > Hi, > > > Subject: [dpdk-dev] Testing memnic for VM to VM transfer > > > > Hi everyone: > > We are interested in testing the performance of the memnic > > driver > posted at http://dpdk.org/browse/memnic/refs/. > > We want to compare its performance compared to other techniques to > > transfer packets between the guest and the kernel, predominately for > > VM to > VM transfers. > > > > We have downloaded the memnic components and have got it running in > > a > guest VM. > > > > The question we hope this group might be able to help with is what > > would be the best way to processes the packets in the kernel to get > > a VM > to VM transfer. > > I think there is no kernel code work with MEMNIC. > The recommend switching software on the host is Intel DPDK vSwitch > hosted on 01.org and github. > https://github.com/01org/dpdk-ovs/tree/development > > Intel DPDK vSwitch runs on userspace not kernel. > > I introduced this mechanism to DPDK vSwitch and the guest drivers are > maintained in dpdk.org. > > thanks, > Hiroshi > > > > > A couple options might be possible > > > > > > 1. Common shared buffer between two VMs. With some utility/code to > switch TX & RX rings between the two VMs. > > > > VM1 application --- memnic --- common shared memory buffer on the > > host --- memnic --- VM2 application > > > > 2. Special purpose Kernel switching module > > > > VM1 application --- memnic --- shared memory VM1 --- Kernel > > switching module --- shared memory VM2 --- memnic --- > > VM2 application > > > > 3. Existing Kernel switching module > > > > VM1 application --- memnic --- shared memory VM1 --- existing > > Kernel switching module (e.g. OVS/linux Bridge/VETh pair) > > --- shared memory VM2 --- memnic --- VM2 application > > > > Can anyone recommend which approach might be best or easiest? We would > like to avoid writing much (or any) kernel code > > so if there are already any open source code or test utilities that > > provide one of these options or would be a good starting point to > > start > from, a pointer would be much appreciated. > > > > Thanks in advance > > > > > > John Joyce
[dpdk-dev] Testing memnic for VM to VM transfer
Hi, Hiroshi I just start to learn DPDK and memnic, in memnic guide, you said "On host, the shared memory must be initialized by an application using memnic", I am not so clear that how to initialize the share memory in host, do you means use posix API or DPDK API to create the share memory?(it seems memnic guest side use rte_mbuf to transfer data), do you have any sample code to demo how to use memnic in host? -Original Message- From: dev [mailto:dev-boun...@dpdk.org] On Behalf Of Hiroshi Shimamoto Sent: Wednesday, June 18, 2014 12:02 PM To: John Joyce (joycej); dev at dpdk.org Subject: Re: [dpdk-dev] Testing memnic for VM to VM transfer Hi, > Subject: [dpdk-dev] Testing memnic for VM to VM transfer > > Hi everyone: > We are interested in testing the performance of the memnic driver posted at http://dpdk.org/browse/memnic/refs/. > We want to compare its performance compared to other techniques to > transfer packets between the guest and the kernel, predominately for VM to VM transfers. > > We have downloaded the memnic components and have got it running in a guest VM. > > The question we hope this group might be able to help with is what > would be the best way to processes the packets in the kernel to get a VM to VM transfer. I think there is no kernel code work with MEMNIC. The recommend switching software on the host is Intel DPDK vSwitch hosted on 01.org and github. https://github.com/01org/dpdk-ovs/tree/development Intel DPDK vSwitch runs on userspace not kernel. I introduced this mechanism to DPDK vSwitch and the guest drivers are maintained in dpdk.org. thanks, Hiroshi > > A couple options might be possible > > > 1. Common shared buffer between two VMs. With some utility/code to switch TX & RX rings between the two VMs. > > VM1 application --- memnic --- common shared memory buffer on the > host --- memnic --- VM2 application > > 2. Special purpose Kernel switching module > > VM1 application --- memnic --- shared memory VM1 --- Kernel > switching module --- shared memory VM2 --- memnic --- > VM2 application > > 3. Existing Kernel switching module > > VM1 application --- memnic --- shared memory VM1 --- existing > Kernel switching module (e.g. OVS/linux Bridge/VETh pair) > --- shared memory VM2 --- memnic --- VM2 application > > Can anyone recommend which approach might be best or easiest? We would like to avoid writing much (or any) kernel code > so if there are already any open source code or test utilities that > provide one of these options or would be a good starting point to start from, a pointer would be much appreciated. > > Thanks in advance > > > John Joyce
[dpdk-dev] Can anyone help me to run the l2fwd-ivshmem example?
Thanks, Mark, the comment is really help. -Original Message- From: Gray, Mark D [mailto:mark.d.g...@intel.com] Sent: Wednesday, June 18, 2014 4:53 PM To: GongJinrong; 'Thomas Monjalon' Cc: dev at dpdk.org Subject: RE: [dpdk-dev] Can anyone help me to run the l2fwd-ivshmem example? > > Hi, > > 2014-06-18 15:56, GongJinrong: > >I want find a zero copy framework from host to vm without any > > physical NIC device, > > I think memnic is what you want: > http://dpdk.org/doc/memnic-pmd > > > it seems l2fwd-ivshmem can be used, but I have problems to run this > > example: > >1. there is no document about this example, even a simple readme :-( > >2. does this example need ovdk? > > No > > >3. can I use standard qemu to run this example? Does the standard > > qemu support ivshmem? > > You should be able to use standard Qemu. Standard QEMU will work for Memnic but not when using DPDK ivshmem. It uses the standard QEMU ivshem and doesn't use DPDK in the way you would like it to You should look at the DPDK vSwitch code to see how DPDK ivshmem is used. Basically, in the host you need to identify what objects that you want to share with the virtual machine e.g. rings, memzones >From this, you can generate a command line to pass to QEMU (with a modified ivshmem.c file - we haven't tried to upstream this yet) Then when you start a DPDK application in the guest, each of the objects that you shared from the host are also available in the guest. I presume the l2fwd-ivshmem does the same > > -- > Thomas -- Intel Shannon Limited Registered in Ireland Registered Office: Collinstown Industrial Park, Leixlip, County Kildare Registered Number: 308263 Business address: Dromore House, East Park, Shannon, Co. Clare This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
[dpdk-dev] Can anyone help me to run the l2fwd-ivshmem example?
Ok, thanks Thomas, I will try memnic. -Original Message- From: Thomas Monjalon [mailto:thomas.monja...@6wind.com] Sent: Wednesday, June 18, 2014 4:20 PM To: GongJinrong Cc: dev at dpdk.org Subject: Re: [dpdk-dev] Can anyone help me to run the l2fwd-ivshmem example? Hi, 2014-06-18 15:56, GongJinrong: >I want find a zero copy framework from host to vm without any > physical NIC device, I think memnic is what you want: http://dpdk.org/doc/memnic-pmd > it seems l2fwd-ivshmem can be used, but I have problems to run this > example: >1. there is no document about this example, even a simple readme :-( >2. does this example need ovdk? No >3. can I use standard qemu to run this example? Does the standard > qemu support ivshmem? You should be able to use standard Qemu. -- Thomas
[dpdk-dev] Can anyone help me to run the l2fwd-ivshmem example?
Hi, I want find a zero copy framework from host to vm without any physical NIC device, it seems l2fwd-ivshmem can be used, but I have problems to run this example: 1. there is no document about this example, even a simple readme :-( 2. does this example need ovdk? 3. can I use standard qemu to run this example? Does the standard qemu support ivshmem? Best Regards John Gong
[dpdk-dev] Need help to run l2fwd-ivshmem
Hugepages issue solved, but I got the this print line "EAL: No IVSHMEM configuration found!", does l2fwd-ivshmem need ovdk to create a ivshmem port? -Original Message- From: dev [mailto:dev-boun...@dpdk.org] On Behalf Of GongJinrong Sent: Tuesday, June 17, 2014 2:50 PM To: dev at dpdk.org Subject: [dpdk-dev] Need help to run l2fwd-ivshmem Hi, Can anyone give some guide about how to run l2fwd-ivshmem, I run host binary by "host -c 7 -n 3", but got "EAL: No free hugepages reported in hugepages-2048kB", how can I make l2fwd-ivshmem work? Another question, is the guest receive data from host binary? Best Regards John Gong
[dpdk-dev] Need help to run l2fwd-ivshmem
Hi, Can anyone give some guide about how to run l2fwd-ivshmem, I run host binary by "host -c 7 -n 3", but got "EAL: No free hugepages reported in hugepages-2048kB", how can I make l2fwd-ivshmem work? Another question, is the guest receive data from host binary? Best Regards John Gong
[dpdk-dev] About ivshmem
Ok, thanks a lot. -Original Message- From: Gray, Mark D [mailto:mark.d.g...@intel.com] Sent: Wednesday, June 11, 2014 6:31 PM To: GongJinrong; 'Thomas Monjalon' Cc: dev at dpdk.org Subject: RE: [dpdk-dev] About ivshmem > > Thanks, I want use DPDK, not OVDK, if I run l2fwd-ivshmem, do I use a > patched qemu or just a normal qemu? > Patched. -- Intel Shannon Limited Registered in Ireland Registered Office: Collinstown Industrial Park, Leixlip, County Kildare Registered Number: 308263 Business address: Dromore House, East Park, Shannon, Co. Clare This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
[dpdk-dev] About ivshmem
Thanks, I want use DPDK, not OVDK, if I run l2fwd-ivshmem, do I use a patched qemu or just a normal qemu? -Original Message- From: Gray, Mark D [mailto:mark.d.g...@intel.com] Sent: Wednesday, June 11, 2014 5:24 PM To: Thomas Monjalon; GongJinrong Cc: dev at dpdk.org Subject: RE: [dpdk-dev] About ivshmem > Hi, > > 2014-06-11 16:53, GongJinrong: > > I found that the ivshmem are supported in DPDK 1.6 but has no > > any document about it, how do I use ivshmem? I remember that we must > > use a patched qemu binary for enabling ivshmem support in OVDK, does > > DPDK > > 1.6 also need do this? Also, where can I find some ivshmem docs? > > If you're looking for information about OVDK, you should ask on the > appropriate mailing list. ovdk mailing List: https://lists.01.org/pipermail/dpdk-ovs/ ivshmem instructions: https://github.com/01org/dpdk-ovs/blob/development/docs/04_Sample_Configurat ions/01_IVSHM.md > > If you are looking for a PMD using ivshmem, you should look at memnic: > http://dpdk.org/doc/memnic-pmd > > -- > Thomas -- Intel Shannon Limited Registered in Ireland Registered Office: Collinstown Industrial Park, Leixlip, County Kildare Registered Number: 308263 Business address: Dromore House, East Park, Shannon, Co. Clare This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
[dpdk-dev] About ivshmem
Hi, guys I found that the ivshmem are supported in DPDK 1.6 but has no any document about it, how do I use ivshmem? I remember that we must use a patched qemu binary for enabling ivshmem support in OVDK, does DPDK 1.6 also need do this? Also, where can I find some ivshmem docs? Best Regards John Gong
[dpdk-dev] About a zero copy framework
Hi, I am trying to develop an open source guest/host zero copy communication channel framework for kvm, I found DPDK has similar module, but it seems couples with intel NICs, how can I use DPDK to do the zero copy for kvm without intel NICs(host to guest or guest to guest)? I only need a data channel framework. Best Regards Jinrong Gong
