Hi Kevin,By core mask i meant -c command line argument. Following is the command i used to run ovs on the host
ovs-vswitchd --dpdk -c 100 -n 4 --socket-mem 2048,0 -- unix:/usr/local/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfile:info --mlockall --no-chdir --log-file=/var/log/openvswitch/ovs-vswitchd.log --pidfile=/var/run/openvswitch/ovs-vswitchd.pid --detach --monitor Moreover, VM is pinned with the cores. Following is the libvirt tag i used: <cputune> <vcpupin vcpu='0' cpuset='4'/> <vcpupin vcpu='1' cpuset='28'/> <vcpupin vcpu='2' cpuset='6'/> <vcpupin vcpu='3' cpuset='30'/> </cputune> <numatune> <memory mode='preferred' nodeset='0'/> </numatune> My VM and ovs-dpdk are running on seperate cores.VM on cores 4,28,6,30ovs on core 8 RegardsHaris Tanvir > From: [email protected] > To: [email protected]; [email protected] > Subject: RE: [ovs-discuss] OVS-dpdk Packet Error for rate beyond 1MPPS > Date: Tue, 1 Dec 2015 10:52:33 +0000 > > > -----Original Message----- > > From: discuss [mailto:[email protected]] On Behalf Of haris > > tanvir > > Sent: Sunday, November 29, 2015 1:00 PM > > To: [email protected] > > Subject: [ovs-discuss] OVS-dpdk Packet Error for rate beyond 1MPPS > > > > Hi, > > I have configured OVS on a host with dpdk. I have created a net-dev type > > bridge and assigned one physical port and one vhost user ports to it.Then, I > > have created a VM using libvirt and assigned vhost user port to the VM. I am > > running dpdk L2 Forward Application inside VM (using dpdk poll mode driver). > > > > I have another machine which as has Packet-gen dpdk running on a host. > > > > When I send Traffic from Virtual Machine to the VM through dpdk at rate > > 1Million packet per second(64byte packet), L2 forward in the VM just works > > fine with zero drop rate. However, when I go beyond 1Million Packet per > > second from packet gen, i see packet errors in OVS physical ports, and as a > > result any additional packets above 1MPPS does not reach VM. Please do let > > me know why I am facing this issue. > > > > OVS OUTPUT: > > ovs-ofctl dump-ports br0 > > OFPST_PORT reply (xid=0x2): 3 ports > > port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0 > > tx pkts=292126777, bytes=17527676820, drop=0, errs=0, coll=0 > > port 1: rx pkts=4917972248, bytes=333253670655, drop=0, errs=7153546496, > > frame=0, over=0, crc=0 > > tx pkts=4917673320, bytes=333233296044, drop=0, errs=0, coll=0 > > port 2: rx pkts=4917673320, bytes=?, drop=?, errs=?, frame=?, over=?, > > crc=? > > tx pkts=4917967282, bytes=?, drop=287, errs=?, coll=? > > > > > > LIBVIRT TAG to create VM: > > <interface type='vhostuser'> > > <mac address='52:54:00:3b:83:1a'/> > > <source type='unix' path='/usr/local/var/run/openvswitch/dpdkvhost0' > > mode='client'/> > > <model type='virtio'/> > > <driver> > > <host csum='off' gso='off' tso4='off' tso6='off' ecn='off' > > ufo='off'/> > > <guest csum='off' tso4='off' tso6='off' ecn='off' ufo='off'/> > > </driver> > > <address type='pci' domain='0x0000' bus='0x00' slot='0x07' > > function='0x0'/> > > </interface> > > > > OVS performance parameters: > > coremask = 0x100 (2 sibling cores) for the OVS on host > > Which coremask? -c command line arg or pmd-cpu-mask ? > > Have a look with top and check that the forwarding in the guest and pmd are > not on the same core. Also, have a look at PMD affinitization > in the performance tuning section. > https://github.com/openvswitch/ovs/blob/master/INSTALL.DPDK.md#performance-tuning > > > > Hugepage=1024Kb for OVS in host > > coremask =0x3(1 logical core) for Dpdk L2 Fwd in guest > > > > Regards > > Haris Tanvir
_______________________________________________ discuss mailing list [email protected] http://openvswitch.org/mailman/listinfo/discuss
