Hello OVS/DPDK team,
I am using OVS+DPDK for some of my work and using 2.12.90 and 18.11.2
versions respectively. I ran some performance tests (iperf3 for TCP and
UDP) on a c5 4xlarge AWS instance. I am supposed to get 10Gbps, however,
for TCP streams I get 2.4Gbps and UDP < 1Gbps.
Ethernet device is AWS ENA so I am using ENA PMD driver from 18.11.2.
Some output from OVS are shown below. Kindly let me know what other stats I
can look for to debug this issue.
*ovs-vsctl show*
6a4ac8cb-295e-4312-8f64-81ad0f3f6a3e
Bridge br0
datapath_type: netdev
Port br0
Interface br0
type: internal
Port dpdk-eth0
Interface dpdk-eth0
type: dpdk
options: {dpdk-devargs="0000:00:06.0", n_rxq_desc="1024",
n_txq_desc="1024"}
ovs_version: "2.12.90"
*ovs-appctl dpif-netdev/pmd-rxq-show*
pmd thread numa_id 0 core_id 4:
isolated : false
pmd thread numa_id 0 core_id 5:
isolated : false
pmd thread numa_id 0 core_id 6:
isolated : false
port: dpdk-eth0 queue-id: 0 (enabled) pmd usage: 0 %
pmd thread numa_id 0 core_id 7:
isolated : false
root@c5ravi-vcpe2nic-01-beta:/home/rkerur/ovs# *cat /proc/cmdline *
BOOT_IMAGE=/boot/vmlinuz-4.15.0-55-generic
root=UUID=2fb8bdd8-490f-412e-85fa-7e93741d9b9f ro audit=1 nofb console=tty0
console=ttyS0 net.ifnames=0 biosdevname=0 audit=1 clocksource=tsc
isolcpus=4-15 nohz_full=4-15 rcu_nocbs=4-15 intel_pstate=disable iommu=pt
intel_iommu=on default_hugepagesz=1G hugepagesz=1G hugepages=16
ovs-appctl dpif-netdev/pmd-stats-show
pmd thread numa_id 0 core_id 4:
packets received: 0
packet recirculations: 0
avg. datapath passes per packet: 0.00
emc hits: 0
smc hits: 0
megaflow hits: 0
avg. subtable lookups per megaflow hit: 0.00
miss with success upcall: 0
miss with failed upcall: 0
avg. packets per output batch: 0.00
pmd thread numa_id 0 core_id 5:
packets received: 0
packet recirculations: 0
avg. datapath passes per packet: 0.00
emc hits: 0
smc hits: 0
megaflow hits: 0
avg. subtable lookups per megaflow hit: 0.00
miss with success upcall: 0
miss with failed upcall: 0
avg. packets per output batch: 0.00
pmd thread numa_id 0 core_id 6:
packets received: 8147132
packet recirculations: 0
avg. datapath passes per packet: 1.00
emc hits: 8144921
smc hits: 0
megaflow hits: 2190
avg. subtable lookups per megaflow hit: 1.14
miss with success upcall: 21
miss with failed upcall: 0
avg. packets per output batch: 1.00
idle cycles: 2282313484912 (91.98%)
processing cycles: 199103025970 (8.02%)
avg cycles per packet: 304575.46 (2481416510882/8147132)
avg processing cycles per packet: 24438.42 (199103025970/8147132)
pmd thread numa_id 0 core_id 7:
packets received: 0
packet recirculations: 0
avg. datapath passes per packet: 0.00
emc hits: 0
smc hits: 0
megaflow hits: 0
avg. subtable lookups per megaflow hit: 0.00
miss with success upcall: 0
miss with failed upcall: 0
avg. packets per output batch: 0.00
main thread:
packets received: 4059807
packet recirculations: 0
avg. datapath passes per packet: 1.00
emc hits: 4059017
smc hits: 0
megaflow hits: 769
avg. subtable lookups per megaflow hit: 1.29
miss with success upcall: 21
miss with failed upcall: 0
avg. packets per output batch: 1.00
*ovs-ofctl dump-ports-desc br0*
OFPST_PORT_DESC reply (xid=0x2):
1(dpdk-eth0): addr:02:aa:d6:8d:9b:b0
config: 0
state: 0
speed: 0 Mbps now, 0 Mbps max
LOCAL(br0): addr:02:aa:d6:8d:9b:b0
config: 0
state: 0
current: 10MB-FD COPPER
speed: 10 Mbps now, 0 Mbps max
root@c5ravi-vcpe2nic-01-beta:/home/rkerur/ovs# *ovs-ofctl dump-ports br0*
OFPST_PORT reply (xid=0x2): 2 ports
port LOCAL: rx pkts=24942892, bytes=1679652210, drop=0, errs=0, frame=0,
over=0, crc=0
tx pkts=50260268, bytes=424185450648, drop=0, errs=0, coll=0
port "dpdk-eth0": rx pkts=14510973, bytes=123910211476, drop=0, errs=0,
frame=?, over=?, crc=?
tx pkts=7304661, bytes=482290873, drop=0, errs=0, coll=?
Thanks,
Ravi
_______________________________________________
dev mailing list
d...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-dev
