Hello, We (OPNFV-VSPERF) are working container networking performance testing. As part of this we are testing Userspace CNI with VPP. The Pod runs a dpdk l2fwd application. We are stuck with a forwarding issue, and any suggestion would be extremely helpful. I checked with CNI team, and they see no issues.
I have provided the summary here. All the details (vpp configuration, version, l2fwd run in pod, patch-info, interface info, statistics, pod-interface-stats, failed-scenarios, etc) can be found here - https://github.com/opensource-tnbt/cnb/blob/master/vpp-forwarding-issue.md We have a very simple 2-node setup. The 2 nodes are connect directly by 2 10-gig interfaces for data traffic. On one node we have T-Rex Running, whereas on the other node we have VPP and DPDK-pod running. So, the traffic will flow like this: Direction1: Trex0-phy ---> TenGigabitEthernet6/0/0 ---> memif1/0 ---> net_memif1 DPDK l2fwd app in pod: net_memif1 ---> net_memif2 Trex1-phy <--- TenGigabitEthernet6/0/1 <--- memif2/0 <--- net_memif2 Direction2: Trex0-phy ---> TenGigabitEthernet6/0/0 ---> memif2/0 ---> net_memif2 DPDK l2fwd app in pod: net_memif2 ---> net_memif1 Trex1-phy <--- TenGigabitEthernet6/0/1 <--- memif1/0 <--- net_memif1 L2pathes are configured Direction:1 sudo vppctl test l2patch rx TenGigabitEthernet6/0/0 tx memif1/0 sudo vppctl test l2patch rx memif2/0 tx TenGigabitEthernet6/0/1 Direction:2 sudo vppctl test l2patch rx TenGigabitEthernet6/0/1 tx memif2/0 sudo vppctl test l2patch rx memif1/0 tx TenGigabitEthernet6/0/0 When The traffic runs, All the traffic somehow ends up only on memif1/0 - like this: vpp# show interface Name Idx State MTU (L3/IP4/IP6/MPLS) Counter Count TenGigabitEthernet6/0/0 1 up 9000/0/0/0 rx packets 70598102 rx bytes 79993565352 tx packets 616631302 tx bytes 696194649320 tx-error 458997285 TenGigabitEthernet6/0/1 2 up 9000/0/0/0 rx packets 70587607 rx bytes 79981831588 local0 0 down 0/0/0/0 memif1/0 3 up 9000/0/0/0 rx packets 616631302 rx bytes 696194649320 tx packets 70598102 tx bytes 79993565352 memif2/0 4 up 9000/0/0/0 tx packets 70587607 tx bytes 79981831588 We have tried the following (The outputs of all these are in the link above). 1. Testing 1-Direction at a time. 2. Swapping the Phy -> memif mapping in the patch 3. Using Xconnect instead of l2patch. 4. Changing the mode from Interface to bridge in CNI. None of these helped to debug the issue. Looking forward for an advice. Cheers, Sridhar
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#16836): https://lists.fd.io/g/vpp-dev/message/16836 Mute This Topic: https://lists.fd.io/mt/75152055/21656 Group Owner: [email protected] Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
